2020-09-08T15:05:04.671 INFO:root:teuthology version: 1.0.0-55bd2dc 2020-09-08T15:05:04.674 DEBUG:teuthology.run:Teuthology command: teuthology --lock --block --owner scheduled_kchai@teuthology --description rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd} --verbose --archive /home/teuthworker/archive/kchai-2020-09-08_12:29:35-rados-wip-kefu-testing-2020-09-08-0934-distro-basic-smithi/5417834 --name kchai-2020-09-08_12:29:35-rados-wip-kefu-testing-2020-09-08-0934-distro-basic-smithi -- /tmp/teuthology-worker.9r6aefq5.tmp 2020-09-08T15:05:04.695 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-09-08T15:05:04.751 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/kchai-2020-09-08_12:29:35-rados-wip-kefu-testing-2020-09-08-0934-distro-basic-smithi/5417834 branch: wip-kefu-testing-2020-09-08-0934 description: rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd} email: tchaikov@gmail.com first_in_suite: false job_id: '5417834' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: kchai-2020-09-08_12:29:35-rados-wip-kefu-testing-2020-09-08-0934-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: rhel os_version: '8.1' overrides: admin_socket: branch: wip-kefu-testing-2020-09-08-0934 ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: dce4d291bd4243c9802c17d67b85a6da6bbc0f8f ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: dce4d291bd4243c9802c17d67b85a6da6bbc0f8f selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-kefu-testing-2020-09-08-0934 sha1: dce4d291bd4243c9802c17d67b85a6da6bbc0f8f owner: scheduled_kchai@teuthology priority: 90 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 sha1: dce4d291bd4243c9802c17d67b85a6da6bbc0f8f sleep_before_teardown: 0 suite: rados suite_branch: wip-kefu-testing-2020-09-08-0934 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-09-08-0934/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: dce4d291bd4243c9802c17d67b85a6da6bbc0f8f tasks: - install: null - workunit: basedir: qa/standalone clients: all: - osd teuthology_branch: master timestamp: 2020-09-08_12:29:35 tube: smithi user: kchai verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.29917 2020-09-08T15:05:04.752 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-09-08-0934/qa; will attempt to use it 2020-09-08T15:05:04.753 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-09-08-0934/qa/tasks 2020-09-08T15:05:04.753 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-09-08T15:05:04.756 INFO:teuthology.task.internal:Checking packages... 2020-09-08T15:05:04.785 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'basic' and ceph hash 'dce4d291bd4243c9802c17d67b85a6da6bbc0f8f' 2020-09-08T15:05:04.786 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-09-08T15:05:04.786 INFO:teuthology.packaging:ref: None 2020-09-08T15:05:04.787 INFO:teuthology.packaging:tag: None 2020-09-08T15:05:04.787 INFO:teuthology.packaging:branch: wip-kefu-testing-2020-09-08-0934 2020-09-08T15:05:04.787 INFO:teuthology.packaging:sha1: dce4d291bd4243c9802c17d67b85a6da6bbc0f8f 2020-09-08T15:05:04.788 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-kefu-testing-2020-09-08-0934 2020-09-08T15:05:04.959 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-5272.gdce4d291bd4 2020-09-08T15:05:04.960 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-09-08T15:05:04.967 INFO:teuthology.task.internal:no buildpackages task found 2020-09-08T15:05:04.968 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-09-08T15:05:04.997 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-09-08T15:05:04.998 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-09-08T15:05:05.054 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 1, have 0)... 2020-09-08T15:05:15.073 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 1, have 0)... 2020-09-08T15:05:25.095 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 1, have 0)... 2020-09-08T15:05:35.116 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 1, have 0)... 2020-09-08T15:05:45.143 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 1, have 0)... 2020-09-08T15:05:55.166 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 1, have 0)... 2020-09-08T15:06:05.186 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 1, have 0)... 2020-09-08T15:06:15.205 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 1, have 0)... 2020-09-08T15:06:25.224 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 1, have 0)... 2020-09-08T15:06:35.249 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 1, have 0)... 2020-09-08T15:06:45.272 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 1, have 0)... 2020-09-08T15:06:55.296 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_kchai@teuthology', 'count': 1, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/kchai-2020-09-08_12:29:35-rados-wip-kefu-testing-2020-09-08-0934-distro-basic-smithi/5417834'} 2020-09-08T15:06:55.331 DEBUG:teuthology.lock.ops:locked ubuntu@smithi065.front.sepia.ceph.com 2020-09-08T15:06:55.371 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3d667e9510>, signals=[15]) 2020-09-08T15:06:55.589 INFO:teuthology.provision.fog.smithi065:Scheduling deploy of rhel 8.1 2020-09-08T15:06:55.932 INFO:teuthology.orchestra.console:Power off smithi065 2020-09-08T15:06:55.934 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi065.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-09-08T15:06:55.991 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi065.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-09-08T15:07:00.024 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi065.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-09-08T15:07:04.150 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi065.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-09-08T15:07:04.379 INFO:teuthology.orchestra.console:Power off for smithi065 completed 2020-09-08T15:07:04.481 INFO:teuthology.orchestra.console:Power on smithi065 2020-09-08T15:07:04.481 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi065.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-09-08T15:07:04.522 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi065.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-09-08T15:07:08.556 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi065.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-09-08T15:07:12.678 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi065.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-09-08T15:07:12.894 INFO:teuthology.orchestra.console:Power on for smithi065 completed 2020-09-08T15:07:12.996 INFO:teuthology.provision.fog.smithi065:Waiting for deploy to finish 2020-09-08T15:09:44.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi065.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-09-08T15:09:53.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi065.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-09-08T15:10:02.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi065.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-09-08T15:10:11.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi065.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-09-08T15:10:20.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi065.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-09-08T15:10:29.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi065.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-09-08T15:10:38.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi065.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-09-08T15:10:47.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi065.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-09-08T15:10:56.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi065.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-09-08T15:11:28.236 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-09-08T15:11:28.240 INFO:teuthology.orchestra.run.smithi065:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-09-08T15:11:48.206 INFO:teuthology.provision.fog.smithi065:Node is ready 2020-09-08T15:11:48.207 INFO:teuthology.orchestra.run.smithi065:> hostname 2020-09-08T15:11:48.226 INFO:teuthology.orchestra.run.smithi065.stdout:smithi065.front.sepia.ceph.com 2020-09-08T15:11:48.227 INFO:teuthology.orchestra.run.smithi065:> grep smithi065.front.sepia.ceph.com /etc/hosts 2020-09-08T15:11:48.282 INFO:teuthology.orchestra.run.smithi065.stdout:172.21.15.65 smithi065.front.sepia.ceph.com smithi065 2020-09-08T15:11:48.283 INFO:teuthology.orchestra.run.smithi065:> sudo hostname smithi065 2020-09-08T15:11:48.430 INFO:teuthology.orchestra.run.smithi065:> sudo sed -i -e 's/smithi065.front.sepia.ceph.com/smithi065/g' /etc/hosts 2020-09-08T15:11:48.464 INFO:teuthology.orchestra.run.smithi065:> sudo sed -i -e 's/172.21.15.65/172.21.15.65/g' /etc/hosts 2020-09-08T15:11:48.544 INFO:teuthology.orchestra.run.smithi065:> sudo sed -i -e 's/smithi065.front.sepia.ceph.com/smithi065/g' /etc/hostname 2020-09-08T15:11:48.610 INFO:teuthology.orchestra.run.smithi065:> sudo hostname smithi065 2020-09-08T15:11:48.681 INFO:teuthology.provision.fog.smithi065:Deploy complete! 2020-09-08T15:11:48.683 DEBUG:teuthology.parallel:result is None 2020-09-08T15:11:48.797 INFO:teuthology.lock.ops:Checking smithi065.front.sepia.ceph.com 2020-09-08T15:11:48.798 INFO:teuthology.lock.ops:New key found. Updating... 2020-09-08T15:11:48.818 INFO:teuthology.lock.ops:Updating [smithi065.front.sepia.ceph.com]: set os type and version on server 2020-09-08T15:11:48.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-09-08T15:11:48.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi065.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-09-08T15:11:48.892 INFO:teuthology.orchestra.run.smithi065:> true 2020-09-08T15:11:49.060 INFO:teuthology.orchestra.run.smithi065:> uname -m 2020-09-08T15:11:49.113 INFO:teuthology.orchestra.run.smithi065.stdout:x86_64 2020-09-08T15:11:49.114 INFO:teuthology.orchestra.run.smithi065:> cat /etc/os-release 2020-09-08T15:11:49.168 INFO:teuthology.orchestra.run.smithi065.stdout:NAME="Red Hat Enterprise Linux" 2020-09-08T15:11:49.168 INFO:teuthology.orchestra.run.smithi065.stdout:VERSION="8.1 (Ootpa)" 2020-09-08T15:11:49.168 INFO:teuthology.orchestra.run.smithi065.stdout:ID="rhel" 2020-09-08T15:11:49.169 INFO:teuthology.orchestra.run.smithi065.stdout:ID_LIKE="fedora" 2020-09-08T15:11:49.169 INFO:teuthology.orchestra.run.smithi065.stdout:VERSION_ID="8.1" 2020-09-08T15:11:49.169 INFO:teuthology.orchestra.run.smithi065.stdout:PLATFORM_ID="platform:el8" 2020-09-08T15:11:49.171 INFO:teuthology.orchestra.run.smithi065.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-09-08T15:11:49.171 INFO:teuthology.orchestra.run.smithi065.stdout:ANSI_COLOR="0;31" 2020-09-08T15:11:49.171 INFO:teuthology.orchestra.run.smithi065.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-09-08T15:11:49.172 INFO:teuthology.orchestra.run.smithi065.stdout:HOME_URL="https://www.redhat.com/" 2020-09-08T15:11:49.172 INFO:teuthology.orchestra.run.smithi065.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-09-08T15:11:49.172 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:11:49.173 INFO:teuthology.orchestra.run.smithi065.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-09-08T15:11:49.173 INFO:teuthology.orchestra.run.smithi065.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-09-08T15:11:49.173 INFO:teuthology.orchestra.run.smithi065.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-09-08T15:11:49.173 INFO:teuthology.orchestra.run.smithi065.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-09-08T15:11:49.175 INFO:teuthology.lock.ops:Updating smithi065.front.sepia.ceph.com on lock server 2020-09-08T15:11:49.196 INFO:teuthology.task.internal.lock_machines:1 smithi machines locked this try, 1/1 locked so far 2020-09-08T15:11:49.219 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi065.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWmLss67wqycc7b3NKzj70tMfrUOjVwupBa5jW9wDqxUoA9kVUAw/5Aa9HJUB71zXQURkCXidsPPUF1D4D7XBOF4Z3rKQ5hA9wttIUQQT/XUg3YLIZOKN0Kpwke5G+v3Sg4H/PbVYl5foaI700mlsB26pAyO7bZG+h8AnOnuM/oQPhzjtYpOBM7rZw7X3Nz99KXeiLFXFBZHDhvTSxdYoS8z1hTAWmS9TRIaMkU2uj26JiRgo2aGYwkWtIo3i6pmZZXC00Mh+9qjaoCIk0Ddyx7YGddeTTWPldoASjj6BZ+lheR+bERrr8vVuC8MqikB+2XGWu/mq2OCe0Hux2g0G7QJlXPAL7R3GQFnMjWAhjNWhcCFaVwfDh4OzdqrSqcaDco8lu6cDMYLu/AkbaeeLDfuYB4hNseQTBvMukf4q/+KBbourwkyr7ZdgMel/dIyP/lD9ko0y1mlKH49V35Tw0to/F0/sQnHuckCLohtZtPtBGioUuvZJpR9xJBE08nDc= 2020-09-08T15:11:49.220 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-09-08T15:11:49.274 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-09-08T15:11:49.286 INFO:teuthology.task.internal:Saving configuration 2020-09-08T15:11:49.295 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-09-08T15:11:49.309 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-09-08T15:11:49.325 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-09-08 15:06:55.315447', 'description': '/home/teuthworker/archive/kchai-2020-09-08_12:29:35-rados-wip-kefu-testing-2020-09-08-0934-distro-basic-smithi/5417834', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOvreIXeirqKaAVf4tCNaS4zsS3x0sULGRLCYyYZGnzHXtPPUCAbkMc+alfgyPkMJrijJ7RHlgHzmDXqxSnsGAk=', 'os_version': '8.1', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi065.front.sepia.ceph.com'} 2020-09-08T15:11:49.326 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-09-08T15:11:49.336 INFO:teuthology.task.internal:roles: ubuntu@smithi065.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2020-09-08T15:11:49.337 INFO:teuthology.run_tasks:Running task console_log... 2020-09-08T15:11:49.379 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3d692da268>, signals=[15]) 2020-09-08T15:11:49.381 INFO:teuthology.run_tasks:Running task internal.connect... 2020-09-08T15:11:49.394 INFO:teuthology.task.internal:Opening connections... 2020-09-08T15:11:49.395 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi065.front.sepia.ceph.com 2020-09-08T15:11:49.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi065.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-09-08T15:11:49.480 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-09-08T15:11:49.491 INFO:teuthology.orchestra.run.smithi065:> uname -m 2020-09-08T15:11:49.648 INFO:teuthology.orchestra.run.smithi065.stdout:x86_64 2020-09-08T15:11:49.649 INFO:teuthology.orchestra.run.smithi065:> cat /etc/os-release 2020-09-08T15:11:49.704 INFO:teuthology.orchestra.run.smithi065.stdout:NAME="Red Hat Enterprise Linux" 2020-09-08T15:11:49.704 INFO:teuthology.orchestra.run.smithi065.stdout:VERSION="8.1 (Ootpa)" 2020-09-08T15:11:49.704 INFO:teuthology.orchestra.run.smithi065.stdout:ID="rhel" 2020-09-08T15:11:49.705 INFO:teuthology.orchestra.run.smithi065.stdout:ID_LIKE="fedora" 2020-09-08T15:11:49.705 INFO:teuthology.orchestra.run.smithi065.stdout:VERSION_ID="8.1" 2020-09-08T15:11:49.705 INFO:teuthology.orchestra.run.smithi065.stdout:PLATFORM_ID="platform:el8" 2020-09-08T15:11:49.705 INFO:teuthology.orchestra.run.smithi065.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-09-08T15:11:49.706 INFO:teuthology.orchestra.run.smithi065.stdout:ANSI_COLOR="0;31" 2020-09-08T15:11:49.706 INFO:teuthology.orchestra.run.smithi065.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-09-08T15:11:49.706 INFO:teuthology.orchestra.run.smithi065.stdout:HOME_URL="https://www.redhat.com/" 2020-09-08T15:11:49.707 INFO:teuthology.orchestra.run.smithi065.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-09-08T15:11:49.707 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:11:49.707 INFO:teuthology.orchestra.run.smithi065.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-09-08T15:11:49.708 INFO:teuthology.orchestra.run.smithi065.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-09-08T15:11:49.708 INFO:teuthology.orchestra.run.smithi065.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-09-08T15:11:49.708 INFO:teuthology.orchestra.run.smithi065.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-09-08T15:11:49.709 INFO:teuthology.lock.ops:Updating smithi065.front.sepia.ceph.com on lock server 2020-09-08T15:11:49.732 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-09-08T15:11:49.768 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-09-08T15:11:49.786 INFO:teuthology.task.internal:Checking for old test directory... 2020-09-08T15:11:49.787 INFO:teuthology.orchestra.run.smithi065:> test '!' -e /home/ubuntu/cephtest 2020-09-08T15:11:49.801 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-09-08T15:11:49.939 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-09-08T15:11:49.940 INFO:teuthology.orchestra.run.smithi065:> test -z $(ls -A /var/lib/ceph) 2020-09-08T15:11:49.974 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-09-08T15:11:50.036 INFO:teuthology.run_tasks:Running task kernel... 2020-09-08T15:11:50.104 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}} 2020-09-08T15:11:50.105 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2020-09-08T15:11:50.105 INFO:teuthology.orchestra.run.smithi065:> uname -r 2020-09-08T15:11:50.120 INFO:teuthology.orchestra.run.smithi065.stdout:4.18.0-193.el8.x86_64 2020-09-08T15:11:50.121 INFO:teuthology.task.kernel:Running kernel on smithi065: 4.18.0-193.el8.x86_64 2020-09-08T15:11:50.121 INFO:teuthology.orchestra.run.smithi065:> sudo yum install -y kernel 2020-09-08T15:11:52.130 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:11:52.135 INFO:teuthology.orchestra.run.smithi065.stdout:Unable to read consumer identity 2020-09-08T15:11:52.497 INFO:teuthology.orchestra.run.smithi065.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-09-08T15:11:53.967 INFO:teuthology.orchestra.run.smithi065.stdout:Copr repo for ceph-el8 owned by ktdreyer 1.2 kB/s | 257 B 00:00 2020-09-08T15:11:54.368 INFO:teuthology.orchestra.run.smithi065.stdout:Extra Packages for Enterprise Linux 22 MB/s | 8.0 MB 00:00 2020-09-08T15:11:56.148 INFO:teuthology.orchestra.run.smithi065.stdout:lab-extras 3.6 MB/s | 21 kB 00:00 2020-09-08T15:11:56.496 INFO:teuthology.orchestra.run.smithi065.stderr:Modular dependency problem: 2020-09-08T15:11:56.497 INFO:teuthology.orchestra.run.smithi065.stderr: 2020-09-08T15:11:56.497 INFO:teuthology.orchestra.run.smithi065.stderr: Problem: conflicting requests 2020-09-08T15:11:56.497 INFO:teuthology.orchestra.run.smithi065.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-09-08T15:11:56.722 INFO:teuthology.orchestra.run.smithi065.stdout:Package kernel-4.18.0-193.el8.x86_64 is already installed. 2020-09-08T15:11:56.723 INFO:teuthology.orchestra.run.smithi065.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-09-08T15:11:56.813 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:11:56.814 INFO:teuthology.orchestra.run.smithi065.stdout:Nothing to do. 2020-09-08T15:11:56.814 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:11:57.003 INFO:teuthology.orchestra.run.smithi065:> echo no | sudo yum reinstall kernel || true 2020-09-08T15:11:57.356 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:11:57.357 INFO:teuthology.orchestra.run.smithi065.stdout:Unable to read consumer identity 2020-09-08T15:11:57.441 INFO:teuthology.orchestra.run.smithi065.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-09-08T15:11:57.617 INFO:teuthology.orchestra.run.smithi065.stdout:Last metadata expiration check: 0:00:01 ago on Tue 08 Sep 2020 03:11:56 PM UTC. 2020-09-08T15:11:57.648 INFO:teuthology.orchestra.run.smithi065.stderr:Modular dependency problem: 2020-09-08T15:11:57.648 INFO:teuthology.orchestra.run.smithi065.stderr: 2020-09-08T15:11:57.649 INFO:teuthology.orchestra.run.smithi065.stderr: Problem: conflicting requests 2020-09-08T15:11:57.649 INFO:teuthology.orchestra.run.smithi065.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-09-08T15:11:57.741 INFO:teuthology.orchestra.run.smithi065.stdout:Installed package kernel-4.18.0-193.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-09-08T15:11:57.742 INFO:teuthology.orchestra.run.smithi065.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-09-08T15:11:57.816 INFO:teuthology.orchestra.run.smithi065.stderr:Error: No packages marked for reinstall. 2020-09-08T15:11:57.891 INFO:teuthology.orchestra.run.smithi065:> sudo yum reinstall -y kernel || true 2020-09-08T15:11:58.245 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:11:58.245 INFO:teuthology.orchestra.run.smithi065.stdout:Unable to read consumer identity 2020-09-08T15:11:58.287 INFO:teuthology.orchestra.run.smithi065.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-09-08T15:11:58.460 INFO:teuthology.orchestra.run.smithi065.stdout:Last metadata expiration check: 0:00:02 ago on Tue 08 Sep 2020 03:11:56 PM UTC. 2020-09-08T15:11:58.491 INFO:teuthology.orchestra.run.smithi065.stderr:Modular dependency problem: 2020-09-08T15:11:58.491 INFO:teuthology.orchestra.run.smithi065.stderr: 2020-09-08T15:11:58.491 INFO:teuthology.orchestra.run.smithi065.stderr: Problem: conflicting requests 2020-09-08T15:11:58.491 INFO:teuthology.orchestra.run.smithi065.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-09-08T15:11:58.646 INFO:teuthology.orchestra.run.smithi065.stdout:Installed package kernel-4.18.0-193.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-09-08T15:11:58.647 INFO:teuthology.orchestra.run.smithi065.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-09-08T15:11:58.731 INFO:teuthology.orchestra.run.smithi065.stderr:Error: No packages marked for reinstall. 2020-09-08T15:11:58.797 INFO:teuthology.orchestra.run.smithi065:> rpm -q kernel --last | head -n 1 2020-09-08T15:11:58.865 INFO:teuthology.orchestra.run.smithi065.stdout:kernel-4.18.0-193.el8.x86_64 Sun 10 May 2020 01:56:55 PM UTC 2020-09-08T15:11:58.865 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-193.el8.x86_64 2020-09-08T15:11:58.866 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-09-08T15:11:58.866 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-09-08T15:11:58.867 INFO:teuthology.orchestra.run.smithi065:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-09-08T15:11:58.922 INFO:teuthology.orchestra.run.smithi065.stdout:ttyS1 2020-09-08T15:11:58.932 INFO:teuthology.run_tasks:Running task internal.base... 2020-09-08T15:11:58.944 INFO:teuthology.task.internal:Creating test directory... 2020-09-08T15:11:58.945 INFO:teuthology.orchestra.run.smithi065:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-09-08T15:11:58.987 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-09-08T15:11:58.997 INFO:teuthology.run_tasks:Running task internal.archive... 2020-09-08T15:11:59.011 INFO:teuthology.task.internal:Creating archive directory... 2020-09-08T15:11:59.013 INFO:teuthology.orchestra.run.smithi065:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-09-08T15:11:59.051 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-09-08T15:11:59.062 INFO:teuthology.task.internal:Enabling coredump saving... 2020-09-08T15:11:59.062 INFO:teuthology.orchestra.run.smithi065:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-09-08T15:11:59.254 INFO:teuthology.orchestra.run.smithi065.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:11:59.271 INFO:teuthology.orchestra.run.smithi065.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:11:59.272 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-09-08T15:11:59.282 INFO:teuthology.task.internal:Configuring sudo... 2020-09-08T15:11:59.283 INFO:teuthology.orchestra.run.smithi065:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-09-08T15:11:59.315 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-09-08T15:11:59.362 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-09-08T15:11:59.362 INFO:teuthology.orchestra.run.smithi065:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-09-08T15:11:59.377 INFO:teuthology.orchestra.run.smithi065:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-09-08T15:11:59.461 INFO:teuthology.orchestra.run.smithi065:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-09-08T15:11:59.531 INFO:teuthology.orchestra.run.smithi065:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-09-08T15:11:59.580 INFO:teuthology.orchestra.run.smithi065:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-09-08T15:11:59.627 INFO:teuthology.orchestra.run.smithi065:> set -ex 2020-09-08T15:11:59.629 INFO:teuthology.orchestra.run.smithi065:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-09-08T15:11:59.681 INFO:teuthology.orchestra.run.smithi065.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-09-08T15:11:59.697 INFO:teuthology.orchestra.run.smithi065.stderr:0+1 records in 2020-09-08T15:11:59.697 INFO:teuthology.orchestra.run.smithi065.stderr:0+1 records out 2020-09-08T15:11:59.697 INFO:teuthology.orchestra.run.smithi065.stderr:152 bytes copied, 3.6391e-05 s, 4.2 MB/s 2020-09-08T15:11:59.699 INFO:teuthology.orchestra.run.smithi065:> sudo service rsyslog restart 2020-09-08T15:11:59.813 INFO:teuthology.orchestra.run.smithi065.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-09-08T15:12:00.121 INFO:teuthology.run_tasks:Running task internal.timer... 2020-09-08T15:12:00.136 INFO:teuthology.task.internal:Starting timer... 2020-09-08T15:12:00.136 INFO:teuthology.run_tasks:Running task pcp... 2020-09-08T15:12:00.157 INFO:teuthology.run_tasks:Running task selinux... 2020-09-08T15:12:00.174 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-09-08T15:12:00.175 INFO:teuthology.orchestra.run.smithi065:> sudo service auditd rotate 2020-09-08T15:12:00.240 INFO:teuthology.orchestra.run.smithi065.stdout:Rotating logs: [ OK ] 2020-09-08T15:12:00.241 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-09-08T15:12:00.242 INFO:teuthology.orchestra.run.smithi065:> /usr/sbin/getenforce 2020-09-08T15:12:00.269 INFO:teuthology.orchestra.run.smithi065.stdout:Permissive 2020-09-08T15:12:00.269 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi065.front.sepia.ceph.com': 'permissive'} 2020-09-08T15:12:00.270 INFO:teuthology.orchestra.run.smithi065:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-09-08T15:12:00.339 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-09-08T15:12:00.340 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-09-08T15:12:00.340 INFO:teuthology.orchestra.run.smithi065:> sudo /usr/sbin/setenforce permissive 2020-09-08T15:12:00.415 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-09-08T15:12:00.439 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-09-08T15:12:00.440 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-09-08T15:12:00.466 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-09-08T15:12:00.468 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi065.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-09-08T15:12:00.850 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-09-08T15:12:01.895 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-09-08T15:12:04.275 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-09-08T15:12:04.303 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:12:04 +0000 (0:00:00.082) 0:00:00.082 ***** 2020-09-08T15:12:05.847 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-09-08T15:12:05.854 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] 2020-09-08T15:12:05.956 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:12:05 +0000 (0:00:01.646) 0:00:01.729 ***** 2020-09-08T15:12:06.430 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-09-08T15:12:06.467 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:12:06 +0000 (0:00:00.513) 0:00:02.243 ***** 2020-09-08T15:12:07.064 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-09-08T15:12:07.066 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-09-08T15:12:07.110 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:12:07 +0000 (0:00:00.645) 0:00:02.888 ***** 2020-09-08T15:12:07.139 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-09-08T15:12:07.141 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:12:07.174 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:12:07 +0000 (0:00:00.064) 0:00:02.953 ***** 2020-09-08T15:12:07.656 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-09-08T15:12:07.658 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-09-08T15:12:07.700 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:12:07 +0000 (0:00:00.526) 0:00:03.479 ***** 2020-09-08T15:12:08.961 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1599577927.7214231-230101812338611/source", "state": "file", "uid": 0} 2020-09-08T15:12:09.011 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:12:09 +0000 (0:00:01.311) 0:00:04.791 ***** 2020-09-08T15:12:09.710 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtC 2020-09-08T15:12:09.712 INFO:teuthology.task.ansible.out:toHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-09-08T15:12:09.815 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** 2020-09-08T15:12:09.816 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-09-08T15:12:09.915 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-09-08T15:12:10.049 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:12:10 +0000 (0:00:01.038) 0:00:05.829 ***** 2020-09-08T15:12:10.723 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi065.front.sepia.ceph.com] 2020-09-08T15:12:10.825 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. Tuesday 08 September 2020 15:12:10 +0000 (0:00:00.775) 0:00:06.604 ***** 2020-09-08T15:12:11.504 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi065.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.272189", "end": "2020-09-08 15:12:11.471183", "rc": 0, "start": "2020-09-08 15:12:11.198994", "stderr": "", "stderr_lines": [], "stdout": "d7c0190f3c79f0107823a9b3caef24ede18680e0", "stdout_lines": ["d7c0190f3c79f0107823a9b3caef24ede18680e0"]} 2020-09-08T15:12:11.544 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:12:11 +0000 (0:00:00.718) 0:00:07.324 ***** 2020-09-08T15:12:11.776 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-09-08T15:12:11.778 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.006173", "end": "2020-09-08 15:12:11.757781", "failed_when_result": false, "rc": 0, "start": "2020-09-08 15:12:11.751608", "stderr": "", "stderr_lines": [], "stdout": "f148133fb0c07a635fda93cc17e7dcc2a5d008b7", "stdout_lines": ["f148133fb0c07a635fda93cc17e7dcc2a5d008b7"]} 2020-09-08T15:12:11.813 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:12:11 +0000 (0:00:00.268) 0:00:07.592 ***** 2020-09-08T15:12:11.845 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:12:11.896 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:12:11 +0000 (0:00:00.082) 0:00:07.675 ***** 2020-09-08T15:12:11.925 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-09-08T15:12:11.927 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:12:11.964 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:12:11 +0000 (0:00:00.068) 0:00:07.743 ***** 2020-09-08T15:12:12.005 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-09-08T15:12:12.007 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:12:12.053 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:12:12 +0000 (0:00:00.088) 0:00:07.832 ***** 2020-09-08T15:12:12.111 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:12:12.147 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:12:12 +0000 (0:00:00.092) 0:00:07.925 ***** 2020-09-08T15:12:12.191 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-09-08T15:12:12.193 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:12:12.229 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:12:12 +0000 (0:00:00.083) 0:00:08.008 ***** 2020-09-08T15:12:12.464 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* ok: [smithi065.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-09-08T15:12:12.502 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:12:12 +0000 (0:00:00.269) 0:00:08.278 ***** 2020-09-08T15:12:12.761 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-09-08T15:12:12.982 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-09-08T15:12:13.194 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-09-08T15:12:13.417 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2020-09-08T15:12:13.629 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-09-08T15:12:13.858 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-09-08T15:12:14.099 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-09-08T15:12:14.328 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-09-08T15:12:14.547 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-09-08T15:12:14.757 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-09-08T15:12:14.976 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-09-08T15:12:15.190 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-09-08T15:12:15.406 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-09-08T15:12:15.615 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-09-08T15:12:15.829 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-09-08T15:12:16.054 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-09-08T15:12:16.282 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-09-08T15:12:16.495 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-09-08T15:12:16.717 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-09-08T15:12:16.986 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-09-08T15:12:17.211 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-09-08T15:12:17.421 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-09-08T15:12:17.654 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-09-08T15:12:17.876 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-09-08T15:12:18.109 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-09-08T15:12:18.320 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-09-08T15:12:18.540 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-09-08T15:12:18.763 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-09-08T15:12:18.997 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-09-08T15:12:19.226 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-09-08T15:12:19.428 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-09-08T15:12:19.655 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-09-08T15:12:19.876 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-09-08T15:12:20.097 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-09-08T15:12:20.313 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-09-08T15:12:20.525 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-09-08T15:12:20.745 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-09-08T15:12:20.965 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-09-08T15:12:21.190 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-09-08T15:12:21.404 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-09-08T15:12:21.657 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-09-08T15:12:21.869 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-09-08T15:12:22.109 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-09-08T15:12:22.328 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-09-08T15:12:22.548 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-09-08T15:12:22.764 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-09-08T15:12:22.978 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-09-08T15:12:23.189 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-09-08T15:12:23.408 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-09-08T15:12:23.621 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-09-08T15:12:23.840 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-09-08T15:12:24.051 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-09-08T15:12:24.279 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-09-08T15:12:24.502 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-09-08T15:12:24.715 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-09-08T15:12:24.943 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-09-08T15:12:25.193 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-09-08T15:12:25.418 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-09-08T15:12:25.654 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-09-08T15:12:25.867 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-09-08T15:12:26.085 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-09-08T15:12:26.305 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-09-08T15:12:26.520 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-09-08T15:12:26.755 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-09-08T15:12:26.973 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-09-08T15:12:27.187 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-09-08T15:12:27.415 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-09-08T15:12:27.627 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-09-08T15:12:27.854 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-09-08T15:12:28.084 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-09-08T15:12:28.307 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-09-08T15:12:28.532 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-09-08T15:12:28.747 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-09-08T15:12:28.976 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-09-08T15:12:29.188 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-09-08T15:12:29.411 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-09-08T15:12:29.637 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-09-08T15:12:29.853 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-09-08T15:12:30.086 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-09-08T15:12:30.294 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-09-08T15:12:30.527 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-09-08T15:12:30.745 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-09-08T15:12:30.967 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-09-08T15:12:31.193 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-09-08T15:12:31.412 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-09-08T15:12:31.646 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-09-08T15:12:31.870 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-09-08T15:12:32.085 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-09-08T15:12:32.315 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-09-08T15:12:32.528 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-09-08T15:12:32.743 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-09-08T15:12:32.971 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-09-08T15:12:33.174 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-09-08T15:12:33.389 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-09-08T15:12:33.618 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-09-08T15:12:33.844 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-09-08T15:12:34.056 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-09-08T15:12:34.278 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-09-08T15:12:34.497 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-09-08T15:12:34.723 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-09-08T15:12:34.943 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-09-08T15:12:35.173 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-09-08T15:12:35.379 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-09-08T15:12:35.604 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-09-08T15:12:35.820 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-09-08T15:12:36.046 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-09-08T15:12:36.285 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-09-08T15:12:36.517 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-09-08T15:12:36.763 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-09-08T15:12:36.984 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-09-08T15:12:37.208 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2020-09-08T15:12:37.421 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2020-09-08T15:12:37.647 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2020-09-08T15:12:37.860 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2020-09-08T15:12:38.077 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2020-09-08T15:12:38.298 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2020-09-08T15:12:39.849 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-09-08T15:12:41.618 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "name": "prateek", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2020-09-08T15:12:42.861 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "name": "jelopez", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2020-09-08T15:12:44.108 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "name": "dcain", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2020-09-08T15:12:45.367 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "name": "sunny", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2020-09-08T15:12:46.710 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2020-09-08T15:12:48.054 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "name": "aclewett", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2020-09-08T15:12:49.338 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10109, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "name": "cblum", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10109} 2020-09-08T15:12:50.672 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10110, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10110} 2020-09-08T15:12:52.044 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10111, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10111} 2020-09-08T15:12:53.303 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10112, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10112} 2020-09-08T15:12:54.627 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10113, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10113} 2020-09-08T15:12:55.992 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10114, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "name": "kchang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10114} 2020-09-08T15:12:57.438 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10115, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "name": "vereddy", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10115} 2020-09-08T15:12:57.574 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:12:57 +0000 (0:00:45.069) 0:00:53.348 ***** 2020-09-08T15:12:57.600 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-09-08T15:12:57.638 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:12:57 +0000 (0:00:00.068) 0:00:53.417 ***** 2020-09-08T15:12:57.703 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* ok: [smithi065.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c 2020-09-08T15:12:57.706 INFO:teuthology.task.ansible.out:68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": " 2020-09-08T15:12:57.709 INFO:teuthology.task.ansible.out:ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 2020-09-08T15:12:57.710 INFO:teuthology.task.ansible.out:79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce66 2020-09-08T15:12:57.712 INFO:teuthology.task.ansible.out:8079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144 2020-09-08T15:12:57.715 INFO:teuthology.task.ansible.out:712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542 2020-09-08T15:12:57.716 INFO:teuthology.task.ansible.out:da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1 2020-09-08T15:12:57.719 INFO:teuthology.task.ansible.out:GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7c 2020-09-08T15:12:57.721 INFO:teuthology.task.ansible.out:ca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 6 2020-09-08T15:12:57.723 INFO:teuthology.task.ansible.out:4V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd 2020-09-08T15:12:57.724 INFO:teuthology.task.ansible.out:82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 9 2020-09-08T15:12:57.726 INFO:teuthology.task.ansible.out:4prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name" 2020-09-08T15:12:57.728 INFO:teuthology.task.ansible.out:: "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}]}, "changed": false} 2020-09-08T15:12:57.787 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:12:57 +0000 (0:00:00.148) 0:00:53.565 ***** 2020-09-08T15:12:59.046 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-09-08T15:12:59.048 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com -> localhost] => {"after": "d7c0190f3c79f0107823a9b3caef24ede18680e0", "attempts": 1, "before": "d7c0190f3c79f0107823a9b3caef24ede18680e0", "changed": false, "remote_url_changed": false} 2020-09-08T15:12:59.084 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:12:59 +0000 (0:00:01.297) 0:00:54.863 ***** 2020-09-08T15:12:59.481 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-09-08T15:12:59.483 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-09-08T15:12:59.810 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-09-08T15:13:00.124 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-09-08T15:13:00.436 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2020-09-08T15:13:00.438 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2020-09-08T15:13:00.766 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-09-08T15:13:01.087 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2020-09-08T15:13:01.100 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-09-08T15:13:01.418 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-09-08T15:13:01.734 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2020-09-08T15:13:02.044 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-09-08T15:13:02.059 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:02.353 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2020-09-08T15:13:02.355 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-09-08T15:13:02.673 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "a 2020-09-08T15:13:02.675 INFO:teuthology.task.ansible.out:emerson", "validate_certs": true} 2020-09-08T15:13:02.684 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:02.695 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:02.995 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-09-08T15:13:03.333 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2020-09-08T15:13:03.335 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-09-08T15:13:03.637 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-09-08T15:13:03.966 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-09-08T15:13:04.280 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2020-09-08T15:13:04.594 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-09-08T15:13:04.919 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-09-08T15:13:05.226 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-09-08T15:13:05.539 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2020-09-08T15:13:05.541 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-09-08T15:13:05.863 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2020-09-08T15:13:05.865 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-09-08T15:13:06.166 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-09-08T15:13:06.483 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-09-08T15:13:06.788 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2020-09-08T15:13:06.790 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-09-08T15:13:07.089 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-09-08T15:13:07.410 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-09-08T15:13:07.735 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-09-08T15:13:08.052 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-09-08T15:13:08.352 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-09-08T15:13:08.662 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2020-09-08T15:13:08.664 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-09-08T15:13:08.970 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-09-08T15:13:09.277 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-09-08T15:13:09.585 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-09-08T15:13:09.910 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-09-08T15:13:10.209 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-09-08T15:13:10.530 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-09-08T15:13:10.837 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-09-08T15:13:11.163 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-09-08T15:13:11.486 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-09-08T15:13:11.792 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2020-09-08T15:13:11.794 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-09-08T15:13:12.104 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2020-09-08T15:13:12.106 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-09-08T15:13:12.445 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-09-08T15:13:12.774 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-09-08T15:13:13.085 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-09-08T15:13:13.394 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2020-09-08T15:13:13.401 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-09-08T15:13:13.727 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2020-09-08T15:13:13.729 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2020-09-08T15:13:13.730 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-09-08T15:13:14.032 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-09-08T15:13:14.342 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-09-08T15:13:14.662 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-09-08T15:13:14.960 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-09-08T15:13:15.267 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-09-08T15:13:15.571 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2020-09-08T15:13:15.573 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-09-08T15:13:15.886 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-09-08T15:13:16.184 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-09-08T15:13:16.509 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2020-09-08T15:13:16.511 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2020-09-08T15:13:16.809 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-09-08T15:13:17.114 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-09-08T15:13:17.427 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2020-09-08T15:13:17.429 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-09-08T15:13:17.749 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-09-08T15:13:18.052 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-09-08T15:13:18.363 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-09-08T15:13:18.691 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-09-08T15:13:19.012 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-09-08T15:13:19.317 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-09-08T15:13:19.642 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-09-08T15:13:19.974 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-09-08T15:13:20.269 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-09-08T15:13:20.571 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-09-08T15:13:20.878 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-09-08T15:13:21.173 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-09-08T15:13:21.489 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-09-08T15:13:21.792 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-09-08T15:13:22.136 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-09-08T15:13:22.138 INFO:teuthology.task.ansible.out: 2020-09-08T15:13:22.454 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-09-08T15:13:22.775 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-09-08T15:13:23.118 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-09-08T15:13:23.440 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-09-08T15:13:23.742 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-09-08T15:13:24.062 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-09-08T15:13:24.385 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-09-08T15:13:24.682 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-09-08T15:13:24.997 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-09-08T15:13:25.303 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-09-08T15:13:25.633 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2020-09-08T15:13:25.635 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-09-08T15:13:25.937 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2020-09-08T15:13:25.939 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-09-08T15:13:26.270 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-09-08T15:13:26.576 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-09-08T15:13:26.917 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-09-08T15:13:27.209 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-09-08T15:13:27.528 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-09-08T15:13:27.881 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-09-08T15:13:28.213 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-09-08T15:13:28.518 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-09-08T15:13:28.833 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-09-08T15:13:29.162 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-09-08T15:13:29.464 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-09-08T15:13:29.772 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-09-08T15:13:30.066 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-09-08T15:13:30.368 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-09-08T15:13:30.687 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2020-09-08T15:13:30.689 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-09-08T15:13:30.983 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-09-08T15:13:31.314 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-09-08T15:13:31.620 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-09-08T15:13:31.932 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-09-08T15:13:32.270 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-09-08T15:13:32.581 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-09-08T15:13:32.892 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-09-08T15:13:33.218 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-09-08T15:13:33.515 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2020-09-08T15:13:33.825 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2020-09-08T15:13:34.134 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2020-09-08T15:13:34.441 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2020-09-08T15:13:34.744 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2020-09-08T15:13:35.051 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2020-09-08T15:13:35.358 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2020-09-08T15:13:35.673 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2020-09-08T15:13:35.987 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2020-09-08T15:13:36.308 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2020-09-08T15:13:36.625 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpb 2020-09-08T15:13:36.627 INFO:teuthology.task.ansible.out:cmjLd+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2020-09-08T15:13:36.922 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2020-09-08T15:13:37.231 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2020-09-08T15:13:37.528 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2020-09-08T15:13:37.865 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2020-09-08T15:13:38.167 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2020-09-08T15:13:38.475 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2020-09-08T15:13:38.793 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2020-09-08T15:13:38.795 INFO:teuthology.task.ansible.out: 2020-09-08T15:13:39.103 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2020-09-08T15:13:39.222 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:13:39 +0000 (0:00:40.137) 0:01:35.001 ***** 2020-09-08T15:13:39.284 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-09-08T15:13:39.290 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:39.298 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:39.308 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:39.320 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:39.331 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:39.355 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:39.664 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-09-08T15:13:39.676 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:39.677 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:39.991 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-09-08T15:13:40.297 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-09-08T15:13:40.309 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.320 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.332 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.343 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.345 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.354 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.365 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.376 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.387 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.389 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.399 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.410 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.426 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.427 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.438 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.462 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.472 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.484 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.495 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.497 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.507 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.509 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.518 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.530 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.544 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.553 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.566 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.577 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.589 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.601 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.611 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.622 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.633 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.644 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.655 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.657 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.669 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.688 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.690 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.700 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.702 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.711 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.713 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.723 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.734 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.745 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.762 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.775 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.778 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.790 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.793 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.804 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.813 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.824 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.847 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.858 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.869 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.879 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.899 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.910 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.922 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.947 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.958 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.970 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.972 INFO:teuthology.task.ansible.out: skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.982 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.994 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:40.996 INFO:teuthology.task.ansible.out: skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.005 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.007 INFO:teuthology.task.ansible.out: 2020-09-08T15:13:41.017 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.021 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.036 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.040 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.051 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.073 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.075 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.084 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.086 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.096 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.107 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.108 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.129 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.132 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.141 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.152 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.163 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.165 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.175 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.186 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.198 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.198 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.210 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.240 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.241 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.254 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.274 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.286 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.294 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.298 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.309 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.365 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:13:41 +0000 (0:00:02.144) 0:01:37.145 ***** 2020-09-08T15:13:41.409 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-09-08T15:13:41.411 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:41.461 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:13:41 +0000 (0:00:00.093) 0:01:37.238 ***** 2020-09-08T15:13:41.734 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-09-08T15:13:41.736 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-09-08T15:13:41.953 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-09-08T15:13:42.173 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-09-08T15:13:42.390 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-09-08T15:13:42.631 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-09-08T15:13:42.843 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-09-08T15:13:43.080 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-09-08T15:13:43.317 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2020-09-08T15:13:43.514 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-09-08T15:13:43.730 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-09-08T15:13:43.950 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-09-08T15:13:44.161 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-09-08T15:13:44.382 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-09-08T15:13:44.602 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-09-08T15:13:44.827 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-09-08T15:13:45.051 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-09-08T15:13:45.274 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-09-08T15:13:45.493 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-09-08T15:13:45.712 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-09-08T15:13:45.954 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-09-08T15:13:46.169 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-09-08T15:13:46.383 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-09-08T15:13:46.588 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-09-08T15:13:46.815 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-09-08T15:13:47.022 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-09-08T15:13:47.243 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-09-08T15:13:47.469 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-09-08T15:13:47.672 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-09-08T15:13:47.890 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-09-08T15:13:48.109 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-09-08T15:13:48.324 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-09-08T15:13:48.549 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-09-08T15:13:48.761 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-09-08T15:13:48.994 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-09-08T15:13:49.221 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2020-09-08T15:13:49.462 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-09-08T15:13:49.681 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-09-08T15:13:49.902 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-09-08T15:13:50.120 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-09-08T15:13:50.341 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-09-08T15:13:50.562 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-09-08T15:13:50.777 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-09-08T15:13:50.998 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-09-08T15:13:51.067 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:13:51 +0000 (0:00:09.607) 0:01:46.845 ***** 2020-09-08T15:13:51.681 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-09-08T15:13:51.683 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "checksum": "e4960b14bdbab8632f61f7e37ba0ea7d7809d19f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "e8a2fd5f594968f54ce19ace8491c379", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1599578031.0974832-81285554400364/source", "state": "file", "uid": 0} 2020-09-08T15:13:51.719 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:13:51 +0000 (0:00:00.652) 0:01:47.498 ***** 2020-09-08T15:13:51.751 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-09-08T15:13:51.753 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => { "msg": "Host smithi065.front.sepia.ceph.com is running RedHat 8.1 (Ootpa)" } 2020-09-08T15:13:51.790 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:13:51 +0000 (0:00:00.071) 0:01:47.569 ***** 2020-09-08T15:13:51.846 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-09-08T15:13:51.848 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2020-09-08T15:13:51.902 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:13:51 +0000 (0:00:00.103) 0:01:47.673 ***** 2020-09-08T15:13:51.928 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-09-08T15:13:51.930 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:51.972 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:13:51 +0000 (0:00:00.077) 0:01:47.751 ***** 2020-09-08T15:13:52.534 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-09-08T15:13:52.536 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.334004", "end": "2020-09-08 15:13:52.510904", "rc": 0, "start": "2020-09-08 15:13:52.176900", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-09-08T15:13:52.573 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:13:52 +0000 (0:00:00.600) 0:01:48.352 ***** 2020-09-08T15:13:52.617 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:52.649 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:13:52 +0000 (0:00:00.076) 0:01:48.428 ***** 2020-09-08T15:13:52.689 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-09-08T15:13:52.691 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:52.725 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:13:52 +0000 (0:00:00.076) 0:01:48.505 ***** 2020-09-08T15:13:52.767 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:52.809 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:13:52 +0000 (0:00:00.083) 0:01:48.588 ***** 2020-09-08T15:13:52.841 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-09-08T15:13:52.843 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:52.882 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:13:52 +0000 (0:00:00.073) 0:01:48.662 ***** 2020-09-08T15:13:52.923 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:13:52.959 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:13:52 +0000 (0:00:00.076) 0:01:48.738 ***** 2020-09-08T15:13:53.011 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-09-08T15:13:53.013 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2020-09-08T15:13:53.048 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:13:53 +0000 (0:00:00.089) 0:01:48.827 ***** 2020-09-08T15:13:53.126 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** ok: [smithi065.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-09-08T15:13:53.128 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-09-08T15:13:53.162 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:13:53 +0000 (0:00:00.113) 0:01:48.941 ***** 2020-09-08T15:13:53.215 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-09-08T15:13:53.216 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2020-09-08T15:13:53.256 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:13:53 +0000 (0:00:00.094) 0:01:49.035 ***** 2020-09-08T15:13:54.636 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-09-08T15:13:54.638 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1599578034.5028572-a0ci01n3/katello-ca-consumer-latest.noarchk3v6cv8b.rpm"]} 2020-09-08T15:13:54.675 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:13:54 +0000 (0:00:01.419) 0:01:50.455 ***** 2020-09-08T15:13:55.703 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-09-08T15:13:55.705 INFO:teuthology.task.ansible.out:fatal: [smithi065.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2020-09-08T15:13:55.738 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:13:55 +0000 (0:00:01.062) 0:01:51.518 ***** 2020-09-08T15:13:55.788 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** ok: [smithi065.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-09-08T15:13:55.821 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:13:55 +0000 (0:00:00.081) 0:01:51.599 ***** 2020-09-08T15:14:03.556 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** changed: [smithi065.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-09-08T15:14:03.594 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:03 +0000 (0:00:07.774) 0:01:59.374 ***** 2020-09-08T15:14:03.650 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** ok: [smithi065.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2020-09-08T15:14:03.695 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:03 +0000 (0:00:00.100) 0:01:59.474 ***** 2020-09-08T15:14:04.881 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-09-08T15:14:04.885 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.927837", "end": "2020-09-08 15:14:04.854847", "failed_when_result": false, "rc": 0, "start": "2020-09-08 15:14:03.927010", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7Server\n8\n8.0\n8.1\n8.2", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7Server", "8", "8.0", "8.1", "8.2"]} 2020-09-08T15:14:04.923 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:04 +0000 (0:00:01.226) 0:02:00.701 ***** 2020-09-08T15:14:04.965 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-09-08T15:14:04.966 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:14:05.009 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:05 +0000 (0:00:00.086) 0:02:00.788 ***** 2020-09-08T15:14:05.051 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-09-08T15:14:05.054 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:14:05.086 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:05 +0000 (0:00:00.077) 0:02:00.865 ***** 2020-09-08T15:14:05.122 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi065.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-09-08T15:14:05.163 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:05 +0000 (0:00:00.071) 0:02:00.937 ***** 2020-09-08T15:14:05.201 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-09-08T15:14:05.204 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:14:05.243 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:05 +0000 (0:00:00.085) 0:02:01.023 ***** 2020-09-08T15:14:16.139 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-09-08T15:14:16.141 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:10.656000", "end": "2020-09-08 15:14:16.112004", "rc": 0, "start": "2020-09-08 15:14:05.456004", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2020-09-08T15:14:16.179 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:16 +0000 (0:00:10.934) 0:02:11.957 ***** 2020-09-08T15:14:16.223 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ ok: [smithi065.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-09-08T15:14:16.266 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:16 +0000 (0:00:00.082) 0:02:12.040 ***** 2020-09-08T15:14:16.307 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:14:16.355 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:16 +0000 (0:00:00.091) 0:02:12.132 ***** 2020-09-08T15:14:16.394 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-09-08T15:14:16.397 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-09-08T15:14:16.432 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:16 +0000 (0:00:00.078) 0:02:12.210 ***** 2020-09-08T15:14:16.472 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-09-08T15:14:16.478 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-09-08T15:14:16.510 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:16 +0000 (0:00:00.079) 0:02:12.289 ***** 2020-09-08T15:14:20.814 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-09-08T15:14:20.816 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-09-08T15:14:20.856 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:20 +0000 (0:00:04.346) 0:02:16.636 ***** 2020-09-08T15:14:24.625 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-09-08T15:14:24.627 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:03.539445", "end": "2020-09-08 15:14:24.607462", "rc": 0, "start": "2020-09-08 15:14:21.068017", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-09-08T15:14:24.669 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:24 +0000 (0:00:03.812) 0:02:20.448 ***** 2020-09-08T15:14:25.269 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-09-08T15:14:25.271 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-09-08T15:14:25.305 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:25 +0000 (0:00:00.635) 0:02:21.084 ***** 2020-09-08T15:14:25.549 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** ok: [smithi065.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-09-08T15:14:25.583 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:25 +0000 (0:00:00.278) 0:02:21.363 ***** 2020-09-08T15:14:26.146 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** ok: [smithi065.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-09-08T15:14:26.684 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-09-08T15:14:26.721 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:26 +0000 (0:00:01.137) 0:02:22.501 ***** 2020-09-08T15:14:27.322 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi065.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-09-08T15:14:27.856 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-09-08T15:14:27.894 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:27 +0000 (0:00:01.173) 0:02:23.674 ***** 2020-09-08T15:14:27.936 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-09-08T15:14:27.938 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:14:27.977 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:27 +0000 (0:00:00.082) 0:02:23.756 ***** 2020-09-08T15:14:28.017 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-09-08T15:14:28.019 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:14:28.054 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:28 +0000 (0:00:00.077) 0:02:23.833 ***** 2020-09-08T15:14:28.086 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-09-08T15:14:28.088 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:14:28.139 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:28 +0000 (0:00:00.085) 0:02:23.919 ***** 2020-09-08T15:14:28.180 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-09-08T15:14:28.182 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:14:28.217 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:28 +0000 (0:00:00.078) 0:02:23.997 ***** 2020-09-08T15:14:28.253 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-09-08T15:14:28.255 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:14:28.298 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:28 +0000 (0:00:00.077) 0:02:24.075 ***** 2020-09-08T15:14:28.327 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-09-08T15:14:28.329 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:14:28.364 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:28 +0000 (0:00:00.068) 0:02:24.143 ***** 2020-09-08T15:14:28.410 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:14:28.449 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:28 +0000 (0:00:00.085) 0:02:24.229 ***** 2020-09-08T15:14:28.481 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-09-08T15:14:28.483 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:14:28.522 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:28 +0000 (0:00:00.069) 0:02:24.298 ***** 2020-09-08T15:14:28.552 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-09-08T15:14:28.554 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:14:28.597 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:28 +0000 (0:00:00.071) 0:02:24.369 ***** 2020-09-08T15:14:29.521 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-09-08T15:14:29.523 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.703739", "end": "2020-09-08 15:14:29.500365", "rc": 0, "start": "2020-09-08 15:14:28.796626", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-09-08T15:14:29.574 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:29 +0000 (0:00:00.983) 0:02:25.353 ***** 2020-09-08T15:14:32.250 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-09-08T15:14:32.290 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:32 +0000 (0:00:02.716) 0:02:28.070 ***** 2020-09-08T15:14:32.325 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-09-08T15:14:32.327 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:14:32.368 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:32 +0000 (0:00:00.077) 0:02:28.147 ***** 2020-09-08T15:14:32.401 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-09-08T15:14:32.402 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:14:32.438 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:32 +0000 (0:00:00.069) 0:02:28.217 ***** 2020-09-08T15:14:32.475 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:14:32.504 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:32 +0000 (0:00:00.065) 0:02:28.283 ***** 2020-09-08T15:14:32.535 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-09-08T15:14:32.537 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:14:32.572 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:32 +0000 (0:00:00.068) 0:02:28.352 ***** 2020-09-08T15:14:33.125 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-09-08T15:14:33.161 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:33 +0000 (0:00:00.588) 0:02:28.940 ***** 2020-09-08T15:14:35.473 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-09-08T15:14:35.475 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-09-08T15:14:35.517 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:35 +0000 (0:00:02.352) 0:02:31.293 ***** 2020-09-08T15:14:36.091 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-09-08T15:14:36.097 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-09-08T15:14:36.607 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-09-08T15:14:37.096 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-09-08T15:14:37.141 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:37 +0000 (0:00:01.627) 0:02:32.920 ***** 2020-09-08T15:14:37.365 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-09-08T15:14:37.402 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:37 +0000 (0:00:00.260) 0:02:33.181 ***** 2020-09-08T15:14:37.933 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi065.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-09-08T15:14:38.450 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-09-08T15:14:38.937 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-09-08T15:14:38.985 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:38 +0000 (0:00:01.583) 0:02:34.765 ***** 2020-09-08T15:14:39.035 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-09-08T15:14:39.037 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:14:39.084 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:39 +0000 (0:00:00.095) 0:02:34.860 ***** 2020-09-08T15:14:39.123 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-09-08T15:14:39.125 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-09-08T15:14:39.160 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:39 +0000 (0:00:00.079) 0:02:34.939 ***** 2020-09-08T15:14:39.396 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi065.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-09-08T15:14:39.450 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:39 +0000 (0:00:00.280) 0:02:35.221 ***** 2020-09-08T15:14:39.508 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi065.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-09-08T15:14:39.519 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-09-08T15:14:39.531 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-09-08T15:14:39.544 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-09-08T15:14:39.580 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:39 +0000 (0:00:00.139) 0:02:35.360 ***** 2020-09-08T15:14:47.459 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load", "Installed: nagios-plugins-load-2.3.3-4.el8.x86_64", "Installed: nrpe-4.0.3-1.el8.x86_64", "Installed: nagios-plugins-2.3.3-4.el8.x86_64", "Removed: nrpe-4.0.2-2.el8.x86_64", "Removed: nagios-plugins-2.3.3-1.el8.x86_64", "Removed: nagios-plugins-load-2.3.3-1.el8.x86_64"]} 2020-09-08T15:14:47.494 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:47 +0000 (0:00:07.914) 0:02:43.274 ***** 2020-09-08T15:14:47.535 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-09-08T15:14:47.536 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:14:47.579 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:47 +0000 (0:00:00.084) 0:02:43.358 ***** 2020-09-08T15:14:48.147 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-09-08T15:14:48.182 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:48 +0000 (0:00:00.603) 0:02:43.962 ***** 2020-09-08T15:14:48.730 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-09-08T15:14:48.734 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-09-08T15:14:48.768 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:48 +0000 (0:00:00.583) 0:02:44.545 ***** 2020-09-08T15:14:48.807 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-09-08T15:14:48.811 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-09-08T15:14:48.819 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-09-08T15:14:48.857 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:48 +0000 (0:00:00.090) 0:02:44.636 ***** 2020-09-08T15:14:49.081 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi065.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-09-08T15:14:49.122 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:49 +0000 (0:00:00.259) 0:02:44.896 ***** 2020-09-08T15:14:49.378 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-09-08T15:14:49.380 INFO:teuthology.task.ansible.out:fatal: [smithi065.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-09-08T15:14:49.418 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:49 +0000 (0:00:00.295) 0:02:45.192 ***** 2020-09-08T15:14:49.468 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:14:49.496 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:49 +0000 (0:00:00.083) 0:02:45.276 ***** 2020-09-08T15:14:50.138 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "md5sum": "28732085640fd0d909d798c6d3e4021a", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1599578089.5322046-1309047175866/source", "state": "file", "uid": 0} 2020-09-08T15:14:50.172 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:50 +0000 (0:00:00.675) 0:02:45.951 ***** 2020-09-08T15:14:51.025 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-09-08T15:14:51.026 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-09-08 15:14:44 UTC", "ActiveEnterTimestampMonotonic": "216904600", "ActiveExitTimestamp": "Tue 2020-09-08 15:14:44 UTC", "ActiveExitTimestampMonotonic": "216872014", "ActiveState": "active", "After": "system.slice -.mount var-run.mount basic.target tmp.mount time-sync.target systemd-journald.socket sysinit.target systemd-tmpfiles-setup.service local-fs.target network.target nss-lookup.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-09-08 15:14:44 UTC", "AssertTimestampMonotonic": "216903652", "Before": "plymouth-quit.service xdm.service getty@tty1.service shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-09-08 15:14:44 UTC", "ConditionTimestampMonotonic": "216903652", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "C 2020-09-08T15:14:51.031 INFO:teuthology.task.ansible.out:ontrolGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "16917", "ExecMainStartTimestamp": "Tue 2020-09-08 15:14:44 UTC", "ExecMainStartTimestampMonotonic": "216904564", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Tue 2020-09-08 15:14:44 UTC", "InactiveEnterTimestampMonotonic": "216902528", "InactiveExitTimestamp": "Tue 2020-09-08 15:14:44 UTC", "InactiveExitTimestampMonotonic": "216904600", "InvocationID": "8d04fcadd620468a88b90cee960282ac", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "Limi 2020-09-08T15:14:51.034 INFO:teuthology.task.ansible.out:tCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", "LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "16917", "MemoryAccounting": "yes", "MemoryCurrent": "909312", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": " 2020-09-08T15:14:51.042 INFO:teuthology.task.ansible.out:no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-09-08 15:14:44 UTC", "StateChangeTimestampMonotonic": "216904600", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-09-08 15:14:44 UTC", "WatchdogTimestampMonotonic": "216904598", "WatchdogUSec": "0"}} 2020-09-08T15:14:51.074 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:51 +0000 (0:00:00.898) 0:02:46.850 ***** 2020-09-08T15:14:51.308 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-09-08T15:14:51.310 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001754", "end": "2020-09-08 15:14:51.282998", "rc": 0, "start": "2020-09-08 15:14:51.281244", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-09-08T15:14:51.352 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:51 +0000 (0:00:00.281) 0:02:47.131 ***** 2020-09-08T15:14:53.709 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-09-08T15:14:53.751 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:14:53 +0000 (0:00:02.396) 0:02:49.527 ***** 2020-09-08T15:15:36.461 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-09-08T15:15:36.465 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted", "Installed: selinux-policy-3.14.3-41.el8_2.5.noarch", "Installed: selinux-policy-targeted-3.14.3-41.el8_2.5.noarch", "Removed: selinux-policy-3.14.3-41.el8_2.2.noarch", "Removed: selinux-policy-targeted-3.14.3-41.el8_2.2.noarch"]} 2020-09-08T15:15:36.503 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:15:36 +0000 (0:00:42.753) 0:03:32.281 ***** 2020-09-08T15:15:37.361 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-09-08T15:15:37.363 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-09-08T15:15:37.398 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:15:37 +0000 (0:00:00.895) 0:03:33.176 ***** 2020-09-08T15:15:54.804 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-09-08T15:15:54.807 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:17.169567", "end": "2020-09-08 15:15:54.785554", "failed_when_result": false, "rc": 0, "start": "2020-09-08 15:15:37.615987", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-09-08T15:15:54.847 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:15:54 +0000 (0:00:17.450) 0:03:50.627 ***** 2020-09-08T15:15:55.407 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-09-08T15:15:55.409 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-09-08T15:15:55.444 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:15:55 +0000 (0:00:00.596) 0:03:51.224 ***** 2020-09-08T15:15:55.682 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-09-08T15:15:55.684 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.012855", "end": "2020-09-08 15:15:55.660220", "rc": 0, "start": "2020-09-08 15:15:55.647365", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-09-08T15:15:55.721 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:15:55 +0000 (0:00:00.276) 0:03:51.500 ***** 2020-09-08T15:15:55.955 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-09-08T15:15:55.957 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.013438", "end": "2020-09-08 15:15:55.934915", "rc": 0, "start": "2020-09-08 15:15:55.921477", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-09-08T15:15:55.991 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:15:55 +0000 (0:00:00.270) 0:03:51.771 ***** 2020-09-08T15:16:12.987 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-09-08T15:16:12.991 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.769566", "end": "2020-09-08 15:16:12.962073", "rc": 0, "start": "2020-09-08 15:15:56.192507", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-09-08T15:16:13.024 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:13 +0000 (0:00:17.032) 0:04:08.803 ***** 2020-09-08T15:16:13.249 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-09-08T15:16:13.251 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-09-08T15:16:13.285 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:13 +0000 (0:00:00.261) 0:04:09.064 ***** 2020-09-08T15:16:13.326 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-09-08T15:16:13.328 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-09-08T15:16:13.364 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:13 +0000 (0:00:00.078) 0:04:09.143 ***** 2020-09-08T15:16:13.405 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-09-08T15:16:13.406 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-09-08T15:16:13.441 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:13 +0000 (0:00:00.077) 0:04:09.220 ***** 2020-09-08T15:16:13.493 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-09-08T15:16:13.495 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-09-08T15:16:13.538 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:13 +0000 (0:00:00.095) 0:04:09.316 ***** 2020-09-08T15:16:13.592 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi065.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-09-08T15:16:13.634 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:13 +0000 (0:00:00.091) 0:04:09.407 ***** 2020-09-08T15:16:13.861 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-09-08T15:16:13.903 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:13 +0000 (0:00:00.274) 0:04:09.682 ***** 2020-09-08T15:16:14.161 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-09-08T15:16:14.164 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2020-09-08T15:16:14.219 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:14 +0000 (0:00:00.316) 0:04:09.998 ***** 2020-09-08T15:16:14.253 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-09-08T15:16:14.255 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:14.304 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:14 +0000 (0:00:00.083) 0:04:10.082 ***** 2020-09-08T15:16:14.334 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-09-08T15:16:14.336 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:14.376 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:14 +0000 (0:00:00.073) 0:04:10.155 ***** 2020-09-08T15:16:14.613 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-09-08T15:16:14.615 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-09-08T15:16:14.651 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:14 +0000 (0:00:00.275) 0:04:10.430 ***** 2020-09-08T15:16:15.254 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-09-08T15:16:15.256 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-09-08T15:16:15.297 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:15 +0000 (0:00:00.646) 0:04:11.077 ***** 2020-09-08T15:16:15.340 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-09-08T15:16:15.342 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi065"}, "changed": false} 2020-09-08T15:16:15.398 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:15 +0000 (0:00:00.100) 0:04:11.178 ***** 2020-09-08T15:16:16.547 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-09-08T15:16:16.549 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi065", "ansible_hostname": "smithi065", "ansible_nodename": "smithi065"}, "changed": false, "name": "smithi065"} 2020-09-08T15:16:16.583 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:16 +0000 (0:00:01.184) 0:04:12.362 ***** 2020-09-08T15:16:17.116 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-09-08T15:16:17.118 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-09-08T15:16:17.176 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:17 +0000 (0:00:00.592) 0:04:12.955 ***** 2020-09-08T15:16:17.710 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-09-08T15:16:17.738 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:17 +0000 (0:00:00.561) 0:04:13.517 ***** 2020-09-08T15:16:18.614 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-09-08T15:16:18.616 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-09-08T15:16:18.682 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:18 +0000 (0:00:00.944) 0:04:14.462 ***** 2020-09-08T15:16:19.219 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-09-08T15:16:19.221 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-09-08T15:16:19.270 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:19 +0000 (0:00:00.587) 0:04:15.050 ***** 2020-09-08T15:16:19.527 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-09-08T15:16:19.529 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-09-08T15:16:19.565 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:19 +0000 (0:00:00.295) 0:04:15.345 ***** 2020-09-08T15:16:19.794 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-09-08T15:16:19.796 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-09-08T15:16:19.833 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:19 +0000 (0:00:00.266) 0:04:15.612 ***** 2020-09-08T15:16:20.085 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-09-08T15:16:20.087 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-09-08T15:16:20.126 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:20 +0000 (0:00:00.291) 0:04:15.904 ***** 2020-09-08T15:16:20.677 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-09-08T15:16:20.713 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:20 +0000 (0:00:00.588) 0:04:16.493 ***** 2020-09-08T15:16:21.280 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-09-08T15:16:21.317 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:21 +0000 (0:00:00.602) 0:04:17.095 ***** 2020-09-08T15:16:23.353 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-09-08T15:16:23.355 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.812135", "end": "2020-09-08 15:16:23.332627", "rc": 0, "start": "2020-09-08 15:16:21.520492", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-09-08T15:16:23.393 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:23 +0000 (0:00:02.077) 0:04:19.172 ***** 2020-09-08T15:16:23.429 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-09-08T15:16:23.431 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:23.473 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:23 +0000 (0:00:00.080) 0:04:19.253 ***** 2020-09-08T15:16:24.048 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-09-08T15:16:24.050 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-09-08T15:16:24.086 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:24 +0000 (0:00:00.612) 0:04:19.865 ***** 2020-09-08T15:16:24.129 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-09-08T15:16:24.163 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:24 +0000 (0:00:00.077) 0:04:19.942 ***** 2020-09-08T15:16:24.205 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-09-08T15:16:24.240 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:24 +0000 (0:00:00.076) 0:04:20.019 ***** 2020-09-08T15:16:24.281 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-09-08T15:16:24.283 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:24.318 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:24 +0000 (0:00:00.078) 0:04:20.098 ***** 2020-09-08T15:16:24.372 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-09-08T15:16:24.374 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-09-08T15:16:24.411 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:24 +0000 (0:00:00.092) 0:04:20.190 ***** 2020-09-08T15:16:24.453 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-09-08T15:16:24.455 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:24.489 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:24 +0000 (0:00:00.078) 0:04:20.269 ***** 2020-09-08T15:16:24.533 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-09-08T15:16:24.535 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:24.585 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:24 +0000 (0:00:00.095) 0:04:20.364 ***** 2020-09-08T15:16:24.640 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-09-08T15:16:24.642 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:24.676 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:24 +0000 (0:00:00.091) 0:04:20.456 ***** 2020-09-08T15:16:24.733 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-09-08T15:16:24.735 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:24.774 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:24 +0000 (0:00:00.097) 0:04:20.553 ***** 2020-09-08T15:16:25.018 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-09-08T15:16:25.020 INFO:teuthology.task.ansible.out:fatal: [smithi065.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007169", "end": "2020-09-08 15:16:24.996814", "msg": "non-zero return code", "rc": 1, "start": "2020-09-08 15:16:24.989645", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-09-08T15:16:25.055 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:25 +0000 (0:00:00.280) 0:04:20.834 ***** 2020-09-08T15:16:25.095 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:25.132 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:25 +0000 (0:00:00.077) 0:04:20.911 ***** 2020-09-08T15:16:31.191 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-09-08T15:16:31.194 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-09-08T15:16:31.231 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:31 +0000 (0:00:06.098) 0:04:27.010 ***** 2020-09-08T15:16:36.655 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-09-08T15:16:36.657 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-7.el8.x86_64", "Removed: boost-random-1.66.0-7.el8.x86_64"]} 2020-09-08T15:16:36.694 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:36 +0000 (0:00:05.463) 0:04:32.474 ***** 2020-09-08T15:16:49.721 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-09-08T15:16:49.722 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: podman-1.9.3-2.module+el8.2.1+6867+366c07d6.x86_64", "Installed: boost-program-options-1.66.0-7.el8.x86_64", "Installed: boost-random-1.66.0-7.el8.x86_64", "Installed: podman-docker-1.9.3-2.module+el8.2.1+6867+366c07d6.noarch", "Installed: qemu-kvm-core-15:2.12.0-99.module+el8.2.0+6870+55b789b4.2.x86_64", "Installed: qemu-kvm-common-15:2.12.0-99.module+el8.2.0+6870+55b789b4.2.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-99.module+el8.2.0+6870+55b789b4.2.x86_64", "Installed: qemu-img-15:2.12.0-99.module+el8.2.0+6870+55b789b4.2.x86_64", "Removed: qemu-img-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: qemu-kvm-common-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: qemu-kvm-core-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: podman-1.6.4-11.module+el8.2.0+6368+cf16aa14.x86_64", "Removed: podman-docker-1.6.4-11.module+el8.2.0+6368+cf16aa14.noarch"]} 2020-09-08T15:16:49.766 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:49 +0000 (0:00:13.072) 0:04:45.546 ***** 2020-09-08T15:16:52.165 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2020-09-08T15:16:52.206 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:52 +0000 (0:00:02.434) 0:04:47.981 ***** 2020-09-08T15:16:54.580 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-09-08T15:16:54.616 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:54 +0000 (0:00:02.414) 0:04:50.395 ***** 2020-09-08T15:16:54.658 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-09-08T15:16:54.660 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:54.699 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:54 +0000 (0:00:00.083) 0:04:50.478 ***** 2020-09-08T15:16:55.045 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice sysinit.target dbus.service dbus.socket basic.target polkit.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "iptables.service ebtables.service ipset.service shutdown.target ip6tables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": " 2020-09-08T15:16:55.047 INFO:teuthology.task.ansible.out:/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Li 2020-09-08T15:16:55.052 INFO:teuthology.task.ansible.out:mitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", "LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice dbus.socket sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWh 2020-09-08T15:16:55.054 INFO:teuthology.task.ansible.out:enUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-09-08T15:16:55.093 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:55 +0000 (0:00:00.385) 0:04:50.864 ***** 2020-09-08T15:16:55.421 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi065.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-09-08T15:16:55.465 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:55 +0000 (0:00:00.371) 0:04:51.236 ***** 2020-09-08T15:16:56.300 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-09-08T15:16:56.302 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-09-08T15:16:56.360 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:56 +0000 (0:00:00.903) 0:04:52.139 ***** 2020-09-08T15:16:56.394 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-09-08T15:16:56.396 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:56.442 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:56 +0000 (0:00:00.081) 0:04:52.221 ***** 2020-09-08T15:16:56.477 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-09-08T15:16:56.479 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:56.512 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:56 +0000 (0:00:00.070) 0:04:52.291 ***** 2020-09-08T15:16:56.554 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:56.590 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:56 +0000 (0:00:00.078) 0:04:52.370 ***** 2020-09-08T15:16:56.625 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-09-08T15:16:56.631 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:56.660 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:56 +0000 (0:00:00.069) 0:04:52.439 ***** 2020-09-08T15:16:56.695 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-09-08T15:16:56.696 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:56.727 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:56 +0000 (0:00:00.067) 0:04:52.507 ***** 2020-09-08T15:16:56.759 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-09-08T15:16:56.761 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:56.794 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:56 +0000 (0:00:00.066) 0:04:52.574 ***** 2020-09-08T15:16:56.825 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-09-08T15:16:56.862 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:56 +0000 (0:00:00.067) 0:04:52.641 ***** 2020-09-08T15:16:56.895 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-09-08T15:16:56.897 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:56.928 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:56 +0000 (0:00:00.066) 0:04:52.708 ***** 2020-09-08T15:16:56.958 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-09-08T15:16:56.961 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:56.993 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:56 +0000 (0:00:00.065) 0:04:52.773 ***** 2020-09-08T15:16:57.055 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-09-08T15:16:57.056 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-09-08T15:16:57.090 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:57 +0000 (0:00:00.096) 0:04:52.869 ***** 2020-09-08T15:16:57.129 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-09-08T15:16:57.131 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:57.164 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:57 +0000 (0:00:00.073) 0:04:52.943 ***** 2020-09-08T15:16:57.208 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-09-08T15:16:57.246 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:57 +0000 (0:00:00.081) 0:04:53.025 ***** 2020-09-08T15:16:57.297 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-09-08T15:16:57.299 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:57.333 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:57 +0000 (0:00:00.087) 0:04:53.112 ***** 2020-09-08T15:16:57.375 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:57.408 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:57 +0000 (0:00:00.075) 0:04:53.188 ***** 2020-09-08T15:16:57.460 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-09-08T15:16:57.462 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:57.494 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:57 +0000 (0:00:00.085) 0:04:53.273 ***** 2020-09-08T15:16:57.526 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-09-08T15:16:57.534 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:57.565 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:57 +0000 (0:00:00.071) 0:04:53.345 ***** 2020-09-08T15:16:57.614 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:57.661 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:57 +0000 (0:00:00.087) 0:04:53.432 ***** 2020-09-08T15:16:57.694 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-09-08T15:16:57.696 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:57.728 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:57 +0000 (0:00:00.075) 0:04:53.508 ***** 2020-09-08T15:16:57.758 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-09-08T15:16:57.760 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:57.793 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:57 +0000 (0:00:00.064) 0:04:53.572 ***** 2020-09-08T15:16:57.823 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-09-08T15:16:57.825 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:57.862 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:57 +0000 (0:00:00.069) 0:04:53.642 ***** 2020-09-08T15:16:57.903 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-09-08T15:16:57.905 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:57.939 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:57 +0000 (0:00:00.074) 0:04:53.717 ***** 2020-09-08T15:16:57.979 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-09-08T15:16:57.982 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:58.015 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:58 +0000 (0:00:00.077) 0:04:53.794 ***** 2020-09-08T15:16:58.051 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-09-08T15:16:58.053 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:58.091 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:58 +0000 (0:00:00.075) 0:04:53.870 ***** 2020-09-08T15:16:58.132 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-09-08T15:16:58.135 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:58.178 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:58 +0000 (0:00:00.083) 0:04:53.954 ***** 2020-09-08T15:16:58.205 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:58.239 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:58 +0000 (0:00:00.063) 0:04:54.018 ***** 2020-09-08T15:16:58.289 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:58.326 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:58 +0000 (0:00:00.087) 0:04:54.105 ***** 2020-09-08T15:16:58.356 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-09-08T15:16:58.359 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:58.396 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:58 +0000 (0:00:00.070) 0:04:54.175 ***** 2020-09-08T15:16:58.437 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-09-08T15:16:58.439 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:58.476 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:58 +0000 (0:00:00.080) 0:04:54.255 ***** 2020-09-08T15:16:58.506 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-09-08T15:16:58.508 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:58.544 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:58 +0000 (0:00:00.064) 0:04:54.320 ***** 2020-09-08T15:16:58.586 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:58.619 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:58 +0000 (0:00:00.077) 0:04:54.398 ***** 2020-09-08T15:16:58.652 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:58.689 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:58 +0000 (0:00:00.069) 0:04:54.467 ***** 2020-09-08T15:16:58.721 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-09-08T15:16:58.727 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:58.759 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:58 +0000 (0:00:00.071) 0:04:54.539 ***** 2020-09-08T15:16:58.791 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-09-08T15:16:58.793 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:58.826 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:58 +0000 (0:00:00.066) 0:04:54.606 ***** 2020-09-08T15:16:58.871 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-09-08T15:16:58.873 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:58.911 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:58 +0000 (0:00:00.084) 0:04:54.690 ***** 2020-09-08T15:16:58.944 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:58.982 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:58 +0000 (0:00:00.068) 0:04:54.759 ***** 2020-09-08T15:16:59.021 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-09-08T15:16:59.023 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:59.058 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:59 +0000 (0:00:00.078) 0:04:54.838 ***** 2020-09-08T15:16:59.115 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-09-08T15:16:59.117 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:59.156 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:59 +0000 (0:00:00.097) 0:04:54.936 ***** 2020-09-08T15:16:59.187 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-09-08T15:16:59.189 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:59.222 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:59 +0000 (0:00:00.066) 0:04:55.002 ***** 2020-09-08T15:16:59.264 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-09-08T15:16:59.266 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:59.305 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:59 +0000 (0:00:00.082) 0:04:55.085 ***** 2020-09-08T15:16:59.336 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-09-08T15:16:59.338 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:59.370 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:59 +0000 (0:00:00.064) 0:04:55.149 ***** 2020-09-08T15:16:59.416 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-09-08T15:16:59.420 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:59.449 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:59 +0000 (0:00:00.078) 0:04:55.228 ***** 2020-09-08T15:16:59.478 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-09-08T15:16:59.480 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:59.518 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:59 +0000 (0:00:00.068) 0:04:55.296 ***** 2020-09-08T15:16:59.520 INFO:teuthology.task.ansible.out: 2020-09-08T15:16:59.562 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-09-08T15:16:59.564 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:59.605 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:59 +0000 (0:00:00.084) 0:04:55.381 ***** 2020-09-08T15:16:59.635 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-09-08T15:16:59.636 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:59.675 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:59 +0000 (0:00:00.073) 0:04:55.454 ***** 2020-09-08T15:16:59.725 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-09-08T15:16:59.727 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:59.762 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:59 +0000 (0:00:00.086) 0:04:55.541 ***** 2020-09-08T15:16:59.812 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:59.847 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:59 +0000 (0:00:00.085) 0:04:55.626 ***** 2020-09-08T15:16:59.887 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-09-08T15:16:59.889 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:59.922 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:59 +0000 (0:00:00.074) 0:04:55.701 ***** 2020-09-08T15:16:59.923 INFO:teuthology.task.ansible.out: 2020-09-08T15:16:59.964 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-09-08T15:16:59.966 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:16:59.998 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:16:59 +0000 (0:00:00.076) 0:04:55.777 ***** 2020-09-08T15:17:00.028 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-09-08T15:17:00.030 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:00.066 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:00 +0000 (0:00:00.068) 0:04:55.846 ***** 2020-09-08T15:17:00.120 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-09-08T15:17:00.122 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:00.155 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:00 +0000 (0:00:00.088) 0:04:55.934 ***** 2020-09-08T15:17:00.187 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-09-08T15:17:00.189 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:00.229 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:00 +0000 (0:00:00.073) 0:04:56.008 ***** 2020-09-08T15:17:00.275 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:00.308 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:00 +0000 (0:00:00.078) 0:04:56.087 ***** 2020-09-08T15:17:00.337 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-09-08T15:17:00.339 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:00.372 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:00 +0000 (0:00:00.064) 0:04:56.152 ***** 2020-09-08T15:17:00.438 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:00.472 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:00 +0000 (0:00:00.099) 0:04:56.251 ***** 2020-09-08T15:17:00.525 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-09-08T15:17:00.527 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:00.561 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:00 +0000 (0:00:00.089) 0:04:56.340 ***** 2020-09-08T15:17:00.594 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-09-08T15:17:00.596 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:00.635 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:00 +0000 (0:00:00.073) 0:04:56.414 ***** 2020-09-08T15:17:00.667 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-09-08T15:17:00.669 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:00.705 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:00 +0000 (0:00:00.069) 0:04:56.484 ***** 2020-09-08T15:17:00.747 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:00.782 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:00 +0000 (0:00:00.076) 0:04:56.561 ***** 2020-09-08T15:17:00.829 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:00.861 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:00 +0000 (0:00:00.079) 0:04:56.640 ***** 2020-09-08T15:17:00.893 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-09-08T15:17:00.894 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:00.936 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:00 +0000 (0:00:00.075) 0:04:56.715 ***** 2020-09-08T15:17:00.971 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-09-08T15:17:00.973 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:01.007 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:01 +0000 (0:00:00.070) 0:04:56.786 ***** 2020-09-08T15:17:01.048 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-09-08T15:17:01.054 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:01.100 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:01 +0000 (0:00:00.093) 0:04:56.880 ***** 2020-09-08T15:17:01.145 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:01.180 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:01 +0000 (0:00:00.079) 0:04:56.959 ***** 2020-09-08T15:17:01.222 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:01.258 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:01 +0000 (0:00:00.078) 0:04:57.038 ***** 2020-09-08T15:17:01.299 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-09-08T15:17:01.301 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-09-08T15:17:01.342 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:01 +0000 (0:00:00.084) 0:04:57.122 ***** 2020-09-08T15:17:01.395 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-09-08T15:17:01.397 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-09-08T15:17:01.407 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-09-08T15:17:01.424 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-09-08T15:17:01.433 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-09-08T15:17:01.436 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-09-08T15:17:01.444 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-09-08T15:17:01.447 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-09-08T15:17:01.495 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:01 +0000 (0:00:00.152) 0:04:57.275 ***** 2020-09-08T15:17:01.764 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-09-08T15:17:01.766 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.010160", "end": "2020-09-08 15:17:01.733578", "rc": 0, "start": "2020-09-08 15:17:01.723418", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-09-08T15:17:01.807 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:01 +0000 (0:00:00.311) 0:04:57.586 ***** 2020-09-08T15:17:01.848 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-09-08T15:17:01.849 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:01.893 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:01 +0000 (0:00:00.086) 0:04:57.672 ***** 2020-09-08T15:17:01.937 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-09-08T15:17:01.940 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:01.973 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:01 +0000 (0:00:00.080) 0:04:57.753 ***** 2020-09-08T15:17:02.015 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:02.050 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:02 +0000 (0:00:00.076) 0:04:57.829 ***** 2020-09-08T15:17:02.092 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:02.131 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:02 +0000 (0:00:00.080) 0:04:57.910 ***** 2020-09-08T15:17:04.452 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-09-08T15:17:04.484 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:04 +0000 (0:00:02.353) 0:05:00.263 ***** 2020-09-08T15:17:04.556 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-09-08T15:17:04.558 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930489327616, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227170246, 'block_used': 12924862, 'inode_total': 61054976, 'inode_available': 60986774, 'inode_used': 68202, 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227170246, "block_size": 4096, "block_total": 240095108, "block_used": 12924862, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986774, "inode_total": 61054976, "inode_used": 68202, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930489327616, "size_total": 983429562368, "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}} 2020-09-08T15:17:04.600 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:04 +0000 (0:00:00.116) 0:05:00.379 ***** 2020-09-08T15:17:04.829 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-09-08T15:17:04.831 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005299", "end": "2020-09-08 15:17:04.809016", "rc": 0, "start": "2020-09-08 15:17:04.803717", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-09-08T15:17:04.867 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:04 +0000 (0:00:00.266) 0:05:00.646 ***** 2020-09-08T15:17:04.918 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi065.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930489327616, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227170246, 'block_used': 12924862, 'inode_total': 61054976, 'inode_available': 60986774, 'inode_used': 68202, 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227170246, "block_size": 4096, "block_total": 240095108, "block_used": 12924862, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986774, "inode_total": 61054976, "inode_used": 68202, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930489327616, "size_total": 983429562368, "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:04.955 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:04 +0000 (0:00:00.088) 0:05:00.734 ***** 2020-09-08T15:17:04.998 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-09-08T15:17:05.046 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:05 +0000 (0:00:00.079) 0:05:00.814 ***** 2020-09-08T15:17:06.604 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Ao21nH8DCrwMDMhy1E9Ct33aDPRFJznhmDLLSrpX5ky3ID546uk8MTw1MANGUeFQ'], 'uuids': ['8d4cc850-7159-4c44-9b21-fef1dc48c5f3'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.293850", "end": "2020-09-08 15:17:06.560193", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Ao21nH8DCrwMDMhy1E9Ct33aDPRFJznhmDLLSrpX5ky3ID546uk8MTw1MANGUeFQ"], "labels": [], "masters": [], "uuids": ["8d4cc850-7159-4c44-9b21-fef1dc48c5f3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-09-08 15:17:05.266343", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk u 2020-09-08T15:17:06.606 INFO:teuthology.task.ansible.out:sing fdisk or", "other utilities."]} 2020-09-08T15:17:07.917 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-v5izPF-ga3o-bJ5B-3F4S-OSjV-h1IH-sFFFQS', 'nvme-INTEL_SSDPEDMD400G4_CVFT53430010400BGN', 'nvme-nvme.8086-43564654353334333030313034303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.069497", "end": "2020-09-08 15:17:07.886119", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-v5izPF-ga3o-bJ5B-3F4S-OSjV-h1IH-sFFFQS", "nvme-INTEL_SSDPEDMD400G4_CVFT53430010400BGN", "nvme-nvme.8086-43564654353334333030313034303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-09-08 15:17:06.816622", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-09-08T15:17:07.919 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-09-08T15:17:09.185 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Ao21nH8DCrwMDMhy1E9Ct33aDPRFJznhuDXKntW06eL1DnqqMHlTsnX6OxiXNRrw'], 'uuids': ['1e949275-4f19-4808-98e9-07837ec2f7ee'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.049806", "end": "2020-09-08 15:17:09.161584", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Ao21nH8DCrwMDMhy1E9Ct33aDPRFJznhuDXKntW06eL1DnqqMHlTsnX6OxiXNRrw"], "labels": [], "masters": [], "uuids": ["1e949275-4f19-4808-98e9-07837ec2f7ee"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-09-08 15:17:08.111778", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-09-08T15:17:10.459 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Ao21nH8DCrwMDMhy1E9Ct33aDPRFJznhA6dkaewkZTadDK6Ur1meJ0PGAfYIFA82'], 'uuids': ['69bfd4f6-5557-4309-8f10-7a9f3ab55e6a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.048433", "end": "2020-09-08 15:17:10.427101", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Ao21nH8DCrwMDMhy1E9Ct33aDPRFJznhA6dkaewkZTadDK6Ur1meJ0PGAfYIFA82"], "labels": [], "masters": [], "uuids": ["69bfd4f6-5557-4309-8f10-7a9f3ab55e6a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-09-08 15:17:09.378668", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-09-08T15:17:11.741 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Ao21nH8DCrwMDMhy1E9Ct33aDPRFJznhMq9cBGZnoQL90lOZNOFT4xT0jvuFRd9j'], 'uuids': ['8cc37404-e79b-4136-a550-585aed9523f3'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.055101", "end": "2020-09-08 15:17:11.710861", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Ao21nH8DCrwMDMhy1E9Ct33aDPRFJznhMq9cBGZnoQL90lOZNOFT4xT0jvuFRd9j"], "labels": [], "masters": [], "uuids": ["8cc37404-e79b-4136-a550-585aed9523f3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-09-08 15:17:10.655760", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-09-08T15:17:11.769 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4VHBH', 'wwn-0x5000c50087b9acc1'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4VHBH', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50087b9acc1', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4VHBH-part1', 'wwn-0x5000c50087b9acc1-part1'], 'uuids': ['0dcc33de-53c3-4ea8-baab-7ca3c59fe577'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4VHBH", "wwn-0x5000c50087b9acc1"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4VHBH-part1", "wwn-0x5000c50087b9acc1-part1"], "labels": [], "masters": [], "uuids": ["0dcc33de-53c3-4ea8-baab-7ca3c59fe577"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4VHBH", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087b9acc1"}}, 2020-09-08T15:17:11.771 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-09-08T15:17:13.042 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Ao21nH8DCrwMDMhy1E9Ct33aDPRFJznhGJxCCBRDp0M0ByCd9AVLjvcNe6ScmQpB'], 'uuids': ['c321caba-09db-4e0c-ab26-c45ab3e4c2c6'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.056878", "end": "2020-09-08 15:17:13.005084", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Ao21nH8DCrwMDMhy1E9Ct33aDPRFJznhGJxCCBRDp0M0ByCd9AVLjvcNe6ScmQpB"], "labels": [], "masters": [], "uuids": ["c321caba-09db-4e0c-ab26-c45ab3e4c2c6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-09-08 15:17:11.948206", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-09-08T15:17:13.098 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:13 +0000 (0:00:08.063) 0:05:08.877 ***** 2020-09-08T15:17:13.514 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Ao21nH8DCrwMDMhy1E9Ct33aDPRFJznhmDLLSrpX5ky3ID546uk8MTw1MANGUeFQ'], 'uuids': ['8d4cc850-7159-4c44-9b21-fef1dc48c5f3'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.150192", "end": "2020-09-08 15:17:13.482433", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Ao21nH8DCrwMDMhy1E9Ct33aDPRFJznhmDLLSrpX5ky3ID546uk8MTw1MANGUeFQ"], "labels": [], "masters": [], "uuids": ["8d4cc850-7159-4c44-9b21-fef1dc48c5f3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-09-08 15:17:13.332241", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.147521 s, 782 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.147521 s, 782 MB/s"], "stdout": "", "stdout_lines": []} 2020-09-08T15:17:13.746 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-v5izPF-ga3o-bJ5B-3F4S-OSjV-h1IH-sFFFQS', 'nvme-INTEL_SSDPEDMD400G4_CVFT53430010400BGN', 'nvme-nvme.8086-43564654353334333030313034303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036154", "end": "2020-09-08 15:17:13.724623", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-v5izPF-ga3o-bJ5B-3F4S-OSjV-h1IH-sFFFQS", "nvme-INTEL_SSDPEDMD400G4_CVFT53430010400BGN", "nvme-nvme.8086-43564654353334333030313034303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-09-08 15:17:13.688469", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0334395 s, 3.4 GB/s", "std 2020-09-08T15:17:13.752 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0334395 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-09-08T15:17:14.106 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Ao21nH8DCrwMDMhy1E9Ct33aDPRFJznhuDXKntW06eL1DnqqMHlTsnX6OxiXNRrw'], 'uuids': ['1e949275-4f19-4808-98e9-07837ec2f7ee'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.141302", "end": "2020-09-08 15:17:14.085714", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Ao21nH8DCrwMDMhy1E9Ct33aDPRFJznhuDXKntW06eL1DnqqMHlTsnX6OxiXNRrw"], "labels": [], "masters": [], "uuids": ["1e949275-4f19-4808-98e9-07837ec2f7ee"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-09-08 15:17:13.944412", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138706 s, 832 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138706 s, 832 MB/s"], "stdout": "", "stdout_lines": []} 2020-09-08T15:17:14.467 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Ao21nH8DCrwMDMhy1E9Ct33aDPRFJznhA6dkaewkZTadDK6Ur1meJ0PGAfYIFA82'], 'uuids': ['69bfd4f6-5557-4309-8f10-7a9f3ab55e6a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.140329", "end": "2020-09-08 15:17:14.433476", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Ao21nH8DCrwMDMhy1E9Ct33aDPRFJznhA6dkaewkZTadDK6Ur1meJ0PGAfYIFA82"], "labels": [], "masters": [], "uuids": ["69bfd4f6-5557-4309-8f10-7a9f3ab55e6a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-09-08 15:17:14.293147", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137724 s, 837 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137724 s, 837 MB/s"], "stdout": "", "stdout_lines": []} 2020-09-08T15:17:14.803 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Ao21nH8DCrwMDMhy1E9Ct33aDPRFJznhMq9cBGZnoQL90lOZNOFT4xT0jvuFRd9j'], 'uuids': ['8cc37404-e79b-4136-a550-585aed9523f3'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.141682", "end": "2020-09-08 15:17:14.776503", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Ao21nH8DCrwMDMhy1E9Ct33aDPRFJznhMq9cBGZnoQL90lOZNOFT4xT0jvuFRd9j"], "labels": [], "masters": [], "uuids": ["8cc37404-e79b-4136-a550-585aed9523f3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-09-08 15:17:14.634821", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138985 s, 830 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138985 s, 830 MB/s"], "stdout": "", "stdout_lines": []} 2020-09-08T15:17:14.815 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4VHBH', 'wwn-0x5000c50087b9acc1'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4VHBH', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50087b9acc1', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4VHBH-part1', 'wwn-0x5000c50087b9acc1-part1'], 'uuids': ['0dcc33de-53c3-4ea8-baab-7ca3c59fe577'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4VHBH", "wwn-0x5000c50087b9acc1"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4VHBH-part1", "wwn-0x5000c50087b9acc1-part1"], "labels": [], "masters": [], "uuids": ["0dcc33de-53c3-4ea8-baab-7ca3c59fe577"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4VHBH", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087b9acc1"}}, 2020-09-08T15:17:14.817 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-09-08T15:17:15.146 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Ao21nH8DCrwMDMhy1E9Ct33aDPRFJznhGJxCCBRDp0M0ByCd9AVLjvcNe6ScmQpB'], 'uuids': ['c321caba-09db-4e0c-ab26-c45ab3e4c2c6'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.138576", "end": "2020-09-08 15:17:15.125152", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Ao21nH8DCrwMDMhy1E9Ct33aDPRFJznhGJxCCBRDp0M0ByCd9AVLjvcNe6ScmQpB"], "labels": [], "masters": [], "uuids": ["c321caba-09db-4e0c-ab26-c45ab3e4c2c6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-09-08 15:17:14.986576", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.13589 s, 849 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.13589 s, 849 MB/s"], "stdout": "", "stdout_lines": []} 2020-09-08T15:17:15.202 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:15 +0000 (0:00:02.103) 0:05:10.980 ***** 2020-09-08T15:17:15.491 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-09-08T15:17:15.494 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.057843", "end": "2020-09-08 15:17:15.461420", "rc": 0, "start": "2020-09-08 15:17:15.403577", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-09-08T15:17:15.530 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:15 +0000 (0:00:00.328) 0:05:11.309 ***** 2020-09-08T15:17:15.826 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.048168", "end": "2020-09-08 15:17:15.802361", "rc": 0, "start": "2020-09-08 15:17:15.754193", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-09-08T15:17:15.862 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:15 +0000 (0:00:00.330) 0:05:11.640 ***** 2020-09-08T15:17:15.915 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-09-08T15:17:15.954 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:15 +0000 (0:00:00.093) 0:05:11.734 ***** 2020-09-08T15:17:16.007 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-09-08T15:17:16.009 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:16.046 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:16 +0000 (0:00:00.091) 0:05:11.825 ***** 2020-09-08T15:17:16.103 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:16.135 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:16 +0000 (0:00:00.089) 0:05:11.915 ***** 2020-09-08T15:17:16.166 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-09-08T15:17:16.168 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:16.206 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:16 +0000 (0:00:00.069) 0:05:11.984 ***** 2020-09-08T15:17:16.246 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-09-08T15:17:16.248 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:16.281 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:16 +0000 (0:00:00.076) 0:05:12.060 ***** 2020-09-08T15:17:16.514 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi065.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-09-08T15:17:16.556 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:16 +0000 (0:00:00.274) 0:05:12.335 ***** 2020-09-08T15:17:16.613 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-09-08T15:17:16.615 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930489327616, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227170246, 'block_used': 12924862, 'inode_total': 61054976, 'inode_available': 60986774, 'inode_used': 68202, 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227170246, "block_size": 4096, "block_total": 240095108, "block_used": 12924862, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986774, "inode_total": 61054976, "inode_used": 68202, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930489327616, "size_total": 983429562368, "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:16.658 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:16 +0000 (0:00:00.099) 0:05:12.435 ***** 2020-09-08T15:17:16.695 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-09-08T15:17:16.697 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:16.738 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:16 +0000 (0:00:00.081) 0:05:12.517 ***** 2020-09-08T15:17:16.781 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-09-08T15:17:16.783 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:16.820 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:16 +0000 (0:00:00.082) 0:05:12.599 ***** 2020-09-08T15:17:16.862 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-09-08T15:17:16.864 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:16.898 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:16 +0000 (0:00:00.078) 0:05:12.677 ***** 2020-09-08T15:17:16.943 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-09-08T15:17:16.945 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:16.977 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:16 +0000 (0:00:00.078) 0:05:12.756 ***** 2020-09-08T15:17:17.023 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-09-08T15:17:17.025 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:17.062 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:17 +0000 (0:00:00.085) 0:05:12.841 ***** 2020-09-08T15:17:17.104 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-09-08T15:17:17.106 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:17.144 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:17 +0000 (0:00:00.082) 0:05:12.923 ***** 2020-09-08T15:17:18.010 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-09-08T15:17:18.012 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-09-08T15:17:18.062 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:18 +0000 (0:00:00.918) 0:05:13.842 ***** 2020-09-08T15:17:18.777 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-09-08T15:17:19.147 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-09-08T15:17:19.494 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-09-08T15:17:19.873 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-09-08T15:17:20.261 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-09-08T15:17:20.304 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:20 +0000 (0:00:02.241) 0:05:16.083 ***** 2020-09-08T15:17:20.542 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-09-08T15:17:20.701 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:20 +0000 (0:00:00.394) 0:05:16.478 ***** 2020-09-08T15:17:20.950 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-09-08T15:17:20.952 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-09-08T15:17:21.148 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-09-08T15:17:21.345 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-09-08T15:17:21.552 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-09-08T15:17:21.573 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:21.611 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:21 +0000 (0:00:00.911) 0:05:17.390 ***** 2020-09-08T15:17:21.837 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-09-08T15:17:21.839 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-09-08T15:17:21.884 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:21 +0000 (0:00:00.273) 0:05:17.663 ***** 2020-09-08T15:17:21.919 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-09-08T15:17:21.921 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:21.967 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:21 +0000 (0:00:00.082) 0:05:17.746 ***** 2020-09-08T15:17:22.485 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-09-08T15:17:22.487 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => {"changed": true} 2020-09-08T15:17:22.532 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:22 +0000 (0:00:00.565) 0:05:18.311 ***** 2020-09-08T15:17:23.056 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-09-08T15:17:23.058 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-09-08T15:17:23.098 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:23 +0000 (0:00:00.562) 0:05:18.874 ***** 2020-09-08T15:17:23.139 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-09-08T15:17:23.142 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:23.186 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:23 +0000 (0:00:00.091) 0:05:18.965 ***** 2020-09-08T15:17:23.228 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-09-08T15:17:23.230 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:23.263 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:23 +0000 (0:00:00.077) 0:05:19.043 ***** 2020-09-08T15:17:23.305 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:23.349 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:23 +0000 (0:00:00.077) 0:05:19.120 ***** 2020-09-08T15:17:23.381 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:23.422 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:23 +0000 (0:00:00.075) 0:05:19.195 ***** 2020-09-08T15:17:23.462 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:23.510 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:23 +0000 (0:00:00.094) 0:05:19.289 ***** 2020-09-08T15:17:23.591 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:23.632 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:23 +0000 (0:00:00.119) 0:05:19.409 ***** 2020-09-08T15:17:23.672 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-09-08T15:17:23.676 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:23.719 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:23 +0000 (0:00:00.085) 0:05:19.494 ***** 2020-09-08T15:17:23.765 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:23.800 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:23 +0000 (0:00:00.085) 0:05:19.580 ***** 2020-09-08T15:17:23.832 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:23.872 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:23 +0000 (0:00:00.071) 0:05:19.651 ***** 2020-09-08T15:17:23.918 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:23.982 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:23 +0000 (0:00:00.110) 0:05:19.761 ***** 2020-09-08T15:17:24.067 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:24.108 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:24 +0000 (0:00:00.120) 0:05:19.882 ***** 2020-09-08T15:17:24.702 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-09-08T15:17:24.742 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:24 +0000 (0:00:00.639) 0:05:20.521 ***** 2020-09-08T15:17:25.094 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-09-08T15:17:25.095 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-09-08 15:11:23 UTC", "ActiveEnterTimestampMonotonic": "16336534", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "tmp.mount -.mount sntp.service sysinit.target system.slice basic.target ntpdate.service systemd-tmpfiles-setup.service systemd-journald.socket ntpd.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-09-08 15:11:22 UTC", "AssertTimestampMonotonic": "14852322", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-09-08 15:11:22 UTC", "ConditionTimestampMonotonic": "14852287", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service ntpd.service shutdown.target", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-09-08T15:17:25.097 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2415", "ExecMainStartTimestamp": "Tue 2020-09-08 15:11:23 UTC", "ExecMainStartTimestampMonotonic": "16225584", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2020-09-08 15:11:22 UTC", "InactiveExitTimestampMonotonic": "14877339", "InvocationID": "837fdfe15a484a1d84666c5d8b753cf2", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-09-08T15:17:25.100 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", "LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2415", "MemoryAccounting": "yes", "MemoryCurrent": "5025792", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-09-08T15:17:25.102 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-09-08 15:11:23 UTC", "StateChangeTimestampMonotonic": "16336534", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-09-08 15:11:23 UTC", "WatchdogTimestampMonotonic": "16225600", "WatchdogUSec": "0"}} 2020-09-08T15:17:25.136 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:25 +0000 (0:00:00.394) 0:05:20.915 ***** 2020-09-08T15:17:25.171 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-09-08T15:17:25.173 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-09-08T15:17:25.210 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:25 +0000 (0:00:00.074) 0:05:20.990 ***** 2020-09-08T15:17:25.265 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi065.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-09-08T15:17:25.309 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:25 +0000 (0:00:00.098) 0:05:21.088 ***** 2020-09-08T15:17:25.355 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:25.394 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:25 +0000 (0:00:00.084) 0:05:21.173 ***** 2020-09-08T15:17:25.442 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:25.474 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:25 +0000 (0:00:00.080) 0:05:21.253 ***** 2020-09-08T15:17:25.505 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-09-08T15:17:25.507 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:25.542 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:25 +0000 (0:00:00.067) 0:05:21.321 ***** 2020-09-08T15:17:25.803 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-09-08T15:17:25.805 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-09-08T15:17:25.849 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:25 +0000 (0:00:00.300) 0:05:21.622 ***** 2020-09-08T15:17:26.393 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-09-08T15:17:26.432 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:26 +0000 (0:00:00.589) 0:05:22.211 ***** 2020-09-08T15:17:27.887 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-09-08T15:17:27.912 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:27 +0000 (0:00:01.480) 0:05:23.692 ***** 2020-09-08T15:17:27.957 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-09-08T15:17:27.959 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:28.008 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:28 +0000 (0:00:00.095) 0:05:23.787 ***** 2020-09-08T15:17:28.052 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-09-08T15:17:28.053 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-09-08T15:17:28.087 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:28 +0000 (0:00:00.079) 0:05:23.867 ***** 2020-09-08T15:17:28.307 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi065.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-09-08T15:17:28.347 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:28 +0000 (0:00:00.258) 0:05:24.125 ***** 2020-09-08T15:17:28.389 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:28.428 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:28 +0000 (0:00:00.081) 0:05:24.207 ***** 2020-09-08T15:17:28.482 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi065.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-09-08T15:17:28.526 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:28 +0000 (0:00:00.097) 0:05:24.305 ***** 2020-09-08T15:17:28.575 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:28.614 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:28 +0000 (0:00:00.083) 0:05:24.389 ***** 2020-09-08T15:17:28.836 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi065.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-09-08T15:17:28.880 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:28 +0000 (0:00:00.269) 0:05:24.658 ***** 2020-09-08T15:17:29.105 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-09-08T15:17:29.107 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-09-08T15:17:29.143 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:29 +0000 (0:00:00.263) 0:05:24.922 ***** 2020-09-08T15:17:29.185 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-09-08T15:17:29.187 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:29.238 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:29 +0000 (0:00:00.094) 0:05:25.017 ***** 2020-09-08T15:17:29.312 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-09-08T15:17:29.314 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-09-08T15:17:29.324 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-09-08T15:17:29.326 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-09-08T15:17:29.369 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:29 +0000 (0:00:00.131) 0:05:25.148 ***** 2020-09-08T15:17:29.423 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-09-08T15:17:29.425 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:29.437 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi065.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:29.462 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:29.505 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:29 +0000 (0:00:00.135) 0:05:25.284 ***** 2020-09-08T15:17:29.539 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-09-08T15:17:29.541 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:29.582 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:29 +0000 (0:00:00.075) 0:05:25.359 ***** 2020-09-08T15:17:29.622 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:29.664 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:29 +0000 (0:00:00.083) 0:05:25.443 ***** 2020-09-08T15:17:29.708 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:29.761 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:29 +0000 (0:00:00.097) 0:05:25.541 ***** 2020-09-08T15:17:29.763 INFO:teuthology.task.ansible.out: 2020-09-08T15:17:29.808 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-09-08T15:17:29.810 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:29.852 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:29 +0000 (0:00:00.090) 0:05:25.631 ***** 2020-09-08T15:17:29.899 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:29.938 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:29 +0000 (0:00:00.086) 0:05:25.718 ***** 2020-09-08T15:17:29.979 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-09-08T15:17:29.982 INFO:teuthology.task.ansible.out:skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:30.018 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:30 +0000 (0:00:00.078) 0:05:25.796 ***** 2020-09-08T15:17:30.062 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:30.102 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:30 +0000 (0:00:00.084) 0:05:25.881 ***** 2020-09-08T15:17:30.140 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi065.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-09-08T15:17:30.169 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:30 +0000 (0:00:00.067) 0:05:25.948 ***** 2020-09-08T15:17:30.450 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-09-08T15:17:30.452 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005277", "end": "2020-09-08 15:17:30.415870", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-09-08 15:17:30.410593", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-09-08T15:17:30.656 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003135", "end": "2020-09-08 15:17:30.621678", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-09-08 15:17:30.618543", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-09-08T15:17:30.887 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002923", "end": "2020-09-08 15:17:30.844170", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-09-08 15:17:30.841247", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-09-08T15:17:31.092 INFO:teuthology.task.ansible.out:ok: [smithi065.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003341", "end": "2020-09-08 15:17:31.059001", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-09-08 15:17:31.055660", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-09-08T15:17:31.132 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:31 +0000 (0:00:00.963) 0:05:26.911 ***** 2020-09-08T15:17:31.180 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-09-08T15:17:31.220 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:31 +0000 (0:00:00.085) 0:05:26.997 ***** 2020-09-08T15:17:31.447 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-09-08T15:17:31.449 INFO:teuthology.task.ansible.out:changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-09-08T15:17:31.490 INFO:teuthology.task.ansible.out:Tuesday 08 September 2020 15:17:31 +0000 (0:00:00.268) 0:05:27.265 ***** 2020-09-08T15:17:31.903 INFO:teuthology.task.ansible.out: RUNNING HANDLER [common : restart nagios-nrpe-server] ************************** changed: [smithi065.front.sepia.ceph.com] => {"changed": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-09-08 15:14:44 UTC", "ActiveEnterTimestampMonotonic": "216904600", "ActiveExitTimestamp": "Tue 2020-09-08 15:14:44 UTC", "ActiveExitTimestampMonotonic": "216872014", "ActiveState": "active", "After": "network.target tmp.mount system.slice local-fs.target basic.target systemd-tmpfiles-setup.service nss-lookup.target time-sync.target sysinit.target var-run.mount systemd-journald.socket -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-09-08 15:14:44 UTC", "AssertTimestampMonotonic": "216903652", "Before": "plymouth-quit.service shutdown.target getty@tty1.service xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-09-08 15:14:44 UTC", "ConditionTimestampMonotonic": "216903652", "Configuratio 2020-09-08T15:17:31.905 INFO:teuthology.task.ansible.out:nDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "16917", "ExecMainStartTimestamp": "Tue 2020-09-08 15:14:44 UTC", "ExecMainStartTimestampMonotonic": "216904564", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Tue 2020-09-08 15:14:44 UTC", "InactiveEnterTimestampMonotonic": "216902528", "InactiveExitTimestamp": "Tue 2020-09-08 15:14:44 UTC", "InactiveExitTimestampMonotonic": "216904600", "InvocationID": "8d04fcadd620468a88b90cee960282ac", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "Kil 2020-09-08T15:17:31.907 INFO:teuthology.task.ansible.out:lSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", "LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "16917", "MemoryAccounting": "yes", "MemoryCurrent": "909312", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/run/nrpe /var/tmp", 2020-09-08T15:17:31.909 INFO:teuthology.task.ansible.out: "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-09-08 15:14:44 UTC", "StateChangeTimestampMonotonic": "216904600", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-09-08 15:14:44 UTC", "WatchdogTimestampMonotonic": "216904598", "WatchdogUSec": "0"}} 2020-09-08T15:17:31.994 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-09-08T15:17:31.998 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** 2020-09-08T15:17:32.000 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-09-08T15:17:32.003 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi065.front.sepia.ceph.com : ok=128 changed=41 unreachable=0 failed=0 skipped=162 rescued=0 ignored=4 Tuesday 08 September 2020 15:17:31 +0000 (0:00:00.515) 0:05:27.781 ***** =============================================================================== users : Create all admin users with sudo access. ----------------------- 45.07s common : nrpe - Ensure SELinux policy is up to date -------------------- 42.75s users : Update authorized_keys using the keys repo --------------------- 40.14s common : nrpe - Remove SELinux policy package -------------------------- 17.45s common : nrpe - Load SELinux policy package ---------------------------- 17.03s testnode : Install packages -------------------------------------------- 13.07s common : Get list of enabled RHSM repos -------------------------------- 10.93s users : Remove revoked users -------------------------------------------- 9.61s testnode : Zap all non-root disks --------------------------------------- 8.06s common : Install nrpe package and dependencies (RHEL/CentOS) ------------ 7.91s common : Register with subscription-manager. ---------------------------- 7.77s testnode : Ensure ceph packages are not present. ------------------------ 6.10s testnode : Ensure ceph dependency packages are not present. ------------- 5.46s common : Disable all rhsm repos ----------------------------------------- 4.35s common : Enable necessary rhsm repos ------------------------------------ 3.81s common : Install Kerberos Packages (RedHat) ----------------------------- 2.72s testnode : Install epel packages ---------------------------------------- 2.43s testnode : Remove packages ---------------------------------------------- 2.41s common : nrpe - Install SELinux dependencies ---------------------------- 2.40s testnode : Make sure rpm dependencies are installed --------------------- 2.35s 2020-09-08T15:17:32.408 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi065.front.sepia.ceph.com')] 2020-09-08T15:17:32.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-09-08T15:17:32.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi065.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-09-08T15:17:32.493 INFO:teuthology.orchestra.run.smithi065:> true 2020-09-08T15:17:32.587 INFO:teuthology.run_tasks:Running task clock... 2020-09-08T15:17:32.602 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-09-08T15:17:32.604 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-09-08T15:17:32.604 INFO:teuthology.orchestra.run.smithi065:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-09-08T15:17:32.665 INFO:teuthology.orchestra.run.smithi065.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-09-08T15:17:32.687 INFO:teuthology.orchestra.run.smithi065.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-09-08T15:17:32.737 INFO:teuthology.orchestra.run.smithi065.stderr:sudo: ntpd: command not found 2020-09-08T15:17:32.757 INFO:teuthology.orchestra.run.smithi065.stdout:506 Cannot talk to daemon 2020-09-08T15:17:32.776 INFO:teuthology.orchestra.run.smithi065.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-09-08T15:17:32.796 INFO:teuthology.orchestra.run.smithi065.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-09-08T15:17:32.870 INFO:teuthology.orchestra.run.smithi065.stderr:bash: ntpq: command not found 2020-09-08T15:17:32.872 INFO:teuthology.orchestra.run.smithi065.stdout:210 Number of sources = 4 2020-09-08T15:17:32.872 INFO:teuthology.orchestra.run.smithi065.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-09-08T15:17:32.872 INFO:teuthology.orchestra.run.smithi065.stdout:=============================================================================== 2020-09-08T15:17:32.873 INFO:teuthology.orchestra.run.smithi065.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-09-08T15:17:32.873 INFO:teuthology.orchestra.run.smithi065.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-09-08T15:17:32.880 INFO:teuthology.orchestra.run.smithi065.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-09-08T15:17:32.881 INFO:teuthology.orchestra.run.smithi065.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-09-08T15:17:32.881 INFO:teuthology.run_tasks:Running task install... 2020-09-08T15:17:32.923 DEBUG:teuthology.task.install:project ceph 2020-09-08T15:17:32.924 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'dce4d291bd4243c9802c17d67b85a6da6bbc0f8f'}} 2020-09-08T15:17:32.924 DEBUG:teuthology.task.install:config {'sha1': 'dce4d291bd4243c9802c17d67b85a6da6bbc0f8f'} 2020-09-08T15:17:32.924 INFO:teuthology.task.install:Using flavor: basic 2020-09-08T15:17:32.933 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-09-08T15:17:32.933 INFO:teuthology.task.install:extra packages: [] 2020-09-08T15:17:32.934 INFO:teuthology.orchestra.run.smithi065:> sudo lsb_release -is 2020-09-08T15:17:32.979 INFO:teuthology.orchestra.run.smithi065.stdout:RedHatEnterprise 2020-09-08T15:17:32.979 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-09-08T15:17:32.981 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dce4d291bd4243c9802c17d67b85a6da6bbc0f8f', 'tag': None, 'wait_for_package': False} 2020-09-08T15:17:32.982 INFO:teuthology.orchestra.run.smithi065:> sudo lsb_release -is 2020-09-08T15:17:33.060 INFO:teuthology.orchestra.run.smithi065.stdout:RedHatEnterprise 2020-09-08T15:17:33.062 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-09-08T15:17:33.063 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dce4d291bd4243c9802c17d67b85a6da6bbc0f8f 2020-09-08T15:17:33.262 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-09-08-0934/dce4d291bd4243c9802c17d67b85a6da6bbc0f8f/centos/8/flavors/default/ 2020-09-08T15:17:33.263 INFO:teuthology.task.install.rpm:Package version is 16.0.0-5272.gdce4d291bd4 2020-09-08T15:17:33.390 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-09-08-0934/dce4d291bd4243c9802c17d67b85a6da6bbc0f8f/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-09-08-0934/dce4d291bd4243c9802c17d67b85a6da6bbc0f8f/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-09-08-0934/dce4d291bd4243c9802c17d67b85a6da6bbc0f8f/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-09-08T15:17:33.391 INFO:teuthology.orchestra.run.smithi065:> set -ex 2020-09-08T15:17:33.391 INFO:teuthology.orchestra.run.smithi065:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-09-08T15:17:33.405 INFO:teuthology.orchestra.run.smithi065.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-09-08T15:17:33.422 INFO:teuthology.orchestra.run.smithi065.stderr:1+1 records in 2020-09-08T15:17:33.422 INFO:teuthology.orchestra.run.smithi065.stderr:1+1 records out 2020-09-08T15:17:33.422 INFO:teuthology.orchestra.run.smithi065.stderr:664 bytes copied, 4.0891e-05 s, 16.2 MB/s 2020-09-08T15:17:33.423 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2020-09-08T15:17:33.424 INFO:teuthology.orchestra.run.smithi065:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dce4d291bd4243c9802c17d67b85a6da6bbc0f8f/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-09-08T15:17:33.496 INFO:teuthology.orchestra.run.smithi065:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-09-08T15:17:33.585 INFO:teuthology.orchestra.run.smithi065:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-09-08T15:17:33.615 INFO:teuthology.orchestra.run.smithi065.stdout:check_obsoletes = 1 2020-09-08T15:17:33.616 INFO:teuthology.orchestra.run.smithi065:> sudo yum clean all 2020-09-08T15:17:34.012 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:17:34.326 INFO:teuthology.orchestra.run.smithi065.stdout:52 files removed 2020-09-08T15:17:34.375 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install ceph-radosgw 2020-09-08T15:17:34.729 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:17:35.464 INFO:teuthology.orchestra.run.smithi065.stdout:ceph packages for x86_64 292 kB/s | 72 kB 00:00 2020-09-08T15:17:35.704 INFO:teuthology.orchestra.run.smithi065.stdout:ceph noarch packages 70 kB/s | 14 kB 00:00 2020-09-08T15:17:35.932 INFO:teuthology.orchestra.run.smithi065.stdout:ceph source packages 7.0 kB/s | 1.4 kB 00:00 2020-09-08T15:17:36.198 INFO:teuthology.orchestra.run.smithi065.stdout:Copr repo for ceph-el8 owned by ktdreyer 1.0 kB/s | 257 B 00:00 2020-09-08T15:17:36.561 INFO:teuthology.orchestra.run.smithi065.stdout:Extra Packages for Enterprise Linux 23 MB/s | 8.0 MB 00:00 2020-09-08T15:17:38.218 INFO:teuthology.orchestra.run.smithi065.stdout:lab-extras 3.9 MB/s | 21 kB 00:00 2020-09-08T15:17:38.514 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 84 MB/s | 20 MB 00:00 2020-09-08T15:17:41.744 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 76 MB/s | 19 MB 00:00 2020-09-08T15:17:46.711 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:17:46.722 INFO:teuthology.orchestra.run.smithi065.stdout:======================================================================================================= 2020-09-08T15:17:46.723 INFO:teuthology.orchestra.run.smithi065.stdout: Package Arch Version Repository Size 2020-09-08T15:17:46.723 INFO:teuthology.orchestra.run.smithi065.stdout:======================================================================================================= 2020-09-08T15:17:46.723 INFO:teuthology.orchestra.run.smithi065.stdout:Installing: 2020-09-08T15:17:46.723 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-radosgw x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 11 M 2020-09-08T15:17:46.730 INFO:teuthology.orchestra.run.smithi065.stdout:Upgrading: 2020-09-08T15:17:46.730 INFO:teuthology.orchestra.run.smithi065.stdout: librados2 x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 3.7 M 2020-09-08T15:17:46.730 INFO:teuthology.orchestra.run.smithi065.stdout: librbd1 x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 2.2 M 2020-09-08T15:17:46.731 INFO:teuthology.orchestra.run.smithi065.stdout:Installing dependencies: 2020-09-08T15:17:46.731 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-base x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 6.0 M 2020-09-08T15:17:46.731 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-common x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 23 M 2020-09-08T15:17:46.731 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-selinux x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 25 k 2020-09-08T15:17:46.732 INFO:teuthology.orchestra.run.smithi065.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2020-09-08T15:17:46.732 INFO:teuthology.orchestra.run.smithi065.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-09-08T15:17:46.732 INFO:teuthology.orchestra.run.smithi065.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-09-08T15:17:46.732 INFO:teuthology.orchestra.run.smithi065.stdout: libcephfs2 x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 553 k 2020-09-08T15:17:46.732 INFO:teuthology.orchestra.run.smithi065.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-09-08T15:17:46.733 INFO:teuthology.orchestra.run.smithi065.stdout: librabbitmq x86_64 0.9.0-1.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2020-09-08T15:17:46.733 INFO:teuthology.orchestra.run.smithi065.stdout: libradosstriper1 x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 485 k 2020-09-08T15:17:46.733 INFO:teuthology.orchestra.run.smithi065.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2020-09-08T15:17:46.733 INFO:teuthology.orchestra.run.smithi065.stdout: librgw2 x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 3.4 M 2020-09-08T15:17:46.734 INFO:teuthology.orchestra.run.smithi065.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-09-08T15:17:46.734 INFO:teuthology.orchestra.run.smithi065.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2020-09-08T15:17:46.734 INFO:teuthology.orchestra.run.smithi065.stdout: python3-ceph-argparse x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 40 k 2020-09-08T15:17:46.734 INFO:teuthology.orchestra.run.smithi065.stdout: python3-ceph-common x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 72 k 2020-09-08T15:17:46.734 INFO:teuthology.orchestra.run.smithi065.stdout: python3-cephfs x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 204 k 2020-09-08T15:17:46.735 INFO:teuthology.orchestra.run.smithi065.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2020-09-08T15:17:46.735 INFO:teuthology.orchestra.run.smithi065.stdout: python3-rados x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 364 k 2020-09-08T15:17:46.735 INFO:teuthology.orchestra.run.smithi065.stdout: python3-rbd x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 335 k 2020-09-08T15:17:46.735 INFO:teuthology.orchestra.run.smithi065.stdout: python3-rgw x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 113 k 2020-09-08T15:17:46.735 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:17:46.736 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction Summary 2020-09-08T15:17:46.736 INFO:teuthology.orchestra.run.smithi065.stdout:======================================================================================================= 2020-09-08T15:17:46.736 INFO:teuthology.orchestra.run.smithi065.stdout:Install 22 Packages 2020-09-08T15:17:46.736 INFO:teuthology.orchestra.run.smithi065.stdout:Upgrade 2 Packages 2020-09-08T15:17:46.736 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:17:46.737 INFO:teuthology.orchestra.run.smithi065.stdout:Total download size: 52 M 2020-09-08T15:17:46.738 INFO:teuthology.orchestra.run.smithi065.stdout:Downloading Packages: 2020-09-08T15:17:47.461 INFO:teuthology.orchestra.run.smithi065.stdout:(1/24): ceph-base-16.0.0-5272.gdce4d291bd4.el8. 8.2 MB/s | 6.0 MB 00:00 2020-09-08T15:17:47.499 INFO:teuthology.orchestra.run.smithi065.stdout:(2/24): ceph-selinux-16.0.0-5272.gdce4d291bd4.e 647 kB/s | 25 kB 00:00 2020-09-08T15:17:47.551 INFO:teuthology.orchestra.run.smithi065.stdout:(3/24): libcephfs2-16.0.0-5272.gdce4d291bd4.el8 9.1 MB/s | 553 kB 00:00 2020-09-08T15:17:47.607 INFO:teuthology.orchestra.run.smithi065.stdout:(4/24): libradosstriper1-16.0.0-5272.gdce4d291b 8.4 MB/s | 485 kB 00:00 2020-09-08T15:17:47.932 INFO:teuthology.orchestra.run.smithi065.stdout:(5/24): librgw2-16.0.0-5272.gdce4d291bd4.el8.x8 11 MB/s | 3.4 MB 00:00 2020-09-08T15:17:47.978 INFO:teuthology.orchestra.run.smithi065.stdout:(6/24): python3-ceph-argparse-16.0.0-5272.gdce4 933 kB/s | 40 kB 00:00 2020-09-08T15:17:48.018 INFO:teuthology.orchestra.run.smithi065.stdout:(7/24): python3-ceph-common-16.0.0-5272.gdce4d2 1.6 MB/s | 72 kB 00:00 2020-09-08T15:17:48.069 INFO:teuthology.orchestra.run.smithi065.stdout:(8/24): python3-cephfs-16.0.0-5272.gdce4d291bd4 4.0 MB/s | 204 kB 00:00 2020-09-08T15:17:48.126 INFO:teuthology.orchestra.run.smithi065.stdout:(9/24): python3-rados-16.0.0-5272.gdce4d291bd4. 6.4 MB/s | 364 kB 00:00 2020-09-08T15:17:48.179 INFO:teuthology.orchestra.run.smithi065.stdout:(10/24): python3-rbd-16.0.0-5272.gdce4d291bd4.e 6.1 MB/s | 335 kB 00:00 2020-09-08T15:17:48.224 INFO:teuthology.orchestra.run.smithi065.stdout:(11/24): python3-rgw-16.0.0-5272.gdce4d291bd4.e 2.4 MB/s | 113 kB 00:00 2020-09-08T15:17:48.316 INFO:teuthology.orchestra.run.smithi065.stdout:(12/24): ceph-radosgw-16.0.0-5272.gdce4d291bd4. 6.7 MB/s | 11 MB 00:01 2020-09-08T15:17:48.327 INFO:teuthology.orchestra.run.smithi065.stdout:(13/24): fmt-6.2.1-1.el8.x86_64.rpm 1.1 MB/s | 116 kB 00:00 2020-09-08T15:17:48.365 INFO:teuthology.orchestra.run.smithi065.stdout:(14/24): leveldb-1.22-1.el8.x86_64.rpm 4.8 MB/s | 181 kB 00:00 2020-09-08T15:17:48.380 INFO:teuthology.orchestra.run.smithi065.stdout:(15/24): liboath-2.6.2-3.el8.x86_64.rpm 3.5 MB/s | 59 kB 00:00 2020-09-08T15:17:48.410 INFO:teuthology.orchestra.run.smithi065.stdout:(16/24): libunwind-1.3.1-3.el8.x86_64.rpm 2.5 MB/s | 75 kB 00:00 2020-09-08T15:17:48.442 INFO:teuthology.orchestra.run.smithi065.stdout:(17/24): gperftools-libs-2.7-6.el8.x86_64.rpm 2.5 MB/s | 315 kB 00:00 2020-09-08T15:17:48.451 INFO:teuthology.orchestra.run.smithi065.stdout:(18/24): librabbitmq-0.9.0-1.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2020-09-08T15:17:48.609 INFO:teuthology.orchestra.run.smithi065.stdout:(19/24): ceph-common-16.0.0-5272.gdce4d291bd4.e 12 MB/s | 23 MB 00:01 2020-09-08T15:17:48.647 INFO:teuthology.orchestra.run.smithi065.stdout:(20/24): python3-prettytable-0.7.2-14.el8.noarc 213 kB/s | 44 kB 00:00 2020-09-08T15:17:48.649 INFO:teuthology.orchestra.run.smithi065.stdout:(21/24): librdkafka-0.11.4-1.el8.x86_64.rpm 1.7 MB/s | 353 kB 00:00 2020-09-08T15:17:48.674 INFO:teuthology.orchestra.run.smithi065.stdout:(22/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2020-09-08T15:17:48.825 INFO:teuthology.orchestra.run.smithi065.stdout:(23/24): librbd1-16.0.0-5272.gdce4d291bd4.el8.x 13 MB/s | 2.2 MB 00:00 2020-09-08T15:17:48.873 INFO:teuthology.orchestra.run.smithi065.stdout:(24/24): librados2-16.0.0-5272.gdce4d291bd4.el8 16 MB/s | 3.7 MB 00:00 2020-09-08T15:17:48.876 INFO:teuthology.orchestra.run.smithi065.stdout:-------------------------------------------------------------------------------- 2020-09-08T15:17:48.876 INFO:teuthology.orchestra.run.smithi065.stdout:Total 24 MB/s | 52 MB 00:02 2020-09-08T15:17:48.880 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction check 2020-09-08T15:17:48.928 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction check succeeded. 2020-09-08T15:17:48.929 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction test 2020-09-08T15:17:49.345 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction test succeeded. 2020-09-08T15:17:49.348 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction 2020-09-08T15:17:50.541 INFO:teuthology.orchestra.run.smithi065.stdout: Preparing : 1/1 2020-09-08T15:17:50.742 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2020-09-08T15:17:50.914 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/26 2020-09-08T15:17:51.384 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/26 2020-09-08T15:17:51.589 INFO:teuthology.orchestra.run.smithi065.stdout: Upgrading : librados2-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 3/26 2020-09-08T15:17:51.688 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: librados2-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 3/26 2020-09-08T15:17:51.855 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-rados-2:16.0.0-5272.gdce4d291bd4.el8.x86_6 4/26 2020-09-08T15:17:52.069 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/26 2020-09-08T15:17:52.299 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : libcephfs2-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 6/26 2020-09-08T15:17:52.501 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: libcephfs2-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 6/26 2020-09-08T15:17:52.722 INFO:teuthology.orchestra.run.smithi065.stdout: Upgrading : librbd1-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 7/26 2020-09-08T15:17:52.815 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: librbd1-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 7/26 2020-09-08T15:17:52.972 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/26 2020-09-08T15:17:53.028 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/26 2020-09-08T15:17:53.514 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 9/26 2020-09-08T15:17:53.664 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : librgw2-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 10/26 2020-09-08T15:17:53.734 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: librgw2-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 10/26 2020-09-08T15:17:53.893 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2020-09-08T15:17:54.021 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-ceph-argparse-2:16.0.0-5272.gdce4d291bd4.e 12/26 2020-09-08T15:17:54.210 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-cephfs-2:16.0.0-5272.gdce4d291bd4.el8.x86_ 13/26 2020-09-08T15:17:54.388 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-rgw-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 14/26 2020-09-08T15:17:54.614 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-rbd-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 15/26 2020-09-08T15:17:54.721 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : libradosstriper1-2:16.0.0-5272.gdce4d291bd4.el8.x8 16/26 2020-09-08T15:17:54.818 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: libradosstriper1-2:16.0.0-5272.gdce4d291bd4.el8.x8 16/26 2020-09-08T15:17:54.976 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 17/26 2020-09-08T15:17:55.187 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 18/26 2020-09-08T15:17:55.390 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 19/26 2020-09-08T15:17:55.564 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-ceph-common-2:16.0.0-5272.gdce4d291bd4.el8 20/26 2020-09-08T15:17:59.053 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: ceph-common-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 21/26 2020-09-08T15:17:59.265 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : ceph-common-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 21/26 2020-09-08T15:18:00.072 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: ceph-common-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 21/26 2020-09-08T15:18:00.390 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : ceph-base-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 22/26 2020-09-08T15:18:00.480 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: ceph-base-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 22/26 2020-09-08T15:18:00.621 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : ceph-selinux-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 23/26 2020-09-08T15:18:18.090 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: ceph-selinux-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 23/26 2020-09-08T15:18:18.090 INFO:teuthology.orchestra.run.smithi065.stdout:skipping the directory /sys 2020-09-08T15:18:18.091 INFO:teuthology.orchestra.run.smithi065.stdout:skipping the directory /proc 2020-09-08T15:18:18.091 INFO:teuthology.orchestra.run.smithi065.stdout:skipping the directory /dev 2020-09-08T15:18:18.091 INFO:teuthology.orchestra.run.smithi065.stdout:skipping the directory /run 2020-09-08T15:18:18.091 INFO:teuthology.orchestra.run.smithi065.stdout:skipping the directory /mnt 2020-09-08T15:18:18.092 INFO:teuthology.orchestra.run.smithi065.stdout:skipping the directory /var/tmp 2020-09-08T15:18:18.092 INFO:teuthology.orchestra.run.smithi065.stdout:skipping the directory /home 2020-09-08T15:18:18.092 INFO:teuthology.orchestra.run.smithi065.stdout:skipping the directory /tmp 2020-09-08T15:18:18.092 INFO:teuthology.orchestra.run.smithi065.stdout:skipping the directory /dev 2020-09-08T15:18:18.092 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:18:19.289 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : ceph-radosgw-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 24/26 2020-09-08T15:18:19.368 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 24/26 2020-09-08T15:18:19.369 INFO:teuthology.orchestra.run.smithi065.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2020-09-08T15:18:19.570 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2020-09-08T15:18:19.571 INFO:teuthology.orchestra.run.smithi065.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2020-09-08T15:18:20.296 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2020-09-08T15:18:20.297 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : ceph-base-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 1/26 2020-09-08T15:18:20.297 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : ceph-common-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2/26 2020-09-08T15:18:20.297 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : ceph-radosgw-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 3/26 2020-09-08T15:18:20.297 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : ceph-selinux-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 4/26 2020-09-08T15:18:20.297 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : libcephfs2-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 5/26 2020-09-08T15:18:20.299 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : libradosstriper1-2:16.0.0-5272.gdce4d291bd4.el8.x8 6/26 2020-09-08T15:18:20.300 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : librgw2-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 7/26 2020-09-08T15:18:20.300 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-ceph-argparse-2:16.0.0-5272.gdce4d291bd4.e 8/26 2020-09-08T15:18:20.300 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-ceph-common-2:16.0.0-5272.gdce4d291bd4.el8 9/26 2020-09-08T15:18:20.300 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-cephfs-2:16.0.0-5272.gdce4d291bd4.el8.x86_ 10/26 2020-09-08T15:18:20.301 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-rados-2:16.0.0-5272.gdce4d291bd4.el8.x86_6 11/26 2020-09-08T15:18:20.301 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-rbd-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 12/26 2020-09-08T15:18:20.301 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-rgw-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 13/26 2020-09-08T15:18:20.301 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 14/26 2020-09-08T15:18:20.301 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 15/26 2020-09-08T15:18:20.302 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : leveldb-1.22-1.el8.x86_64 16/26 2020-09-08T15:18:20.302 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 17/26 2020-09-08T15:18:20.302 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 18/26 2020-09-08T15:18:20.302 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 19/26 2020-09-08T15:18:20.302 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 20/26 2020-09-08T15:18:20.303 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 21/26 2020-09-08T15:18:20.303 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 22/26 2020-09-08T15:18:20.303 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : librados2-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 23/26 2020-09-08T15:18:20.303 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2020-09-08T15:18:20.303 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : librbd1-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 25/26 2020-09-08T15:18:20.948 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2020-09-08T15:18:20.949 INFO:teuthology.orchestra.run.smithi065.stdout:Installed products updated. 2020-09-08T15:18:23.033 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:18:23.034 INFO:teuthology.orchestra.run.smithi065.stdout:Upgraded: 2020-09-08T15:18:23.034 INFO:teuthology.orchestra.run.smithi065.stdout: librados2-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:18:23.034 INFO:teuthology.orchestra.run.smithi065.stdout: librbd1-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:18:23.034 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:18:23.035 INFO:teuthology.orchestra.run.smithi065.stdout:Installed: 2020-09-08T15:18:23.035 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-base-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:18:23.035 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-common-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:18:23.035 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-radosgw-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:18:23.035 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-selinux-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:18:23.036 INFO:teuthology.orchestra.run.smithi065.stdout: fmt-6.2.1-1.el8.x86_64 2020-09-08T15:18:23.036 INFO:teuthology.orchestra.run.smithi065.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-09-08T15:18:23.036 INFO:teuthology.orchestra.run.smithi065.stdout: leveldb-1.22-1.el8.x86_64 2020-09-08T15:18:23.036 INFO:teuthology.orchestra.run.smithi065.stdout: libcephfs2-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:18:23.036 INFO:teuthology.orchestra.run.smithi065.stdout: liboath-2.6.2-3.el8.x86_64 2020-09-08T15:18:23.037 INFO:teuthology.orchestra.run.smithi065.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-09-08T15:18:23.037 INFO:teuthology.orchestra.run.smithi065.stdout: libradosstriper1-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:18:23.037 INFO:teuthology.orchestra.run.smithi065.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-09-08T15:18:23.037 INFO:teuthology.orchestra.run.smithi065.stdout: librgw2-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:18:23.037 INFO:teuthology.orchestra.run.smithi065.stdout: libunwind-1.3.1-3.el8.x86_64 2020-09-08T15:18:23.046 INFO:teuthology.orchestra.run.smithi065.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-09-08T15:18:23.053 INFO:teuthology.orchestra.run.smithi065.stdout: python3-ceph-argparse-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:18:23.053 INFO:teuthology.orchestra.run.smithi065.stdout: python3-ceph-common-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:18:23.054 INFO:teuthology.orchestra.run.smithi065.stdout: python3-cephfs-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:18:23.054 INFO:teuthology.orchestra.run.smithi065.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-09-08T15:18:23.054 INFO:teuthology.orchestra.run.smithi065.stdout: python3-rados-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:18:23.054 INFO:teuthology.orchestra.run.smithi065.stdout: python3-rbd-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:18:23.054 INFO:teuthology.orchestra.run.smithi065.stdout: python3-rgw-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:18:23.055 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:18:23.055 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:18:23.217 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install ceph-test 2020-09-08T15:18:23.591 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:18:24.184 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 66 kB/s | 2.4 kB 00:00 2020-09-08T15:18:24.283 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 77 kB/s | 2.8 kB 00:00 2020-09-08T15:18:25.853 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:18:25.854 INFO:teuthology.orchestra.run.smithi065.stdout:============================================================================================ 2020-09-08T15:18:25.855 INFO:teuthology.orchestra.run.smithi065.stdout: Package Arch Version Repository Size 2020-09-08T15:18:25.855 INFO:teuthology.orchestra.run.smithi065.stdout:============================================================================================ 2020-09-08T15:18:25.856 INFO:teuthology.orchestra.run.smithi065.stdout:Installing: 2020-09-08T15:18:25.856 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-test x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 46 M 2020-09-08T15:18:25.856 INFO:teuthology.orchestra.run.smithi065.stdout:Installing dependencies: 2020-09-08T15:18:25.856 INFO:teuthology.orchestra.run.smithi065.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2020-09-08T15:18:25.857 INFO:teuthology.orchestra.run.smithi065.stdout: libxslt x86_64 1.1.32-4.el8 rhel-8-for-x86_64-baseos-rpms 249 k 2020-09-08T15:18:25.857 INFO:teuthology.orchestra.run.smithi065.stdout: oniguruma x86_64 6.8.2-1.el8 rhel-8-for-x86_64-appstream-rpms 188 k 2020-09-08T15:18:25.857 INFO:teuthology.orchestra.run.smithi065.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2020-09-08T15:18:25.857 INFO:teuthology.orchestra.run.smithi065.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-09-08T15:18:25.857 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:18:25.858 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction Summary 2020-09-08T15:18:25.858 INFO:teuthology.orchestra.run.smithi065.stdout:============================================================================================ 2020-09-08T15:18:25.858 INFO:teuthology.orchestra.run.smithi065.stdout:Install 6 Packages 2020-09-08T15:18:25.858 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:18:25.858 INFO:teuthology.orchestra.run.smithi065.stdout:Total download size: 47 M 2020-09-08T15:18:25.858 INFO:teuthology.orchestra.run.smithi065.stdout:Installed size: 200 M 2020-09-08T15:18:25.859 INFO:teuthology.orchestra.run.smithi065.stdout:Downloading Packages: 2020-09-08T15:18:25.909 INFO:teuthology.orchestra.run.smithi065.stdout:(1/6): libxslt-1.1.32-4.el8.x86_64.rpm 5.2 MB/s | 249 kB 00:00 2020-09-08T15:18:25.923 INFO:teuthology.orchestra.run.smithi065.stdout:(2/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.0 MB/s | 69 kB 00:00 2020-09-08T15:18:25.933 INFO:teuthology.orchestra.run.smithi065.stdout:(3/6): jq-1.5-12.el8.x86_64.rpm 5.2 MB/s | 161 kB 00:00 2020-09-08T15:18:25.966 INFO:teuthology.orchestra.run.smithi065.stdout:(4/6): oniguruma-6.8.2-1.el8.x86_64.rpm 4.2 MB/s | 188 kB 00:00 2020-09-08T15:18:25.973 INFO:teuthology.orchestra.run.smithi065.stdout:(5/6): socat-1.7.3.3-2.el8.x86_64.rpm 7.6 MB/s | 302 kB 00:00 2020-09-08T15:18:28.385 INFO:teuthology.orchestra.run.smithi065.stdout:(6/6): ceph-test-16.0.0-5272.gdce4d291bd4.el8.x 18 MB/s | 46 MB 00:02 2020-09-08T15:18:28.386 INFO:teuthology.orchestra.run.smithi065.stdout:-------------------------------------------------------------------------------- 2020-09-08T15:18:28.386 INFO:teuthology.orchestra.run.smithi065.stdout:Total 19 MB/s | 47 MB 00:02 2020-09-08T15:18:28.391 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction check 2020-09-08T15:18:28.416 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction check succeeded. 2020-09-08T15:18:28.416 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction test 2020-09-08T15:18:28.731 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction test succeeded. 2020-09-08T15:18:28.734 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction 2020-09-08T15:18:29.252 INFO:teuthology.orchestra.run.smithi065.stdout: Preparing : 1/1 2020-09-08T15:18:29.438 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 1/6 2020-09-08T15:18:29.619 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 2/6 2020-09-08T15:18:29.682 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 2/6 2020-09-08T15:18:29.882 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : jq-1.5-12.el8.x86_64 3/6 2020-09-08T15:18:30.160 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : libxslt-1.1.32-4.el8.x86_64 4/6 2020-09-08T15:18:34.864 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 5/6 2020-09-08T15:18:35.100 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : ceph-test-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 6/6 2020-09-08T15:18:35.324 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: ceph-test-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 6/6 2020-09-08T15:18:35.324 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : ceph-test-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 1/6 2020-09-08T15:18:35.324 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2020-09-08T15:18:35.325 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : libxslt-1.1.32-4.el8.x86_64 3/6 2020-09-08T15:18:35.325 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : jq-1.5-12.el8.x86_64 4/6 2020-09-08T15:18:35.325 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 5/6 2020-09-08T15:18:35.639 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 6/6 2020-09-08T15:18:35.639 INFO:teuthology.orchestra.run.smithi065.stdout:Installed products updated. 2020-09-08T15:18:37.689 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:18:37.690 INFO:teuthology.orchestra.run.smithi065.stdout:Installed: 2020-09-08T15:18:37.690 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-test-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:18:37.690 INFO:teuthology.orchestra.run.smithi065.stdout: jq-1.5-12.el8.x86_64 2020-09-08T15:18:37.690 INFO:teuthology.orchestra.run.smithi065.stdout: libxslt-1.1.32-4.el8.x86_64 2020-09-08T15:18:37.691 INFO:teuthology.orchestra.run.smithi065.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-09-08T15:18:37.691 INFO:teuthology.orchestra.run.smithi065.stdout: socat-1.7.3.3-2.el8.x86_64 2020-09-08T15:18:37.691 INFO:teuthology.orchestra.run.smithi065.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-09-08T15:18:37.691 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:18:37.692 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:18:37.847 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install ceph 2020-09-08T15:18:38.208 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:18:38.749 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 66 kB/s | 2.4 kB 00:00 2020-09-08T15:18:38.848 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 78 kB/s | 2.8 kB 00:00 2020-09-08T15:18:40.092 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:18:40.096 INFO:teuthology.orchestra.run.smithi065.stdout:========================================================================================================== 2020-09-08T15:18:40.096 INFO:teuthology.orchestra.run.smithi065.stdout: Package Arch Version Repository Size 2020-09-08T15:18:40.096 INFO:teuthology.orchestra.run.smithi065.stdout:========================================================================================================== 2020-09-08T15:18:40.097 INFO:teuthology.orchestra.run.smithi065.stdout:Installing: 2020-09-08T15:18:40.097 INFO:teuthology.orchestra.run.smithi065.stdout: ceph x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 6.5 k 2020-09-08T15:18:40.097 INFO:teuthology.orchestra.run.smithi065.stdout:Installing dependencies: 2020-09-08T15:18:40.097 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-mds x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 2.2 M 2020-09-08T15:18:40.098 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-mgr x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 1.5 M 2020-09-08T15:18:40.098 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-mgr-modules-core noarch 2:16.0.0-5272.gdce4d291bd4.el8 ceph-noarch 189 k 2020-09-08T15:18:40.098 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-mon x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 4.9 M 2020-09-08T15:18:40.098 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-osd x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 18 M 2020-09-08T15:18:40.098 INFO:teuthology.orchestra.run.smithi065.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2020-09-08T15:18:40.099 INFO:teuthology.orchestra.run.smithi065.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2020-09-08T15:18:40.099 INFO:teuthology.orchestra.run.smithi065.stdout: python3-cheroot noarch 8.2.1-1.el8 epel 145 k 2020-09-08T15:18:40.100 INFO:teuthology.orchestra.run.smithi065.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2020-09-08T15:18:40.100 INFO:teuthology.orchestra.run.smithi065.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2020-09-08T15:18:40.100 INFO:teuthology.orchestra.run.smithi065.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2020-09-08T15:18:40.100 INFO:teuthology.orchestra.run.smithi065.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2020-09-08T15:18:40.100 INFO:teuthology.orchestra.run.smithi065.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2020-09-08T15:18:40.101 INFO:teuthology.orchestra.run.smithi065.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2020-09-08T15:18:40.101 INFO:teuthology.orchestra.run.smithi065.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2020-09-08T15:18:40.101 INFO:teuthology.orchestra.run.smithi065.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2020-09-08T15:18:40.101 INFO:teuthology.orchestra.run.smithi065.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2020-09-08T15:18:40.101 INFO:teuthology.orchestra.run.smithi065.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2020-09-08T15:18:40.107 INFO:teuthology.orchestra.run.smithi065.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2020-09-08T15:18:40.107 INFO:teuthology.orchestra.run.smithi065.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2020-09-08T15:18:40.107 INFO:teuthology.orchestra.run.smithi065.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2020-09-08T15:18:40.107 INFO:teuthology.orchestra.run.smithi065.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2020-09-08T15:18:40.108 INFO:teuthology.orchestra.run.smithi065.stdout: python3-trustme noarch 0.5.2-4.el8 epel 26 k 2020-09-08T15:18:40.108 INFO:teuthology.orchestra.run.smithi065.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2020-09-08T15:18:40.108 INFO:teuthology.orchestra.run.smithi065.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-09-08T15:18:40.108 INFO:teuthology.orchestra.run.smithi065.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2020-09-08T15:18:40.108 INFO:teuthology.orchestra.run.smithi065.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2020-09-08T15:18:40.109 INFO:teuthology.orchestra.run.smithi065.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2020-09-08T15:18:40.109 INFO:teuthology.orchestra.run.smithi065.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2020-09-08T15:18:40.132 INFO:teuthology.orchestra.run.smithi065.stdout:Installing weak dependencies: 2020-09-08T15:18:40.132 INFO:teuthology.orchestra.run.smithi065.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2020-09-08T15:18:40.133 INFO:teuthology.orchestra.run.smithi065.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2020-09-08T15:18:40.133 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:18:40.133 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction Summary 2020-09-08T15:18:40.133 INFO:teuthology.orchestra.run.smithi065.stdout:========================================================================================================== 2020-09-08T15:18:40.134 INFO:teuthology.orchestra.run.smithi065.stdout:Install 32 Packages 2020-09-08T15:18:40.134 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:18:40.141 INFO:teuthology.orchestra.run.smithi065.stdout:Total download size: 31 M 2020-09-08T15:18:40.141 INFO:teuthology.orchestra.run.smithi065.stdout:Installed size: 109 M 2020-09-08T15:18:40.141 INFO:teuthology.orchestra.run.smithi065.stdout:Downloading Packages: 2020-09-08T15:18:40.202 INFO:teuthology.orchestra.run.smithi065.stdout:(1/32): ceph-16.0.0-5272.gdce4d291bd4.el8.x86_6 65 kB/s | 6.5 kB 00:00 2020-09-08T15:18:40.462 INFO:teuthology.orchestra.run.smithi065.stdout:(2/32): ceph-mds-16.0.0-5272.gdce4d291bd4.el8.x 6.0 MB/s | 2.2 MB 00:00 2020-09-08T15:18:40.513 INFO:teuthology.orchestra.run.smithi065.stdout:(3/32): ceph-mgr-16.0.0-5272.gdce4d291bd4.el8.x 3.7 MB/s | 1.5 MB 00:00 2020-09-08T15:18:40.592 INFO:teuthology.orchestra.run.smithi065.stdout:(4/32): ceph-mgr-modules-core-16.0.0-5272.gdce4 2.3 MB/s | 189 kB 00:00 2020-09-08T15:18:40.647 INFO:teuthology.orchestra.run.smithi065.stdout:(5/32): ceph-mon-16.0.0-5272.gdce4d291bd4.el8.x 11 MB/s | 4.9 MB 00:00 2020-09-08T15:18:40.728 INFO:teuthology.orchestra.run.smithi065.stdout:(6/32): python3-beautifulsoup4-4.6.3-2.el8.1.no 2.3 MB/s | 185 kB 00:00 2020-09-08T15:18:40.746 INFO:teuthology.orchestra.run.smithi065.stdout:(7/32): python3-cheroot-8.2.1-1.el8.noarch.rpm 8.1 MB/s | 145 kB 00:00 2020-09-08T15:18:40.781 INFO:teuthology.orchestra.run.smithi065.stdout:(8/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 230 kB/s | 44 kB 00:00 2020-09-08T15:18:40.833 INFO:teuthology.orchestra.run.smithi065.stdout:(9/32): python3-cssselect-0.9.2-10.el8.noarch.r 785 kB/s | 40 kB 00:00 2020-09-08T15:18:40.852 INFO:teuthology.orchestra.run.smithi065.stdout:(10/32): python3-jaraco-6.2-6.el8.noarch.rpm 565 kB/s | 11 kB 00:00 2020-09-08T15:18:40.866 INFO:teuthology.orchestra.run.smithi065.stdout:(11/32): python3-cherrypy-18.4.0-1.el8.noarch.r 3.1 MB/s | 384 kB 00:00 2020-09-08T15:18:40.872 INFO:teuthology.orchestra.run.smithi065.stdout:(12/32): python3-jaraco-functools-2.0-4.el8.noa 894 kB/s | 18 kB 00:00 2020-09-08T15:18:40.892 INFO:teuthology.orchestra.run.smithi065.stdout:(13/32): python3-more-itertools-7.2.0-3.el8.noa 2.9 MB/s | 59 kB 00:00 2020-09-08T15:18:40.933 INFO:teuthology.orchestra.run.smithi065.stdout:(14/32): python3-pecan-1.3.2-9.el8.noarch.rpm 6.8 MB/s | 283 kB 00:00 2020-09-08T15:18:40.958 INFO:teuthology.orchestra.run.smithi065.stdout:(15/32): python3-portend-2.6-1.el8.noarch.rpm 790 kB/s | 16 kB 00:00 2020-09-08T15:18:40.965 INFO:teuthology.orchestra.run.smithi065.stdout:(16/32): python3-logutils-0.3.5-11.el8.noarch.r 496 kB/s | 49 kB 00:00 2020-09-08T15:18:40.974 INFO:teuthology.orchestra.run.smithi065.stdout:(17/32): python3-simplegeneric-0.8.1-17.el8.noa 953 kB/s | 19 kB 00:00 2020-09-08T15:18:40.981 INFO:teuthology.orchestra.run.smithi065.stdout:(18/32): python3-singledispatch-3.4.0.3-18.el8. 1.4 MB/s | 24 kB 00:00 2020-09-08T15:18:40.993 INFO:teuthology.orchestra.run.smithi065.stdout:(19/32): python3-tempora-1.14.1-5.el8.noarch.rp 1.4 MB/s | 29 kB 00:00 2020-09-08T15:18:41.006 INFO:teuthology.orchestra.run.smithi065.stdout:(20/32): python3-trustme-0.5.2-4.el8.noarch.rpm 1.6 MB/s | 26 kB 00:00 2020-09-08T15:18:41.014 INFO:teuthology.orchestra.run.smithi065.stdout:(21/32): python3-waitress-1.2.1-2.el8.1.noarch. 11 MB/s | 241 kB 00:00 2020-09-08T15:18:41.018 INFO:teuthology.orchestra.run.smithi065.stdout:(22/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 13 MB/s | 251 kB 00:00 2020-09-08T15:18:41.033 INFO:teuthology.orchestra.run.smithi065.stdout:(23/32): python3-zc-lockfile-2.0-2.el8.noarch.r 1.4 MB/s | 23 kB 00:00 2020-09-08T15:18:41.039 INFO:teuthology.orchestra.run.smithi065.stdout:(24/32): python3-webtest-2.0.33-1.el8.noarch.rp 4.0 MB/s | 85 kB 00:00 2020-09-08T15:18:41.083 INFO:teuthology.orchestra.run.smithi065.stdout:(25/32): python3-webencodings-0.5.1-6.el8.noarc 540 kB/s | 27 kB 00:00 2020-09-08T15:18:41.112 INFO:teuthology.orchestra.run.smithi065.stdout:(26/32): python3-lxml-4.2.3-1.el8.x86_64.rpm 20 MB/s | 1.5 MB 00:00 2020-09-08T15:18:41.123 INFO:teuthology.orchestra.run.smithi065.stdout:(27/32): python3-werkzeug-0.12.2-4.el8.noarch.r 11 MB/s | 457 kB 00:00 2020-09-08T15:18:41.141 INFO:teuthology.orchestra.run.smithi065.stdout:(28/32): python3-mako-1.0.6-13.el8.noarch.rpm 5.4 MB/s | 157 kB 00:00 2020-09-08T15:18:41.160 INFO:teuthology.orchestra.run.smithi065.stdout:(29/32): python3-html5lib-0.999999999-6.el8.noa 5.9 MB/s | 214 kB 00:00 2020-09-08T15:18:41.174 INFO:teuthology.orchestra.run.smithi065.stdout:(30/32): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2020-09-08T15:18:41.280 INFO:teuthology.orchestra.run.smithi065.stdout:(31/32): ceph-osd-16.0.0-5272.gdce4d291bd4.el8. 22 MB/s | 18 MB 00:00 2020-09-08T15:18:41.282 INFO:teuthology.orchestra.run.smithi065.stdout:(32/32): python3-markupsafe-0.23-19.el8.x86_64. 315 kB/s | 39 kB 00:00 2020-09-08T15:18:41.283 INFO:teuthology.orchestra.run.smithi065.stdout:-------------------------------------------------------------------------------- 2020-09-08T15:18:41.284 INFO:teuthology.orchestra.run.smithi065.stdout:Total 26 MB/s | 31 MB 00:01 2020-09-08T15:18:41.292 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction check 2020-09-08T15:18:41.334 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction check succeeded. 2020-09-08T15:18:41.334 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction test 2020-09-08T15:18:41.642 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction test succeeded. 2020-09-08T15:18:41.644 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction 2020-09-08T15:18:42.868 INFO:teuthology.orchestra.run.smithi065.stdout: Preparing : 1/1 2020-09-08T15:18:43.120 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2020-09-08T15:18:43.337 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2020-09-08T15:18:43.574 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 3/32 2020-09-08T15:18:43.801 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 4/32 2020-09-08T15:18:44.100 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 5/32 2020-09-08T15:18:44.303 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 6/32 2020-09-08T15:18:44.574 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 7/32 2020-09-08T15:18:44.774 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 8/32 2020-09-08T15:18:45.010 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 9/32 2020-09-08T15:18:45.215 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 10/32 2020-09-08T15:18:45.408 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 11/32 2020-09-08T15:18:45.595 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 12/32 2020-09-08T15:18:45.798 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 13/32 2020-09-08T15:18:46.010 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 14/32 2020-09-08T15:18:46.171 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 15/32 2020-09-08T15:18:46.422 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 16/32 2020-09-08T15:18:46.664 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 17/32 2020-09-08T15:18:46.866 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 18/32 2020-09-08T15:18:47.118 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-portend-2.6-1.el8.noarch 19/32 2020-09-08T15:18:47.487 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 20/32 2020-09-08T15:18:47.884 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 21/32 2020-09-08T15:18:48.175 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 22/32 2020-09-08T15:18:48.473 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 23/32 2020-09-08T15:18:48.798 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 24/32 2020-09-08T15:18:49.051 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 25/32 2020-09-08T15:18:49.338 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 26/32 2020-09-08T15:18:49.703 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-5272.gdce4d291bd4.e 27/32 2020-09-08T15:18:49.875 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : ceph-mgr-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 28/32 2020-09-08T15:18:51.498 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: ceph-mgr-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 28/32 2020-09-08T15:18:51.702 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : ceph-osd-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 29/32 2020-09-08T15:18:52.178 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: ceph-osd-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 29/32 2020-09-08T15:18:52.777 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : ceph-mon-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 30/32 2020-09-08T15:18:52.986 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: ceph-mon-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 30/32 2020-09-08T15:18:53.170 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : ceph-mds-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 31/32 2020-09-08T15:18:53.186 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: ceph-mds-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 31/32 2020-09-08T15:18:53.322 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : ceph-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 32/32 2020-09-08T15:18:53.664 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: ceph-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 32/32 2020-09-08T15:18:53.665 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : ceph-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 1/32 2020-09-08T15:18:53.665 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : ceph-mds-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2/32 2020-09-08T15:18:53.665 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : ceph-mgr-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 3/32 2020-09-08T15:18:53.666 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : ceph-mon-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 4/32 2020-09-08T15:18:53.666 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : ceph-osd-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 5/32 2020-09-08T15:18:53.666 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-5272.gdce4d291bd4.e 6/32 2020-09-08T15:18:53.666 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/32 2020-09-08T15:18:53.666 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/32 2020-09-08T15:18:53.667 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 9/32 2020-09-08T15:18:53.667 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/32 2020-09-08T15:18:53.667 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 11/32 2020-09-08T15:18:53.667 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 12/32 2020-09-08T15:18:53.667 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 13/32 2020-09-08T15:18:53.668 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 14/32 2020-09-08T15:18:53.668 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 15/32 2020-09-08T15:18:53.668 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 16/32 2020-09-08T15:18:53.668 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-portend-2.6-1.el8.noarch 17/32 2020-09-08T15:18:53.698 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 18/32 2020-09-08T15:18:53.698 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 19/32 2020-09-08T15:18:53.698 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 20/32 2020-09-08T15:18:53.699 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 21/32 2020-09-08T15:18:53.699 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 22/32 2020-09-08T15:18:53.699 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 23/32 2020-09-08T15:18:53.699 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 24/32 2020-09-08T15:18:53.699 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 25/32 2020-09-08T15:18:53.700 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 26/32 2020-09-08T15:18:53.700 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 27/32 2020-09-08T15:18:53.700 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 28/32 2020-09-08T15:18:53.700 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 29/32 2020-09-08T15:18:53.700 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 30/32 2020-09-08T15:18:53.701 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 31/32 2020-09-08T15:18:54.364 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 32/32 2020-09-08T15:18:54.364 INFO:teuthology.orchestra.run.smithi065.stdout:Installed products updated. 2020-09-08T15:18:56.363 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:18:56.363 INFO:teuthology.orchestra.run.smithi065.stdout:Installed: 2020-09-08T15:18:56.364 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:18:56.364 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-mds-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:18:56.364 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-mgr-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:18:56.364 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-mgr-modules-core-2:16.0.0-5272.gdce4d291bd4.el8.noarch 2020-09-08T15:18:56.364 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-mon-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:18:56.365 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-osd-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:18:56.365 INFO:teuthology.orchestra.run.smithi065.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-09-08T15:18:56.365 INFO:teuthology.orchestra.run.smithi065.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-09-08T15:18:56.365 INFO:teuthology.orchestra.run.smithi065.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-09-08T15:18:56.365 INFO:teuthology.orchestra.run.smithi065.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-09-08T15:18:56.366 INFO:teuthology.orchestra.run.smithi065.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-09-08T15:18:56.366 INFO:teuthology.orchestra.run.smithi065.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-09-08T15:18:56.366 INFO:teuthology.orchestra.run.smithi065.stdout: python3-jaraco-6.2-6.el8.noarch 2020-09-08T15:18:56.366 INFO:teuthology.orchestra.run.smithi065.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-09-08T15:18:56.366 INFO:teuthology.orchestra.run.smithi065.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-09-08T15:18:56.367 INFO:teuthology.orchestra.run.smithi065.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-09-08T15:18:56.367 INFO:teuthology.orchestra.run.smithi065.stdout: python3-mako-1.0.6-13.el8.noarch 2020-09-08T15:18:56.367 INFO:teuthology.orchestra.run.smithi065.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-09-08T15:18:56.367 INFO:teuthology.orchestra.run.smithi065.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-09-08T15:18:56.367 INFO:teuthology.orchestra.run.smithi065.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-09-08T15:18:56.368 INFO:teuthology.orchestra.run.smithi065.stdout: python3-portend-2.6-1.el8.noarch 2020-09-08T15:18:56.368 INFO:teuthology.orchestra.run.smithi065.stdout: python3-pytz-2017.2-9.el8.noarch 2020-09-08T15:18:56.368 INFO:teuthology.orchestra.run.smithi065.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-09-08T15:18:56.368 INFO:teuthology.orchestra.run.smithi065.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-09-08T15:18:56.368 INFO:teuthology.orchestra.run.smithi065.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-09-08T15:18:56.368 INFO:teuthology.orchestra.run.smithi065.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-09-08T15:18:56.369 INFO:teuthology.orchestra.run.smithi065.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-09-08T15:18:56.369 INFO:teuthology.orchestra.run.smithi065.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-09-08T15:18:56.375 INFO:teuthology.orchestra.run.smithi065.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-09-08T15:18:56.375 INFO:teuthology.orchestra.run.smithi065.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-09-08T15:18:56.375 INFO:teuthology.orchestra.run.smithi065.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-09-08T15:18:56.375 INFO:teuthology.orchestra.run.smithi065.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-09-08T15:18:56.375 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:18:56.376 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:18:56.536 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install ceph-base 2020-09-08T15:18:56.915 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:18:57.511 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 66 kB/s | 2.4 kB 00:00 2020-09-08T15:18:57.599 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 76 kB/s | 2.8 kB 00:00 2020-09-08T15:18:58.419 INFO:teuthology.orchestra.run.smithi065.stdout:Package ceph-base-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 is already installed. 2020-09-08T15:18:58.682 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:18:58.683 INFO:teuthology.orchestra.run.smithi065.stdout:Nothing to do. 2020-09-08T15:18:58.683 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:18:58.833 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install cephadm 2020-09-08T15:18:59.202 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:18:59.767 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 67 kB/s | 2.4 kB 00:00 2020-09-08T15:18:59.879 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 76 kB/s | 2.8 kB 00:00 2020-09-08T15:19:00.969 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:19:00.970 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================ 2020-09-08T15:19:00.971 INFO:teuthology.orchestra.run.smithi065.stdout: Package Arch Version Repo Size 2020-09-08T15:19:00.971 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================ 2020-09-08T15:19:00.971 INFO:teuthology.orchestra.run.smithi065.stdout:Installing: 2020-09-08T15:19:00.971 INFO:teuthology.orchestra.run.smithi065.stdout: cephadm x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 55 k 2020-09-08T15:19:00.971 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:00.972 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction Summary 2020-09-08T15:19:00.972 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================ 2020-09-08T15:19:00.972 INFO:teuthology.orchestra.run.smithi065.stdout:Install 1 Package 2020-09-08T15:19:00.972 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:00.972 INFO:teuthology.orchestra.run.smithi065.stdout:Total download size: 55 k 2020-09-08T15:19:00.973 INFO:teuthology.orchestra.run.smithi065.stdout:Installed size: 206 k 2020-09-08T15:19:00.973 INFO:teuthology.orchestra.run.smithi065.stdout:Downloading Packages: 2020-09-08T15:19:01.121 INFO:teuthology.orchestra.run.smithi065.stdout:cephadm-16.0.0-5272.gdce4d291bd4.el8.x86_64.rpm 380 kB/s | 55 kB 00:00 2020-09-08T15:19:01.122 INFO:teuthology.orchestra.run.smithi065.stdout:-------------------------------------------------------------------------------- 2020-09-08T15:19:01.122 INFO:teuthology.orchestra.run.smithi065.stdout:Total 376 kB/s | 55 kB 00:00 2020-09-08T15:19:01.122 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction check 2020-09-08T15:19:01.129 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction check succeeded. 2020-09-08T15:19:01.130 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction test 2020-09-08T15:19:01.130 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction test succeeded. 2020-09-08T15:19:01.130 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction 2020-09-08T15:19:01.170 INFO:teuthology.orchestra.run.smithi065.stdout: Preparing : 1/1 2020-09-08T15:19:02.771 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: cephadm-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 1/1 2020-09-08T15:19:03.345 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : cephadm-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 1/1 2020-09-08T15:19:03.512 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: cephadm-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 1/1 2020-09-08T15:19:04.005 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : cephadm-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 1/1 2020-09-08T15:19:04.005 INFO:teuthology.orchestra.run.smithi065.stdout:Installed products updated. 2020-09-08T15:19:06.445 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:06.446 INFO:teuthology.orchestra.run.smithi065.stdout:Installed: 2020-09-08T15:19:06.446 INFO:teuthology.orchestra.run.smithi065.stdout: cephadm-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:19:06.446 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:06.446 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:19:06.626 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install ceph-immutable-object-cache 2020-09-08T15:19:07.007 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:19:07.641 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 kB/s | 2.4 kB 00:00 2020-09-08T15:19:07.740 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 74 kB/s | 2.8 kB 00:00 2020-09-08T15:19:08.859 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:19:08.860 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================ 2020-09-08T15:19:08.860 INFO:teuthology.orchestra.run.smithi065.stdout: Package Arch Version Repo Size 2020-09-08T15:19:08.860 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================ 2020-09-08T15:19:08.861 INFO:teuthology.orchestra.run.smithi065.stdout:Installing: 2020-09-08T15:19:08.861 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-immutable-object-cache x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 203 k 2020-09-08T15:19:08.861 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:08.861 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction Summary 2020-09-08T15:19:08.861 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================ 2020-09-08T15:19:08.862 INFO:teuthology.orchestra.run.smithi065.stdout:Install 1 Package 2020-09-08T15:19:08.862 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:08.862 INFO:teuthology.orchestra.run.smithi065.stdout:Total download size: 203 k 2020-09-08T15:19:08.862 INFO:teuthology.orchestra.run.smithi065.stdout:Installed size: 692 k 2020-09-08T15:19:08.862 INFO:teuthology.orchestra.run.smithi065.stdout:Downloading Packages: 2020-09-08T15:19:09.052 INFO:teuthology.orchestra.run.smithi065.stdout:ceph-immutable-object-cache-16.0.0-5272.gdce4d2 1.0 MB/s | 203 kB 00:00 2020-09-08T15:19:09.053 INFO:teuthology.orchestra.run.smithi065.stdout:-------------------------------------------------------------------------------- 2020-09-08T15:19:09.053 INFO:teuthology.orchestra.run.smithi065.stdout:Total 1.0 MB/s | 203 kB 00:00 2020-09-08T15:19:09.053 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction check 2020-09-08T15:19:09.067 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction check succeeded. 2020-09-08T15:19:09.067 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction test 2020-09-08T15:19:09.120 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction test succeeded. 2020-09-08T15:19:09.122 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction 2020-09-08T15:19:09.251 INFO:teuthology.orchestra.run.smithi065.stdout: Preparing : 1/1 2020-09-08T15:19:09.448 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-5272.gdce4d291b 1/1 2020-09-08T15:19:09.793 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-5272.gdce4d291b 1/1 2020-09-08T15:19:10.060 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-5272.gdce4d291b 1/1 2020-09-08T15:19:10.061 INFO:teuthology.orchestra.run.smithi065.stdout:Installed products updated. 2020-09-08T15:19:12.173 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:12.174 INFO:teuthology.orchestra.run.smithi065.stdout:Installed: 2020-09-08T15:19:12.174 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-immutable-object-cache-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:19:12.175 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:12.175 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:19:12.348 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install ceph-mgr 2020-09-08T15:19:12.720 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:19:13.302 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 kB/s | 2.4 kB 00:00 2020-09-08T15:19:13.399 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 75 kB/s | 2.8 kB 00:00 2020-09-08T15:19:14.233 INFO:teuthology.orchestra.run.smithi065.stdout:Package ceph-mgr-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 is already installed. 2020-09-08T15:19:14.493 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:19:14.494 INFO:teuthology.orchestra.run.smithi065.stdout:Nothing to do. 2020-09-08T15:19:14.495 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:19:14.635 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install ceph-mgr-dashboard 2020-09-08T15:19:15.003 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:19:15.585 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 59 kB/s | 2.4 kB 00:00 2020-09-08T15:19:15.681 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 74 kB/s | 2.8 kB 00:00 2020-09-08T15:19:16.805 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:19:16.806 INFO:teuthology.orchestra.run.smithi065.stdout:====================================================================================================== 2020-09-08T15:19:16.807 INFO:teuthology.orchestra.run.smithi065.stdout: Package Arch Version Repository Size 2020-09-08T15:19:16.807 INFO:teuthology.orchestra.run.smithi065.stdout:====================================================================================================== 2020-09-08T15:19:16.807 INFO:teuthology.orchestra.run.smithi065.stdout:Installing: 2020-09-08T15:19:16.808 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-mgr-dashboard noarch 2:16.0.0-5272.gdce4d291bd4.el8 ceph-noarch 3.2 M 2020-09-08T15:19:16.808 INFO:teuthology.orchestra.run.smithi065.stdout:Installing dependencies: 2020-09-08T15:19:16.808 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-grafana-dashboards noarch 2:16.0.0-5272.gdce4d291bd4.el8 ceph-noarch 24 k 2020-09-08T15:19:16.809 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-prometheus-alerts noarch 2:16.0.0-5272.gdce4d291bd4.el8 ceph-noarch 8.8 k 2020-09-08T15:19:16.809 INFO:teuthology.orchestra.run.smithi065.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-09-08T15:19:16.809 INFO:teuthology.orchestra.run.smithi065.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2020-09-08T15:19:16.810 INFO:teuthology.orchestra.run.smithi065.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2020-09-08T15:19:16.810 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:16.810 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction Summary 2020-09-08T15:19:16.811 INFO:teuthology.orchestra.run.smithi065.stdout:====================================================================================================== 2020-09-08T15:19:16.811 INFO:teuthology.orchestra.run.smithi065.stdout:Install 6 Packages 2020-09-08T15:19:16.811 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:16.812 INFO:teuthology.orchestra.run.smithi065.stdout:Total download size: 3.5 M 2020-09-08T15:19:16.813 INFO:teuthology.orchestra.run.smithi065.stdout:Installed size: 14 M 2020-09-08T15:19:16.813 INFO:teuthology.orchestra.run.smithi065.stdout:Downloading Packages: 2020-09-08T15:19:16.919 INFO:teuthology.orchestra.run.smithi065.stdout:(1/6): ceph-prometheus-alerts-16.0.0-5272.gdce4 81 kB/s | 8.8 kB 00:00 2020-09-08T15:19:16.932 INFO:teuthology.orchestra.run.smithi065.stdout:(2/6): ceph-grafana-dashboards-16.0.0-5272.gdce 195 kB/s | 24 kB 00:00 2020-09-08T15:19:17.029 INFO:teuthology.orchestra.run.smithi065.stdout:(3/6): python3-routes-2.4.1-12.el8.noarch.rpm 2.0 MB/s | 196 kB 00:00 2020-09-08T15:19:17.041 INFO:teuthology.orchestra.run.smithi065.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 274 kB/s | 34 kB 00:00 2020-09-08T15:19:17.068 INFO:teuthology.orchestra.run.smithi065.stdout:(5/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.1 MB/s | 43 kB 00:00 2020-09-08T15:19:17.129 INFO:teuthology.orchestra.run.smithi065.stdout:(6/6): ceph-mgr-dashboard-16.0.0-5272.gdce4d291 9.8 MB/s | 3.2 MB 00:00 2020-09-08T15:19:17.130 INFO:teuthology.orchestra.run.smithi065.stdout:-------------------------------------------------------------------------------- 2020-09-08T15:19:17.131 INFO:teuthology.orchestra.run.smithi065.stdout:Total 11 MB/s | 3.5 MB 00:00 2020-09-08T15:19:17.136 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction check 2020-09-08T15:19:17.142 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction check succeeded. 2020-09-08T15:19:17.143 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction test 2020-09-08T15:19:17.292 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction test succeeded. 2020-09-08T15:19:17.294 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction 2020-09-08T15:19:17.581 INFO:teuthology.orchestra.run.smithi065.stdout: Preparing : 1/1 2020-09-08T15:19:17.780 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/6 2020-09-08T15:19:18.016 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/6 2020-09-08T15:19:18.995 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/6 2020-09-08T15:19:18.995 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-5272.gdce4d291bd4.el 4/6 2020-09-08T15:19:19.481 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-5272.gdce4d291bd4.e 5/6 2020-09-08T15:19:19.771 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-5272.gdce4d291bd4.el8.no 6/6 2020-09-08T15:19:19.995 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-5272.gdce4d291bd4.el8.no 6/6 2020-09-08T15:19:19.996 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-5272.gdce4d291bd4.e 1/6 2020-09-08T15:19:19.996 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-5272.gdce4d291bd4.el8.no 2/6 2020-09-08T15:19:19.997 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-5272.gdce4d291bd4.el 3/6 2020-09-08T15:19:19.997 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/6 2020-09-08T15:19:19.997 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/6 2020-09-08T15:19:20.298 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/6 2020-09-08T15:19:20.299 INFO:teuthology.orchestra.run.smithi065.stdout:Installed products updated. 2020-09-08T15:19:22.749 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:22.750 INFO:teuthology.orchestra.run.smithi065.stdout:Installed: 2020-09-08T15:19:22.750 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-grafana-dashboards-2:16.0.0-5272.gdce4d291bd4.el8.noarch 2020-09-08T15:19:22.750 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-mgr-dashboard-2:16.0.0-5272.gdce4d291bd4.el8.noarch 2020-09-08T15:19:22.750 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-prometheus-alerts-2:16.0.0-5272.gdce4d291bd4.el8.noarch 2020-09-08T15:19:22.751 INFO:teuthology.orchestra.run.smithi065.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-09-08T15:19:22.751 INFO:teuthology.orchestra.run.smithi065.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-09-08T15:19:22.751 INFO:teuthology.orchestra.run.smithi065.stdout: python3-routes-2.4.1-12.el8.noarch 2020-09-08T15:19:22.751 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:22.751 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:19:22.903 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install ceph-mgr-diskprediction-local 2020-09-08T15:19:23.280 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:19:23.852 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 kB/s | 2.4 kB 00:00 2020-09-08T15:19:23.951 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 72 kB/s | 2.8 kB 00:00 2020-09-08T15:19:25.082 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:19:25.083 INFO:teuthology.orchestra.run.smithi065.stdout:====================================================================================================================== 2020-09-08T15:19:25.084 INFO:teuthology.orchestra.run.smithi065.stdout: Package Arch Version Repository Size 2020-09-08T15:19:25.084 INFO:teuthology.orchestra.run.smithi065.stdout:====================================================================================================================== 2020-09-08T15:19:25.084 INFO:teuthology.orchestra.run.smithi065.stdout:Installing: 2020-09-08T15:19:25.084 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-mgr-diskprediction-local noarch 2:16.0.0-5272.gdce4d291bd4.el8 ceph-noarch 8.6 M 2020-09-08T15:19:25.085 INFO:teuthology.orchestra.run.smithi065.stdout:Installing dependencies: 2020-09-08T15:19:25.085 INFO:teuthology.orchestra.run.smithi065.stdout: libgfortran x86_64 8.3.1-5.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2020-09-08T15:19:25.085 INFO:teuthology.orchestra.run.smithi065.stdout: libquadmath x86_64 8.3.1-5.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2020-09-08T15:19:25.085 INFO:teuthology.orchestra.run.smithi065.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2020-09-08T15:19:25.085 INFO:teuthology.orchestra.run.smithi065.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2020-09-08T15:19:25.086 INFO:teuthology.orchestra.run.smithi065.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2020-09-08T15:19:25.086 INFO:teuthology.orchestra.run.smithi065.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2020-09-08T15:19:25.086 INFO:teuthology.orchestra.run.smithi065.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2020-09-08T15:19:25.086 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:25.086 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction Summary 2020-09-08T15:19:25.087 INFO:teuthology.orchestra.run.smithi065.stdout:====================================================================================================================== 2020-09-08T15:19:25.087 INFO:teuthology.orchestra.run.smithi065.stdout:Install 8 Packages 2020-09-08T15:19:25.087 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:25.088 INFO:teuthology.orchestra.run.smithi065.stdout:Total download size: 37 M 2020-09-08T15:19:25.088 INFO:teuthology.orchestra.run.smithi065.stdout:Installed size: 196 M 2020-09-08T15:19:25.088 INFO:teuthology.orchestra.run.smithi065.stdout:Downloading Packages: 2020-09-08T15:19:25.144 INFO:teuthology.orchestra.run.smithi065.stdout:(1/8): libquadmath-8.3.1-5.el8.x86_64.rpm 2.9 MB/s | 169 kB 00:00 2020-09-08T15:19:25.163 INFO:teuthology.orchestra.run.smithi065.stdout:(2/8): libgfortran-8.3.1-5.el8.x86_64.rpm 8.1 MB/s | 639 kB 00:00 2020-09-08T15:19:25.192 INFO:teuthology.orchestra.run.smithi065.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 7.9 MB/s | 225 kB 00:00 2020-09-08T15:19:25.221 INFO:teuthology.orchestra.run.smithi065.stdout:(4/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 48 MB/s | 3.7 MB 00:00 2020-09-08T15:19:25.290 INFO:teuthology.orchestra.run.smithi065.stdout:(5/8): openblas-threads-0.3.3-5.el8.x86_64.rpm 68 MB/s | 4.4 MB 00:00 2020-09-08T15:19:25.350 INFO:teuthology.orchestra.run.smithi065.stdout:(6/8): openblas-0.3.3-5.el8.x86_64.rpm 67 MB/s | 4.3 MB 00:00 2020-09-08T15:19:25.480 INFO:teuthology.orchestra.run.smithi065.stdout:(7/8): python3-scipy-1.0.0-20.module+el8.1.0+33 50 MB/s | 15 MB 00:00 2020-09-08T15:19:25.633 INFO:teuthology.orchestra.run.smithi065.stdout:(8/8): ceph-mgr-diskprediction-local-16.0.0-527 16 MB/s | 8.6 MB 00:00 2020-09-08T15:19:25.635 INFO:teuthology.orchestra.run.smithi065.stdout:-------------------------------------------------------------------------------- 2020-09-08T15:19:25.635 INFO:teuthology.orchestra.run.smithi065.stdout:Total 66 MB/s | 37 MB 00:00 2020-09-08T15:19:25.646 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction check 2020-09-08T15:19:25.664 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction check succeeded. 2020-09-08T15:19:25.664 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction test 2020-09-08T15:19:25.972 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction test succeeded. 2020-09-08T15:19:25.975 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction 2020-09-08T15:19:27.074 INFO:teuthology.orchestra.run.smithi065.stdout: Preparing : 1/1 2020-09-08T15:19:27.260 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : libquadmath-8.3.1-5.el8.x86_64 1/8 2020-09-08T15:19:27.410 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: libquadmath-8.3.1-5.el8.x86_64 1/8 2020-09-08T15:19:27.630 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : libgfortran-8.3.1-5.el8.x86_64 2/8 2020-09-08T15:19:28.169 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: libgfortran-8.3.1-5.el8.x86_64 2/8 2020-09-08T15:19:28.326 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 3/8 2020-09-08T15:19:28.874 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 3/8 2020-09-08T15:19:29.036 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : openblas-0.3.3-5.el8.x86_64 4/8 2020-09-08T15:19:29.779 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 4/8 2020-09-08T15:19:30.104 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2020-09-08T15:19:30.297 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-09-08T15:19:32.429 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-09-08T15:19:33.828 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 7/8 2020-09-08T15:19:34.008 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-5272.gdce4d29 8/8 2020-09-08T15:19:34.281 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-5272.gdce4d29 8/8 2020-09-08T15:19:34.282 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-5272.gdce4d29 1/8 2020-09-08T15:19:34.282 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : libquadmath-8.3.1-5.el8.x86_64 2/8 2020-09-08T15:19:34.282 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : libgfortran-8.3.1-5.el8.x86_64 3/8 2020-09-08T15:19:34.282 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2020-09-08T15:19:34.282 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2020-09-08T15:19:34.283 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 6/8 2020-09-08T15:19:34.283 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 7/8 2020-09-08T15:19:34.588 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 8/8 2020-09-08T15:19:34.589 INFO:teuthology.orchestra.run.smithi065.stdout:Installed products updated. 2020-09-08T15:19:36.596 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:36.596 INFO:teuthology.orchestra.run.smithi065.stdout:Installed: 2020-09-08T15:19:36.596 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-mgr-diskprediction-local-2:16.0.0-5272.gdce4d291bd4.el8.noarch 2020-09-08T15:19:36.597 INFO:teuthology.orchestra.run.smithi065.stdout: libgfortran-8.3.1-5.el8.x86_64 2020-09-08T15:19:36.597 INFO:teuthology.orchestra.run.smithi065.stdout: libquadmath-8.3.1-5.el8.x86_64 2020-09-08T15:19:36.597 INFO:teuthology.orchestra.run.smithi065.stdout: openblas-0.3.3-5.el8.x86_64 2020-09-08T15:19:36.597 INFO:teuthology.orchestra.run.smithi065.stdout: openblas-threads-0.3.3-5.el8.x86_64 2020-09-08T15:19:36.597 INFO:teuthology.orchestra.run.smithi065.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-09-08T15:19:36.598 INFO:teuthology.orchestra.run.smithi065.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-09-08T15:19:36.598 INFO:teuthology.orchestra.run.smithi065.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2020-09-08T15:19:36.598 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:36.598 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:19:36.928 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install ceph-mgr-rook 2020-09-08T15:19:37.305 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:19:37.862 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 67 kB/s | 2.4 kB 00:00 2020-09-08T15:19:37.958 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 75 kB/s | 2.8 kB 00:00 2020-09-08T15:19:39.077 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:19:39.077 INFO:teuthology.orchestra.run.smithi065.stdout:=========================================================================================================== 2020-09-08T15:19:39.077 INFO:teuthology.orchestra.run.smithi065.stdout: Package Arch Version Repository Size 2020-09-08T15:19:39.078 INFO:teuthology.orchestra.run.smithi065.stdout:=========================================================================================================== 2020-09-08T15:19:39.078 INFO:teuthology.orchestra.run.smithi065.stdout:Installing: 2020-09-08T15:19:39.078 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-mgr-rook noarch 2:16.0.0-5272.gdce4d291bd4.el8 ceph-noarch 27 k 2020-09-08T15:19:39.078 INFO:teuthology.orchestra.run.smithi065.stdout:Installing dependencies: 2020-09-08T15:19:39.078 INFO:teuthology.orchestra.run.smithi065.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-09-08T15:19:39.079 INFO:teuthology.orchestra.run.smithi065.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-09-08T15:19:39.079 INFO:teuthology.orchestra.run.smithi065.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-09-08T15:19:39.079 INFO:teuthology.orchestra.run.smithi065.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-09-08T15:19:39.079 INFO:teuthology.orchestra.run.smithi065.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2020-09-08T15:19:39.079 INFO:teuthology.orchestra.run.smithi065.stdout: python3-kubernetes noarch 11.0.0-2.el8 epel 1.2 M 2020-09-08T15:19:39.080 INFO:teuthology.orchestra.run.smithi065.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2020-09-08T15:19:39.080 INFO:teuthology.orchestra.run.smithi065.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2020-09-08T15:19:39.080 INFO:teuthology.orchestra.run.smithi065.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2020-09-08T15:19:39.080 INFO:teuthology.orchestra.run.smithi065.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-09-08T15:19:39.080 INFO:teuthology.orchestra.run.smithi065.stdout: python3-rsa noarch 3.4.2-15.el8 epel 73 k 2020-09-08T15:19:39.081 INFO:teuthology.orchestra.run.smithi065.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-09-08T15:19:39.081 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:39.081 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction Summary 2020-09-08T15:19:39.081 INFO:teuthology.orchestra.run.smithi065.stdout:=========================================================================================================== 2020-09-08T15:19:39.081 INFO:teuthology.orchestra.run.smithi065.stdout:Install 13 Packages 2020-09-08T15:19:39.082 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:39.082 INFO:teuthology.orchestra.run.smithi065.stdout:Total download size: 1.9 M 2020-09-08T15:19:39.082 INFO:teuthology.orchestra.run.smithi065.stdout:Installed size: 24 M 2020-09-08T15:19:39.082 INFO:teuthology.orchestra.run.smithi065.stdout:Downloading Packages: 2020-09-08T15:19:39.126 INFO:teuthology.orchestra.run.smithi065.stdout:(1/13): python3-certifi-2018.10.15-7.el8.noarch 334 kB/s | 16 kB 00:00 2020-09-08T15:19:39.137 INFO:teuthology.orchestra.run.smithi065.stdout:(2/13): python3-cachetools-3.1.1-4.el8.noarch.r 559 kB/s | 33 kB 00:00 2020-09-08T15:19:39.174 INFO:teuthology.orchestra.run.smithi065.stdout:(3/13): python3-google-auth-1.1.1-10.el8.noarch 1.7 MB/s | 81 kB 00:00 2020-09-08T15:19:39.197 INFO:teuthology.orchestra.run.smithi065.stdout:(4/13): python3-rsa-3.4.2-15.el8.noarch.rpm 4.2 MB/s | 73 kB 00:00 2020-09-08T15:19:39.209 INFO:teuthology.orchestra.run.smithi065.stdout:(5/13): python3-websocket-client-0.56.0-5.el8.n 3.6 MB/s | 61 kB 00:00 2020-09-08T15:19:39.250 INFO:teuthology.orchestra.run.smithi065.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 1.0 MB/s | 43 kB 00:00 2020-09-08T15:19:39.264 INFO:teuthology.orchestra.run.smithi065.stdout:(7/13): python3-kubernetes-11.0.0-2.el8.noarch. 9.5 MB/s | 1.2 MB 00:00 2020-09-08T15:19:39.283 INFO:teuthology.orchestra.run.smithi065.stdout:(8/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 4.6 MB/s | 155 kB 00:00 2020-09-08T15:19:39.315 INFO:teuthology.orchestra.run.smithi065.stdout:(9/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 599 kB/s | 27 kB 00:00 2020-09-08T15:19:39.325 INFO:teuthology.orchestra.run.smithi065.stdout:(10/13): python3-jsonpointer-1.10-11.el8.noarch 477 kB/s | 20 kB 00:00 2020-09-08T15:19:39.342 INFO:teuthology.orchestra.run.smithi065.stdout:(11/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 4.5 MB/s | 126 kB 00:00 2020-09-08T15:19:39.360 INFO:teuthology.orchestra.run.smithi065.stdout:(12/13): python3-pyasn1-modules-0.3.7-6.el8.noa 3.3 MB/s | 110 kB 00:00 2020-09-08T15:19:39.367 INFO:teuthology.orchestra.run.smithi065.stdout:(13/13): ceph-mgr-rook-16.0.0-5272.gdce4d291bd4 94 kB/s | 27 kB 00:00 2020-09-08T15:19:39.368 INFO:teuthology.orchestra.run.smithi065.stdout:-------------------------------------------------------------------------------- 2020-09-08T15:19:39.368 INFO:teuthology.orchestra.run.smithi065.stdout:Total 6.6 MB/s | 1.9 MB 00:00 2020-09-08T15:19:39.373 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction check 2020-09-08T15:19:39.388 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction check succeeded. 2020-09-08T15:19:39.389 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction test 2020-09-08T15:19:39.460 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction test succeeded. 2020-09-08T15:19:39.462 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction 2020-09-08T15:19:39.970 INFO:teuthology.orchestra.run.smithi065.stdout: Preparing : 1/1 2020-09-08T15:19:40.202 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2020-09-08T15:19:40.457 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 2/13 2020-09-08T15:19:40.657 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/13 2020-09-08T15:19:40.857 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 4/13 2020-09-08T15:19:41.137 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 5/13 2020-09-08T15:19:41.357 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2020-09-08T15:19:41.556 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2020-09-08T15:19:41.778 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 8/13 2020-09-08T15:19:41.995 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 9/13 2020-09-08T15:19:42.270 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 10/13 2020-09-08T15:19:43.536 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 11/13 2020-09-08T15:19:43.800 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 12/13 2020-09-08T15:19:43.978 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : ceph-mgr-rook-2:16.0.0-5272.gdce4d291bd4.el8.noarc 13/13 2020-09-08T15:19:44.227 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-5272.gdce4d291bd4.el8.noarc 13/13 2020-09-08T15:19:44.227 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : ceph-mgr-rook-2:16.0.0-5272.gdce4d291bd4.el8.noarc 1/13 2020-09-08T15:19:44.227 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/13 2020-09-08T15:19:44.227 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/13 2020-09-08T15:19:44.228 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/13 2020-09-08T15:19:44.228 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 5/13 2020-09-08T15:19:44.228 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 6/13 2020-09-08T15:19:44.228 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/13 2020-09-08T15:19:44.228 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 8/13 2020-09-08T15:19:44.229 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 9/13 2020-09-08T15:19:44.229 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 10/13 2020-09-08T15:19:44.229 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 11/13 2020-09-08T15:19:44.229 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 12/13 2020-09-08T15:19:44.597 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 13/13 2020-09-08T15:19:44.598 INFO:teuthology.orchestra.run.smithi065.stdout:Installed products updated. 2020-09-08T15:19:46.606 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:46.606 INFO:teuthology.orchestra.run.smithi065.stdout:Installed: 2020-09-08T15:19:46.606 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-mgr-rook-2:16.0.0-5272.gdce4d291bd4.el8.noarch 2020-09-08T15:19:46.607 INFO:teuthology.orchestra.run.smithi065.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-09-08T15:19:46.607 INFO:teuthology.orchestra.run.smithi065.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-09-08T15:19:46.607 INFO:teuthology.orchestra.run.smithi065.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-09-08T15:19:46.607 INFO:teuthology.orchestra.run.smithi065.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-09-08T15:19:46.607 INFO:teuthology.orchestra.run.smithi065.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-09-08T15:19:46.608 INFO:teuthology.orchestra.run.smithi065.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-09-08T15:19:46.608 INFO:teuthology.orchestra.run.smithi065.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-09-08T15:19:46.608 INFO:teuthology.orchestra.run.smithi065.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-09-08T15:19:46.608 INFO:teuthology.orchestra.run.smithi065.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-09-08T15:19:46.608 INFO:teuthology.orchestra.run.smithi065.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-09-08T15:19:46.609 INFO:teuthology.orchestra.run.smithi065.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-09-08T15:19:46.609 INFO:teuthology.orchestra.run.smithi065.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-09-08T15:19:46.609 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:46.609 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:19:46.809 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install ceph-mgr-cephadm 2020-09-08T15:19:47.192 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:19:47.802 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 kB/s | 2.4 kB 00:00 2020-09-08T15:19:47.899 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 79 kB/s | 2.8 kB 00:00 2020-09-08T15:19:48.972 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:19:49.362 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================================== 2020-09-08T15:19:49.362 INFO:teuthology.orchestra.run.smithi065.stdout: Package Arch Version Repository Size 2020-09-08T15:19:49.362 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================================== 2020-09-08T15:19:49.363 INFO:teuthology.orchestra.run.smithi065.stdout:Installing: 2020-09-08T15:19:49.363 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-mgr-cephadm noarch 2:16.0.0-5272.gdce4d291bd4.el8 ceph-noarch 63 k 2020-09-08T15:19:49.363 INFO:teuthology.orchestra.run.smithi065.stdout:Installing dependencies: 2020-09-08T15:19:49.363 INFO:teuthology.orchestra.run.smithi065.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2020-09-08T15:19:49.363 INFO:teuthology.orchestra.run.smithi065.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2020-09-08T15:19:49.364 INFO:teuthology.orchestra.run.smithi065.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2020-09-08T15:19:49.364 INFO:teuthology.orchestra.run.smithi065.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2020-09-08T15:19:49.364 INFO:teuthology.orchestra.run.smithi065.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2020-09-08T15:19:49.364 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:49.364 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction Summary 2020-09-08T15:19:49.365 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================================== 2020-09-08T15:19:49.365 INFO:teuthology.orchestra.run.smithi065.stdout:Install 6 Packages 2020-09-08T15:19:49.365 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:49.365 INFO:teuthology.orchestra.run.smithi065.stdout:Total download size: 5.8 M 2020-09-08T15:19:49.365 INFO:teuthology.orchestra.run.smithi065.stdout:Installed size: 24 M 2020-09-08T15:19:49.366 INFO:teuthology.orchestra.run.smithi065.stdout:Downloading Packages: 2020-09-08T15:19:49.366 INFO:teuthology.orchestra.run.smithi065.stdout:(1/6): python3-apipkg-1.5-6.el8.noarch.rpm 432 kB/s | 21 kB 00:00 2020-09-08T15:19:49.366 INFO:teuthology.orchestra.run.smithi065.stdout:(2/6): python3-remoto-1.1.4-4.el8.noarch.rpm 1.5 MB/s | 48 kB 00:00 2020-09-08T15:19:49.366 INFO:teuthology.orchestra.run.smithi065.stdout:(3/6): python3-execnet-1.7.1-1.el8.noarch.rpm 3.3 MB/s | 355 kB 00:00 2020-09-08T15:19:49.366 INFO:teuthology.orchestra.run.smithi065.stdout:(4/6): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 12 MB/s | 538 kB 00:00 2020-09-08T15:19:49.367 INFO:teuthology.orchestra.run.smithi065.stdout:(5/6): ceph-mgr-cephadm-16.0.0-5272.gdce4d291bd 435 kB/s | 63 kB 00:00 2020-09-08T15:19:49.367 INFO:teuthology.orchestra.run.smithi065.stdout:(6/6): python3-babel-2.5.1-5.el8.noarch.rpm 68 MB/s | 4.8 MB 00:00 2020-09-08T15:19:49.367 INFO:teuthology.orchestra.run.smithi065.stdout:-------------------------------------------------------------------------------- 2020-09-08T15:19:49.367 INFO:teuthology.orchestra.run.smithi065.stdout:Total 33 MB/s | 5.8 MB 00:00 2020-09-08T15:19:49.368 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction check 2020-09-08T15:19:49.368 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction check succeeded. 2020-09-08T15:19:49.368 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction test 2020-09-08T15:19:49.368 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction test succeeded. 2020-09-08T15:19:49.368 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction 2020-09-08T15:19:50.351 INFO:teuthology.orchestra.run.smithi065.stdout: Preparing : 1/1 2020-09-08T15:19:50.750 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 1/6 2020-09-08T15:19:51.014 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 2/6 2020-09-08T15:19:51.320 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 3/6 2020-09-08T15:19:51.597 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 4/6 2020-09-08T15:19:51.826 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 5/6 2020-09-08T15:19:52.021 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-5272.gdce4d291bd4.el8.noar 6/6 2020-09-08T15:19:52.258 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-5272.gdce4d291bd4.el8.noar 6/6 2020-09-08T15:19:52.258 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-5272.gdce4d291bd4.el8.noar 1/6 2020-09-08T15:19:52.258 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 2/6 2020-09-08T15:19:52.258 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 3/6 2020-09-08T15:19:52.259 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 4/6 2020-09-08T15:19:52.259 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 5/6 2020-09-08T15:19:52.545 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 6/6 2020-09-08T15:19:52.546 INFO:teuthology.orchestra.run.smithi065.stdout:Installed products updated. 2020-09-08T15:19:54.800 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:54.800 INFO:teuthology.orchestra.run.smithi065.stdout:Installed: 2020-09-08T15:19:54.802 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-mgr-cephadm-2:16.0.0-5272.gdce4d291bd4.el8.noarch 2020-09-08T15:19:54.802 INFO:teuthology.orchestra.run.smithi065.stdout: python3-apipkg-1.5-6.el8.noarch 2020-09-08T15:19:54.802 INFO:teuthology.orchestra.run.smithi065.stdout: python3-babel-2.5.1-5.el8.noarch 2020-09-08T15:19:54.802 INFO:teuthology.orchestra.run.smithi065.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-09-08T15:19:54.803 INFO:teuthology.orchestra.run.smithi065.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-09-08T15:19:54.803 INFO:teuthology.orchestra.run.smithi065.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-09-08T15:19:54.803 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:54.803 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:19:54.983 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install ceph-fuse 2020-09-08T15:19:55.372 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:19:55.925 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 kB/s | 2.4 kB 00:00 2020-09-08T15:19:56.021 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 78 kB/s | 2.8 kB 00:00 2020-09-08T15:19:57.114 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:19:57.115 INFO:teuthology.orchestra.run.smithi065.stdout:========================================================================================== 2020-09-08T15:19:57.115 INFO:teuthology.orchestra.run.smithi065.stdout: Package Arch Version Repository Size 2020-09-08T15:19:57.115 INFO:teuthology.orchestra.run.smithi065.stdout:========================================================================================== 2020-09-08T15:19:57.115 INFO:teuthology.orchestra.run.smithi065.stdout:Installing: 2020-09-08T15:19:57.116 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-fuse x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 623 k 2020-09-08T15:19:57.116 INFO:teuthology.orchestra.run.smithi065.stdout:Installing dependencies: 2020-09-08T15:19:57.116 INFO:teuthology.orchestra.run.smithi065.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2020-09-08T15:19:57.116 INFO:teuthology.orchestra.run.smithi065.stdout: fuse-common x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2020-09-08T15:19:57.117 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:57.117 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction Summary 2020-09-08T15:19:57.117 INFO:teuthology.orchestra.run.smithi065.stdout:========================================================================================== 2020-09-08T15:19:57.117 INFO:teuthology.orchestra.run.smithi065.stdout:Install 3 Packages 2020-09-08T15:19:57.117 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:57.118 INFO:teuthology.orchestra.run.smithi065.stdout:Total download size: 726 k 2020-09-08T15:19:57.118 INFO:teuthology.orchestra.run.smithi065.stdout:Installed size: 2.2 M 2020-09-08T15:19:57.118 INFO:teuthology.orchestra.run.smithi065.stdout:Downloading Packages: 2020-09-08T15:19:57.173 INFO:teuthology.orchestra.run.smithi065.stdout:(1/3): fuse-2.9.7-12.el8.x86_64.rpm 1.5 MB/s | 83 kB 00:00 2020-09-08T15:19:57.178 INFO:teuthology.orchestra.run.smithi065.stdout:(2/3): fuse-common-3.2.1-12.el8.x86_64.rpm 345 kB/s | 21 kB 00:00 2020-09-08T15:19:57.344 INFO:teuthology.orchestra.run.smithi065.stdout:(3/3): ceph-fuse-16.0.0-5272.gdce4d291bd4.el8.x 2.7 MB/s | 623 kB 00:00 2020-09-08T15:19:57.345 INFO:teuthology.orchestra.run.smithi065.stdout:-------------------------------------------------------------------------------- 2020-09-08T15:19:57.345 INFO:teuthology.orchestra.run.smithi065.stdout:Total 3.1 MB/s | 726 kB 00:00 2020-09-08T15:19:57.347 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction check 2020-09-08T15:19:57.369 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction check succeeded. 2020-09-08T15:19:57.370 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction test 2020-09-08T15:19:57.444 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction test succeeded. 2020-09-08T15:19:57.446 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction 2020-09-08T15:19:57.669 INFO:teuthology.orchestra.run.smithi065.stdout: Preparing : 1/1 2020-09-08T15:19:57.670 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 1/3 2020-09-08T15:19:57.670 INFO:teuthology.orchestra.run.smithi065.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-09-08T15:19:57.670 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:19:58.104 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : fuse-2.9.7-12.el8.x86_64 2/3 2020-09-08T15:19:58.798 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : ceph-fuse-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 3/3 2020-09-08T15:19:59.122 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: ceph-fuse-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 3/3 2020-09-08T15:19:59.123 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : ceph-fuse-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 1/3 2020-09-08T15:19:59.123 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2020-09-08T15:19:59.390 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2020-09-08T15:19:59.390 INFO:teuthology.orchestra.run.smithi065.stdout:Installed products updated. 2020-09-08T15:20:01.402 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:01.403 INFO:teuthology.orchestra.run.smithi065.stdout:Installed: 2020-09-08T15:20:01.404 INFO:teuthology.orchestra.run.smithi065.stdout: ceph-fuse-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-09-08T15:20:01.404 INFO:teuthology.orchestra.run.smithi065.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-09-08T15:20:01.404 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:01.404 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:20:01.553 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install librados-devel 2020-09-08T15:20:01.942 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:20:02.518 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 kB/s | 2.4 kB 00:00 2020-09-08T15:20:02.616 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 74 kB/s | 2.8 kB 00:00 2020-09-08T15:20:03.735 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:20:03.736 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================ 2020-09-08T15:20:03.736 INFO:teuthology.orchestra.run.smithi065.stdout: Package Arch Version Repo Size 2020-09-08T15:20:03.736 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================ 2020-09-08T15:20:03.736 INFO:teuthology.orchestra.run.smithi065.stdout:Installing: 2020-09-08T15:20:03.737 INFO:teuthology.orchestra.run.smithi065.stdout: librados-devel x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 131 k 2020-09-08T15:20:03.737 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:03.740 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction Summary 2020-09-08T15:20:03.740 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================ 2020-09-08T15:20:03.740 INFO:teuthology.orchestra.run.smithi065.stdout:Install 1 Package 2020-09-08T15:20:03.740 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:03.741 INFO:teuthology.orchestra.run.smithi065.stdout:Total download size: 131 k 2020-09-08T15:20:03.741 INFO:teuthology.orchestra.run.smithi065.stdout:Installed size: 436 k 2020-09-08T15:20:03.741 INFO:teuthology.orchestra.run.smithi065.stdout:Downloading Packages: 2020-09-08T15:20:04.129 INFO:teuthology.orchestra.run.smithi065.stdout:librados-devel-16.0.0-5272.gdce4d291bd4.el8.x86 329 kB/s | 131 kB 00:00 2020-09-08T15:20:04.129 INFO:teuthology.orchestra.run.smithi065.stdout:-------------------------------------------------------------------------------- 2020-09-08T15:20:04.130 INFO:teuthology.orchestra.run.smithi065.stdout:Total 327 kB/s | 131 kB 00:00 2020-09-08T15:20:04.130 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction check 2020-09-08T15:20:04.149 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction check succeeded. 2020-09-08T15:20:04.149 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction test 2020-09-08T15:20:04.197 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction test succeeded. 2020-09-08T15:20:04.201 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction 2020-09-08T15:20:05.182 INFO:teuthology.orchestra.run.smithi065.stdout: Preparing : 1/1 2020-09-08T15:20:05.386 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : librados-devel-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 1/1 2020-09-08T15:20:05.627 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: librados-devel-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 1/1 2020-09-08T15:20:05.879 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : librados-devel-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 1/1 2020-09-08T15:20:05.879 INFO:teuthology.orchestra.run.smithi065.stdout:Installed products updated. 2020-09-08T15:20:07.990 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:07.991 INFO:teuthology.orchestra.run.smithi065.stdout:Installed: 2020-09-08T15:20:07.991 INFO:teuthology.orchestra.run.smithi065.stdout: librados-devel-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:20:07.991 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:07.991 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:20:08.168 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install libcephfs2 2020-09-08T15:20:08.553 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:20:09.143 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 kB/s | 2.4 kB 00:00 2020-09-08T15:20:09.241 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 76 kB/s | 2.8 kB 00:00 2020-09-08T15:20:10.078 INFO:teuthology.orchestra.run.smithi065.stdout:Package libcephfs2-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 is already installed. 2020-09-08T15:20:10.346 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:20:10.346 INFO:teuthology.orchestra.run.smithi065.stdout:Nothing to do. 2020-09-08T15:20:10.347 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:20:10.519 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install libcephfs-devel 2020-09-08T15:20:10.903 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:20:11.477 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 65 kB/s | 2.4 kB 00:00 2020-09-08T15:20:11.574 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 74 kB/s | 2.8 kB 00:00 2020-09-08T15:20:12.659 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:20:12.660 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================ 2020-09-08T15:20:12.660 INFO:teuthology.orchestra.run.smithi065.stdout: Package Arch Version Repo Size 2020-09-08T15:20:12.661 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================ 2020-09-08T15:20:12.661 INFO:teuthology.orchestra.run.smithi065.stdout:Installing: 2020-09-08T15:20:12.661 INFO:teuthology.orchestra.run.smithi065.stdout: libcephfs-devel x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 23 k 2020-09-08T15:20:12.661 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:12.661 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction Summary 2020-09-08T15:20:12.662 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================ 2020-09-08T15:20:12.662 INFO:teuthology.orchestra.run.smithi065.stdout:Install 1 Package 2020-09-08T15:20:12.662 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:12.662 INFO:teuthology.orchestra.run.smithi065.stdout:Total download size: 23 k 2020-09-08T15:20:12.662 INFO:teuthology.orchestra.run.smithi065.stdout:Installed size: 84 k 2020-09-08T15:20:12.663 INFO:teuthology.orchestra.run.smithi065.stdout:Downloading Packages: 2020-09-08T15:20:12.798 INFO:teuthology.orchestra.run.smithi065.stdout:libcephfs-devel-16.0.0-5272.gdce4d291bd4.el8.x8 170 kB/s | 23 kB 00:00 2020-09-08T15:20:12.799 INFO:teuthology.orchestra.run.smithi065.stdout:-------------------------------------------------------------------------------- 2020-09-08T15:20:12.800 INFO:teuthology.orchestra.run.smithi065.stdout:Total 168 kB/s | 23 kB 00:00 2020-09-08T15:20:12.800 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction check 2020-09-08T15:20:12.803 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction check succeeded. 2020-09-08T15:20:12.803 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction test 2020-09-08T15:20:12.805 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction test succeeded. 2020-09-08T15:20:12.808 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction 2020-09-08T15:20:12.862 INFO:teuthology.orchestra.run.smithi065.stdout: Preparing : 1/1 2020-09-08T15:20:13.085 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : libcephfs-devel-2:16.0.0-5272.gdce4d291bd4.el8.x86_6 1/1 2020-09-08T15:20:13.279 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: libcephfs-devel-2:16.0.0-5272.gdce4d291bd4.el8.x86_6 1/1 2020-09-08T15:20:13.525 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : libcephfs-devel-2:16.0.0-5272.gdce4d291bd4.el8.x86_6 1/1 2020-09-08T15:20:13.526 INFO:teuthology.orchestra.run.smithi065.stdout:Installed products updated. 2020-09-08T15:20:15.725 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:15.726 INFO:teuthology.orchestra.run.smithi065.stdout:Installed: 2020-09-08T15:20:15.726 INFO:teuthology.orchestra.run.smithi065.stdout: libcephfs-devel-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:20:15.726 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:15.727 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:20:16.002 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install librados2 2020-09-08T15:20:16.389 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:20:16.966 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 63 kB/s | 2.4 kB 00:00 2020-09-08T15:20:17.065 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 77 kB/s | 2.8 kB 00:00 2020-09-08T15:20:17.925 INFO:teuthology.orchestra.run.smithi065.stdout:Package librados2-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 is already installed. 2020-09-08T15:20:18.186 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:20:18.187 INFO:teuthology.orchestra.run.smithi065.stdout:Nothing to do. 2020-09-08T15:20:18.187 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:20:18.330 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install librbd1 2020-09-08T15:20:18.711 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:20:19.317 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 kB/s | 2.4 kB 00:00 2020-09-08T15:20:19.418 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 74 kB/s | 2.8 kB 00:00 2020-09-08T15:20:20.275 INFO:teuthology.orchestra.run.smithi065.stdout:Package librbd1-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 is already installed. 2020-09-08T15:20:20.538 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:20:21.186 INFO:teuthology.orchestra.run.smithi065.stdout:Nothing to do. 2020-09-08T15:20:21.187 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:20:21.188 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install python3-rados 2020-09-08T15:20:21.578 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:20:22.179 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 63 kB/s | 2.4 kB 00:00 2020-09-08T15:20:22.278 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 77 kB/s | 2.8 kB 00:00 2020-09-08T15:20:23.131 INFO:teuthology.orchestra.run.smithi065.stdout:Package python3-rados-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 is already installed. 2020-09-08T15:20:23.383 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:20:23.384 INFO:teuthology.orchestra.run.smithi065.stdout:Nothing to do. 2020-09-08T15:20:23.384 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:20:23.521 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install python3-rgw 2020-09-08T15:20:23.904 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:20:24.486 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 kB/s | 2.4 kB 00:00 2020-09-08T15:20:24.585 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 72 kB/s | 2.8 kB 00:00 2020-09-08T15:20:25.466 INFO:teuthology.orchestra.run.smithi065.stdout:Package python3-rgw-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 is already installed. 2020-09-08T15:20:25.722 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:20:25.723 INFO:teuthology.orchestra.run.smithi065.stdout:Nothing to do. 2020-09-08T15:20:25.723 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:20:25.861 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install python3-cephfs 2020-09-08T15:20:26.245 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:20:26.791 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 65 kB/s | 2.4 kB 00:00 2020-09-08T15:20:26.888 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 77 kB/s | 2.8 kB 00:00 2020-09-08T15:20:27.710 INFO:teuthology.orchestra.run.smithi065.stdout:Package python3-cephfs-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 is already installed. 2020-09-08T15:20:27.965 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:20:27.967 INFO:teuthology.orchestra.run.smithi065.stdout:Nothing to do. 2020-09-08T15:20:27.967 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:20:28.100 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install python3-rbd 2020-09-08T15:20:28.481 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:20:29.071 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 65 kB/s | 2.4 kB 00:00 2020-09-08T15:20:29.170 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 75 kB/s | 2.8 kB 00:00 2020-09-08T15:20:30.015 INFO:teuthology.orchestra.run.smithi065.stdout:Package python3-rbd-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 is already installed. 2020-09-08T15:20:30.271 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:20:30.272 INFO:teuthology.orchestra.run.smithi065.stdout:Nothing to do. 2020-09-08T15:20:30.273 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:20:30.429 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install rbd-fuse 2020-09-08T15:20:30.809 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:20:31.409 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 kB/s | 2.4 kB 00:00 2020-09-08T15:20:31.509 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 77 kB/s | 2.8 kB 00:00 2020-09-08T15:20:32.616 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:20:32.618 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================ 2020-09-08T15:20:32.618 INFO:teuthology.orchestra.run.smithi065.stdout: Package Arch Version Repo Size 2020-09-08T15:20:32.619 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================ 2020-09-08T15:20:32.619 INFO:teuthology.orchestra.run.smithi065.stdout:Installing: 2020-09-08T15:20:32.619 INFO:teuthology.orchestra.run.smithi065.stdout: rbd-fuse x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 87 k 2020-09-08T15:20:32.619 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:32.619 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction Summary 2020-09-08T15:20:32.620 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================ 2020-09-08T15:20:32.620 INFO:teuthology.orchestra.run.smithi065.stdout:Install 1 Package 2020-09-08T15:20:32.620 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:32.620 INFO:teuthology.orchestra.run.smithi065.stdout:Total download size: 87 k 2020-09-08T15:20:32.620 INFO:teuthology.orchestra.run.smithi065.stdout:Installed size: 296 k 2020-09-08T15:20:32.621 INFO:teuthology.orchestra.run.smithi065.stdout:Downloading Packages: 2020-09-08T15:20:32.998 INFO:teuthology.orchestra.run.smithi065.stdout:rbd-fuse-16.0.0-5272.gdce4d291bd4.el8.x86_64.rp 230 kB/s | 87 kB 00:00 2020-09-08T15:20:32.999 INFO:teuthology.orchestra.run.smithi065.stdout:-------------------------------------------------------------------------------- 2020-09-08T15:20:32.999 INFO:teuthology.orchestra.run.smithi065.stdout:Total 230 kB/s | 87 kB 00:00 2020-09-08T15:20:32.999 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction check 2020-09-08T15:20:33.010 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction check succeeded. 2020-09-08T15:20:33.010 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction test 2020-09-08T15:20:33.066 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction test succeeded. 2020-09-08T15:20:33.069 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction 2020-09-08T15:20:33.211 INFO:teuthology.orchestra.run.smithi065.stdout: Preparing : 1/1 2020-09-08T15:20:33.425 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : rbd-fuse-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 1/1 2020-09-08T15:20:33.649 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: rbd-fuse-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 1/1 2020-09-08T15:20:33.900 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : rbd-fuse-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 1/1 2020-09-08T15:20:33.901 INFO:teuthology.orchestra.run.smithi065.stdout:Installed products updated. 2020-09-08T15:20:35.975 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:35.976 INFO:teuthology.orchestra.run.smithi065.stdout:Installed: 2020-09-08T15:20:35.976 INFO:teuthology.orchestra.run.smithi065.stdout: rbd-fuse-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:20:35.976 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:35.976 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:20:36.127 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install rbd-mirror 2020-09-08T15:20:36.513 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:20:37.079 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 kB/s | 2.4 kB 00:00 2020-09-08T15:20:37.179 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 73 kB/s | 2.8 kB 00:00 2020-09-08T15:20:38.294 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:20:38.295 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================ 2020-09-08T15:20:38.295 INFO:teuthology.orchestra.run.smithi065.stdout: Package Arch Version Repo Size 2020-09-08T15:20:38.295 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================ 2020-09-08T15:20:38.295 INFO:teuthology.orchestra.run.smithi065.stdout:Installing: 2020-09-08T15:20:38.296 INFO:teuthology.orchestra.run.smithi065.stdout: rbd-mirror x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 3.1 M 2020-09-08T15:20:38.296 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:38.296 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction Summary 2020-09-08T15:20:38.296 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================ 2020-09-08T15:20:38.296 INFO:teuthology.orchestra.run.smithi065.stdout:Install 1 Package 2020-09-08T15:20:38.297 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:38.297 INFO:teuthology.orchestra.run.smithi065.stdout:Total download size: 3.1 M 2020-09-08T15:20:38.298 INFO:teuthology.orchestra.run.smithi065.stdout:Installed size: 14 M 2020-09-08T15:20:38.298 INFO:teuthology.orchestra.run.smithi065.stdout:Downloading Packages: 2020-09-08T15:20:38.614 INFO:teuthology.orchestra.run.smithi065.stdout:rbd-mirror-16.0.0-5272.gdce4d291bd4.el8.x86_64. 9.9 MB/s | 3.1 MB 00:00 2020-09-08T15:20:38.615 INFO:teuthology.orchestra.run.smithi065.stdout:-------------------------------------------------------------------------------- 2020-09-08T15:20:38.615 INFO:teuthology.orchestra.run.smithi065.stdout:Total 9.8 MB/s | 3.1 MB 00:00 2020-09-08T15:20:38.615 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction check 2020-09-08T15:20:38.622 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction check succeeded. 2020-09-08T15:20:38.622 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction test 2020-09-08T15:20:38.689 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction test succeeded. 2020-09-08T15:20:38.691 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction 2020-09-08T15:20:39.119 INFO:teuthology.orchestra.run.smithi065.stdout: Preparing : 1/1 2020-09-08T15:20:39.312 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : rbd-mirror-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 1/1 2020-09-08T15:20:39.662 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: rbd-mirror-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 1/1 2020-09-08T15:20:39.937 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : rbd-mirror-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 1/1 2020-09-08T15:20:39.938 INFO:teuthology.orchestra.run.smithi065.stdout:Installed products updated. 2020-09-08T15:20:42.057 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:42.058 INFO:teuthology.orchestra.run.smithi065.stdout:Installed: 2020-09-08T15:20:42.058 INFO:teuthology.orchestra.run.smithi065.stdout: rbd-mirror-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:20:42.059 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:42.059 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:20:42.193 INFO:teuthology.orchestra.run.smithi065:> sudo yum -y install rbd-nbd 2020-09-08T15:20:42.579 INFO:teuthology.orchestra.run.smithi065.stdout:Updating Subscription Management repositories. 2020-09-08T15:20:43.231 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 kB/s | 2.4 kB 00:00 2020-09-08T15:20:43.349 INFO:teuthology.orchestra.run.smithi065.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 76 kB/s | 2.8 kB 00:00 2020-09-08T15:20:44.458 INFO:teuthology.orchestra.run.smithi065.stdout:Dependencies resolved. 2020-09-08T15:20:44.459 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================ 2020-09-08T15:20:44.459 INFO:teuthology.orchestra.run.smithi065.stdout: Package Arch Version Repo Size 2020-09-08T15:20:44.459 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================ 2020-09-08T15:20:44.460 INFO:teuthology.orchestra.run.smithi065.stdout:Installing: 2020-09-08T15:20:44.460 INFO:teuthology.orchestra.run.smithi065.stdout: rbd-nbd x86_64 2:16.0.0-5272.gdce4d291bd4.el8 ceph 161 k 2020-09-08T15:20:44.460 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:44.460 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction Summary 2020-09-08T15:20:44.460 INFO:teuthology.orchestra.run.smithi065.stdout:================================================================================ 2020-09-08T15:20:44.461 INFO:teuthology.orchestra.run.smithi065.stdout:Install 1 Package 2020-09-08T15:20:44.461 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:44.461 INFO:teuthology.orchestra.run.smithi065.stdout:Total download size: 161 k 2020-09-08T15:20:44.461 INFO:teuthology.orchestra.run.smithi065.stdout:Installed size: 608 k 2020-09-08T15:20:44.461 INFO:teuthology.orchestra.run.smithi065.stdout:Downloading Packages: 2020-09-08T15:20:44.629 INFO:teuthology.orchestra.run.smithi065.stdout:rbd-nbd-16.0.0-5272.gdce4d291bd4.el8.x86_64.rpm 950 kB/s | 161 kB 00:00 2020-09-08T15:20:44.630 INFO:teuthology.orchestra.run.smithi065.stdout:-------------------------------------------------------------------------------- 2020-09-08T15:20:44.631 INFO:teuthology.orchestra.run.smithi065.stdout:Total 943 kB/s | 161 kB 00:00 2020-09-08T15:20:44.631 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction check 2020-09-08T15:20:44.643 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction check succeeded. 2020-09-08T15:20:44.644 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction test 2020-09-08T15:20:44.703 INFO:teuthology.orchestra.run.smithi065.stdout:Transaction test succeeded. 2020-09-08T15:20:44.705 INFO:teuthology.orchestra.run.smithi065.stdout:Running transaction 2020-09-08T15:20:44.828 INFO:teuthology.orchestra.run.smithi065.stdout: Preparing : 1/1 2020-09-08T15:20:44.973 INFO:teuthology.orchestra.run.smithi065.stdout: Installing : rbd-nbd-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 1/1 2020-09-08T15:20:45.231 INFO:teuthology.orchestra.run.smithi065.stdout: Running scriptlet: rbd-nbd-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 1/1 2020-09-08T15:20:45.467 INFO:teuthology.orchestra.run.smithi065.stdout: Verifying : rbd-nbd-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 1/1 2020-09-08T15:20:45.467 INFO:teuthology.orchestra.run.smithi065.stdout:Installed products updated. 2020-09-08T15:20:47.663 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:47.664 INFO:teuthology.orchestra.run.smithi065.stdout:Installed: 2020-09-08T15:20:47.664 INFO:teuthology.orchestra.run.smithi065.stdout: rbd-nbd-2:16.0.0-5272.gdce4d291bd4.el8.x86_64 2020-09-08T15:20:47.664 INFO:teuthology.orchestra.run.smithi065.stdout: 2020-09-08T15:20:47.664 INFO:teuthology.orchestra.run.smithi065.stdout:Complete! 2020-09-08T15:20:47.825 DEBUG:teuthology.parallel:result is None 2020-09-08T15:20:47.827 INFO:teuthology.orchestra.run.smithi065:> sudo lsb_release -is 2020-09-08T15:20:47.871 INFO:teuthology.orchestra.run.smithi065.stdout:RedHatEnterprise 2020-09-08T15:20:47.872 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-09-08T15:20:47.873 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dce4d291bd4243c9802c17d67b85a6da6bbc0f8f 2020-09-08T15:20:48.061 INFO:teuthology.orchestra.run.smithi065:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-09-08T15:20:48.081 INFO:teuthology.orchestra.run.smithi065.stdout:16.0.0-5272.gdce4d291bd4.el8 2020-09-08T15:20:48.082 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-5272.gdce4d291bd4.el8 2020-09-08T15:20:48.083 INFO:teuthology.task.install:The correct ceph version 16.0.0-5272.gdce4d291bd4 is installed. 2020-09-08T15:20:48.083 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-09-08T15:20:48.084 INFO:teuthology.orchestra.run.smithi065:> set -ex 2020-09-08T15:20:48.084 INFO:teuthology.orchestra.run.smithi065:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-09-08T15:20:48.135 INFO:teuthology.orchestra.run.smithi065.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-09-08T15:20:48.152 INFO:teuthology.orchestra.run.smithi065.stderr:24+1 records in 2020-09-08T15:20:48.153 INFO:teuthology.orchestra.run.smithi065.stderr:24+1 records out 2020-09-08T15:20:48.153 INFO:teuthology.orchestra.run.smithi065.stderr:12667 bytes (13 kB, 12 KiB) copied, 8.5502e-05 s, 148 MB/s 2020-09-08T15:20:48.154 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-09-08T15:20:48.155 INFO:teuthology.orchestra.run.smithi065:> set -ex 2020-09-08T15:20:48.155 INFO:teuthology.orchestra.run.smithi065:> sudo dd of=/usr/bin/daemon-helper 2020-09-08T15:20:48.210 INFO:teuthology.orchestra.run.smithi065.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-09-08T15:20:48.227 INFO:teuthology.orchestra.run.smithi065.stderr:5+1 records in 2020-09-08T15:20:48.227 INFO:teuthology.orchestra.run.smithi065.stderr:5+1 records out 2020-09-08T15:20:48.228 INFO:teuthology.orchestra.run.smithi065.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 4.1955e-05 s, 72.9 MB/s 2020-09-08T15:20:48.229 INFO:teuthology.orchestra.run.smithi065:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-09-08T15:20:48.300 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-09-08T15:20:48.300 INFO:teuthology.orchestra.run.smithi065:> set -ex 2020-09-08T15:20:48.301 INFO:teuthology.orchestra.run.smithi065:> sudo dd of=/usr/bin/adjust-ulimits 2020-09-08T15:20:48.353 INFO:teuthology.orchestra.run.smithi065.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-09-08T15:20:48.370 INFO:teuthology.orchestra.run.smithi065.stderr:0+1 records in 2020-09-08T15:20:48.370 INFO:teuthology.orchestra.run.smithi065.stderr:0+1 records out 2020-09-08T15:20:48.370 INFO:teuthology.orchestra.run.smithi065.stderr:299 bytes copied, 2.8417e-05 s, 10.5 MB/s 2020-09-08T15:20:48.371 INFO:teuthology.orchestra.run.smithi065:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-09-08T15:20:48.446 INFO:teuthology.run_tasks:Running task workunit... 2020-09-08T15:20:48.465 INFO:tasks.workunit:Pulling workunits from ref dce4d291bd4243c9802c17d67b85a6da6bbc0f8f 2020-09-08T15:20:48.469 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-09-08T15:20:48.470 INFO:tasks.workunit:timeout=3h 2020-09-08T15:20:48.471 INFO:tasks.workunit:cleanup=True 2020-09-08T15:20:48.472 INFO:teuthology.orchestra.run.smithi065:> stat -- /home/ubuntu/cephtest/mnt.0 2020-09-08T15:20:48.507 INFO:teuthology.orchestra.run.smithi065.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-09-08T15:20:48.507 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-09-08T15:20:48.508 INFO:teuthology.orchestra.run.smithi065:> mkdir -- /home/ubuntu/cephtest/mnt.0 2020-09-08T15:20:48.561 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2020-09-08T15:20:48.562 INFO:teuthology.orchestra.run.smithi065:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2020-09-08T15:20:48.615 INFO:teuthology.orchestra.run.smithi065:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout dce4d291bd4243c9802c17d67b85a6da6bbc0f8f 2020-09-08T15:20:48.727 INFO:tasks.workunit.client.0.smithi065.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-09-08T15:21:36.996 INFO:tasks.workunit.client.0.smithi065.stderr:Note: checking out 'dce4d291bd4243c9802c17d67b85a6da6bbc0f8f'. 2020-09-08T15:21:36.997 INFO:tasks.workunit.client.0.smithi065.stderr: 2020-09-08T15:21:36.998 INFO:tasks.workunit.client.0.smithi065.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-09-08T15:21:36.998 INFO:tasks.workunit.client.0.smithi065.stderr:changes and commit them, and you can discard any commits you make in this 2020-09-08T15:21:36.998 INFO:tasks.workunit.client.0.smithi065.stderr:state without impacting any branches by performing another checkout. 2020-09-08T15:21:36.998 INFO:tasks.workunit.client.0.smithi065.stderr: 2020-09-08T15:21:36.998 INFO:tasks.workunit.client.0.smithi065.stderr:If you want to create a new branch to retain commits you create, you may 2020-09-08T15:21:36.999 INFO:tasks.workunit.client.0.smithi065.stderr:do so (now or later) by using -b with the checkout command again. Example: 2020-09-08T15:21:36.999 INFO:tasks.workunit.client.0.smithi065.stderr: 2020-09-08T15:21:36.999 INFO:tasks.workunit.client.0.smithi065.stderr: git checkout -b 2020-09-08T15:21:36.999 INFO:tasks.workunit.client.0.smithi065.stderr: 2020-09-08T15:21:36.999 INFO:tasks.workunit.client.0.smithi065.stderr:HEAD is now at dce4d291bd4 Merge branch 'wip-osd-pass-by-ref' of https://github.com/tchaikov/ceph into wip-kefu-testing-2020-09-08-0934 2020-09-08T15:21:37.002 INFO:teuthology.orchestra.run.smithi065:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-09-08T15:21:37.033 INFO:teuthology.orchestra.run.smithi065:> set -ex 2020-09-08T15:21:37.034 INFO:teuthology.orchestra.run.smithi065:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2020-09-08T15:21:37.086 INFO:teuthology.orchestra.run.smithi065.stderr:+ dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2020-09-08T15:21:37.087 INFO:teuthology.orchestra.run.smithi065.stdout:ceph-helpers.sherasure-code/test-erasure-code-plugins.sherasure-code/test-erasure-code.sherasure-code/test-erasure-eio.shmon/mon-scrub.shmon/mkfs.shmon/osd-erasure-code-profile.shmon/osd-crush.shmon/mon-bind.shmon/mon-osdmap-prune.shmon/osd-df.shmon/mon-handle-forward.shmon/mon-ping.shmon/osd-pool-create.shmon/osd-pool-df.shmon/health-mute.shmon/mon-last-epoch-clean.shmon/mon-created-time.shmon/test_pool_quota.shmon/misc.shmon/mon-seesaw.shscrub/osd-scrub-repair.shscrub/osd-scrub-snaps.shscrub/osd-scrub-dump.shscrub/osd-scrub-test.shscrub/osd-recovery-scrub.shscrub/osd-unexpected-clone.shmisc/ok-to-stop.shmisc/test-ceph-helpers.shmisc/rados-striper.shmisc/network-ping.shspecial/ceph_objectstore_tool.pyspecial/test-failure.shcrush/crush-choose-args.shcrush/crush-classes.shmgr/balancer.shosd/osd-copy-from.shosd/osd-recovery-prio.shosd/osd-backfill-recovery-log.shosd/osd-fast-mark-down.shosd/osd-markdown.shosd/osd-backfill-prio.shosd/osd-force-create-pg.shosd/osd-recovery-stats.shosd/bad-inc-map.shosd/ec-error-rollforward.shosd/osd-reuse-id.shosd/osd-reactivate.shosd/osd-dup.shosd/osd-bluefs-volume-ops.shosd/divergent-priors.shosd/osd-backfill-space.shosd/osd-recovery-space.shosd/osd-bench.shosd/osd-rep-recov-eio.shosd/repro_long_log.shosd/osd-backfill-stats.shosd/pg-split-merge.shosd/repeer-on-acting-back.shosd/osd-config.sh 2020-09-08T15:21:37.088 INFO:teuthology.orchestra.run.smithi065.stderr:2+1 records in 2020-09-08T15:21:37.088 INFO:teuthology.orchestra.run.smithi065.stderr:2+1 records out 2020-09-08T15:21:37.088 INFO:teuthology.orchestra.run.smithi065.stderr:1404 bytes (1.4 kB, 1.4 KiB) copied, 3.6959e-05 s, 38.0 MB/s 2020-09-08T15:21:37.089 INFO:tasks.workunit:Running workunits matching osd on client.0... 2020-09-08T15:21:37.089 INFO:tasks.workunit:Running workunit osd/bad-inc-map.sh... 2020-09-08T15:21:37.091 INFO:teuthology.orchestra.run.smithi065:workunit test osd/bad-inc-map.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dce4d291bd4243c9802c17d67b85a6da6bbc0f8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh 2020-09-08T15:21:37.169 INFO:tasks.workunit.client.0.smithi065.stderr:stty: 'standard input': Inappropriate ioctl for device 2020-09-08T15:21:37.195 INFO:tasks.workunit.client.0.smithi065.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2020-09-08T15:21:37.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T15:21:37.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T15:21:37.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: export PYTHONWARNINGS=ignore 2020-09-08T15:21:37.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: PYTHONWARNINGS=ignore 2020-09-08T15:21:37.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: export CEPH_CONF=/dev/null 2020-09-08T15:21:37.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: CEPH_CONF=/dev/null 2020-09-08T15:21:37.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2147: main: unset CEPH_ARGS 2020-09-08T15:21:37.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2149: main: local code 2020-09-08T15:21:37.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2150: main: run td/bad-inc-map 2020-09-08T15:21:37.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:8: run: local dir=td/bad-inc-map 2020-09-08T15:21:37.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:9: run: shift 2020-09-08T15:21:37.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: export CEPH_MON=127.0.0.1:38949 2020-09-08T15:21:37.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: CEPH_MON=127.0.0.1:38949 2020-09-08T15:21:37.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:12: run: export CEPH_ARGS 2020-09-08T15:21:37.198 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: uuidgen 2020-09-08T15:21:37.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: CEPH_ARGS+='--fsid=16769b4c-e6b0-42aa-8a32-55f280ab4e22 --auth-supported=none ' 2020-09-08T15:21:37.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:14: run: CEPH_ARGS+='--mon-host=127.0.0.1:38949 ' 2020-09-08T15:21:37.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:15: run: set -e 2020-09-08T15:21:37.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: set 2020-09-08T15:21:37.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2020-09-08T15:21:37.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: local funcs=TEST_bad_inc_map 2020-09-08T15:21:37.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:18: run: for func in $funcs 2020-09-08T15:21:37.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:19: run: setup td/bad-inc-map 2020-09-08T15:21:37.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/bad-inc-map 2020-09-08T15:21:37.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/bad-inc-map 2020-09-08T15:21:37.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/bad-inc-map 2020-09-08T15:21:37.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:21:37.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/bad-inc-map KILL 2020-09-08T15:21:37.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:21:37.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:21:37.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:21:37.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:21:37.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:21:37.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:21:37.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:21:37.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:21:37.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:21:37.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:21:37.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:21:37.210 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:21:37.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:21:37.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:21:37.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:21:37.212 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:21:37.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:21:37.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:21:37.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/bad-inc-map 2020-09-08T15:21:37.213 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:21:37.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:21:37.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.27014 2020-09-08T15:21:37.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.27014 2020-09-08T15:21:37.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:21:37.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:21:37.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/bad-inc-map 2020-09-08T15:21:37.217 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T15:21:37.217 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:21:37.217 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.27014 2020-09-08T15:21:37.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.27014 2020-09-08T15:21:37.218 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T15:21:37.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2020-09-08T15:21:37.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2020-09-08T15:21:37.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T15:21:37.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/bad-inc-map 1' TERM HUP INT 2020-09-08T15:21:37.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:20: run: TEST_bad_inc_map td/bad-inc-map 2020-09-08T15:21:37.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:26: TEST_bad_inc_map: local dir=td/bad-inc-map 2020-09-08T15:21:37.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:28: TEST_bad_inc_map: run_mon td/bad-inc-map a 2020-09-08T15:21:37.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/bad-inc-map 2020-09-08T15:21:37.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T15:21:37.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T15:21:37.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T15:21:37.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/bad-inc-map/a 2020-09-08T15:21:37.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/bad-inc-map/a --run-dir=td/bad-inc-map 2020-09-08T15:21:37.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T15:21:37.534 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:21:37.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:21:37.535 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:21:37.535 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:21:37.535 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.27014 2020-09-08T15:21:37.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.27014/$cluster-$name.asok' 2020-09-08T15:21:37.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/bad-inc-map/a '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.27014/$cluster-$name.asok' --mon-cluster-log-file=td/bad-inc-map/log --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T15:21:37.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T15:21:37.685 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T15:21:37.685 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:21:37.685 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:21:37.686 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T15:21:37.686 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T15:21:37.686 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:21:37.686 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:21:37.686 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:21:37.687 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:21:37.687 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:21:37.687 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.27014 2020-09-08T15:21:37.687 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.27014/ceph-mon.a.asok 2020-09-08T15:21:37.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:21:37.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.27014/ceph-mon.a.asok config get fsid 2020-09-08T15:21:37.777 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T15:21:37.777 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:21:37.778 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:21:37.778 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T15:21:37.778 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T15:21:37.779 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:21:37.779 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:21:37.779 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:21:37.780 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:21:37.780 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:21:37.780 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.27014 2020-09-08T15:21:37.780 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.27014/ceph-mon.a.asok 2020-09-08T15:21:37.780 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:21:37.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.27014/ceph-mon.a.asok config get mon_host 2020-09-08T15:21:37.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:29: TEST_bad_inc_map: run_mgr td/bad-inc-map x 2020-09-08T15:21:37.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/bad-inc-map 2020-09-08T15:21:37.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T15:21:37.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T15:21:37.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T15:21:37.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/bad-inc-map/x 2020-09-08T15:21:37.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T15:21:38.762 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T15:21:38.763 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:21:38.763 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:21:38.763 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:21:38.763 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:21:38.764 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.27014 2020-09-08T15:21:38.764 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.27014/$cluster-$name.asok' 2020-09-08T15:21:38.764 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:21:38.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/bad-inc-map/x '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.27014/$cluster-$name.asok' --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:21:38.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:30: TEST_bad_inc_map: run_osd td/bad-inc-map 0 2020-09-08T15:21:38.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/bad-inc-map 2020-09-08T15:21:38.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:21:38.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T15:21:38.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:21:38.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/bad-inc-map/0 2020-09-08T15:21:38.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=16769b4c-e6b0-42aa-8a32-55f280ab4e22 --auth-supported=none --mon-host=127.0.0.1:38949 ' 2020-09-08T15:21:38.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:21:38.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:21:38.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:21:38.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/0' 2020-09-08T15:21:38.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/0/journal' 2020-09-08T15:21:38.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:21:38.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:21:38.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2020-09-08T15:21:38.793 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:21:38.793 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:21:38.793 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:21:38.793 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:21:38.794 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:21:38.794 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.27014 2020-09-08T15:21:38.794 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.27014/$cluster-$name.asok' 2020-09-08T15:21:38.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.27014/$cluster-$name.asok' 2020-09-08T15:21:38.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:21:38.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:21:38.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:21:38.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2020-09-08T15:21:38.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2020-09-08T15:21:38.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:21:38.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:21:38.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:21:38.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:21:38.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:21:38.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/bad-inc-map/0 2020-09-08T15:21:38.798 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:21:38.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=99a2fa7d-6bbf-4b06-9d1a-b4e47f04bbcf 2020-09-08T15:21:38.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 99a2fa7d-6bbf-4b06-9d1a-b4e47f04bbcf' 2020-09-08T15:21:38.798 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:21:38.799 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 99a2fa7d-6bbf-4b06-9d1a-b4e47f04bbcf 2020-09-08T15:21:38.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCCoVdfLAAkMBAACGZz0LUsg/1lpgjV2K/ajg== 2020-09-08T15:21:38.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCCoVdfLAAkMBAACGZz0LUsg/1lpgjV2K/ajg=="}' 2020-09-08T15:21:38.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 99a2fa7d-6bbf-4b06-9d1a-b4e47f04bbcf -i td/bad-inc-map/0/new.json 2020-09-08T15:21:39.175 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:21:39.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/bad-inc-map/0/new.json 2020-09-08T15:21:39.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=16769b4c-e6b0-42aa-8a32-55f280ab4e22 --auth-supported=none --mon-host=127.0.0.1:38949 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.27014/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCCoVdfLAAkMBAACGZz0LUsg/1lpgjV2K/ajg== --osd-uuid 99a2fa7d-6bbf-4b06-9d1a-b4e47f04bbcf 2020-09-08T15:21:39.208 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:39.213+0000 7fdeec964ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:21:39.209 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:39.214+0000 7fdeec964ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:21:39.210 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:39.215+0000 7fdeec964ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:21:39.211 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:39.216+0000 7fdeec964ec0 -1 bluestore(td/bad-inc-map/0/block) _read_bdev_label failed to open td/bad-inc-map/0/block: (2) No such file or directory 2020-09-08T15:21:39.211 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:39.216+0000 7fdeec964ec0 -1 bluestore(td/bad-inc-map/0/block) _read_bdev_label failed to open td/bad-inc-map/0/block: (2) No such file or directory 2020-09-08T15:21:39.211 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:39.216+0000 7fdeec964ec0 -1 bluestore(td/bad-inc-map/0/block) _read_bdev_label failed to open td/bad-inc-map/0/block: (2) No such file or directory 2020-09-08T15:21:39.269 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:39.271+0000 7fdeec964ec0 -1 bluestore(td/bad-inc-map/0) _read_fsid unparsable uuid 2020-09-08T15:21:43.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/bad-inc-map/0/keyring 2020-09-08T15:21:43.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:21:43.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T15:21:43.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/bad-inc-map/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:21:43.565 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T15:21:43.839 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T15:21:43.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T15:21:43.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=16769b4c-e6b0-42aa-8a32-55f280ab4e22 --auth-supported=none --mon-host=127.0.0.1:38949 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.27014/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:21:43.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:21:43.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:21:43.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:21:43.849 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:43.854+0000 7f34c0d13ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:21:43.851 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:43.856+0000 7f34c0d13ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:21:43.855 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:43.857+0000 7f34c0d13ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:21:44.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T15:21:44.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:21:44.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:21:44.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:21:44.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:21:44.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:21:44.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:21:44.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:21:44.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:21:44.076 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:21:44.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:21:44.379 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:44.378+0000 7f34c0d13ec0 -1 Falling back to public interface 2020-09-08T15:21:45.231 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:45.235+0000 7f34c0d13ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T15:21:45.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:21:45.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:21:45.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:21:45.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:21:45.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:21:45.342 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:21:45.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:21:46.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:21:46.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:21:46.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T15:21:46.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:21:46.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:21:46.736 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T15:21:47.144 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/27824,v1:127.0.0.1:6803/27824] [v2:127.0.0.1:6804/27824,v1:127.0.0.1:6805/27824] exists,up 99a2fa7d-6bbf-4b06-9d1a-b4e47f04bbcf 2020-09-08T15:21:47.145 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 0d61f9ed-1223-4052-bcf0-242751eb0b9b 2020-09-08T15:21:47.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:21:47.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:21:47.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:21:47.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:31: TEST_bad_inc_map: run_osd td/bad-inc-map 1 2020-09-08T15:21:47.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/bad-inc-map 2020-09-08T15:21:47.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:21:47.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T15:21:47.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:21:47.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/bad-inc-map/1 2020-09-08T15:21:47.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=16769b4c-e6b0-42aa-8a32-55f280ab4e22 --auth-supported=none --mon-host=127.0.0.1:38949 ' 2020-09-08T15:21:47.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:21:47.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:21:47.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:21:47.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/1' 2020-09-08T15:21:47.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/1/journal' 2020-09-08T15:21:47.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:21:47.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:21:47.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2020-09-08T15:21:47.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:21:47.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:21:47.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:21:47.162 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:21:47.163 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:21:47.163 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.27014 2020-09-08T15:21:47.163 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.27014/$cluster-$name.asok' 2020-09-08T15:21:47.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.27014/$cluster-$name.asok' 2020-09-08T15:21:47.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:21:47.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:21:47.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:21:47.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2020-09-08T15:21:47.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2020-09-08T15:21:47.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:21:47.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:21:47.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:21:47.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:21:47.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:21:47.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/bad-inc-map/1 2020-09-08T15:21:47.166 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:21:47.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=0d61f9ed-1223-4052-bcf0-242751eb0b9b 2020-09-08T15:21:47.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 0d61f9ed-1223-4052-bcf0-242751eb0b9b' 2020-09-08T15:21:47.166 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:21:47.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCLoVdffqKlCRAAErln0HgS6Z4/rOK/bSJJHQ== 2020-09-08T15:21:47.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCLoVdffqKlCRAAErln0HgS6Z4/rOK/bSJJHQ=="}' 2020-09-08T15:21:47.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 0d61f9ed-1223-4052-bcf0-242751eb0b9b -i td/bad-inc-map/1/new.json 2020-09-08T15:21:47.648 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:21:47.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/bad-inc-map/1/new.json 2020-09-08T15:21:47.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=16769b4c-e6b0-42aa-8a32-55f280ab4e22 --auth-supported=none --mon-host=127.0.0.1:38949 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.27014/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCLoVdffqKlCRAAErln0HgS6Z4/rOK/bSJJHQ== --osd-uuid 0d61f9ed-1223-4052-bcf0-242751eb0b9b 2020-09-08T15:21:47.683 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:47.685+0000 7f77da39fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:21:47.684 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:47.687+0000 7f77da39fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:21:47.684 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:47.689+0000 7f77da39fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:21:47.685 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:47.689+0000 7f77da39fec0 -1 bluestore(td/bad-inc-map/1/block) _read_bdev_label failed to open td/bad-inc-map/1/block: (2) No such file or directory 2020-09-08T15:21:47.685 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:47.689+0000 7f77da39fec0 -1 bluestore(td/bad-inc-map/1/block) _read_bdev_label failed to open td/bad-inc-map/1/block: (2) No such file or directory 2020-09-08T15:21:47.685 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:47.689+0000 7f77da39fec0 -1 bluestore(td/bad-inc-map/1/block) _read_bdev_label failed to open td/bad-inc-map/1/block: (2) No such file or directory 2020-09-08T15:21:47.733 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:47.738+0000 7f77da39fec0 -1 bluestore(td/bad-inc-map/1) _read_fsid unparsable uuid 2020-09-08T15:21:52.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/bad-inc-map/1/keyring 2020-09-08T15:21:52.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:21:52.194 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T15:21:52.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T15:21:52.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/bad-inc-map/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:21:52.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T15:21:52.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=16769b4c-e6b0-42aa-8a32-55f280ab4e22 --auth-supported=none --mon-host=127.0.0.1:38949 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.27014/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:21:52.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:21:52.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:21:52.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:21:52.728 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:21:52.746 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:52.750+0000 7fc7c96abec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:21:52.763 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:52.768+0000 7fc7c96abec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:21:52.764 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:52.769+0000 7fc7c96abec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:21:53.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T15:21:53.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:21:53.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:21:53.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:21:53.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:21:53.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:21:53.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:21:53.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:21:53.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:21:53.160 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:21:53.281 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:53.284+0000 7fc7c96abec0 -1 Falling back to public interface 2020-09-08T15:21:53.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:21:54.064 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:54.068+0000 7fc7c96abec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T15:21:54.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:21:55.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:21:55.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:21:55.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:21:55.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:21:55.446 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:21:55.451 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/28903,v1:127.0.0.1:6811/28903] [v2:127.0.0.1:6812/28903,v1:127.0.0.1:6813/28903] exists,up 0d61f9ed-1223-4052-bcf0-242751eb0b9b 2020-09-08T15:21:55.451 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 a53d8a3d-fd58-4212-83c3-93b34198b55f 2020-09-08T15:21:55.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:21:55.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:21:55.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:21:55.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:32: TEST_bad_inc_map: run_osd td/bad-inc-map 2 2020-09-08T15:21:55.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/bad-inc-map 2020-09-08T15:21:55.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:21:55.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T15:21:55.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:21:55.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/bad-inc-map/2 2020-09-08T15:21:55.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=16769b4c-e6b0-42aa-8a32-55f280ab4e22 --auth-supported=none --mon-host=127.0.0.1:38949 ' 2020-09-08T15:21:55.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:21:55.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:21:55.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:21:55.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/2' 2020-09-08T15:21:55.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/2/journal' 2020-09-08T15:21:55.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:21:55.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:21:55.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2020-09-08T15:21:55.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:21:55.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:21:55.456 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:21:55.456 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:21:55.456 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:21:55.456 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.27014 2020-09-08T15:21:55.457 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.27014/$cluster-$name.asok' 2020-09-08T15:21:55.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.27014/$cluster-$name.asok' 2020-09-08T15:21:55.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:21:55.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:21:55.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:21:55.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2020-09-08T15:21:55.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2020-09-08T15:21:55.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:21:55.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:21:55.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:21:55.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:21:55.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:21:55.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/bad-inc-map/2 2020-09-08T15:21:55.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:21:55.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=a53d8a3d-fd58-4212-83c3-93b34198b55f 2020-09-08T15:21:55.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 a53d8a3d-fd58-4212-83c3-93b34198b55f' 2020-09-08T15:21:55.460 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:21:55.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCToVdfFTwnABAA/MlUKGU9kcVYntXEMwdc8Q== 2020-09-08T15:21:55.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCToVdfFTwnABAA/MlUKGU9kcVYntXEMwdc8Q=="}' 2020-09-08T15:21:55.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new a53d8a3d-fd58-4212-83c3-93b34198b55f -i td/bad-inc-map/2/new.json 2020-09-08T15:21:55.520 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T15:21:55.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/bad-inc-map/2/new.json 2020-09-08T15:21:55.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=16769b4c-e6b0-42aa-8a32-55f280ab4e22 --auth-supported=none --mon-host=127.0.0.1:38949 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.27014/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCToVdfFTwnABAA/MlUKGU9kcVYntXEMwdc8Q== --osd-uuid a53d8a3d-fd58-4212-83c3-93b34198b55f 2020-09-08T15:21:55.552 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:55.557+0000 7f3dd5b28ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:21:55.554 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:55.559+0000 7f3dd5b28ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:21:55.555 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:55.560+0000 7f3dd5b28ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:21:55.556 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:55.561+0000 7f3dd5b28ec0 -1 bluestore(td/bad-inc-map/2/block) _read_bdev_label failed to open td/bad-inc-map/2/block: (2) No such file or directory 2020-09-08T15:21:55.557 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:55.561+0000 7f3dd5b28ec0 -1 bluestore(td/bad-inc-map/2/block) _read_bdev_label failed to open td/bad-inc-map/2/block: (2) No such file or directory 2020-09-08T15:21:55.557 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:55.561+0000 7f3dd5b28ec0 -1 bluestore(td/bad-inc-map/2/block) _read_bdev_label failed to open td/bad-inc-map/2/block: (2) No such file or directory 2020-09-08T15:21:55.646 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:21:55.650+0000 7f3dd5b28ec0 -1 bluestore(td/bad-inc-map/2) _read_fsid unparsable uuid 2020-09-08T15:21:59.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/bad-inc-map/2/keyring 2020-09-08T15:21:59.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:21:59.945 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T15:21:59.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T15:21:59.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/bad-inc-map/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:22:00.475 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T15:22:00.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T15:22:00.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:22:00.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=16769b4c-e6b0-42aa-8a32-55f280ab4e22 --auth-supported=none --mon-host=127.0.0.1:38949 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.27014/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:22:00.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:22:00.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:22:00.495 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:00.500+0000 7fb9bb742ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:22:00.497 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:00.502+0000 7fb9bb742ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:22:00.499 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:00.503+0000 7fb9bb742ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:22:00.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T15:22:00.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:22:00.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:22:00.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:22:00.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:22:00.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:22:00.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:22:00.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:22:00.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:22:00.875 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:22:01.020 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:01.025+0000 7fb9bb742ec0 -1 Falling back to public interface 2020-09-08T15:22:01.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:22:01.830 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:01.835+0000 7fb9bb742ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T15:22:02.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:22:02.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:22:02.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:22:02.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:22:02.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:22:02.310 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:22:02.739 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/29951,v1:127.0.0.1:6819/29951] [v2:127.0.0.1:6820/29951,v1:127.0.0.1:6821/29951] exists,up a53d8a3d-fd58-4212-83c3-93b34198b55f 2020-09-08T15:22:02.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:22:02.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:22:02.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:22:02.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:34: TEST_bad_inc_map: ceph config set osd.2 osd_inject_bad_map_crc_probability 1 2020-09-08T15:22:03.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:37: TEST_bad_inc_map: create_pool foo 8 2020-09-08T15:22:03.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create foo 8 2020-09-08T15:22:03.788 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'foo' already exists 2020-09-08T15:22:03.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:22:04.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:38: TEST_bad_inc_map: ceph osd pool set foo min_size 1 2020-09-08T15:22:05.979 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 min_size to 1 2020-09-08T15:22:05.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:39: TEST_bad_inc_map: ceph osd pool set foo min_size 2 2020-09-08T15:22:06.955 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 min_size to 2 2020-09-08T15:22:06.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:41: TEST_bad_inc_map: sleep 5 2020-09-08T15:22:11.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: TIMEOUT=10 2020-09-08T15:22:11.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: wait_for_osd up 0 2020-09-08T15:22:11.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:22:11.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:22:11.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:22:11.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:22:11.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 10 )) 2020-09-08T15:22:11.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:22:11.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:22:11.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:22:11.967 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:22:12.369 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/27824,v1:127.0.0.1:6803/27824] [v2:127.0.0.1:6804/27824,v1:127.0.0.1:6805/27824] exists,up 99a2fa7d-6bbf-4b06-9d1a-b4e47f04bbcf 2020-09-08T15:22:12.369 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:22:12.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:22:12.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:22:12.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:22:12.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: TIMEOUT=10 2020-09-08T15:22:12.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: wait_for_osd up 1 2020-09-08T15:22:12.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:22:12.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:22:12.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:22:12.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:22:12.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 10 )) 2020-09-08T15:22:12.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:22:12.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:22:12.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:22:12.757 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/28903,v1:127.0.0.1:6811/28903] [v2:127.0.0.1:6812/28903,v1:127.0.0.1:6813/28903] exists,up 0d61f9ed-1223-4052-bcf0-242751eb0b9b 2020-09-08T15:22:12.758 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:22:12.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:22:12.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:22:12.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:22:12.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: TIMEOUT=10 2020-09-08T15:22:12.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: wait_for_osd up 2 2020-09-08T15:22:12.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:22:12.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:22:12.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:22:12.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:22:12.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 10 )) 2020-09-08T15:22:12.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:22:12.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:22:12.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:22:13.142 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/29951,v1:127.0.0.1:6819/29951] [v2:127.0.0.1:6820/29951,v1:127.0.0.1:6821/29951] exists,up a53d8a3d-fd58-4212-83c3-93b34198b55f 2020-09-08T15:22:13.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:22:13.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:22:13.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:22:13.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:49: TEST_bad_inc_map: grep 'injecting map crc failure' td/bad-inc-map/osd.2.log 2020-09-08T15:22:13.144 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:03.651+0000 7fb9a4093700 -1 osd.2 15 handle_osd_map injecting map crc failure 2020-09-08T15:22:13.144 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:03.904+0000 7fb9a4093700 -1 osd.2 17 handle_osd_map injecting map crc failure 2020-09-08T15:22:13.144 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:04.330+0000 7fb9a4093700 -1 osd.2 18 handle_osd_map injecting map crc failure 2020-09-08T15:22:13.144 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:04.983+0000 7fb9a4093700 -1 osd.2 19 handle_osd_map injecting map crc failure 2020-09-08T15:22:13.144 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:05.721+0000 7fb9a208f700 -1 osd.2 20 handle_osd_map injecting map crc failure 2020-09-08T15:22:13.145 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:06.224+0000 7fb9a208f700 -1 osd.2 23 handle_osd_map injecting map crc failure 2020-09-08T15:22:13.145 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:06.224+0000 7fb9a208f700 -1 osd.2 23 handle_osd_map injecting map crc failure 2020-09-08T15:22:13.145 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:06.274+0000 7fb9a4093700 -1 osd.2 23 handle_osd_map injecting map crc failure 2020-09-08T15:22:13.145 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:06.275+0000 7fb9a4093700 -1 osd.2 23 handle_osd_map injecting map crc failure 2020-09-08T15:22:13.145 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:06.601+0000 7fb9a4093700 -1 osd.2 25 handle_osd_map injecting map crc failure 2020-09-08T15:22:13.146 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:07.188+0000 7fb9a208f700 -1 osd.2 26 handle_osd_map injecting map crc failure 2020-09-08T15:22:13.146 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:07.189+0000 7fb9a208f700 -1 osd.2 26 handle_osd_map injecting map crc failure 2020-09-08T15:22:13.146 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:07.306+0000 7fb9a4093700 -1 osd.2 26 handle_osd_map injecting map crc failure 2020-09-08T15:22:13.146 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:07.682+0000 7fb9a4093700 -1 osd.2 28 handle_osd_map injecting map crc failure 2020-09-08T15:22:13.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:50: TEST_bad_inc_map: grep 'bailing because last' td/bad-inc-map/osd.2.log 2020-09-08T15:22:13.147 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:03.652+0000 7fb9a4093700 10 osd.2 15 handle_osd_map bailing because last < start (15<16) 2020-09-08T15:22:13.148 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:03.904+0000 7fb9a4093700 10 osd.2 17 handle_osd_map bailing because last < start (17<18) 2020-09-08T15:22:13.148 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:04.330+0000 7fb9a4093700 10 osd.2 18 handle_osd_map bailing because last < start (18<19) 2020-09-08T15:22:13.148 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:04.984+0000 7fb9a4093700 10 osd.2 19 handle_osd_map bailing because last < start (19<20) 2020-09-08T15:22:13.148 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:05.722+0000 7fb9a208f700 10 osd.2 20 handle_osd_map bailing because last < start (20<21) 2020-09-08T15:22:13.148 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:06.224+0000 7fb9a208f700 10 osd.2 23 handle_osd_map bailing because last < start (23<24) 2020-09-08T15:22:13.149 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:06.225+0000 7fb9a208f700 10 osd.2 23 handle_osd_map bailing because last < start (23<24) 2020-09-08T15:22:13.149 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:06.274+0000 7fb9a4093700 10 osd.2 23 handle_osd_map bailing because last < start (23<24) 2020-09-08T15:22:13.149 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:06.275+0000 7fb9a4093700 10 osd.2 23 handle_osd_map bailing because last < start (23<24) 2020-09-08T15:22:13.149 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:06.602+0000 7fb9a4093700 10 osd.2 25 handle_osd_map bailing because last < start (25<26) 2020-09-08T15:22:13.149 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:07.188+0000 7fb9a208f700 10 osd.2 26 handle_osd_map bailing because last < start (26<27) 2020-09-08T15:22:13.150 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:07.189+0000 7fb9a208f700 10 osd.2 26 handle_osd_map bailing because last < start (26<27) 2020-09-08T15:22:13.150 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:07.307+0000 7fb9a4093700 10 osd.2 26 handle_osd_map bailing because last < start (27<28) 2020-09-08T15:22:13.150 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T15:22:07.682+0000 7fb9a4093700 10 osd.2 28 handle_osd_map bailing because last < start (28<29) 2020-09-08T15:22:13.150 INFO:tasks.workunit.client.0.smithi065.stdout:success 2020-09-08T15:22:13.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:52: TEST_bad_inc_map: echo success 2020-09-08T15:22:13.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:54: TEST_bad_inc_map: delete_pool foo 2020-09-08T15:22:13.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=foo 2020-09-08T15:22:13.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete foo foo --yes-i-really-really-mean-it 2020-09-08T15:22:13.682 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'foo' does not exist 2020-09-08T15:22:13.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:55: TEST_bad_inc_map: kill_daemons td/bad-inc-map 2020-09-08T15:22:13.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:22:13.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:22:13.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:22:13.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:22:13.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:22:13.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:22:13.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:21: run: teardown td/bad-inc-map 2020-09-08T15:22:13.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/bad-inc-map 2020-09-08T15:22:13.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:22:13.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/bad-inc-map KILL 2020-09-08T15:22:13.799 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:22:13.799 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:22:13.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:22:13.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:22:13.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:22:13.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:22:13.805 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:22:13.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:22:13.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:22:13.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:22:13.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:22:13.809 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:22:13.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:22:13.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:22:13.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:22:13.811 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:22:13.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:22:13.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:22:13.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/bad-inc-map 2020-09-08T15:22:13.813 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:22:13.813 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:22:13.813 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.27014 2020-09-08T15:22:13.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.27014 2020-09-08T15:22:13.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:22:13.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:22:13.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2151: main: code=0 2020-09-08T15:22:13.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2155: main: teardown td/bad-inc-map 0 2020-09-08T15:22:13.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/bad-inc-map 2020-09-08T15:22:13.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2020-09-08T15:22:13.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/bad-inc-map KILL 2020-09-08T15:22:13.820 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:22:13.821 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:22:13.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:22:13.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:22:13.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:22:13.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:22:13.826 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:22:13.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:22:13.826 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:22:13.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:22:13.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:22:13.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:22:13.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:22:13.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:22:13.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:22:13.828 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:22:13.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:22:13.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2020-09-08T15:22:13.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/bad-inc-map 2020-09-08T15:22:13.828 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:22:13.829 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:22:13.829 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.27014 2020-09-08T15:22:13.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.27014 2020-09-08T15:22:13.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:22:13.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:22:13.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2156: main: return 0 2020-09-08T15:22:13.831 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-09-08T15:22:13.831 INFO:teuthology.orchestra.run.smithi065:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-09-08T15:22:13.899 INFO:tasks.workunit:Running workunit osd/divergent-priors.sh... 2020-09-08T15:22:13.900 INFO:teuthology.orchestra.run.smithi065:workunit test osd/divergent-priors.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dce4d291bd4243c9802c17d67b85a6da6bbc0f8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh 2020-09-08T15:22:13.960 INFO:tasks.workunit.client.0.smithi065.stderr:stty: 'standard input': Inappropriate ioctl for device 2020-09-08T15:22:13.974 INFO:tasks.workunit.client.0.smithi065.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2020-09-08T15:22:13.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T15:22:13.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T15:22:13.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: export PYTHONWARNINGS=ignore 2020-09-08T15:22:13.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: PYTHONWARNINGS=ignore 2020-09-08T15:22:13.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: export CEPH_CONF=/dev/null 2020-09-08T15:22:13.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: CEPH_CONF=/dev/null 2020-09-08T15:22:13.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2147: main: unset CEPH_ARGS 2020-09-08T15:22:13.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2149: main: local code 2020-09-08T15:22:13.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2150: main: run td/divergent-priors 2020-09-08T15:22:13.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:21: run: local dir=td/divergent-priors 2020-09-08T15:22:14.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:22: run: shift 2020-09-08T15:22:14.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: export loglen=12 2020-09-08T15:22:14.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: loglen=12 2020-09-08T15:22:14.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: export divisor=3 2020-09-08T15:22:14.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: divisor=3 2020-09-08T15:22:14.028 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: expr 12 / 2 2020-09-08T15:22:14.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: export trim=6 2020-09-08T15:22:14.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: trim=6 2020-09-08T15:22:14.029 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: expr 6 / 3 2020-09-08T15:22:14.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: export DIVERGENT_WRITE=2 2020-09-08T15:22:14.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: DIVERGENT_WRITE=2 2020-09-08T15:22:14.037 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: expr 6 / 3 2020-09-08T15:22:14.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: export DIVERGENT_REMOVE=2 2020-09-08T15:22:14.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: DIVERGENT_REMOVE=2 2020-09-08T15:22:14.040 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: expr 6 / 3 2020-09-08T15:22:14.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: export DIVERGENT_CREATE=2 2020-09-08T15:22:14.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: DIVERGENT_CREATE=2 2020-09-08T15:22:14.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: export poolname=test 2020-09-08T15:22:14.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: poolname=test 2020-09-08T15:22:14.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: export testobjects=100 2020-09-08T15:22:14.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: testobjects=100 2020-09-08T15:22:14.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: export CEPH_MON=127.0.0.1:7115 2020-09-08T15:22:14.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: CEPH_MON=127.0.0.1:7115 2020-09-08T15:22:14.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:35: run: export CEPH_ARGS 2020-09-08T15:22:14.043 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: uuidgen 2020-09-08T15:22:14.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: CEPH_ARGS+='--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none ' 2020-09-08T15:22:14.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:37: run: CEPH_ARGS+='--mon-host=127.0.0.1:7115 ' 2020-09-08T15:22:14.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:39: run: CEPH_ARGS+='--osd_force_auth_primary_missing_objects=1000000 ' 2020-09-08T15:22:14.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:40: run: CEPH_ARGS+='--osd_debug_pg_log_writeout=true ' 2020-09-08T15:22:14.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:41: run: CEPH_ARGS+='--osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:22:14.045 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: set 2020-09-08T15:22:14.045 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2020-09-08T15:22:14.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: local 'funcs=TEST_divergent 2020-09-08T15:22:14.069 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_divergent_2 2020-09-08T15:22:14.070 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_divergent_3 2020-09-08T15:22:14.070 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_divergent_ec' 2020-09-08T15:22:14.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2020-09-08T15:22:14.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2020-09-08T15:22:14.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/divergent-priors 2020-09-08T15:22:14.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/divergent-priors 2020-09-08T15:22:14.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/divergent-priors 2020-09-08T15:22:14.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:22:14.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/divergent-priors KILL 2020-09-08T15:22:14.073 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:22:14.073 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:22:14.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:22:14.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:22:14.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:22:14.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:22:14.075 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:22:14.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:22:14.076 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:22:14.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:22:14.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:22:14.077 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:22:14.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:22:14.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:22:14.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:22:14.078 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:22:14.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:22:14.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:22:14.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/divergent-priors 2020-09-08T15:22:14.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:22:14.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:22:14.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:22:14.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30667 2020-09-08T15:22:14.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:22:14.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:22:14.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/divergent-priors 2020-09-08T15:22:14.087 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T15:22:14.087 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:22:14.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:22:14.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.30667 2020-09-08T15:22:14.089 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T15:22:14.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2020-09-08T15:22:14.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2020-09-08T15:22:14.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T15:22:14.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2020-09-08T15:22:14.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent td/divergent-priors 2020-09-08T15:22:14.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:57: TEST_divergent: local dir=td/divergent-priors 2020-09-08T15:22:14.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:60: TEST_divergent: local dummyfile=/etc/fstab 2020-09-08T15:22:14.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: local dummyfile2=/etc/resolv.conf 2020-09-08T15:22:14.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:63: TEST_divergent: local num_osds=3 2020-09-08T15:22:14.093 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: expr 3 - 1 2020-09-08T15:22:14.094 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: seq 0 2 2020-09-08T15:22:14.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: local 'osds=0 2020-09-08T15:22:14.094 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:22:14.095 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:22:14.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:65: TEST_divergent: run_mon td/divergent-priors a 2020-09-08T15:22:14.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/divergent-priors 2020-09-08T15:22:14.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T15:22:14.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T15:22:14.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T15:22:14.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/divergent-priors/a 2020-09-08T15:22:14.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2020-09-08T15:22:14.243 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T15:22:14.244 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:22:14.244 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:22:14.245 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:22:14.245 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:22:14.246 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:22:14.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:22:14.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T15:22:14.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T15:22:14.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T15:22:14.454 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:22:14.454 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:22:14.454 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T15:22:14.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T15:22:14.455 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:22:14.455 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:22:14.456 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:22:14.456 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:22:14.456 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:22:14.457 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:22:14.457 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-mon.a.asok 2020-09-08T15:22:14.458 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:22:14.458 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30667/ceph-mon.a.asok config get fsid 2020-09-08T15:22:14.544 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T15:22:14.545 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:22:14.545 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:22:14.545 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T15:22:14.546 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T15:22:14.546 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:22:14.546 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:22:14.546 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:22:14.546 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:22:14.547 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:22:14.547 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:22:14.547 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-mon.a.asok 2020-09-08T15:22:14.547 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:22:14.547 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30667/ceph-mon.a.asok config get mon_host 2020-09-08T15:22:14.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_mgr td/divergent-priors x 2020-09-08T15:22:14.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/divergent-priors 2020-09-08T15:22:14.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T15:22:14.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T15:22:14.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T15:22:14.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/divergent-priors/x 2020-09-08T15:22:14.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T15:22:15.639 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T15:22:15.639 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:22:15.639 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:22:15.640 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:22:15.640 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:22:15.640 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:22:15.640 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:22:15.640 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:22:15.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:22:15.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:67: TEST_divergent: for i in $osds 2020-09-08T15:22:15.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:69: TEST_divergent: run_osd td/divergent-priors 0 2020-09-08T15:22:15.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/divergent-priors 2020-09-08T15:22:15.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:22:15.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T15:22:15.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:22:15.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/divergent-priors/0 2020-09-08T15:22:15.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:22:15.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:22:15.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:22:15.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:22:15.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2020-09-08T15:22:15.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2020-09-08T15:22:15.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:22:15.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:22:15.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:22:15.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:22:15.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:22:15.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:22:15.664 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:22:15.664 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:22:15.664 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:22:15.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:22:15.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:22:15.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:22:15.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:22:15.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:22:15.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:22:15.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:22:15.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:22:15.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:22:15.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:22:15.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:22:15.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:22:15.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/divergent-priors/0 2020-09-08T15:22:15.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:22:15.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=0995576a-0b47-4a00-b362-285884219bcc 2020-09-08T15:22:15.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 0995576a-0b47-4a00-b362-285884219bcc' 2020-09-08T15:22:15.670 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:22:15.671 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 0995576a-0b47-4a00-b362-285884219bcc 2020-09-08T15:22:15.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCnoVdfD9DXKBAAEhH7RU4jLXMB6F89brAs8w== 2020-09-08T15:22:15.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCnoVdfD9DXKBAAEhH7RU4jLXMB6F89brAs8w=="}' 2020-09-08T15:22:15.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 0995576a-0b47-4a00-b362-285884219bcc -i td/divergent-priors/0/new.json 2020-09-08T15:22:16.112 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:22:16.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/divergent-priors/0/new.json 2020-09-08T15:22:16.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCnoVdfD9DXKBAAEhH7RU4jLXMB6F89brAs8w== --osd-uuid 0995576a-0b47-4a00-b362-285884219bcc 2020-09-08T15:22:16.153 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:16.157+0000 7fa93be4cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:22:16.154 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:16.159+0000 7fa93be4cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:22:16.156 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:16.161+0000 7fa93be4cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:22:16.157 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:16.162+0000 7fa93be4cec0 -1 bluestore(td/divergent-priors/0/block) _read_bdev_label failed to open td/divergent-priors/0/block: (2) No such file or directory 2020-09-08T15:22:16.157 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:16.162+0000 7fa93be4cec0 -1 bluestore(td/divergent-priors/0/block) _read_bdev_label failed to open td/divergent-priors/0/block: (2) No such file or directory 2020-09-08T15:22:16.157 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:16.162+0000 7fa93be4cec0 -1 bluestore(td/divergent-priors/0/block) _read_bdev_label failed to open td/divergent-priors/0/block: (2) No such file or directory 2020-09-08T15:22:16.192 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:16.197+0000 7fa93be4cec0 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2020-09-08T15:22:20.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/divergent-priors/0/keyring 2020-09-08T15:22:20.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:22:20.699 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T15:22:20.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T15:22:20.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:22:21.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T15:22:21.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:22:21.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:22:21.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:22:21.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:22:21.228 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T15:22:21.255 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:21.259+0000 7f8dfd029ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:22:21.274 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:21.278+0000 7f8dfd029ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:22:21.276 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:21.280+0000 7f8dfd029ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:22:21.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T15:22:21.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:22:21.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:22:21.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:22:21.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:22:21.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:22:21.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:22:21.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:22:21.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:22:21.636 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:22:21.793 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:21.796+0000 7f8dfd029ec0 -1 Falling back to public interface 2020-09-08T15:22:22.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:22:22.600 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:22.603+0000 7f8dfd029ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T15:22:23.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:22:23.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:22:23.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:22:23.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:22:23.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:22:23.043 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:22:23.451 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/31532,v1:127.0.0.1:6803/31532] [v2:127.0.0.1:6804/31532,v1:127.0.0.1:6805/31532] exists,up 0995576a-0b47-4a00-b362-285884219bcc 2020-09-08T15:22:23.451 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 a4e3c598-4840-46b3-b4f8-a70df3240520 2020-09-08T15:22:23.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:22:23.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:22:23.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:22:23.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:67: TEST_divergent: for i in $osds 2020-09-08T15:22:23.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:69: TEST_divergent: run_osd td/divergent-priors 1 2020-09-08T15:22:23.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/divergent-priors 2020-09-08T15:22:23.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:22:23.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T15:22:23.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:22:23.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/divergent-priors/1 2020-09-08T15:22:23.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:22:23.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:22:23.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:22:23.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:22:23.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2020-09-08T15:22:23.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2020-09-08T15:22:23.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:22:23.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:22:23.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:22:23.458 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:22:23.458 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:22:23.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:22:23.459 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:22:23.459 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:22:23.460 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:22:23.460 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:22:23.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:22:23.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:22:23.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:22:23.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:22:23.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:22:23.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:22:23.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:22:23.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:22:23.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:22:23.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:22:23.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:22:23.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/divergent-priors/1 2020-09-08T15:22:23.463 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:22:23.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=a4e3c598-4840-46b3-b4f8-a70df3240520 2020-09-08T15:22:23.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 a4e3c598-4840-46b3-b4f8-a70df3240520' 2020-09-08T15:22:23.465 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:22:23.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCvoVdfJr0sHBAAfM+YEm13XcEHMDyW+UqWHA== 2020-09-08T15:22:23.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCvoVdfJr0sHBAAfM+YEm13XcEHMDyW+UqWHA=="}' 2020-09-08T15:22:23.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new a4e3c598-4840-46b3-b4f8-a70df3240520 -i td/divergent-priors/1/new.json 2020-09-08T15:22:24.011 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:22:24.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/divergent-priors/1/new.json 2020-09-08T15:22:24.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCvoVdfJr0sHBAAfM+YEm13XcEHMDyW+UqWHA== --osd-uuid a4e3c598-4840-46b3-b4f8-a70df3240520 2020-09-08T15:22:24.052 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:24.055+0000 7fcf15b68ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:22:24.053 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:24.057+0000 7fcf15b68ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:22:24.055 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:24.058+0000 7fcf15b68ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:22:24.056 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:24.058+0000 7fcf15b68ec0 -1 bluestore(td/divergent-priors/1/block) _read_bdev_label failed to open td/divergent-priors/1/block: (2) No such file or directory 2020-09-08T15:22:24.056 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:24.058+0000 7fcf15b68ec0 -1 bluestore(td/divergent-priors/1/block) _read_bdev_label failed to open td/divergent-priors/1/block: (2) No such file or directory 2020-09-08T15:22:24.056 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:24.058+0000 7fcf15b68ec0 -1 bluestore(td/divergent-priors/1/block) _read_bdev_label failed to open td/divergent-priors/1/block: (2) No such file or directory 2020-09-08T15:22:24.126 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:24.130+0000 7fcf15b68ec0 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2020-09-08T15:22:28.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/divergent-priors/1/keyring 2020-09-08T15:22:28.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:22:28.880 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T15:22:28.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T15:22:28.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:22:29.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T15:22:29.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:22:29.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:22:29.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:22:29.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:22:29.419 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:22:29.447 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:29.452+0000 7f14db96dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:22:29.455 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:29.460+0000 7f14db96dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:22:29.457 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:29.462+0000 7f14db96dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:22:29.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T15:22:29.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:22:29.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:22:29.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:22:29.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:22:29.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:22:29.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:22:29.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:22:29.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:22:29.845 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:22:29.975 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:29.977+0000 7f14db96dec0 -1 Falling back to public interface 2020-09-08T15:22:30.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:22:30.773 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:30.778+0000 7f14db96dec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T15:22:31.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:22:31.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:22:31.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:22:31.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:22:31.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:22:31.244 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:22:31.661 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/32526,v1:127.0.0.1:6811/32526] [v2:127.0.0.1:6812/32526,v1:127.0.0.1:6813/32526] exists,up a4e3c598-4840-46b3-b4f8-a70df3240520 2020-09-08T15:22:31.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:22:31.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:22:31.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:22:31.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:67: TEST_divergent: for i in $osds 2020-09-08T15:22:31.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:69: TEST_divergent: run_osd td/divergent-priors 2 2020-09-08T15:22:31.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/divergent-priors 2020-09-08T15:22:31.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:22:31.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T15:22:31.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:22:31.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/divergent-priors/2 2020-09-08T15:22:31.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:22:31.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:22:31.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:22:31.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:22:31.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2020-09-08T15:22:31.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2020-09-08T15:22:31.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:22:31.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:22:31.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:22:31.672 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:22:31.672 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:22:31.673 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:22:31.673 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:22:31.673 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:22:31.673 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:22:31.673 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:22:31.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:22:31.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:22:31.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:22:31.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:22:31.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:22:31.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:22:31.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:22:31.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:22:31.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:22:31.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:22:31.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:22:31.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/divergent-priors/2 2020-09-08T15:22:31.676 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:22:31.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=ba9a9e7f-9bc8-4e25-8fb1-8c4ab677561a 2020-09-08T15:22:31.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 ba9a9e7f-9bc8-4e25-8fb1-8c4ab677561a' 2020-09-08T15:22:31.682 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:22:31.682 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 ba9a9e7f-9bc8-4e25-8fb1-8c4ab677561a 2020-09-08T15:22:31.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQC3oVdfOC/1KBAA5GixSiJ1Yl7U/W3twHbDxQ== 2020-09-08T15:22:31.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQC3oVdfOC/1KBAA5GixSiJ1Yl7U/W3twHbDxQ=="}' 2020-09-08T15:22:31.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new ba9a9e7f-9bc8-4e25-8fb1-8c4ab677561a -i td/divergent-priors/2/new.json 2020-09-08T15:22:32.291 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T15:22:32.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/divergent-priors/2/new.json 2020-09-08T15:22:32.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQC3oVdfOC/1KBAA5GixSiJ1Yl7U/W3twHbDxQ== --osd-uuid ba9a9e7f-9bc8-4e25-8fb1-8c4ab677561a 2020-09-08T15:22:32.330 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:32.335+0000 7f56ddb66ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:22:32.331 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:32.336+0000 7f56ddb66ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:22:32.334 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:32.337+0000 7f56ddb66ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:22:32.334 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:32.338+0000 7f56ddb66ec0 -1 bluestore(td/divergent-priors/2/block) _read_bdev_label failed to open td/divergent-priors/2/block: (2) No such file or directory 2020-09-08T15:22:32.334 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:32.338+0000 7f56ddb66ec0 -1 bluestore(td/divergent-priors/2/block) _read_bdev_label failed to open td/divergent-priors/2/block: (2) No such file or directory 2020-09-08T15:22:32.334 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:32.338+0000 7f56ddb66ec0 -1 bluestore(td/divergent-priors/2/block) _read_bdev_label failed to open td/divergent-priors/2/block: (2) No such file or directory 2020-09-08T15:22:32.372 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:32.377+0000 7f56ddb66ec0 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2020-09-08T15:22:36.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/divergent-priors/2/keyring 2020-09-08T15:22:36.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:22:36.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T15:22:36.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:22:36.899 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T15:22:37.444 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T15:22:37.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T15:22:37.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:22:37.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:22:37.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:22:37.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:22:37.473 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:37.477+0000 7f796aa7bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:22:37.496 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:37.501+0000 7f796aa7bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:22:37.499 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:37.503+0000 7f796aa7bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:22:37.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T15:22:37.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:22:37.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:22:37.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:22:37.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:22:37.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:22:37.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:22:37.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:22:37.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:22:37.883 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:22:38.015 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:38.018+0000 7f796aa7bec0 -1 Falling back to public interface 2020-09-08T15:22:38.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:22:38.861 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:22:38.865+0000 7f796aa7bec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T15:22:39.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:22:39.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:22:39.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:22:39.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:22:39.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:22:39.276 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:22:39.711 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/33520,v1:127.0.0.1:6819/33520] [v2:127.0.0.1:6820/33520,v1:127.0.0.1:6821/33520] exists,up ba9a9e7f-9bc8-4e25-8fb1-8c4ab677561a 2020-09-08T15:22:39.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:22:39.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:22:39.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:22:39.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:72: TEST_divergent: ceph osd set noout 2020-09-08T15:22:40.432 INFO:tasks.workunit.client.0.smithi065.stderr:noout is set 2020-09-08T15:22:40.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:73: TEST_divergent: ceph osd set noin 2020-09-08T15:22:41.195 INFO:tasks.workunit.client.0.smithi065.stderr:noin is set 2020-09-08T15:22:41.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:74: TEST_divergent: ceph osd set nodown 2020-09-08T15:22:41.982 INFO:tasks.workunit.client.0.smithi065.stderr:nodown is set 2020-09-08T15:22:41.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:75: TEST_divergent: create_pool test 1 1 2020-09-08T15:22:41.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test 1 1 2020-09-08T15:22:42.781 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' already exists 2020-09-08T15:22:42.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:22:43.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:76: TEST_divergent: ceph osd pool set test size 3 2020-09-08T15:22:44.474 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 3 2020-09-08T15:22:44.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:77: TEST_divergent: ceph osd pool set test min_size 2 2020-09-08T15:22:45.176 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 min_size to 2 2020-09-08T15:22:45.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:79: TEST_divergent: flush_pg_stats 2020-09-08T15:22:45.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:22:45.186 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:22:45.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:22:45.599 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:22:45.599 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:22:45.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:22:45.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:22:45.600 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:22:45.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836487 2020-09-08T15:22:45.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836487 2020-09-08T15:22:45.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836487' 2020-09-08T15:22:45.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:22:45.737 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:22:45.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672965 2020-09-08T15:22:45.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672965 2020-09-08T15:22:45.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836487 1-42949672965' 2020-09-08T15:22:45.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:22:45.886 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:22:46.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509444 2020-09-08T15:22:46.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509444 2020-09-08T15:22:46.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836487 1-42949672965 2-64424509444' 2020-09-08T15:22:46.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:22:46.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836487 2020-09-08T15:22:46.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:22:46.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:22:46.025 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836487 2020-09-08T15:22:46.025 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:22:46.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836487 2020-09-08T15:22:46.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2020-09-08T15:22:46.026 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836487 2020-09-08T15:22:46.026 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:22:46.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836485 -lt 21474836487 2020-09-08T15:22:46.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:22:47.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:22:47.431 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:22:47.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836487 -lt 21474836487 2020-09-08T15:22:47.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:22:47.871 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672965 2020-09-08T15:22:47.871 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:22:47.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:22:47.873 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672965 2020-09-08T15:22:47.873 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:22:47.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672965 2020-09-08T15:22:47.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672965' 2020-09-08T15:22:47.874 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672965 2020-09-08T15:22:47.875 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:22:48.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672966 -lt 42949672965 2020-09-08T15:22:48.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:22:48.278 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509444 2020-09-08T15:22:48.278 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:22:48.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:22:48.280 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509444 2020-09-08T15:22:48.280 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:22:48.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509444 2020-09-08T15:22:48.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509444' 2020-09-08T15:22:48.282 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509444 2020-09-08T15:22:48.282 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:22:48.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509444 -lt 64424509444 2020-09-08T15:22:48.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: wait_for_clean 2020-09-08T15:22:48.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:22:48.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:22:48.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:22:48.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:22:48.689 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T15:22:48.689 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:22:48.689 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:22:48.689 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:22:48.689 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:22:48.690 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:22:48.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:22:48.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:22:48.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:22:48.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:22:48.774 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:22:49.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:22:49.172 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:22:49.172 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:22:49.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:22:49.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:22:49.173 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:22:49.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836490 2020-09-08T15:22:49.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836490 2020-09-08T15:22:49.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836490' 2020-09-08T15:22:49.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:22:49.331 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:22:49.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672968 2020-09-08T15:22:49.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672968 2020-09-08T15:22:49.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836490 1-42949672968' 2020-09-08T15:22:49.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:22:49.468 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:22:49.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509446 2020-09-08T15:22:49.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509446 2020-09-08T15:22:49.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836490 1-42949672968 2-64424509446' 2020-09-08T15:22:49.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:22:49.610 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836490 2020-09-08T15:22:49.610 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:22:49.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:22:49.611 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836490 2020-09-08T15:22:49.611 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:22:49.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836490 2020-09-08T15:22:49.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2020-09-08T15:22:49.612 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:22:49.612 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836490 2020-09-08T15:22:50.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836489 -lt 21474836490 2020-09-08T15:22:50.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:22:51.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:22:51.006 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:22:51.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836489 -lt 21474836490 2020-09-08T15:22:51.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:22:52.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 299 -eq 0 ']' 2020-09-08T15:22:52.433 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:22:52.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836490 -lt 21474836490 2020-09-08T15:22:52.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:22:52.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672968 2020-09-08T15:22:52.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:22:52.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:22:52.846 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672968 2020-09-08T15:22:52.846 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:22:52.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672968 2020-09-08T15:22:52.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672968' 2020-09-08T15:22:52.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:22:52.847 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672968 2020-09-08T15:22:53.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672968 -lt 42949672968 2020-09-08T15:22:53.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:22:53.268 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509446 2020-09-08T15:22:53.268 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:22:53.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:22:53.269 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509446 2020-09-08T15:22:53.270 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:22:53.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509446 2020-09-08T15:22:53.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509446' 2020-09-08T15:22:53.271 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509446 2020-09-08T15:22:53.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:22:53.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509447 -lt 64424509446 2020-09-08T15:22:53.682 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:22:53.682 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:22:53.682 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:22:54.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T15:22:54.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:22:54.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:22:54.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:22:54.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:22:54.216 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:22:54.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:22:54.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:22:54.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:22:54.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:22:54.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:22:54.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:22:55.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T15:22:55.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:22:55.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:22:55.124 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:83: TEST_divergent: ceph pg dump pgs --format=json 2020-09-08T15:22:55.124 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:83: TEST_divergent: jq '.pg_stats[0].up_primary' 2020-09-08T15:22:55.496 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:22:55.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:83: TEST_divergent: local divergent=1 2020-09-08T15:22:55.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: echo 'primary and soon to be divergent is 1' 2020-09-08T15:22:55.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:85: TEST_divergent: ceph pg dump pgs 2020-09-08T15:22:55.506 INFO:tasks.workunit.client.0.smithi065.stdout:primary and soon to be divergent is 1 2020-09-08T15:22:55.879 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:22:55.879 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:22:43.747125+0000 0'0 28:12 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:22:42.389382+0000 0'0 2020-09-08T15:22:42.389382+0000 0 2020-09-08T15:22:55.880 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:22:55.880 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:22:55.880 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:22:55.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: local non_divergent= 2020-09-08T15:22:55.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:87: TEST_divergent: for i in $osds 2020-09-08T15:22:55.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: '[' 0 = 1 ']' 2020-09-08T15:22:55.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:92: TEST_divergent: non_divergent=' 0' 2020-09-08T15:22:55.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:87: TEST_divergent: for i in $osds 2020-09-08T15:22:55.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: '[' 1 = 1 ']' 2020-09-08T15:22:55.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:90: TEST_divergent: continue 2020-09-08T15:22:55.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:87: TEST_divergent: for i in $osds 2020-09-08T15:22:55.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: '[' 2 = 1 ']' 2020-09-08T15:22:55.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:92: TEST_divergent: non_divergent=' 0 2' 2020-09-08T15:22:55.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:95: TEST_divergent: echo 'writing initial objects' 2020-09-08T15:22:55.892 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: seq 1 100 2020-09-08T15:22:55.892 INFO:tasks.workunit.client.0.smithi065.stdout:writing initial objects 2020-09-08T15:22:55.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:55.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_1 /etc/fstab 2020-09-08T15:22:56.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:56.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_2 /etc/fstab 2020-09-08T15:22:56.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:56.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_3 /etc/fstab 2020-09-08T15:22:56.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:56.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_4 /etc/fstab 2020-09-08T15:22:56.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:56.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_5 /etc/fstab 2020-09-08T15:22:56.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:56.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_6 /etc/fstab 2020-09-08T15:22:56.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:56.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_7 /etc/fstab 2020-09-08T15:22:56.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:56.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_8 /etc/fstab 2020-09-08T15:22:57.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:57.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_9 /etc/fstab 2020-09-08T15:22:57.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:57.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_10 /etc/fstab 2020-09-08T15:22:57.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:57.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_11 /etc/fstab 2020-09-08T15:22:57.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:57.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_12 /etc/fstab 2020-09-08T15:22:57.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:57.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_13 /etc/fstab 2020-09-08T15:22:57.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:57.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_14 /etc/fstab 2020-09-08T15:22:58.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:58.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_15 /etc/fstab 2020-09-08T15:22:58.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:58.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_16 /etc/fstab 2020-09-08T15:22:58.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:58.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_17 /etc/fstab 2020-09-08T15:22:58.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:58.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_18 /etc/fstab 2020-09-08T15:22:58.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:58.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_19 /etc/fstab 2020-09-08T15:22:58.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:58.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_20 /etc/fstab 2020-09-08T15:22:59.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:59.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_21 /etc/fstab 2020-09-08T15:22:59.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:59.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_22 /etc/fstab 2020-09-08T15:22:59.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:59.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_23 /etc/fstab 2020-09-08T15:22:59.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:59.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_24 /etc/fstab 2020-09-08T15:22:59.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:59.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_25 /etc/fstab 2020-09-08T15:22:59.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:59.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_26 /etc/fstab 2020-09-08T15:22:59.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:22:59.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_27 /etc/fstab 2020-09-08T15:23:00.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:00.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_28 /etc/fstab 2020-09-08T15:23:00.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:00.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_29 /etc/fstab 2020-09-08T15:23:00.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:00.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_30 /etc/fstab 2020-09-08T15:23:00.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:00.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_31 /etc/fstab 2020-09-08T15:23:00.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:00.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_32 /etc/fstab 2020-09-08T15:23:00.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:00.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_33 /etc/fstab 2020-09-08T15:23:01.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:01.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_34 /etc/fstab 2020-09-08T15:23:01.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:01.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_35 /etc/fstab 2020-09-08T15:23:01.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:01.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_36 /etc/fstab 2020-09-08T15:23:01.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:01.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_37 /etc/fstab 2020-09-08T15:23:01.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:01.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_38 /etc/fstab 2020-09-08T15:23:01.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:02.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_39 /etc/fstab 2020-09-08T15:23:02.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:02.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_40 /etc/fstab 2020-09-08T15:23:02.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:02.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_41 /etc/fstab 2020-09-08T15:23:02.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:02.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_42 /etc/fstab 2020-09-08T15:23:02.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:02.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_43 /etc/fstab 2020-09-08T15:23:02.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:02.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_44 /etc/fstab 2020-09-08T15:23:02.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:02.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_45 /etc/fstab 2020-09-08T15:23:02.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:02.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_46 /etc/fstab 2020-09-08T15:23:03.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:03.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_47 /etc/fstab 2020-09-08T15:23:03.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:03.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_48 /etc/fstab 2020-09-08T15:23:03.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:03.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_49 /etc/fstab 2020-09-08T15:23:03.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:03.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_50 /etc/fstab 2020-09-08T15:23:03.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:03.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_51 /etc/fstab 2020-09-08T15:23:03.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:03.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_52 /etc/fstab 2020-09-08T15:23:03.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:03.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_53 /etc/fstab 2020-09-08T15:23:04.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:04.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_54 /etc/fstab 2020-09-08T15:23:04.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:04.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_55 /etc/fstab 2020-09-08T15:23:04.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:04.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_56 /etc/fstab 2020-09-08T15:23:04.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:04.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_57 /etc/fstab 2020-09-08T15:23:04.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:04.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_58 /etc/fstab 2020-09-08T15:23:04.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:04.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_59 /etc/fstab 2020-09-08T15:23:05.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:05.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_60 /etc/fstab 2020-09-08T15:23:05.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:05.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_61 /etc/fstab 2020-09-08T15:23:05.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:05.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_62 /etc/fstab 2020-09-08T15:23:05.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:05.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_63 /etc/fstab 2020-09-08T15:23:05.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:05.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_64 /etc/fstab 2020-09-08T15:23:05.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:05.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_65 /etc/fstab 2020-09-08T15:23:05.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:05.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_66 /etc/fstab 2020-09-08T15:23:06.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:06.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_67 /etc/fstab 2020-09-08T15:23:06.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:06.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_68 /etc/fstab 2020-09-08T15:23:06.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:06.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_69 /etc/fstab 2020-09-08T15:23:06.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:06.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_70 /etc/fstab 2020-09-08T15:23:06.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:06.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_71 /etc/fstab 2020-09-08T15:23:06.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:06.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_72 /etc/fstab 2020-09-08T15:23:07.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:07.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_73 /etc/fstab 2020-09-08T15:23:07.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:07.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_74 /etc/fstab 2020-09-08T15:23:07.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:07.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_75 /etc/fstab 2020-09-08T15:23:07.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:07.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_76 /etc/fstab 2020-09-08T15:23:07.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:07.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_77 /etc/fstab 2020-09-08T15:23:07.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:07.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_78 /etc/fstab 2020-09-08T15:23:08.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:08.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_79 /etc/fstab 2020-09-08T15:23:08.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:08.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_80 /etc/fstab 2020-09-08T15:23:08.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:08.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_81 /etc/fstab 2020-09-08T15:23:08.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:08.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_82 /etc/fstab 2020-09-08T15:23:08.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:08.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_83 /etc/fstab 2020-09-08T15:23:08.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:08.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_84 /etc/fstab 2020-09-08T15:23:08.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:08.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_85 /etc/fstab 2020-09-08T15:23:09.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:09.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_86 /etc/fstab 2020-09-08T15:23:09.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:09.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_87 /etc/fstab 2020-09-08T15:23:09.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:09.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_88 /etc/fstab 2020-09-08T15:23:09.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:09.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_89 /etc/fstab 2020-09-08T15:23:09.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:09.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_90 /etc/fstab 2020-09-08T15:23:09.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:09.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_91 /etc/fstab 2020-09-08T15:23:10.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:10.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_92 /etc/fstab 2020-09-08T15:23:10.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:10.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_93 /etc/fstab 2020-09-08T15:23:10.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:10.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_94 /etc/fstab 2020-09-08T15:23:10.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:10.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_95 /etc/fstab 2020-09-08T15:23:10.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:10.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_96 /etc/fstab 2020-09-08T15:23:10.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:10.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_97 /etc/fstab 2020-09-08T15:23:10.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:10.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_98 /etc/fstab 2020-09-08T15:23:11.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:11.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_99 /etc/fstab 2020-09-08T15:23:11.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2020-09-08T15:23:11.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_100 /etc/fstab 2020-09-08T15:23:11.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:102: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2020-09-08T15:23:11.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:102: TEST_divergent: wait_for_clean 2020-09-08T15:23:11.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:23:11.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:23:11.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:23:11.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:23:11.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 20 .1 2020-09-08T15:23:11.451 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:23:11.452 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:23:11.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:23:11.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:23:11.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:23:11.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:23:11.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:23:11.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:23:11.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:23:11.509 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:23:11.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:23:11.909 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:23:11.909 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:23:11.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:23:11.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:23:11.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:23:12.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836496 2020-09-08T15:23:12.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836496 2020-09-08T15:23:12.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836496' 2020-09-08T15:23:12.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:23:12.047 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:23:12.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672975 2020-09-08T15:23:12.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672975 2020-09-08T15:23:12.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836496 1-42949672975' 2020-09-08T15:23:12.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:23:12.184 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:23:12.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509453 2020-09-08T15:23:12.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509453 2020-09-08T15:23:12.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836496 1-42949672975 2-64424509453' 2020-09-08T15:23:12.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:23:12.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836496 2020-09-08T15:23:12.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:23:12.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:23:12.322 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836496 2020-09-08T15:23:12.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:23:12.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836496 2020-09-08T15:23:12.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836496' 2020-09-08T15:23:12.324 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836496 2020-09-08T15:23:12.325 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:23:12.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836494 -lt 21474836496 2020-09-08T15:23:12.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:23:13.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:23:13.735 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:23:14.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836496 -lt 21474836496 2020-09-08T15:23:14.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:23:14.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672975 2020-09-08T15:23:14.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:23:14.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:23:14.141 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672975 2020-09-08T15:23:14.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:23:14.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672975 2020-09-08T15:23:14.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672975' 2020-09-08T15:23:14.143 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672975 2020-09-08T15:23:14.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:23:14.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672975 -lt 42949672975 2020-09-08T15:23:14.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:23:14.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509453 2020-09-08T15:23:14.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:23:14.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:23:14.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509453 2020-09-08T15:23:14.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:23:14.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509453 2020-09-08T15:23:14.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509453' 2020-09-08T15:23:14.557 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509453 2020-09-08T15:23:14.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:23:14.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509453 -lt 64424509453 2020-09-08T15:23:14.952 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:23:14.953 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:23:14.953 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:23:15.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T15:23:15.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:23:15.495 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:23:15.495 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:23:15.495 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:23:15.496 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:23:15.496 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:23:15.496 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:23:15.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:23:15.878 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:23:15.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:23:15.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:23:16.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T15:23:16.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:23:16.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:23:16.395 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:104: TEST_divergent: get_pg test existing_1 2020-09-08T15:23:16.396 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1031: get_pg: local poolname=test 2020-09-08T15:23:16.396 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: local objectname=existing_1 2020-09-08T15:23:16.396 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: ceph --format json osd map test existing_1 2020-09-08T15:23:16.396 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: jq -r .pgid 2020-09-08T15:23:16.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:104: TEST_divergent: local pgid=1.0 2020-09-08T15:23:16.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:107: TEST_divergent: echo 'blackholing osds 0 2' 2020-09-08T15:23:16.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph pg dump pgs 2020-09-08T15:23:16.797 INFO:tasks.workunit.client.0.smithi065.stdout:blackholing osds 0 2 2020-09-08T15:23:17.192 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:23:17.192 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 0 0 0 0 48300 0 0 16 16 active+clean 2020-09-08T15:22:43.747125+0000 29'100 29:112 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:22:42.389382+0000 0'0 2020-09-08T15:22:42.389382+0000 0 2020-09-08T15:23:17.193 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:23:17.193 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:23:17.193 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:23:17.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:109: TEST_divergent: for i in $non_divergent 2020-09-08T15:23:17.201 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: get_asok_path osd.0 2020-09-08T15:23:17.201 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-09-08T15:23:17.202 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-09-08T15:23:17.202 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:23:17.202 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:23:17.202 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:23:17.202 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.0.asok 2020-09-08T15:23:17.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: CEPH_ARGS= 2020-09-08T15:23:17.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.0.asok config set objectstore_blackhole 1 2020-09-08T15:23:17.293 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:23:17.294 INFO:tasks.workunit.client.0.smithi065.stdout: "success": "objectstore_blackhole = 'true' (not observed, change may require restart) " 2020-09-08T15:23:17.294 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:23:17.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:109: TEST_divergent: for i in $non_divergent 2020-09-08T15:23:17.302 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: get_asok_path osd.2 2020-09-08T15:23:17.302 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-09-08T15:23:17.302 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-09-08T15:23:17.302 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:23:17.303 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:23:17.303 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:23:17.303 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.2.asok 2020-09-08T15:23:17.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: CEPH_ARGS= 2020-09-08T15:23:17.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.2.asok config set objectstore_blackhole 1 2020-09-08T15:23:17.393 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:23:17.394 INFO:tasks.workunit.client.0.smithi065.stdout: "success": "objectstore_blackhole = 'true' (not observed, change may require restart) " 2020-09-08T15:23:17.394 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:23:17.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:114: TEST_divergent: local case5=100 2020-09-08T15:23:17.401 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:115: TEST_divergent: expr 100 - 1 2020-09-08T15:23:17.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:115: TEST_divergent: local case3=99 2020-09-08T15:23:17.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:117: TEST_divergent: echo 'writing divergent object' 2020-09-08T15:23:17.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:119: TEST_divergent: echo 'create missing divergent object' 2020-09-08T15:23:17.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:120: TEST_divergent: inject_eio rep data test existing_99 td/divergent-priors 0 2020-09-08T15:23:17.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:118: TEST_divergent: rados -p test put existing_100 /etc/fstab 2020-09-08T15:23:17.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2231: inject_eio: local pooltype=rep 2020-09-08T15:23:17.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: inject_eio: shift 2020-09-08T15:23:17.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2233: inject_eio: local which=data 2020-09-08T15:23:17.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2234: inject_eio: shift 2020-09-08T15:23:17.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2235: inject_eio: local poolname=test 2020-09-08T15:23:17.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2236: inject_eio: shift 2020-09-08T15:23:17.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2237: inject_eio: local objname=existing_99 2020-09-08T15:23:17.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2238: inject_eio: shift 2020-09-08T15:23:17.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2239: inject_eio: local dir=td/divergent-priors 2020-09-08T15:23:17.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2240: inject_eio: shift 2020-09-08T15:23:17.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2241: inject_eio: local shard_id=0 2020-09-08T15:23:17.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2242: inject_eio: shift 2020-09-08T15:23:17.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2244: inject_eio: initial_osds=($(get_osds $poolname $objname)) 2020-09-08T15:23:17.408 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2244: inject_eio: get_osds test existing_99 2020-09-08T15:23:17.409 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:959: get_osds: local poolname=test 2020-09-08T15:23:17.409 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:960: get_osds: local objectname=existing_99 2020-09-08T15:23:17.409 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:963: get_osds: ceph --format json osd map test existing_99 2020-09-08T15:23:17.409 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:963: get_osds: jq '.acting | .[]' 2020-09-08T15:23:17.409 INFO:tasks.workunit.client.0.smithi065.stdout:writing divergent object 2020-09-08T15:23:17.410 INFO:tasks.workunit.client.0.smithi065.stdout:create missing divergent object 2020-09-08T15:23:17.811 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:963: get_osds: local 'osds=1 2020-09-08T15:23:17.811 INFO:tasks.workunit.client.0.smithi065.stderr:0 2020-09-08T15:23:17.812 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:23:17.812 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:965: get_osds: echo 1 0 2 2020-09-08T15:23:17.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2244: inject_eio: local -a initial_osds 2020-09-08T15:23:17.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2245: inject_eio: local osd_id=1 2020-09-08T15:23:17.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2246: inject_eio: '[' rep '!=' ec ']' 2020-09-08T15:23:17.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2247: inject_eio: shard_id= 2020-09-08T15:23:17.814 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2249: inject_eio: cat td/divergent-priors/1/type 2020-09-08T15:23:17.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2249: inject_eio: type=bluestore 2020-09-08T15:23:17.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2250: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2020-09-08T15:23:17.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1099: set_config: local daemon=osd 2020-09-08T15:23:17.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1100: set_config: local id=1 2020-09-08T15:23:17.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1101: set_config: local config=bluestore_debug_inject_read_err 2020-09-08T15:23:17.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1102: set_config: local value=true 2020-09-08T15:23:17.816 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1106: set_config: jq 'has("success")' 2020-09-08T15:23:17.816 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1106: set_config: get_asok_path osd.1 2020-09-08T15:23:17.817 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-09-08T15:23:17.817 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-09-08T15:23:17.817 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:23:17.817 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:23:17.817 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:23:17.818 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.1.asok 2020-09-08T15:23:17.818 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1106: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.30667/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2020-09-08T15:23:17.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1106: set_config: test true == true 2020-09-08T15:23:17.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2251: inject_eio: local loop=0 2020-09-08T15:23:17.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: inject_eio: grep -q Invalid 2020-09-08T15:23:17.917 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2252: inject_eio: get_asok_path osd.1 2020-09-08T15:23:17.917 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-09-08T15:23:17.917 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-09-08T15:23:17.917 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:23:17.917 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:23:17.918 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:23:17.918 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.1.asok 2020-09-08T15:23:17.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2252: inject_eio: CEPH_ARGS= 2020-09-08T15:23:17.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2252: inject_eio: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.1.asok injectdataerr test existing_99 2020-09-08T15:23:18.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:122: TEST_divergent: sleep 10 2020-09-08T15:23:18.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:121: TEST_divergent: rados -p test get existing_99 td/divergent-priors/existing 2020-09-08T15:23:28.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:123: TEST_divergent: killall -9 rados 2020-09-08T15:23:28.034 INFO:tasks.workunit.client.0.smithi065.stderr:rados: no process found 2020-09-08T15:23:28.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: echo 'killing all the osds' 2020-09-08T15:23:28.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:127: TEST_divergent: ceph pg dump pgs 2020-09-08T15:23:28.035 INFO:tasks.workunit.client.0.smithi065.stdout:killing all the osds 2020-09-08T15:23:28.430 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:23:28.430 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 0 0 0 0 48300 0 0 17 17 active+clean 2020-09-08T15:23:18.358638+0000 29'101 29:121 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:22:42.389382+0000 0'0 2020-09-08T15:22:42.389382+0000 0 2020-09-08T15:23:28.431 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:23:28.431 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:23:28.432 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:23:28.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: kill_daemons td/divergent-priors KILL osd 2020-09-08T15:23:28.443 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:23:28.443 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:23:28.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:23:28.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:23:28.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:23:28.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:23:28.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:129: TEST_divergent: for i in $osds 2020-09-08T15:23:28.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:131: TEST_divergent: ceph osd down osd.0 2020-09-08T15:23:29.086 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already down. 2020-09-08T15:23:29.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:129: TEST_divergent: for i in $osds 2020-09-08T15:23:29.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:131: TEST_divergent: ceph osd down osd.1 2020-09-08T15:23:29.665 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already down. 2020-09-08T15:23:29.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:129: TEST_divergent: for i in $osds 2020-09-08T15:23:29.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:131: TEST_divergent: ceph osd down osd.2 2020-09-08T15:23:30.231 INFO:tasks.workunit.client.0.smithi065.stderr:osd.2 is already down. 2020-09-08T15:23:30.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:133: TEST_divergent: for i in $non_divergent 2020-09-08T15:23:30.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:135: TEST_divergent: ceph osd out osd.0 2020-09-08T15:23:30.866 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already out. 2020-09-08T15:23:30.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:133: TEST_divergent: for i in $non_divergent 2020-09-08T15:23:30.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:135: TEST_divergent: ceph osd out osd.2 2020-09-08T15:23:31.440 INFO:tasks.workunit.client.0.smithi065.stderr:osd.2 is already out. 2020-09-08T15:23:31.449 INFO:tasks.workunit.client.0.smithi065.stdout:bringing up non_divergent 0 2 2020-09-08T15:23:31.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:139: TEST_divergent: echo 'bringing up non_divergent 0 2' 2020-09-08T15:23:31.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: ceph pg dump pgs 2020-09-08T15:23:31.835 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:23:31.835 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 0 0 0 0 48300 0 0 17 17 stale+active+clean 2020-09-08T15:23:18.358638+0000 29'101 29:121 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:22:42.389382+0000 0'0 2020-09-08T15:22:42.389382+0000 0 2020-09-08T15:23:31.835 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:23:31.835 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:23:31.837 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:23:31.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:141: TEST_divergent: for i in $non_divergent 2020-09-08T15:23:31.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:143: TEST_divergent: activate_osd td/divergent-priors 0 2020-09-08T15:23:31.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/divergent-priors 2020-09-08T15:23:31.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:23:31.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=0 2020-09-08T15:23:31.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:23:31.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/divergent-priors/0 2020-09-08T15:23:31.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:23:31.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:23:31.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:23:31.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:23:31.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2020-09-08T15:23:31.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2020-09-08T15:23:31.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:23:31.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:23:31.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:23:31.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:23:31.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:23:31.857 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:23:31.857 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:23:31.858 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:23:31.858 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:23:31.858 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:23:31.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:23:31.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:23:31.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:23:31.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:23:31.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:23:31.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:23:31.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:23:31.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:23:31.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:23:31.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/divergent-priors/0 2020-09-08T15:23:31.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.0 2020-09-08T15:23:31.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 0 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:23:31.861 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/divergent-priors/0/whoami 2020-09-08T15:23:31.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 0 = 0 ']' 2020-09-08T15:23:31.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:23:31.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:23:31.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:23:31.862 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T15:23:31.876 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:23:31.881+0000 7f4ae273cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:23:31.878 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:23:31.883+0000 7f4ae273cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:23:31.879 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:23:31.884+0000 7f4ae273cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:23:32.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 0 2020-09-08T15:23:32.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:23:32.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:23:32.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:23:32.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:23:32.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:23:32.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:23:32.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:23:32.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:23:32.247 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:23:32.400 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:23:32.405+0000 7f4ae273cec0 -1 Falling back to public interface 2020-09-08T15:23:32.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:23:33.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:23:33.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:23:33.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:23:33.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:23:33.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:23:33.666 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:23:33.831 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:23:33.828+0000 7f4ae273cec0 -1 osd.0 29 log_to_monitors {default=true} 2020-09-08T15:23:34.117 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up out weight 0 up_from 35 up_thru 0 down_at 30 last_clean_interval [5,29) [v2:127.0.0.1:6802/37437,v1:127.0.0.1:6803/37437] [v2:127.0.0.1:6804/37437,v1:127.0.0.1:6805/37437] exists,up 0995576a-0b47-4a00-b362-285884219bcc 2020-09-08T15:23:34.117 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T15:23:34.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:23:34.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:23:34.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:23:34.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:141: TEST_divergent: for i in $non_divergent 2020-09-08T15:23:34.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:143: TEST_divergent: activate_osd td/divergent-priors 2 2020-09-08T15:23:34.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/divergent-priors 2020-09-08T15:23:34.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:23:34.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=2 2020-09-08T15:23:34.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:23:34.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/divergent-priors/2 2020-09-08T15:23:34.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:23:34.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:23:34.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:23:34.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:23:34.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2020-09-08T15:23:34.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2020-09-08T15:23:34.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:23:34.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:23:34.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:23:34.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:23:34.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:23:34.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:23:34.129 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:23:34.129 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:23:34.129 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:23:34.129 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:23:34.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:23:34.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:23:34.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:23:34.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:23:34.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:23:34.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:23:34.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:23:34.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:23:34.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:23:34.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/divergent-priors/2 2020-09-08T15:23:34.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.2 2020-09-08T15:23:34.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 2 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:23:34.133 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/divergent-priors/2/whoami 2020-09-08T15:23:34.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 2 = 2 ']' 2020-09-08T15:23:34.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:23:34.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:23:34.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:23:34.154 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:23:34.149+0000 7f7f3ed24ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:23:34.155 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:23:34.151+0000 7f7f3ed24ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:23:34.155 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:23:34.152+0000 7f7f3ed24ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:23:34.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 2 2020-09-08T15:23:34.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:23:34.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:23:34.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:23:34.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:23:34.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:23:34.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:23:34.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:23:34.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:23:34.520 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:23:34.663 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:23:34.667+0000 7f7f3ed24ec0 -1 Falling back to public interface 2020-09-08T15:23:34.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:23:35.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:23:35.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:23:35.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:23:35.938 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:23:35.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:23:35.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:23:35.964 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:23:35.969+0000 7f7f3ed24ec0 -1 osd.2 29 log_to_monitors {default=true} 2020-09-08T15:23:36.347 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up out weight 0 up_from 36 up_thru 0 down_at 32 last_clean_interval [15,29) [v2:127.0.0.1:6810/37836,v1:127.0.0.1:6811/37836] [v2:127.0.0.1:6812/37836,v1:127.0.0.1:6813/37836] exists,up ba9a9e7f-9bc8-4e25-8fb1-8c4ab677561a 2020-09-08T15:23:36.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:23:36.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:23:36.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:23:36.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:145: TEST_divergent: for i in $non_divergent 2020-09-08T15:23:36.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: ceph osd in osd.0 2020-09-08T15:23:36.904 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already in. 2020-09-08T15:23:36.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:145: TEST_divergent: for i in $non_divergent 2020-09-08T15:23:36.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: ceph osd in osd.2 2020-09-08T15:23:37.543 INFO:tasks.workunit.client.0.smithi065.stderr:osd.2 is already in. 2020-09-08T15:23:37.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2020-09-08T15:23:37.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: wait_for_clean 2020-09-08T15:23:37.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:23:37.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:23:37.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:23:37.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:23:37.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 20 .1 2020-09-08T15:23:37.554 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:23:37.554 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:23:37.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:23:37.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:23:37.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:23:37.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:23:37.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:23:37.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:23:37.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:23:37.611 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:23:38.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:23:38.024 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:23:38.025 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:23:38.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:23:38.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:23:38.025 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:23:38.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=150323855363 2020-09-08T15:23:38.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 150323855363 2020-09-08T15:23:38.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-150323855363' 2020-09-08T15:23:38.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:23:38.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:23:38.258 INFO:tasks.workunit.client.0.smithi065.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-09-08T15:23:38.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq= 2020-09-08T15:23:38.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z '' 2020-09-08T15:23:38.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: continue 2020-09-08T15:23:38.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:23:38.260 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:23:38.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=154618822659 2020-09-08T15:23:38.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 154618822659 2020-09-08T15:23:38.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-150323855363 2-154618822659' 2020-09-08T15:23:38.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:23:38.396 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-150323855363 2020-09-08T15:23:38.396 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:23:38.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:23:38.397 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-150323855363 2020-09-08T15:23:38.398 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:23:38.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=150323855363 2020-09-08T15:23:38.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 150323855363' 2020-09-08T15:23:38.399 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:23:38.399 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 150323855363 2020-09-08T15:23:38.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 1 -lt 150323855363 2020-09-08T15:23:38.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:23:39.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:23:39.799 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:23:40.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 150323855364 -lt 150323855363 2020-09-08T15:23:40.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:23:40.212 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-154618822659 2020-09-08T15:23:40.212 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:23:40.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:23:40.212 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-154618822659 2020-09-08T15:23:40.213 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:23:40.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=154618822659 2020-09-08T15:23:40.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 154618822659' 2020-09-08T15:23:40.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:23:40.214 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 154618822659 2020-09-08T15:23:40.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 154618822659 -lt 154618822659 2020-09-08T15:23:40.611 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:23:40.611 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:23:40.611 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:23:41.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T15:23:41.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:23:41.136 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:23:41.136 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:23:41.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:23:41.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:23:41.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:23:41.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:23:41.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:23:41.522 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:23:41.522 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:23:41.522 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:23:42.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:23:42.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T15:23:42.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T15:23:42.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T15:23:42.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:23:42.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:23:42.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:23:42.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:23:42.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:23:42.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:23:42.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:23:42.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:23:42.154 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:23:42.154 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:23:42.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:23:42.546 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:23:42.547 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:23:42.547 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:23:43.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:23:43.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:23:43.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:23:43.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:23:43.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:23:43.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:23:43.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:23:43.073 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:23:43.074 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:23:43.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:23:43.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:23:43.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 1 >= 8 )) 2020-09-08T15:23:43.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:23:43.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.2 2020-09-08T15:23:43.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:23:43.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:23:43.803 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:23:43.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:23:43.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:23:43.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:23:43.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:23:43.805 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:23:44.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:23:44.191 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:23:44.191 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:23:44.191 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:23:44.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:23:44.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:23:44.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:23:44.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:23:44.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:23:44.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:23:44.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:23:44.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:23:44.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:23:45.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:23:45.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:23:45.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 2 >= 8 )) 2020-09-08T15:23:45.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:23:45.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.4 2020-09-08T15:23:45.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:23:45.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:23:45.641 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:23:45.642 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:23:45.642 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:23:45.642 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:23:45.652 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:23:45.652 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:23:46.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:23:46.049 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:23:46.050 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:23:46.056 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:23:46.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:23:46.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:23:46.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:23:46.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:23:46.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:23:46.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:23:46.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:23:46.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:23:46.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:23:47.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:23:47.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:23:47.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 3 >= 8 )) 2020-09-08T15:23:47.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:23:47.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.8 2020-09-08T15:23:47.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:23:47.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:23:47.904 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:23:47.905 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:23:47.905 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:23:47.905 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:23:47.905 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:23:47.906 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:23:48.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:23:48.303 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:23:48.303 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:23:48.303 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:23:48.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:23:48.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:23:48.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:23:48.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:23:48.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:23:48.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:23:48.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:23:48.820 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:23:48.821 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:23:49.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:23:49.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:23:49.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 4 >= 8 )) 2020-09-08T15:23:49.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:23:49.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 1.6 2020-09-08T15:23:50.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:23:50.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:23:50.951 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:23:50.951 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:23:50.952 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:23:50.952 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:23:50.952 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:23:50.952 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:23:51.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:23:51.345 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:23:51.345 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:23:51.345 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:23:51.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:23:51.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:23:51.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:23:51.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:23:51.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:23:51.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:23:51.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:23:51.871 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:23:51.871 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:23:52.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:23:52.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:23:52.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 5 >= 8 )) 2020-09-08T15:23:52.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:23:52.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 3.2 2020-09-08T15:23:55.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:23:55.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:23:55.600 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:23:55.600 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:23:55.600 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:23:55.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:23:55.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:23:55.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:23:55.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:23:55.998 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:23:55.998 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:23:55.998 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:23:56.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:23:56.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:23:56.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:23:56.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:23:56.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:23:56.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:23:56.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:23:56.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:23:56.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:23:57.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:23:57.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:23:57.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 6 >= 8 )) 2020-09-08T15:23:57.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:23:57.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 6.4 2020-09-08T15:24:03.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:24:03.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:24:03.456 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:24:03.456 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:24:03.457 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:24:03.457 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:24:03.457 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:24:03.458 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:24:03.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:24:03.851 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:24:03.852 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:24:03.852 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:24:04.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:24:04.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:24:04.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:24:04.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:24:04.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:24:04.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:24:04.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:24:04.439 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:24:04.439 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:24:04.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:24:04.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:24:04.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 7 >= 8 )) 2020-09-08T15:24:04.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:24:04.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 7.3 2020-09-08T15:24:12.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:24:12.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:24:12.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:24:12.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:24:12.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:24:12.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:24:12.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:24:12.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:24:12.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:24:12.603 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:24:12.603 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:24:12.603 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:24:13.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:24:13.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:24:13.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:24:13.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:24:13.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:24:13.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:24:13.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:24:13.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:24:13.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:24:13.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:24:13.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:24:13.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 8 >= 8 )) 2020-09-08T15:24:13.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: wait_for_clean: ceph report 2020-09-08T15:24:14.189 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:24:14.190 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_fingerprint": "0682d878-98bf-48bd-a8bb-0226aafdf94a", 2020-09-08T15:24:14.190 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:24:14.190 INFO:tasks.workunit.client.0.smithi065.stdout: "commit": "dce4d291bd4243c9802c17d67b85a6da6bbc0f8f", 2020-09-08T15:24:14.190 INFO:tasks.workunit.client.0.smithi065.stdout: "timestamp": "2020-09-08T15:24:14.193510+0000", 2020-09-08T15:24:14.191 INFO:tasks.workunit.client.0.smithi065.stdout: "tag": "", 2020-09-08T15:24:14.191 INFO:tasks.workunit.client.0.smithi065.stdout: "health": { 2020-09-08T15:24:14.191 INFO:tasks.workunit.client.0.smithi065.stdout: "status": "HEALTH_WARN", 2020-09-08T15:24:14.191 INFO:tasks.workunit.client.0.smithi065.stdout: "checks": { 2020-09-08T15:24:14.191 INFO:tasks.workunit.client.0.smithi065.stdout: "OSDMAP_FLAGS": { 2020-09-08T15:24:14.191 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:24:14.192 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:24:14.192 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "nodown,noout,noin flag(s) set", 2020-09-08T15:24:14.192 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 17 2020-09-08T15:24:14.192 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.192 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [], 2020-09-08T15:24:14.193 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:24:14.193 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.193 INFO:tasks.workunit.client.0.smithi065.stdout: "OSD_DOWN": { 2020-09-08T15:24:14.193 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:24:14.193 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:24:14.194 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "1 osds down", 2020-09-08T15:24:14.194 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 1 2020-09-08T15:24:14.194 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.194 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [ 2020-09-08T15:24:14.194 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.195 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "osd.1 (root=default,host=smithi065) is down" 2020-09-08T15:24:14.195 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.195 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:24:14.195 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:24:14.195 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.196 INFO:tasks.workunit.client.0.smithi065.stdout: "PG_DEGRADED": { 2020-09-08T15:24:14.196 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:24:14.196 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:24:14.196 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2020-09-08T15:24:14.196 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 1 2020-09-08T15:24:14.196 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.197 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [ 2020-09-08T15:24:14.197 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.197 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:24:14.197 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.197 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:24:14.198 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:24:14.198 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.198 INFO:tasks.workunit.client.0.smithi065.stdout: "POOL_APP_NOT_ENABLED": { 2020-09-08T15:24:14.198 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:24:14.198 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:24:14.199 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "1 pool(s) do not have an application enabled", 2020-09-08T15:24:14.199 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 1 2020-09-08T15:24:14.199 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.199 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [ 2020-09-08T15:24:14.199 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.200 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "application not enabled on pool 'test'" 2020-09-08T15:24:14.200 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.200 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.200 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." 2020-09-08T15:24:14.200 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.201 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:24:14.201 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:24:14.201 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.201 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.202 INFO:tasks.workunit.client.0.smithi065.stdout: "mutes": [] 2020-09-08T15:24:14.202 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.202 INFO:tasks.workunit.client.0.smithi065.stdout: "monmap_first_committed": 1, 2020-09-08T15:24:14.202 INFO:tasks.workunit.client.0.smithi065.stdout: "monmap_last_committed": 1, 2020-09-08T15:24:14.202 INFO:tasks.workunit.client.0.smithi065.stdout: "monmap": { 2020-09-08T15:24:14.203 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 1, 2020-09-08T15:24:14.203 INFO:tasks.workunit.client.0.smithi065.stdout: "fsid": "c25e19f6-e2e3-4d0b-8f34-71c93296ff3c", 2020-09-08T15:24:14.203 INFO:tasks.workunit.client.0.smithi065.stdout: "modified": "2020-09-08T15:22:14.027979Z", 2020-09-08T15:24:14.203 INFO:tasks.workunit.client.0.smithi065.stdout: "created": "2020-09-08T15:22:14.027979Z", 2020-09-08T15:24:14.203 INFO:tasks.workunit.client.0.smithi065.stdout: "min_mon_release": 16, 2020-09-08T15:24:14.204 INFO:tasks.workunit.client.0.smithi065.stdout: "min_mon_release_name": "pacific", 2020-09-08T15:24:14.204 INFO:tasks.workunit.client.0.smithi065.stdout: "features": { 2020-09-08T15:24:14.204 INFO:tasks.workunit.client.0.smithi065.stdout: "persistent": [ 2020-09-08T15:24:14.204 INFO:tasks.workunit.client.0.smithi065.stdout: "kraken", 2020-09-08T15:24:14.204 INFO:tasks.workunit.client.0.smithi065.stdout: "luminous", 2020-09-08T15:24:14.204 INFO:tasks.workunit.client.0.smithi065.stdout: "mimic", 2020-09-08T15:24:14.205 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap-prune", 2020-09-08T15:24:14.205 INFO:tasks.workunit.client.0.smithi065.stdout: "nautilus", 2020-09-08T15:24:14.205 INFO:tasks.workunit.client.0.smithi065.stdout: "octopus", 2020-09-08T15:24:14.205 INFO:tasks.workunit.client.0.smithi065.stdout: "pacific" 2020-09-08T15:24:14.205 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:24:14.206 INFO:tasks.workunit.client.0.smithi065.stdout: "optional": [] 2020-09-08T15:24:14.206 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.206 INFO:tasks.workunit.client.0.smithi065.stdout: "mons": [ 2020-09-08T15:24:14.206 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.206 INFO:tasks.workunit.client.0.smithi065.stdout: "rank": 0, 2020-09-08T15:24:14.207 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "a", 2020-09-08T15:24:14.207 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:24:14.207 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:24:14.207 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.207 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:24:14.207 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:7115", 2020-09-08T15:24:14.208 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 0 2020-09-08T15:24:14.208 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.208 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.208 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.208 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:7115/0", 2020-09-08T15:24:14.209 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:7115/0", 2020-09-08T15:24:14.209 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 0, 2020-09-08T15:24:14.209 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 0 2020-09-08T15:24:14.209 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.209 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.210 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.210 INFO:tasks.workunit.client.0.smithi065.stdout: "quorum": [ 2020-09-08T15:24:14.217 INFO:tasks.workunit.client.0.smithi065.stdout: 0 2020-09-08T15:24:14.217 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:24:14.217 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap": { 2020-09-08T15:24:14.217 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 39, 2020-09-08T15:24:14.217 INFO:tasks.workunit.client.0.smithi065.stdout: "fsid": "c25e19f6-e2e3-4d0b-8f34-71c93296ff3c", 2020-09-08T15:24:14.218 INFO:tasks.workunit.client.0.smithi065.stdout: "created": "2020-09-08T15:22:14.702523+0000", 2020-09-08T15:24:14.218 INFO:tasks.workunit.client.0.smithi065.stdout: "modified": "2020-09-08T15:23:37.672420+0000", 2020-09-08T15:24:14.218 INFO:tasks.workunit.client.0.smithi065.stdout: "last_up_change": "2020-09-08T15:23:36.042771+0000", 2020-09-08T15:24:14.218 INFO:tasks.workunit.client.0.smithi065.stdout: "last_in_change": "2020-09-08T15:23:37.251112+0000", 2020-09-08T15:24:14.218 INFO:tasks.workunit.client.0.smithi065.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-09-08T15:24:14.218 INFO:tasks.workunit.client.0.smithi065.stdout: "flags_num": 5800384, 2020-09-08T15:24:14.219 INFO:tasks.workunit.client.0.smithi065.stdout: "flags_set": [ 2020-09-08T15:24:14.219 INFO:tasks.workunit.client.0.smithi065.stdout: "nodown", 2020-09-08T15:24:14.219 INFO:tasks.workunit.client.0.smithi065.stdout: "noin", 2020-09-08T15:24:14.219 INFO:tasks.workunit.client.0.smithi065.stdout: "noout", 2020-09-08T15:24:14.219 INFO:tasks.workunit.client.0.smithi065.stdout: "pglog_hardlimit", 2020-09-08T15:24:14.220 INFO:tasks.workunit.client.0.smithi065.stdout: "purged_snapdirs", 2020-09-08T15:24:14.220 INFO:tasks.workunit.client.0.smithi065.stdout: "recovery_deletes", 2020-09-08T15:24:14.220 INFO:tasks.workunit.client.0.smithi065.stdout: "sortbitwise" 2020-09-08T15:24:14.220 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:24:14.220 INFO:tasks.workunit.client.0.smithi065.stdout: "crush_version": 7, 2020-09-08T15:24:14.220 INFO:tasks.workunit.client.0.smithi065.stdout: "full_ratio": 0.99000000953674316, 2020-09-08T15:24:14.221 INFO:tasks.workunit.client.0.smithi065.stdout: "backfillfull_ratio": 0.99000000953674316, 2020-09-08T15:24:14.221 INFO:tasks.workunit.client.0.smithi065.stdout: "nearfull_ratio": 0.85000002384185791, 2020-09-08T15:24:14.221 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_snapshot": "", 2020-09-08T15:24:14.221 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_max": 1, 2020-09-08T15:24:14.221 INFO:tasks.workunit.client.0.smithi065.stdout: "max_osd": 3, 2020-09-08T15:24:14.222 INFO:tasks.workunit.client.0.smithi065.stdout: "require_min_compat_client": "luminous", 2020-09-08T15:24:14.222 INFO:tasks.workunit.client.0.smithi065.stdout: "min_compat_client": "jewel", 2020-09-08T15:24:14.222 INFO:tasks.workunit.client.0.smithi065.stdout: "require_osd_release": "pacific", 2020-09-08T15:24:14.222 INFO:tasks.workunit.client.0.smithi065.stdout: "pools": [ 2020-09-08T15:24:14.222 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.223 INFO:tasks.workunit.client.0.smithi065.stdout: "pool": 1, 2020-09-08T15:24:14.223 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_name": "test", 2020-09-08T15:24:14.223 INFO:tasks.workunit.client.0.smithi065.stdout: "create_time": "2020-09-08T15:22:42.288006+0000", 2020-09-08T15:24:14.223 INFO:tasks.workunit.client.0.smithi065.stdout: "flags": 1, 2020-09-08T15:24:14.223 INFO:tasks.workunit.client.0.smithi065.stdout: "flags_names": "hashpspool", 2020-09-08T15:24:14.223 INFO:tasks.workunit.client.0.smithi065.stdout: "type": 1, 2020-09-08T15:24:14.224 INFO:tasks.workunit.client.0.smithi065.stdout: "size": 3, 2020-09-08T15:24:14.224 INFO:tasks.workunit.client.0.smithi065.stdout: "min_size": 2, 2020-09-08T15:24:14.224 INFO:tasks.workunit.client.0.smithi065.stdout: "crush_rule": 0, 2020-09-08T15:24:14.224 INFO:tasks.workunit.client.0.smithi065.stdout: "object_hash": 2, 2020-09-08T15:24:14.224 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_autoscale_mode": "off", 2020-09-08T15:24:14.225 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_num": 1, 2020-09-08T15:24:14.225 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_placement_num": 1, 2020-09-08T15:24:14.225 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_placement_num_target": 1, 2020-09-08T15:24:14.225 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_num_target": 1, 2020-09-08T15:24:14.226 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_num_pending": 1, 2020-09-08T15:24:14.226 INFO:tasks.workunit.client.0.smithi065.stdout: "last_pg_merge_meta": { 2020-09-08T15:24:14.226 INFO:tasks.workunit.client.0.smithi065.stdout: "source_pgid": "0.0", 2020-09-08T15:24:14.226 INFO:tasks.workunit.client.0.smithi065.stdout: "ready_epoch": 0, 2020-09-08T15:24:14.226 INFO:tasks.workunit.client.0.smithi065.stdout: "last_epoch_started": 0, 2020-09-08T15:24:14.227 INFO:tasks.workunit.client.0.smithi065.stdout: "last_epoch_clean": 0, 2020-09-08T15:24:14.227 INFO:tasks.workunit.client.0.smithi065.stdout: "source_version": "0'0", 2020-09-08T15:24:14.227 INFO:tasks.workunit.client.0.smithi065.stdout: "target_version": "0'0" 2020-09-08T15:24:14.227 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.227 INFO:tasks.workunit.client.0.smithi065.stdout: "last_change": "29", 2020-09-08T15:24:14.228 INFO:tasks.workunit.client.0.smithi065.stdout: "last_force_op_resend": "0", 2020-09-08T15:24:14.228 INFO:tasks.workunit.client.0.smithi065.stdout: "last_force_op_resend_prenautilus": "0", 2020-09-08T15:24:14.228 INFO:tasks.workunit.client.0.smithi065.stdout: "last_force_op_resend_preluminous": "0", 2020-09-08T15:24:14.228 INFO:tasks.workunit.client.0.smithi065.stdout: "auid": 0, 2020-09-08T15:24:14.228 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_mode": "selfmanaged", 2020-09-08T15:24:14.228 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_seq": 0, 2020-09-08T15:24:14.229 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_epoch": 0, 2020-09-08T15:24:14.229 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_snaps": [], 2020-09-08T15:24:14.229 INFO:tasks.workunit.client.0.smithi065.stdout: "removed_snaps": "[]", 2020-09-08T15:24:14.229 INFO:tasks.workunit.client.0.smithi065.stdout: "quota_max_bytes": 0, 2020-09-08T15:24:14.229 INFO:tasks.workunit.client.0.smithi065.stdout: "quota_max_objects": 0, 2020-09-08T15:24:14.230 INFO:tasks.workunit.client.0.smithi065.stdout: "tiers": [], 2020-09-08T15:24:14.230 INFO:tasks.workunit.client.0.smithi065.stdout: "tier_of": -1, 2020-09-08T15:24:14.230 INFO:tasks.workunit.client.0.smithi065.stdout: "read_tier": -1, 2020-09-08T15:24:14.230 INFO:tasks.workunit.client.0.smithi065.stdout: "write_tier": -1, 2020-09-08T15:24:14.230 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_mode": "none", 2020-09-08T15:24:14.230 INFO:tasks.workunit.client.0.smithi065.stdout: "target_max_bytes": 0, 2020-09-08T15:24:14.231 INFO:tasks.workunit.client.0.smithi065.stdout: "target_max_objects": 0, 2020-09-08T15:24:14.231 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-09-08T15:24:14.231 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-09-08T15:24:14.231 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_target_full_ratio_micro": 800000, 2020-09-08T15:24:14.231 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_min_flush_age": 0, 2020-09-08T15:24:14.232 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_min_evict_age": 0, 2020-09-08T15:24:14.232 INFO:tasks.workunit.client.0.smithi065.stdout: "erasure_code_profile": "", 2020-09-08T15:24:14.232 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_params": { 2020-09-08T15:24:14.232 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "none" 2020-09-08T15:24:14.232 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.233 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_period": 0, 2020-09-08T15:24:14.233 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_count": 0, 2020-09-08T15:24:14.233 INFO:tasks.workunit.client.0.smithi065.stdout: "use_gmt_hitset": true, 2020-09-08T15:24:14.233 INFO:tasks.workunit.client.0.smithi065.stdout: "min_read_recency_for_promote": 0, 2020-09-08T15:24:14.233 INFO:tasks.workunit.client.0.smithi065.stdout: "min_write_recency_for_promote": 0, 2020-09-08T15:24:14.234 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_grade_decay_rate": 0, 2020-09-08T15:24:14.234 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_search_last_n": 0, 2020-09-08T15:24:14.234 INFO:tasks.workunit.client.0.smithi065.stdout: "grade_table": [], 2020-09-08T15:24:14.234 INFO:tasks.workunit.client.0.smithi065.stdout: "stripe_width": 0, 2020-09-08T15:24:14.234 INFO:tasks.workunit.client.0.smithi065.stdout: "expected_num_objects": 0, 2020-09-08T15:24:14.235 INFO:tasks.workunit.client.0.smithi065.stdout: "fast_read": false, 2020-09-08T15:24:14.235 INFO:tasks.workunit.client.0.smithi065.stdout: "options": {}, 2020-09-08T15:24:14.235 INFO:tasks.workunit.client.0.smithi065.stdout: "application_metadata": {} 2020-09-08T15:24:14.235 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.235 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:24:14.235 INFO:tasks.workunit.client.0.smithi065.stdout: "osds": [ 2020-09-08T15:24:14.236 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.236 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:24:14.236 INFO:tasks.workunit.client.0.smithi065.stdout: "uuid": "0995576a-0b47-4a00-b362-285884219bcc", 2020-09-08T15:24:14.236 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 1, 2020-09-08T15:24:14.236 INFO:tasks.workunit.client.0.smithi065.stdout: "in": 1, 2020-09-08T15:24:14.237 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 1, 2020-09-08T15:24:14.237 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_affinity": 1, 2020-09-08T15:24:14.237 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_begin": 5, 2020-09-08T15:24:14.237 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_end": 29, 2020-09-08T15:24:14.237 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 35, 2020-09-08T15:24:14.237 INFO:tasks.workunit.client.0.smithi065.stdout: "up_thru": 38, 2020-09-08T15:24:14.238 INFO:tasks.workunit.client.0.smithi065.stdout: "down_at": 30, 2020-09-08T15:24:14.238 INFO:tasks.workunit.client.0.smithi065.stdout: "lost_at": 0, 2020-09-08T15:24:14.238 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:24:14.238 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:24:14.238 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.239 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:24:14.239 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6802", 2020-09-08T15:24:14.239 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 37437 2020-09-08T15:24:14.239 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.239 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.239 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:24:14.240 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6803", 2020-09-08T15:24:14.240 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 37437 2020-09-08T15:24:14.240 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.240 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.240 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.241 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addrs": { 2020-09-08T15:24:14.241 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:24:14.241 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.241 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:24:14.241 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6804", 2020-09-08T15:24:14.242 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 37437 2020-09-08T15:24:14.242 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.242 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.242 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:24:14.242 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6805", 2020-09-08T15:24:14.242 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 37437 2020-09-08T15:24:14.243 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.243 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.243 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.243 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addrs": { 2020-09-08T15:24:14.243 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:24:14.244 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.244 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:24:14.244 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6808", 2020-09-08T15:24:14.244 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 37437 2020-09-08T15:24:14.244 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.244 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.245 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:24:14.245 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6809", 2020-09-08T15:24:14.245 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 37437 2020-09-08T15:24:14.245 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.246 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.246 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.246 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addrs": { 2020-09-08T15:24:14.246 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:24:14.246 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.247 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:24:14.247 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6806", 2020-09-08T15:24:14.247 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 37437 2020-09-08T15:24:14.247 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.247 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.247 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:24:14.248 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6807", 2020-09-08T15:24:14.248 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 37437 2020-09-08T15:24:14.248 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.248 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.248 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.249 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:6803/37437", 2020-09-08T15:24:14.249 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addr": "127.0.0.1:6805/37437", 2020-09-08T15:24:14.249 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addr": "127.0.0.1:6809/37437", 2020-09-08T15:24:14.249 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addr": "127.0.0.1:6807/37437", 2020-09-08T15:24:14.249 INFO:tasks.workunit.client.0.smithi065.stdout: "state": [ 2020-09-08T15:24:14.250 INFO:tasks.workunit.client.0.smithi065.stdout: "exists", 2020-09-08T15:24:14.250 INFO:tasks.workunit.client.0.smithi065.stdout: "up" 2020-09-08T15:24:14.250 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.250 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.250 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.250 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:24:14.251 INFO:tasks.workunit.client.0.smithi065.stdout: "uuid": "a4e3c598-4840-46b3-b4f8-a70df3240520", 2020-09-08T15:24:14.251 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 0, 2020-09-08T15:24:14.251 INFO:tasks.workunit.client.0.smithi065.stdout: "in": 1, 2020-09-08T15:24:14.251 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 1, 2020-09-08T15:24:14.251 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_affinity": 1, 2020-09-08T15:24:14.252 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_begin": 0, 2020-09-08T15:24:14.252 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_end": 0, 2020-09-08T15:24:14.252 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 10, 2020-09-08T15:24:14.252 INFO:tasks.workunit.client.0.smithi065.stdout: "up_thru": 23, 2020-09-08T15:24:14.252 INFO:tasks.workunit.client.0.smithi065.stdout: "down_at": 31, 2020-09-08T15:24:14.252 INFO:tasks.workunit.client.0.smithi065.stdout: "lost_at": 0, 2020-09-08T15:24:14.253 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:24:14.253 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:24:14.253 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.253 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:24:14.253 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6810", 2020-09-08T15:24:14.254 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 32526 2020-09-08T15:24:14.254 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.254 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.254 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:24:14.254 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6811", 2020-09-08T15:24:14.255 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 32526 2020-09-08T15:24:14.255 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.255 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.255 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.255 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addrs": { 2020-09-08T15:24:14.255 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:24:14.256 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.256 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:24:14.256 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6812", 2020-09-08T15:24:14.256 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 32526 2020-09-08T15:24:14.256 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.257 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.257 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:24:14.257 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6813", 2020-09-08T15:24:14.257 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 32526 2020-09-08T15:24:14.257 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.257 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.258 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.258 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addrs": { 2020-09-08T15:24:14.258 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:24:14.258 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.258 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:24:14.259 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6816", 2020-09-08T15:24:14.259 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 32526 2020-09-08T15:24:14.259 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.259 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.259 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:24:14.259 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6817", 2020-09-08T15:24:14.260 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 32526 2020-09-08T15:24:14.260 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.260 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.260 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.260 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addrs": { 2020-09-08T15:24:14.261 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:24:14.261 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.261 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:24:14.261 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6814", 2020-09-08T15:24:14.261 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 32526 2020-09-08T15:24:14.262 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.262 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.262 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:24:14.262 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6815", 2020-09-08T15:24:14.262 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 32526 2020-09-08T15:24:14.262 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.263 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.263 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.263 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:6811/32526", 2020-09-08T15:24:14.263 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addr": "127.0.0.1:6813/32526", 2020-09-08T15:24:14.263 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addr": "127.0.0.1:6817/32526", 2020-09-08T15:24:14.264 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addr": "127.0.0.1:6815/32526", 2020-09-08T15:24:14.264 INFO:tasks.workunit.client.0.smithi065.stdout: "state": [ 2020-09-08T15:24:14.264 INFO:tasks.workunit.client.0.smithi065.stdout: "exists" 2020-09-08T15:24:14.264 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.264 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.265 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.265 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:24:14.265 INFO:tasks.workunit.client.0.smithi065.stdout: "uuid": "ba9a9e7f-9bc8-4e25-8fb1-8c4ab677561a", 2020-09-08T15:24:14.265 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 1, 2020-09-08T15:24:14.265 INFO:tasks.workunit.client.0.smithi065.stdout: "in": 1, 2020-09-08T15:24:14.266 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 1, 2020-09-08T15:24:14.266 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_affinity": 1, 2020-09-08T15:24:14.266 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_begin": 15, 2020-09-08T15:24:14.266 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_end": 29, 2020-09-08T15:24:14.266 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 36, 2020-09-08T15:24:14.267 INFO:tasks.workunit.client.0.smithi065.stdout: "up_thru": 0, 2020-09-08T15:24:14.267 INFO:tasks.workunit.client.0.smithi065.stdout: "down_at": 32, 2020-09-08T15:24:14.267 INFO:tasks.workunit.client.0.smithi065.stdout: "lost_at": 0, 2020-09-08T15:24:14.267 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:24:14.267 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:24:14.267 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.268 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:24:14.268 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6810", 2020-09-08T15:24:14.268 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 37836 2020-09-08T15:24:14.268 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.268 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.269 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:24:14.269 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6811", 2020-09-08T15:24:14.269 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 37836 2020-09-08T15:24:14.269 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.269 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.270 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.270 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addrs": { 2020-09-08T15:24:14.270 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:24:14.270 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.270 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:24:14.270 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6812", 2020-09-08T15:24:14.271 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 37836 2020-09-08T15:24:14.271 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.271 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.271 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:24:14.271 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6813", 2020-09-08T15:24:14.272 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 37836 2020-09-08T15:24:14.272 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.272 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.272 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.272 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addrs": { 2020-09-08T15:24:14.272 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:24:14.273 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.273 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:24:14.273 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6816", 2020-09-08T15:24:14.273 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 37836 2020-09-08T15:24:14.273 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.274 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.274 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:24:14.274 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6817", 2020-09-08T15:24:14.274 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 37836 2020-09-08T15:24:14.274 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.274 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.275 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.275 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addrs": { 2020-09-08T15:24:14.275 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:24:14.275 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.275 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:24:14.276 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6814", 2020-09-08T15:24:14.276 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 37836 2020-09-08T15:24:14.276 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.276 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.276 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:24:14.277 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6815", 2020-09-08T15:24:14.277 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 37836 2020-09-08T15:24:14.277 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.277 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.277 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.277 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:6811/37836", 2020-09-08T15:24:14.278 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addr": "127.0.0.1:6813/37836", 2020-09-08T15:24:14.278 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addr": "127.0.0.1:6817/37836", 2020-09-08T15:24:14.278 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addr": "127.0.0.1:6815/37836", 2020-09-08T15:24:14.278 INFO:tasks.workunit.client.0.smithi065.stdout: "state": [ 2020-09-08T15:24:14.278 INFO:tasks.workunit.client.0.smithi065.stdout: "exists", 2020-09-08T15:24:14.279 INFO:tasks.workunit.client.0.smithi065.stdout: "up" 2020-09-08T15:24:14.279 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.279 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.279 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:24:14.279 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_xinfo": [ 2020-09-08T15:24:14.279 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.280 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:24:14.280 INFO:tasks.workunit.client.0.smithi065.stdout: "down_stamp": "2020-09-08T15:23:28.885520+0000", 2020-09-08T15:24:14.280 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_probability": 0, 2020-09-08T15:24:14.280 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_interval": 0, 2020-09-08T15:24:14.280 INFO:tasks.workunit.client.0.smithi065.stdout: "features": 4540138292837744639, 2020-09-08T15:24:14.281 INFO:tasks.workunit.client.0.smithi065.stdout: "old_weight": 0, 2020-09-08T15:24:14.281 INFO:tasks.workunit.client.0.smithi065.stdout: "last_purged_snaps_scrub": "2020-09-08T15:22:23.635407+0000", 2020-09-08T15:24:14.281 INFO:tasks.workunit.client.0.smithi065.stdout: "dead_epoch": 0 2020-09-08T15:24:14.281 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.281 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.281 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:24:14.282 INFO:tasks.workunit.client.0.smithi065.stdout: "down_stamp": "2020-09-08T15:23:29.446008+0000", 2020-09-08T15:24:14.282 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_probability": 0, 2020-09-08T15:24:14.282 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_interval": 0, 2020-09-08T15:24:14.282 INFO:tasks.workunit.client.0.smithi065.stdout: "features": 4540138292837744639, 2020-09-08T15:24:14.282 INFO:tasks.workunit.client.0.smithi065.stdout: "old_weight": 0, 2020-09-08T15:24:14.283 INFO:tasks.workunit.client.0.smithi065.stdout: "last_purged_snaps_scrub": "2020-09-08T15:22:31.815833+0000", 2020-09-08T15:24:14.283 INFO:tasks.workunit.client.0.smithi065.stdout: "dead_epoch": 0 2020-09-08T15:24:14.283 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.283 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.283 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:24:14.283 INFO:tasks.workunit.client.0.smithi065.stdout: "down_stamp": "2020-09-08T15:23:30.029631+0000", 2020-09-08T15:24:14.284 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_probability": 0, 2020-09-08T15:24:14.284 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_interval": 0, 2020-09-08T15:24:14.284 INFO:tasks.workunit.client.0.smithi065.stdout: "features": 4540138292837744639, 2020-09-08T15:24:14.284 INFO:tasks.workunit.client.0.smithi065.stdout: "old_weight": 0, 2020-09-08T15:24:14.284 INFO:tasks.workunit.client.0.smithi065.stdout: "last_purged_snaps_scrub": "2020-09-08T15:22:39.838383+0000", 2020-09-08T15:24:14.285 INFO:tasks.workunit.client.0.smithi065.stdout: "dead_epoch": 0 2020-09-08T15:24:14.285 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.285 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:24:14.285 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_upmap": [], 2020-09-08T15:24:14.285 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_upmap_items": [], 2020-09-08T15:24:14.286 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_temp": [], 2020-09-08T15:24:14.286 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_temp": [], 2020-09-08T15:24:14.286 INFO:tasks.workunit.client.0.smithi065.stdout: "blocklist": {}, 2020-09-08T15:24:14.286 INFO:tasks.workunit.client.0.smithi065.stdout: "erasure_code_profiles": { 2020-09-08T15:24:14.286 INFO:tasks.workunit.client.0.smithi065.stdout: "default": { 2020-09-08T15:24:14.287 INFO:tasks.workunit.client.0.smithi065.stdout: "k": "2", 2020-09-08T15:24:14.287 INFO:tasks.workunit.client.0.smithi065.stdout: "m": "2", 2020-09-08T15:24:14.287 INFO:tasks.workunit.client.0.smithi065.stdout: "plugin": "jerasure", 2020-09-08T15:24:14.287 INFO:tasks.workunit.client.0.smithi065.stdout: "technique": "reed_sol_van" 2020-09-08T15:24:14.287 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.287 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.288 INFO:tasks.workunit.client.0.smithi065.stdout: "removed_snaps_queue": [], 2020-09-08T15:24:14.288 INFO:tasks.workunit.client.0.smithi065.stdout: "new_removed_snaps": [], 2020-09-08T15:24:14.288 INFO:tasks.workunit.client.0.smithi065.stdout: "new_purged_snaps": [], 2020-09-08T15:24:14.288 INFO:tasks.workunit.client.0.smithi065.stdout: "crush_node_flags": {}, 2020-09-08T15:24:14.288 INFO:tasks.workunit.client.0.smithi065.stdout: "device_class_flags": {} 2020-09-08T15:24:14.289 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.289 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_metadata": [ 2020-09-08T15:24:14.289 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.289 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:24:14.289 INFO:tasks.workunit.client.0.smithi065.stdout: "arch": "x86_64", 2020-09-08T15:24:14.289 INFO:tasks.workunit.client.0.smithi065.stdout: "back_addr": "[v2:127.0.0.1:6804/37437,v1:127.0.0.1:6805/37437]", 2020-09-08T15:24:14.290 INFO:tasks.workunit.client.0.smithi065.stdout: "back_iface": "", 2020-09-08T15:24:14.290 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs": "1", 2020-09-08T15:24:14.290 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_db": "0", 2020-09-08T15:24:14.290 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_wal": "0", 2020-09-08T15:24:14.290 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_single_shared_device": "1", 2020-09-08T15:24:14.291 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T15:24:14.291 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T15:24:14.291 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T15:24:14.291 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T15:24:14.291 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2020-09-08T15:24:14.291 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T15:24:14.292 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T15:24:14.292 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T15:24:14.292 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T15:24:14.292 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_release": "pacific", 2020-09-08T15:24:14.292 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version": "ceph version 16.0.0-5272-gdce4d291bd4 (dce4d291bd4243c9802c17d67b85a6da6bbc0f8f) pacific (dev)", 2020-09-08T15:24:14.293 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version_short": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:24:14.293 INFO:tasks.workunit.client.0.smithi065.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-09-08T15:24:14.293 INFO:tasks.workunit.client.0.smithi065.stdout: "default_device_class": "hdd", 2020-09-08T15:24:14.293 INFO:tasks.workunit.client.0.smithi065.stdout: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W4VHBH", 2020-09-08T15:24:14.293 INFO:tasks.workunit.client.0.smithi065.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2020-09-08T15:24:14.294 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": "sda", 2020-09-08T15:24:14.294 INFO:tasks.workunit.client.0.smithi065.stdout: "distro": "rhel", 2020-09-08T15:24:14.294 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_description": "Red Hat Enterprise Linux 8.1 (Ootpa)", 2020-09-08T15:24:14.294 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_version": "8.1", 2020-09-08T15:24:14.294 INFO:tasks.workunit.client.0.smithi065.stdout: "front_addr": "[v2:127.0.0.1:6802/37437,v1:127.0.0.1:6803/37437]", 2020-09-08T15:24:14.294 INFO:tasks.workunit.client.0.smithi065.stdout: "front_iface": "", 2020-09-08T15:24:14.295 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/37437,v1:127.0.0.1:6809/37437]", 2020-09-08T15:24:14.295 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/37437,v1:127.0.0.1:6807/37437]", 2020-09-08T15:24:14.295 INFO:tasks.workunit.client.0.smithi065.stdout: "hostname": "smithi065", 2020-09-08T15:24:14.295 INFO:tasks.workunit.client.0.smithi065.stdout: "journal_rotational": "1", 2020-09-08T15:24:14.295 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_description": "#1 SMP Fri Mar 27 14:35:58 UTC 2020", 2020-09-08T15:24:14.296 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_version": "4.18.0-193.el8.x86_64", 2020-09-08T15:24:14.296 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_swap_kb": "0", 2020-09-08T15:24:14.296 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_total_kb": "32653204", 2020-09-08T15:24:14.296 INFO:tasks.workunit.client.0.smithi065.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2020-09-08T15:24:14.296 INFO:tasks.workunit.client.0.smithi065.stdout: "objectstore_numa_unknown_devices": "sda", 2020-09-08T15:24:14.296 INFO:tasks.workunit.client.0.smithi065.stdout: "os": "Linux", 2020-09-08T15:24:14.297 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_data": "td/divergent-priors/0", 2020-09-08T15:24:14.297 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T15:24:14.297 INFO:tasks.workunit.client.0.smithi065.stdout: "osdspec_affinity": "", 2020-09-08T15:24:14.297 INFO:tasks.workunit.client.0.smithi065.stdout: "rotational": "1" 2020-09-08T15:24:14.297 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.298 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.298 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:24:14.298 INFO:tasks.workunit.client.0.smithi065.stdout: "arch": "x86_64", 2020-09-08T15:24:14.298 INFO:tasks.workunit.client.0.smithi065.stdout: "back_addr": "[v2:127.0.0.1:6812/32526,v1:127.0.0.1:6813/32526]", 2020-09-08T15:24:14.298 INFO:tasks.workunit.client.0.smithi065.stdout: "back_iface": "", 2020-09-08T15:24:14.299 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs": "1", 2020-09-08T15:24:14.299 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_db": "0", 2020-09-08T15:24:14.299 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_wal": "0", 2020-09-08T15:24:14.299 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_single_shared_device": "1", 2020-09-08T15:24:14.299 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T15:24:14.299 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T15:24:14.300 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T15:24:14.300 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T15:24:14.300 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2020-09-08T15:24:14.300 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T15:24:14.300 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T15:24:14.301 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T15:24:14.301 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T15:24:14.301 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_release": "pacific", 2020-09-08T15:24:14.301 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version": "ceph version 16.0.0-5272-gdce4d291bd4 (dce4d291bd4243c9802c17d67b85a6da6bbc0f8f) pacific (dev)", 2020-09-08T15:24:14.301 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version_short": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:24:14.301 INFO:tasks.workunit.client.0.smithi065.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-09-08T15:24:14.302 INFO:tasks.workunit.client.0.smithi065.stdout: "default_device_class": "hdd", 2020-09-08T15:24:14.302 INFO:tasks.workunit.client.0.smithi065.stdout: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W4VHBH", 2020-09-08T15:24:14.302 INFO:tasks.workunit.client.0.smithi065.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2020-09-08T15:24:14.302 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": "sda", 2020-09-08T15:24:14.302 INFO:tasks.workunit.client.0.smithi065.stdout: "distro": "rhel", 2020-09-08T15:24:14.303 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_description": "Red Hat Enterprise Linux 8.1 (Ootpa)", 2020-09-08T15:24:14.303 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_version": "8.1", 2020-09-08T15:24:14.303 INFO:tasks.workunit.client.0.smithi065.stdout: "front_addr": "[v2:127.0.0.1:6810/32526,v1:127.0.0.1:6811/32526]", 2020-09-08T15:24:14.303 INFO:tasks.workunit.client.0.smithi065.stdout: "front_iface": "", 2020-09-08T15:24:14.303 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/32526,v1:127.0.0.1:6817/32526]", 2020-09-08T15:24:14.304 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/32526,v1:127.0.0.1:6815/32526]", 2020-09-08T15:24:14.304 INFO:tasks.workunit.client.0.smithi065.stdout: "hostname": "smithi065", 2020-09-08T15:24:14.304 INFO:tasks.workunit.client.0.smithi065.stdout: "journal_rotational": "1", 2020-09-08T15:24:14.304 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_description": "#1 SMP Fri Mar 27 14:35:58 UTC 2020", 2020-09-08T15:24:14.304 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_version": "4.18.0-193.el8.x86_64", 2020-09-08T15:24:14.304 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_swap_kb": "0", 2020-09-08T15:24:14.305 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_total_kb": "32653204", 2020-09-08T15:24:14.305 INFO:tasks.workunit.client.0.smithi065.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2020-09-08T15:24:14.305 INFO:tasks.workunit.client.0.smithi065.stdout: "objectstore_numa_unknown_devices": "sda", 2020-09-08T15:24:14.305 INFO:tasks.workunit.client.0.smithi065.stdout: "os": "Linux", 2020-09-08T15:24:14.305 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_data": "td/divergent-priors/1", 2020-09-08T15:24:14.306 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T15:24:14.306 INFO:tasks.workunit.client.0.smithi065.stdout: "osdspec_affinity": "", 2020-09-08T15:24:14.306 INFO:tasks.workunit.client.0.smithi065.stdout: "rotational": "1" 2020-09-08T15:24:14.306 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.306 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.306 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:24:14.307 INFO:tasks.workunit.client.0.smithi065.stdout: "arch": "x86_64", 2020-09-08T15:24:14.307 INFO:tasks.workunit.client.0.smithi065.stdout: "back_addr": "[v2:127.0.0.1:6812/37836,v1:127.0.0.1:6813/37836]", 2020-09-08T15:24:14.307 INFO:tasks.workunit.client.0.smithi065.stdout: "back_iface": "", 2020-09-08T15:24:14.307 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs": "1", 2020-09-08T15:24:14.307 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_db": "0", 2020-09-08T15:24:14.308 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_wal": "0", 2020-09-08T15:24:14.308 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_single_shared_device": "1", 2020-09-08T15:24:14.308 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T15:24:14.308 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T15:24:14.308 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T15:24:14.308 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T15:24:14.309 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2020-09-08T15:24:14.309 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T15:24:14.309 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T15:24:14.309 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T15:24:14.309 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T15:24:14.310 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_release": "pacific", 2020-09-08T15:24:14.310 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version": "ceph version 16.0.0-5272-gdce4d291bd4 (dce4d291bd4243c9802c17d67b85a6da6bbc0f8f) pacific (dev)", 2020-09-08T15:24:14.310 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version_short": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:24:14.310 INFO:tasks.workunit.client.0.smithi065.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-09-08T15:24:14.310 INFO:tasks.workunit.client.0.smithi065.stdout: "default_device_class": "hdd", 2020-09-08T15:24:14.311 INFO:tasks.workunit.client.0.smithi065.stdout: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W4VHBH", 2020-09-08T15:24:14.311 INFO:tasks.workunit.client.0.smithi065.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2020-09-08T15:24:14.311 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": "sda", 2020-09-08T15:24:14.311 INFO:tasks.workunit.client.0.smithi065.stdout: "distro": "rhel", 2020-09-08T15:24:14.311 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_description": "Red Hat Enterprise Linux 8.1 (Ootpa)", 2020-09-08T15:24:14.311 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_version": "8.1", 2020-09-08T15:24:14.312 INFO:tasks.workunit.client.0.smithi065.stdout: "front_addr": "[v2:127.0.0.1:6810/37836,v1:127.0.0.1:6811/37836]", 2020-09-08T15:24:14.312 INFO:tasks.workunit.client.0.smithi065.stdout: "front_iface": "", 2020-09-08T15:24:14.312 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/37836,v1:127.0.0.1:6817/37836]", 2020-09-08T15:24:14.312 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/37836,v1:127.0.0.1:6815/37836]", 2020-09-08T15:24:14.312 INFO:tasks.workunit.client.0.smithi065.stdout: "hostname": "smithi065", 2020-09-08T15:24:14.313 INFO:tasks.workunit.client.0.smithi065.stdout: "journal_rotational": "1", 2020-09-08T15:24:14.313 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_description": "#1 SMP Fri Mar 27 14:35:58 UTC 2020", 2020-09-08T15:24:14.313 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_version": "4.18.0-193.el8.x86_64", 2020-09-08T15:24:14.313 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_swap_kb": "0", 2020-09-08T15:24:14.313 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_total_kb": "32653204", 2020-09-08T15:24:14.313 INFO:tasks.workunit.client.0.smithi065.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2020-09-08T15:24:14.314 INFO:tasks.workunit.client.0.smithi065.stdout: "objectstore_numa_unknown_devices": "sda", 2020-09-08T15:24:14.314 INFO:tasks.workunit.client.0.smithi065.stdout: "os": "Linux", 2020-09-08T15:24:14.314 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_data": "td/divergent-priors/2", 2020-09-08T15:24:14.314 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T15:24:14.314 INFO:tasks.workunit.client.0.smithi065.stdout: "osdspec_affinity": "", 2020-09-08T15:24:14.315 INFO:tasks.workunit.client.0.smithi065.stdout: "rotational": "1" 2020-09-08T15:24:14.315 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.315 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:24:14.315 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap_clean_epochs": { 2020-09-08T15:24:14.315 INFO:tasks.workunit.client.0.smithi065.stdout: "min_last_epoch_clean": 0, 2020-09-08T15:24:14.315 INFO:tasks.workunit.client.0.smithi065.stdout: "last_epoch_clean": { 2020-09-08T15:24:14.316 INFO:tasks.workunit.client.0.smithi065.stdout: "per_pool": [] 2020-09-08T15:24:14.316 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.316 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_epochs": [ 2020-09-08T15:24:14.316 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.316 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:24:14.317 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 35 2020-09-08T15:24:14.317 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.317 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.317 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:24:14.317 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 10 2020-09-08T15:24:14.318 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.318 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.318 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:24:14.318 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 37 2020-09-08T15:24:14.318 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.318 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.319 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.319 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap_first_committed": 1, 2020-09-08T15:24:14.319 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap_last_committed": 39, 2020-09-08T15:24:14.319 INFO:tasks.workunit.client.0.smithi065.stdout: "crushmap": { 2020-09-08T15:24:14.319 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": [ 2020-09-08T15:24:14.320 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.320 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:24:14.320 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd.0", 2020-09-08T15:24:14.321 INFO:tasks.workunit.client.0.smithi065.stdout: "class": "hdd" 2020-09-08T15:24:14.321 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.321 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.321 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:24:14.321 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd.1", 2020-09-08T15:24:14.322 INFO:tasks.workunit.client.0.smithi065.stdout: "class": "hdd" 2020-09-08T15:24:14.322 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.322 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.322 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:24:14.322 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd.2", 2020-09-08T15:24:14.322 INFO:tasks.workunit.client.0.smithi065.stdout: "class": "hdd" 2020-09-08T15:24:14.323 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.323 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:24:14.323 INFO:tasks.workunit.client.0.smithi065.stdout: "types": [ 2020-09-08T15:24:14.323 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.323 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 0, 2020-09-08T15:24:14.324 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd" 2020-09-08T15:24:14.324 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.324 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.324 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 1, 2020-09-08T15:24:14.324 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "host" 2020-09-08T15:24:14.325 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.325 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.325 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 2, 2020-09-08T15:24:14.325 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "chassis" 2020-09-08T15:24:14.325 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.325 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.326 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 3, 2020-09-08T15:24:14.326 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "rack" 2020-09-08T15:24:14.326 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.326 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.326 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 4, 2020-09-08T15:24:14.327 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "row" 2020-09-08T15:24:14.327 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.327 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.327 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 5, 2020-09-08T15:24:14.327 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "pdu" 2020-09-08T15:24:14.327 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.328 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.328 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 6, 2020-09-08T15:24:14.328 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "pod" 2020-09-08T15:24:14.328 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.328 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.329 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 7, 2020-09-08T15:24:14.329 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "room" 2020-09-08T15:24:14.329 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.329 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.329 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 8, 2020-09-08T15:24:14.330 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "datacenter" 2020-09-08T15:24:14.330 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.330 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.330 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 9, 2020-09-08T15:24:14.330 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "zone" 2020-09-08T15:24:14.330 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.331 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.331 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 10, 2020-09-08T15:24:14.331 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "region" 2020-09-08T15:24:14.331 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.331 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.332 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 11, 2020-09-08T15:24:14.332 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "root" 2020-09-08T15:24:14.332 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.332 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:24:14.332 INFO:tasks.workunit.client.0.smithi065.stdout: "buckets": [ 2020-09-08T15:24:14.332 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.333 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -1, 2020-09-08T15:24:14.333 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "default", 2020-09-08T15:24:14.333 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 11, 2020-09-08T15:24:14.333 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "root", 2020-09-08T15:24:14.333 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:24:14.334 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:24:14.334 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:24:14.334 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:24:14.334 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.334 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -3, 2020-09-08T15:24:14.334 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:24:14.335 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:24:14.335 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.335 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.335 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.335 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.336 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -2, 2020-09-08T15:24:14.336 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "default~hdd", 2020-09-08T15:24:14.336 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 11, 2020-09-08T15:24:14.336 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "root", 2020-09-08T15:24:14.336 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:24:14.336 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:24:14.337 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:24:14.337 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:24:14.337 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.337 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -4, 2020-09-08T15:24:14.337 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:24:14.338 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:24:14.338 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.338 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.338 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.338 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.339 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -3, 2020-09-08T15:24:14.339 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "smithi065", 2020-09-08T15:24:14.339 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 1, 2020-09-08T15:24:14.339 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "host", 2020-09-08T15:24:14.339 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:24:14.339 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:24:14.340 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:24:14.340 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:24:14.340 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.340 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:24:14.340 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:24:14.341 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:24:14.341 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.341 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.341 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:24:14.341 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:24:14.342 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 1 2020-09-08T15:24:14.342 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.342 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.342 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:24:14.342 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:24:14.342 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 2 2020-09-08T15:24:14.343 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.343 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.343 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.343 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.343 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -4, 2020-09-08T15:24:14.344 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "smithi065~hdd", 2020-09-08T15:24:14.344 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 1, 2020-09-08T15:24:14.344 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "host", 2020-09-08T15:24:14.344 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:24:14.344 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:24:14.344 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:24:14.345 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:24:14.345 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.345 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:24:14.345 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:24:14.345 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:24:14.346 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.346 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.346 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:24:14.346 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:24:14.346 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 1 2020-09-08T15:24:14.346 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.347 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.347 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:24:14.347 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:24:14.347 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 2 2020-09-08T15:24:14.347 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.348 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.348 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.348 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:24:14.348 INFO:tasks.workunit.client.0.smithi065.stdout: "rules": [ 2020-09-08T15:24:14.348 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.348 INFO:tasks.workunit.client.0.smithi065.stdout: "rule_id": 0, 2020-09-08T15:24:14.349 INFO:tasks.workunit.client.0.smithi065.stdout: "rule_name": "replicated_rule", 2020-09-08T15:24:14.349 INFO:tasks.workunit.client.0.smithi065.stdout: "ruleset": 0, 2020-09-08T15:24:14.349 INFO:tasks.workunit.client.0.smithi065.stdout: "type": 1, 2020-09-08T15:24:14.349 INFO:tasks.workunit.client.0.smithi065.stdout: "min_size": 1, 2020-09-08T15:24:14.349 INFO:tasks.workunit.client.0.smithi065.stdout: "max_size": 10, 2020-09-08T15:24:14.350 INFO:tasks.workunit.client.0.smithi065.stdout: "steps": [ 2020-09-08T15:24:14.350 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.350 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "take", 2020-09-08T15:24:14.350 INFO:tasks.workunit.client.0.smithi065.stdout: "item": -1, 2020-09-08T15:24:14.350 INFO:tasks.workunit.client.0.smithi065.stdout: "item_name": "default" 2020-09-08T15:24:14.351 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.351 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.351 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "choose_firstn", 2020-09-08T15:24:14.351 INFO:tasks.workunit.client.0.smithi065.stdout: "num": 0, 2020-09-08T15:24:14.351 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "osd" 2020-09-08T15:24:14.351 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.352 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.352 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "emit" 2020-09-08T15:24:14.352 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.352 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:24:14.352 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.353 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:24:14.353 INFO:tasks.workunit.client.0.smithi065.stdout: "tunables": { 2020-09-08T15:24:14.353 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_local_tries": 0, 2020-09-08T15:24:14.353 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_local_fallback_tries": 0, 2020-09-08T15:24:14.353 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_total_tries": 50, 2020-09-08T15:24:14.353 INFO:tasks.workunit.client.0.smithi065.stdout: "chooseleaf_descend_once": 1, 2020-09-08T15:24:14.354 INFO:tasks.workunit.client.0.smithi065.stdout: "chooseleaf_vary_r": 1, 2020-09-08T15:24:14.354 INFO:tasks.workunit.client.0.smithi065.stdout: "chooseleaf_stable": 1, 2020-09-08T15:24:14.354 INFO:tasks.workunit.client.0.smithi065.stdout: "straw_calc_version": 1, 2020-09-08T15:24:14.354 INFO:tasks.workunit.client.0.smithi065.stdout: "allowed_bucket_algs": 54, 2020-09-08T15:24:14.354 INFO:tasks.workunit.client.0.smithi065.stdout: "profile": "jewel", 2020-09-08T15:24:14.355 INFO:tasks.workunit.client.0.smithi065.stdout: "optimal_tunables": 1, 2020-09-08T15:24:14.355 INFO:tasks.workunit.client.0.smithi065.stdout: "legacy_tunables": 0, 2020-09-08T15:24:14.355 INFO:tasks.workunit.client.0.smithi065.stdout: "minimum_required_version": "jewel", 2020-09-08T15:24:14.355 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables": 1, 2020-09-08T15:24:14.355 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables2": 1, 2020-09-08T15:24:14.355 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v2_rules": 0, 2020-09-08T15:24:14.356 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables3": 1, 2020-09-08T15:24:14.356 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v3_rules": 0, 2020-09-08T15:24:14.356 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v4_buckets": 1, 2020-09-08T15:24:14.356 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables5": 1, 2020-09-08T15:24:14.356 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v5_rules": 0 2020-09-08T15:24:14.357 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.357 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_args": {} 2020-09-08T15:24:14.357 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.357 INFO:tasks.workunit.client.0.smithi065.stdout: "fsmap": { 2020-09-08T15:24:14.357 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 1, 2020-09-08T15:24:14.357 INFO:tasks.workunit.client.0.smithi065.stdout: "default_fscid": -1, 2020-09-08T15:24:14.358 INFO:tasks.workunit.client.0.smithi065.stdout: "compat": { 2020-09-08T15:24:14.358 INFO:tasks.workunit.client.0.smithi065.stdout: "compat": {}, 2020-09-08T15:24:14.358 INFO:tasks.workunit.client.0.smithi065.stdout: "ro_compat": {}, 2020-09-08T15:24:14.358 INFO:tasks.workunit.client.0.smithi065.stdout: "incompat": { 2020-09-08T15:24:14.358 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_1": "base v0.20", 2020-09-08T15:24:14.359 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_2": "client writeable ranges", 2020-09-08T15:24:14.359 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_3": "default file layouts on dirs", 2020-09-08T15:24:14.359 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_4": "dir inode in separate object", 2020-09-08T15:24:14.359 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_5": "mds uses versioned encoding", 2020-09-08T15:24:14.360 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_6": "dirfrag is stored in omap", 2020-09-08T15:24:14.360 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_8": "no anchor table", 2020-09-08T15:24:14.360 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_9": "file layout v2", 2020-09-08T15:24:14.360 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_10": "snaprealm v2" 2020-09-08T15:24:14.360 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.360 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.361 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_flags": { 2020-09-08T15:24:14.361 INFO:tasks.workunit.client.0.smithi065.stdout: "enable_multiple": false, 2020-09-08T15:24:14.361 INFO:tasks.workunit.client.0.smithi065.stdout: "ever_enabled_multiple": false 2020-09-08T15:24:14.361 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.361 INFO:tasks.workunit.client.0.smithi065.stdout: "standbys": [], 2020-09-08T15:24:14.362 INFO:tasks.workunit.client.0.smithi065.stdout: "filesystems": [] 2020-09-08T15:24:14.362 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.362 INFO:tasks.workunit.client.0.smithi065.stdout: "mdsmap_first_committed": 1, 2020-09-08T15:24:14.362 INFO:tasks.workunit.client.0.smithi065.stdout: "mdsmap_last_committed": 1, 2020-09-08T15:24:14.362 INFO:tasks.workunit.client.0.smithi065.stdout: "auth": { 2020-09-08T15:24:14.363 INFO:tasks.workunit.client.0.smithi065.stdout: "first_committed": 1, 2020-09-08T15:24:14.363 INFO:tasks.workunit.client.0.smithi065.stdout: "last_committed": 5, 2020-09-08T15:24:14.363 INFO:tasks.workunit.client.0.smithi065.stdout: "num_secrets": 3 2020-09-08T15:24:14.363 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.363 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg": 1, 2020-09-08T15:24:14.363 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_active": 1, 2020-09-08T15:24:14.364 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_unknown": 0, 2020-09-08T15:24:14.364 INFO:tasks.workunit.client.0.smithi065.stdout: "num_osd": 3, 2020-09-08T15:24:14.364 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_sum": { 2020-09-08T15:24:14.364 INFO:tasks.workunit.client.0.smithi065.stdout: "stat_sum": { 2020-09-08T15:24:14.364 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes": 48300, 2020-09-08T15:24:14.365 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects": 100, 2020-09-08T15:24:14.365 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_clones": 0, 2020-09-08T15:24:14.365 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_copies": 300, 2020-09-08T15:24:14.365 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing_on_primary": 0, 2020-09-08T15:24:14.365 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing": 0, 2020-09-08T15:24:14.365 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_degraded": 100, 2020-09-08T15:24:14.366 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_misplaced": 0, 2020-09-08T15:24:14.366 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_unfound": 0, 2020-09-08T15:24:14.366 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_dirty": 100, 2020-09-08T15:24:14.366 INFO:tasks.workunit.client.0.smithi065.stdout: "num_whiteouts": 0, 2020-09-08T15:24:14.366 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read": 0, 2020-09-08T15:24:14.367 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read_kb": 0, 2020-09-08T15:24:14.367 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write": 100, 2020-09-08T15:24:14.367 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write_kb": 100, 2020-09-08T15:24:14.367 INFO:tasks.workunit.client.0.smithi065.stdout: "num_scrub_errors": 0, 2020-09-08T15:24:14.367 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shallow_scrub_errors": 0, 2020-09-08T15:24:14.367 INFO:tasks.workunit.client.0.smithi065.stdout: "num_deep_scrub_errors": 0, 2020-09-08T15:24:14.368 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_recovered": 0, 2020-09-08T15:24:14.368 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_recovered": 0, 2020-09-08T15:24:14.368 INFO:tasks.workunit.client.0.smithi065.stdout: "num_keys_recovered": 0, 2020-09-08T15:24:14.368 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_omap": 0, 2020-09-08T15:24:14.368 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_hit_set_archive": 0, 2020-09-08T15:24:14.369 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_hit_set_archive": 0, 2020-09-08T15:24:14.369 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush": 0, 2020-09-08T15:24:14.369 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_kb": 0, 2020-09-08T15:24:14.369 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict": 0, 2020-09-08T15:24:14.369 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_kb": 0, 2020-09-08T15:24:14.369 INFO:tasks.workunit.client.0.smithi065.stdout: "num_promote": 0, 2020-09-08T15:24:14.370 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_high": 0, 2020-09-08T15:24:14.370 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_low": 0, 2020-09-08T15:24:14.370 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_some": 0, 2020-09-08T15:24:14.370 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_full": 0, 2020-09-08T15:24:14.370 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_pinned": 0, 2020-09-08T15:24:14.371 INFO:tasks.workunit.client.0.smithi065.stdout: "num_legacy_snapsets": 0, 2020-09-08T15:24:14.371 INFO:tasks.workunit.client.0.smithi065.stdout: "num_large_omap_objects": 0, 2020-09-08T15:24:14.371 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_manifest": 0, 2020-09-08T15:24:14.371 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_bytes": 0, 2020-09-08T15:24:14.371 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_keys": 0, 2020-09-08T15:24:14.371 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_repaired": 0 2020-09-08T15:24:14.372 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.372 INFO:tasks.workunit.client.0.smithi065.stdout: "store_stats": { 2020-09-08T15:24:14.372 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 0, 2020-09-08T15:24:14.372 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 0, 2020-09-08T15:24:14.372 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:24:14.373 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 0, 2020-09-08T15:24:14.373 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 0, 2020-09-08T15:24:14.373 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:24:14.373 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:24:14.373 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:24:14.374 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 0, 2020-09-08T15:24:14.374 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 0 2020-09-08T15:24:14.374 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.374 INFO:tasks.workunit.client.0.smithi065.stdout: "log_size": 16, 2020-09-08T15:24:14.374 INFO:tasks.workunit.client.0.smithi065.stdout: "ondisk_log_size": 16, 2020-09-08T15:24:14.374 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 2, 2020-09-08T15:24:14.375 INFO:tasks.workunit.client.0.smithi065.stdout: "acting": 2, 2020-09-08T15:24:14.375 INFO:tasks.workunit.client.0.smithi065.stdout: "num_store_stats": 0 2020-09-08T15:24:14.375 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.375 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_sum": { 2020-09-08T15:24:14.375 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 0, 2020-09-08T15:24:14.376 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 0, 2020-09-08T15:24:14.376 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pgs": 3, 2020-09-08T15:24:14.376 INFO:tasks.workunit.client.0.smithi065.stdout: "num_osds": 3, 2020-09-08T15:24:14.376 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_osds": 3, 2020-09-08T15:24:14.376 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_omap_osds": 3, 2020-09-08T15:24:14.376 INFO:tasks.workunit.client.0.smithi065.stdout: "kb": 314572800, 2020-09-08T15:24:14.377 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used": 18172, 2020-09-08T15:24:14.377 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_data": 2080, 2020-09-08T15:24:14.377 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_omap": 1, 2020-09-08T15:24:14.377 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_meta": 16062, 2020-09-08T15:24:14.377 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_avail": 314554628, 2020-09-08T15:24:14.378 INFO:tasks.workunit.client.0.smithi065.stdout: "statfs": { 2020-09-08T15:24:14.378 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 322122547200, 2020-09-08T15:24:14.378 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 322103939072, 2020-09-08T15:24:14.378 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:24:14.378 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 2129920, 2020-09-08T15:24:14.379 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 404900, 2020-09-08T15:24:14.379 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:24:14.379 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:24:14.379 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:24:14.379 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 1928, 2020-09-08T15:24:14.379 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 16447608 2020-09-08T15:24:14.380 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.380 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_peers": [], 2020-09-08T15:24:14.380 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_trim_queue_len": 0, 2020-09-08T15:24:14.380 INFO:tasks.workunit.client.0.smithi065.stdout: "num_snap_trimming": 0, 2020-09-08T15:24:14.380 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shards_repaired": 1, 2020-09-08T15:24:14.381 INFO:tasks.workunit.client.0.smithi065.stdout: "op_queue_age_hist": { 2020-09-08T15:24:14.381 INFO:tasks.workunit.client.0.smithi065.stdout: "histogram": [], 2020-09-08T15:24:14.381 INFO:tasks.workunit.client.0.smithi065.stdout: "upper_bound": 1 2020-09-08T15:24:14.381 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.381 INFO:tasks.workunit.client.0.smithi065.stdout: "perf_stat": { 2020-09-08T15:24:14.381 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ms": 0, 2020-09-08T15:24:14.382 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ms": 0, 2020-09-08T15:24:14.382 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ns": 0, 2020-09-08T15:24:14.382 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ns": 0 2020-09-08T15:24:14.382 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.382 INFO:tasks.workunit.client.0.smithi065.stdout: "alerts": [], 2020-09-08T15:24:14.383 INFO:tasks.workunit.client.0.smithi065.stdout: "network_ping_times": [] 2020-09-08T15:24:14.383 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.383 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_sum_by_class": { 2020-09-08T15:24:14.383 INFO:tasks.workunit.client.0.smithi065.stdout: "hdd": { 2020-09-08T15:24:14.383 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 0, 2020-09-08T15:24:14.383 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 0, 2020-09-08T15:24:14.384 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pgs": 3, 2020-09-08T15:24:14.384 INFO:tasks.workunit.client.0.smithi065.stdout: "num_osds": 3, 2020-09-08T15:24:14.384 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_osds": 3, 2020-09-08T15:24:14.384 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_omap_osds": 3, 2020-09-08T15:24:14.384 INFO:tasks.workunit.client.0.smithi065.stdout: "kb": 314572800, 2020-09-08T15:24:14.385 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used": 18172, 2020-09-08T15:24:14.385 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_data": 2080, 2020-09-08T15:24:14.385 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_omap": 1, 2020-09-08T15:24:14.385 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_meta": 16062, 2020-09-08T15:24:14.385 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_avail": 314554628, 2020-09-08T15:24:14.386 INFO:tasks.workunit.client.0.smithi065.stdout: "statfs": { 2020-09-08T15:24:14.386 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 322122547200, 2020-09-08T15:24:14.386 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 322103939072, 2020-09-08T15:24:14.386 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:24:14.386 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 2129920, 2020-09-08T15:24:14.386 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 404900, 2020-09-08T15:24:14.387 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:24:14.387 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:24:14.387 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:24:14.387 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 1928, 2020-09-08T15:24:14.387 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 16447608 2020-09-08T15:24:14.388 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.388 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_peers": [], 2020-09-08T15:24:14.388 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_trim_queue_len": 0, 2020-09-08T15:24:14.388 INFO:tasks.workunit.client.0.smithi065.stdout: "num_snap_trimming": 0, 2020-09-08T15:24:14.388 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shards_repaired": 1, 2020-09-08T15:24:14.388 INFO:tasks.workunit.client.0.smithi065.stdout: "op_queue_age_hist": { 2020-09-08T15:24:14.389 INFO:tasks.workunit.client.0.smithi065.stdout: "histogram": [], 2020-09-08T15:24:14.389 INFO:tasks.workunit.client.0.smithi065.stdout: "upper_bound": 1 2020-09-08T15:24:14.389 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.389 INFO:tasks.workunit.client.0.smithi065.stdout: "perf_stat": { 2020-09-08T15:24:14.389 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ms": 0, 2020-09-08T15:24:14.390 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ms": 0, 2020-09-08T15:24:14.390 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ns": 0, 2020-09-08T15:24:14.390 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ns": 0 2020-09-08T15:24:14.390 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.390 INFO:tasks.workunit.client.0.smithi065.stdout: "alerts": [], 2020-09-08T15:24:14.390 INFO:tasks.workunit.client.0.smithi065.stdout: "network_ping_times": [] 2020-09-08T15:24:14.391 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.391 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.391 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_stats": [ 2020-09-08T15:24:14.391 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.391 INFO:tasks.workunit.client.0.smithi065.stdout: "poolid": 1, 2020-09-08T15:24:14.392 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg": 1, 2020-09-08T15:24:14.392 INFO:tasks.workunit.client.0.smithi065.stdout: "stat_sum": { 2020-09-08T15:24:14.392 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes": 48300, 2020-09-08T15:24:14.392 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects": 100, 2020-09-08T15:24:14.392 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_clones": 0, 2020-09-08T15:24:14.392 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_copies": 300, 2020-09-08T15:24:14.393 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing_on_primary": 0, 2020-09-08T15:24:14.393 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing": 0, 2020-09-08T15:24:14.393 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_degraded": 100, 2020-09-08T15:24:14.393 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_misplaced": 0, 2020-09-08T15:24:14.393 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_unfound": 0, 2020-09-08T15:24:14.394 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_dirty": 100, 2020-09-08T15:24:14.394 INFO:tasks.workunit.client.0.smithi065.stdout: "num_whiteouts": 0, 2020-09-08T15:24:14.394 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read": 0, 2020-09-08T15:24:14.394 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read_kb": 0, 2020-09-08T15:24:14.394 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write": 100, 2020-09-08T15:24:14.395 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write_kb": 100, 2020-09-08T15:24:14.395 INFO:tasks.workunit.client.0.smithi065.stdout: "num_scrub_errors": 0, 2020-09-08T15:24:14.395 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shallow_scrub_errors": 0, 2020-09-08T15:24:14.395 INFO:tasks.workunit.client.0.smithi065.stdout: "num_deep_scrub_errors": 0, 2020-09-08T15:24:14.395 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_recovered": 0, 2020-09-08T15:24:14.395 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_recovered": 0, 2020-09-08T15:24:14.396 INFO:tasks.workunit.client.0.smithi065.stdout: "num_keys_recovered": 0, 2020-09-08T15:24:14.396 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_omap": 0, 2020-09-08T15:24:14.396 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_hit_set_archive": 0, 2020-09-08T15:24:14.396 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_hit_set_archive": 0, 2020-09-08T15:24:14.396 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush": 0, 2020-09-08T15:24:14.397 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_kb": 0, 2020-09-08T15:24:14.397 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict": 0, 2020-09-08T15:24:14.397 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_kb": 0, 2020-09-08T15:24:14.397 INFO:tasks.workunit.client.0.smithi065.stdout: "num_promote": 0, 2020-09-08T15:24:14.397 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_high": 0, 2020-09-08T15:24:14.397 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_low": 0, 2020-09-08T15:24:14.398 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_some": 0, 2020-09-08T15:24:14.398 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_full": 0, 2020-09-08T15:24:14.398 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_pinned": 0, 2020-09-08T15:24:14.398 INFO:tasks.workunit.client.0.smithi065.stdout: "num_legacy_snapsets": 0, 2020-09-08T15:24:14.398 INFO:tasks.workunit.client.0.smithi065.stdout: "num_large_omap_objects": 0, 2020-09-08T15:24:14.399 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_manifest": 0, 2020-09-08T15:24:14.399 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_bytes": 0, 2020-09-08T15:24:14.399 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_keys": 0, 2020-09-08T15:24:14.399 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_repaired": 0 2020-09-08T15:24:14.399 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.399 INFO:tasks.workunit.client.0.smithi065.stdout: "store_stats": { 2020-09-08T15:24:14.400 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 0, 2020-09-08T15:24:14.400 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 0, 2020-09-08T15:24:14.400 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:24:14.400 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 1228800, 2020-09-08T15:24:14.400 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 144900, 2020-09-08T15:24:14.401 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:24:14.401 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:24:14.401 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:24:14.401 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 0, 2020-09-08T15:24:14.401 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 0 2020-09-08T15:24:14.401 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.402 INFO:tasks.workunit.client.0.smithi065.stdout: "log_size": 16, 2020-09-08T15:24:14.402 INFO:tasks.workunit.client.0.smithi065.stdout: "ondisk_log_size": 16, 2020-09-08T15:24:14.402 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 2, 2020-09-08T15:24:14.402 INFO:tasks.workunit.client.0.smithi065.stdout: "acting": 2, 2020-09-08T15:24:14.402 INFO:tasks.workunit.client.0.smithi065.stdout: "num_store_stats": 3 2020-09-08T15:24:14.403 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.403 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:24:14.403 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_stats": [ 2020-09-08T15:24:14.403 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.403 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:24:14.403 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 150323855370 2020-09-08T15:24:14.404 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.404 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.404 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:24:14.404 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 42949672978 2020-09-08T15:24:14.404 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.405 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.405 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:24:14.405 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 154618822666 2020-09-08T15:24:14.405 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.405 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:24:14.405 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_by_state": [ 2020-09-08T15:24:14.406 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.406 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "active+undersized+degraded", 2020-09-08T15:24:14.406 INFO:tasks.workunit.client.0.smithi065.stdout: "num": 1 2020-09-08T15:24:14.406 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.406 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:24:14.407 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_by_osd": [ 2020-09-08T15:24:14.407 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.407 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:24:14.407 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 0, 2020-09-08T15:24:14.407 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 1, 2020-09-08T15:24:14.407 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:24:14.408 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.408 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.408 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:24:14.408 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 0, 2020-09-08T15:24:14.408 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 0, 2020-09-08T15:24:14.409 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:24:14.409 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.409 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.409 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:24:14.409 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 1, 2020-09-08T15:24:14.410 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 1, 2020-09-08T15:24:14.410 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:24:14.410 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.410 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:24:14.410 INFO:tasks.workunit.client.0.smithi065.stdout: "purged_snaps": [ 2020-09-08T15:24:14.410 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:24:14.411 INFO:tasks.workunit.client.0.smithi065.stdout: "pool": 1, 2020-09-08T15:24:14.411 INFO:tasks.workunit.client.0.smithi065.stdout: "purged_snaps": {} 2020-09-08T15:24:14.411 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.411 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:24:14.411 INFO:tasks.workunit.client.0.smithi065.stdout: "servicemap": { 2020-09-08T15:24:14.412 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 4, 2020-09-08T15:24:14.412 INFO:tasks.workunit.client.0.smithi065.stdout: "modified": "2020-09-08T15:23:33.322979+0000", 2020-09-08T15:24:14.412 INFO:tasks.workunit.client.0.smithi065.stdout: "services": { 2020-09-08T15:24:14.412 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": { 2020-09-08T15:24:14.412 INFO:tasks.workunit.client.0.smithi065.stdout: "daemons": { 2020-09-08T15:24:14.412 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": "", 2020-09-08T15:24:14.413 INFO:tasks.workunit.client.0.smithi065.stdout: "2": { 2020-09-08T15:24:14.413 INFO:tasks.workunit.client.0.smithi065.stdout: "start_epoch": 0, 2020-09-08T15:24:14.413 INFO:tasks.workunit.client.0.smithi065.stdout: "start_stamp": "0.000000", 2020-09-08T15:24:14.413 INFO:tasks.workunit.client.0.smithi065.stdout: "gid": 0, 2020-09-08T15:24:14.413 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "(unrecognized address family 0)/0", 2020-09-08T15:24:14.414 INFO:tasks.workunit.client.0.smithi065.stdout: "metadata": {}, 2020-09-08T15:24:14.414 INFO:tasks.workunit.client.0.smithi065.stdout: "task_status": {} 2020-09-08T15:24:14.414 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.414 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.414 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.414 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.415 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:24:14.415 INFO:tasks.workunit.client.0.smithi065.stdout: "paxos": { 2020-09-08T15:24:14.415 INFO:tasks.workunit.client.0.smithi065.stdout: "first_committed": 1, 2020-09-08T15:24:14.415 INFO:tasks.workunit.client.0.smithi065.stdout: "last_committed": 364, 2020-09-08T15:24:14.415 INFO:tasks.workunit.client.0.smithi065.stdout: "last_pn": 0, 2020-09-08T15:24:14.416 INFO:tasks.workunit.client.0.smithi065.stdout: "accepted_pn": 0 2020-09-08T15:24:14.416 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:24:14.416 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:24:14.417 INFO:tasks.workunit.client.0.smithi065.stderr:report 1326325480 2020-09-08T15:24:14.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1604: wait_for_clean: return 1 2020-09-08T15:24:14.418 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:153: TEST_divergent: expr 2 + 2 2020-09-08T15:24:14.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:153: TEST_divergent: objname=existing_4 2020-09-08T15:24:14.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: echo 'writing non-divergent object existing_4' 2020-09-08T15:24:14.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:155: TEST_divergent: ceph pg dump pgs 2020-09-08T15:24:14.418 INFO:tasks.workunit.client.0.smithi065.stdout:writing non-divergent object existing_4 2020-09-08T15:24:14.577 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:24:14.577 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 0 100 0 0 48300 0 0 16 16 active+undersized+degraded 2020-09-08T15:23:38.038791+0000 29'100 39:120 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:22:42.389382+0000 0'0 2020-09-08T15:22:42.389382+0000 0 2020-09-08T15:24:14.578 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:24:14.578 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:24:14.579 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:24:14.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:156: TEST_divergent: rados -p test put existing_4 /etc/resolv.conf 2020-09-08T15:24:14.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: echo 'delay recovery' 2020-09-08T15:24:14.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:160: TEST_divergent: ceph pg dump pgs 2020-09-08T15:24:14.780 INFO:tasks.workunit.client.0.smithi065.stdout:delay recovery 2020-09-08T15:24:15.157 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:24:15.157 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 0 100 0 0 48300 0 0 16 16 active+undersized+degraded 2020-09-08T15:23:38.038791+0000 29'100 39:120 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:22:42.389382+0000 0'0 2020-09-08T15:22:42.389382+0000 0 2020-09-08T15:24:15.157 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:24:15.158 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:24:15.158 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:24:15.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: for i in $non_divergent 2020-09-08T15:24:15.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:163: TEST_divergent: get_asok_path osd.0 2020-09-08T15:24:15.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-09-08T15:24:15.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-09-08T15:24:15.168 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:24:15.169 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:24:15.169 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:24:15.169 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.0.asok 2020-09-08T15:24:15.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:163: TEST_divergent: CEPH_ARGS= 2020-09-08T15:24:15.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:163: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.0.asok set_recovery_delay 100000 2020-09-08T15:24:15.264 INFO:tasks.workunit.client.0.smithi065.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2020-09-08T15:24:15.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: for i in $non_divergent 2020-09-08T15:24:15.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:163: TEST_divergent: get_asok_path osd.2 2020-09-08T15:24:15.273 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-09-08T15:24:15.273 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-09-08T15:24:15.273 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:24:15.273 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:24:15.274 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:24:15.274 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.2.asok 2020-09-08T15:24:15.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:163: TEST_divergent: CEPH_ARGS= 2020-09-08T15:24:15.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:163: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.2.asok set_recovery_delay 100000 2020-09-08T15:24:15.369 INFO:tasks.workunit.client.0.smithi065.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2020-09-08T15:24:15.376 INFO:tasks.workunit.client.0.smithi065.stdout:revive divergent 1 2020-09-08T15:24:15.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:167: TEST_divergent: echo 'revive divergent 1' 2020-09-08T15:24:15.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:168: TEST_divergent: ceph pg dump pgs 2020-09-08T15:24:15.750 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:24:15.750 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 0 100 0 0 48300 0 0 16 16 active+undersized+degraded 2020-09-08T15:23:38.038791+0000 29'100 39:120 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:22:42.389382+0000 0'0 2020-09-08T15:22:42.389382+0000 0 2020-09-08T15:24:15.751 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:24:15.751 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:24:15.751 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:24:15.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:169: TEST_divergent: ceph osd set noup 2020-09-08T15:24:16.475 INFO:tasks.workunit.client.0.smithi065.stderr:noup is set 2020-09-08T15:24:16.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:170: TEST_divergent: activate_osd td/divergent-priors 1 2020-09-08T15:24:16.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/divergent-priors 2020-09-08T15:24:16.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:24:16.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=1 2020-09-08T15:24:16.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:24:16.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/divergent-priors/1 2020-09-08T15:24:16.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:24:16.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:24:16.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:24:16.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:24:16.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2020-09-08T15:24:16.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2020-09-08T15:24:16.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:24:16.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:24:16.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:24:16.489 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:24:16.489 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:24:16.490 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:24:16.490 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:24:16.490 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:24:16.490 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:24:16.490 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:24:16.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:24:16.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:24:16.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:24:16.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:24:16.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:24:16.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:24:16.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:24:16.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:24:16.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:24:16.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/divergent-priors/1 2020-09-08T15:24:16.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.1 2020-09-08T15:24:16.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 1 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:24:16.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/divergent-priors/1/whoami 2020-09-08T15:24:16.493 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:24:16.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 1 = 1 ']' 2020-09-08T15:24:16.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:24:16.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:24:16.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:24:16.517 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:24:16.519+0000 7efc61331ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:24:16.556 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:24:16.560+0000 7efc61331ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:24:16.556 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:24:16.561+0000 7efc61331ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:24:16.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:877: activate_osd: return 0 2020-09-08T15:24:16.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:171: TEST_divergent: sleep 5 2020-09-08T15:24:17.072 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:24:17.077+0000 7efc61331ec0 -1 Falling back to public interface 2020-09-08T15:24:18.436 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:24:18.441+0000 7efc61331ec0 -1 osd.1 29 log_to_monitors {default=true} 2020-09-08T15:24:21.894 INFO:tasks.workunit.client.0.smithi065.stdout:delay recovery divergent 2020-09-08T15:24:21.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: echo 'delay recovery divergent' 2020-09-08T15:24:21.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:174: TEST_divergent: ceph pg dump pgs 2020-09-08T15:24:22.284 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:24:22.284 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 0 100 0 0 47947 0 0 17 17 active+undersized+degraded 2020-09-08T15:23:38.038791+0000 39'101 39:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:22:42.389382+0000 0'0 2020-09-08T15:22:42.389382+0000 0 2020-09-08T15:24:22.284 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:24:22.285 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:24:22.285 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:24:22.295 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:175: TEST_divergent: get_asok_path osd.1 2020-09-08T15:24:22.295 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-09-08T15:24:22.295 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-09-08T15:24:22.295 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:24:22.296 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:24:22.296 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:24:22.296 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.1.asok 2020-09-08T15:24:22.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:175: TEST_divergent: CEPH_ARGS= 2020-09-08T15:24:22.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:175: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.1.asok set_recovery_delay 100000 2020-09-08T15:24:22.392 INFO:tasks.workunit.client.0.smithi065.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2020-09-08T15:24:22.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:177: TEST_divergent: ceph osd unset noup 2020-09-08T15:24:23.183 INFO:tasks.workunit.client.0.smithi065.stderr:noup is unset 2020-09-08T15:24:23.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:179: TEST_divergent: wait_for_osd up 0 2020-09-08T15:24:23.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:24:23.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:24:23.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:24:23.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:24:23.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:24:23.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:24:23.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:24:23.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:24:23.196 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:24:23.605 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 35 up_thru 38 down_at 30 last_clean_interval [5,29) [v2:127.0.0.1:6802/37437,v1:127.0.0.1:6803/37437] [v2:127.0.0.1:6804/37437,v1:127.0.0.1:6805/37437] exists,up 0995576a-0b47-4a00-b362-285884219bcc 2020-09-08T15:24:23.605 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:24:23.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:24:23.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:24:23.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:24:23.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:180: TEST_divergent: wait_for_osd up 1 2020-09-08T15:24:23.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:24:23.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:24:23.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:24:23.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:24:23.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:24:23.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:24:23.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:24:23.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:24:24.060 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 43 up_thru 43 down_at 31 last_clean_interval [10,29) [v2:127.0.0.1:6818/39395,v1:127.0.0.1:6819/39395] [v2:127.0.0.1:6820/39395,v1:127.0.0.1:6821/39395] exists,up a4e3c598-4840-46b3-b4f8-a70df3240520 2020-09-08T15:24:24.060 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:24:24.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:24:24.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:24:24.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:24:24.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:181: TEST_divergent: wait_for_osd up 2 2020-09-08T15:24:24.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:24:24.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:24:24.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:24:24.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:24:24.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:24:24.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:24:24.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:24:24.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:24:24.455 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 36 up_thru 0 down_at 32 last_clean_interval [15,29) [v2:127.0.0.1:6810/37836,v1:127.0.0.1:6811/37836] [v2:127.0.0.1:6812/37836,v1:127.0.0.1:6813/37836] exists,up ba9a9e7f-9bc8-4e25-8fb1-8c4ab677561a 2020-09-08T15:24:24.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:24:24.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:24:24.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:24:24.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:183: TEST_divergent: ceph pg dump pgs 2020-09-08T15:24:24.831 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:24:24.831 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 0 0 0 0 48300 0 0 17 17 peering 2020-09-08T15:24:23.277142+0000 29'101 43:124 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:22:42.389382+0000 0'0 2020-09-08T15:22:42.389382+0000 0 2020-09-08T15:24:24.832 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:24:24.832 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:24:24.833 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:24:24.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:184: TEST_divergent: echo 'wait for peering' 2020-09-08T15:24:24.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:185: TEST_divergent: ceph pg dump pgs 2020-09-08T15:24:24.842 INFO:tasks.workunit.client.0.smithi065.stdout:wait for peering 2020-09-08T15:24:25.216 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:24:25.217 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 0 0 0 0 48300 0 0 17 17 peering 2020-09-08T15:24:23.277142+0000 29'101 43:124 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:22:42.389382+0000 0'0 2020-09-08T15:22:42.389382+0000 0 2020-09-08T15:24:25.217 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:24:25.217 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:24:25.218 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:24:25.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:186: TEST_divergent: rados -p test put foo /etc/fstab 2020-09-08T15:24:34.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:188: TEST_divergent: echo 'killing divergent 1' 2020-09-08T15:24:34.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:189: TEST_divergent: ceph pg dump pgs 2020-09-08T15:24:34.174 INFO:tasks.workunit.client.0.smithi065.stdout:killing divergent 1 2020-09-08T15:24:34.556 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:24:34.557 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 2 2 0 0 47947 0 0 17 17 active+recovering+degraded+wait 2020-09-08T15:24:23.920361+0000 39'101 44:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:22:42.389382+0000 0'0 2020-09-08T15:22:42.389382+0000 0 2020-09-08T15:24:34.557 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:24:34.557 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:24:34.558 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:24:34.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:190: TEST_divergent: kill_daemons td/divergent-priors KILL osd.1 2020-09-08T15:24:34.567 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:24:34.567 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:24:34.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:24:34.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:24:34.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:24:34.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:24:34.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:192: TEST_divergent: echo 'reviving divergent 1' 2020-09-08T15:24:34.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:193: TEST_divergent: ceph pg dump pgs 2020-09-08T15:24:34.674 INFO:tasks.workunit.client.0.smithi065.stdout:reviving divergent 1 2020-09-08T15:24:35.049 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:24:35.049 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 2 2 0 0 47947 0 0 17 17 active+recovering+degraded+wait 2020-09-08T15:24:23.920361+0000 39'101 44:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:22:42.389382+0000 0'0 2020-09-08T15:22:42.389382+0000 0 2020-09-08T15:24:35.049 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:24:35.050 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:24:35.050 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:24:35.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:194: TEST_divergent: activate_osd td/divergent-priors 1 2020-09-08T15:24:35.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/divergent-priors 2020-09-08T15:24:35.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:24:35.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=1 2020-09-08T15:24:35.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:24:35.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/divergent-priors/1 2020-09-08T15:24:35.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:24:35.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:24:35.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:24:35.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:24:35.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2020-09-08T15:24:35.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2020-09-08T15:24:35.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:24:35.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:24:35.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:24:35.065 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:24:35.065 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:24:35.065 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:24:35.065 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:24:35.066 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:24:35.066 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:24:35.066 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:24:35.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:24:35.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:24:35.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:24:35.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:24:35.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:24:35.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:24:35.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:24:35.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:24:35.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:24:35.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/divergent-priors/1 2020-09-08T15:24:35.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.1 2020-09-08T15:24:35.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 1 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:24:35.068 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/divergent-priors/1/whoami 2020-09-08T15:24:35.069 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:24:35.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 1 = 1 ']' 2020-09-08T15:24:35.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:24:35.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:24:35.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:24:35.090 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:24:35.095+0000 7fe86b5b9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:24:35.092 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:24:35.097+0000 7fe86b5b9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:24:35.093 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:24:35.098+0000 7fe86b5b9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:24:35.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 1 2020-09-08T15:24:35.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:24:35.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:24:35.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:24:35.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:24:35.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:24:35.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:24:35.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:24:35.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:24:35.463 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:24:35.609 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:24:35.614+0000 7fe86b5b9ec0 -1 Falling back to public interface 2020-09-08T15:24:35.982 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 43 up_thru 43 down_at 31 last_clean_interval [10,29) [v2:127.0.0.1:6818/39395,v1:127.0.0.1:6819/39395] [v2:127.0.0.1:6820/39395,v1:127.0.0.1:6821/39395] exists,up a4e3c598-4840-46b3-b4f8-a70df3240520 2020-09-08T15:24:35.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:24:35.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:24:35.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:24:35.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:196: TEST_divergent: sleep 20 2020-09-08T15:24:36.740 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:24:36.745+0000 7fe86b5b9ec0 -1 osd.1 44 log_to_monitors {default=true} 2020-09-08T15:24:55.882 INFO:tasks.workunit.client.0.smithi065.stdout:allowing recovery 2020-09-08T15:24:55.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:198: TEST_divergent: echo 'allowing recovery' 2020-09-08T15:24:55.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: ceph pg dump pgs 2020-09-08T15:24:56.270 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:24:56.270 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 101 0 0 0 0 48430 0 0 18 18 active+clean 2020-09-08T15:24:38.332444+0000 44'102 48:151 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:22:42.389382+0000 0'0 2020-09-08T15:22:42.389382+0000 0 2020-09-08T15:24:56.271 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:24:56.271 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:24:56.272 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:24:56.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: for i in $osds 2020-09-08T15:24:56.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:203: TEST_divergent: ceph tell osd.0 debug kick_recovery_wq 0 2020-09-08T15:24:56.407 INFO:tasks.workunit.client.0.smithi065.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2020-09-08T15:24:56.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: for i in $osds 2020-09-08T15:24:56.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:203: TEST_divergent: ceph tell osd.1 debug kick_recovery_wq 0 2020-09-08T15:24:56.541 INFO:tasks.workunit.client.0.smithi065.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2020-09-08T15:24:56.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: for i in $osds 2020-09-08T15:24:56.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:203: TEST_divergent: ceph tell osd.2 debug kick_recovery_wq 0 2020-09-08T15:24:56.676 INFO:tasks.workunit.client.0.smithi065.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2020-09-08T15:24:56.684 INFO:tasks.workunit.client.0.smithi065.stdout:reading divergent objects 2020-09-08T15:24:56.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: echo 'reading divergent objects' 2020-09-08T15:24:56.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:207: TEST_divergent: ceph pg dump pgs 2020-09-08T15:24:57.060 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:24:57.061 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 101 0 0 0 0 48430 0 0 18 18 active+clean 2020-09-08T15:24:38.332444+0000 44'102 48:151 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:22:42.389382+0000 0'0 2020-09-08T15:22:42.389382+0000 0 2020-09-08T15:24:57.061 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:24:57.061 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:24:57.062 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:24:57.070 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: expr 2 + 2 2020-09-08T15:24:57.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: seq 1 4 2020-09-08T15:24:57.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2020-09-08T15:24:57.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:210: TEST_divergent: rados -p test get existing_1 td/divergent-priors/existing 2020-09-08T15:24:57.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2020-09-08T15:24:57.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:210: TEST_divergent: rados -p test get existing_2 td/divergent-priors/existing 2020-09-08T15:24:57.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2020-09-08T15:24:57.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:210: TEST_divergent: rados -p test get existing_3 td/divergent-priors/existing 2020-09-08T15:24:57.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2020-09-08T15:24:57.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:210: TEST_divergent: rados -p test get existing_4 td/divergent-priors/existing 2020-09-08T15:24:57.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: rm -f td/divergent-priors/existing 2020-09-08T15:24:57.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: find td/divergent-priors -name '*osd*log' 2020-09-08T15:24:57.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2020-09-08T15:24:57.224 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:24:23.833+0000 7efc3ec6c700 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 29'101 (29'100) modify 1:c156033e:::existing_100:head by client.4528.0:1 2020-09-08T15:23:17.437727+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:24:57.225 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:24:23.833+0000 7efc3ec6c700 20 _merge_object_divergent_entries: keeping 29'101 (29'100) modify 1:c156033e:::existing_100:head by client.4528.0:1 2020-09-08T15:23:17.437727+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:24:57.225 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:24:23.833+0000 7efc3ec6c700 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2020-09-08T15:24:57.225 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:24:23.833+0000 7efc3ec6c700 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 29'100 first_divergent_update: 29'101 last_divergent_update: 29'101 2020-09-08T15:24:57.225 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:24:23.833+0000 7efc3ec6c700 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2020-09-08T15:24:57.228 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:24:23.833+0000 7efc3ec6c700 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2020-09-08T15:24:57.228 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:24:23.833+0000 7efc3ec6c700 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 29'101 2020-09-08T15:24:57.229 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:24:23.833+0000 7efc3ec6c700 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 29'101 (29'100) modify 1:c156033e:::existing_100:head by client.4528.0:1 2020-09-08T15:23:17.437727+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:24:57.229 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:24:23.833+0000 7efc3ec6c700 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2020-09-08T15:24:57.229 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:216: TEST_divergent: find td/divergent-priors -name '*osd*log' 2020-09-08T15:24:57.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:216: TEST_divergent: grep -q '_merge_object_divergent_entries.*cannot roll back, removing and adding to missing' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2020-09-08T15:24:57.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:221: TEST_divergent: echo success 2020-09-08T15:24:57.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:223: TEST_divergent: delete_pool test 2020-09-08T15:24:57.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test 2020-09-08T15:24:57.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2020-09-08T15:24:57.233 INFO:tasks.workunit.client.0.smithi065.stdout:success 2020-09-08T15:24:57.822 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' does not exist 2020-09-08T15:24:57.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:224: TEST_divergent: kill_daemons td/divergent-priors 2020-09-08T15:24:57.830 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:24:57.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:24:57.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:24:57.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:24:57.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:24:57.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:24:57.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2020-09-08T15:24:57.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/divergent-priors 2020-09-08T15:24:57.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:24:57.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/divergent-priors KILL 2020-09-08T15:24:57.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:24:57.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:24:57.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:24:57.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:24:57.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:24:57.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:24:57.943 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:24:57.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:24:57.946 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:24:57.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:24:57.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:24:57.947 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:24:57.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:24:57.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:24:57.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:24:57.949 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:24:57.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:24:57.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:24:57.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/divergent-priors 2020-09-08T15:24:57.959 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:24:57.959 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:24:57.959 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:24:57.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30667 2020-09-08T15:24:57.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:24:57.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:24:57.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2020-09-08T15:24:57.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2020-09-08T15:24:57.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/divergent-priors 2020-09-08T15:24:57.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/divergent-priors 2020-09-08T15:24:57.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/divergent-priors 2020-09-08T15:24:57.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:24:57.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/divergent-priors KILL 2020-09-08T15:24:57.964 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:24:57.964 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:24:57.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:24:57.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:24:57.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:24:57.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:24:57.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:24:57.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:24:57.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:24:57.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:24:57.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:24:57.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:24:57.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:24:57.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:24:57.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:24:57.969 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:24:57.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:24:57.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:24:57.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/divergent-priors 2020-09-08T15:24:57.970 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:24:57.971 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:24:57.971 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:24:57.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30667 2020-09-08T15:24:57.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:24:57.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:24:57.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/divergent-priors 2020-09-08T15:24:57.974 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T15:24:57.974 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:24:57.975 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:24:57.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.30667 2020-09-08T15:24:57.975 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T15:24:57.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T15:24:57.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T15:24:57.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2020-09-08T15:24:57.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_2 td/divergent-priors 2020-09-08T15:24:57.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:421: TEST_divergent_2: local dir=td/divergent-priors 2020-09-08T15:24:57.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: local dummyfile=/etc/fstab 2020-09-08T15:24:57.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:425: TEST_divergent_2: local dummyfile2=/etc/resolv.conf 2020-09-08T15:24:57.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:427: TEST_divergent_2: local num_osds=3 2020-09-08T15:24:57.977 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:428: TEST_divergent_2: expr 3 - 1 2020-09-08T15:24:57.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:428: TEST_divergent_2: seq 0 2 2020-09-08T15:24:57.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:428: TEST_divergent_2: local 'osds=0 2020-09-08T15:24:57.979 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:24:57.979 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:24:57.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: run_mon td/divergent-priors a 2020-09-08T15:24:57.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/divergent-priors 2020-09-08T15:24:57.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T15:24:57.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T15:24:57.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T15:24:57.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/divergent-priors/a 2020-09-08T15:24:57.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2020-09-08T15:24:58.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T15:24:58.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:24:58.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:24:58.323 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:24:58.324 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:24:58.324 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:24:58.324 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:24:58.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T15:24:58.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T15:24:58.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T15:24:58.516 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:24:58.526 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:24:58.526 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T15:24:58.526 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T15:24:58.526 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:24:58.527 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:24:58.527 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:24:58.527 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:24:58.527 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:24:58.528 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:24:58.528 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-mon.a.asok 2020-09-08T15:24:58.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:24:58.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30667/ceph-mon.a.asok config get fsid 2020-09-08T15:24:58.609 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T15:24:58.609 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:24:58.609 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:24:58.610 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T15:24:58.610 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T15:24:58.610 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:24:58.610 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:24:58.610 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:24:58.611 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:24:58.612 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:24:58.612 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:24:58.612 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-mon.a.asok 2020-09-08T15:24:58.612 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:24:58.612 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30667/ceph-mon.a.asok config get mon_host 2020-09-08T15:24:58.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:430: TEST_divergent_2: run_mgr td/divergent-priors x 2020-09-08T15:24:58.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/divergent-priors 2020-09-08T15:24:58.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T15:24:58.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T15:24:58.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T15:24:58.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/divergent-priors/x 2020-09-08T15:24:58.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T15:24:59.611 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T15:24:59.611 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:24:59.612 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:24:59.612 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:24:59.613 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:24:59.613 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:24:59.613 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:24:59.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:24:59.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:24:59.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:431: TEST_divergent_2: for i in $osds 2020-09-08T15:24:59.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:433: TEST_divergent_2: run_osd td/divergent-priors 0 2020-09-08T15:24:59.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/divergent-priors 2020-09-08T15:24:59.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:24:59.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T15:24:59.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:24:59.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/divergent-priors/0 2020-09-08T15:24:59.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:24:59.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:24:59.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:24:59.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:24:59.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2020-09-08T15:24:59.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2020-09-08T15:24:59.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:24:59.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:24:59.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:24:59.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:24:59.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:24:59.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:24:59.650 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:24:59.650 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:24:59.650 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:24:59.650 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:24:59.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:24:59.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:24:59.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:24:59.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:24:59.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:24:59.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:24:59.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:24:59.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:24:59.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:24:59.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:24:59.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:24:59.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/divergent-priors/0 2020-09-08T15:24:59.654 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:24:59.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=dc78991d-f410-4ef4-a45b-5573679ca87b 2020-09-08T15:24:59.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 dc78991d-f410-4ef4-a45b-5573679ca87b' 2020-09-08T15:24:59.654 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:24:59.654 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 dc78991d-f410-4ef4-a45b-5573679ca87b 2020-09-08T15:24:59.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBLoldfi+XHJxAAYF2kxBKsrTs2xDHl6E3qJQ== 2020-09-08T15:24:59.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBLoldfi+XHJxAAYF2kxBKsrTs2xDHl6E3qJQ=="}' 2020-09-08T15:24:59.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new dc78991d-f410-4ef4-a45b-5573679ca87b -i td/divergent-priors/0/new.json 2020-09-08T15:25:00.025 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:25:00.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/divergent-priors/0/new.json 2020-09-08T15:25:00.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBLoldfi+XHJxAAYF2kxBKsrTs2xDHl6E3qJQ== --osd-uuid dc78991d-f410-4ef4-a45b-5573679ca87b 2020-09-08T15:25:00.066 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:00.071+0000 7fee56691ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:25:00.068 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:00.073+0000 7fee56691ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:25:00.069 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:00.074+0000 7fee56691ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:25:00.070 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:00.075+0000 7fee56691ec0 -1 bluestore(td/divergent-priors/0/block) _read_bdev_label failed to open td/divergent-priors/0/block: (2) No such file or directory 2020-09-08T15:25:00.070 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:00.075+0000 7fee56691ec0 -1 bluestore(td/divergent-priors/0/block) _read_bdev_label failed to open td/divergent-priors/0/block: (2) No such file or directory 2020-09-08T15:25:00.070 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:00.075+0000 7fee56691ec0 -1 bluestore(td/divergent-priors/0/block) _read_bdev_label failed to open td/divergent-priors/0/block: (2) No such file or directory 2020-09-08T15:25:00.105 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:00.110+0000 7fee56691ec0 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2020-09-08T15:25:04.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/divergent-priors/0/keyring 2020-09-08T15:25:04.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:25:04.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T15:25:04.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:25:04.584 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T15:25:05.128 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T15:25:05.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T15:25:05.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:25:05.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:25:05.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:25:05.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:25:05.157 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:05.162+0000 7f26a357dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:25:05.161 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:05.165+0000 7f26a357dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:25:05.161 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:05.166+0000 7f26a357dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:25:05.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T15:25:05.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:25:05.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:25:05.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:25:05.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:25:05.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:25:05.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:25:05.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:25:05.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:25:05.533 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:25:05.677 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:05.682+0000 7f26a357dec0 -1 Falling back to public interface 2020-09-08T15:25:05.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:25:06.482 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:06.482+0000 7f26a357dec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T15:25:06.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:25:06.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:25:06.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:25:06.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:25:06.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:25:06.946 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:25:07.342 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/41501,v1:127.0.0.1:6803/41501] [v2:127.0.0.1:6804/41501,v1:127.0.0.1:6805/41501] exists,up dc78991d-f410-4ef4-a45b-5573679ca87b 2020-09-08T15:25:07.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:25:07.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:25:07.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:25:07.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:431: TEST_divergent_2: for i in $osds 2020-09-08T15:25:07.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:433: TEST_divergent_2: run_osd td/divergent-priors 1 2020-09-08T15:25:07.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/divergent-priors 2020-09-08T15:25:07.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:25:07.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T15:25:07.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:25:07.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/divergent-priors/1 2020-09-08T15:25:07.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:25:07.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:25:07.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:25:07.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:25:07.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2020-09-08T15:25:07.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2020-09-08T15:25:07.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:25:07.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:25:07.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:25:07.346 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:25:07.346 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:25:07.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:25:07.347 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:25:07.347 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:25:07.347 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:25:07.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:25:07.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:25:07.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:25:07.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:25:07.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:25:07.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:25:07.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:25:07.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:25:07.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:25:07.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:25:07.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:25:07.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:25:07.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/divergent-priors/1 2020-09-08T15:25:07.350 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:25:07.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=0a291c9f-6efd-44cb-baaf-35b800dc7866 2020-09-08T15:25:07.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 0a291c9f-6efd-44cb-baaf-35b800dc7866' 2020-09-08T15:25:07.352 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:25:07.352 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 0a291c9f-6efd-44cb-baaf-35b800dc7866 2020-09-08T15:25:07.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBToldf8d/hFRAAkgL8ScAOEtanZ/+a9SWIfg== 2020-09-08T15:25:07.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBToldf8d/hFRAAkgL8ScAOEtanZ/+a9SWIfg=="}' 2020-09-08T15:25:07.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 0a291c9f-6efd-44cb-baaf-35b800dc7866 -i td/divergent-priors/1/new.json 2020-09-08T15:25:07.875 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:25:07.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/divergent-priors/1/new.json 2020-09-08T15:25:07.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBToldf8d/hFRAAkgL8ScAOEtanZ/+a9SWIfg== --osd-uuid 0a291c9f-6efd-44cb-baaf-35b800dc7866 2020-09-08T15:25:07.918 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:07.922+0000 7f1a03974ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:25:07.918 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:07.923+0000 7f1a03974ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:25:07.919 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:07.924+0000 7f1a03974ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:25:07.920 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:07.925+0000 7f1a03974ec0 -1 bluestore(td/divergent-priors/1/block) _read_bdev_label failed to open td/divergent-priors/1/block: (2) No such file or directory 2020-09-08T15:25:07.921 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:07.925+0000 7f1a03974ec0 -1 bluestore(td/divergent-priors/1/block) _read_bdev_label failed to open td/divergent-priors/1/block: (2) No such file or directory 2020-09-08T15:25:07.921 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:07.925+0000 7f1a03974ec0 -1 bluestore(td/divergent-priors/1/block) _read_bdev_label failed to open td/divergent-priors/1/block: (2) No such file or directory 2020-09-08T15:25:07.998 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:07.989+0000 7f1a03974ec0 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2020-09-08T15:25:12.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/divergent-priors/1/keyring 2020-09-08T15:25:12.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:25:12.531 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T15:25:12.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T15:25:12.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:25:13.069 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:25:13.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T15:25:13.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:25:13.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:25:13.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:25:13.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:25:13.098 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:13.102+0000 7f0e65104ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:25:13.130 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:13.128+0000 7f0e65104ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:25:13.131 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:13.129+0000 7f0e65104ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:25:13.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T15:25:13.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:25:13.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:25:13.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:25:13.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:25:13.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:25:13.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:25:13.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:25:13.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:25:13.503 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:25:13.644 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:13.648+0000 7f0e65104ec0 -1 Falling back to public interface 2020-09-08T15:25:13.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:25:14.464 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:14.467+0000 7f0e65104ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T15:25:14.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:25:14.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:25:14.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:25:14.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:25:14.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:25:14.946 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:25:15.350 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/42495,v1:127.0.0.1:6811/42495] [v2:127.0.0.1:6812/42495,v1:127.0.0.1:6813/42495] exists,up 0a291c9f-6efd-44cb-baaf-35b800dc7866 2020-09-08T15:25:15.350 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 1064be2f-cb2a-4046-8814-ce923b7aef68 2020-09-08T15:25:15.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:25:15.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:25:15.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:25:15.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:431: TEST_divergent_2: for i in $osds 2020-09-08T15:25:15.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:433: TEST_divergent_2: run_osd td/divergent-priors 2 2020-09-08T15:25:15.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/divergent-priors 2020-09-08T15:25:15.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:25:15.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T15:25:15.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:25:15.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/divergent-priors/2 2020-09-08T15:25:15.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:25:15.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:25:15.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:25:15.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:25:15.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2020-09-08T15:25:15.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2020-09-08T15:25:15.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:25:15.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:25:15.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:25:15.380 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:25:15.380 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:25:15.380 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:25:15.380 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:25:15.380 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:25:15.381 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:25:15.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:25:15.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:25:15.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:25:15.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:25:15.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:25:15.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:25:15.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:25:15.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:25:15.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:25:15.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:25:15.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:25:15.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:25:15.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/divergent-priors/2 2020-09-08T15:25:15.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:25:15.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=1064be2f-cb2a-4046-8814-ce923b7aef68 2020-09-08T15:25:15.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 1064be2f-cb2a-4046-8814-ce923b7aef68' 2020-09-08T15:25:15.389 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:25:15.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBboldfT75GFhAAuB58U3p+GrbTvlcrhEoWiw== 2020-09-08T15:25:15.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBboldfT75GFhAAuB58U3p+GrbTvlcrhEoWiw=="}' 2020-09-08T15:25:15.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 1064be2f-cb2a-4046-8814-ce923b7aef68 -i td/divergent-priors/2/new.json 2020-09-08T15:25:15.905 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T15:25:15.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/divergent-priors/2/new.json 2020-09-08T15:25:15.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBboldfT75GFhAAuB58U3p+GrbTvlcrhEoWiw== --osd-uuid 1064be2f-cb2a-4046-8814-ce923b7aef68 2020-09-08T15:25:15.947 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:15.951+0000 7fd1254b5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:25:15.948 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:15.953+0000 7fd1254b5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:25:15.950 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:15.954+0000 7fd1254b5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:25:15.950 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:15.954+0000 7fd1254b5ec0 -1 bluestore(td/divergent-priors/2/block) _read_bdev_label failed to open td/divergent-priors/2/block: (2) No such file or directory 2020-09-08T15:25:15.951 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:15.954+0000 7fd1254b5ec0 -1 bluestore(td/divergent-priors/2/block) _read_bdev_label failed to open td/divergent-priors/2/block: (2) No such file or directory 2020-09-08T15:25:15.951 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:15.954+0000 7fd1254b5ec0 -1 bluestore(td/divergent-priors/2/block) _read_bdev_label failed to open td/divergent-priors/2/block: (2) No such file or directory 2020-09-08T15:25:15.990 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:15.995+0000 7fd1254b5ec0 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2020-09-08T15:25:20.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/divergent-priors/2/keyring 2020-09-08T15:25:20.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:25:20.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T15:25:20.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:25:20.512 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T15:25:21.044 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T15:25:21.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T15:25:21.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:25:21.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:25:21.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:25:21.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:25:21.074 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:21.078+0000 7fe2a55b1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:25:21.075 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:21.080+0000 7fe2a55b1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:25:21.076 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:21.081+0000 7fe2a55b1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:25:21.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T15:25:21.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:25:21.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:25:21.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:25:21.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:25:21.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:25:21.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:25:21.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:25:21.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:25:21.468 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:25:21.603 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:21.607+0000 7fe2a55b1ec0 -1 Falling back to public interface 2020-09-08T15:25:21.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:25:22.413 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:25:22.417+0000 7fe2a55b1ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T15:25:22.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:25:22.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:25:22.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:25:22.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:25:22.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:25:22.884 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:25:23.283 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/43489,v1:127.0.0.1:6819/43489] [v2:127.0.0.1:6820/43489,v1:127.0.0.1:6821/43489] exists,up 1064be2f-cb2a-4046-8814-ce923b7aef68 2020-09-08T15:25:23.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:25:23.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:25:23.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:25:23.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:436: TEST_divergent_2: ceph osd set noout 2020-09-08T15:25:24.123 INFO:tasks.workunit.client.0.smithi065.stderr:noout is set 2020-09-08T15:25:24.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:437: TEST_divergent_2: ceph osd set noin 2020-09-08T15:25:24.834 INFO:tasks.workunit.client.0.smithi065.stderr:noin is set 2020-09-08T15:25:24.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:438: TEST_divergent_2: ceph osd set nodown 2020-09-08T15:25:25.544 INFO:tasks.workunit.client.0.smithi065.stderr:nodown is set 2020-09-08T15:25:25.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:439: TEST_divergent_2: create_pool test 1 1 2020-09-08T15:25:25.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test 1 1 2020-09-08T15:25:26.166 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' already exists 2020-09-08T15:25:26.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:25:27.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:440: TEST_divergent_2: ceph osd pool set test size 3 2020-09-08T15:25:27.935 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 3 2020-09-08T15:25:27.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:441: TEST_divergent_2: ceph osd pool set test min_size 2 2020-09-08T15:25:28.658 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 min_size to 2 2020-09-08T15:25:28.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:443: TEST_divergent_2: flush_pg_stats 2020-09-08T15:25:28.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:25:28.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:25:29.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:25:29.101 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:25:29.101 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:25:29.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:25:29.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:25:29.102 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:25:29.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836487 2020-09-08T15:25:29.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836487 2020-09-08T15:25:29.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836487' 2020-09-08T15:25:29.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:25:29.249 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:25:29.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672965 2020-09-08T15:25:29.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672965 2020-09-08T15:25:29.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836487 1-42949672965' 2020-09-08T15:25:29.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:25:29.408 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:25:29.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509444 2020-09-08T15:25:29.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509444 2020-09-08T15:25:29.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836487 1-42949672965 2-64424509444' 2020-09-08T15:25:29.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:25:29.548 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836487 2020-09-08T15:25:29.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:25:29.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:25:29.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836487 2020-09-08T15:25:29.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:25:29.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836487 2020-09-08T15:25:29.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2020-09-08T15:25:29.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:25:29.550 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836487 2020-09-08T15:25:29.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836487 -lt 21474836487 2020-09-08T15:25:29.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:25:29.941 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672965 2020-09-08T15:25:29.941 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:25:29.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:25:29.943 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672965 2020-09-08T15:25:29.943 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:25:29.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672965 2020-09-08T15:25:29.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672965' 2020-09-08T15:25:29.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:25:29.945 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672965 2020-09-08T15:25:30.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672963 -lt 42949672965 2020-09-08T15:25:30.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:25:31.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:25:31.378 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:25:31.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672966 -lt 42949672965 2020-09-08T15:25:31.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:25:31.791 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509444 2020-09-08T15:25:31.791 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:25:31.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:25:31.795 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509444 2020-09-08T15:25:31.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:25:31.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509444 2020-09-08T15:25:31.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509444' 2020-09-08T15:25:31.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:25:31.796 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509444 2020-09-08T15:25:32.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509444 -lt 64424509444 2020-09-08T15:25:32.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:444: TEST_divergent_2: wait_for_clean 2020-09-08T15:25:32.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:25:32.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:25:32.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:25:32.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:25:32.200 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T15:25:32.201 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:25:32.201 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:25:32.201 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:25:32.201 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:25:32.201 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:25:32.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:25:32.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:25:32.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:25:32.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:25:32.292 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:25:32.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:25:32.688 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:25:32.688 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:25:32.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:25:32.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:25:32.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:25:32.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836489 2020-09-08T15:25:32.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836489 2020-09-08T15:25:32.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836489' 2020-09-08T15:25:32.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:25:32.824 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:25:32.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672968 2020-09-08T15:25:32.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672968 2020-09-08T15:25:32.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836489 1-42949672968' 2020-09-08T15:25:32.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:25:32.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:25:33.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509446 2020-09-08T15:25:33.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509446 2020-09-08T15:25:33.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836489 1-42949672968 2-64424509446' 2020-09-08T15:25:33.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:25:33.102 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836489 2020-09-08T15:25:33.103 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:25:33.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:25:33.103 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836489 2020-09-08T15:25:33.104 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:25:33.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836489 2020-09-08T15:25:33.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836489' 2020-09-08T15:25:33.105 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:25:33.105 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836489 2020-09-08T15:25:33.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836490 -lt 21474836489 2020-09-08T15:25:33.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:25:33.527 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672968 2020-09-08T15:25:33.527 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:25:33.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:25:33.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672968 2020-09-08T15:25:33.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:25:33.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672968 2020-09-08T15:25:33.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672968' 2020-09-08T15:25:33.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:25:33.530 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672968 2020-09-08T15:25:33.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672968 -lt 42949672968 2020-09-08T15:25:33.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:25:33.941 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509446 2020-09-08T15:25:33.942 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:25:33.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:25:33.942 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509446 2020-09-08T15:25:33.943 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:25:33.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509446 2020-09-08T15:25:33.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509446' 2020-09-08T15:25:33.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:25:33.944 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509446 2020-09-08T15:25:34.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509446 -lt 64424509446 2020-09-08T15:25:34.339 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:25:34.340 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:25:34.340 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:25:34.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T15:25:34.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:25:34.864 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:25:34.864 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:25:34.864 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:25:34.864 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:25:34.865 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:25:34.865 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:25:35.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:25:35.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:25:35.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:25:35.256 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:25:35.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T15:25:35.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:25:35.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:25:35.798 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:447: TEST_divergent_2: ceph pg dump pgs --format=json 2020-09-08T15:25:35.798 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:447: TEST_divergent_2: jq '.pg_stats[0].up_primary' 2020-09-08T15:25:36.176 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:25:36.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:447: TEST_divergent_2: local divergent=1 2020-09-08T15:25:36.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: echo 'primary and soon to be divergent is 1' 2020-09-08T15:25:36.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:449: TEST_divergent_2: ceph pg dump pgs 2020-09-08T15:25:36.186 INFO:tasks.workunit.client.0.smithi065.stdout:primary and soon to be divergent is 1 2020-09-08T15:25:36.563 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:25:36.563 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:25:27.177727+0000 0'0 28:11 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:25:25.927857+0000 0'0 2020-09-08T15:25:25.927857+0000 0 2020-09-08T15:25:36.564 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:25:36.564 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:25:36.564 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:25:36.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:450: TEST_divergent_2: local non_divergent= 2020-09-08T15:25:36.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:451: TEST_divergent_2: for i in $osds 2020-09-08T15:25:36.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:453: TEST_divergent_2: '[' 0 = 1 ']' 2020-09-08T15:25:36.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:456: TEST_divergent_2: non_divergent=' 0' 2020-09-08T15:25:36.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:451: TEST_divergent_2: for i in $osds 2020-09-08T15:25:36.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:453: TEST_divergent_2: '[' 1 = 1 ']' 2020-09-08T15:25:36.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: continue 2020-09-08T15:25:36.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:451: TEST_divergent_2: for i in $osds 2020-09-08T15:25:36.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:453: TEST_divergent_2: '[' 2 = 1 ']' 2020-09-08T15:25:36.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:456: TEST_divergent_2: non_divergent=' 0 2' 2020-09-08T15:25:36.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:459: TEST_divergent_2: echo 'writing initial objects' 2020-09-08T15:25:36.595 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: seq 1 100 2020-09-08T15:25:36.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:36.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_1 /etc/fstab 2020-09-08T15:25:36.595 INFO:tasks.workunit.client.0.smithi065.stdout:writing initial objects 2020-09-08T15:25:36.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:36.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_2 /etc/fstab 2020-09-08T15:25:36.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:36.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_3 /etc/fstab 2020-09-08T15:25:37.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:37.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_4 /etc/fstab 2020-09-08T15:25:37.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:37.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_5 /etc/fstab 2020-09-08T15:25:37.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:37.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_6 /etc/fstab 2020-09-08T15:25:37.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:37.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_7 /etc/fstab 2020-09-08T15:25:37.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:37.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_8 /etc/fstab 2020-09-08T15:25:37.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:37.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_9 /etc/fstab 2020-09-08T15:25:37.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:37.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_10 /etc/fstab 2020-09-08T15:25:38.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:38.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_11 /etc/fstab 2020-09-08T15:25:38.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:38.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_12 /etc/fstab 2020-09-08T15:25:38.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:38.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_13 /etc/fstab 2020-09-08T15:25:38.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:38.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_14 /etc/fstab 2020-09-08T15:25:38.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:38.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_15 /etc/fstab 2020-09-08T15:25:38.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:38.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_16 /etc/fstab 2020-09-08T15:25:39.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:39.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_17 /etc/fstab 2020-09-08T15:25:39.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:39.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_18 /etc/fstab 2020-09-08T15:25:39.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:39.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_19 /etc/fstab 2020-09-08T15:25:39.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:39.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_20 /etc/fstab 2020-09-08T15:25:39.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:39.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_21 /etc/fstab 2020-09-08T15:25:39.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:39.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_22 /etc/fstab 2020-09-08T15:25:39.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:39.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_23 /etc/fstab 2020-09-08T15:25:40.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:40.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_24 /etc/fstab 2020-09-08T15:25:40.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:40.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_25 /etc/fstab 2020-09-08T15:25:40.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:40.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_26 /etc/fstab 2020-09-08T15:25:40.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:40.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_27 /etc/fstab 2020-09-08T15:25:40.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:40.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_28 /etc/fstab 2020-09-08T15:25:40.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:40.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_29 /etc/fstab 2020-09-08T15:25:41.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:41.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_30 /etc/fstab 2020-09-08T15:25:41.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:41.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_31 /etc/fstab 2020-09-08T15:25:41.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:41.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_32 /etc/fstab 2020-09-08T15:25:41.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:41.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_33 /etc/fstab 2020-09-08T15:25:41.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:41.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_34 /etc/fstab 2020-09-08T15:25:41.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:41.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_35 /etc/fstab 2020-09-08T15:25:41.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:41.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_36 /etc/fstab 2020-09-08T15:25:42.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:42.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_37 /etc/fstab 2020-09-08T15:25:42.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:42.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_38 /etc/fstab 2020-09-08T15:25:42.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:42.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_39 /etc/fstab 2020-09-08T15:25:42.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:42.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_40 /etc/fstab 2020-09-08T15:25:42.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:42.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_41 /etc/fstab 2020-09-08T15:25:42.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:42.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_42 /etc/fstab 2020-09-08T15:25:43.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:43.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_43 /etc/fstab 2020-09-08T15:25:43.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:43.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_44 /etc/fstab 2020-09-08T15:25:43.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:43.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_45 /etc/fstab 2020-09-08T15:25:43.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:43.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_46 /etc/fstab 2020-09-08T15:25:43.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:43.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_47 /etc/fstab 2020-09-08T15:25:43.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:43.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_48 /etc/fstab 2020-09-08T15:25:44.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:44.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_49 /etc/fstab 2020-09-08T15:25:44.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:44.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_50 /etc/fstab 2020-09-08T15:25:44.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:44.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_51 /etc/fstab 2020-09-08T15:25:44.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:44.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_52 /etc/fstab 2020-09-08T15:25:44.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:44.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_53 /etc/fstab 2020-09-08T15:25:44.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:44.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_54 /etc/fstab 2020-09-08T15:25:44.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:44.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_55 /etc/fstab 2020-09-08T15:25:45.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:45.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_56 /etc/fstab 2020-09-08T15:25:45.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:45.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_57 /etc/fstab 2020-09-08T15:25:45.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:45.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_58 /etc/fstab 2020-09-08T15:25:45.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:45.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_59 /etc/fstab 2020-09-08T15:25:45.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:45.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_60 /etc/fstab 2020-09-08T15:25:45.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:45.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_61 /etc/fstab 2020-09-08T15:25:45.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:45.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_62 /etc/fstab 2020-09-08T15:25:46.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:46.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_63 /etc/fstab 2020-09-08T15:25:46.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:46.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_64 /etc/fstab 2020-09-08T15:25:46.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:46.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_65 /etc/fstab 2020-09-08T15:25:46.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:46.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_66 /etc/fstab 2020-09-08T15:25:46.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:46.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_67 /etc/fstab 2020-09-08T15:25:47.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:47.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_68 /etc/fstab 2020-09-08T15:25:47.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:47.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_69 /etc/fstab 2020-09-08T15:25:47.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:47.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_70 /etc/fstab 2020-09-08T15:25:47.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:47.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_71 /etc/fstab 2020-09-08T15:25:47.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:47.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_72 /etc/fstab 2020-09-08T15:25:47.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:47.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_73 /etc/fstab 2020-09-08T15:25:47.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:47.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_74 /etc/fstab 2020-09-08T15:25:48.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:48.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_75 /etc/fstab 2020-09-08T15:25:48.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:48.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_76 /etc/fstab 2020-09-08T15:25:48.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:48.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_77 /etc/fstab 2020-09-08T15:25:48.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:48.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_78 /etc/fstab 2020-09-08T15:25:48.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:48.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_79 /etc/fstab 2020-09-08T15:25:48.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:48.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_80 /etc/fstab 2020-09-08T15:25:48.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:48.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_81 /etc/fstab 2020-09-08T15:25:49.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:49.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_82 /etc/fstab 2020-09-08T15:25:49.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:49.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_83 /etc/fstab 2020-09-08T15:25:49.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:49.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_84 /etc/fstab 2020-09-08T15:25:49.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:49.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_85 /etc/fstab 2020-09-08T15:25:49.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:49.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_86 /etc/fstab 2020-09-08T15:25:49.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:49.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_87 /etc/fstab 2020-09-08T15:25:50.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:50.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_88 /etc/fstab 2020-09-08T15:25:50.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:50.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_89 /etc/fstab 2020-09-08T15:25:50.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:50.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_90 /etc/fstab 2020-09-08T15:25:50.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:50.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_91 /etc/fstab 2020-09-08T15:25:50.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:50.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_92 /etc/fstab 2020-09-08T15:25:50.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:50.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_93 /etc/fstab 2020-09-08T15:25:50.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:50.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_94 /etc/fstab 2020-09-08T15:25:51.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:51.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_95 /etc/fstab 2020-09-08T15:25:51.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:51.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_96 /etc/fstab 2020-09-08T15:25:51.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:51.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_97 /etc/fstab 2020-09-08T15:25:51.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:51.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_98 /etc/fstab 2020-09-08T15:25:51.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:51.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_99 /etc/fstab 2020-09-08T15:25:51.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2020-09-08T15:25:51.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_100 /etc/fstab 2020-09-08T15:25:51.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:466: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2020-09-08T15:25:51.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:466: TEST_divergent_2: wait_for_clean 2020-09-08T15:25:51.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:25:51.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:25:51.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:25:51.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:25:51.999 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 20 .1 2020-09-08T15:25:52.000 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:25:52.000 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:25:52.000 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:25:52.000 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:25:52.000 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:25:52.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:25:52.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:25:52.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:25:52.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:25:52.053 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:25:52.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:25:52.449 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:25:52.450 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:25:52.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:25:52.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:25:52.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:25:52.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836495 2020-09-08T15:25:52.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836495 2020-09-08T15:25:52.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495' 2020-09-08T15:25:52.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:25:52.602 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:25:52.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672974 2020-09-08T15:25:52.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672974 2020-09-08T15:25:52.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495 1-42949672974' 2020-09-08T15:25:52.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:25:52.739 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:25:52.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509452 2020-09-08T15:25:52.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509452 2020-09-08T15:25:52.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495 1-42949672974 2-64424509452' 2020-09-08T15:25:52.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:25:52.874 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836495 2020-09-08T15:25:52.874 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:25:52.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:25:52.874 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836495 2020-09-08T15:25:52.875 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:25:52.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836495 2020-09-08T15:25:52.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836495' 2020-09-08T15:25:52.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:25:52.879 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836495 2020-09-08T15:25:53.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836493 -lt 21474836495 2020-09-08T15:25:53.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:25:54.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:25:54.275 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:25:54.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836496 -lt 21474836495 2020-09-08T15:25:54.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:25:54.683 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672974 2020-09-08T15:25:54.683 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:25:54.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:25:54.684 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672974 2020-09-08T15:25:54.684 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:25:54.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672974 2020-09-08T15:25:54.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672974' 2020-09-08T15:25:54.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:25:54.688 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672974 2020-09-08T15:25:55.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672974 -lt 42949672974 2020-09-08T15:25:55.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:25:55.107 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509452 2020-09-08T15:25:55.107 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:25:55.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:25:55.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509452 2020-09-08T15:25:55.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:25:55.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509452 2020-09-08T15:25:55.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509452' 2020-09-08T15:25:55.114 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:25:55.114 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509452 2020-09-08T15:25:55.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509453 -lt 64424509452 2020-09-08T15:25:55.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:25:55.512 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:25:55.512 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:25:56.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T15:25:56.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:25:56.054 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:25:56.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:25:56.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:25:56.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:25:56.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:25:56.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:25:56.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:25:56.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:25:56.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:25:56.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:25:56.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T15:25:56.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:25:56.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:25:56.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:468: TEST_divergent_2: get_pg test existing_1 2020-09-08T15:25:56.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1031: get_pg: local poolname=test 2020-09-08T15:25:56.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: local objectname=existing_1 2020-09-08T15:25:56.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: ceph --format json osd map test existing_1 2020-09-08T15:25:56.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: jq -r .pgid 2020-09-08T15:25:57.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:468: TEST_divergent_2: local pgid=1.0 2020-09-08T15:25:57.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:471: TEST_divergent_2: echo 'blackholing osds 0 2' 2020-09-08T15:25:57.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:472: TEST_divergent_2: ceph pg dump pgs 2020-09-08T15:25:57.371 INFO:tasks.workunit.client.0.smithi065.stdout:blackholing osds 0 2 2020-09-08T15:25:57.755 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:25:57.756 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 0 0 0 0 48300 0 0 16 16 active+clean 2020-09-08T15:25:27.177727+0000 29'100 29:111 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:25:25.927857+0000 0'0 2020-09-08T15:25:25.927857+0000 0 2020-09-08T15:25:57.756 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:25:57.757 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:25:57.764 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:25:57.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:473: TEST_divergent_2: for i in $non_divergent 2020-09-08T15:25:57.767 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:475: TEST_divergent_2: get_asok_path osd.0 2020-09-08T15:25:57.767 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-09-08T15:25:57.767 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-09-08T15:25:57.768 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:25:57.768 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:25:57.768 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:25:57.768 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.0.asok 2020-09-08T15:25:57.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:475: TEST_divergent_2: CEPH_ARGS= 2020-09-08T15:25:57.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:475: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.0.asok config set objectstore_blackhole 1 2020-09-08T15:25:57.858 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:25:57.868 INFO:tasks.workunit.client.0.smithi065.stdout: "success": "objectstore_blackhole = 'true' (not observed, change may require restart) " 2020-09-08T15:25:57.869 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:25:57.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:473: TEST_divergent_2: for i in $non_divergent 2020-09-08T15:25:57.871 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:475: TEST_divergent_2: get_asok_path osd.2 2020-09-08T15:25:57.871 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-09-08T15:25:57.871 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-09-08T15:25:57.872 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:25:57.872 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:25:57.872 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:25:57.872 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.2.asok 2020-09-08T15:25:57.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:475: TEST_divergent_2: CEPH_ARGS= 2020-09-08T15:25:57.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:475: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.2.asok config set objectstore_blackhole 1 2020-09-08T15:25:57.958 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:25:57.958 INFO:tasks.workunit.client.0.smithi065.stdout: "success": "objectstore_blackhole = 'true' (not observed, change may require restart) " 2020-09-08T15:25:57.959 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:25:57.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:479: TEST_divergent_2: echo 'create new divergent objects' 2020-09-08T15:25:57.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:480: TEST_divergent_2: seq 1 2 2020-09-08T15:25:57.966 INFO:tasks.workunit.client.0.smithi065.stdout:create new divergent objects 2020-09-08T15:25:57.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:480: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2020-09-08T15:25:57.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:480: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2020-09-08T15:25:57.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:482: TEST_divergent_2: rados -p test create newobject_1 2020-09-08T15:25:57.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:485: TEST_divergent_2: echo 'writing divergent objects' 2020-09-08T15:25:57.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:482: TEST_divergent_2: rados -p test create newobject_2 2020-09-08T15:25:57.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:486: TEST_divergent_2: seq 1 2 2020-09-08T15:25:57.968 INFO:tasks.workunit.client.0.smithi065.stdout:writing divergent objects 2020-09-08T15:25:57.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:486: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2020-09-08T15:25:57.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:486: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2020-09-08T15:25:57.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:488: TEST_divergent_2: rados -p test put existing_1 /etc/resolv.conf 2020-09-08T15:25:57.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:491: TEST_divergent_2: echo 'remove divergent objects' 2020-09-08T15:25:57.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:488: TEST_divergent_2: rados -p test put existing_2 /etc/resolv.conf 2020-09-08T15:25:57.971 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:492: TEST_divergent_2: seq 1 2 2020-09-08T15:25:57.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:492: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2020-09-08T15:25:57.973 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:494: TEST_divergent_2: expr 1 + 2 2020-09-08T15:25:57.974 INFO:tasks.workunit.client.0.smithi065.stdout:remove divergent objects 2020-09-08T15:25:57.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:494: TEST_divergent_2: rmi=3 2020-09-08T15:25:57.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:492: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2020-09-08T15:25:57.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rados -p test rm existing_3 2020-09-08T15:25:57.975 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:494: TEST_divergent_2: expr 2 + 2 2020-09-08T15:25:57.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:494: TEST_divergent_2: rmi=4 2020-09-08T15:25:57.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:497: TEST_divergent_2: sleep 10 2020-09-08T15:25:57.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rados -p test rm existing_4 2020-09-08T15:26:07.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:498: TEST_divergent_2: killall -9 rados 2020-09-08T15:26:07.980 INFO:tasks.workunit.client.0.smithi065.stderr:rados: no process found 2020-09-08T15:26:07.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:501: TEST_divergent_2: echo 'killing all the osds' 2020-09-08T15:26:07.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:502: TEST_divergent_2: ceph pg dump pgs 2020-09-08T15:26:07.981 INFO:tasks.workunit.client.0.smithi065.stdout:killing all the osds 2020-09-08T15:26:08.363 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:26:08.364 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 0 0 0 0 46628 0 0 16 16 active+clean 2020-09-08T15:25:27.177727+0000 29'106 29:117 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:25:25.927857+0000 0'0 2020-09-08T15:25:25.927857+0000 0 2020-09-08T15:26:08.364 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:26:08.364 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:26:08.365 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:26:08.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:503: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd 2020-09-08T15:26:08.376 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:26:08.376 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:26:08.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:26:08.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:26:08.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:26:08.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:26:08.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:504: TEST_divergent_2: for i in $osds 2020-09-08T15:26:08.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:506: TEST_divergent_2: ceph osd down osd.0 2020-09-08T15:26:09.166 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already down. 2020-09-08T15:26:09.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:504: TEST_divergent_2: for i in $osds 2020-09-08T15:26:09.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:506: TEST_divergent_2: ceph osd down osd.1 2020-09-08T15:26:09.855 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already down. 2020-09-08T15:26:09.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:504: TEST_divergent_2: for i in $osds 2020-09-08T15:26:09.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:506: TEST_divergent_2: ceph osd down osd.2 2020-09-08T15:26:10.418 INFO:tasks.workunit.client.0.smithi065.stderr:osd.2 is already down. 2020-09-08T15:26:10.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:508: TEST_divergent_2: for i in $non_divergent 2020-09-08T15:26:10.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:510: TEST_divergent_2: ceph osd out osd.0 2020-09-08T15:26:11.007 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already out. 2020-09-08T15:26:11.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:508: TEST_divergent_2: for i in $non_divergent 2020-09-08T15:26:11.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:510: TEST_divergent_2: ceph osd out osd.2 2020-09-08T15:26:11.548 INFO:tasks.workunit.client.0.smithi065.stderr:osd.2 is already out. 2020-09-08T15:26:11.556 INFO:tasks.workunit.client.0.smithi065.stdout:bringing up non_divergent 0 2 2020-09-08T15:26:11.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:514: TEST_divergent_2: echo 'bringing up non_divergent 0 2' 2020-09-08T15:26:11.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:515: TEST_divergent_2: ceph pg dump pgs 2020-09-08T15:26:11.934 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:26:11.935 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 0 0 0 0 46628 0 0 16 16 stale+active+clean 2020-09-08T15:25:27.177727+0000 29'106 29:117 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:25:25.927857+0000 0'0 2020-09-08T15:25:25.927857+0000 0 2020-09-08T15:26:11.935 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:26:11.936 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:26:11.936 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:26:11.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:516: TEST_divergent_2: for i in $non_divergent 2020-09-08T15:26:11.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:518: TEST_divergent_2: activate_osd td/divergent-priors 0 2020-09-08T15:26:11.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/divergent-priors 2020-09-08T15:26:11.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:26:11.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=0 2020-09-08T15:26:11.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:26:11.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/divergent-priors/0 2020-09-08T15:26:11.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:26:11.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:26:11.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:26:11.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:26:11.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2020-09-08T15:26:11.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2020-09-08T15:26:11.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:26:11.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:26:11.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:26:11.952 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:26:11.953 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:26:11.953 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:26:11.953 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:26:11.953 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:26:11.953 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:26:11.955 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:26:11.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:26:11.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:26:11.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:26:11.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:26:11.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:26:11.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:26:11.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:26:11.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:26:11.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:26:11.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/divergent-priors/0 2020-09-08T15:26:11.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.0 2020-09-08T15:26:11.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 0 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:26:11.958 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/divergent-priors/0/whoami 2020-09-08T15:26:11.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 0 = 0 ']' 2020-09-08T15:26:11.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:26:11.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:26:11.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:26:11.959 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T15:26:11.977 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:26:11.981+0000 7fe1dee54ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:26:11.978 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:26:11.983+0000 7fe1dee54ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:26:11.978 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:26:11.983+0000 7fe1dee54ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:26:12.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 0 2020-09-08T15:26:12.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:26:12.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:26:12.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:26:12.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:26:12.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:26:12.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:26:12.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:26:12.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:26:12.360 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:26:12.494 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:26:12.499+0000 7fe1dee54ec0 -1 Falling back to public interface 2020-09-08T15:26:12.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:26:13.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:26:13.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:26:13.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:26:13.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:26:13.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:26:13.773 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:26:13.816 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:26:13.821+0000 7fe1dee54ec0 -1 osd.0 29 log_to_monitors {default=true} 2020-09-08T15:26:14.191 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up out weight 0 up_from 35 up_thru 0 down_at 30 last_clean_interval [5,29) [v2:127.0.0.1:6802/47402,v1:127.0.0.1:6803/47402] [v2:127.0.0.1:6804/47402,v1:127.0.0.1:6805/47402] exists,up dc78991d-f410-4ef4-a45b-5573679ca87b 2020-09-08T15:26:14.192 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T15:26:14.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:26:14.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:26:14.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:26:14.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:516: TEST_divergent_2: for i in $non_divergent 2020-09-08T15:26:14.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:518: TEST_divergent_2: activate_osd td/divergent-priors 2 2020-09-08T15:26:14.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/divergent-priors 2020-09-08T15:26:14.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:26:14.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=2 2020-09-08T15:26:14.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:26:14.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/divergent-priors/2 2020-09-08T15:26:14.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:26:14.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:26:14.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:26:14.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:26:14.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2020-09-08T15:26:14.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2020-09-08T15:26:14.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:26:14.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:26:14.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:26:14.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:26:14.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:26:14.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:26:14.217 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:26:14.217 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:26:14.217 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:26:14.217 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:26:14.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:26:14.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:26:14.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:26:14.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:26:14.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:26:14.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:26:14.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:26:14.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:26:14.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:26:14.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/divergent-priors/2 2020-09-08T15:26:14.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.2 2020-09-08T15:26:14.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 2 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:26:14.221 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/divergent-priors/2/whoami 2020-09-08T15:26:14.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 2 = 2 ']' 2020-09-08T15:26:14.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:26:14.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:26:14.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:26:14.235 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:26:14.224+0000 7fe849f1aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:26:14.236 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:26:14.226+0000 7fe849f1aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:26:14.236 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:26:14.227+0000 7fe849f1aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:26:14.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 2 2020-09-08T15:26:14.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:26:14.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:26:14.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:26:14.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:26:14.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:26:14.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:26:14.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:26:14.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:26:14.594 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:26:14.739 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:26:14.744+0000 7fe849f1aec0 -1 Falling back to public interface 2020-09-08T15:26:14.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:26:15.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:26:15.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:26:15.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:26:15.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:26:15.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:26:15.992 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:26:16.122 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:26:16.126+0000 7fe849f1aec0 -1 osd.2 29 log_to_monitors {default=true} 2020-09-08T15:26:16.411 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up out weight 0 up_from 36 up_thru 0 down_at 32 last_clean_interval [15,29) [v2:127.0.0.1:6810/47801,v1:127.0.0.1:6811/47801] [v2:127.0.0.1:6812/47801,v1:127.0.0.1:6813/47801] exists,up 1064be2f-cb2a-4046-8814-ce923b7aef68 2020-09-08T15:26:16.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:26:16.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:26:16.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:26:16.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:520: TEST_divergent_2: for i in $non_divergent 2020-09-08T15:26:16.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:522: TEST_divergent_2: ceph osd in osd.0 2020-09-08T15:26:16.978 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already in. 2020-09-08T15:26:16.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:520: TEST_divergent_2: for i in $non_divergent 2020-09-08T15:26:16.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:522: TEST_divergent_2: ceph osd in osd.2 2020-09-08T15:26:17.557 INFO:tasks.workunit.client.0.smithi065.stderr:osd.2 is already in. 2020-09-08T15:26:17.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:525: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2020-09-08T15:26:17.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:525: TEST_divergent_2: wait_for_clean 2020-09-08T15:26:17.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:26:17.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:26:17.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:26:17.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:26:17.569 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 20 .1 2020-09-08T15:26:17.570 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:26:17.570 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:26:17.570 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:26:17.570 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:26:17.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:26:17.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:26:17.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:26:17.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:26:17.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:26:17.625 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:26:18.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:26:18.086 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:26:18.086 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:26:18.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:26:18.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:26:18.087 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:26:18.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=150323855363 2020-09-08T15:26:18.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 150323855363 2020-09-08T15:26:18.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-150323855363' 2020-09-08T15:26:18.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:26:18.254 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:26:18.349 INFO:tasks.workunit.client.0.smithi065.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-09-08T15:26:18.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq= 2020-09-08T15:26:18.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z '' 2020-09-08T15:26:18.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: continue 2020-09-08T15:26:18.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:26:18.351 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:26:18.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=154618822659 2020-09-08T15:26:18.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 154618822659 2020-09-08T15:26:18.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-150323855363 2-154618822659' 2020-09-08T15:26:18.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:26:18.488 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-150323855363 2020-09-08T15:26:18.488 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:26:18.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:26:18.489 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-150323855363 2020-09-08T15:26:18.489 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:26:18.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=150323855363 2020-09-08T15:26:18.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 150323855363' 2020-09-08T15:26:18.490 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:26:18.490 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 150323855363 2020-09-08T15:26:18.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 1 -lt 150323855363 2020-09-08T15:26:18.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:26:19.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:26:19.898 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:26:20.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 150323855364 -lt 150323855363 2020-09-08T15:26:20.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:26:20.300 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-154618822659 2020-09-08T15:26:20.301 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:26:20.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:26:20.301 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-154618822659 2020-09-08T15:26:20.302 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:26:20.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=154618822659 2020-09-08T15:26:20.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 154618822659' 2020-09-08T15:26:20.303 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:26:20.303 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 154618822659 2020-09-08T15:26:20.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 154618822659 -lt 154618822659 2020-09-08T15:26:20.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:26:20.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:26:20.742 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:26:21.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T15:26:21.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:26:21.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:26:21.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:26:21.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:26:21.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:26:21.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:26:21.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:26:21.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:26:21.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:26:21.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:26:21.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:26:22.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:26:22.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T15:26:22.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T15:26:22.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T15:26:22.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:26:22.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:26:22.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:26:22.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:26:22.309 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:26:22.309 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:26:22.309 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:26:22.309 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:26:22.310 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:26:22.310 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:26:22.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:26:22.697 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:26:22.698 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:26:22.698 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:26:23.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:26:23.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:26:23.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:26:23.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:26:23.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:26:23.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:26:23.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:26:23.221 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:26:23.221 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:26:23.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:26:23.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:26:23.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 1 >= 8 )) 2020-09-08T15:26:23.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:26:23.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.2 2020-09-08T15:26:23.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:26:23.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:26:23.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:26:23.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:26:23.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:26:23.969 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:26:23.969 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:26:23.969 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:26:24.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:26:24.338 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:26:24.338 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:26:24.338 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:26:24.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:26:24.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:26:24.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:26:24.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:26:24.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:26:24.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:26:24.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:26:24.888 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:26:24.888 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:26:25.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:26:25.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:26:25.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 2 >= 8 )) 2020-09-08T15:26:25.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:26:25.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.4 2020-09-08T15:26:25.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:26:25.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:26:25.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:26:25.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:26:25.809 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:26:25.809 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:26:25.809 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:26:25.809 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:26:26.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:26:26.189 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:26:26.190 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:26:26.190 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:26:26.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:26:26.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:26:26.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:26:26.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:26:26.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:26:26.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:26:26.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:26:26.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:26:26.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:26:27.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:26:27.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:26:27.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 3 >= 8 )) 2020-09-08T15:26:27.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:26:27.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.8 2020-09-08T15:26:28.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:26:28.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:26:28.041 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:26:28.042 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:26:28.042 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:26:28.042 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:26:28.042 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:26:28.042 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:26:28.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:26:28.438 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:26:28.438 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:26:28.438 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:26:28.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:26:28.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:26:28.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:26:28.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:26:28.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:26:28.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:26:28.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:26:28.960 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:26:28.960 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:26:29.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:26:29.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:26:29.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 4 >= 8 )) 2020-09-08T15:26:29.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:26:29.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 1.6 2020-09-08T15:26:31.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:26:31.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:26:31.089 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:26:31.089 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:26:31.090 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:26:31.090 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:26:31.090 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:26:31.091 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:26:31.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:26:31.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:26:31.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:26:31.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:26:32.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:26:32.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:26:32.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:26:32.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:26:32.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:26:32.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:26:32.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:26:32.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:26:32.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:26:32.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:26:32.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:26:32.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 5 >= 8 )) 2020-09-08T15:26:32.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:26:32.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 3.2 2020-09-08T15:26:35.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:26:35.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:26:35.736 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:26:35.737 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:26:35.737 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:26:35.738 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:26:35.738 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:26:35.739 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:26:36.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:26:36.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:26:36.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:26:36.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:26:36.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:26:36.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:26:36.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:26:36.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:26:36.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:26:36.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:26:36.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:26:36.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:26:36.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:26:37.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:26:37.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:26:37.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 6 >= 8 )) 2020-09-08T15:26:37.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:26:37.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 6.4 2020-09-08T15:26:43.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:26:43.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:26:43.594 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:26:43.594 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:26:43.594 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:26:43.595 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:26:43.595 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:26:43.595 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:26:43.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:26:43.986 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:26:43.986 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:26:43.987 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:26:44.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:26:44.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:26:44.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:26:44.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:26:44.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:26:44.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:26:44.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:26:44.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:26:44.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:26:45.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:26:45.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:26:45.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 7 >= 8 )) 2020-09-08T15:26:45.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:26:45.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 7.3 2020-09-08T15:26:52.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:26:52.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:26:52.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:26:52.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:26:52.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:26:52.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:26:52.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:26:52.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:26:52.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:26:52.762 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:26:52.763 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:26:52.763 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:26:53.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:26:53.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:26:53.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:26:53.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:26:53.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:26:53.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:26:53.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:26:53.285 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:26:53.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:26:53.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:26:53.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:26:53.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 8 >= 8 )) 2020-09-08T15:26:53.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: wait_for_clean: ceph report 2020-09-08T15:26:54.376 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:26:54.377 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_fingerprint": "b1755866-7906-482e-a973-0c1469821204", 2020-09-08T15:26:54.377 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:26:54.377 INFO:tasks.workunit.client.0.smithi065.stdout: "commit": "dce4d291bd4243c9802c17d67b85a6da6bbc0f8f", 2020-09-08T15:26:54.378 INFO:tasks.workunit.client.0.smithi065.stdout: "timestamp": "2020-09-08T15:26:54.379604+0000", 2020-09-08T15:26:54.378 INFO:tasks.workunit.client.0.smithi065.stdout: "tag": "", 2020-09-08T15:26:54.378 INFO:tasks.workunit.client.0.smithi065.stdout: "health": { 2020-09-08T15:26:54.379 INFO:tasks.workunit.client.0.smithi065.stdout: "status": "HEALTH_WARN", 2020-09-08T15:26:54.379 INFO:tasks.workunit.client.0.smithi065.stdout: "checks": { 2020-09-08T15:26:54.379 INFO:tasks.workunit.client.0.smithi065.stdout: "OSDMAP_FLAGS": { 2020-09-08T15:26:54.380 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:26:54.380 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:26:54.380 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "nodown,noout,noin flag(s) set", 2020-09-08T15:26:54.381 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 17 2020-09-08T15:26:54.381 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.381 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [], 2020-09-08T15:26:54.384 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:26:54.385 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.385 INFO:tasks.workunit.client.0.smithi065.stdout: "OSD_DOWN": { 2020-09-08T15:26:54.385 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:26:54.386 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:26:54.386 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "1 osds down", 2020-09-08T15:26:54.387 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 1 2020-09-08T15:26:54.387 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.387 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [ 2020-09-08T15:26:54.388 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.388 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "osd.1 (root=default,host=smithi065) is down" 2020-09-08T15:26:54.388 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.389 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:26:54.389 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:26:54.389 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.390 INFO:tasks.workunit.client.0.smithi065.stdout: "PG_DEGRADED": { 2020-09-08T15:26:54.390 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:26:54.390 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:26:54.391 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2020-09-08T15:26:54.391 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 1 2020-09-08T15:26:54.391 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.391 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [ 2020-09-08T15:26:54.392 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.392 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:26:54.392 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.393 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:26:54.393 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:26:54.394 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.395 INFO:tasks.workunit.client.0.smithi065.stdout: "POOL_APP_NOT_ENABLED": { 2020-09-08T15:26:54.395 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:26:54.395 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:26:54.396 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "1 pool(s) do not have an application enabled", 2020-09-08T15:26:54.396 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 1 2020-09-08T15:26:54.396 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.397 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [ 2020-09-08T15:26:54.397 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.397 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "application not enabled on pool 'test'" 2020-09-08T15:26:54.398 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.398 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.398 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." 2020-09-08T15:26:54.399 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.399 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:26:54.399 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:26:54.400 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.400 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.400 INFO:tasks.workunit.client.0.smithi065.stdout: "mutes": [] 2020-09-08T15:26:54.401 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.401 INFO:tasks.workunit.client.0.smithi065.stdout: "monmap_first_committed": 1, 2020-09-08T15:26:54.401 INFO:tasks.workunit.client.0.smithi065.stdout: "monmap_last_committed": 1, 2020-09-08T15:26:54.402 INFO:tasks.workunit.client.0.smithi065.stdout: "monmap": { 2020-09-08T15:26:54.402 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 1, 2020-09-08T15:26:54.402 INFO:tasks.workunit.client.0.smithi065.stdout: "fsid": "c25e19f6-e2e3-4d0b-8f34-71c93296ff3c", 2020-09-08T15:26:54.403 INFO:tasks.workunit.client.0.smithi065.stdout: "modified": "2020-09-08T15:24:58.005157Z", 2020-09-08T15:26:54.403 INFO:tasks.workunit.client.0.smithi065.stdout: "created": "2020-09-08T15:24:58.005157Z", 2020-09-08T15:26:54.403 INFO:tasks.workunit.client.0.smithi065.stdout: "min_mon_release": 16, 2020-09-08T15:26:54.404 INFO:tasks.workunit.client.0.smithi065.stdout: "min_mon_release_name": "pacific", 2020-09-08T15:26:54.404 INFO:tasks.workunit.client.0.smithi065.stdout: "features": { 2020-09-08T15:26:54.405 INFO:tasks.workunit.client.0.smithi065.stdout: "persistent": [ 2020-09-08T15:26:54.405 INFO:tasks.workunit.client.0.smithi065.stdout: "kraken", 2020-09-08T15:26:54.406 INFO:tasks.workunit.client.0.smithi065.stdout: "luminous", 2020-09-08T15:26:54.406 INFO:tasks.workunit.client.0.smithi065.stdout: "mimic", 2020-09-08T15:26:54.406 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap-prune", 2020-09-08T15:26:54.407 INFO:tasks.workunit.client.0.smithi065.stdout: "nautilus", 2020-09-08T15:26:54.407 INFO:tasks.workunit.client.0.smithi065.stdout: "octopus", 2020-09-08T15:26:54.407 INFO:tasks.workunit.client.0.smithi065.stdout: "pacific" 2020-09-08T15:26:54.408 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:26:54.408 INFO:tasks.workunit.client.0.smithi065.stdout: "optional": [] 2020-09-08T15:26:54.408 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.409 INFO:tasks.workunit.client.0.smithi065.stdout: "mons": [ 2020-09-08T15:26:54.409 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.409 INFO:tasks.workunit.client.0.smithi065.stdout: "rank": 0, 2020-09-08T15:26:54.411 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "a", 2020-09-08T15:26:54.412 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:26:54.412 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:26:54.412 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.413 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:26:54.413 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:7115", 2020-09-08T15:26:54.413 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 0 2020-09-08T15:26:54.414 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.414 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.414 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.415 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:7115/0", 2020-09-08T15:26:54.416 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:7115/0", 2020-09-08T15:26:54.416 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 0, 2020-09-08T15:26:54.416 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 0 2020-09-08T15:26:54.417 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.417 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.417 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.418 INFO:tasks.workunit.client.0.smithi065.stdout: "quorum": [ 2020-09-08T15:26:54.418 INFO:tasks.workunit.client.0.smithi065.stdout: 0 2020-09-08T15:26:54.418 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:26:54.418 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap": { 2020-09-08T15:26:54.419 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 39, 2020-09-08T15:26:54.419 INFO:tasks.workunit.client.0.smithi065.stdout: "fsid": "c25e19f6-e2e3-4d0b-8f34-71c93296ff3c", 2020-09-08T15:26:54.419 INFO:tasks.workunit.client.0.smithi065.stdout: "created": "2020-09-08T15:24:58.858602+0000", 2020-09-08T15:26:54.424 INFO:tasks.workunit.client.0.smithi065.stdout: "modified": "2020-09-08T15:26:17.637939+0000", 2020-09-08T15:26:54.425 INFO:tasks.workunit.client.0.smithi065.stdout: "last_up_change": "2020-09-08T15:26:16.200572+0000", 2020-09-08T15:26:54.425 INFO:tasks.workunit.client.0.smithi065.stdout: "last_in_change": "2020-09-08T15:26:17.321413+0000", 2020-09-08T15:26:54.429 INFO:tasks.workunit.client.0.smithi065.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-09-08T15:26:54.429 INFO:tasks.workunit.client.0.smithi065.stdout: "flags_num": 5800384, 2020-09-08T15:26:54.429 INFO:tasks.workunit.client.0.smithi065.stdout: "flags_set": [ 2020-09-08T15:26:54.430 INFO:tasks.workunit.client.0.smithi065.stdout: "nodown", 2020-09-08T15:26:54.430 INFO:tasks.workunit.client.0.smithi065.stdout: "noin", 2020-09-08T15:26:54.430 INFO:tasks.workunit.client.0.smithi065.stdout: "noout", 2020-09-08T15:26:54.431 INFO:tasks.workunit.client.0.smithi065.stdout: "pglog_hardlimit", 2020-09-08T15:26:54.431 INFO:tasks.workunit.client.0.smithi065.stdout: "purged_snapdirs", 2020-09-08T15:26:54.431 INFO:tasks.workunit.client.0.smithi065.stdout: "recovery_deletes", 2020-09-08T15:26:54.432 INFO:tasks.workunit.client.0.smithi065.stdout: "sortbitwise" 2020-09-08T15:26:54.432 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:26:54.432 INFO:tasks.workunit.client.0.smithi065.stdout: "crush_version": 7, 2020-09-08T15:26:54.433 INFO:tasks.workunit.client.0.smithi065.stdout: "full_ratio": 0.99000000953674316, 2020-09-08T15:26:54.433 INFO:tasks.workunit.client.0.smithi065.stdout: "backfillfull_ratio": 0.99000000953674316, 2020-09-08T15:26:54.433 INFO:tasks.workunit.client.0.smithi065.stdout: "nearfull_ratio": 0.85000002384185791, 2020-09-08T15:26:54.434 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_snapshot": "", 2020-09-08T15:26:54.435 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_max": 1, 2020-09-08T15:26:54.435 INFO:tasks.workunit.client.0.smithi065.stdout: "max_osd": 3, 2020-09-08T15:26:54.435 INFO:tasks.workunit.client.0.smithi065.stdout: "require_min_compat_client": "luminous", 2020-09-08T15:26:54.436 INFO:tasks.workunit.client.0.smithi065.stdout: "min_compat_client": "jewel", 2020-09-08T15:26:54.438 INFO:tasks.workunit.client.0.smithi065.stdout: "require_osd_release": "pacific", 2020-09-08T15:26:54.438 INFO:tasks.workunit.client.0.smithi065.stdout: "pools": [ 2020-09-08T15:26:54.439 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.439 INFO:tasks.workunit.client.0.smithi065.stdout: "pool": 1, 2020-09-08T15:26:54.439 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_name": "test", 2020-09-08T15:26:54.440 INFO:tasks.workunit.client.0.smithi065.stdout: "create_time": "2020-09-08T15:25:25.877656+0000", 2020-09-08T15:26:54.440 INFO:tasks.workunit.client.0.smithi065.stdout: "flags": 1, 2020-09-08T15:26:54.441 INFO:tasks.workunit.client.0.smithi065.stdout: "flags_names": "hashpspool", 2020-09-08T15:26:54.441 INFO:tasks.workunit.client.0.smithi065.stdout: "type": 1, 2020-09-08T15:26:54.442 INFO:tasks.workunit.client.0.smithi065.stdout: "size": 3, 2020-09-08T15:26:54.442 INFO:tasks.workunit.client.0.smithi065.stdout: "min_size": 2, 2020-09-08T15:26:54.442 INFO:tasks.workunit.client.0.smithi065.stdout: "crush_rule": 0, 2020-09-08T15:26:54.443 INFO:tasks.workunit.client.0.smithi065.stdout: "object_hash": 2, 2020-09-08T15:26:54.443 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_autoscale_mode": "off", 2020-09-08T15:26:54.443 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_num": 1, 2020-09-08T15:26:54.444 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_placement_num": 1, 2020-09-08T15:26:54.444 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_placement_num_target": 1, 2020-09-08T15:26:54.445 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_num_target": 1, 2020-09-08T15:26:54.445 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_num_pending": 1, 2020-09-08T15:26:54.445 INFO:tasks.workunit.client.0.smithi065.stdout: "last_pg_merge_meta": { 2020-09-08T15:26:54.446 INFO:tasks.workunit.client.0.smithi065.stdout: "source_pgid": "0.0", 2020-09-08T15:26:54.446 INFO:tasks.workunit.client.0.smithi065.stdout: "ready_epoch": 0, 2020-09-08T15:26:54.446 INFO:tasks.workunit.client.0.smithi065.stdout: "last_epoch_started": 0, 2020-09-08T15:26:54.448 INFO:tasks.workunit.client.0.smithi065.stdout: "last_epoch_clean": 0, 2020-09-08T15:26:54.448 INFO:tasks.workunit.client.0.smithi065.stdout: "source_version": "0'0", 2020-09-08T15:26:54.448 INFO:tasks.workunit.client.0.smithi065.stdout: "target_version": "0'0" 2020-09-08T15:26:54.449 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.449 INFO:tasks.workunit.client.0.smithi065.stdout: "last_change": "29", 2020-09-08T15:26:54.449 INFO:tasks.workunit.client.0.smithi065.stdout: "last_force_op_resend": "0", 2020-09-08T15:26:54.450 INFO:tasks.workunit.client.0.smithi065.stdout: "last_force_op_resend_prenautilus": "0", 2020-09-08T15:26:54.450 INFO:tasks.workunit.client.0.smithi065.stdout: "last_force_op_resend_preluminous": "0", 2020-09-08T15:26:54.451 INFO:tasks.workunit.client.0.smithi065.stdout: "auid": 0, 2020-09-08T15:26:54.451 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_mode": "selfmanaged", 2020-09-08T15:26:54.451 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_seq": 0, 2020-09-08T15:26:54.452 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_epoch": 0, 2020-09-08T15:26:54.452 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_snaps": [], 2020-09-08T15:26:54.453 INFO:tasks.workunit.client.0.smithi065.stdout: "removed_snaps": "[]", 2020-09-08T15:26:54.453 INFO:tasks.workunit.client.0.smithi065.stdout: "quota_max_bytes": 0, 2020-09-08T15:26:54.453 INFO:tasks.workunit.client.0.smithi065.stdout: "quota_max_objects": 0, 2020-09-08T15:26:54.454 INFO:tasks.workunit.client.0.smithi065.stdout: "tiers": [], 2020-09-08T15:26:54.454 INFO:tasks.workunit.client.0.smithi065.stdout: "tier_of": -1, 2020-09-08T15:26:54.454 INFO:tasks.workunit.client.0.smithi065.stdout: "read_tier": -1, 2020-09-08T15:26:54.455 INFO:tasks.workunit.client.0.smithi065.stdout: "write_tier": -1, 2020-09-08T15:26:54.455 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_mode": "none", 2020-09-08T15:26:54.455 INFO:tasks.workunit.client.0.smithi065.stdout: "target_max_bytes": 0, 2020-09-08T15:26:54.456 INFO:tasks.workunit.client.0.smithi065.stdout: "target_max_objects": 0, 2020-09-08T15:26:54.456 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-09-08T15:26:54.457 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-09-08T15:26:54.457 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_target_full_ratio_micro": 800000, 2020-09-08T15:26:54.458 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_min_flush_age": 0, 2020-09-08T15:26:54.459 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_min_evict_age": 0, 2020-09-08T15:26:54.459 INFO:tasks.workunit.client.0.smithi065.stdout: "erasure_code_profile": "", 2020-09-08T15:26:54.459 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_params": { 2020-09-08T15:26:54.460 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "none" 2020-09-08T15:26:54.460 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.460 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_period": 0, 2020-09-08T15:26:54.461 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_count": 0, 2020-09-08T15:26:54.461 INFO:tasks.workunit.client.0.smithi065.stdout: "use_gmt_hitset": true, 2020-09-08T15:26:54.462 INFO:tasks.workunit.client.0.smithi065.stdout: "min_read_recency_for_promote": 0, 2020-09-08T15:26:54.462 INFO:tasks.workunit.client.0.smithi065.stdout: "min_write_recency_for_promote": 0, 2020-09-08T15:26:54.462 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_grade_decay_rate": 0, 2020-09-08T15:26:54.463 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_search_last_n": 0, 2020-09-08T15:26:54.463 INFO:tasks.workunit.client.0.smithi065.stdout: "grade_table": [], 2020-09-08T15:26:54.464 INFO:tasks.workunit.client.0.smithi065.stdout: "stripe_width": 0, 2020-09-08T15:26:54.464 INFO:tasks.workunit.client.0.smithi065.stdout: "expected_num_objects": 0, 2020-09-08T15:26:54.464 INFO:tasks.workunit.client.0.smithi065.stdout: "fast_read": false, 2020-09-08T15:26:54.465 INFO:tasks.workunit.client.0.smithi065.stdout: "options": {}, 2020-09-08T15:26:54.465 INFO:tasks.workunit.client.0.smithi065.stdout: "application_metadata": {} 2020-09-08T15:26:54.465 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.466 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:26:54.466 INFO:tasks.workunit.client.0.smithi065.stdout: "osds": [ 2020-09-08T15:26:54.466 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.467 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:26:54.467 INFO:tasks.workunit.client.0.smithi065.stdout: "uuid": "dc78991d-f410-4ef4-a45b-5573679ca87b", 2020-09-08T15:26:54.467 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 1, 2020-09-08T15:26:54.468 INFO:tasks.workunit.client.0.smithi065.stdout: "in": 1, 2020-09-08T15:26:54.468 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 1, 2020-09-08T15:26:54.469 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_affinity": 1, 2020-09-08T15:26:54.469 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_begin": 5, 2020-09-08T15:26:54.470 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_end": 29, 2020-09-08T15:26:54.470 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 35, 2020-09-08T15:26:54.471 INFO:tasks.workunit.client.0.smithi065.stdout: "up_thru": 38, 2020-09-08T15:26:54.471 INFO:tasks.workunit.client.0.smithi065.stdout: "down_at": 30, 2020-09-08T15:26:54.471 INFO:tasks.workunit.client.0.smithi065.stdout: "lost_at": 0, 2020-09-08T15:26:54.471 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:26:54.472 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:26:54.472 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.472 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:26:54.472 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6802", 2020-09-08T15:26:54.472 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47402 2020-09-08T15:26:54.473 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.473 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.473 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:26:54.473 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6803", 2020-09-08T15:26:54.473 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47402 2020-09-08T15:26:54.474 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.474 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.474 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.474 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addrs": { 2020-09-08T15:26:54.474 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:26:54.475 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.475 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:26:54.475 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6804", 2020-09-08T15:26:54.476 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47402 2020-09-08T15:26:54.476 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.476 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.476 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:26:54.476 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6805", 2020-09-08T15:26:54.477 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47402 2020-09-08T15:26:54.477 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.477 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.477 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.478 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addrs": { 2020-09-08T15:26:54.478 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:26:54.478 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.478 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:26:54.478 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6808", 2020-09-08T15:26:54.479 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47402 2020-09-08T15:26:54.479 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.479 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.479 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:26:54.480 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6809", 2020-09-08T15:26:54.480 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47402 2020-09-08T15:26:54.481 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.481 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.481 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.481 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addrs": { 2020-09-08T15:26:54.482 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:26:54.482 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.482 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:26:54.482 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6806", 2020-09-08T15:26:54.482 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47402 2020-09-08T15:26:54.483 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.483 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.483 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:26:54.483 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6807", 2020-09-08T15:26:54.483 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47402 2020-09-08T15:26:54.484 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.484 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.484 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.485 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:6803/47402", 2020-09-08T15:26:54.485 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addr": "127.0.0.1:6805/47402", 2020-09-08T15:26:54.485 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addr": "127.0.0.1:6809/47402", 2020-09-08T15:26:54.485 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addr": "127.0.0.1:6807/47402", 2020-09-08T15:26:54.485 INFO:tasks.workunit.client.0.smithi065.stdout: "state": [ 2020-09-08T15:26:54.486 INFO:tasks.workunit.client.0.smithi065.stdout: "exists", 2020-09-08T15:26:54.486 INFO:tasks.workunit.client.0.smithi065.stdout: "up" 2020-09-08T15:26:54.486 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.486 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.487 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.487 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:26:54.487 INFO:tasks.workunit.client.0.smithi065.stdout: "uuid": "0a291c9f-6efd-44cb-baaf-35b800dc7866", 2020-09-08T15:26:54.487 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 0, 2020-09-08T15:26:54.488 INFO:tasks.workunit.client.0.smithi065.stdout: "in": 1, 2020-09-08T15:26:54.488 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 1, 2020-09-08T15:26:54.488 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_affinity": 1, 2020-09-08T15:26:54.488 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_begin": 0, 2020-09-08T15:26:54.489 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_end": 0, 2020-09-08T15:26:54.489 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 10, 2020-09-08T15:26:54.489 INFO:tasks.workunit.client.0.smithi065.stdout: "up_thru": 23, 2020-09-08T15:26:54.489 INFO:tasks.workunit.client.0.smithi065.stdout: "down_at": 31, 2020-09-08T15:26:54.490 INFO:tasks.workunit.client.0.smithi065.stdout: "lost_at": 0, 2020-09-08T15:26:54.490 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:26:54.490 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:26:54.490 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.491 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:26:54.491 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6810", 2020-09-08T15:26:54.492 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 42495 2020-09-08T15:26:54.492 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.492 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.492 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:26:54.493 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6811", 2020-09-08T15:26:54.493 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 42495 2020-09-08T15:26:54.493 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.493 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.494 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.494 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addrs": { 2020-09-08T15:26:54.494 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:26:54.494 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.494 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:26:54.495 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6812", 2020-09-08T15:26:54.495 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 42495 2020-09-08T15:26:54.495 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.495 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.496 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:26:54.496 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6813", 2020-09-08T15:26:54.496 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 42495 2020-09-08T15:26:54.496 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.497 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.497 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.497 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addrs": { 2020-09-08T15:26:54.497 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:26:54.498 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.498 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:26:54.498 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6816", 2020-09-08T15:26:54.499 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 42495 2020-09-08T15:26:54.499 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.499 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.499 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:26:54.499 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6817", 2020-09-08T15:26:54.500 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 42495 2020-09-08T15:26:54.500 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.500 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.500 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.501 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addrs": { 2020-09-08T15:26:54.501 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:26:54.502 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.502 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:26:54.502 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6814", 2020-09-08T15:26:54.502 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 42495 2020-09-08T15:26:54.502 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.503 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.503 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:26:54.503 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6815", 2020-09-08T15:26:54.503 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 42495 2020-09-08T15:26:54.504 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.504 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.504 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.504 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:6811/42495", 2020-09-08T15:26:54.505 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addr": "127.0.0.1:6813/42495", 2020-09-08T15:26:54.505 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addr": "127.0.0.1:6817/42495", 2020-09-08T15:26:54.505 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addr": "127.0.0.1:6815/42495", 2020-09-08T15:26:54.505 INFO:tasks.workunit.client.0.smithi065.stdout: "state": [ 2020-09-08T15:26:54.505 INFO:tasks.workunit.client.0.smithi065.stdout: "exists" 2020-09-08T15:26:54.506 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.506 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.506 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.506 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:26:54.506 INFO:tasks.workunit.client.0.smithi065.stdout: "uuid": "1064be2f-cb2a-4046-8814-ce923b7aef68", 2020-09-08T15:26:54.507 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 1, 2020-09-08T15:26:54.507 INFO:tasks.workunit.client.0.smithi065.stdout: "in": 1, 2020-09-08T15:26:54.507 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 1, 2020-09-08T15:26:54.507 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_affinity": 1, 2020-09-08T15:26:54.507 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_begin": 15, 2020-09-08T15:26:54.508 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_end": 29, 2020-09-08T15:26:54.508 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 36, 2020-09-08T15:26:54.508 INFO:tasks.workunit.client.0.smithi065.stdout: "up_thru": 0, 2020-09-08T15:26:54.508 INFO:tasks.workunit.client.0.smithi065.stdout: "down_at": 32, 2020-09-08T15:26:54.508 INFO:tasks.workunit.client.0.smithi065.stdout: "lost_at": 0, 2020-09-08T15:26:54.508 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:26:54.509 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:26:54.509 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.509 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:26:54.509 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6810", 2020-09-08T15:26:54.509 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47801 2020-09-08T15:26:54.510 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.510 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.510 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:26:54.510 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6811", 2020-09-08T15:26:54.510 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47801 2020-09-08T15:26:54.511 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.511 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.511 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.511 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addrs": { 2020-09-08T15:26:54.511 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:26:54.512 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.512 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:26:54.513 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6812", 2020-09-08T15:26:54.513 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47801 2020-09-08T15:26:54.513 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.513 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.513 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:26:54.514 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6813", 2020-09-08T15:26:54.514 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47801 2020-09-08T15:26:54.514 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.514 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.514 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.515 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addrs": { 2020-09-08T15:26:54.515 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:26:54.515 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.515 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:26:54.515 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6816", 2020-09-08T15:26:54.515 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47801 2020-09-08T15:26:54.516 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.516 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.516 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:26:54.516 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6817", 2020-09-08T15:26:54.516 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47801 2020-09-08T15:26:54.517 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.517 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.517 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.517 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addrs": { 2020-09-08T15:26:54.517 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:26:54.518 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.518 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:26:54.518 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6814", 2020-09-08T15:26:54.518 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47801 2020-09-08T15:26:54.518 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.519 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.519 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:26:54.519 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6815", 2020-09-08T15:26:54.519 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47801 2020-09-08T15:26:54.519 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.520 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.520 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.520 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:6811/47801", 2020-09-08T15:26:54.520 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addr": "127.0.0.1:6813/47801", 2020-09-08T15:26:54.520 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addr": "127.0.0.1:6817/47801", 2020-09-08T15:26:54.521 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addr": "127.0.0.1:6815/47801", 2020-09-08T15:26:54.521 INFO:tasks.workunit.client.0.smithi065.stdout: "state": [ 2020-09-08T15:26:54.521 INFO:tasks.workunit.client.0.smithi065.stdout: "exists", 2020-09-08T15:26:54.521 INFO:tasks.workunit.client.0.smithi065.stdout: "up" 2020-09-08T15:26:54.521 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.523 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.523 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:26:54.524 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_xinfo": [ 2020-09-08T15:26:54.524 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.524 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:26:54.525 INFO:tasks.workunit.client.0.smithi065.stdout: "down_stamp": "2020-09-08T15:26:08.902994+0000", 2020-09-08T15:26:54.525 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_probability": 0, 2020-09-08T15:26:54.525 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_interval": 0, 2020-09-08T15:26:54.525 INFO:tasks.workunit.client.0.smithi065.stdout: "features": 4540138292837744639, 2020-09-08T15:26:54.525 INFO:tasks.workunit.client.0.smithi065.stdout: "old_weight": 0, 2020-09-08T15:26:54.526 INFO:tasks.workunit.client.0.smithi065.stdout: "last_purged_snaps_scrub": "2020-09-08T15:25:07.467187+0000", 2020-09-08T15:26:54.526 INFO:tasks.workunit.client.0.smithi065.stdout: "dead_epoch": 0 2020-09-08T15:26:54.526 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.526 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.526 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:26:54.527 INFO:tasks.workunit.client.0.smithi065.stdout: "down_stamp": "2020-09-08T15:26:09.595855+0000", 2020-09-08T15:26:54.527 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_probability": 0, 2020-09-08T15:26:54.527 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_interval": 0, 2020-09-08T15:26:54.527 INFO:tasks.workunit.client.0.smithi065.stdout: "features": 4540138292837744639, 2020-09-08T15:26:54.527 INFO:tasks.workunit.client.0.smithi065.stdout: "old_weight": 0, 2020-09-08T15:26:54.528 INFO:tasks.workunit.client.0.smithi065.stdout: "last_purged_snaps_scrub": "2020-09-08T15:25:15.472904+0000", 2020-09-08T15:26:54.528 INFO:tasks.workunit.client.0.smithi065.stdout: "dead_epoch": 0 2020-09-08T15:26:54.528 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.528 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.528 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:26:54.529 INFO:tasks.workunit.client.0.smithi065.stdout: "down_stamp": "2020-09-08T15:26:10.205149+0000", 2020-09-08T15:26:54.529 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_probability": 0, 2020-09-08T15:26:54.529 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_interval": 0, 2020-09-08T15:26:54.529 INFO:tasks.workunit.client.0.smithi065.stdout: "features": 4540138292837744639, 2020-09-08T15:26:54.530 INFO:tasks.workunit.client.0.smithi065.stdout: "old_weight": 0, 2020-09-08T15:26:54.530 INFO:tasks.workunit.client.0.smithi065.stdout: "last_purged_snaps_scrub": "2020-09-08T15:25:23.387631+0000", 2020-09-08T15:26:54.530 INFO:tasks.workunit.client.0.smithi065.stdout: "dead_epoch": 0 2020-09-08T15:26:54.530 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.530 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:26:54.531 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_upmap": [], 2020-09-08T15:26:54.531 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_upmap_items": [], 2020-09-08T15:26:54.531 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_temp": [], 2020-09-08T15:26:54.531 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_temp": [], 2020-09-08T15:26:54.531 INFO:tasks.workunit.client.0.smithi065.stdout: "blocklist": {}, 2020-09-08T15:26:54.532 INFO:tasks.workunit.client.0.smithi065.stdout: "erasure_code_profiles": { 2020-09-08T15:26:54.532 INFO:tasks.workunit.client.0.smithi065.stdout: "default": { 2020-09-08T15:26:54.532 INFO:tasks.workunit.client.0.smithi065.stdout: "k": "2", 2020-09-08T15:26:54.532 INFO:tasks.workunit.client.0.smithi065.stdout: "m": "2", 2020-09-08T15:26:54.532 INFO:tasks.workunit.client.0.smithi065.stdout: "plugin": "jerasure", 2020-09-08T15:26:54.533 INFO:tasks.workunit.client.0.smithi065.stdout: "technique": "reed_sol_van" 2020-09-08T15:26:54.533 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.533 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.533 INFO:tasks.workunit.client.0.smithi065.stdout: "removed_snaps_queue": [], 2020-09-08T15:26:54.533 INFO:tasks.workunit.client.0.smithi065.stdout: "new_removed_snaps": [], 2020-09-08T15:26:54.534 INFO:tasks.workunit.client.0.smithi065.stdout: "new_purged_snaps": [], 2020-09-08T15:26:54.534 INFO:tasks.workunit.client.0.smithi065.stdout: "crush_node_flags": {}, 2020-09-08T15:26:54.534 INFO:tasks.workunit.client.0.smithi065.stdout: "device_class_flags": {} 2020-09-08T15:26:54.534 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.534 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_metadata": [ 2020-09-08T15:26:54.535 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.535 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:26:54.535 INFO:tasks.workunit.client.0.smithi065.stdout: "arch": "x86_64", 2020-09-08T15:26:54.535 INFO:tasks.workunit.client.0.smithi065.stdout: "back_addr": "[v2:127.0.0.1:6804/47402,v1:127.0.0.1:6805/47402]", 2020-09-08T15:26:54.535 INFO:tasks.workunit.client.0.smithi065.stdout: "back_iface": "", 2020-09-08T15:26:54.536 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs": "1", 2020-09-08T15:26:54.536 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_db": "0", 2020-09-08T15:26:54.536 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_wal": "0", 2020-09-08T15:26:54.536 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_single_shared_device": "1", 2020-09-08T15:26:54.536 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T15:26:54.537 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T15:26:54.537 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T15:26:54.537 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T15:26:54.537 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2020-09-08T15:26:54.538 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T15:26:54.538 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T15:26:54.538 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T15:26:54.538 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T15:26:54.538 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_release": "pacific", 2020-09-08T15:26:54.539 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version": "ceph version 16.0.0-5272-gdce4d291bd4 (dce4d291bd4243c9802c17d67b85a6da6bbc0f8f) pacific (dev)", 2020-09-08T15:26:54.539 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version_short": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:26:54.539 INFO:tasks.workunit.client.0.smithi065.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-09-08T15:26:54.539 INFO:tasks.workunit.client.0.smithi065.stdout: "default_device_class": "hdd", 2020-09-08T15:26:54.539 INFO:tasks.workunit.client.0.smithi065.stdout: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W4VHBH", 2020-09-08T15:26:54.540 INFO:tasks.workunit.client.0.smithi065.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2020-09-08T15:26:54.540 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": "sda", 2020-09-08T15:26:54.540 INFO:tasks.workunit.client.0.smithi065.stdout: "distro": "rhel", 2020-09-08T15:26:54.540 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_description": "Red Hat Enterprise Linux 8.1 (Ootpa)", 2020-09-08T15:26:54.541 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_version": "8.1", 2020-09-08T15:26:54.541 INFO:tasks.workunit.client.0.smithi065.stdout: "front_addr": "[v2:127.0.0.1:6802/47402,v1:127.0.0.1:6803/47402]", 2020-09-08T15:26:54.541 INFO:tasks.workunit.client.0.smithi065.stdout: "front_iface": "", 2020-09-08T15:26:54.541 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/47402,v1:127.0.0.1:6809/47402]", 2020-09-08T15:26:54.542 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/47402,v1:127.0.0.1:6807/47402]", 2020-09-08T15:26:54.548 INFO:tasks.workunit.client.0.smithi065.stdout: "hostname": "smithi065", 2020-09-08T15:26:54.549 INFO:tasks.workunit.client.0.smithi065.stdout: "journal_rotational": "1", 2020-09-08T15:26:54.549 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_description": "#1 SMP Fri Mar 27 14:35:58 UTC 2020", 2020-09-08T15:26:54.549 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_version": "4.18.0-193.el8.x86_64", 2020-09-08T15:26:54.549 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_swap_kb": "0", 2020-09-08T15:26:54.550 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_total_kb": "32653204", 2020-09-08T15:26:54.550 INFO:tasks.workunit.client.0.smithi065.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2020-09-08T15:26:54.550 INFO:tasks.workunit.client.0.smithi065.stdout: "objectstore_numa_unknown_devices": "sda", 2020-09-08T15:26:54.550 INFO:tasks.workunit.client.0.smithi065.stdout: "os": "Linux", 2020-09-08T15:26:54.551 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_data": "td/divergent-priors/0", 2020-09-08T15:26:54.551 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T15:26:54.551 INFO:tasks.workunit.client.0.smithi065.stdout: "osdspec_affinity": "", 2020-09-08T15:26:54.551 INFO:tasks.workunit.client.0.smithi065.stdout: "rotational": "1" 2020-09-08T15:26:54.552 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.552 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.552 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:26:54.552 INFO:tasks.workunit.client.0.smithi065.stdout: "arch": "x86_64", 2020-09-08T15:26:54.552 INFO:tasks.workunit.client.0.smithi065.stdout: "back_addr": "[v2:127.0.0.1:6812/42495,v1:127.0.0.1:6813/42495]", 2020-09-08T15:26:54.553 INFO:tasks.workunit.client.0.smithi065.stdout: "back_iface": "", 2020-09-08T15:26:54.553 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs": "1", 2020-09-08T15:26:54.553 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_db": "0", 2020-09-08T15:26:54.553 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_wal": "0", 2020-09-08T15:26:54.554 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_single_shared_device": "1", 2020-09-08T15:26:54.554 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T15:26:54.554 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T15:26:54.554 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T15:26:54.555 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T15:26:54.555 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2020-09-08T15:26:54.555 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T15:26:54.555 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T15:26:54.555 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T15:26:54.556 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T15:26:54.556 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_release": "pacific", 2020-09-08T15:26:54.556 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version": "ceph version 16.0.0-5272-gdce4d291bd4 (dce4d291bd4243c9802c17d67b85a6da6bbc0f8f) pacific (dev)", 2020-09-08T15:26:54.556 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version_short": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:26:54.556 INFO:tasks.workunit.client.0.smithi065.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-09-08T15:26:54.557 INFO:tasks.workunit.client.0.smithi065.stdout: "default_device_class": "hdd", 2020-09-08T15:26:54.557 INFO:tasks.workunit.client.0.smithi065.stdout: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W4VHBH", 2020-09-08T15:26:54.557 INFO:tasks.workunit.client.0.smithi065.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2020-09-08T15:26:54.557 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": "sda", 2020-09-08T15:26:54.557 INFO:tasks.workunit.client.0.smithi065.stdout: "distro": "rhel", 2020-09-08T15:26:54.558 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_description": "Red Hat Enterprise Linux 8.1 (Ootpa)", 2020-09-08T15:26:54.558 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_version": "8.1", 2020-09-08T15:26:54.558 INFO:tasks.workunit.client.0.smithi065.stdout: "front_addr": "[v2:127.0.0.1:6810/42495,v1:127.0.0.1:6811/42495]", 2020-09-08T15:26:54.558 INFO:tasks.workunit.client.0.smithi065.stdout: "front_iface": "", 2020-09-08T15:26:54.559 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/42495,v1:127.0.0.1:6817/42495]", 2020-09-08T15:26:54.559 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/42495,v1:127.0.0.1:6815/42495]", 2020-09-08T15:26:54.559 INFO:tasks.workunit.client.0.smithi065.stdout: "hostname": "smithi065", 2020-09-08T15:26:54.559 INFO:tasks.workunit.client.0.smithi065.stdout: "journal_rotational": "1", 2020-09-08T15:26:54.559 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_description": "#1 SMP Fri Mar 27 14:35:58 UTC 2020", 2020-09-08T15:26:54.560 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_version": "4.18.0-193.el8.x86_64", 2020-09-08T15:26:54.560 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_swap_kb": "0", 2020-09-08T15:26:54.561 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_total_kb": "32653204", 2020-09-08T15:26:54.561 INFO:tasks.workunit.client.0.smithi065.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2020-09-08T15:26:54.561 INFO:tasks.workunit.client.0.smithi065.stdout: "objectstore_numa_unknown_devices": "sda", 2020-09-08T15:26:54.561 INFO:tasks.workunit.client.0.smithi065.stdout: "os": "Linux", 2020-09-08T15:26:54.561 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_data": "td/divergent-priors/1", 2020-09-08T15:26:54.562 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T15:26:54.562 INFO:tasks.workunit.client.0.smithi065.stdout: "osdspec_affinity": "", 2020-09-08T15:26:54.563 INFO:tasks.workunit.client.0.smithi065.stdout: "rotational": "1" 2020-09-08T15:26:54.563 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.563 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.564 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:26:54.564 INFO:tasks.workunit.client.0.smithi065.stdout: "arch": "x86_64", 2020-09-08T15:26:54.565 INFO:tasks.workunit.client.0.smithi065.stdout: "back_addr": "[v2:127.0.0.1:6812/47801,v1:127.0.0.1:6813/47801]", 2020-09-08T15:26:54.565 INFO:tasks.workunit.client.0.smithi065.stdout: "back_iface": "", 2020-09-08T15:26:54.565 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs": "1", 2020-09-08T15:26:54.565 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_db": "0", 2020-09-08T15:26:54.565 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_wal": "0", 2020-09-08T15:26:54.566 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_single_shared_device": "1", 2020-09-08T15:26:54.566 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T15:26:54.566 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T15:26:54.566 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T15:26:54.567 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T15:26:54.567 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2020-09-08T15:26:54.567 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T15:26:54.567 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T15:26:54.567 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T15:26:54.568 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T15:26:54.568 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_release": "pacific", 2020-09-08T15:26:54.568 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version": "ceph version 16.0.0-5272-gdce4d291bd4 (dce4d291bd4243c9802c17d67b85a6da6bbc0f8f) pacific (dev)", 2020-09-08T15:26:54.569 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version_short": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:26:54.569 INFO:tasks.workunit.client.0.smithi065.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-09-08T15:26:54.569 INFO:tasks.workunit.client.0.smithi065.stdout: "default_device_class": "hdd", 2020-09-08T15:26:54.569 INFO:tasks.workunit.client.0.smithi065.stdout: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W4VHBH", 2020-09-08T15:26:54.570 INFO:tasks.workunit.client.0.smithi065.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2020-09-08T15:26:54.570 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": "sda", 2020-09-08T15:26:54.570 INFO:tasks.workunit.client.0.smithi065.stdout: "distro": "rhel", 2020-09-08T15:26:54.571 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_description": "Red Hat Enterprise Linux 8.1 (Ootpa)", 2020-09-08T15:26:54.571 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_version": "8.1", 2020-09-08T15:26:54.571 INFO:tasks.workunit.client.0.smithi065.stdout: "front_addr": "[v2:127.0.0.1:6810/47801,v1:127.0.0.1:6811/47801]", 2020-09-08T15:26:54.571 INFO:tasks.workunit.client.0.smithi065.stdout: "front_iface": "", 2020-09-08T15:26:54.571 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/47801,v1:127.0.0.1:6817/47801]", 2020-09-08T15:26:54.572 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/47801,v1:127.0.0.1:6815/47801]", 2020-09-08T15:26:54.572 INFO:tasks.workunit.client.0.smithi065.stdout: "hostname": "smithi065", 2020-09-08T15:26:54.572 INFO:tasks.workunit.client.0.smithi065.stdout: "journal_rotational": "1", 2020-09-08T15:26:54.572 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_description": "#1 SMP Fri Mar 27 14:35:58 UTC 2020", 2020-09-08T15:26:54.572 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_version": "4.18.0-193.el8.x86_64", 2020-09-08T15:26:54.572 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_swap_kb": "0", 2020-09-08T15:26:54.573 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_total_kb": "32653204", 2020-09-08T15:26:54.573 INFO:tasks.workunit.client.0.smithi065.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2020-09-08T15:26:54.573 INFO:tasks.workunit.client.0.smithi065.stdout: "objectstore_numa_unknown_devices": "sda", 2020-09-08T15:26:54.573 INFO:tasks.workunit.client.0.smithi065.stdout: "os": "Linux", 2020-09-08T15:26:54.573 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_data": "td/divergent-priors/2", 2020-09-08T15:26:54.574 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T15:26:54.574 INFO:tasks.workunit.client.0.smithi065.stdout: "osdspec_affinity": "", 2020-09-08T15:26:54.574 INFO:tasks.workunit.client.0.smithi065.stdout: "rotational": "1" 2020-09-08T15:26:54.574 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.574 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:26:54.575 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap_clean_epochs": { 2020-09-08T15:26:54.575 INFO:tasks.workunit.client.0.smithi065.stdout: "min_last_epoch_clean": 0, 2020-09-08T15:26:54.575 INFO:tasks.workunit.client.0.smithi065.stdout: "last_epoch_clean": { 2020-09-08T15:26:54.575 INFO:tasks.workunit.client.0.smithi065.stdout: "per_pool": [] 2020-09-08T15:26:54.575 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.576 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_epochs": [ 2020-09-08T15:26:54.576 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.576 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:26:54.576 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 35 2020-09-08T15:26:54.576 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.577 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.577 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:26:54.577 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 10 2020-09-08T15:26:54.577 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.577 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.578 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:26:54.578 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 37 2020-09-08T15:26:54.578 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.578 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.578 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.579 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap_first_committed": 1, 2020-09-08T15:26:54.579 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap_last_committed": 39, 2020-09-08T15:26:54.579 INFO:tasks.workunit.client.0.smithi065.stdout: "crushmap": { 2020-09-08T15:26:54.579 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": [ 2020-09-08T15:26:54.579 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.580 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:26:54.580 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd.0", 2020-09-08T15:26:54.580 INFO:tasks.workunit.client.0.smithi065.stdout: "class": "hdd" 2020-09-08T15:26:54.580 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.580 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.581 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:26:54.581 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd.1", 2020-09-08T15:26:54.581 INFO:tasks.workunit.client.0.smithi065.stdout: "class": "hdd" 2020-09-08T15:26:54.581 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.581 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.582 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:26:54.582 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd.2", 2020-09-08T15:26:54.583 INFO:tasks.workunit.client.0.smithi065.stdout: "class": "hdd" 2020-09-08T15:26:54.583 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.583 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:26:54.583 INFO:tasks.workunit.client.0.smithi065.stdout: "types": [ 2020-09-08T15:26:54.583 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.584 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 0, 2020-09-08T15:26:54.584 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd" 2020-09-08T15:26:54.584 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.584 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.584 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 1, 2020-09-08T15:26:54.585 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "host" 2020-09-08T15:26:54.585 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.585 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.585 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 2, 2020-09-08T15:26:54.585 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "chassis" 2020-09-08T15:26:54.585 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.586 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.586 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 3, 2020-09-08T15:26:54.586 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "rack" 2020-09-08T15:26:54.586 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.586 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.587 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 4, 2020-09-08T15:26:54.587 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "row" 2020-09-08T15:26:54.587 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.587 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.587 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 5, 2020-09-08T15:26:54.588 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "pdu" 2020-09-08T15:26:54.588 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.588 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.588 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 6, 2020-09-08T15:26:54.588 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "pod" 2020-09-08T15:26:54.588 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.589 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.589 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 7, 2020-09-08T15:26:54.589 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "room" 2020-09-08T15:26:54.589 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.589 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.590 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 8, 2020-09-08T15:26:54.590 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "datacenter" 2020-09-08T15:26:54.590 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.590 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.590 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 9, 2020-09-08T15:26:54.590 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "zone" 2020-09-08T15:26:54.591 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.591 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.591 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 10, 2020-09-08T15:26:54.591 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "region" 2020-09-08T15:26:54.591 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.592 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.592 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 11, 2020-09-08T15:26:54.592 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "root" 2020-09-08T15:26:54.592 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.592 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:26:54.592 INFO:tasks.workunit.client.0.smithi065.stdout: "buckets": [ 2020-09-08T15:26:54.593 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.593 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -1, 2020-09-08T15:26:54.593 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "default", 2020-09-08T15:26:54.593 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 11, 2020-09-08T15:26:54.593 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "root", 2020-09-08T15:26:54.594 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:26:54.594 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:26:54.594 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:26:54.594 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:26:54.594 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.595 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -3, 2020-09-08T15:26:54.595 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:26:54.595 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:26:54.595 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.595 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.596 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.596 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.596 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -2, 2020-09-08T15:26:54.596 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "default~hdd", 2020-09-08T15:26:54.596 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 11, 2020-09-08T15:26:54.597 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "root", 2020-09-08T15:26:54.597 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:26:54.597 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:26:54.597 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:26:54.597 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:26:54.598 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.598 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -4, 2020-09-08T15:26:54.598 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:26:54.598 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:26:54.598 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.598 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.599 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.599 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.599 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -3, 2020-09-08T15:26:54.599 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "smithi065", 2020-09-08T15:26:54.599 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 1, 2020-09-08T15:26:54.600 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "host", 2020-09-08T15:26:54.600 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:26:54.600 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:26:54.600 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:26:54.600 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:26:54.600 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.601 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:26:54.601 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:26:54.601 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:26:54.601 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.601 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.602 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:26:54.602 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:26:54.602 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 1 2020-09-08T15:26:54.602 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.602 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.603 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:26:54.603 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:26:54.603 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 2 2020-09-08T15:26:54.603 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.603 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.604 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.604 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.604 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -4, 2020-09-08T15:26:54.604 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "smithi065~hdd", 2020-09-08T15:26:54.604 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 1, 2020-09-08T15:26:54.605 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "host", 2020-09-08T15:26:54.605 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:26:54.605 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:26:54.605 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:26:54.605 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:26:54.605 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.606 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:26:54.606 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:26:54.606 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:26:54.606 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.606 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.607 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:26:54.607 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:26:54.607 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 1 2020-09-08T15:26:54.607 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.607 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.607 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:26:54.608 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:26:54.608 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 2 2020-09-08T15:26:54.608 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.608 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.608 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.609 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:26:54.609 INFO:tasks.workunit.client.0.smithi065.stdout: "rules": [ 2020-09-08T15:26:54.609 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.609 INFO:tasks.workunit.client.0.smithi065.stdout: "rule_id": 0, 2020-09-08T15:26:54.609 INFO:tasks.workunit.client.0.smithi065.stdout: "rule_name": "replicated_rule", 2020-09-08T15:26:54.610 INFO:tasks.workunit.client.0.smithi065.stdout: "ruleset": 0, 2020-09-08T15:26:54.610 INFO:tasks.workunit.client.0.smithi065.stdout: "type": 1, 2020-09-08T15:26:54.610 INFO:tasks.workunit.client.0.smithi065.stdout: "min_size": 1, 2020-09-08T15:26:54.610 INFO:tasks.workunit.client.0.smithi065.stdout: "max_size": 10, 2020-09-08T15:26:54.610 INFO:tasks.workunit.client.0.smithi065.stdout: "steps": [ 2020-09-08T15:26:54.611 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.611 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "take", 2020-09-08T15:26:54.611 INFO:tasks.workunit.client.0.smithi065.stdout: "item": -1, 2020-09-08T15:26:54.611 INFO:tasks.workunit.client.0.smithi065.stdout: "item_name": "default" 2020-09-08T15:26:54.612 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.612 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.612 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "choose_firstn", 2020-09-08T15:26:54.612 INFO:tasks.workunit.client.0.smithi065.stdout: "num": 0, 2020-09-08T15:26:54.612 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "osd" 2020-09-08T15:26:54.612 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.613 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.613 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "emit" 2020-09-08T15:26:54.613 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.613 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:26:54.613 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.614 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:26:54.614 INFO:tasks.workunit.client.0.smithi065.stdout: "tunables": { 2020-09-08T15:26:54.614 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_local_tries": 0, 2020-09-08T15:26:54.614 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_local_fallback_tries": 0, 2020-09-08T15:26:54.614 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_total_tries": 50, 2020-09-08T15:26:54.615 INFO:tasks.workunit.client.0.smithi065.stdout: "chooseleaf_descend_once": 1, 2020-09-08T15:26:54.615 INFO:tasks.workunit.client.0.smithi065.stdout: "chooseleaf_vary_r": 1, 2020-09-08T15:26:54.615 INFO:tasks.workunit.client.0.smithi065.stdout: "chooseleaf_stable": 1, 2020-09-08T15:26:54.615 INFO:tasks.workunit.client.0.smithi065.stdout: "straw_calc_version": 1, 2020-09-08T15:26:54.615 INFO:tasks.workunit.client.0.smithi065.stdout: "allowed_bucket_algs": 54, 2020-09-08T15:26:54.616 INFO:tasks.workunit.client.0.smithi065.stdout: "profile": "jewel", 2020-09-08T15:26:54.616 INFO:tasks.workunit.client.0.smithi065.stdout: "optimal_tunables": 1, 2020-09-08T15:26:54.616 INFO:tasks.workunit.client.0.smithi065.stdout: "legacy_tunables": 0, 2020-09-08T15:26:54.616 INFO:tasks.workunit.client.0.smithi065.stdout: "minimum_required_version": "jewel", 2020-09-08T15:26:54.616 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables": 1, 2020-09-08T15:26:54.617 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables2": 1, 2020-09-08T15:26:54.617 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v2_rules": 0, 2020-09-08T15:26:54.617 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables3": 1, 2020-09-08T15:26:54.617 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v3_rules": 0, 2020-09-08T15:26:54.617 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v4_buckets": 1, 2020-09-08T15:26:54.617 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables5": 1, 2020-09-08T15:26:54.618 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v5_rules": 0 2020-09-08T15:26:54.618 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.618 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_args": {} 2020-09-08T15:26:54.618 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.618 INFO:tasks.workunit.client.0.smithi065.stdout: "fsmap": { 2020-09-08T15:26:54.619 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 1, 2020-09-08T15:26:54.619 INFO:tasks.workunit.client.0.smithi065.stdout: "default_fscid": -1, 2020-09-08T15:26:54.619 INFO:tasks.workunit.client.0.smithi065.stdout: "compat": { 2020-09-08T15:26:54.619 INFO:tasks.workunit.client.0.smithi065.stdout: "compat": {}, 2020-09-08T15:26:54.619 INFO:tasks.workunit.client.0.smithi065.stdout: "ro_compat": {}, 2020-09-08T15:26:54.620 INFO:tasks.workunit.client.0.smithi065.stdout: "incompat": { 2020-09-08T15:26:54.620 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_1": "base v0.20", 2020-09-08T15:26:54.620 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_2": "client writeable ranges", 2020-09-08T15:26:54.620 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_3": "default file layouts on dirs", 2020-09-08T15:26:54.620 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_4": "dir inode in separate object", 2020-09-08T15:26:54.621 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_5": "mds uses versioned encoding", 2020-09-08T15:26:54.621 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_6": "dirfrag is stored in omap", 2020-09-08T15:26:54.621 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_8": "no anchor table", 2020-09-08T15:26:54.621 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_9": "file layout v2", 2020-09-08T15:26:54.621 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_10": "snaprealm v2" 2020-09-08T15:26:54.622 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.622 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.622 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_flags": { 2020-09-08T15:26:54.622 INFO:tasks.workunit.client.0.smithi065.stdout: "enable_multiple": false, 2020-09-08T15:26:54.622 INFO:tasks.workunit.client.0.smithi065.stdout: "ever_enabled_multiple": false 2020-09-08T15:26:54.622 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.623 INFO:tasks.workunit.client.0.smithi065.stdout: "standbys": [], 2020-09-08T15:26:54.623 INFO:tasks.workunit.client.0.smithi065.stdout: "filesystems": [] 2020-09-08T15:26:54.623 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.623 INFO:tasks.workunit.client.0.smithi065.stdout: "mdsmap_first_committed": 1, 2020-09-08T15:26:54.623 INFO:tasks.workunit.client.0.smithi065.stdout: "mdsmap_last_committed": 1, 2020-09-08T15:26:54.624 INFO:tasks.workunit.client.0.smithi065.stdout: "auth": { 2020-09-08T15:26:54.624 INFO:tasks.workunit.client.0.smithi065.stdout: "first_committed": 1, 2020-09-08T15:26:54.624 INFO:tasks.workunit.client.0.smithi065.stdout: "last_committed": 5, 2020-09-08T15:26:54.624 INFO:tasks.workunit.client.0.smithi065.stdout: "num_secrets": 3 2020-09-08T15:26:54.625 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.625 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg": 1, 2020-09-08T15:26:54.625 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_active": 1, 2020-09-08T15:26:54.625 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_unknown": 0, 2020-09-08T15:26:54.625 INFO:tasks.workunit.client.0.smithi065.stdout: "num_osd": 3, 2020-09-08T15:26:54.626 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_sum": { 2020-09-08T15:26:54.626 INFO:tasks.workunit.client.0.smithi065.stdout: "stat_sum": { 2020-09-08T15:26:54.626 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes": 48300, 2020-09-08T15:26:54.626 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects": 100, 2020-09-08T15:26:54.626 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_clones": 0, 2020-09-08T15:26:54.627 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_copies": 300, 2020-09-08T15:26:54.627 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing_on_primary": 0, 2020-09-08T15:26:54.627 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing": 0, 2020-09-08T15:26:54.627 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_degraded": 100, 2020-09-08T15:26:54.627 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_misplaced": 0, 2020-09-08T15:26:54.627 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_unfound": 0, 2020-09-08T15:26:54.628 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_dirty": 100, 2020-09-08T15:26:54.628 INFO:tasks.workunit.client.0.smithi065.stdout: "num_whiteouts": 0, 2020-09-08T15:26:54.628 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read": 0, 2020-09-08T15:26:54.628 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read_kb": 0, 2020-09-08T15:26:54.628 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write": 100, 2020-09-08T15:26:54.629 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write_kb": 100, 2020-09-08T15:26:54.629 INFO:tasks.workunit.client.0.smithi065.stdout: "num_scrub_errors": 0, 2020-09-08T15:26:54.629 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shallow_scrub_errors": 0, 2020-09-08T15:26:54.629 INFO:tasks.workunit.client.0.smithi065.stdout: "num_deep_scrub_errors": 0, 2020-09-08T15:26:54.629 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_recovered": 0, 2020-09-08T15:26:54.629 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_recovered": 0, 2020-09-08T15:26:54.630 INFO:tasks.workunit.client.0.smithi065.stdout: "num_keys_recovered": 0, 2020-09-08T15:26:54.630 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_omap": 0, 2020-09-08T15:26:54.630 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_hit_set_archive": 0, 2020-09-08T15:26:54.630 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_hit_set_archive": 0, 2020-09-08T15:26:54.630 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush": 0, 2020-09-08T15:26:54.631 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_kb": 0, 2020-09-08T15:26:54.631 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict": 0, 2020-09-08T15:26:54.631 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_kb": 0, 2020-09-08T15:26:54.631 INFO:tasks.workunit.client.0.smithi065.stdout: "num_promote": 0, 2020-09-08T15:26:54.631 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_high": 0, 2020-09-08T15:26:54.631 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_low": 0, 2020-09-08T15:26:54.632 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_some": 0, 2020-09-08T15:26:54.632 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_full": 0, 2020-09-08T15:26:54.632 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_pinned": 0, 2020-09-08T15:26:54.632 INFO:tasks.workunit.client.0.smithi065.stdout: "num_legacy_snapsets": 0, 2020-09-08T15:26:54.632 INFO:tasks.workunit.client.0.smithi065.stdout: "num_large_omap_objects": 0, 2020-09-08T15:26:54.633 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_manifest": 0, 2020-09-08T15:26:54.633 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_bytes": 0, 2020-09-08T15:26:54.633 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_keys": 0, 2020-09-08T15:26:54.633 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_repaired": 0 2020-09-08T15:26:54.633 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.633 INFO:tasks.workunit.client.0.smithi065.stdout: "store_stats": { 2020-09-08T15:26:54.634 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 0, 2020-09-08T15:26:54.634 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 0, 2020-09-08T15:26:54.634 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:26:54.634 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 0, 2020-09-08T15:26:54.634 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 0, 2020-09-08T15:26:54.635 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:26:54.635 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:26:54.635 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:26:54.635 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 0, 2020-09-08T15:26:54.635 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 0 2020-09-08T15:26:54.636 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.636 INFO:tasks.workunit.client.0.smithi065.stdout: "log_size": 16, 2020-09-08T15:26:54.636 INFO:tasks.workunit.client.0.smithi065.stdout: "ondisk_log_size": 16, 2020-09-08T15:26:54.636 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 2, 2020-09-08T15:26:54.636 INFO:tasks.workunit.client.0.smithi065.stdout: "acting": 2, 2020-09-08T15:26:54.636 INFO:tasks.workunit.client.0.smithi065.stdout: "num_store_stats": 0 2020-09-08T15:26:54.637 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.637 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_sum": { 2020-09-08T15:26:54.637 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 0, 2020-09-08T15:26:54.637 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 0, 2020-09-08T15:26:54.638 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pgs": 3, 2020-09-08T15:26:54.638 INFO:tasks.workunit.client.0.smithi065.stdout: "num_osds": 3, 2020-09-08T15:26:54.638 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_osds": 3, 2020-09-08T15:26:54.638 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_omap_osds": 3, 2020-09-08T15:26:54.638 INFO:tasks.workunit.client.0.smithi065.stdout: "kb": 314572800, 2020-09-08T15:26:54.638 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used": 18168, 2020-09-08T15:26:54.639 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_data": 2072, 2020-09-08T15:26:54.639 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_omap": 1, 2020-09-08T15:26:54.639 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_meta": 16062, 2020-09-08T15:26:54.639 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_avail": 314554632, 2020-09-08T15:26:54.639 INFO:tasks.workunit.client.0.smithi065.stdout: "statfs": { 2020-09-08T15:26:54.640 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 322122547200, 2020-09-08T15:26:54.640 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 322103943168, 2020-09-08T15:26:54.640 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:26:54.640 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 2121728, 2020-09-08T15:26:54.640 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 403244, 2020-09-08T15:26:54.641 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:26:54.641 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:26:54.641 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:26:54.641 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 1928, 2020-09-08T15:26:54.641 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 16447608 2020-09-08T15:26:54.641 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.642 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_peers": [], 2020-09-08T15:26:54.642 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_trim_queue_len": 0, 2020-09-08T15:26:54.642 INFO:tasks.workunit.client.0.smithi065.stdout: "num_snap_trimming": 0, 2020-09-08T15:26:54.642 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shards_repaired": 0, 2020-09-08T15:26:54.642 INFO:tasks.workunit.client.0.smithi065.stdout: "op_queue_age_hist": { 2020-09-08T15:26:54.643 INFO:tasks.workunit.client.0.smithi065.stdout: "histogram": [], 2020-09-08T15:26:54.643 INFO:tasks.workunit.client.0.smithi065.stdout: "upper_bound": 1 2020-09-08T15:26:54.643 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.643 INFO:tasks.workunit.client.0.smithi065.stdout: "perf_stat": { 2020-09-08T15:26:54.643 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ms": 0, 2020-09-08T15:26:54.643 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ms": 0, 2020-09-08T15:26:54.644 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ns": 0, 2020-09-08T15:26:54.644 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ns": 0 2020-09-08T15:26:54.644 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.644 INFO:tasks.workunit.client.0.smithi065.stdout: "alerts": [], 2020-09-08T15:26:54.644 INFO:tasks.workunit.client.0.smithi065.stdout: "network_ping_times": [] 2020-09-08T15:26:54.645 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.645 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_sum_by_class": { 2020-09-08T15:26:54.645 INFO:tasks.workunit.client.0.smithi065.stdout: "hdd": { 2020-09-08T15:26:54.645 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 0, 2020-09-08T15:26:54.645 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 0, 2020-09-08T15:26:54.646 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pgs": 3, 2020-09-08T15:26:54.646 INFO:tasks.workunit.client.0.smithi065.stdout: "num_osds": 3, 2020-09-08T15:26:54.646 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_osds": 3, 2020-09-08T15:26:54.646 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_omap_osds": 3, 2020-09-08T15:26:54.646 INFO:tasks.workunit.client.0.smithi065.stdout: "kb": 314572800, 2020-09-08T15:26:54.647 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used": 18168, 2020-09-08T15:26:54.647 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_data": 2072, 2020-09-08T15:26:54.647 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_omap": 1, 2020-09-08T15:26:54.647 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_meta": 16062, 2020-09-08T15:26:54.647 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_avail": 314554632, 2020-09-08T15:26:54.647 INFO:tasks.workunit.client.0.smithi065.stdout: "statfs": { 2020-09-08T15:26:54.648 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 322122547200, 2020-09-08T15:26:54.648 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 322103943168, 2020-09-08T15:26:54.648 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:26:54.648 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 2121728, 2020-09-08T15:26:54.648 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 403244, 2020-09-08T15:26:54.649 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:26:54.649 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:26:54.649 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:26:54.649 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 1928, 2020-09-08T15:26:54.649 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 16447608 2020-09-08T15:26:54.649 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.650 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_peers": [], 2020-09-08T15:26:54.650 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_trim_queue_len": 0, 2020-09-08T15:26:54.650 INFO:tasks.workunit.client.0.smithi065.stdout: "num_snap_trimming": 0, 2020-09-08T15:26:54.650 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shards_repaired": 0, 2020-09-08T15:26:54.650 INFO:tasks.workunit.client.0.smithi065.stdout: "op_queue_age_hist": { 2020-09-08T15:26:54.651 INFO:tasks.workunit.client.0.smithi065.stdout: "histogram": [], 2020-09-08T15:26:54.651 INFO:tasks.workunit.client.0.smithi065.stdout: "upper_bound": 1 2020-09-08T15:26:54.651 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.651 INFO:tasks.workunit.client.0.smithi065.stdout: "perf_stat": { 2020-09-08T15:26:54.651 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ms": 0, 2020-09-08T15:26:54.651 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ms": 0, 2020-09-08T15:26:54.652 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ns": 0, 2020-09-08T15:26:54.652 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ns": 0 2020-09-08T15:26:54.652 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.652 INFO:tasks.workunit.client.0.smithi065.stdout: "alerts": [], 2020-09-08T15:26:54.652 INFO:tasks.workunit.client.0.smithi065.stdout: "network_ping_times": [] 2020-09-08T15:26:54.653 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.653 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.653 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_stats": [ 2020-09-08T15:26:54.653 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.653 INFO:tasks.workunit.client.0.smithi065.stdout: "poolid": 1, 2020-09-08T15:26:54.654 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg": 1, 2020-09-08T15:26:54.654 INFO:tasks.workunit.client.0.smithi065.stdout: "stat_sum": { 2020-09-08T15:26:54.654 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes": 48300, 2020-09-08T15:26:54.654 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects": 100, 2020-09-08T15:26:54.654 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_clones": 0, 2020-09-08T15:26:54.654 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_copies": 300, 2020-09-08T15:26:54.655 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing_on_primary": 0, 2020-09-08T15:26:54.655 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing": 0, 2020-09-08T15:26:54.655 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_degraded": 100, 2020-09-08T15:26:54.655 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_misplaced": 0, 2020-09-08T15:26:54.655 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_unfound": 0, 2020-09-08T15:26:54.656 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_dirty": 100, 2020-09-08T15:26:54.656 INFO:tasks.workunit.client.0.smithi065.stdout: "num_whiteouts": 0, 2020-09-08T15:26:54.656 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read": 0, 2020-09-08T15:26:54.656 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read_kb": 0, 2020-09-08T15:26:54.656 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write": 100, 2020-09-08T15:26:54.657 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write_kb": 100, 2020-09-08T15:26:54.657 INFO:tasks.workunit.client.0.smithi065.stdout: "num_scrub_errors": 0, 2020-09-08T15:26:54.657 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shallow_scrub_errors": 0, 2020-09-08T15:26:54.657 INFO:tasks.workunit.client.0.smithi065.stdout: "num_deep_scrub_errors": 0, 2020-09-08T15:26:54.657 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_recovered": 0, 2020-09-08T15:26:54.658 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_recovered": 0, 2020-09-08T15:26:54.658 INFO:tasks.workunit.client.0.smithi065.stdout: "num_keys_recovered": 0, 2020-09-08T15:26:54.658 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_omap": 0, 2020-09-08T15:26:54.658 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_hit_set_archive": 0, 2020-09-08T15:26:54.658 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_hit_set_archive": 0, 2020-09-08T15:26:54.658 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush": 0, 2020-09-08T15:26:54.659 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_kb": 0, 2020-09-08T15:26:54.659 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict": 0, 2020-09-08T15:26:54.659 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_kb": 0, 2020-09-08T15:26:54.659 INFO:tasks.workunit.client.0.smithi065.stdout: "num_promote": 0, 2020-09-08T15:26:54.659 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_high": 0, 2020-09-08T15:26:54.660 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_low": 0, 2020-09-08T15:26:54.660 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_some": 0, 2020-09-08T15:26:54.660 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_full": 0, 2020-09-08T15:26:54.660 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_pinned": 0, 2020-09-08T15:26:54.660 INFO:tasks.workunit.client.0.smithi065.stdout: "num_legacy_snapsets": 0, 2020-09-08T15:26:54.661 INFO:tasks.workunit.client.0.smithi065.stdout: "num_large_omap_objects": 0, 2020-09-08T15:26:54.661 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_manifest": 0, 2020-09-08T15:26:54.661 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_bytes": 0, 2020-09-08T15:26:54.661 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_keys": 0, 2020-09-08T15:26:54.662 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_repaired": 0 2020-09-08T15:26:54.662 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.662 INFO:tasks.workunit.client.0.smithi065.stdout: "store_stats": { 2020-09-08T15:26:54.662 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 0, 2020-09-08T15:26:54.664 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 0, 2020-09-08T15:26:54.664 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:26:54.664 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 1220608, 2020-09-08T15:26:54.664 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 143228, 2020-09-08T15:26:54.665 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:26:54.665 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:26:54.665 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:26:54.666 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 0, 2020-09-08T15:26:54.666 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 0 2020-09-08T15:26:54.666 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.666 INFO:tasks.workunit.client.0.smithi065.stdout: "log_size": 16, 2020-09-08T15:26:54.666 INFO:tasks.workunit.client.0.smithi065.stdout: "ondisk_log_size": 16, 2020-09-08T15:26:54.667 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 2, 2020-09-08T15:26:54.667 INFO:tasks.workunit.client.0.smithi065.stdout: "acting": 2, 2020-09-08T15:26:54.667 INFO:tasks.workunit.client.0.smithi065.stdout: "num_store_stats": 3 2020-09-08T15:26:54.667 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.667 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:26:54.668 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_stats": [ 2020-09-08T15:26:54.668 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.668 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:26:54.668 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 150323855370 2020-09-08T15:26:54.668 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.669 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.669 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:26:54.669 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 42949672977 2020-09-08T15:26:54.670 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.670 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.670 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:26:54.670 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 154618822666 2020-09-08T15:26:54.671 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.671 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:26:54.671 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_by_state": [ 2020-09-08T15:26:54.672 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.672 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "active+undersized+degraded", 2020-09-08T15:26:54.672 INFO:tasks.workunit.client.0.smithi065.stdout: "num": 1 2020-09-08T15:26:54.672 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.672 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:26:54.673 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_by_osd": [ 2020-09-08T15:26:54.673 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.673 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:26:54.673 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 0, 2020-09-08T15:26:54.673 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 1, 2020-09-08T15:26:54.674 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:26:54.674 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.674 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.674 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:26:54.674 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 0, 2020-09-08T15:26:54.675 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 0, 2020-09-08T15:26:54.675 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:26:54.675 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.675 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.675 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:26:54.675 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 1, 2020-09-08T15:26:54.676 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 1, 2020-09-08T15:26:54.676 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:26:54.676 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.676 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:26:54.676 INFO:tasks.workunit.client.0.smithi065.stdout: "purged_snaps": [ 2020-09-08T15:26:54.677 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:26:54.677 INFO:tasks.workunit.client.0.smithi065.stdout: "pool": 1, 2020-09-08T15:26:54.677 INFO:tasks.workunit.client.0.smithi065.stdout: "purged_snaps": {} 2020-09-08T15:26:54.677 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.677 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:26:54.678 INFO:tasks.workunit.client.0.smithi065.stdout: "servicemap": { 2020-09-08T15:26:54.678 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 4, 2020-09-08T15:26:54.678 INFO:tasks.workunit.client.0.smithi065.stdout: "modified": "2020-09-08T15:26:17.308847+0000", 2020-09-08T15:26:54.678 INFO:tasks.workunit.client.0.smithi065.stdout: "services": { 2020-09-08T15:26:54.678 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": { 2020-09-08T15:26:54.678 INFO:tasks.workunit.client.0.smithi065.stdout: "daemons": { 2020-09-08T15:26:54.679 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": "", 2020-09-08T15:26:54.679 INFO:tasks.workunit.client.0.smithi065.stdout: "0": { 2020-09-08T15:26:54.679 INFO:tasks.workunit.client.0.smithi065.stdout: "start_epoch": 0, 2020-09-08T15:26:54.679 INFO:tasks.workunit.client.0.smithi065.stdout: "start_stamp": "0.000000", 2020-09-08T15:26:54.679 INFO:tasks.workunit.client.0.smithi065.stdout: "gid": 0, 2020-09-08T15:26:54.680 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "(unrecognized address family 0)/0", 2020-09-08T15:26:54.680 INFO:tasks.workunit.client.0.smithi065.stdout: "metadata": {}, 2020-09-08T15:26:54.680 INFO:tasks.workunit.client.0.smithi065.stdout: "task_status": {} 2020-09-08T15:26:54.680 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.680 INFO:tasks.workunit.client.0.smithi065.stdout: "2": { 2020-09-08T15:26:54.681 INFO:tasks.workunit.client.0.smithi065.stdout: "start_epoch": 0, 2020-09-08T15:26:54.681 INFO:tasks.workunit.client.0.smithi065.stdout: "start_stamp": "0.000000", 2020-09-08T15:26:54.681 INFO:tasks.workunit.client.0.smithi065.stdout: "gid": 0, 2020-09-08T15:26:54.681 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "(unrecognized address family 0)/0", 2020-09-08T15:26:54.681 INFO:tasks.workunit.client.0.smithi065.stdout: "metadata": {}, 2020-09-08T15:26:54.682 INFO:tasks.workunit.client.0.smithi065.stdout: "task_status": {} 2020-09-08T15:26:54.682 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.682 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.682 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.683 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.683 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:26:54.683 INFO:tasks.workunit.client.0.smithi065.stdout: "paxos": { 2020-09-08T15:26:54.683 INFO:tasks.workunit.client.0.smithi065.stdout: "first_committed": 1, 2020-09-08T15:26:54.684 INFO:tasks.workunit.client.0.smithi065.stdout: "last_committed": 351, 2020-09-08T15:26:54.684 INFO:tasks.workunit.client.0.smithi065.stdout: "last_pn": 0, 2020-09-08T15:26:54.684 INFO:tasks.workunit.client.0.smithi065.stdout: "accepted_pn": 0 2020-09-08T15:26:54.684 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:26:54.684 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:26:54.685 INFO:tasks.workunit.client.0.smithi065.stderr:report 487794284 2020-09-08T15:26:54.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1604: wait_for_clean: return 1 2020-09-08T15:26:54.686 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:528: TEST_divergent_2: expr 2 + 2 2020-09-08T15:26:54.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:528: TEST_divergent_2: objname=existing_4 2020-09-08T15:26:54.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: echo 'writing non-divergent object existing_4' 2020-09-08T15:26:54.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:530: TEST_divergent_2: ceph pg dump pgs 2020-09-08T15:26:54.687 INFO:tasks.workunit.client.0.smithi065.stdout:writing non-divergent object existing_4 2020-09-08T15:26:54.761 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:26:54.761 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 0 100 0 0 48300 0 0 16 16 active+undersized+degraded 2020-09-08T15:26:17.932310+0000 29'100 39:120 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:25:25.927857+0000 0'0 2020-09-08T15:25:25.927857+0000 0 2020-09-08T15:26:54.763 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:26:54.763 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:26:54.765 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:26:54.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:531: TEST_divergent_2: rados -p test put existing_4 /etc/resolv.conf 2020-09-08T15:26:54.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:533: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2020-09-08T15:26:54.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:533: TEST_divergent_2: wait_for_clean 2020-09-08T15:26:54.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:26:54.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:26:54.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:26:54.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:26:54.891 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 20 .1 2020-09-08T15:26:54.892 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:26:54.892 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:26:54.892 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:26:54.892 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:26:54.892 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:26:54.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:26:54.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:26:54.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:26:54.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:26:54.946 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:26:55.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:26:55.352 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:26:55.352 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:26:55.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:26:55.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:26:55.352 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:26:55.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=150323855373 2020-09-08T15:26:55.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 150323855373 2020-09-08T15:26:55.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-150323855373' 2020-09-08T15:26:55.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:26:55.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:26:55.613 INFO:tasks.workunit.client.0.smithi065.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-09-08T15:26:55.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq= 2020-09-08T15:26:55.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z '' 2020-09-08T15:26:55.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: continue 2020-09-08T15:26:55.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:26:55.617 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:26:55.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=154618822668 2020-09-08T15:26:55.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 154618822668 2020-09-08T15:26:55.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-150323855373 2-154618822668' 2020-09-08T15:26:55.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:26:55.747 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-150323855373 2020-09-08T15:26:55.748 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:26:55.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:26:55.748 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-150323855373 2020-09-08T15:26:55.748 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:26:55.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=150323855373 2020-09-08T15:26:55.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 150323855373' 2020-09-08T15:26:55.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:26:55.749 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 150323855373 2020-09-08T15:26:56.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 150323855371 -lt 150323855373 2020-09-08T15:26:56.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:26:57.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:26:57.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:26:57.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 150323855373 -lt 150323855373 2020-09-08T15:26:57.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:26:57.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-154618822668 2020-09-08T15:26:57.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:26:57.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:26:57.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-154618822668 2020-09-08T15:26:57.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:26:57.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=154618822668 2020-09-08T15:26:57.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 154618822668' 2020-09-08T15:26:57.559 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:26:57.559 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 154618822668 2020-09-08T15:26:57.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 154618822669 -lt 154618822668 2020-09-08T15:26:57.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:26:57.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:26:57.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:26:58.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T15:26:58.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:26:58.477 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:26:58.477 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:26:58.477 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:26:58.478 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:26:58.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:26:58.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:26:58.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:26:58.867 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:26:58.868 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:26:58.868 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:26:59.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:26:59.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T15:26:59.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T15:26:59.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T15:26:59.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:26:59.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:26:59.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:26:59.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:26:59.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:26:59.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:26:59.516 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:26:59.516 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:26:59.516 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:26:59.516 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:26:59.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:26:59.904 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:26:59.905 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:26:59.905 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:27:00.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:27:00.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:27:00.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:27:00.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:27:00.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:27:00.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:27:00.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:27:00.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:27:00.443 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:27:00.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:27:00.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:27:00.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 1 >= 8 )) 2020-09-08T15:27:00.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:27:00.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.2 2020-09-08T15:27:01.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:27:01.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:27:01.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:27:01.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:27:01.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:27:01.176 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:27:01.176 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:27:01.176 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:27:01.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:27:01.563 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:27:01.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:27:01.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:27:02.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:27:02.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:27:02.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:27:02.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:27:02.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:27:02.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:27:02.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:27:02.091 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:27:02.091 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:27:02.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:27:02.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:27:02.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 2 >= 8 )) 2020-09-08T15:27:02.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:27:02.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.4 2020-09-08T15:27:03.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:27:03.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:27:03.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:27:03.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:27:03.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:27:03.020 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:27:03.020 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:27:03.020 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:27:03.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:27:03.419 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:27:03.419 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:27:03.420 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:27:03.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:27:03.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:27:03.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:27:03.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:27:03.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:27:03.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:27:03.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:27:03.953 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:27:03.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:27:04.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:27:04.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:27:04.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 3 >= 8 )) 2020-09-08T15:27:04.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:27:04.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.8 2020-09-08T15:27:05.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:27:05.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:27:05.296 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:27:05.297 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:27:05.297 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:27:05.297 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:27:05.297 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:27:05.297 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:27:05.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:27:05.691 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:27:05.691 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:27:05.691 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:27:06.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:27:06.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:27:06.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:27:06.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:27:06.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:27:06.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:27:06.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:27:06.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:27:06.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:27:06.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:27:06.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:27:06.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 4 >= 8 )) 2020-09-08T15:27:06.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:27:06.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 1.6 2020-09-08T15:27:08.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:27:08.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:27:08.333 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:27:08.333 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:27:08.334 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:27:08.334 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:27:08.334 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:27:08.334 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:27:08.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:27:08.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:27:08.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:27:08.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:27:09.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:27:09.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:27:09.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:27:09.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:27:09.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:27:09.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:27:09.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:27:09.254 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:27:09.254 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:27:09.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:27:09.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:27:09.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 5 >= 8 )) 2020-09-08T15:27:09.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:27:09.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 3.2 2020-09-08T15:27:12.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:27:12.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:27:12.988 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:27:12.989 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:27:12.989 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:27:12.989 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:27:12.989 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:27:12.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:27:13.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:27:13.389 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:27:13.390 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:27:13.390 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:27:13.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:27:13.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:27:13.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:27:13.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:27:13.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:27:13.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:27:13.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:27:13.933 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:27:13.933 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:27:14.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:27:14.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:27:14.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 6 >= 8 )) 2020-09-08T15:27:14.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:27:14.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 6.4 2020-09-08T15:27:20.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:27:20.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:27:20.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:27:20.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:27:20.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:27:20.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:27:20.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:27:20.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:27:21.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:27:21.332 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:27:21.332 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:27:21.332 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:27:21.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:27:21.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:27:21.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:27:21.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:27:21.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:27:21.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:27:21.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:27:21.861 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:27:21.861 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:27:22.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:27:22.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:27:22.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 7 >= 8 )) 2020-09-08T15:27:22.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:27:22.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 7.3 2020-09-08T15:27:29.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:27:29.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:27:29.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:27:29.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:27:29.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:27:29.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:27:29.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:27:29.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:27:30.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:27:30.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:27:30.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:27:30.163 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:27:30.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:27:30.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:27:30.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:27:30.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:27:30.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:27:30.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:27:30.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:27:30.700 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:27:30.701 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:27:31.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:27:31.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:27:31.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 8 >= 8 )) 2020-09-08T15:27:31.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: wait_for_clean: ceph report 2020-09-08T15:27:31.975 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:27:31.976 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_fingerprint": "b1755866-7906-482e-a973-0c1469821204", 2020-09-08T15:27:31.976 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:27:31.976 INFO:tasks.workunit.client.0.smithi065.stdout: "commit": "dce4d291bd4243c9802c17d67b85a6da6bbc0f8f", 2020-09-08T15:27:31.977 INFO:tasks.workunit.client.0.smithi065.stdout: "timestamp": "2020-09-08T15:27:31.979098+0000", 2020-09-08T15:27:31.977 INFO:tasks.workunit.client.0.smithi065.stdout: "tag": "", 2020-09-08T15:27:31.977 INFO:tasks.workunit.client.0.smithi065.stdout: "health": { 2020-09-08T15:27:31.977 INFO:tasks.workunit.client.0.smithi065.stdout: "status": "HEALTH_WARN", 2020-09-08T15:27:31.977 INFO:tasks.workunit.client.0.smithi065.stdout: "checks": { 2020-09-08T15:27:31.978 INFO:tasks.workunit.client.0.smithi065.stdout: "OSDMAP_FLAGS": { 2020-09-08T15:27:31.978 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:27:31.978 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:27:31.978 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "nodown,noout,noin flag(s) set", 2020-09-08T15:27:31.978 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 17 2020-09-08T15:27:31.979 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:31.979 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [], 2020-09-08T15:27:31.979 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:27:31.979 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:31.979 INFO:tasks.workunit.client.0.smithi065.stdout: "OSD_DOWN": { 2020-09-08T15:27:31.980 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:27:31.980 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:27:31.980 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "1 osds down", 2020-09-08T15:27:31.980 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 1 2020-09-08T15:27:31.980 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:31.980 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [ 2020-09-08T15:27:31.981 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:31.981 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "osd.1 (root=default,host=smithi065) is down" 2020-09-08T15:27:31.981 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:31.981 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:27:31.981 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:27:31.982 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:31.982 INFO:tasks.workunit.client.0.smithi065.stdout: "PG_DEGRADED": { 2020-09-08T15:27:31.982 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:27:31.982 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:27:31.983 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded, 1 pg undersized", 2020-09-08T15:27:31.983 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 2 2020-09-08T15:27:31.983 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:31.983 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [ 2020-09-08T15:27:31.983 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:31.984 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.0 is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:27:31.984 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:31.984 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:27:31.984 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:27:31.984 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:31.984 INFO:tasks.workunit.client.0.smithi065.stdout: "POOL_APP_NOT_ENABLED": { 2020-09-08T15:27:31.985 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:27:31.985 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:27:31.985 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "1 pool(s) do not have an application enabled", 2020-09-08T15:27:31.987 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 1 2020-09-08T15:27:31.987 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:31.987 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [ 2020-09-08T15:27:31.988 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:31.988 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "application not enabled on pool 'test'" 2020-09-08T15:27:31.988 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:31.988 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:31.988 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." 2020-09-08T15:27:31.989 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:31.989 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:27:31.989 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:27:31.989 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:31.989 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:31.990 INFO:tasks.workunit.client.0.smithi065.stdout: "mutes": [] 2020-09-08T15:27:31.990 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:31.990 INFO:tasks.workunit.client.0.smithi065.stdout: "monmap_first_committed": 1, 2020-09-08T15:27:31.990 INFO:tasks.workunit.client.0.smithi065.stdout: "monmap_last_committed": 1, 2020-09-08T15:27:31.990 INFO:tasks.workunit.client.0.smithi065.stdout: "monmap": { 2020-09-08T15:27:31.990 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 1, 2020-09-08T15:27:31.991 INFO:tasks.workunit.client.0.smithi065.stdout: "fsid": "c25e19f6-e2e3-4d0b-8f34-71c93296ff3c", 2020-09-08T15:27:31.991 INFO:tasks.workunit.client.0.smithi065.stdout: "modified": "2020-09-08T15:24:58.005157Z", 2020-09-08T15:27:31.991 INFO:tasks.workunit.client.0.smithi065.stdout: "created": "2020-09-08T15:24:58.005157Z", 2020-09-08T15:27:31.991 INFO:tasks.workunit.client.0.smithi065.stdout: "min_mon_release": 16, 2020-09-08T15:27:31.991 INFO:tasks.workunit.client.0.smithi065.stdout: "min_mon_release_name": "pacific", 2020-09-08T15:27:31.992 INFO:tasks.workunit.client.0.smithi065.stdout: "features": { 2020-09-08T15:27:31.992 INFO:tasks.workunit.client.0.smithi065.stdout: "persistent": [ 2020-09-08T15:27:31.992 INFO:tasks.workunit.client.0.smithi065.stdout: "kraken", 2020-09-08T15:27:31.992 INFO:tasks.workunit.client.0.smithi065.stdout: "luminous", 2020-09-08T15:27:31.992 INFO:tasks.workunit.client.0.smithi065.stdout: "mimic", 2020-09-08T15:27:31.993 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap-prune", 2020-09-08T15:27:31.993 INFO:tasks.workunit.client.0.smithi065.stdout: "nautilus", 2020-09-08T15:27:31.993 INFO:tasks.workunit.client.0.smithi065.stdout: "octopus", 2020-09-08T15:27:31.993 INFO:tasks.workunit.client.0.smithi065.stdout: "pacific" 2020-09-08T15:27:31.993 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:27:31.995 INFO:tasks.workunit.client.0.smithi065.stdout: "optional": [] 2020-09-08T15:27:31.995 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:31.995 INFO:tasks.workunit.client.0.smithi065.stdout: "mons": [ 2020-09-08T15:27:31.995 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:31.996 INFO:tasks.workunit.client.0.smithi065.stdout: "rank": 0, 2020-09-08T15:27:31.997 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "a", 2020-09-08T15:27:31.997 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:27:31.997 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:27:31.998 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:31.998 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:27:31.998 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:7115", 2020-09-08T15:27:31.998 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 0 2020-09-08T15:27:31.998 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:31.999 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:31.999 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:31.999 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:7115/0", 2020-09-08T15:27:31.999 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:7115/0", 2020-09-08T15:27:31.999 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 0, 2020-09-08T15:27:31.999 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 0 2020-09-08T15:27:32.000 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.000 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.000 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.000 INFO:tasks.workunit.client.0.smithi065.stdout: "quorum": [ 2020-09-08T15:27:32.000 INFO:tasks.workunit.client.0.smithi065.stdout: 0 2020-09-08T15:27:32.001 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:27:32.001 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap": { 2020-09-08T15:27:32.001 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 39, 2020-09-08T15:27:32.001 INFO:tasks.workunit.client.0.smithi065.stdout: "fsid": "c25e19f6-e2e3-4d0b-8f34-71c93296ff3c", 2020-09-08T15:27:32.001 INFO:tasks.workunit.client.0.smithi065.stdout: "created": "2020-09-08T15:24:58.858602+0000", 2020-09-08T15:27:32.002 INFO:tasks.workunit.client.0.smithi065.stdout: "modified": "2020-09-08T15:26:17.637939+0000", 2020-09-08T15:27:32.003 INFO:tasks.workunit.client.0.smithi065.stdout: "last_up_change": "2020-09-08T15:26:16.200572+0000", 2020-09-08T15:27:32.003 INFO:tasks.workunit.client.0.smithi065.stdout: "last_in_change": "2020-09-08T15:26:17.321413+0000", 2020-09-08T15:27:32.003 INFO:tasks.workunit.client.0.smithi065.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-09-08T15:27:32.003 INFO:tasks.workunit.client.0.smithi065.stdout: "flags_num": 5800384, 2020-09-08T15:27:32.003 INFO:tasks.workunit.client.0.smithi065.stdout: "flags_set": [ 2020-09-08T15:27:32.004 INFO:tasks.workunit.client.0.smithi065.stdout: "nodown", 2020-09-08T15:27:32.004 INFO:tasks.workunit.client.0.smithi065.stdout: "noin", 2020-09-08T15:27:32.004 INFO:tasks.workunit.client.0.smithi065.stdout: "noout", 2020-09-08T15:27:32.004 INFO:tasks.workunit.client.0.smithi065.stdout: "pglog_hardlimit", 2020-09-08T15:27:32.004 INFO:tasks.workunit.client.0.smithi065.stdout: "purged_snapdirs", 2020-09-08T15:27:32.005 INFO:tasks.workunit.client.0.smithi065.stdout: "recovery_deletes", 2020-09-08T15:27:32.005 INFO:tasks.workunit.client.0.smithi065.stdout: "sortbitwise" 2020-09-08T15:27:32.005 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:27:32.005 INFO:tasks.workunit.client.0.smithi065.stdout: "crush_version": 7, 2020-09-08T15:27:32.005 INFO:tasks.workunit.client.0.smithi065.stdout: "full_ratio": 0.99000000953674316, 2020-09-08T15:27:32.010 INFO:tasks.workunit.client.0.smithi065.stdout: "backfillfull_ratio": 0.99000000953674316, 2020-09-08T15:27:32.010 INFO:tasks.workunit.client.0.smithi065.stdout: "nearfull_ratio": 0.85000002384185791, 2020-09-08T15:27:32.011 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_snapshot": "", 2020-09-08T15:27:32.011 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_max": 1, 2020-09-08T15:27:32.011 INFO:tasks.workunit.client.0.smithi065.stdout: "max_osd": 3, 2020-09-08T15:27:32.011 INFO:tasks.workunit.client.0.smithi065.stdout: "require_min_compat_client": "luminous", 2020-09-08T15:27:32.011 INFO:tasks.workunit.client.0.smithi065.stdout: "min_compat_client": "jewel", 2020-09-08T15:27:32.012 INFO:tasks.workunit.client.0.smithi065.stdout: "require_osd_release": "pacific", 2020-09-08T15:27:32.012 INFO:tasks.workunit.client.0.smithi065.stdout: "pools": [ 2020-09-08T15:27:32.012 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.012 INFO:tasks.workunit.client.0.smithi065.stdout: "pool": 1, 2020-09-08T15:27:32.012 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_name": "test", 2020-09-08T15:27:32.013 INFO:tasks.workunit.client.0.smithi065.stdout: "create_time": "2020-09-08T15:25:25.877656+0000", 2020-09-08T15:27:32.013 INFO:tasks.workunit.client.0.smithi065.stdout: "flags": 1, 2020-09-08T15:27:32.013 INFO:tasks.workunit.client.0.smithi065.stdout: "flags_names": "hashpspool", 2020-09-08T15:27:32.013 INFO:tasks.workunit.client.0.smithi065.stdout: "type": 1, 2020-09-08T15:27:32.013 INFO:tasks.workunit.client.0.smithi065.stdout: "size": 3, 2020-09-08T15:27:32.015 INFO:tasks.workunit.client.0.smithi065.stdout: "min_size": 2, 2020-09-08T15:27:32.016 INFO:tasks.workunit.client.0.smithi065.stdout: "crush_rule": 0, 2020-09-08T15:27:32.016 INFO:tasks.workunit.client.0.smithi065.stdout: "object_hash": 2, 2020-09-08T15:27:32.016 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_autoscale_mode": "off", 2020-09-08T15:27:32.016 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_num": 1, 2020-09-08T15:27:32.016 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_placement_num": 1, 2020-09-08T15:27:32.017 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_placement_num_target": 1, 2020-09-08T15:27:32.017 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_num_target": 1, 2020-09-08T15:27:32.017 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_num_pending": 1, 2020-09-08T15:27:32.017 INFO:tasks.workunit.client.0.smithi065.stdout: "last_pg_merge_meta": { 2020-09-08T15:27:32.017 INFO:tasks.workunit.client.0.smithi065.stdout: "source_pgid": "0.0", 2020-09-08T15:27:32.018 INFO:tasks.workunit.client.0.smithi065.stdout: "ready_epoch": 0, 2020-09-08T15:27:32.018 INFO:tasks.workunit.client.0.smithi065.stdout: "last_epoch_started": 0, 2020-09-08T15:27:32.018 INFO:tasks.workunit.client.0.smithi065.stdout: "last_epoch_clean": 0, 2020-09-08T15:27:32.018 INFO:tasks.workunit.client.0.smithi065.stdout: "source_version": "0'0", 2020-09-08T15:27:32.018 INFO:tasks.workunit.client.0.smithi065.stdout: "target_version": "0'0" 2020-09-08T15:27:32.019 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.019 INFO:tasks.workunit.client.0.smithi065.stdout: "last_change": "29", 2020-09-08T15:27:32.019 INFO:tasks.workunit.client.0.smithi065.stdout: "last_force_op_resend": "0", 2020-09-08T15:27:32.019 INFO:tasks.workunit.client.0.smithi065.stdout: "last_force_op_resend_prenautilus": "0", 2020-09-08T15:27:32.019 INFO:tasks.workunit.client.0.smithi065.stdout: "last_force_op_resend_preluminous": "0", 2020-09-08T15:27:32.020 INFO:tasks.workunit.client.0.smithi065.stdout: "auid": 0, 2020-09-08T15:27:32.020 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_mode": "selfmanaged", 2020-09-08T15:27:32.020 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_seq": 0, 2020-09-08T15:27:32.021 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_epoch": 0, 2020-09-08T15:27:32.021 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_snaps": [], 2020-09-08T15:27:32.021 INFO:tasks.workunit.client.0.smithi065.stdout: "removed_snaps": "[]", 2020-09-08T15:27:32.021 INFO:tasks.workunit.client.0.smithi065.stdout: "quota_max_bytes": 0, 2020-09-08T15:27:32.022 INFO:tasks.workunit.client.0.smithi065.stdout: "quota_max_objects": 0, 2020-09-08T15:27:32.022 INFO:tasks.workunit.client.0.smithi065.stdout: "tiers": [], 2020-09-08T15:27:32.022 INFO:tasks.workunit.client.0.smithi065.stdout: "tier_of": -1, 2020-09-08T15:27:32.022 INFO:tasks.workunit.client.0.smithi065.stdout: "read_tier": -1, 2020-09-08T15:27:32.022 INFO:tasks.workunit.client.0.smithi065.stdout: "write_tier": -1, 2020-09-08T15:27:32.023 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_mode": "none", 2020-09-08T15:27:32.023 INFO:tasks.workunit.client.0.smithi065.stdout: "target_max_bytes": 0, 2020-09-08T15:27:32.023 INFO:tasks.workunit.client.0.smithi065.stdout: "target_max_objects": 0, 2020-09-08T15:27:32.023 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-09-08T15:27:32.023 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-09-08T15:27:32.023 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_target_full_ratio_micro": 800000, 2020-09-08T15:27:32.024 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_min_flush_age": 0, 2020-09-08T15:27:32.024 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_min_evict_age": 0, 2020-09-08T15:27:32.024 INFO:tasks.workunit.client.0.smithi065.stdout: "erasure_code_profile": "", 2020-09-08T15:27:32.024 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_params": { 2020-09-08T15:27:32.024 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "none" 2020-09-08T15:27:32.025 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.025 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_period": 0, 2020-09-08T15:27:32.025 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_count": 0, 2020-09-08T15:27:32.025 INFO:tasks.workunit.client.0.smithi065.stdout: "use_gmt_hitset": true, 2020-09-08T15:27:32.025 INFO:tasks.workunit.client.0.smithi065.stdout: "min_read_recency_for_promote": 0, 2020-09-08T15:27:32.026 INFO:tasks.workunit.client.0.smithi065.stdout: "min_write_recency_for_promote": 0, 2020-09-08T15:27:32.026 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_grade_decay_rate": 0, 2020-09-08T15:27:32.026 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_search_last_n": 0, 2020-09-08T15:27:32.026 INFO:tasks.workunit.client.0.smithi065.stdout: "grade_table": [], 2020-09-08T15:27:32.026 INFO:tasks.workunit.client.0.smithi065.stdout: "stripe_width": 0, 2020-09-08T15:27:32.027 INFO:tasks.workunit.client.0.smithi065.stdout: "expected_num_objects": 0, 2020-09-08T15:27:32.027 INFO:tasks.workunit.client.0.smithi065.stdout: "fast_read": false, 2020-09-08T15:27:32.027 INFO:tasks.workunit.client.0.smithi065.stdout: "options": {}, 2020-09-08T15:27:32.027 INFO:tasks.workunit.client.0.smithi065.stdout: "application_metadata": {} 2020-09-08T15:27:32.027 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.028 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:27:32.028 INFO:tasks.workunit.client.0.smithi065.stdout: "osds": [ 2020-09-08T15:27:32.028 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.028 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:27:32.028 INFO:tasks.workunit.client.0.smithi065.stdout: "uuid": "dc78991d-f410-4ef4-a45b-5573679ca87b", 2020-09-08T15:27:32.028 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 1, 2020-09-08T15:27:32.029 INFO:tasks.workunit.client.0.smithi065.stdout: "in": 1, 2020-09-08T15:27:32.029 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 1, 2020-09-08T15:27:32.029 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_affinity": 1, 2020-09-08T15:27:32.029 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_begin": 5, 2020-09-08T15:27:32.029 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_end": 29, 2020-09-08T15:27:32.030 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 35, 2020-09-08T15:27:32.030 INFO:tasks.workunit.client.0.smithi065.stdout: "up_thru": 38, 2020-09-08T15:27:32.030 INFO:tasks.workunit.client.0.smithi065.stdout: "down_at": 30, 2020-09-08T15:27:32.030 INFO:tasks.workunit.client.0.smithi065.stdout: "lost_at": 0, 2020-09-08T15:27:32.030 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:27:32.031 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:27:32.031 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.031 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:27:32.032 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6802", 2020-09-08T15:27:32.032 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47402 2020-09-08T15:27:32.032 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.032 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.032 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:27:32.033 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6803", 2020-09-08T15:27:32.033 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47402 2020-09-08T15:27:32.033 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.033 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.033 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.034 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addrs": { 2020-09-08T15:27:32.034 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:27:32.034 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.034 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:27:32.034 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6804", 2020-09-08T15:27:32.035 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47402 2020-09-08T15:27:32.035 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.035 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.035 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:27:32.035 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6805", 2020-09-08T15:27:32.036 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47402 2020-09-08T15:27:32.036 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.036 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.036 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.036 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addrs": { 2020-09-08T15:27:32.036 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:27:32.037 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.037 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:27:32.037 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6808", 2020-09-08T15:27:32.037 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47402 2020-09-08T15:27:32.037 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.038 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.038 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:27:32.038 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6809", 2020-09-08T15:27:32.038 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47402 2020-09-08T15:27:32.038 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.039 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.039 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.039 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addrs": { 2020-09-08T15:27:32.039 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:27:32.039 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.040 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:27:32.040 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6806", 2020-09-08T15:27:32.040 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47402 2020-09-08T15:27:32.040 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.040 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.040 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:27:32.041 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6807", 2020-09-08T15:27:32.041 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47402 2020-09-08T15:27:32.041 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.042 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.042 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.042 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:6803/47402", 2020-09-08T15:27:32.042 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addr": "127.0.0.1:6805/47402", 2020-09-08T15:27:32.043 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addr": "127.0.0.1:6809/47402", 2020-09-08T15:27:32.043 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addr": "127.0.0.1:6807/47402", 2020-09-08T15:27:32.043 INFO:tasks.workunit.client.0.smithi065.stdout: "state": [ 2020-09-08T15:27:32.043 INFO:tasks.workunit.client.0.smithi065.stdout: "exists", 2020-09-08T15:27:32.043 INFO:tasks.workunit.client.0.smithi065.stdout: "up" 2020-09-08T15:27:32.044 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.044 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.044 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.044 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:27:32.044 INFO:tasks.workunit.client.0.smithi065.stdout: "uuid": "0a291c9f-6efd-44cb-baaf-35b800dc7866", 2020-09-08T15:27:32.044 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 0, 2020-09-08T15:27:32.045 INFO:tasks.workunit.client.0.smithi065.stdout: "in": 1, 2020-09-08T15:27:32.045 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 1, 2020-09-08T15:27:32.045 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_affinity": 1, 2020-09-08T15:27:32.045 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_begin": 0, 2020-09-08T15:27:32.045 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_end": 0, 2020-09-08T15:27:32.046 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 10, 2020-09-08T15:27:32.046 INFO:tasks.workunit.client.0.smithi065.stdout: "up_thru": 23, 2020-09-08T15:27:32.046 INFO:tasks.workunit.client.0.smithi065.stdout: "down_at": 31, 2020-09-08T15:27:32.046 INFO:tasks.workunit.client.0.smithi065.stdout: "lost_at": 0, 2020-09-08T15:27:32.046 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:27:32.047 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:27:32.047 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.047 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:27:32.047 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6810", 2020-09-08T15:27:32.047 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 42495 2020-09-08T15:27:32.048 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.048 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.048 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:27:32.048 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6811", 2020-09-08T15:27:32.048 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 42495 2020-09-08T15:27:32.049 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.049 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.049 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.049 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addrs": { 2020-09-08T15:27:32.049 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:27:32.049 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.050 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:27:32.050 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6812", 2020-09-08T15:27:32.050 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 42495 2020-09-08T15:27:32.050 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.050 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.051 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:27:32.051 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6813", 2020-09-08T15:27:32.051 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 42495 2020-09-08T15:27:32.051 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.051 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.052 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.052 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addrs": { 2020-09-08T15:27:32.052 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:27:32.053 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.053 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:27:32.053 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6816", 2020-09-08T15:27:32.053 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 42495 2020-09-08T15:27:32.054 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.054 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.054 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:27:32.054 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6817", 2020-09-08T15:27:32.054 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 42495 2020-09-08T15:27:32.054 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.055 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.055 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.055 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addrs": { 2020-09-08T15:27:32.055 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:27:32.055 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.056 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:27:32.056 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6814", 2020-09-08T15:27:32.056 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 42495 2020-09-08T15:27:32.056 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.056 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.057 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:27:32.057 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6815", 2020-09-08T15:27:32.057 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 42495 2020-09-08T15:27:32.057 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.057 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.057 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.058 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:6811/42495", 2020-09-08T15:27:32.058 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addr": "127.0.0.1:6813/42495", 2020-09-08T15:27:32.058 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addr": "127.0.0.1:6817/42495", 2020-09-08T15:27:32.058 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addr": "127.0.0.1:6815/42495", 2020-09-08T15:27:32.058 INFO:tasks.workunit.client.0.smithi065.stdout: "state": [ 2020-09-08T15:27:32.059 INFO:tasks.workunit.client.0.smithi065.stdout: "exists" 2020-09-08T15:27:32.059 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.059 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.059 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.059 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:27:32.060 INFO:tasks.workunit.client.0.smithi065.stdout: "uuid": "1064be2f-cb2a-4046-8814-ce923b7aef68", 2020-09-08T15:27:32.060 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 1, 2020-09-08T15:27:32.060 INFO:tasks.workunit.client.0.smithi065.stdout: "in": 1, 2020-09-08T15:27:32.060 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 1, 2020-09-08T15:27:32.060 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_affinity": 1, 2020-09-08T15:27:32.060 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_begin": 15, 2020-09-08T15:27:32.061 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_end": 29, 2020-09-08T15:27:32.061 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 36, 2020-09-08T15:27:32.061 INFO:tasks.workunit.client.0.smithi065.stdout: "up_thru": 0, 2020-09-08T15:27:32.061 INFO:tasks.workunit.client.0.smithi065.stdout: "down_at": 32, 2020-09-08T15:27:32.061 INFO:tasks.workunit.client.0.smithi065.stdout: "lost_at": 0, 2020-09-08T15:27:32.062 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:27:32.062 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:27:32.062 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.062 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:27:32.063 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6810", 2020-09-08T15:27:32.063 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47801 2020-09-08T15:27:32.063 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.064 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.064 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:27:32.064 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6811", 2020-09-08T15:27:32.064 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47801 2020-09-08T15:27:32.064 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.065 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.065 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.065 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addrs": { 2020-09-08T15:27:32.065 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:27:32.065 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.065 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:27:32.066 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6812", 2020-09-08T15:27:32.066 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47801 2020-09-08T15:27:32.066 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.066 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.066 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:27:32.067 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6813", 2020-09-08T15:27:32.067 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47801 2020-09-08T15:27:32.067 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.067 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.067 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.068 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addrs": { 2020-09-08T15:27:32.068 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:27:32.068 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.068 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:27:32.068 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6816", 2020-09-08T15:27:32.068 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47801 2020-09-08T15:27:32.069 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.069 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.069 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:27:32.069 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6817", 2020-09-08T15:27:32.069 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47801 2020-09-08T15:27:32.070 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.070 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.070 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.070 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addrs": { 2020-09-08T15:27:32.070 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:27:32.071 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.071 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:27:32.071 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6814", 2020-09-08T15:27:32.071 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47801 2020-09-08T15:27:32.071 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.071 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.072 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:27:32.072 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6815", 2020-09-08T15:27:32.072 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 47801 2020-09-08T15:27:32.072 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.072 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.073 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.073 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:6811/47801", 2020-09-08T15:27:32.074 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addr": "127.0.0.1:6813/47801", 2020-09-08T15:27:32.074 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addr": "127.0.0.1:6817/47801", 2020-09-08T15:27:32.074 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addr": "127.0.0.1:6815/47801", 2020-09-08T15:27:32.074 INFO:tasks.workunit.client.0.smithi065.stdout: "state": [ 2020-09-08T15:27:32.074 INFO:tasks.workunit.client.0.smithi065.stdout: "exists", 2020-09-08T15:27:32.075 INFO:tasks.workunit.client.0.smithi065.stdout: "up" 2020-09-08T15:27:32.075 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.075 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.075 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:27:32.075 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_xinfo": [ 2020-09-08T15:27:32.075 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.076 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:27:32.076 INFO:tasks.workunit.client.0.smithi065.stdout: "down_stamp": "2020-09-08T15:26:08.902994+0000", 2020-09-08T15:27:32.076 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_probability": 0, 2020-09-08T15:27:32.076 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_interval": 0, 2020-09-08T15:27:32.076 INFO:tasks.workunit.client.0.smithi065.stdout: "features": 4540138292837744639, 2020-09-08T15:27:32.077 INFO:tasks.workunit.client.0.smithi065.stdout: "old_weight": 0, 2020-09-08T15:27:32.077 INFO:tasks.workunit.client.0.smithi065.stdout: "last_purged_snaps_scrub": "2020-09-08T15:25:07.467187+0000", 2020-09-08T15:27:32.077 INFO:tasks.workunit.client.0.smithi065.stdout: "dead_epoch": 0 2020-09-08T15:27:32.077 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.077 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.078 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:27:32.078 INFO:tasks.workunit.client.0.smithi065.stdout: "down_stamp": "2020-09-08T15:26:09.595855+0000", 2020-09-08T15:27:32.078 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_probability": 0, 2020-09-08T15:27:32.078 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_interval": 0, 2020-09-08T15:27:32.078 INFO:tasks.workunit.client.0.smithi065.stdout: "features": 4540138292837744639, 2020-09-08T15:27:32.078 INFO:tasks.workunit.client.0.smithi065.stdout: "old_weight": 0, 2020-09-08T15:27:32.079 INFO:tasks.workunit.client.0.smithi065.stdout: "last_purged_snaps_scrub": "2020-09-08T15:25:15.472904+0000", 2020-09-08T15:27:32.079 INFO:tasks.workunit.client.0.smithi065.stdout: "dead_epoch": 0 2020-09-08T15:27:32.079 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.079 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.079 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:27:32.080 INFO:tasks.workunit.client.0.smithi065.stdout: "down_stamp": "2020-09-08T15:26:10.205149+0000", 2020-09-08T15:27:32.080 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_probability": 0, 2020-09-08T15:27:32.080 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_interval": 0, 2020-09-08T15:27:32.080 INFO:tasks.workunit.client.0.smithi065.stdout: "features": 4540138292837744639, 2020-09-08T15:27:32.080 INFO:tasks.workunit.client.0.smithi065.stdout: "old_weight": 0, 2020-09-08T15:27:32.081 INFO:tasks.workunit.client.0.smithi065.stdout: "last_purged_snaps_scrub": "2020-09-08T15:25:23.387631+0000", 2020-09-08T15:27:32.081 INFO:tasks.workunit.client.0.smithi065.stdout: "dead_epoch": 0 2020-09-08T15:27:32.081 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.081 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:27:32.081 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_upmap": [], 2020-09-08T15:27:32.082 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_upmap_items": [], 2020-09-08T15:27:32.082 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_temp": [], 2020-09-08T15:27:32.082 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_temp": [], 2020-09-08T15:27:32.082 INFO:tasks.workunit.client.0.smithi065.stdout: "blocklist": {}, 2020-09-08T15:27:32.082 INFO:tasks.workunit.client.0.smithi065.stdout: "erasure_code_profiles": { 2020-09-08T15:27:32.082 INFO:tasks.workunit.client.0.smithi065.stdout: "default": { 2020-09-08T15:27:32.083 INFO:tasks.workunit.client.0.smithi065.stdout: "k": "2", 2020-09-08T15:27:32.083 INFO:tasks.workunit.client.0.smithi065.stdout: "m": "2", 2020-09-08T15:27:32.083 INFO:tasks.workunit.client.0.smithi065.stdout: "plugin": "jerasure", 2020-09-08T15:27:32.083 INFO:tasks.workunit.client.0.smithi065.stdout: "technique": "reed_sol_van" 2020-09-08T15:27:32.084 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.084 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.084 INFO:tasks.workunit.client.0.smithi065.stdout: "removed_snaps_queue": [], 2020-09-08T15:27:32.085 INFO:tasks.workunit.client.0.smithi065.stdout: "new_removed_snaps": [], 2020-09-08T15:27:32.085 INFO:tasks.workunit.client.0.smithi065.stdout: "new_purged_snaps": [], 2020-09-08T15:27:32.085 INFO:tasks.workunit.client.0.smithi065.stdout: "crush_node_flags": {}, 2020-09-08T15:27:32.085 INFO:tasks.workunit.client.0.smithi065.stdout: "device_class_flags": {} 2020-09-08T15:27:32.085 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.086 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_metadata": [ 2020-09-08T15:27:32.086 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.086 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:27:32.086 INFO:tasks.workunit.client.0.smithi065.stdout: "arch": "x86_64", 2020-09-08T15:27:32.086 INFO:tasks.workunit.client.0.smithi065.stdout: "back_addr": "[v2:127.0.0.1:6804/47402,v1:127.0.0.1:6805/47402]", 2020-09-08T15:27:32.087 INFO:tasks.workunit.client.0.smithi065.stdout: "back_iface": "", 2020-09-08T15:27:32.087 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs": "1", 2020-09-08T15:27:32.087 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_db": "0", 2020-09-08T15:27:32.087 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_wal": "0", 2020-09-08T15:27:32.087 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_single_shared_device": "1", 2020-09-08T15:27:32.088 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T15:27:32.088 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T15:27:32.088 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T15:27:32.088 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T15:27:32.088 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2020-09-08T15:27:32.088 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T15:27:32.089 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T15:27:32.089 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T15:27:32.089 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T15:27:32.089 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_release": "pacific", 2020-09-08T15:27:32.089 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version": "ceph version 16.0.0-5272-gdce4d291bd4 (dce4d291bd4243c9802c17d67b85a6da6bbc0f8f) pacific (dev)", 2020-09-08T15:27:32.090 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version_short": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:27:32.090 INFO:tasks.workunit.client.0.smithi065.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-09-08T15:27:32.090 INFO:tasks.workunit.client.0.smithi065.stdout: "default_device_class": "hdd", 2020-09-08T15:27:32.090 INFO:tasks.workunit.client.0.smithi065.stdout: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W4VHBH", 2020-09-08T15:27:32.090 INFO:tasks.workunit.client.0.smithi065.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2020-09-08T15:27:32.091 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": "sda", 2020-09-08T15:27:32.091 INFO:tasks.workunit.client.0.smithi065.stdout: "distro": "rhel", 2020-09-08T15:27:32.091 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_description": "Red Hat Enterprise Linux 8.1 (Ootpa)", 2020-09-08T15:27:32.091 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_version": "8.1", 2020-09-08T15:27:32.091 INFO:tasks.workunit.client.0.smithi065.stdout: "front_addr": "[v2:127.0.0.1:6802/47402,v1:127.0.0.1:6803/47402]", 2020-09-08T15:27:32.091 INFO:tasks.workunit.client.0.smithi065.stdout: "front_iface": "", 2020-09-08T15:27:32.092 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/47402,v1:127.0.0.1:6809/47402]", 2020-09-08T15:27:32.092 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/47402,v1:127.0.0.1:6807/47402]", 2020-09-08T15:27:32.092 INFO:tasks.workunit.client.0.smithi065.stdout: "hostname": "smithi065", 2020-09-08T15:27:32.092 INFO:tasks.workunit.client.0.smithi065.stdout: "journal_rotational": "1", 2020-09-08T15:27:32.092 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_description": "#1 SMP Fri Mar 27 14:35:58 UTC 2020", 2020-09-08T15:27:32.093 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_version": "4.18.0-193.el8.x86_64", 2020-09-08T15:27:32.093 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_swap_kb": "0", 2020-09-08T15:27:32.093 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_total_kb": "32653204", 2020-09-08T15:27:32.093 INFO:tasks.workunit.client.0.smithi065.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2020-09-08T15:27:32.093 INFO:tasks.workunit.client.0.smithi065.stdout: "objectstore_numa_unknown_devices": "sda", 2020-09-08T15:27:32.094 INFO:tasks.workunit.client.0.smithi065.stdout: "os": "Linux", 2020-09-08T15:27:32.094 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_data": "td/divergent-priors/0", 2020-09-08T15:27:32.094 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T15:27:32.095 INFO:tasks.workunit.client.0.smithi065.stdout: "osdspec_affinity": "", 2020-09-08T15:27:32.095 INFO:tasks.workunit.client.0.smithi065.stdout: "rotational": "1" 2020-09-08T15:27:32.095 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.095 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.095 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:27:32.096 INFO:tasks.workunit.client.0.smithi065.stdout: "arch": "x86_64", 2020-09-08T15:27:32.096 INFO:tasks.workunit.client.0.smithi065.stdout: "back_addr": "[v2:127.0.0.1:6812/42495,v1:127.0.0.1:6813/42495]", 2020-09-08T15:27:32.096 INFO:tasks.workunit.client.0.smithi065.stdout: "back_iface": "", 2020-09-08T15:27:32.096 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs": "1", 2020-09-08T15:27:32.096 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_db": "0", 2020-09-08T15:27:32.097 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_wal": "0", 2020-09-08T15:27:32.097 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_single_shared_device": "1", 2020-09-08T15:27:32.097 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T15:27:32.097 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T15:27:32.097 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T15:27:32.098 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T15:27:32.098 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2020-09-08T15:27:32.098 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T15:27:32.098 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T15:27:32.098 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T15:27:32.099 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T15:27:32.099 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_release": "pacific", 2020-09-08T15:27:32.099 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version": "ceph version 16.0.0-5272-gdce4d291bd4 (dce4d291bd4243c9802c17d67b85a6da6bbc0f8f) pacific (dev)", 2020-09-08T15:27:32.099 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version_short": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:27:32.099 INFO:tasks.workunit.client.0.smithi065.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-09-08T15:27:32.099 INFO:tasks.workunit.client.0.smithi065.stdout: "default_device_class": "hdd", 2020-09-08T15:27:32.100 INFO:tasks.workunit.client.0.smithi065.stdout: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W4VHBH", 2020-09-08T15:27:32.100 INFO:tasks.workunit.client.0.smithi065.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2020-09-08T15:27:32.100 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": "sda", 2020-09-08T15:27:32.100 INFO:tasks.workunit.client.0.smithi065.stdout: "distro": "rhel", 2020-09-08T15:27:32.100 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_description": "Red Hat Enterprise Linux 8.1 (Ootpa)", 2020-09-08T15:27:32.101 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_version": "8.1", 2020-09-08T15:27:32.101 INFO:tasks.workunit.client.0.smithi065.stdout: "front_addr": "[v2:127.0.0.1:6810/42495,v1:127.0.0.1:6811/42495]", 2020-09-08T15:27:32.101 INFO:tasks.workunit.client.0.smithi065.stdout: "front_iface": "", 2020-09-08T15:27:32.101 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/42495,v1:127.0.0.1:6817/42495]", 2020-09-08T15:27:32.101 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/42495,v1:127.0.0.1:6815/42495]", 2020-09-08T15:27:32.102 INFO:tasks.workunit.client.0.smithi065.stdout: "hostname": "smithi065", 2020-09-08T15:27:32.102 INFO:tasks.workunit.client.0.smithi065.stdout: "journal_rotational": "1", 2020-09-08T15:27:32.102 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_description": "#1 SMP Fri Mar 27 14:35:58 UTC 2020", 2020-09-08T15:27:32.102 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_version": "4.18.0-193.el8.x86_64", 2020-09-08T15:27:32.102 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_swap_kb": "0", 2020-09-08T15:27:32.102 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_total_kb": "32653204", 2020-09-08T15:27:32.103 INFO:tasks.workunit.client.0.smithi065.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2020-09-08T15:27:32.103 INFO:tasks.workunit.client.0.smithi065.stdout: "objectstore_numa_unknown_devices": "sda", 2020-09-08T15:27:32.103 INFO:tasks.workunit.client.0.smithi065.stdout: "os": "Linux", 2020-09-08T15:27:32.103 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_data": "td/divergent-priors/1", 2020-09-08T15:27:32.103 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T15:27:32.104 INFO:tasks.workunit.client.0.smithi065.stdout: "osdspec_affinity": "", 2020-09-08T15:27:32.104 INFO:tasks.workunit.client.0.smithi065.stdout: "rotational": "1" 2020-09-08T15:27:32.104 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.104 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.104 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:27:32.105 INFO:tasks.workunit.client.0.smithi065.stdout: "arch": "x86_64", 2020-09-08T15:27:32.105 INFO:tasks.workunit.client.0.smithi065.stdout: "back_addr": "[v2:127.0.0.1:6812/47801,v1:127.0.0.1:6813/47801]", 2020-09-08T15:27:32.105 INFO:tasks.workunit.client.0.smithi065.stdout: "back_iface": "", 2020-09-08T15:27:32.106 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs": "1", 2020-09-08T15:27:32.106 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_db": "0", 2020-09-08T15:27:32.106 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_wal": "0", 2020-09-08T15:27:32.106 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_single_shared_device": "1", 2020-09-08T15:27:32.106 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T15:27:32.107 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T15:27:32.107 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T15:27:32.107 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T15:27:32.107 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2020-09-08T15:27:32.107 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T15:27:32.108 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T15:27:32.108 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T15:27:32.108 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T15:27:32.108 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_release": "pacific", 2020-09-08T15:27:32.108 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version": "ceph version 16.0.0-5272-gdce4d291bd4 (dce4d291bd4243c9802c17d67b85a6da6bbc0f8f) pacific (dev)", 2020-09-08T15:27:32.108 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version_short": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:27:32.109 INFO:tasks.workunit.client.0.smithi065.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-09-08T15:27:32.109 INFO:tasks.workunit.client.0.smithi065.stdout: "default_device_class": "hdd", 2020-09-08T15:27:32.109 INFO:tasks.workunit.client.0.smithi065.stdout: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W4VHBH", 2020-09-08T15:27:32.109 INFO:tasks.workunit.client.0.smithi065.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2020-09-08T15:27:32.109 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": "sda", 2020-09-08T15:27:32.110 INFO:tasks.workunit.client.0.smithi065.stdout: "distro": "rhel", 2020-09-08T15:27:32.110 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_description": "Red Hat Enterprise Linux 8.1 (Ootpa)", 2020-09-08T15:27:32.110 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_version": "8.1", 2020-09-08T15:27:32.110 INFO:tasks.workunit.client.0.smithi065.stdout: "front_addr": "[v2:127.0.0.1:6810/47801,v1:127.0.0.1:6811/47801]", 2020-09-08T15:27:32.110 INFO:tasks.workunit.client.0.smithi065.stdout: "front_iface": "", 2020-09-08T15:27:32.111 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/47801,v1:127.0.0.1:6817/47801]", 2020-09-08T15:27:32.111 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/47801,v1:127.0.0.1:6815/47801]", 2020-09-08T15:27:32.111 INFO:tasks.workunit.client.0.smithi065.stdout: "hostname": "smithi065", 2020-09-08T15:27:32.111 INFO:tasks.workunit.client.0.smithi065.stdout: "journal_rotational": "1", 2020-09-08T15:27:32.111 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_description": "#1 SMP Fri Mar 27 14:35:58 UTC 2020", 2020-09-08T15:27:32.111 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_version": "4.18.0-193.el8.x86_64", 2020-09-08T15:27:32.112 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_swap_kb": "0", 2020-09-08T15:27:32.112 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_total_kb": "32653204", 2020-09-08T15:27:32.112 INFO:tasks.workunit.client.0.smithi065.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2020-09-08T15:27:32.112 INFO:tasks.workunit.client.0.smithi065.stdout: "objectstore_numa_unknown_devices": "sda", 2020-09-08T15:27:32.112 INFO:tasks.workunit.client.0.smithi065.stdout: "os": "Linux", 2020-09-08T15:27:32.113 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_data": "td/divergent-priors/2", 2020-09-08T15:27:32.113 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T15:27:32.113 INFO:tasks.workunit.client.0.smithi065.stdout: "osdspec_affinity": "", 2020-09-08T15:27:32.113 INFO:tasks.workunit.client.0.smithi065.stdout: "rotational": "1" 2020-09-08T15:27:32.113 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.114 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:27:32.114 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap_clean_epochs": { 2020-09-08T15:27:32.114 INFO:tasks.workunit.client.0.smithi065.stdout: "min_last_epoch_clean": 0, 2020-09-08T15:27:32.114 INFO:tasks.workunit.client.0.smithi065.stdout: "last_epoch_clean": { 2020-09-08T15:27:32.114 INFO:tasks.workunit.client.0.smithi065.stdout: "per_pool": [] 2020-09-08T15:27:32.114 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.115 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_epochs": [ 2020-09-08T15:27:32.115 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.116 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:27:32.116 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 35 2020-09-08T15:27:32.116 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.116 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.116 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:27:32.117 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 10 2020-09-08T15:27:32.117 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.117 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.117 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:27:32.117 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 37 2020-09-08T15:27:32.117 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.118 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.118 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.118 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap_first_committed": 1, 2020-09-08T15:27:32.118 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap_last_committed": 39, 2020-09-08T15:27:32.118 INFO:tasks.workunit.client.0.smithi065.stdout: "crushmap": { 2020-09-08T15:27:32.119 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": [ 2020-09-08T15:27:32.119 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.119 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:27:32.119 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd.0", 2020-09-08T15:27:32.119 INFO:tasks.workunit.client.0.smithi065.stdout: "class": "hdd" 2020-09-08T15:27:32.120 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.120 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.120 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:27:32.120 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd.1", 2020-09-08T15:27:32.120 INFO:tasks.workunit.client.0.smithi065.stdout: "class": "hdd" 2020-09-08T15:27:32.121 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.121 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.121 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:27:32.121 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd.2", 2020-09-08T15:27:32.121 INFO:tasks.workunit.client.0.smithi065.stdout: "class": "hdd" 2020-09-08T15:27:32.121 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.122 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:27:32.122 INFO:tasks.workunit.client.0.smithi065.stdout: "types": [ 2020-09-08T15:27:32.122 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.122 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 0, 2020-09-08T15:27:32.122 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd" 2020-09-08T15:27:32.123 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.123 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.123 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 1, 2020-09-08T15:27:32.123 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "host" 2020-09-08T15:27:32.123 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.124 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.124 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 2, 2020-09-08T15:27:32.124 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "chassis" 2020-09-08T15:27:32.124 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.124 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.124 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 3, 2020-09-08T15:27:32.125 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "rack" 2020-09-08T15:27:32.125 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.125 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.125 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 4, 2020-09-08T15:27:32.126 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "row" 2020-09-08T15:27:32.126 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.126 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.127 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 5, 2020-09-08T15:27:32.127 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "pdu" 2020-09-08T15:27:32.127 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.127 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.127 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 6, 2020-09-08T15:27:32.128 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "pod" 2020-09-08T15:27:32.128 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.128 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.128 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 7, 2020-09-08T15:27:32.128 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "room" 2020-09-08T15:27:32.128 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.129 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.129 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 8, 2020-09-08T15:27:32.129 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "datacenter" 2020-09-08T15:27:32.129 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.129 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.130 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 9, 2020-09-08T15:27:32.130 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "zone" 2020-09-08T15:27:32.130 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.130 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.130 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 10, 2020-09-08T15:27:32.131 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "region" 2020-09-08T15:27:32.131 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.131 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.131 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 11, 2020-09-08T15:27:32.131 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "root" 2020-09-08T15:27:32.131 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.132 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:27:32.132 INFO:tasks.workunit.client.0.smithi065.stdout: "buckets": [ 2020-09-08T15:27:32.132 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.132 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -1, 2020-09-08T15:27:32.132 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "default", 2020-09-08T15:27:32.133 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 11, 2020-09-08T15:27:32.133 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "root", 2020-09-08T15:27:32.133 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:27:32.133 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:27:32.133 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:27:32.134 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:27:32.134 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.134 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -3, 2020-09-08T15:27:32.134 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:27:32.134 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:27:32.134 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.135 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.135 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.135 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.135 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -2, 2020-09-08T15:27:32.135 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "default~hdd", 2020-09-08T15:27:32.136 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 11, 2020-09-08T15:27:32.136 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "root", 2020-09-08T15:27:32.137 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:27:32.137 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:27:32.137 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:27:32.137 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:27:32.137 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.138 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -4, 2020-09-08T15:27:32.138 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:27:32.138 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:27:32.138 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.138 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.139 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.139 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.139 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -3, 2020-09-08T15:27:32.139 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "smithi065", 2020-09-08T15:27:32.139 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 1, 2020-09-08T15:27:32.139 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "host", 2020-09-08T15:27:32.140 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:27:32.140 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:27:32.140 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:27:32.140 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:27:32.140 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.141 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:27:32.141 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:27:32.141 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:27:32.141 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.141 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.142 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:27:32.142 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:27:32.142 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 1 2020-09-08T15:27:32.142 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.142 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.142 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:27:32.143 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:27:32.143 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 2 2020-09-08T15:27:32.143 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.143 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.143 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.144 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.144 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -4, 2020-09-08T15:27:32.144 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "smithi065~hdd", 2020-09-08T15:27:32.144 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 1, 2020-09-08T15:27:32.144 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "host", 2020-09-08T15:27:32.144 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:27:32.145 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:27:32.145 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:27:32.145 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:27:32.145 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.145 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:27:32.146 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:27:32.146 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:27:32.146 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.146 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.146 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:27:32.153 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:27:32.153 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 1 2020-09-08T15:27:32.154 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.154 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.154 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:27:32.154 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:27:32.154 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 2 2020-09-08T15:27:32.155 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.155 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.155 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.155 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:27:32.155 INFO:tasks.workunit.client.0.smithi065.stdout: "rules": [ 2020-09-08T15:27:32.156 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.156 INFO:tasks.workunit.client.0.smithi065.stdout: "rule_id": 0, 2020-09-08T15:27:32.156 INFO:tasks.workunit.client.0.smithi065.stdout: "rule_name": "replicated_rule", 2020-09-08T15:27:32.156 INFO:tasks.workunit.client.0.smithi065.stdout: "ruleset": 0, 2020-09-08T15:27:32.156 INFO:tasks.workunit.client.0.smithi065.stdout: "type": 1, 2020-09-08T15:27:32.156 INFO:tasks.workunit.client.0.smithi065.stdout: "min_size": 1, 2020-09-08T15:27:32.157 INFO:tasks.workunit.client.0.smithi065.stdout: "max_size": 10, 2020-09-08T15:27:32.157 INFO:tasks.workunit.client.0.smithi065.stdout: "steps": [ 2020-09-08T15:27:32.157 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.157 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "take", 2020-09-08T15:27:32.157 INFO:tasks.workunit.client.0.smithi065.stdout: "item": -1, 2020-09-08T15:27:32.158 INFO:tasks.workunit.client.0.smithi065.stdout: "item_name": "default" 2020-09-08T15:27:32.158 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.158 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.158 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "choose_firstn", 2020-09-08T15:27:32.158 INFO:tasks.workunit.client.0.smithi065.stdout: "num": 0, 2020-09-08T15:27:32.159 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "osd" 2020-09-08T15:27:32.159 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.159 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.159 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "emit" 2020-09-08T15:27:32.159 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.160 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:27:32.160 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.160 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:27:32.160 INFO:tasks.workunit.client.0.smithi065.stdout: "tunables": { 2020-09-08T15:27:32.160 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_local_tries": 0, 2020-09-08T15:27:32.161 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_local_fallback_tries": 0, 2020-09-08T15:27:32.161 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_total_tries": 50, 2020-09-08T15:27:32.161 INFO:tasks.workunit.client.0.smithi065.stdout: "chooseleaf_descend_once": 1, 2020-09-08T15:27:32.161 INFO:tasks.workunit.client.0.smithi065.stdout: "chooseleaf_vary_r": 1, 2020-09-08T15:27:32.161 INFO:tasks.workunit.client.0.smithi065.stdout: "chooseleaf_stable": 1, 2020-09-08T15:27:32.161 INFO:tasks.workunit.client.0.smithi065.stdout: "straw_calc_version": 1, 2020-09-08T15:27:32.162 INFO:tasks.workunit.client.0.smithi065.stdout: "allowed_bucket_algs": 54, 2020-09-08T15:27:32.162 INFO:tasks.workunit.client.0.smithi065.stdout: "profile": "jewel", 2020-09-08T15:27:32.162 INFO:tasks.workunit.client.0.smithi065.stdout: "optimal_tunables": 1, 2020-09-08T15:27:32.162 INFO:tasks.workunit.client.0.smithi065.stdout: "legacy_tunables": 0, 2020-09-08T15:27:32.162 INFO:tasks.workunit.client.0.smithi065.stdout: "minimum_required_version": "jewel", 2020-09-08T15:27:32.163 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables": 1, 2020-09-08T15:27:32.163 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables2": 1, 2020-09-08T15:27:32.164 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v2_rules": 0, 2020-09-08T15:27:32.164 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables3": 1, 2020-09-08T15:27:32.164 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v3_rules": 0, 2020-09-08T15:27:32.164 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v4_buckets": 1, 2020-09-08T15:27:32.164 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables5": 1, 2020-09-08T15:27:32.165 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v5_rules": 0 2020-09-08T15:27:32.165 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.165 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_args": {} 2020-09-08T15:27:32.165 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.165 INFO:tasks.workunit.client.0.smithi065.stdout: "fsmap": { 2020-09-08T15:27:32.166 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 1, 2020-09-08T15:27:32.166 INFO:tasks.workunit.client.0.smithi065.stdout: "default_fscid": -1, 2020-09-08T15:27:32.166 INFO:tasks.workunit.client.0.smithi065.stdout: "compat": { 2020-09-08T15:27:32.166 INFO:tasks.workunit.client.0.smithi065.stdout: "compat": {}, 2020-09-08T15:27:32.166 INFO:tasks.workunit.client.0.smithi065.stdout: "ro_compat": {}, 2020-09-08T15:27:32.166 INFO:tasks.workunit.client.0.smithi065.stdout: "incompat": { 2020-09-08T15:27:32.167 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_1": "base v0.20", 2020-09-08T15:27:32.167 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_2": "client writeable ranges", 2020-09-08T15:27:32.167 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_3": "default file layouts on dirs", 2020-09-08T15:27:32.167 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_4": "dir inode in separate object", 2020-09-08T15:27:32.167 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_5": "mds uses versioned encoding", 2020-09-08T15:27:32.168 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_6": "dirfrag is stored in omap", 2020-09-08T15:27:32.168 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_8": "no anchor table", 2020-09-08T15:27:32.168 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_9": "file layout v2", 2020-09-08T15:27:32.168 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_10": "snaprealm v2" 2020-09-08T15:27:32.168 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.168 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.169 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_flags": { 2020-09-08T15:27:32.169 INFO:tasks.workunit.client.0.smithi065.stdout: "enable_multiple": false, 2020-09-08T15:27:32.169 INFO:tasks.workunit.client.0.smithi065.stdout: "ever_enabled_multiple": false 2020-09-08T15:27:32.169 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.169 INFO:tasks.workunit.client.0.smithi065.stdout: "standbys": [], 2020-09-08T15:27:32.170 INFO:tasks.workunit.client.0.smithi065.stdout: "filesystems": [] 2020-09-08T15:27:32.170 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.170 INFO:tasks.workunit.client.0.smithi065.stdout: "mdsmap_first_committed": 1, 2020-09-08T15:27:32.170 INFO:tasks.workunit.client.0.smithi065.stdout: "mdsmap_last_committed": 1, 2020-09-08T15:27:32.170 INFO:tasks.workunit.client.0.smithi065.stdout: "auth": { 2020-09-08T15:27:32.171 INFO:tasks.workunit.client.0.smithi065.stdout: "first_committed": 1, 2020-09-08T15:27:32.171 INFO:tasks.workunit.client.0.smithi065.stdout: "last_committed": 5, 2020-09-08T15:27:32.171 INFO:tasks.workunit.client.0.smithi065.stdout: "num_secrets": 3 2020-09-08T15:27:32.171 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.171 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg": 1, 2020-09-08T15:27:32.171 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_active": 1, 2020-09-08T15:27:32.172 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_unknown": 0, 2020-09-08T15:27:32.172 INFO:tasks.workunit.client.0.smithi065.stdout: "num_osd": 3, 2020-09-08T15:27:32.172 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_sum": { 2020-09-08T15:27:32.172 INFO:tasks.workunit.client.0.smithi065.stdout: "stat_sum": { 2020-09-08T15:27:32.172 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes": 47947, 2020-09-08T15:27:32.173 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects": 100, 2020-09-08T15:27:32.173 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_clones": 0, 2020-09-08T15:27:32.173 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_copies": 300, 2020-09-08T15:27:32.173 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing_on_primary": 0, 2020-09-08T15:27:32.173 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing": 0, 2020-09-08T15:27:32.174 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_degraded": 100, 2020-09-08T15:27:32.174 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_misplaced": 0, 2020-09-08T15:27:32.175 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_unfound": 0, 2020-09-08T15:27:32.175 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_dirty": 100, 2020-09-08T15:27:32.175 INFO:tasks.workunit.client.0.smithi065.stdout: "num_whiteouts": 0, 2020-09-08T15:27:32.175 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read": 0, 2020-09-08T15:27:32.175 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read_kb": 0, 2020-09-08T15:27:32.175 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write": 101, 2020-09-08T15:27:32.176 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write_kb": 101, 2020-09-08T15:27:32.176 INFO:tasks.workunit.client.0.smithi065.stdout: "num_scrub_errors": 0, 2020-09-08T15:27:32.176 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shallow_scrub_errors": 0, 2020-09-08T15:27:32.176 INFO:tasks.workunit.client.0.smithi065.stdout: "num_deep_scrub_errors": 0, 2020-09-08T15:27:32.176 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_recovered": 0, 2020-09-08T15:27:32.177 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_recovered": 0, 2020-09-08T15:27:32.177 INFO:tasks.workunit.client.0.smithi065.stdout: "num_keys_recovered": 0, 2020-09-08T15:27:32.177 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_omap": 0, 2020-09-08T15:27:32.177 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_hit_set_archive": 0, 2020-09-08T15:27:32.177 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_hit_set_archive": 0, 2020-09-08T15:27:32.178 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush": 0, 2020-09-08T15:27:32.178 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_kb": 0, 2020-09-08T15:27:32.178 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict": 0, 2020-09-08T15:27:32.178 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_kb": 0, 2020-09-08T15:27:32.178 INFO:tasks.workunit.client.0.smithi065.stdout: "num_promote": 0, 2020-09-08T15:27:32.178 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_high": 0, 2020-09-08T15:27:32.179 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_low": 0, 2020-09-08T15:27:32.179 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_some": 0, 2020-09-08T15:27:32.179 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_full": 0, 2020-09-08T15:27:32.179 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_pinned": 0, 2020-09-08T15:27:32.179 INFO:tasks.workunit.client.0.smithi065.stdout: "num_legacy_snapsets": 0, 2020-09-08T15:27:32.180 INFO:tasks.workunit.client.0.smithi065.stdout: "num_large_omap_objects": 0, 2020-09-08T15:27:32.180 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_manifest": 0, 2020-09-08T15:27:32.180 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_bytes": 0, 2020-09-08T15:27:32.180 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_keys": 0, 2020-09-08T15:27:32.180 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_repaired": 0 2020-09-08T15:27:32.181 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.181 INFO:tasks.workunit.client.0.smithi065.stdout: "store_stats": { 2020-09-08T15:27:32.181 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 0, 2020-09-08T15:27:32.181 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 0, 2020-09-08T15:27:32.181 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:27:32.182 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 0, 2020-09-08T15:27:32.182 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 0, 2020-09-08T15:27:32.182 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:27:32.182 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:27:32.182 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:27:32.182 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 0, 2020-09-08T15:27:32.183 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 0 2020-09-08T15:27:32.183 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.183 INFO:tasks.workunit.client.0.smithi065.stdout: "log_size": 17, 2020-09-08T15:27:32.183 INFO:tasks.workunit.client.0.smithi065.stdout: "ondisk_log_size": 17, 2020-09-08T15:27:32.183 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 2, 2020-09-08T15:27:32.184 INFO:tasks.workunit.client.0.smithi065.stdout: "acting": 2, 2020-09-08T15:27:32.184 INFO:tasks.workunit.client.0.smithi065.stdout: "num_store_stats": 0 2020-09-08T15:27:32.184 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.185 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_sum": { 2020-09-08T15:27:32.185 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 0, 2020-09-08T15:27:32.185 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 0, 2020-09-08T15:27:32.186 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pgs": 3, 2020-09-08T15:27:32.186 INFO:tasks.workunit.client.0.smithi065.stdout: "num_osds": 3, 2020-09-08T15:27:32.186 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_osds": 3, 2020-09-08T15:27:32.186 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_omap_osds": 3, 2020-09-08T15:27:32.186 INFO:tasks.workunit.client.0.smithi065.stdout: "kb": 314572800, 2020-09-08T15:27:32.187 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used": 18168, 2020-09-08T15:27:32.187 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_data": 2072, 2020-09-08T15:27:32.187 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_omap": 1, 2020-09-08T15:27:32.187 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_meta": 16062, 2020-09-08T15:27:32.187 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_avail": 314554632, 2020-09-08T15:27:32.188 INFO:tasks.workunit.client.0.smithi065.stdout: "statfs": { 2020-09-08T15:27:32.188 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 322122547200, 2020-09-08T15:27:32.188 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 322103943168, 2020-09-08T15:27:32.188 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:27:32.188 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 2121728, 2020-09-08T15:27:32.189 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 402538, 2020-09-08T15:27:32.189 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:27:32.189 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:27:32.189 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:27:32.189 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 1928, 2020-09-08T15:27:32.189 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 16447608 2020-09-08T15:27:32.190 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.190 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_peers": [], 2020-09-08T15:27:32.190 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_trim_queue_len": 0, 2020-09-08T15:27:32.190 INFO:tasks.workunit.client.0.smithi065.stdout: "num_snap_trimming": 0, 2020-09-08T15:27:32.190 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shards_repaired": 0, 2020-09-08T15:27:32.191 INFO:tasks.workunit.client.0.smithi065.stdout: "op_queue_age_hist": { 2020-09-08T15:27:32.191 INFO:tasks.workunit.client.0.smithi065.stdout: "histogram": [], 2020-09-08T15:27:32.191 INFO:tasks.workunit.client.0.smithi065.stdout: "upper_bound": 1 2020-09-08T15:27:32.191 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.191 INFO:tasks.workunit.client.0.smithi065.stdout: "perf_stat": { 2020-09-08T15:27:32.192 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ms": 0, 2020-09-08T15:27:32.192 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ms": 0, 2020-09-08T15:27:32.192 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ns": 0, 2020-09-08T15:27:32.192 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ns": 0 2020-09-08T15:27:32.192 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.192 INFO:tasks.workunit.client.0.smithi065.stdout: "alerts": [], 2020-09-08T15:27:32.193 INFO:tasks.workunit.client.0.smithi065.stdout: "network_ping_times": [] 2020-09-08T15:27:32.193 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.193 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_sum_by_class": { 2020-09-08T15:27:32.193 INFO:tasks.workunit.client.0.smithi065.stdout: "hdd": { 2020-09-08T15:27:32.193 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 0, 2020-09-08T15:27:32.194 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 0, 2020-09-08T15:27:32.194 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pgs": 3, 2020-09-08T15:27:32.194 INFO:tasks.workunit.client.0.smithi065.stdout: "num_osds": 3, 2020-09-08T15:27:32.194 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_osds": 3, 2020-09-08T15:27:32.194 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_omap_osds": 3, 2020-09-08T15:27:32.195 INFO:tasks.workunit.client.0.smithi065.stdout: "kb": 314572800, 2020-09-08T15:27:32.195 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used": 18168, 2020-09-08T15:27:32.195 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_data": 2072, 2020-09-08T15:27:32.196 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_omap": 1, 2020-09-08T15:27:32.196 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_meta": 16062, 2020-09-08T15:27:32.196 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_avail": 314554632, 2020-09-08T15:27:32.196 INFO:tasks.workunit.client.0.smithi065.stdout: "statfs": { 2020-09-08T15:27:32.196 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 322122547200, 2020-09-08T15:27:32.197 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 322103943168, 2020-09-08T15:27:32.197 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:27:32.197 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 2121728, 2020-09-08T15:27:32.197 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 402538, 2020-09-08T15:27:32.197 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:27:32.198 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:27:32.198 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:27:32.198 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 1928, 2020-09-08T15:27:32.198 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 16447608 2020-09-08T15:27:32.198 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.199 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_peers": [], 2020-09-08T15:27:32.199 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_trim_queue_len": 0, 2020-09-08T15:27:32.199 INFO:tasks.workunit.client.0.smithi065.stdout: "num_snap_trimming": 0, 2020-09-08T15:27:32.199 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shards_repaired": 0, 2020-09-08T15:27:32.199 INFO:tasks.workunit.client.0.smithi065.stdout: "op_queue_age_hist": { 2020-09-08T15:27:32.199 INFO:tasks.workunit.client.0.smithi065.stdout: "histogram": [], 2020-09-08T15:27:32.200 INFO:tasks.workunit.client.0.smithi065.stdout: "upper_bound": 1 2020-09-08T15:27:32.200 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.200 INFO:tasks.workunit.client.0.smithi065.stdout: "perf_stat": { 2020-09-08T15:27:32.200 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ms": 0, 2020-09-08T15:27:32.200 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ms": 0, 2020-09-08T15:27:32.201 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ns": 0, 2020-09-08T15:27:32.201 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ns": 0 2020-09-08T15:27:32.201 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.201 INFO:tasks.workunit.client.0.smithi065.stdout: "alerts": [], 2020-09-08T15:27:32.201 INFO:tasks.workunit.client.0.smithi065.stdout: "network_ping_times": [] 2020-09-08T15:27:32.202 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.202 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.202 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_stats": [ 2020-09-08T15:27:32.202 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.202 INFO:tasks.workunit.client.0.smithi065.stdout: "poolid": 1, 2020-09-08T15:27:32.202 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg": 1, 2020-09-08T15:27:32.203 INFO:tasks.workunit.client.0.smithi065.stdout: "stat_sum": { 2020-09-08T15:27:32.203 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes": 47947, 2020-09-08T15:27:32.203 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects": 100, 2020-09-08T15:27:32.203 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_clones": 0, 2020-09-08T15:27:32.203 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_copies": 300, 2020-09-08T15:27:32.204 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing_on_primary": 0, 2020-09-08T15:27:32.204 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing": 0, 2020-09-08T15:27:32.204 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_degraded": 100, 2020-09-08T15:27:32.204 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_misplaced": 0, 2020-09-08T15:27:32.204 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_unfound": 0, 2020-09-08T15:27:32.204 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_dirty": 100, 2020-09-08T15:27:32.205 INFO:tasks.workunit.client.0.smithi065.stdout: "num_whiteouts": 0, 2020-09-08T15:27:32.205 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read": 0, 2020-09-08T15:27:32.205 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read_kb": 0, 2020-09-08T15:27:32.205 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write": 101, 2020-09-08T15:27:32.206 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write_kb": 101, 2020-09-08T15:27:32.206 INFO:tasks.workunit.client.0.smithi065.stdout: "num_scrub_errors": 0, 2020-09-08T15:27:32.206 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shallow_scrub_errors": 0, 2020-09-08T15:27:32.207 INFO:tasks.workunit.client.0.smithi065.stdout: "num_deep_scrub_errors": 0, 2020-09-08T15:27:32.207 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_recovered": 0, 2020-09-08T15:27:32.207 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_recovered": 0, 2020-09-08T15:27:32.207 INFO:tasks.workunit.client.0.smithi065.stdout: "num_keys_recovered": 0, 2020-09-08T15:27:32.207 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_omap": 0, 2020-09-08T15:27:32.208 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_hit_set_archive": 0, 2020-09-08T15:27:32.208 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_hit_set_archive": 0, 2020-09-08T15:27:32.208 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush": 0, 2020-09-08T15:27:32.208 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_kb": 0, 2020-09-08T15:27:32.208 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict": 0, 2020-09-08T15:27:32.208 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_kb": 0, 2020-09-08T15:27:32.209 INFO:tasks.workunit.client.0.smithi065.stdout: "num_promote": 0, 2020-09-08T15:27:32.209 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_high": 0, 2020-09-08T15:27:32.209 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_low": 0, 2020-09-08T15:27:32.209 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_some": 0, 2020-09-08T15:27:32.209 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_full": 0, 2020-09-08T15:27:32.210 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_pinned": 0, 2020-09-08T15:27:32.210 INFO:tasks.workunit.client.0.smithi065.stdout: "num_legacy_snapsets": 0, 2020-09-08T15:27:32.210 INFO:tasks.workunit.client.0.smithi065.stdout: "num_large_omap_objects": 0, 2020-09-08T15:27:32.210 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_manifest": 0, 2020-09-08T15:27:32.210 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_bytes": 0, 2020-09-08T15:27:32.211 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_keys": 0, 2020-09-08T15:27:32.211 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_repaired": 0 2020-09-08T15:27:32.211 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.211 INFO:tasks.workunit.client.0.smithi065.stdout: "store_stats": { 2020-09-08T15:27:32.211 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 0, 2020-09-08T15:27:32.211 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 0, 2020-09-08T15:27:32.212 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:27:32.212 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 1220608, 2020-09-08T15:27:32.212 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 142522, 2020-09-08T15:27:32.212 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:27:32.212 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:27:32.213 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:27:32.213 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 0, 2020-09-08T15:27:32.213 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 0 2020-09-08T15:27:32.213 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.213 INFO:tasks.workunit.client.0.smithi065.stdout: "log_size": 17, 2020-09-08T15:27:32.214 INFO:tasks.workunit.client.0.smithi065.stdout: "ondisk_log_size": 17, 2020-09-08T15:27:32.214 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 2, 2020-09-08T15:27:32.214 INFO:tasks.workunit.client.0.smithi065.stdout: "acting": 2, 2020-09-08T15:27:32.214 INFO:tasks.workunit.client.0.smithi065.stdout: "num_store_stats": 3 2020-09-08T15:27:32.214 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.214 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:27:32.215 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_stats": [ 2020-09-08T15:27:32.215 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.215 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:27:32.215 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 150323855380 2020-09-08T15:27:32.215 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.216 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.216 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:27:32.216 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 42949672977 2020-09-08T15:27:32.217 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.217 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.217 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:27:32.217 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 154618822676 2020-09-08T15:27:32.217 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.218 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:27:32.218 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_by_state": [ 2020-09-08T15:27:32.218 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.218 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "active+undersized+degraded", 2020-09-08T15:27:32.218 INFO:tasks.workunit.client.0.smithi065.stdout: "num": 1 2020-09-08T15:27:32.219 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.219 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:27:32.219 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_by_osd": [ 2020-09-08T15:27:32.219 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.219 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:27:32.220 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 0, 2020-09-08T15:27:32.220 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 1, 2020-09-08T15:27:32.220 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:27:32.220 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.220 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.220 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:27:32.221 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 0, 2020-09-08T15:27:32.221 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 0, 2020-09-08T15:27:32.221 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:27:32.221 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.221 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.222 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:27:32.222 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 1, 2020-09-08T15:27:32.222 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 1, 2020-09-08T15:27:32.222 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:27:32.222 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.223 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:27:32.223 INFO:tasks.workunit.client.0.smithi065.stdout: "purged_snaps": [ 2020-09-08T15:27:32.223 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:27:32.223 INFO:tasks.workunit.client.0.smithi065.stdout: "pool": 1, 2020-09-08T15:27:32.223 INFO:tasks.workunit.client.0.smithi065.stdout: "purged_snaps": {} 2020-09-08T15:27:32.223 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.224 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:27:32.224 INFO:tasks.workunit.client.0.smithi065.stdout: "servicemap": { 2020-09-08T15:27:32.224 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 6, 2020-09-08T15:27:32.224 INFO:tasks.workunit.client.0.smithi065.stdout: "modified": "2020-09-08T15:27:17.320509+0000", 2020-09-08T15:27:32.224 INFO:tasks.workunit.client.0.smithi065.stdout: "services": {} 2020-09-08T15:27:32.225 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:27:32.225 INFO:tasks.workunit.client.0.smithi065.stdout: "paxos": { 2020-09-08T15:27:32.225 INFO:tasks.workunit.client.0.smithi065.stdout: "first_committed": 1, 2020-09-08T15:27:32.225 INFO:tasks.workunit.client.0.smithi065.stdout: "last_committed": 442, 2020-09-08T15:27:32.225 INFO:tasks.workunit.client.0.smithi065.stdout: "last_pn": 0, 2020-09-08T15:27:32.225 INFO:tasks.workunit.client.0.smithi065.stdout: "accepted_pn": 0 2020-09-08T15:27:32.226 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:27:32.226 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:27:32.227 INFO:tasks.workunit.client.0.smithi065.stderr:report 3159814865 2020-09-08T15:27:32.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1604: wait_for_clean: return 1 2020-09-08T15:27:32.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:536: TEST_divergent_2: echo 'delay recovery' 2020-09-08T15:27:32.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:537: TEST_divergent_2: ceph pg dump pgs 2020-09-08T15:27:32.228 INFO:tasks.workunit.client.0.smithi065.stdout:delay recovery 2020-09-08T15:27:32.363 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:27:32.364 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 0 100 0 0 47947 0 0 17 17 active+undersized+degraded 2020-09-08T15:26:17.932310+0000 39'101 39:121 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:25:25.927857+0000 0'0 2020-09-08T15:25:25.927857+0000 0 2020-09-08T15:27:32.364 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:27:32.364 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:27:32.365 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:27:32.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:538: TEST_divergent_2: for i in $non_divergent 2020-09-08T15:27:32.375 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: get_asok_path osd.0 2020-09-08T15:27:32.375 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-09-08T15:27:32.376 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-09-08T15:27:32.376 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:27:32.376 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:27:32.376 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:27:32.376 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.0.asok 2020-09-08T15:27:32.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: CEPH_ARGS= 2020-09-08T15:27:32.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.0.asok set_recovery_delay 100000 2020-09-08T15:27:32.472 INFO:tasks.workunit.client.0.smithi065.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2020-09-08T15:27:32.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:538: TEST_divergent_2: for i in $non_divergent 2020-09-08T15:27:32.480 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: get_asok_path osd.2 2020-09-08T15:27:32.480 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-09-08T15:27:32.481 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-09-08T15:27:32.481 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:27:32.482 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:27:32.482 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:27:32.482 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.2.asok 2020-09-08T15:27:32.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: CEPH_ARGS= 2020-09-08T15:27:32.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.2.asok set_recovery_delay 100000 2020-09-08T15:27:32.578 INFO:tasks.workunit.client.0.smithi065.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2020-09-08T15:27:32.585 INFO:tasks.workunit.client.0.smithi065.stdout:revive divergent 1 2020-09-08T15:27:32.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:544: TEST_divergent_2: echo 'revive divergent 1' 2020-09-08T15:27:32.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:545: TEST_divergent_2: ceph pg dump pgs 2020-09-08T15:27:32.970 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:27:32.971 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 0 100 0 0 47947 0 0 17 17 active+undersized+degraded 2020-09-08T15:26:17.932310+0000 39'101 39:121 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:25:25.927857+0000 0'0 2020-09-08T15:25:25.927857+0000 0 2020-09-08T15:27:32.971 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:27:32.971 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:27:32.971 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:27:32.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:546: TEST_divergent_2: ceph osd set noup 2020-09-08T15:27:33.706 INFO:tasks.workunit.client.0.smithi065.stderr:noup is set 2020-09-08T15:27:33.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:547: TEST_divergent_2: activate_osd td/divergent-priors 1 2020-09-08T15:27:33.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/divergent-priors 2020-09-08T15:27:33.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:27:33.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=1 2020-09-08T15:27:33.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:27:33.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/divergent-priors/1 2020-09-08T15:27:33.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:27:33.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:27:33.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:27:33.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:27:33.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2020-09-08T15:27:33.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2020-09-08T15:27:33.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:27:33.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:27:33.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:27:33.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:27:33.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:27:33.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:27:33.721 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:27:33.722 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:27:33.722 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:27:33.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:27:33.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:27:33.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:27:33.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:27:33.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:27:33.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:27:33.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:27:33.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:27:33.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:27:33.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:27:33.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/divergent-priors/1 2020-09-08T15:27:33.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.1 2020-09-08T15:27:33.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 1 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:27:33.726 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/divergent-priors/1/whoami 2020-09-08T15:27:33.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 1 = 1 ']' 2020-09-08T15:27:33.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:27:33.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:27:33.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:27:33.728 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:27:33.744 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:27:33.748+0000 7f216e2a3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:27:33.762 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:27:33.763+0000 7f216e2a3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:27:33.762 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:27:33.764+0000 7f216e2a3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:27:34.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:877: activate_osd: return 0 2020-09-08T15:27:34.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:548: TEST_divergent_2: sleep 5 2020-09-08T15:27:34.274 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:27:34.279+0000 7f216e2a3ec0 -1 Falling back to public interface 2020-09-08T15:27:35.565 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:27:35.570+0000 7f216e2a3ec0 -1 osd.1 29 log_to_monitors {default=true} 2020-09-08T15:27:39.123 INFO:tasks.workunit.client.0.smithi065.stdout:delay recovery divergent 2020-09-08T15:27:39.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:550: TEST_divergent_2: echo 'delay recovery divergent' 2020-09-08T15:27:39.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:551: TEST_divergent_2: ceph pg dump pgs 2020-09-08T15:27:39.509 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:27:39.510 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 0 100 0 0 47947 0 0 17 17 active+undersized+degraded 2020-09-08T15:26:17.932310+0000 39'101 39:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:25:25.927857+0000 0'0 2020-09-08T15:25:25.927857+0000 0 2020-09-08T15:27:39.510 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:27:39.510 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:27:39.511 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:27:39.520 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:552: TEST_divergent_2: get_asok_path osd.1 2020-09-08T15:27:39.520 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-09-08T15:27:39.520 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-09-08T15:27:39.520 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:27:39.521 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:27:39.521 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:27:39.521 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.1.asok 2020-09-08T15:27:39.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:552: TEST_divergent_2: CEPH_ARGS= 2020-09-08T15:27:39.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:552: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.1.asok set_recovery_delay 100000 2020-09-08T15:27:39.626 INFO:tasks.workunit.client.0.smithi065.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2020-09-08T15:27:39.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: ceph osd unset noup 2020-09-08T15:27:40.332 INFO:tasks.workunit.client.0.smithi065.stderr:noup is unset 2020-09-08T15:27:40.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:556: TEST_divergent_2: wait_for_osd up 0 2020-09-08T15:27:40.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:27:40.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:27:40.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:27:40.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:27:40.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:27:40.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:27:40.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:27:40.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:27:40.544 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:27:40.735 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 35 up_thru 38 down_at 30 last_clean_interval [5,29) [v2:127.0.0.1:6802/47402,v1:127.0.0.1:6803/47402] [v2:127.0.0.1:6804/47402,v1:127.0.0.1:6805/47402] exists,up dc78991d-f410-4ef4-a45b-5573679ca87b 2020-09-08T15:27:40.735 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:27:40.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:27:40.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:27:40.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:27:40.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:557: TEST_divergent_2: wait_for_osd up 1 2020-09-08T15:27:40.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:27:40.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:27:40.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:27:40.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:27:40.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:27:40.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:27:40.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:27:40.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:27:41.137 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 43 up_thru 43 down_at 31 last_clean_interval [10,29) [v2:127.0.0.1:6818/50333,v1:127.0.0.1:6819/50333] [v2:127.0.0.1:6820/50333,v1:127.0.0.1:6821/50333] exists,up 0a291c9f-6efd-44cb-baaf-35b800dc7866 2020-09-08T15:27:41.137 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:27:41.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:27:41.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:27:41.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:27:41.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:558: TEST_divergent_2: wait_for_osd up 2 2020-09-08T15:27:41.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:27:41.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:27:41.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:27:41.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:27:41.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:27:41.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:27:41.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:27:41.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:27:41.534 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 36 up_thru 0 down_at 32 last_clean_interval [15,29) [v2:127.0.0.1:6810/47801,v1:127.0.0.1:6811/47801] [v2:127.0.0.1:6812/47801,v1:127.0.0.1:6813/47801] exists,up 1064be2f-cb2a-4046-8814-ce923b7aef68 2020-09-08T15:27:41.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:27:41.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:27:41.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:27:41.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:560: TEST_divergent_2: ceph pg dump pgs 2020-09-08T15:27:41.910 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:27:41.911 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 0 0 0 0 46628 0 0 16 16 peering 2020-09-08T15:27:40.472514+0000 29'106 43:115 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:25:25.927857+0000 0'0 2020-09-08T15:25:25.927857+0000 0 2020-09-08T15:27:41.911 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:27:41.911 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:27:41.912 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:27:41.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:561: TEST_divergent_2: echo 'wait for peering' 2020-09-08T15:27:41.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:562: TEST_divergent_2: ceph pg dump pgs 2020-09-08T15:27:41.920 INFO:tasks.workunit.client.0.smithi065.stdout:wait for peering 2020-09-08T15:27:42.293 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:27:42.293 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 0 0 0 0 46628 0 0 16 16 peering 2020-09-08T15:27:40.472514+0000 29'106 43:115 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:25:25.927857+0000 0'0 2020-09-08T15:25:25.927857+0000 0 2020-09-08T15:27:42.293 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:27:42.294 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:27:42.294 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:27:42.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:563: TEST_divergent_2: rados -p test put foo /etc/fstab 2020-09-08T15:27:54.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:567: TEST_divergent_2: echo 'killing divergent 1' 2020-09-08T15:27:54.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:568: TEST_divergent_2: ceph pg dump pgs 2020-09-08T15:27:54.038 INFO:tasks.workunit.client.0.smithi065.stdout:killing divergent 1 2020-09-08T15:27:54.423 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:27:54.424 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 4 4 0 0 47947 0 0 11 11 active+recovering+degraded+wait 2020-09-08T15:27:41.026544+0000 39'101 44:124 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:25:25.927857+0000 0'0 2020-09-08T15:25:25.927857+0000 0 2020-09-08T15:27:54.424 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:27:54.424 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:27:54.425 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:27:54.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:569: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd.1 2020-09-08T15:27:54.429 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:27:54.429 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:27:54.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:27:54.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:27:54.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:27:54.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:27:54.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:572: TEST_divergent_2: expfile=td/divergent-priors/exp.30667.out 2020-09-08T15:27:54.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:573: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.30667.out 2020-09-08T15:27:54.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local dir=td/divergent-priors 2020-09-08T15:27:54.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2020-09-08T15:27:54.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local id=1 2020-09-08T15:27:54.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1198: _objectstore_tool_nodown: shift 2020-09-08T15:27:54.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2020-09-08T15:27:54.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1202: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.30667.out 2020-09-08T15:27:55.310 INFO:tasks.workunit.client.0.smithi065.stderr:Exporting 1.0 info 1.0( v 44'102 lc 0'0 (29'90,44'102] local-lis/les=43/44 n=101 ec=23/23 lis/c=43/23 les/c/f=44/24/0 sis=43 pruub=12.909746229s) 2020-09-08T15:27:55.321 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:023dd3d2:::existing_12:head# 2020-09-08T15:27:55.322 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:04c40a0c:::existing_93:head# 2020-09-08T15:27:55.324 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:064ff5fb:::existing_36:head# 2020-09-08T15:27:55.330 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:091f9f1d:::existing_94:head# 2020-09-08T15:27:55.345 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:0a865a93:::existing_54:head# 2020-09-08T15:27:55.345 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:0fed513c:::existing_41:head# 2020-09-08T15:27:55.345 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:13b9e0b8:::existing_92:head# 2020-09-08T15:27:55.346 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:169157fa:::existing_81:head# 2020-09-08T15:27:55.346 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:17731382:::existing_58:head# 2020-09-08T15:27:55.346 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:18a45a39:::existing_43:head# 2020-09-08T15:27:55.346 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:1c160f01:::existing_66:head# 2020-09-08T15:27:55.347 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:1dd6c249:::existing_97:head# 2020-09-08T15:27:55.347 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:227e0c77:::existing_7:head# 2020-09-08T15:27:55.347 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:23e1b063:::existing_59:head# 2020-09-08T15:27:55.347 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:28566edb:::existing_78:head# 2020-09-08T15:27:55.347 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2a101182:::existing_20:head# 2020-09-08T15:27:55.348 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2d1519da:::existing_96:head# 2020-09-08T15:27:55.348 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:3078b87a:::existing_86:head# 2020-09-08T15:27:55.348 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:30bde01b:::existing_15:head# 2020-09-08T15:27:55.348 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:317a7e19:::existing_56:head# 2020-09-08T15:27:55.348 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:38b9c7fa:::existing_33:head# 2020-09-08T15:27:55.349 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:3e16d84b:::existing_48:head# 2020-09-08T15:27:55.349 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:45fe8203:::existing_75:head# 2020-09-08T15:27:55.349 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:4e82c9ba:::existing_50:head# 2020-09-08T15:27:55.349 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5298dcdb:::existing_57:head# 2020-09-08T15:27:55.349 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:52ebaa44:::existing_32:head# 2020-09-08T15:27:55.350 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:53588912:::existing_9:head# 2020-09-08T15:27:55.350 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5b7e2de6:::existing_84:head# 2020-09-08T15:27:55.350 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5da0255c:::existing_13:head# 2020-09-08T15:27:55.350 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5da2dab8:::existing_53:head# 2020-09-08T15:27:55.350 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5ee3514b:::existing_30:head# 2020-09-08T15:27:55.351 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:602f83fe:::foo:head# 2020-09-08T15:27:55.351 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:60426cc7:::existing_62:head# 2020-09-08T15:27:55.351 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:628918ca:::existing_79:head# 2020-09-08T15:27:55.351 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:63f8ab2d:::existing_77:head# 2020-09-08T15:27:55.351 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:67e1780f:::existing_27:head# 2020-09-08T15:27:55.356 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:68143ca1:::existing_71:head# 2020-09-08T15:27:55.356 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:6bac9509:::existing_29:head# 2020-09-08T15:27:55.356 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:6bbec798:::existing_45:head# 2020-09-08T15:27:55.356 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:6cb23a40:::existing_65:head# 2020-09-08T15:27:55.357 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7055ec5e:::existing_83:head# 2020-09-08T15:27:55.357 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:70a54e2b:::existing_87:head# 2020-09-08T15:27:55.357 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:750ace21:::existing_19:head# 2020-09-08T15:27:55.357 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:78623b1d:::existing_6:head# 2020-09-08T15:27:55.357 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:79881152:::existing_63:head# 2020-09-08T15:27:55.358 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7a80c0d5:::existing_99:head# 2020-09-08T15:27:55.358 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:81490677:::existing_76:head# 2020-09-08T15:27:55.358 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:85ec8e5d:::existing_85:head# 2020-09-08T15:27:55.358 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8e2abbf0:::existing_49:head# 2020-09-08T15:27:55.358 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8ee0fe0f:::existing_52:head# 2020-09-08T15:27:55.359 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:923c5d4d:::existing_5:head# 2020-09-08T15:27:55.359 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:92731e71:::existing_89:head# 2020-09-08T15:27:55.359 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:928205cf:::existing_82:head# 2020-09-08T15:27:55.359 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:93be2267:::existing_24:head# 2020-09-08T15:27:55.360 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:99ceda2c:::existing_44:head# 2020-09-08T15:27:55.360 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:9dd917ee:::existing_26:head# 2020-09-08T15:27:55.360 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a28805a6:::existing_72:head# 2020-09-08T15:27:55.360 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a294a8f6:::existing_16:head# 2020-09-08T15:27:55.360 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a2f5473a:::existing_42:head# 2020-09-08T15:27:55.360 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a504a533:::existing_90:head# 2020-09-08T15:27:55.365 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a691337e:::existing_61:head# 2020-09-08T15:27:55.366 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a6e8d7ac:::existing_28:head# 2020-09-08T15:27:55.366 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a9fde86e:::existing_18:head# 2020-09-08T15:27:55.366 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:aa309faa:::existing_68:head# 2020-09-08T15:27:55.366 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ae40b0ed:::existing_31:head# 2020-09-08T15:27:55.367 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b279b1fe:::existing_10:head# 2020-09-08T15:27:55.367 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b343e277:::existing_88:head# 2020-09-08T15:27:55.367 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b7130e90:::existing_80:head# 2020-09-08T15:27:55.367 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:bc6f7309:::existing_70:head# 2020-09-08T15:27:55.367 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:be8489b7:::existing_38:head# 2020-09-08T15:27:55.368 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:beb4e5e3:::existing_47:head# 2020-09-08T15:27:55.368 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:bebec877:::existing_74:head# 2020-09-08T15:27:55.368 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c04347d8:::existing_60:head# 2020-09-08T15:27:55.368 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c156033e:::existing_100:head# 2020-09-08T15:27:55.368 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c19f5a8e:::existing_8:head# 2020-09-08T15:27:55.369 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c3e6ebe4:::existing_17:head# 2020-09-08T15:27:55.369 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c6c5a7c2:::existing_39:head# 2020-09-08T15:27:55.369 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:cc1d0abf:::existing_95:head# 2020-09-08T15:27:55.369 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ccb3865b:::existing_73:head# 2020-09-08T15:27:55.371 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:cd84e19e:::existing_40:head# 2020-09-08T15:27:55.371 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d2cd64ce:::existing_37:head# 2020-09-08T15:27:55.371 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d41a25c9:::existing_22:head# 2020-09-08T15:27:55.372 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d7f088da:::existing_91:head# 2020-09-08T15:27:55.372 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d9cbd1d6:::existing_64:head# 2020-09-08T15:27:55.372 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:dcc4ff82:::existing_98:head# 2020-09-08T15:27:55.372 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:dd677bd3:::existing_35:head# 2020-09-08T15:27:55.375 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:dd6d90e7:::existing_46:head# 2020-09-08T15:27:55.376 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:e0e22077:::existing_21:head# 2020-09-08T15:27:55.376 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:e255b710:::existing_55:head# 2020-09-08T15:27:55.376 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:eff1d5db:::existing_14:head# 2020-09-08T15:27:55.377 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:f1b156bf:::existing_23:head# 2020-09-08T15:27:55.377 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:f5ce4199:::existing_34:head# 2020-09-08T15:27:55.377 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:f6809456:::existing_11:head# 2020-09-08T15:27:55.377 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:f699a2a9:::existing_67:head# 2020-09-08T15:27:55.378 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:f9baac43:::existing_25:head# 2020-09-08T15:27:55.378 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:fb76688e:::existing_51:head# 2020-09-08T15:27:55.378 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:fbb92eec:::existing_69:head# 2020-09-08T15:27:55.378 INFO:tasks.workunit.client.0.smithi065.stderr:Export successful 2020-09-08T15:27:55.379 INFO:tasks.workunit.client.0.smithi065.stdout: marking collection for removal 2020-09-08T15:27:55.379 INFO:tasks.workunit.client.0.smithi065.stdout:setting '_remove' omap key 2020-09-08T15:27:55.379 INFO:tasks.workunit.client.0.smithi065.stdout:finish_remove_pgs 1.0_head removing 1.0 2020-09-08T15:27:55.652 INFO:tasks.workunit.client.0.smithi065.stderr:Remove successful 2020-09-08T15:27:56.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:574: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.30667.out 2020-09-08T15:27:56.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local dir=td/divergent-priors 2020-09-08T15:27:56.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2020-09-08T15:27:56.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local id=1 2020-09-08T15:27:56.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1198: _objectstore_tool_nodown: shift 2020-09-08T15:27:56.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2020-09-08T15:27:56.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1202: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.30667.out 2020-09-08T15:27:56.907 INFO:tasks.workunit.client.0.smithi065.stdout:get_pg_num_history pg_num_history pg_num_history(e44 pg_nums {1={23=1}} deleted_pools ) 2020-09-08T15:27:56.908 INFO:tasks.workunit.client.0.smithi065.stdout:Importing pgid 1.0 2020-09-08T15:27:56.908 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:023dd3d2:::existing_12:head# 2020-09-08T15:27:56.908 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:56.977 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:04c40a0c:::existing_93:head# 2020-09-08T15:27:56.977 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.006 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:064ff5fb:::existing_36:head# 2020-09-08T15:27:57.007 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.048 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:091f9f1d:::existing_94:head# 2020-09-08T15:27:57.049 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.123 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:0a865a93:::existing_54:head# 2020-09-08T15:27:57.123 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.157 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:0fed513c:::existing_41:head# 2020-09-08T15:27:57.157 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.190 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:13b9e0b8:::existing_92:head# 2020-09-08T15:27:57.190 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.224 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:169157fa:::existing_81:head# 2020-09-08T15:27:57.224 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.258 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:17731382:::existing_58:head# 2020-09-08T15:27:57.258 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.290 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:18a45a39:::existing_43:head# 2020-09-08T15:27:57.291 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.365 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:1c160f01:::existing_66:head# 2020-09-08T15:27:57.366 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.399 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:1dd6c249:::existing_97:head# 2020-09-08T15:27:57.399 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.466 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:227e0c77:::existing_7:head# 2020-09-08T15:27:57.467 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.501 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:23e1b063:::existing_59:head# 2020-09-08T15:27:57.502 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.561 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:28566edb:::existing_78:head# 2020-09-08T15:27:57.562 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.600 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2a101182:::existing_20:head# 2020-09-08T15:27:57.600 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.633 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2d1519da:::existing_96:head# 2020-09-08T15:27:57.634 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.667 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:3078b87a:::existing_86:head# 2020-09-08T15:27:57.667 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.695 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:30bde01b:::existing_15:head# 2020-09-08T15:27:57.695 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.717 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:317a7e19:::existing_56:head# 2020-09-08T15:27:57.717 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.800 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:38b9c7fa:::existing_33:head# 2020-09-08T15:27:57.800 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.852 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:3e16d84b:::existing_48:head# 2020-09-08T15:27:57.853 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.877 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:45fe8203:::existing_75:head# 2020-09-08T15:27:57.877 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.901 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:4e82c9ba:::existing_50:head# 2020-09-08T15:27:57.902 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.926 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5298dcdb:::existing_57:head# 2020-09-08T15:27:57.927 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.953 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:52ebaa44:::existing_32:head# 2020-09-08T15:27:57.953 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:57.977 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:53588912:::existing_9:head# 2020-09-08T15:27:57.977 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.028 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5b7e2de6:::existing_84:head# 2020-09-08T15:27:58.029 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.060 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5da0255c:::existing_13:head# 2020-09-08T15:27:58.060 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.085 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5da2dab8:::existing_53:head# 2020-09-08T15:27:58.085 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.110 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5ee3514b:::existing_30:head# 2020-09-08T15:27:58.110 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.135 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:602f83fe:::foo:head# 2020-09-08T15:27:58.135 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.169 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:60426cc7:::existing_62:head# 2020-09-08T15:27:58.169 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.185 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:628918ca:::existing_79:head# 2020-09-08T15:27:58.186 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.211 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:63f8ab2d:::existing_77:head# 2020-09-08T15:27:58.211 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.267 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:67e1780f:::existing_27:head# 2020-09-08T15:27:58.268 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.303 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:68143ca1:::existing_71:head# 2020-09-08T15:27:58.303 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.334 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:6bac9509:::existing_29:head# 2020-09-08T15:27:58.335 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.353 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:6bbec798:::existing_45:head# 2020-09-08T15:27:58.353 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.378 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:6cb23a40:::existing_65:head# 2020-09-08T15:27:58.379 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.403 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7055ec5e:::existing_83:head# 2020-09-08T15:27:58.404 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.431 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:70a54e2b:::existing_87:head# 2020-09-08T15:27:58.431 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.454 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:750ace21:::existing_19:head# 2020-09-08T15:27:58.454 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.512 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:78623b1d:::existing_6:head# 2020-09-08T15:27:58.512 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.539 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:79881152:::existing_63:head# 2020-09-08T15:27:58.540 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.574 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7a80c0d5:::existing_99:head# 2020-09-08T15:27:58.574 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.605 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:81490677:::existing_76:head# 2020-09-08T15:27:58.605 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.646 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:85ec8e5d:::existing_85:head# 2020-09-08T15:27:58.646 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.679 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8e2abbf0:::existing_49:head# 2020-09-08T15:27:58.680 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.754 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8ee0fe0f:::existing_52:head# 2020-09-08T15:27:58.755 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.788 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:923c5d4d:::existing_5:head# 2020-09-08T15:27:58.788 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.822 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:92731e71:::existing_89:head# 2020-09-08T15:27:58.823 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.858 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:928205cf:::existing_82:head# 2020-09-08T15:27:58.859 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.888 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:93be2267:::existing_24:head# 2020-09-08T15:27:58.889 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.922 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:99ceda2c:::existing_44:head# 2020-09-08T15:27:58.922 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:58.989 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:9dd917ee:::existing_26:head# 2020-09-08T15:27:58.989 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:59.022 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a28805a6:::existing_72:head# 2020-09-08T15:27:59.022 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:59.055 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a294a8f6:::existing_16:head# 2020-09-08T15:27:59.056 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:59.093 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a2f5473a:::existing_42:head# 2020-09-08T15:27:59.093 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:59.122 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a504a533:::existing_90:head# 2020-09-08T15:27:59.123 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:59.157 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a691337e:::existing_61:head# 2020-09-08T15:27:59.157 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:59.223 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a6e8d7ac:::existing_28:head# 2020-09-08T15:27:59.223 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:59.256 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a9fde86e:::existing_18:head# 2020-09-08T15:27:59.256 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:59.289 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:aa309faa:::existing_68:head# 2020-09-08T15:27:59.290 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:59.323 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ae40b0ed:::existing_31:head# 2020-09-08T15:27:59.323 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:59.380 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b279b1fe:::existing_10:head# 2020-09-08T15:27:59.381 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:59.456 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b343e277:::existing_88:head# 2020-09-08T15:27:59.457 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:59.507 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b7130e90:::existing_80:head# 2020-09-08T15:27:59.507 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:59.541 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:bc6f7309:::existing_70:head# 2020-09-08T15:27:59.541 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:59.599 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:be8489b7:::existing_38:head# 2020-09-08T15:27:59.599 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:59.691 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:beb4e5e3:::existing_47:head# 2020-09-08T15:27:59.691 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:59.727 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:bebec877:::existing_74:head# 2020-09-08T15:27:59.727 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:59.783 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c04347d8:::existing_60:head# 2020-09-08T15:27:59.784 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:59.834 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c156033e:::existing_100:head# 2020-09-08T15:27:59.834 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:59.871 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c19f5a8e:::existing_8:head# 2020-09-08T15:27:59.871 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:59.942 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c3e6ebe4:::existing_17:head# 2020-09-08T15:27:59.943 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:27:59.978 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c6c5a7c2:::existing_39:head# 2020-09-08T15:27:59.979 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:28:00.012 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:cc1d0abf:::existing_95:head# 2020-09-08T15:28:00.012 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:28:00.042 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ccb3865b:::existing_73:head# 2020-09-08T15:28:00.042 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:28:00.076 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:cd84e19e:::existing_40:head# 2020-09-08T15:28:00.077 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:28:00.109 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d2cd64ce:::existing_37:head# 2020-09-08T15:28:00.110 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:28:00.184 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d41a25c9:::existing_22:head# 2020-09-08T15:28:00.185 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:28:00.218 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d7f088da:::existing_91:head# 2020-09-08T15:28:00.219 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:28:00.251 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d9cbd1d6:::existing_64:head# 2020-09-08T15:28:00.251 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:28:00.284 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:dcc4ff82:::existing_98:head# 2020-09-08T15:28:00.285 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:28:00.326 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:dd677bd3:::existing_35:head# 2020-09-08T15:28:00.327 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:28:00.410 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:dd6d90e7:::existing_46:head# 2020-09-08T15:28:00.410 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:28:00.451 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:e0e22077:::existing_21:head# 2020-09-08T15:28:00.452 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:28:00.499 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:e255b710:::existing_55:head# 2020-09-08T15:28:00.499 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:28:00.535 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:eff1d5db:::existing_14:head# 2020-09-08T15:28:00.536 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:28:00.610 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:f1b156bf:::existing_23:head# 2020-09-08T15:28:00.611 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:28:00.670 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:f5ce4199:::existing_34:head# 2020-09-08T15:28:00.873 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:28:00.875 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:f6809456:::existing_11:head# 2020-09-08T15:28:00.875 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:28:00.875 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:f699a2a9:::existing_67:head# 2020-09-08T15:28:00.875 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:28:00.876 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:f9baac43:::existing_25:head# 2020-09-08T15:28:00.876 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:28:00.929 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:fb76688e:::existing_51:head# 2020-09-08T15:28:00.930 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:28:00.979 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:fbb92eec:::existing_69:head# 2020-09-08T15:28:00.979 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:28:01.021 INFO:tasks.workunit.client.0.smithi065.stdout:write_pg epoch 44 info 1.0( v 44'102 lc 0'0 (29'90,44'102] local-lis/les=43/44 n=101 ec=23/23 lis/c=43/23 les/c/f=44/24/0 sis=43 pruub=12.909746229s) 2020-09-08T15:28:01.086 INFO:tasks.workunit.client.0.smithi065.stdout:Import successful 2020-09-08T15:28:01.604 INFO:tasks.workunit.client.0.smithi065.stdout:reviving divergent 1 2020-09-08T15:28:01.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:576: TEST_divergent_2: echo 'reviving divergent 1' 2020-09-08T15:28:01.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:577: TEST_divergent_2: ceph pg dump pgs 2020-09-08T15:28:01.991 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:28:01.992 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 4 4 0 0 47947 0 0 11 11 active+recovering+degraded+wait 2020-09-08T15:27:41.026544+0000 39'101 44:124 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:25:25.927857+0000 0'0 2020-09-08T15:25:25.927857+0000 0 2020-09-08T15:28:01.992 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:28:01.992 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:28:01.992 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:28:02.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:578: TEST_divergent_2: activate_osd td/divergent-priors 1 2020-09-08T15:28:02.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/divergent-priors 2020-09-08T15:28:02.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:28:02.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=1 2020-09-08T15:28:02.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:28:02.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/divergent-priors/1 2020-09-08T15:28:02.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:28:02.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:28:02.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:28:02.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:28:02.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2020-09-08T15:28:02.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2020-09-08T15:28:02.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:28:02.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:28:02.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:28:02.008 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:28:02.008 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:28:02.008 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:28:02.009 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:28:02.009 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:28:02.009 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:28:02.009 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:28:02.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:28:02.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:28:02.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:28:02.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:28:02.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:28:02.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:28:02.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:28:02.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:28:02.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:28:02.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/divergent-priors/1 2020-09-08T15:28:02.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.1 2020-09-08T15:28:02.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 1 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:28:02.013 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/divergent-priors/1/whoami 2020-09-08T15:28:02.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 1 = 1 ']' 2020-09-08T15:28:02.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:28:02.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:28:02.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:28:02.014 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:28:02.030 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:02.034+0000 7fab91e4aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:28:02.031 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:02.036+0000 7fab91e4aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:28:02.032 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:02.037+0000 7fab91e4aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:28:02.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 1 2020-09-08T15:28:02.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:28:02.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:28:02.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:28:02.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:28:02.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:28:02.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:28:02.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:28:02.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:28:02.403 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:28:02.548 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:02.553+0000 7fab91e4aec0 -1 Falling back to public interface 2020-09-08T15:28:02.825 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 43 up_thru 43 down_at 31 last_clean_interval [10,29) [v2:127.0.0.1:6818/50333,v1:127.0.0.1:6819/50333] [v2:127.0.0.1:6820/50333,v1:127.0.0.1:6821/50333] exists,up 0a291c9f-6efd-44cb-baaf-35b800dc7866 2020-09-08T15:28:02.825 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:28:02.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:28:02.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:28:02.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:28:02.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:579: TEST_divergent_2: wait_for_osd up 1 2020-09-08T15:28:02.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:28:02.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:28:02.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:28:02.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:28:02.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:28:02.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:28:02.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:28:02.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:28:03.230 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 43 up_thru 43 down_at 31 last_clean_interval [10,29) [v2:127.0.0.1:6818/50333,v1:127.0.0.1:6819/50333] [v2:127.0.0.1:6820/50333,v1:127.0.0.1:6821/50333] exists,up 0a291c9f-6efd-44cb-baaf-35b800dc7866 2020-09-08T15:28:03.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:28:03.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:28:03.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:28:03.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:581: TEST_divergent_2: sleep 20 2020-09-08T15:28:03.960 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:03.964+0000 7fab91e4aec0 -1 osd.1 44 log_to_monitors {default=true} 2020-09-08T15:28:23.229 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:582: TEST_divergent_2: get_asok_path osd.1 2020-09-08T15:28:23.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-09-08T15:28:23.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-09-08T15:28:23.256 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:28:23.256 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:28:23.256 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:28:23.256 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.1.asok 2020-09-08T15:28:23.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:582: TEST_divergent_2: CEPH_ARGS= 2020-09-08T15:28:23.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:582: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.1.asok dump_ops_in_flight 2020-09-08T15:28:23.330 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:28:23.331 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [], 2020-09-08T15:28:23.331 INFO:tasks.workunit.client.0.smithi065.stdout: "num_ops": 0 2020-09-08T15:28:23.331 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:28:23.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:584: TEST_divergent_2: echo 'allowing recovery' 2020-09-08T15:28:23.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: ceph pg dump pgs 2020-09-08T15:28:23.340 INFO:tasks.workunit.client.0.smithi065.stdout:allowing recovery 2020-09-08T15:28:23.714 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:28:23.714 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 101 0 0 0 0 48430 0 0 12 12 active+clean 2020-09-08T15:28:06.198398+0000 44'102 48:148 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:25:25.927857+0000 0'0 2020-09-08T15:25:25.927857+0000 0 2020-09-08T15:28:23.714 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:28:23.715 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:28:23.715 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:28:23.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:587: TEST_divergent_2: for i in $osds 2020-09-08T15:28:23.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:589: TEST_divergent_2: ceph tell osd.0 debug kick_recovery_wq 0 2020-09-08T15:28:23.853 INFO:tasks.workunit.client.0.smithi065.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2020-09-08T15:28:23.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:587: TEST_divergent_2: for i in $osds 2020-09-08T15:28:23.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:589: TEST_divergent_2: ceph tell osd.1 debug kick_recovery_wq 0 2020-09-08T15:28:23.988 INFO:tasks.workunit.client.0.smithi065.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2020-09-08T15:28:23.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:587: TEST_divergent_2: for i in $osds 2020-09-08T15:28:23.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:589: TEST_divergent_2: ceph tell osd.2 debug kick_recovery_wq 0 2020-09-08T15:28:24.122 INFO:tasks.workunit.client.0.smithi065.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2020-09-08T15:28:24.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: echo 'reading divergent objects' 2020-09-08T15:28:24.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:593: TEST_divergent_2: ceph pg dump pgs 2020-09-08T15:28:24.131 INFO:tasks.workunit.client.0.smithi065.stdout:reading divergent objects 2020-09-08T15:28:24.504 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:28:24.504 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 101 0 0 0 0 48430 0 0 12 12 active+clean 2020-09-08T15:28:06.198398+0000 44'102 48:148 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:25:25.927857+0000 0'0 2020-09-08T15:25:25.927857+0000 0 2020-09-08T15:28:24.505 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:28:24.505 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:28:24.505 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:28:24.514 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:594: TEST_divergent_2: expr 2 + 2 2020-09-08T15:28:24.516 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:594: TEST_divergent_2: seq 1 4 2020-09-08T15:28:24.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:594: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2020-09-08T15:28:24.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:596: TEST_divergent_2: rados -p test get existing_1 td/divergent-priors/existing 2020-09-08T15:28:24.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:594: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2020-09-08T15:28:24.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:596: TEST_divergent_2: rados -p test get existing_2 td/divergent-priors/existing 2020-09-08T15:28:24.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:594: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2020-09-08T15:28:24.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:596: TEST_divergent_2: rados -p test get existing_3 td/divergent-priors/existing 2020-09-08T15:28:24.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:594: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2020-09-08T15:28:24.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:596: TEST_divergent_2: rados -p test get existing_4 td/divergent-priors/existing 2020-09-08T15:28:24.641 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:598: TEST_divergent_2: seq 1 2 2020-09-08T15:28:24.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:598: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2020-09-08T15:28:24.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:600: TEST_divergent_2: rados -p test get newobject_1 td/divergent-priors/existing 2020-09-08T15:28:24.709 INFO:tasks.workunit.client.0.smithi065.stderr:error getting test/newobject_1: (2) No such file or directory 2020-09-08T15:28:24.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:598: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2020-09-08T15:28:24.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:600: TEST_divergent_2: rados -p test get newobject_2 td/divergent-priors/existing 2020-09-08T15:28:24.739 INFO:tasks.workunit.client.0.smithi065.stderr:error getting test/newobject_2: (2) No such file or directory 2020-09-08T15:28:24.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:602: TEST_divergent_2: rm -f td/divergent-priors/existing 2020-09-08T15:28:24.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:604: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2020-09-08T15:28:24.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:604: TEST_divergent_2: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2020-09-08T15:28:24.744 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 29'106 (29'4) delete 1:70b3bf12:::existing_4:head by client.4539.0:1 2020-09-08T15:25:58.023556+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 0, new_object: 0 2020-09-08T15:28:24.744 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 20 _merge_object_divergent_entries: keeping 29'106 (29'4) delete 1:70b3bf12:::existing_4:head by client.4539.0:1 2020-09-08T15:25:58.023556+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 0, new_object: 0 2020-09-08T15:28:24.745 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2020-09-08T15:28:24.745 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 29'4 first_divergent_update: 29'106 last_divergent_update: 29'106 2020-09-08T15:28:24.745 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: more recent entry found: 39'101 (29'4) modify 1:70b3bf12:::existing_4:head by client.4648.0:1 2020-09-08T15:26:54.805103+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0, already merged 2020-09-08T15:28:24.746 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 29'103 (0'0) modify 1:75ac5091:::newobject_2:head by client.4531.0:1 2020-09-08T15:25:58.017404+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 2020-09-08T15:28:24.746 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 20 _merge_object_divergent_entries: keeping 29'103 (0'0) modify 1:75ac5091:::newobject_2:head by client.4531.0:1 2020-09-08T15:25:58.017404+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 2020-09-08T15:28:24.746 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2020-09-08T15:28:24.746 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 29'103 last_divergent_update: 29'103 2020-09-08T15:28:24.747 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2020-09-08T15:28:24.748 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2020-09-08T15:28:24.749 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 29'105 (29'3) delete 1:8881e6d8:::existing_3:head by client.4538.0:1 2020-09-08T15:25:58.023257+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 0, new_object: 0 2020-09-08T15:28:24.749 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 20 _merge_object_divergent_entries: keeping 29'105 (29'3) delete 1:8881e6d8:::existing_3:head by client.4538.0:1 2020-09-08T15:25:58.023257+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 0, new_object: 0 2020-09-08T15:28:24.749 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2020-09-08T15:28:24.749 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 29'3 first_divergent_update: 29'105 last_divergent_update: 29'105 2020-09-08T15:28:24.750 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2020-09-08T15:28:24.751 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2020-09-08T15:28:24.751 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 29'106 2020-09-08T15:28:24.751 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 29'105 (29'3) delete 1:8881e6d8:::existing_3:head by client.4538.0:1 2020-09-08T15:25:58.023257+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 0, new_object: 0 2020-09-08T15:28:24.751 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2020-09-08T15:28:24.752 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 29'3 <= info.log_tail 29'90 2020-09-08T15:28:24.752 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 29'104 (29'2) modify 1:97db2a0f:::existing_2:head by client.4534.0:1 2020-09-08T15:25:58.019504+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:28:24.752 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 20 _merge_object_divergent_entries: keeping 29'104 (29'2) modify 1:97db2a0f:::existing_2:head by client.4534.0:1 2020-09-08T15:25:58.019504+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:28:24.752 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2020-09-08T15:28:24.752 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 29'2 first_divergent_update: 29'104 last_divergent_update: 29'104 2020-09-08T15:28:24.754 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2020-09-08T15:28:24.754 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2020-09-08T15:28:24.754 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 29'106 2020-09-08T15:28:24.754 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 29'104 (29'2) modify 1:97db2a0f:::existing_2:head by client.4534.0:1 2020-09-08T15:25:58.019504+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:28:24.755 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2020-09-08T15:28:24.755 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 29'2 <= info.log_tail 29'90 2020-09-08T15:28:24.755 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 29'102 (29'1) modify 1:d858c035:::existing_1:head by client.4527.0:1 2020-09-08T15:25:58.006174+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:28:24.755 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 20 _merge_object_divergent_entries: keeping 29'102 (29'1) modify 1:d858c035:::existing_1:head by client.4527.0:1 2020-09-08T15:25:58.006174+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:28:24.755 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2020-09-08T15:28:24.757 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 29'1 first_divergent_update: 29'102 last_divergent_update: 29'102 2020-09-08T15:28:24.757 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2020-09-08T15:28:24.758 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2020-09-08T15:28:24.758 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 29'106 2020-09-08T15:28:24.758 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 29'102 (29'1) modify 1:d858c035:::existing_1:head by client.4527.0:1 2020-09-08T15:25:58.006174+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:28:24.758 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2020-09-08T15:28:24.759 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 29'1 <= info.log_tail 29'90 2020-09-08T15:28:24.759 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 29'101 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4526.0:1 2020-09-08T15:25:58.003609+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 2020-09-08T15:28:24.759 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 20 _merge_object_divergent_entries: keeping 29'101 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4526.0:1 2020-09-08T15:25:58.003609+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 2020-09-08T15:28:24.759 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2020-09-08T15:28:24.760 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 29'101 last_divergent_update: 29'101 2020-09-08T15:28:24.760 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2020-09-08T15:28:24.760 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:27:40.915+0000 7f214bbde700 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2020-09-08T15:28:24.761 INFO:tasks.workunit.client.0.smithi065.stdout:success 2020-09-08T15:28:24.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:606: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2020-09-08T15:28:24.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:606: TEST_divergent_2: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2020-09-08T15:28:24.762 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:612: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2020-09-08T15:28:24.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:612: TEST_divergent_2: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2020-09-08T15:28:24.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:617: TEST_divergent_2: echo success 2020-09-08T15:28:24.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:619: TEST_divergent_2: rm td/divergent-priors/td/divergent-priors/exp.30667.out 2020-09-08T15:28:24.762 INFO:tasks.workunit.client.0.smithi065.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.30667.out': No such file or directory 2020-09-08T15:28:24.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:621: TEST_divergent_2: delete_pool test 2020-09-08T15:28:24.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test 2020-09-08T15:28:24.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2020-09-08T15:28:25.302 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' does not exist 2020-09-08T15:28:25.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:622: TEST_divergent_2: kill_daemons td/divergent-priors 2020-09-08T15:28:25.310 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:28:25.310 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:28:25.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:28:25.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:28:25.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:28:25.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:28:25.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2020-09-08T15:28:25.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/divergent-priors 2020-09-08T15:28:25.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:28:25.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/divergent-priors KILL 2020-09-08T15:28:25.418 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:28:25.418 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:28:25.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:28:25.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:28:25.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:28:25.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:28:25.423 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:28:25.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:28:25.423 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:28:25.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:28:25.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:28:25.424 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:28:25.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:28:25.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:28:25.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:28:25.428 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:28:25.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:28:25.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:28:25.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/divergent-priors 2020-09-08T15:28:25.441 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:28:25.441 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:28:25.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:28:25.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30667 2020-09-08T15:28:25.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:28:25.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:28:25.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2020-09-08T15:28:25.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2020-09-08T15:28:25.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/divergent-priors 2020-09-08T15:28:25.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/divergent-priors 2020-09-08T15:28:25.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/divergent-priors 2020-09-08T15:28:25.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:28:25.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/divergent-priors KILL 2020-09-08T15:28:25.444 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:28:25.444 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:28:25.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:28:25.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:28:25.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:28:25.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:28:25.446 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:28:25.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:28:25.447 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:28:25.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:28:25.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:28:25.447 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:28:25.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:28:25.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:28:25.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:28:25.501 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:28:25.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:28:25.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:28:25.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/divergent-priors 2020-09-08T15:28:25.503 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:28:25.503 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:28:25.503 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:28:25.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30667 2020-09-08T15:28:25.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:28:25.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:28:25.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/divergent-priors 2020-09-08T15:28:25.504 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T15:28:25.504 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:28:25.504 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:28:25.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.30667 2020-09-08T15:28:25.505 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T15:28:25.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T15:28:25.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T15:28:25.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2020-09-08T15:28:25.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_3 td/divergent-priors 2020-09-08T15:28:25.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:628: TEST_divergent_3: local dir=td/divergent-priors 2020-09-08T15:28:25.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:631: TEST_divergent_3: local dummyfile=/etc/fstab 2020-09-08T15:28:25.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: local dummyfile2=/etc/resolv.conf 2020-09-08T15:28:25.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: local num_osds=3 2020-09-08T15:28:25.507 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:635: TEST_divergent_3: expr 3 - 1 2020-09-08T15:28:25.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:635: TEST_divergent_3: seq 0 2 2020-09-08T15:28:25.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:635: TEST_divergent_3: local 'osds=0 2020-09-08T15:28:25.507 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:28:25.507 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:28:25.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:636: TEST_divergent_3: run_mon td/divergent-priors a 2020-09-08T15:28:25.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/divergent-priors 2020-09-08T15:28:25.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T15:28:25.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T15:28:25.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T15:28:25.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/divergent-priors/a 2020-09-08T15:28:25.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2020-09-08T15:28:25.788 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T15:28:25.788 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:28:25.788 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:28:25.789 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:28:25.789 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:28:25.789 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:28:25.789 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:28:25.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T15:28:25.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T15:28:25.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T15:28:25.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:28:25.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:28:25.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T15:28:25.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T15:28:25.985 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:28:25.985 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:28:25.986 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:28:25.986 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:28:25.986 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:28:25.986 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:28:25.987 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-mon.a.asok 2020-09-08T15:28:25.987 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:28:25.987 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30667/ceph-mon.a.asok config get fsid 2020-09-08T15:28:26.075 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T15:28:26.076 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:28:26.076 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:28:26.076 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T15:28:26.077 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T15:28:26.077 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:28:26.077 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:28:26.077 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:28:26.078 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:28:26.078 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:28:26.078 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:28:26.079 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-mon.a.asok 2020-09-08T15:28:26.079 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:28:26.079 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30667/ceph-mon.a.asok config get mon_host 2020-09-08T15:28:26.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: run_mgr td/divergent-priors x 2020-09-08T15:28:26.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/divergent-priors 2020-09-08T15:28:26.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T15:28:26.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T15:28:26.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T15:28:26.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/divergent-priors/x 2020-09-08T15:28:26.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T15:28:27.108 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T15:28:27.109 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:28:27.109 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:28:27.109 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:28:27.109 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:28:27.109 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:28:27.110 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:28:27.110 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:28:27.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:28:27.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:638: TEST_divergent_3: for i in $osds 2020-09-08T15:28:27.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: run_osd td/divergent-priors 0 2020-09-08T15:28:27.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/divergent-priors 2020-09-08T15:28:27.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:28:27.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T15:28:27.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:28:27.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/divergent-priors/0 2020-09-08T15:28:27.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:28:27.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:28:27.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:28:27.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:28:27.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2020-09-08T15:28:27.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2020-09-08T15:28:27.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:28:27.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:28:27.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:28:27.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:28:27.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:28:27.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:28:27.143 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:28:27.144 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:28:27.144 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:28:27.144 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:28:27.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:28:27.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:28:27.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:28:27.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:28:27.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:28:27.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:28:27.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:28:27.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:28:27.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:28:27.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:28:27.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:28:27.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/divergent-priors/0 2020-09-08T15:28:27.147 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:28:27.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=017c780f-0863-4f60-9e7f-475ba27124f2 2020-09-08T15:28:27.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 017c780f-0863-4f60-9e7f-475ba27124f2' 2020-09-08T15:28:27.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:28:27.148 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 017c780f-0863-4f60-9e7f-475ba27124f2 2020-09-08T15:28:27.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAbo1dftXuPChAA6mcSKobB8mJdWQjX7C7yGA== 2020-09-08T15:28:27.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAbo1dftXuPChAA6mcSKobB8mJdWQjX7C7yGA=="}' 2020-09-08T15:28:27.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 017c780f-0863-4f60-9e7f-475ba27124f2 -i td/divergent-priors/0/new.json 2020-09-08T15:28:27.516 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:28:27.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/divergent-priors/0/new.json 2020-09-08T15:28:27.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAbo1dftXuPChAA6mcSKobB8mJdWQjX7C7yGA== --osd-uuid 017c780f-0863-4f60-9e7f-475ba27124f2 2020-09-08T15:28:27.558 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:27.562+0000 7fc483ec6ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:28:27.559 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:27.564+0000 7fc483ec6ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:28:27.560 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:27.565+0000 7fc483ec6ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:28:27.561 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:27.566+0000 7fc483ec6ec0 -1 bluestore(td/divergent-priors/0/block) _read_bdev_label failed to open td/divergent-priors/0/block: (2) No such file or directory 2020-09-08T15:28:27.561 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:27.566+0000 7fc483ec6ec0 -1 bluestore(td/divergent-priors/0/block) _read_bdev_label failed to open td/divergent-priors/0/block: (2) No such file or directory 2020-09-08T15:28:27.561 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:27.566+0000 7fc483ec6ec0 -1 bluestore(td/divergent-priors/0/block) _read_bdev_label failed to open td/divergent-priors/0/block: (2) No such file or directory 2020-09-08T15:28:27.598 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:27.599+0000 7fc483ec6ec0 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2020-09-08T15:28:32.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/divergent-priors/0/keyring 2020-09-08T15:28:32.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:28:32.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T15:28:32.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:28:32.123 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T15:28:32.662 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T15:28:32.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T15:28:32.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:28:32.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:28:32.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:28:32.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:28:32.691 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:32.696+0000 7f440cff4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:28:32.708 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:32.713+0000 7f440cff4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:28:32.710 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:32.715+0000 7f440cff4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:28:33.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T15:28:33.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:28:33.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:28:33.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:28:33.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:28:33.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:28:33.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:28:33.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:28:33.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:28:33.065 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:28:33.226 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:33.230+0000 7f440cff4ec0 -1 Falling back to public interface 2020-09-08T15:28:33.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:28:34.067 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:34.072+0000 7f440cff4ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T15:28:34.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:28:34.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:28:34.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:28:34.465 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:28:34.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:28:34.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:28:34.881 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/53048,v1:127.0.0.1:6803/53048] [v2:127.0.0.1:6804/53048,v1:127.0.0.1:6805/53048] exists,up 017c780f-0863-4f60-9e7f-475ba27124f2 2020-09-08T15:28:34.882 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 caaf9207-8d21-4a1e-ae34-2becc94a4d1f 2020-09-08T15:28:34.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:28:34.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:28:34.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:28:34.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:638: TEST_divergent_3: for i in $osds 2020-09-08T15:28:34.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: run_osd td/divergent-priors 1 2020-09-08T15:28:34.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/divergent-priors 2020-09-08T15:28:34.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:28:34.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T15:28:34.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:28:34.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/divergent-priors/1 2020-09-08T15:28:34.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:28:34.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:28:34.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:28:34.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:28:34.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2020-09-08T15:28:34.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2020-09-08T15:28:34.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:28:34.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:28:34.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:28:34.887 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:28:34.888 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:28:34.888 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:28:34.888 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:28:34.888 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:28:34.888 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:28:34.889 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:28:34.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:28:34.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:28:34.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:28:34.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:28:34.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:28:34.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:28:34.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:28:34.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:28:34.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:28:34.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:28:34.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:28:34.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/divergent-priors/1 2020-09-08T15:28:34.892 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:28:34.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=caaf9207-8d21-4a1e-ae34-2becc94a4d1f 2020-09-08T15:28:34.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 caaf9207-8d21-4a1e-ae34-2becc94a4d1f' 2020-09-08T15:28:34.893 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:28:34.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAio1dfg6oBNhAA6U93eepVQzE38nJY7c06zQ== 2020-09-08T15:28:34.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAio1dfg6oBNhAA6U93eepVQzE38nJY7c06zQ=="}' 2020-09-08T15:28:34.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new caaf9207-8d21-4a1e-ae34-2becc94a4d1f -i td/divergent-priors/1/new.json 2020-09-08T15:28:35.481 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:28:35.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/divergent-priors/1/new.json 2020-09-08T15:28:35.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAio1dfg6oBNhAA6U93eepVQzE38nJY7c06zQ== --osd-uuid caaf9207-8d21-4a1e-ae34-2becc94a4d1f 2020-09-08T15:28:35.526 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:35.527+0000 7f7dcbc9dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:28:35.527 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:35.529+0000 7f7dcbc9dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:28:35.527 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:35.530+0000 7f7dcbc9dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:28:35.527 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:35.531+0000 7f7dcbc9dec0 -1 bluestore(td/divergent-priors/1/block) _read_bdev_label failed to open td/divergent-priors/1/block: (2) No such file or directory 2020-09-08T15:28:35.527 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:35.531+0000 7f7dcbc9dec0 -1 bluestore(td/divergent-priors/1/block) _read_bdev_label failed to open td/divergent-priors/1/block: (2) No such file or directory 2020-09-08T15:28:35.528 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:35.531+0000 7f7dcbc9dec0 -1 bluestore(td/divergent-priors/1/block) _read_bdev_label failed to open td/divergent-priors/1/block: (2) No such file or directory 2020-09-08T15:28:35.570 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:35.574+0000 7f7dcbc9dec0 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2020-09-08T15:28:40.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/divergent-priors/1/keyring 2020-09-08T15:28:40.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:28:40.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T15:28:40.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:28:40.423 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T15:28:40.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T15:28:40.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:28:40.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:28:40.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:28:40.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:28:40.968 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:28:40.995 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:41.000+0000 7ff2dfbf6ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:28:41.034 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:41.039+0000 7ff2dfbf6ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:28:41.035 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:41.040+0000 7ff2dfbf6ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:28:41.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T15:28:41.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:28:41.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:28:41.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:28:41.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:28:41.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:28:41.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:28:41.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:28:41.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:28:41.401 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:28:41.553 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:41.558+0000 7ff2dfbf6ec0 -1 Falling back to public interface 2020-09-08T15:28:41.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:28:42.370 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:42.375+0000 7ff2dfbf6ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T15:28:42.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:28:42.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:28:42.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:28:42.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:28:42.801 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:28:42.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:28:43.228 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/54043,v1:127.0.0.1:6811/54043] [v2:127.0.0.1:6812/54043,v1:127.0.0.1:6813/54043] exists,up caaf9207-8d21-4a1e-ae34-2becc94a4d1f 2020-09-08T15:28:43.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:28:43.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:28:43.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:28:43.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:638: TEST_divergent_3: for i in $osds 2020-09-08T15:28:43.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: run_osd td/divergent-priors 2 2020-09-08T15:28:43.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/divergent-priors 2020-09-08T15:28:43.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:28:43.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T15:28:43.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:28:43.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/divergent-priors/2 2020-09-08T15:28:43.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:28:43.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:28:43.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:28:43.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:28:43.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2020-09-08T15:28:43.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2020-09-08T15:28:43.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:28:43.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:28:43.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:28:43.237 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:28:43.237 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:28:43.237 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:28:43.238 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:28:43.238 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:28:43.238 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:28:43.238 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:28:43.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:28:43.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:28:43.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:28:43.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:28:43.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:28:43.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:28:43.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:28:43.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:28:43.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:28:43.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:28:43.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:28:43.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/divergent-priors/2 2020-09-08T15:28:43.241 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:28:43.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=559be8ed-3798-4af1-85bb-af8664f6f09f 2020-09-08T15:28:43.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 559be8ed-3798-4af1-85bb-af8664f6f09f' 2020-09-08T15:28:43.241 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:28:43.241 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 559be8ed-3798-4af1-85bb-af8664f6f09f 2020-09-08T15:28:43.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAro1dfVD8/DxAAJQDnz/ylGb10wWR8Vp/D0Q== 2020-09-08T15:28:43.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAro1dfVD8/DxAAJQDnz/ylGb10wWR8Vp/D0Q=="}' 2020-09-08T15:28:43.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 559be8ed-3798-4af1-85bb-af8664f6f09f -i td/divergent-priors/2/new.json 2020-09-08T15:28:43.786 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T15:28:43.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/divergent-priors/2/new.json 2020-09-08T15:28:43.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAro1dfVD8/DxAAJQDnz/ylGb10wWR8Vp/D0Q== --osd-uuid 559be8ed-3798-4af1-85bb-af8664f6f09f 2020-09-08T15:28:43.833 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:43.833+0000 7fc6cb0faec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:28:43.834 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:43.834+0000 7fc6cb0faec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:28:43.835 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:43.836+0000 7fc6cb0faec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:28:43.835 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:43.836+0000 7fc6cb0faec0 -1 bluestore(td/divergent-priors/2/block) _read_bdev_label failed to open td/divergent-priors/2/block: (2) No such file or directory 2020-09-08T15:28:43.835 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:43.836+0000 7fc6cb0faec0 -1 bluestore(td/divergent-priors/2/block) _read_bdev_label failed to open td/divergent-priors/2/block: (2) No such file or directory 2020-09-08T15:28:43.835 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:43.836+0000 7fc6cb0faec0 -1 bluestore(td/divergent-priors/2/block) _read_bdev_label failed to open td/divergent-priors/2/block: (2) No such file or directory 2020-09-08T15:28:43.927 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:43.932+0000 7fc6cb0faec0 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2020-09-08T15:28:48.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/divergent-priors/2/keyring 2020-09-08T15:28:48.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:28:48.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T15:28:48.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:28:48.494 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T15:28:49.068 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T15:28:49.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T15:28:49.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:28:49.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:28:49.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:28:49.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:28:49.096 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:49.101+0000 7f1a1ceb9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:28:49.108 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:49.112+0000 7f1a1ceb9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:28:49.109 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:49.114+0000 7f1a1ceb9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:28:49.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T15:28:49.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:28:49.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:28:49.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:28:49.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:28:49.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:28:49.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:28:49.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:28:49.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:28:49.475 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:28:49.631 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:49.634+0000 7f1a1ceb9ec0 -1 Falling back to public interface 2020-09-08T15:28:49.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:28:50.408 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:28:50.413+0000 7f1a1ceb9ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T15:28:50.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:28:50.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:28:50.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:28:50.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:28:50.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:28:50.891 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:28:51.307 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/55044,v1:127.0.0.1:6819/55044] [v2:127.0.0.1:6820/55044,v1:127.0.0.1:6821/55044] exists,up 559be8ed-3798-4af1-85bb-af8664f6f09f 2020-09-08T15:28:51.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:28:51.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:28:51.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:28:51.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:643: TEST_divergent_3: ceph osd set noout 2020-09-08T15:28:52.144 INFO:tasks.workunit.client.0.smithi065.stderr:noout is set 2020-09-08T15:28:52.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:644: TEST_divergent_3: ceph osd set noin 2020-09-08T15:28:52.912 INFO:tasks.workunit.client.0.smithi065.stderr:noin is set 2020-09-08T15:28:52.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:645: TEST_divergent_3: ceph osd set nodown 2020-09-08T15:28:53.614 INFO:tasks.workunit.client.0.smithi065.stderr:nodown is set 2020-09-08T15:28:53.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:646: TEST_divergent_3: create_pool test 1 1 2020-09-08T15:28:53.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test 1 1 2020-09-08T15:28:54.221 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' already exists 2020-09-08T15:28:54.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:28:55.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:647: TEST_divergent_3: ceph osd pool set test size 3 2020-09-08T15:28:56.054 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 3 2020-09-08T15:28:56.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:648: TEST_divergent_3: ceph osd pool set test min_size 2 2020-09-08T15:28:56.816 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 min_size to 2 2020-09-08T15:28:56.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:651: TEST_divergent_3: ceph osd pool set test pg_autoscale_mode on 2020-09-08T15:28:57.526 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 pg_autoscale_mode to on 2020-09-08T15:28:57.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:653: TEST_divergent_3: flush_pg_stats 2020-09-08T15:28:57.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:28:57.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:28:57.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:28:57.930 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:28:57.931 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:28:57.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:28:57.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:28:57.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:28:58.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836487 2020-09-08T15:28:58.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836487 2020-09-08T15:28:58.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836487' 2020-09-08T15:28:58.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:28:58.067 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:28:58.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672965 2020-09-08T15:28:58.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672965 2020-09-08T15:28:58.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836487 1-42949672965' 2020-09-08T15:28:58.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:28:58.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:28:58.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509444 2020-09-08T15:28:58.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509444 2020-09-08T15:28:58.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836487 1-42949672965 2-64424509444' 2020-09-08T15:28:58.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:28:58.342 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836487 2020-09-08T15:28:58.343 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:28:58.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:28:58.345 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836487 2020-09-08T15:28:58.345 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:28:58.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836487 2020-09-08T15:28:58.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2020-09-08T15:28:58.346 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:28:58.346 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836487 2020-09-08T15:28:58.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836485 -lt 21474836487 2020-09-08T15:28:58.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:28:59.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:28:59.739 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:29:00.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836487 -lt 21474836487 2020-09-08T15:29:00.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:29:00.147 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672965 2020-09-08T15:29:00.147 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:29:00.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:29:00.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672965 2020-09-08T15:29:00.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:29:00.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672965 2020-09-08T15:29:00.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672965' 2020-09-08T15:29:00.150 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:29:00.150 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672965 2020-09-08T15:29:00.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672966 -lt 42949672965 2020-09-08T15:29:00.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:29:00.565 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509444 2020-09-08T15:29:00.566 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:29:00.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:29:00.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509444 2020-09-08T15:29:00.569 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:29:00.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509444 2020-09-08T15:29:00.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509444' 2020-09-08T15:29:00.582 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:29:00.582 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509444 2020-09-08T15:29:00.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509444 -lt 64424509444 2020-09-08T15:29:00.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:654: TEST_divergent_3: wait_for_clean 2020-09-08T15:29:00.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:29:00.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:29:00.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:29:00.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:29:00.977 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T15:29:00.977 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:29:00.977 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:29:00.977 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:29:00.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:29:00.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:29:01.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:29:01.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:29:01.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:29:01.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:29:01.075 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:29:01.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:29:01.531 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:29:01.532 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:29:01.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:29:01.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:29:01.533 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:29:01.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836490 2020-09-08T15:29:01.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836490 2020-09-08T15:29:01.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836490' 2020-09-08T15:29:01.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:29:01.666 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:29:01.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672968 2020-09-08T15:29:01.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672968 2020-09-08T15:29:01.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836490 1-42949672968' 2020-09-08T15:29:01.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:29:01.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:29:01.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509447 2020-09-08T15:29:01.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509447 2020-09-08T15:29:01.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836490 1-42949672968 2-64424509447' 2020-09-08T15:29:01.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:29:01.942 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836490 2020-09-08T15:29:01.943 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:29:01.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:29:01.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836490 2020-09-08T15:29:01.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:29:01.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836490 2020-09-08T15:29:01.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2020-09-08T15:29:01.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:29:01.947 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836490 2020-09-08T15:29:02.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836488 -lt 21474836490 2020-09-08T15:29:02.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:29:03.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:29:03.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:29:03.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836490 -lt 21474836490 2020-09-08T15:29:03.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:29:03.757 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672968 2020-09-08T15:29:03.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:29:03.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:29:03.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672968 2020-09-08T15:29:03.759 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:29:03.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672968 2020-09-08T15:29:03.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672968' 2020-09-08T15:29:03.760 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:29:03.760 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672968 2020-09-08T15:29:04.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672968 -lt 42949672968 2020-09-08T15:29:04.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:29:04.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509447 2020-09-08T15:29:04.157 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:29:04.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:29:04.160 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509447 2020-09-08T15:29:04.160 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:29:04.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509447 2020-09-08T15:29:04.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509447' 2020-09-08T15:29:04.161 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:29:04.172 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509447 2020-09-08T15:29:04.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509447 -lt 64424509447 2020-09-08T15:29:04.575 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:29:04.576 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:29:04.576 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:29:05.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T15:29:05.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:29:05.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:29:05.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:29:05.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:29:05.146 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:29:05.146 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:29:05.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:29:05.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:29:05.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:29:05.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:29:05.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:29:06.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T15:29:06.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:29:06.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:29:06.253 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:657: TEST_divergent_3: ceph pg dump pgs --format=json 2020-09-08T15:29:06.253 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:657: TEST_divergent_3: jq '.pg_stats[0].up_primary' 2020-09-08T15:29:06.436 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:29:06.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:657: TEST_divergent_3: local divergent=1 2020-09-08T15:29:06.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:658: TEST_divergent_3: echo 'primary and soon to be divergent is 1' 2020-09-08T15:29:06.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: ceph pg dump pgs 2020-09-08T15:29:06.445 INFO:tasks.workunit.client.0.smithi065.stdout:primary and soon to be divergent is 1 2020-09-08T15:29:06.818 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:29:06.823 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:28:55.389166+0000 0'0 27:11 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:06.824 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:29:06.824 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:29:06.827 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:29:06.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:660: TEST_divergent_3: local non_divergent= 2020-09-08T15:29:06.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:661: TEST_divergent_3: for i in $osds 2020-09-08T15:29:06.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:663: TEST_divergent_3: '[' 0 = 1 ']' 2020-09-08T15:29:06.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:666: TEST_divergent_3: non_divergent=' 0' 2020-09-08T15:29:06.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:661: TEST_divergent_3: for i in $osds 2020-09-08T15:29:06.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:663: TEST_divergent_3: '[' 1 = 1 ']' 2020-09-08T15:29:06.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:664: TEST_divergent_3: continue 2020-09-08T15:29:06.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:661: TEST_divergent_3: for i in $osds 2020-09-08T15:29:06.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:663: TEST_divergent_3: '[' 2 = 1 ']' 2020-09-08T15:29:06.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:666: TEST_divergent_3: non_divergent=' 0 2' 2020-09-08T15:29:06.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: echo 'writing initial objects' 2020-09-08T15:29:06.852 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: seq 1 100 2020-09-08T15:29:06.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:06.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_1 /etc/fstab 2020-09-08T15:29:06.853 INFO:tasks.workunit.client.0.smithi065.stdout:writing initial objects 2020-09-08T15:29:06.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:06.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_2 /etc/fstab 2020-09-08T15:29:07.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:07.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_3 /etc/fstab 2020-09-08T15:29:07.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:07.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_4 /etc/fstab 2020-09-08T15:29:07.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:07.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_5 /etc/fstab 2020-09-08T15:29:07.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:07.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_6 /etc/fstab 2020-09-08T15:29:07.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:07.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_7 /etc/fstab 2020-09-08T15:29:07.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:07.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_8 /etc/fstab 2020-09-08T15:29:08.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:08.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_9 /etc/fstab 2020-09-08T15:29:08.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:08.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_10 /etc/fstab 2020-09-08T15:29:08.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:08.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_11 /etc/fstab 2020-09-08T15:29:08.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:08.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_12 /etc/fstab 2020-09-08T15:29:08.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:08.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_13 /etc/fstab 2020-09-08T15:29:08.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:08.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_14 /etc/fstab 2020-09-08T15:29:09.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:09.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_15 /etc/fstab 2020-09-08T15:29:09.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:09.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_16 /etc/fstab 2020-09-08T15:29:09.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:09.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_17 /etc/fstab 2020-09-08T15:29:09.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:09.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_18 /etc/fstab 2020-09-08T15:29:09.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:09.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_19 /etc/fstab 2020-09-08T15:29:09.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:09.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_20 /etc/fstab 2020-09-08T15:29:10.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:10.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_21 /etc/fstab 2020-09-08T15:29:10.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:10.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_22 /etc/fstab 2020-09-08T15:29:10.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:10.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_23 /etc/fstab 2020-09-08T15:29:10.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:10.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_24 /etc/fstab 2020-09-08T15:29:10.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:10.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_25 /etc/fstab 2020-09-08T15:29:10.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:10.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_26 /etc/fstab 2020-09-08T15:29:10.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:10.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_27 /etc/fstab 2020-09-08T15:29:11.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:11.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_28 /etc/fstab 2020-09-08T15:29:11.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:11.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_29 /etc/fstab 2020-09-08T15:29:11.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:11.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_30 /etc/fstab 2020-09-08T15:29:11.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:11.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_31 /etc/fstab 2020-09-08T15:29:11.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:11.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_32 /etc/fstab 2020-09-08T15:29:11.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:11.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_33 /etc/fstab 2020-09-08T15:29:12.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:12.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_34 /etc/fstab 2020-09-08T15:29:12.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:12.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_35 /etc/fstab 2020-09-08T15:29:12.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:12.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_36 /etc/fstab 2020-09-08T15:29:12.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:12.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_37 /etc/fstab 2020-09-08T15:29:12.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:12.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_38 /etc/fstab 2020-09-08T15:29:12.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:12.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_39 /etc/fstab 2020-09-08T15:29:13.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:13.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_40 /etc/fstab 2020-09-08T15:29:13.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:13.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_41 /etc/fstab 2020-09-08T15:29:13.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:13.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_42 /etc/fstab 2020-09-08T15:29:13.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:13.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_43 /etc/fstab 2020-09-08T15:29:13.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:13.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_44 /etc/fstab 2020-09-08T15:29:13.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:13.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_45 /etc/fstab 2020-09-08T15:29:14.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:14.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_46 /etc/fstab 2020-09-08T15:29:14.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:14.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_47 /etc/fstab 2020-09-08T15:29:14.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:14.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_48 /etc/fstab 2020-09-08T15:29:14.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:14.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_49 /etc/fstab 2020-09-08T15:29:14.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:14.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_50 /etc/fstab 2020-09-08T15:29:14.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:14.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_51 /etc/fstab 2020-09-08T15:29:15.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:15.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_52 /etc/fstab 2020-09-08T15:29:15.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:15.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_53 /etc/fstab 2020-09-08T15:29:15.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:15.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_54 /etc/fstab 2020-09-08T15:29:15.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:15.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_55 /etc/fstab 2020-09-08T15:29:15.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:15.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_56 /etc/fstab 2020-09-08T15:29:15.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:15.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_57 /etc/fstab 2020-09-08T15:29:15.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:15.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_58 /etc/fstab 2020-09-08T15:29:16.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:16.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_59 /etc/fstab 2020-09-08T15:29:16.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:16.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_60 /etc/fstab 2020-09-08T15:29:16.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:16.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_61 /etc/fstab 2020-09-08T15:29:16.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:16.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_62 /etc/fstab 2020-09-08T15:29:16.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:16.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_63 /etc/fstab 2020-09-08T15:29:16.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:16.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_64 /etc/fstab 2020-09-08T15:29:17.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:17.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_65 /etc/fstab 2020-09-08T15:29:17.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:17.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_66 /etc/fstab 2020-09-08T15:29:17.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:17.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_67 /etc/fstab 2020-09-08T15:29:17.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:17.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_68 /etc/fstab 2020-09-08T15:29:17.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:17.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_69 /etc/fstab 2020-09-08T15:29:17.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:17.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_70 /etc/fstab 2020-09-08T15:29:17.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:17.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_71 /etc/fstab 2020-09-08T15:29:18.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:18.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_72 /etc/fstab 2020-09-08T15:29:18.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:18.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_73 /etc/fstab 2020-09-08T15:29:18.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:18.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_74 /etc/fstab 2020-09-08T15:29:18.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:18.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_75 /etc/fstab 2020-09-08T15:29:19.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:19.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_76 /etc/fstab 2020-09-08T15:29:19.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:19.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_77 /etc/fstab 2020-09-08T15:29:19.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:19.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_78 /etc/fstab 2020-09-08T15:29:19.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:19.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_79 /etc/fstab 2020-09-08T15:29:19.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:19.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_80 /etc/fstab 2020-09-08T15:29:19.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:19.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_81 /etc/fstab 2020-09-08T15:29:20.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:20.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_82 /etc/fstab 2020-09-08T15:29:20.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:20.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_83 /etc/fstab 2020-09-08T15:29:20.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:20.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_84 /etc/fstab 2020-09-08T15:29:20.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:20.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_85 /etc/fstab 2020-09-08T15:29:20.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:20.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_86 /etc/fstab 2020-09-08T15:29:20.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:20.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_87 /etc/fstab 2020-09-08T15:29:20.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:20.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_88 /etc/fstab 2020-09-08T15:29:21.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:21.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_89 /etc/fstab 2020-09-08T15:29:21.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:21.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_90 /etc/fstab 2020-09-08T15:29:21.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:21.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_91 /etc/fstab 2020-09-08T15:29:21.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:21.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_92 /etc/fstab 2020-09-08T15:29:21.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:21.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_93 /etc/fstab 2020-09-08T15:29:21.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:21.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_94 /etc/fstab 2020-09-08T15:29:22.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:22.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_95 /etc/fstab 2020-09-08T15:29:22.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:22.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_96 /etc/fstab 2020-09-08T15:29:22.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:22.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_97 /etc/fstab 2020-09-08T15:29:22.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:22.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_98 /etc/fstab 2020-09-08T15:29:22.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:22.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_99 /etc/fstab 2020-09-08T15:29:22.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: for i in $(seq 1 $testobjects) 2020-09-08T15:29:22.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:673: TEST_divergent_3: rados -p test put existing_100 /etc/fstab 2020-09-08T15:29:23.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:676: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2020-09-08T15:29:23.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:676: TEST_divergent_3: wait_for_clean 2020-09-08T15:29:23.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:29:23.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:29:23.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:29:23.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:29:23.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 20 .1 2020-09-08T15:29:23.063 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:29:23.063 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:29:23.064 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:29:23.064 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:29:23.064 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:29:23.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:29:23.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:29:23.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:29:23.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:29:23.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:29:23.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:29:23.532 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:29:23.532 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:29:23.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:29:23.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:29:23.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:29:23.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836496 2020-09-08T15:29:23.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836496 2020-09-08T15:29:23.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836496' 2020-09-08T15:29:23.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:29:23.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:29:23.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672975 2020-09-08T15:29:23.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672975 2020-09-08T15:29:23.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836496 1-42949672975' 2020-09-08T15:29:23.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:29:23.854 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:29:23.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509453 2020-09-08T15:29:23.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509453 2020-09-08T15:29:23.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836496 1-42949672975 2-64424509453' 2020-09-08T15:29:23.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:29:23.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836496 2020-09-08T15:29:23.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:29:23.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:29:23.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836496 2020-09-08T15:29:23.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:29:23.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836496 2020-09-08T15:29:23.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836496' 2020-09-08T15:29:23.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:29:23.992 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836496 2020-09-08T15:29:24.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836494 -lt 21474836496 2020-09-08T15:29:24.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:29:25.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:29:25.387 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:29:25.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836496 -lt 21474836496 2020-09-08T15:29:25.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:29:25.792 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672975 2020-09-08T15:29:25.792 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:29:25.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:29:25.793 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672975 2020-09-08T15:29:25.793 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:29:25.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672975 2020-09-08T15:29:25.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672975' 2020-09-08T15:29:25.794 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:29:25.795 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672975 2020-09-08T15:29:26.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672975 -lt 42949672975 2020-09-08T15:29:26.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:29:26.196 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509453 2020-09-08T15:29:26.197 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:29:26.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:29:26.197 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509453 2020-09-08T15:29:26.198 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:29:26.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509453 2020-09-08T15:29:26.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509453' 2020-09-08T15:29:26.199 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:29:26.199 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509453 2020-09-08T15:29:26.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509453 -lt 64424509453 2020-09-08T15:29:26.618 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:29:26.619 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:29:26.619 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:29:27.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T15:29:27.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:29:27.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:29:27.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:29:27.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:29:27.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:29:27.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:29:27.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:29:27.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:29:27.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:29:27.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:29:27.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:29:28.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T15:29:28.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:29:28.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:29:28.082 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: get_pg test existing_1 2020-09-08T15:29:28.082 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1031: get_pg: local poolname=test 2020-09-08T15:29:28.082 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: local objectname=existing_1 2020-09-08T15:29:28.083 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: ceph --format json osd map test existing_1 2020-09-08T15:29:28.083 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: jq -r .pgid 2020-09-08T15:29:28.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: local pgid=1.0 2020-09-08T15:29:28.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:681: TEST_divergent_3: echo 'blackholing osds 0 2' 2020-09-08T15:29:28.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:682: TEST_divergent_3: ceph pg dump pgs 2020-09-08T15:29:28.484 INFO:tasks.workunit.client.0.smithi065.stdout:blackholing osds 0 2 2020-09-08T15:29:28.879 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:29:28.880 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 0 0 0 0 48300 0 0 16 16 active+clean 2020-09-08T15:28:55.389166+0000 31'100 31:111 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:28.880 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:29:28.880 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:29:28.881 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:29:28.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: for i in $non_divergent 2020-09-08T15:29:28.891 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:685: TEST_divergent_3: get_asok_path osd.0 2020-09-08T15:29:28.891 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-09-08T15:29:28.891 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-09-08T15:29:28.891 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:29:28.891 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:29:28.892 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:29:28.892 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.0.asok 2020-09-08T15:29:28.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:685: TEST_divergent_3: CEPH_ARGS= 2020-09-08T15:29:28.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:685: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.0.asok config set objectstore_blackhole 1 2020-09-08T15:29:28.982 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:29:28.982 INFO:tasks.workunit.client.0.smithi065.stdout: "success": "objectstore_blackhole = 'true' (not observed, change may require restart) " 2020-09-08T15:29:28.983 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:29:28.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: for i in $non_divergent 2020-09-08T15:29:28.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:685: TEST_divergent_3: get_asok_path osd.2 2020-09-08T15:29:28.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-09-08T15:29:28.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-09-08T15:29:28.991 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:29:28.991 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:29:28.992 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:29:28.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.2.asok 2020-09-08T15:29:28.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:685: TEST_divergent_3: CEPH_ARGS= 2020-09-08T15:29:28.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:685: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.2.asok config set objectstore_blackhole 1 2020-09-08T15:29:29.082 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:29:29.082 INFO:tasks.workunit.client.0.smithi065.stdout: "success": "objectstore_blackhole = 'true' (not observed, change may require restart) " 2020-09-08T15:29:29.083 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:29:29.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:689: TEST_divergent_3: echo 'create new divergent objects' 2020-09-08T15:29:29.089 INFO:tasks.workunit.client.0.smithi065.stdout:create new divergent objects 2020-09-08T15:29:29.090 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: seq 1 2 2020-09-08T15:29:29.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2020-09-08T15:29:29.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2020-09-08T15:29:29.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:692: TEST_divergent_3: rados -p test create newobject_1 2020-09-08T15:29:29.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:695: TEST_divergent_3: echo 'writing divergent objects' 2020-09-08T15:29:29.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:692: TEST_divergent_3: rados -p test create newobject_2 2020-09-08T15:29:29.092 INFO:tasks.workunit.client.0.smithi065.stdout:writing divergent objects 2020-09-08T15:29:29.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:696: TEST_divergent_3: seq 1 2 2020-09-08T15:29:29.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:696: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2020-09-08T15:29:29.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:696: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2020-09-08T15:29:29.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:698: TEST_divergent_3: rados -p test put existing_1 /etc/resolv.conf 2020-09-08T15:29:29.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:701: TEST_divergent_3: echo 'remove divergent objects' 2020-09-08T15:29:29.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:698: TEST_divergent_3: rados -p test put existing_2 /etc/resolv.conf 2020-09-08T15:29:29.094 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: seq 1 2 2020-09-08T15:29:29.094 INFO:tasks.workunit.client.0.smithi065.stdout:remove divergent objects 2020-09-08T15:29:29.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2020-09-08T15:29:29.096 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:704: TEST_divergent_3: expr 1 + 2 2020-09-08T15:29:29.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:704: TEST_divergent_3: rmi=3 2020-09-08T15:29:29.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2020-09-08T15:29:29.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:705: TEST_divergent_3: rados -p test rm existing_3 2020-09-08T15:29:29.096 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:704: TEST_divergent_3: expr 2 + 2 2020-09-08T15:29:29.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:704: TEST_divergent_3: rmi=4 2020-09-08T15:29:29.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: sleep 10 2020-09-08T15:29:29.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:705: TEST_divergent_3: rados -p test rm existing_4 2020-09-08T15:29:39.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:708: TEST_divergent_3: killall -9 rados 2020-09-08T15:29:39.103 INFO:tasks.workunit.client.0.smithi065.stderr:rados: no process found 2020-09-08T15:29:39.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:711: TEST_divergent_3: echo 'killing all the osds' 2020-09-08T15:29:39.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:712: TEST_divergent_3: ceph pg dump pgs 2020-09-08T15:29:39.104 INFO:tasks.workunit.client.0.smithi065.stdout:killing all the osds 2020-09-08T15:29:39.513 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:29:39.514 INFO:tasks.workunit.client.0.smithi065.stdout:1.1f 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.363742+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.514 INFO:tasks.workunit.client.0.smithi065.stdout:1.1e 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.364542+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.514 INFO:tasks.workunit.client.0.smithi065.stdout:1.1d 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.363860+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.515 INFO:tasks.workunit.client.0.smithi065.stdout:1.1c 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.363800+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.515 INFO:tasks.workunit.client.0.smithi065.stdout:1.1b 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.363683+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.515 INFO:tasks.workunit.client.0.smithi065.stdout:1.1a 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.365637+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.516 INFO:tasks.workunit.client.0.smithi065.stdout:1.19 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.365950+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.516 INFO:tasks.workunit.client.0.smithi065.stdout:1.18 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.364200+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.517 INFO:tasks.workunit.client.0.smithi065.stdout:1.17 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.364366+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.517 INFO:tasks.workunit.client.0.smithi065.stdout:1.16 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.364013+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.517 INFO:tasks.workunit.client.0.smithi065.stdout:1.15 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.365022+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.518 INFO:tasks.workunit.client.0.smithi065.stdout:1.14 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.365758+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.519 INFO:tasks.workunit.client.0.smithi065.stdout:1.13 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.364578+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.519 INFO:tasks.workunit.client.0.smithi065.stdout:1.12 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.365098+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.519 INFO:tasks.workunit.client.0.smithi065.stdout:1.11 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.364337+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.520 INFO:tasks.workunit.client.0.smithi065.stdout:1.10 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.364694+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.520 INFO:tasks.workunit.client.0.smithi065.stdout:1.5 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.365493+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.520 INFO:tasks.workunit.client.0.smithi065.stdout:1.4 4 0 0 0 0 1458 0 0 16 16 peering 2020-09-08T15:29:33.364946+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.521 INFO:tasks.workunit.client.0.smithi065.stdout:1.3 4 0 0 0 0 1458 0 0 16 16 peering 2020-09-08T15:29:33.365640+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.521 INFO:tasks.workunit.client.0.smithi065.stdout:1.2 4 0 0 0 0 1458 0 0 16 16 peering 2020-09-08T15:29:33.364668+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.522 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.107987+0000 31'106 33:122 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.522 INFO:tasks.workunit.client.0.smithi065.stdout:1.1 4 0 0 0 0 1458 0 0 16 16 peering 2020-09-08T15:29:33.364383+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.522 INFO:tasks.workunit.client.0.smithi065.stdout:1.6 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.364077+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.523 INFO:tasks.workunit.client.0.smithi065.stdout:1.7 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.365258+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.523 INFO:tasks.workunit.client.0.smithi065.stdout:1.8 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.366281+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.524 INFO:tasks.workunit.client.0.smithi065.stdout:1.9 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.365643+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.524 INFO:tasks.workunit.client.0.smithi065.stdout:1.a 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.363600+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.524 INFO:tasks.workunit.client.0.smithi065.stdout:1.b 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.365344+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.525 INFO:tasks.workunit.client.0.smithi065.stdout:1.c 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.364963+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.525 INFO:tasks.workunit.client.0.smithi065.stdout:1.d 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.365380+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.526 INFO:tasks.workunit.client.0.smithi065.stdout:1.e 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.365271+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.526 INFO:tasks.workunit.client.0.smithi065.stdout:1.f 3 0 0 0 0 1457 0 0 16 16 peering 2020-09-08T15:29:33.364927+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:39.526 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:29:39.527 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:29:39.528 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:29:39.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd 2020-09-08T15:29:39.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:29:39.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:29:39.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:29:39.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:29:39.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:29:39.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:29:39.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:714: TEST_divergent_3: for i in $osds 2020-09-08T15:29:39.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:716: TEST_divergent_3: ceph osd down osd.0 2020-09-08T15:29:40.228 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already down. 2020-09-08T15:29:40.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:714: TEST_divergent_3: for i in $osds 2020-09-08T15:29:40.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:716: TEST_divergent_3: ceph osd down osd.1 2020-09-08T15:29:40.782 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already down. 2020-09-08T15:29:40.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:714: TEST_divergent_3: for i in $osds 2020-09-08T15:29:40.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:716: TEST_divergent_3: ceph osd down osd.2 2020-09-08T15:29:41.410 INFO:tasks.workunit.client.0.smithi065.stderr:osd.2 is already down. 2020-09-08T15:29:41.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:718: TEST_divergent_3: for i in $non_divergent 2020-09-08T15:29:41.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:720: TEST_divergent_3: ceph osd out osd.0 2020-09-08T15:29:41.977 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already out. 2020-09-08T15:29:41.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:718: TEST_divergent_3: for i in $non_divergent 2020-09-08T15:29:41.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:720: TEST_divergent_3: ceph osd out osd.2 2020-09-08T15:29:42.612 INFO:tasks.workunit.client.0.smithi065.stderr:osd.2 is already out. 2020-09-08T15:29:42.620 INFO:tasks.workunit.client.0.smithi065.stdout:bringing up non_divergent 0 2 2020-09-08T15:29:42.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:724: TEST_divergent_3: echo 'bringing up non_divergent 0 2' 2020-09-08T15:29:42.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:725: TEST_divergent_3: ceph pg dump pgs 2020-09-08T15:29:42.996 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:29:42.996 INFO:tasks.workunit.client.0.smithi065.stdout:1.1f 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.363742+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:42.997 INFO:tasks.workunit.client.0.smithi065.stdout:1.1e 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.364542+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:42.997 INFO:tasks.workunit.client.0.smithi065.stdout:1.1d 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.363860+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:42.998 INFO:tasks.workunit.client.0.smithi065.stdout:1.1c 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.363800+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:42.998 INFO:tasks.workunit.client.0.smithi065.stdout:1.1b 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.363683+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:42.998 INFO:tasks.workunit.client.0.smithi065.stdout:1.1a 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.365637+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:42.998 INFO:tasks.workunit.client.0.smithi065.stdout:1.19 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.365950+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:42.999 INFO:tasks.workunit.client.0.smithi065.stdout:1.18 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.364200+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:42.999 INFO:tasks.workunit.client.0.smithi065.stdout:1.17 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.364366+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:42.999 INFO:tasks.workunit.client.0.smithi065.stdout:1.16 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.364013+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:42.999 INFO:tasks.workunit.client.0.smithi065.stdout:1.15 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.365022+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:42.999 INFO:tasks.workunit.client.0.smithi065.stdout:1.14 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.365758+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:43.000 INFO:tasks.workunit.client.0.smithi065.stdout:1.13 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.364578+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:43.000 INFO:tasks.workunit.client.0.smithi065.stdout:1.12 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.365098+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:43.000 INFO:tasks.workunit.client.0.smithi065.stdout:1.11 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.364337+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:43.000 INFO:tasks.workunit.client.0.smithi065.stdout:1.10 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.364694+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:43.000 INFO:tasks.workunit.client.0.smithi065.stdout:1.5 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.365493+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:43.001 INFO:tasks.workunit.client.0.smithi065.stdout:1.4 4 0 0 0 0 1458 0 0 16 16 stale+peering 2020-09-08T15:29:33.364946+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:43.001 INFO:tasks.workunit.client.0.smithi065.stdout:1.3 4 0 0 0 0 1458 0 0 16 16 stale+peering 2020-09-08T15:29:33.365640+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:43.001 INFO:tasks.workunit.client.0.smithi065.stdout:1.2 4 0 0 0 0 1458 0 0 16 16 stale+peering 2020-09-08T15:29:33.364668+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:43.001 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.107987+0000 31'106 33:122 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:43.001 INFO:tasks.workunit.client.0.smithi065.stdout:1.1 4 0 0 0 0 1458 0 0 16 16 stale+peering 2020-09-08T15:29:33.364383+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:43.002 INFO:tasks.workunit.client.0.smithi065.stdout:1.6 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.364077+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:43.002 INFO:tasks.workunit.client.0.smithi065.stdout:1.7 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.365258+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:43.002 INFO:tasks.workunit.client.0.smithi065.stdout:1.8 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.366281+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:43.002 INFO:tasks.workunit.client.0.smithi065.stdout:1.9 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.365643+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:43.002 INFO:tasks.workunit.client.0.smithi065.stdout:1.a 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.363600+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:43.003 INFO:tasks.workunit.client.0.smithi065.stdout:1.b 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.365344+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:43.003 INFO:tasks.workunit.client.0.smithi065.stdout:1.c 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.364963+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:43.003 INFO:tasks.workunit.client.0.smithi065.stdout:1.d 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.365380+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:43.003 INFO:tasks.workunit.client.0.smithi065.stdout:1.e 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.365271+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:43.003 INFO:tasks.workunit.client.0.smithi065.stdout:1.f 3 0 0 0 0 1457 0 0 16 16 stale+peering 2020-09-08T15:29:33.364927+0000 31'106 33:120 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:29:43.004 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:29:43.004 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:29:43.004 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:29:43.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:726: TEST_divergent_3: for i in $non_divergent 2020-09-08T15:29:43.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:728: TEST_divergent_3: activate_osd td/divergent-priors 0 2020-09-08T15:29:43.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/divergent-priors 2020-09-08T15:29:43.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:29:43.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=0 2020-09-08T15:29:43.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:29:43.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/divergent-priors/0 2020-09-08T15:29:43.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:29:43.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:29:43.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:29:43.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:29:43.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2020-09-08T15:29:43.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2020-09-08T15:29:43.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:29:43.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:29:43.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:29:43.013 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:29:43.013 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:29:43.013 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:29:43.013 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:29:43.013 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:29:43.014 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:29:43.014 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:29:43.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:29:43.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:29:43.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:29:43.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:29:43.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:29:43.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:29:43.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:29:43.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:29:43.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:29:43.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/divergent-priors/0 2020-09-08T15:29:43.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.0 2020-09-08T15:29:43.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 0 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:29:43.016 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/divergent-priors/0/whoami 2020-09-08T15:29:43.017 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T15:29:43.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 0 = 0 ']' 2020-09-08T15:29:43.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:29:43.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:29:43.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:29:43.039 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:29:43.043+0000 7f221f56eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:29:43.039 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:29:43.044+0000 7f221f56eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:29:43.041 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:29:43.046+0000 7f221f56eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:29:43.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 0 2020-09-08T15:29:43.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:29:43.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:29:43.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:29:43.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:29:43.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:29:43.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:29:43.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:29:43.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:29:43.412 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:29:43.557 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:29:43.562+0000 7f221f56eec0 -1 Falling back to public interface 2020-09-08T15:29:43.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:29:44.777 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:29:44.782+0000 7f221f56eec0 -1 osd.0 31 log_to_monitors {default=true} 2020-09-08T15:29:44.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:29:44.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:29:44.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:29:44.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:29:44.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:29:44.813 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:29:45.242 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up out weight 0 up_from 40 up_thru 0 down_at 35 last_clean_interval [5,31) [v2:127.0.0.1:6802/58997,v1:127.0.0.1:6803/58997] [v2:127.0.0.1:6804/58997,v1:127.0.0.1:6805/58997] exists,up 017c780f-0863-4f60-9e7f-475ba27124f2 2020-09-08T15:29:45.243 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T15:29:45.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:29:45.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:29:45.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:29:45.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:726: TEST_divergent_3: for i in $non_divergent 2020-09-08T15:29:45.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:728: TEST_divergent_3: activate_osd td/divergent-priors 2 2020-09-08T15:29:45.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/divergent-priors 2020-09-08T15:29:45.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:29:45.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=2 2020-09-08T15:29:45.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:29:45.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/divergent-priors/2 2020-09-08T15:29:45.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:29:45.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:29:45.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:29:45.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:29:45.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2020-09-08T15:29:45.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2020-09-08T15:29:45.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:29:45.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:29:45.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:29:45.248 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:29:45.248 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:29:45.248 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:29:45.248 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:29:45.248 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:29:45.249 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:29:45.249 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:29:45.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:29:45.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:29:45.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:29:45.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:29:45.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:29:45.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:29:45.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:29:45.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:29:45.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:29:45.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/divergent-priors/2 2020-09-08T15:29:45.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.2 2020-09-08T15:29:45.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 2 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:29:45.252 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/divergent-priors/2/whoami 2020-09-08T15:29:45.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 2 = 2 ']' 2020-09-08T15:29:45.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:29:45.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:29:45.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:29:45.271 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:29:45.276+0000 7f9c10918ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:29:45.273 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:29:45.278+0000 7f9c10918ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:29:45.274 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:29:45.278+0000 7f9c10918ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:29:45.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 2 2020-09-08T15:29:45.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:29:45.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:29:45.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:29:45.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:29:45.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:29:45.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:29:45.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:29:45.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:29:45.645 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:29:45.789 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:29:45.794+0000 7f9c10918ec0 -1 Falling back to public interface 2020-09-08T15:29:46.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:29:47.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:29:47.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:29:47.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:29:47.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:29:47.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:29:47.048 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:29:47.257 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:29:47.262+0000 7f9c10918ec0 -1 osd.2 31 log_to_monitors {default=true} 2020-09-08T15:29:47.509 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up out weight 0 up_from 41 up_thru 0 down_at 37 last_clean_interval [15,31) [v2:127.0.0.1:6810/59396,v1:127.0.0.1:6811/59396] [v2:127.0.0.1:6812/59396,v1:127.0.0.1:6813/59396] exists,up 559be8ed-3798-4af1-85bb-af8664f6f09f 2020-09-08T15:29:47.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:29:47.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:29:47.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:29:47.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:730: TEST_divergent_3: for i in $non_divergent 2020-09-08T15:29:47.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:732: TEST_divergent_3: ceph osd in osd.0 2020-09-08T15:29:48.125 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already in. 2020-09-08T15:29:48.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:730: TEST_divergent_3: for i in $non_divergent 2020-09-08T15:29:48.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:732: TEST_divergent_3: ceph osd in osd.2 2020-09-08T15:29:48.715 INFO:tasks.workunit.client.0.smithi065.stderr:osd.2 is already in. 2020-09-08T15:29:48.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2020-09-08T15:29:48.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: wait_for_clean 2020-09-08T15:29:48.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:29:48.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:29:48.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:29:48.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:29:48.725 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 20 .1 2020-09-08T15:29:48.726 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:29:48.726 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:29:48.726 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:29:48.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:29:48.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:29:48.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:29:48.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:29:48.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:29:48.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:29:48.784 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:29:49.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:29:49.396 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:29:49.396 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:29:49.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:29:49.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:29:49.397 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:29:49.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=171798691843 2020-09-08T15:29:49.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 171798691843 2020-09-08T15:29:49.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-171798691843' 2020-09-08T15:29:49.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:29:49.534 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:29:49.632 INFO:tasks.workunit.client.0.smithi065.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-09-08T15:29:49.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq= 2020-09-08T15:29:49.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z '' 2020-09-08T15:29:49.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: continue 2020-09-08T15:29:49.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:29:49.633 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:29:49.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=176093659139 2020-09-08T15:29:49.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 176093659139 2020-09-08T15:29:49.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-171798691843 2-176093659139' 2020-09-08T15:29:49.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:29:49.778 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-171798691843 2020-09-08T15:29:49.778 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:29:49.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:29:49.778 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-171798691843 2020-09-08T15:29:49.779 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:29:49.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=171798691843 2020-09-08T15:29:49.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 171798691843' 2020-09-08T15:29:49.779 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:29:49.780 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 171798691843 2020-09-08T15:29:50.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 1 -lt 171798691843 2020-09-08T15:29:50.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:29:51.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:29:51.165 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:29:51.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 171798691844 -lt 171798691843 2020-09-08T15:29:51.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:29:51.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-176093659139 2020-09-08T15:29:51.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:29:51.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:29:51.575 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-176093659139 2020-09-08T15:29:51.575 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:29:51.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=176093659139 2020-09-08T15:29:51.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 176093659139' 2020-09-08T15:29:51.576 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:29:51.576 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 176093659139 2020-09-08T15:29:51.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 176093659139 -lt 176093659139 2020-09-08T15:29:51.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:29:51.986 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:29:51.986 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:29:52.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 32 == 0 2020-09-08T15:29:52.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:29:52.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:29:52.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:29:52.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:29:52.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:29:52.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:29:52.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:29:52.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:29:52.924 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:29:52.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:29:52.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:29:53.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 32 2020-09-08T15:29:53.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T15:29:53.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T15:29:53.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T15:29:53.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:29:53.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:29:53.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:29:53.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:29:53.547 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:29:53.547 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:29:53.547 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:29:53.547 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:29:53.548 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:29:53.548 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:29:53.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:29:53.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:29:53.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:29:53.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:29:54.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 32 2020-09-08T15:29:54.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:29:54.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:29:54.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:29:54.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:29:54.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:29:54.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:29:54.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:29:54.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:29:54.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:29:54.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:29:54.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 1 >= 8 )) 2020-09-08T15:29:54.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:29:54.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.2 2020-09-08T15:29:55.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:29:55.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:29:55.202 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:29:55.202 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:29:55.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:29:55.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:29:55.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:29:55.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:29:55.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:29:55.594 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:29:55.595 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:29:55.595 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:29:56.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 32 2020-09-08T15:29:56.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:29:56.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:29:56.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:29:56.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:29:56.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:29:56.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:29:56.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:29:56.129 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:29:56.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:29:56.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:29:56.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 2 >= 8 )) 2020-09-08T15:29:56.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:29:56.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.4 2020-09-08T15:29:57.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:29:57.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:29:57.054 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:29:57.054 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:29:57.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:29:57.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:29:57.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:29:57.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:29:57.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:29:57.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:29:57.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:29:57.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:29:57.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 32 2020-09-08T15:29:57.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:29:57.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:29:57.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:29:57.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:29:57.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:29:57.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:29:57.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:29:57.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:29:58.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:29:58.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:29:58.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 3 >= 8 )) 2020-09-08T15:29:58.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:29:58.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.8 2020-09-08T15:29:59.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:29:59.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:29:59.312 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:29:59.312 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:29:59.312 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:29:59.312 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:29:59.313 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:29:59.313 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:29:59.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:29:59.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:29:59.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:29:59.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:30:00.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 32 2020-09-08T15:30:00.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:30:00.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:30:00.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:30:00.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:30:00.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:30:00.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:30:00.245 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:30:00.245 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:30:00.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:30:00.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:30:00.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 4 >= 8 )) 2020-09-08T15:30:00.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:30:00.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 1.6 2020-09-08T15:30:02.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:30:02.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:30:02.366 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:30:02.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:30:02.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:30:02.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:30:02.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:30:02.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:30:02.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:30:02.766 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:30:02.766 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:30:02.767 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:30:03.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 32 2020-09-08T15:30:03.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:30:03.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:30:03.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:30:03.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:30:03.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:30:03.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:30:03.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:30:03.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:30:03.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:30:03.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:30:03.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 5 >= 8 )) 2020-09-08T15:30:03.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:30:03.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 3.2 2020-09-08T15:30:07.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:30:07.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:30:07.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:30:07.028 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:30:07.028 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:30:07.028 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:30:07.028 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:30:07.028 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:30:07.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:30:07.425 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:30:07.425 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:30:07.425 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:30:07.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 32 2020-09-08T15:30:07.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:30:07.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:30:07.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:30:07.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:30:07.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:30:07.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:30:07.960 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:30:07.960 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:30:08.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:30:08.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:30:08.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 6 >= 8 )) 2020-09-08T15:30:08.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:30:08.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 6.4 2020-09-08T15:30:14.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:30:14.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:30:14.884 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:30:14.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:30:14.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:30:14.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:30:14.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:30:14.886 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:30:15.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:30:15.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:30:15.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:30:15.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:30:15.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 32 2020-09-08T15:30:15.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:30:15.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:30:15.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:30:15.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:30:15.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:30:15.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:30:15.828 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:30:15.828 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:30:16.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:30:16.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:30:16.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 7 >= 8 )) 2020-09-08T15:30:16.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:30:16.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 7.3 2020-09-08T15:30:23.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:30:23.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:30:23.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:30:23.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:30:23.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:30:23.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:30:23.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:30:23.670 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:30:24.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:30:24.052 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:30:24.053 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:30:24.053 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:30:24.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 32 2020-09-08T15:30:24.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:30:24.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:30:24.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:30:24.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:30:24.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:30:24.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:30:24.589 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:30:24.590 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:30:25.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:30:25.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:30:25.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 8 >= 8 )) 2020-09-08T15:30:25.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: wait_for_clean: ceph report 2020-09-08T15:30:25.658 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:30:25.658 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_fingerprint": "bdb0347a-3926-46bb-b508-196a91dbfaa0", 2020-09-08T15:30:25.658 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:30:25.659 INFO:tasks.workunit.client.0.smithi065.stdout: "commit": "dce4d291bd4243c9802c17d67b85a6da6bbc0f8f", 2020-09-08T15:30:25.659 INFO:tasks.workunit.client.0.smithi065.stdout: "timestamp": "2020-09-08T15:30:25.660953+0000", 2020-09-08T15:30:25.659 INFO:tasks.workunit.client.0.smithi065.stdout: "tag": "", 2020-09-08T15:30:25.659 INFO:tasks.workunit.client.0.smithi065.stdout: "health": { 2020-09-08T15:30:25.659 INFO:tasks.workunit.client.0.smithi065.stdout: "status": "HEALTH_WARN", 2020-09-08T15:30:25.660 INFO:tasks.workunit.client.0.smithi065.stdout: "checks": { 2020-09-08T15:30:25.660 INFO:tasks.workunit.client.0.smithi065.stdout: "OSDMAP_FLAGS": { 2020-09-08T15:30:25.660 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:30:25.660 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:30:25.660 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "nodown,noout,noin flag(s) set", 2020-09-08T15:30:25.661 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 17 2020-09-08T15:30:25.661 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.661 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [], 2020-09-08T15:30:25.661 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:30:25.661 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.662 INFO:tasks.workunit.client.0.smithi065.stdout: "OSD_DOWN": { 2020-09-08T15:30:25.662 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:30:25.662 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:30:25.662 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "1 osds down", 2020-09-08T15:30:25.662 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 1 2020-09-08T15:30:25.663 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.663 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [ 2020-09-08T15:30:25.663 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.663 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "osd.1 (root=default,host=smithi065) is down" 2020-09-08T15:30:25.663 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.664 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:30:25.664 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:30:25.664 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.664 INFO:tasks.workunit.client.0.smithi065.stdout: "PG_DEGRADED": { 2020-09-08T15:30:25.664 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:30:25.665 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:30:25.665 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2020-09-08T15:30:25.665 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 32 2020-09-08T15:30:25.665 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.665 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [ 2020-09-08T15:30:25.667 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.668 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.668 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.668 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.668 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.668 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.669 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.669 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.669 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.669 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.669 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.670 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.670 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.670 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.670 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.670 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.671 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.671 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.671 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.671 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.671 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.672 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.672 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.672 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.672 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.672 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.673 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.673 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.673 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.682 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.682 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.682 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.683 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.683 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.683 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.683 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.683 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.684 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.684 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.684 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.684 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.684 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.685 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.685 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.685 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.685 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.685 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.686 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.686 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.686 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.686 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.686 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.687 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.687 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.687 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.687 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.687 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.687 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.688 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.688 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.688 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.688 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.688 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.689 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.689 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.696 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.697 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.697 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.697 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.697 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.697 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.698 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.698 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.698 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.698 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.698 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.699 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.699 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.699 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.699 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.699 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.699 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.700 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.700 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.700 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.701 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.702 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.702 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.702 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.702 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.703 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.703 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.703 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.703 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.703 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2020-09-08T15:30:25.703 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.704 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:30:25.704 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:30:25.704 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.704 INFO:tasks.workunit.client.0.smithi065.stdout: "POOL_APP_NOT_ENABLED": { 2020-09-08T15:30:25.704 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:30:25.705 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:30:25.705 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "1 pool(s) do not have an application enabled", 2020-09-08T15:30:25.705 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 1 2020-09-08T15:30:25.705 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.705 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [ 2020-09-08T15:30:25.706 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.706 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "application not enabled on pool 'test'" 2020-09-08T15:30:25.706 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.706 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.706 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." 2020-09-08T15:30:25.707 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.707 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:30:25.707 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:30:25.707 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.707 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.708 INFO:tasks.workunit.client.0.smithi065.stdout: "mutes": [] 2020-09-08T15:30:25.708 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.708 INFO:tasks.workunit.client.0.smithi065.stdout: "monmap_first_committed": 1, 2020-09-08T15:30:25.708 INFO:tasks.workunit.client.0.smithi065.stdout: "monmap_last_committed": 1, 2020-09-08T15:30:25.708 INFO:tasks.workunit.client.0.smithi065.stdout: "monmap": { 2020-09-08T15:30:25.708 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 1, 2020-09-08T15:30:25.709 INFO:tasks.workunit.client.0.smithi065.stdout: "fsid": "c25e19f6-e2e3-4d0b-8f34-71c93296ff3c", 2020-09-08T15:30:25.709 INFO:tasks.workunit.client.0.smithi065.stdout: "modified": "2020-09-08T15:28:25.484818Z", 2020-09-08T15:30:25.709 INFO:tasks.workunit.client.0.smithi065.stdout: "created": "2020-09-08T15:28:25.484818Z", 2020-09-08T15:30:25.709 INFO:tasks.workunit.client.0.smithi065.stdout: "min_mon_release": 16, 2020-09-08T15:30:25.709 INFO:tasks.workunit.client.0.smithi065.stdout: "min_mon_release_name": "pacific", 2020-09-08T15:30:25.710 INFO:tasks.workunit.client.0.smithi065.stdout: "features": { 2020-09-08T15:30:25.710 INFO:tasks.workunit.client.0.smithi065.stdout: "persistent": [ 2020-09-08T15:30:25.710 INFO:tasks.workunit.client.0.smithi065.stdout: "kraken", 2020-09-08T15:30:25.710 INFO:tasks.workunit.client.0.smithi065.stdout: "luminous", 2020-09-08T15:30:25.710 INFO:tasks.workunit.client.0.smithi065.stdout: "mimic", 2020-09-08T15:30:25.711 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap-prune", 2020-09-08T15:30:25.711 INFO:tasks.workunit.client.0.smithi065.stdout: "nautilus", 2020-09-08T15:30:25.711 INFO:tasks.workunit.client.0.smithi065.stdout: "octopus", 2020-09-08T15:30:25.711 INFO:tasks.workunit.client.0.smithi065.stdout: "pacific" 2020-09-08T15:30:25.711 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:30:25.711 INFO:tasks.workunit.client.0.smithi065.stdout: "optional": [] 2020-09-08T15:30:25.712 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.712 INFO:tasks.workunit.client.0.smithi065.stdout: "mons": [ 2020-09-08T15:30:25.712 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.713 INFO:tasks.workunit.client.0.smithi065.stdout: "rank": 0, 2020-09-08T15:30:25.713 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "a", 2020-09-08T15:30:25.713 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:30:25.714 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:30:25.714 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.714 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:30:25.714 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:7115", 2020-09-08T15:30:25.715 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 0 2020-09-08T15:30:25.715 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.715 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.715 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.715 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:7115/0", 2020-09-08T15:30:25.716 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:7115/0", 2020-09-08T15:30:25.716 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 0, 2020-09-08T15:30:25.716 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 0 2020-09-08T15:30:25.716 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.716 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.717 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.717 INFO:tasks.workunit.client.0.smithi065.stdout: "quorum": [ 2020-09-08T15:30:25.717 INFO:tasks.workunit.client.0.smithi065.stdout: 0 2020-09-08T15:30:25.717 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:30:25.718 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap": { 2020-09-08T15:30:25.718 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 45, 2020-09-08T15:30:25.718 INFO:tasks.workunit.client.0.smithi065.stdout: "fsid": "c25e19f6-e2e3-4d0b-8f34-71c93296ff3c", 2020-09-08T15:30:25.718 INFO:tasks.workunit.client.0.smithi065.stdout: "created": "2020-09-08T15:28:26.311819+0000", 2020-09-08T15:30:25.719 INFO:tasks.workunit.client.0.smithi065.stdout: "modified": "2020-09-08T15:29:48.794802+0000", 2020-09-08T15:30:25.719 INFO:tasks.workunit.client.0.smithi065.stdout: "last_up_change": "2020-09-08T15:29:47.361601+0000", 2020-09-08T15:30:25.719 INFO:tasks.workunit.client.0.smithi065.stdout: "last_in_change": "2020-09-08T15:29:48.431815+0000", 2020-09-08T15:30:25.719 INFO:tasks.workunit.client.0.smithi065.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-09-08T15:30:25.720 INFO:tasks.workunit.client.0.smithi065.stdout: "flags_num": 5800384, 2020-09-08T15:30:25.720 INFO:tasks.workunit.client.0.smithi065.stdout: "flags_set": [ 2020-09-08T15:30:25.720 INFO:tasks.workunit.client.0.smithi065.stdout: "nodown", 2020-09-08T15:30:25.720 INFO:tasks.workunit.client.0.smithi065.stdout: "noin", 2020-09-08T15:30:25.720 INFO:tasks.workunit.client.0.smithi065.stdout: "noout", 2020-09-08T15:30:25.721 INFO:tasks.workunit.client.0.smithi065.stdout: "pglog_hardlimit", 2020-09-08T15:30:25.721 INFO:tasks.workunit.client.0.smithi065.stdout: "purged_snapdirs", 2020-09-08T15:30:25.721 INFO:tasks.workunit.client.0.smithi065.stdout: "recovery_deletes", 2020-09-08T15:30:25.721 INFO:tasks.workunit.client.0.smithi065.stdout: "sortbitwise" 2020-09-08T15:30:25.721 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:30:25.722 INFO:tasks.workunit.client.0.smithi065.stdout: "crush_version": 7, 2020-09-08T15:30:25.722 INFO:tasks.workunit.client.0.smithi065.stdout: "full_ratio": 0.99000000953674316, 2020-09-08T15:30:25.722 INFO:tasks.workunit.client.0.smithi065.stdout: "backfillfull_ratio": 0.99000000953674316, 2020-09-08T15:30:25.722 INFO:tasks.workunit.client.0.smithi065.stdout: "nearfull_ratio": 0.85000002384185791, 2020-09-08T15:30:25.722 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_snapshot": "", 2020-09-08T15:30:25.723 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_max": 1, 2020-09-08T15:30:25.723 INFO:tasks.workunit.client.0.smithi065.stdout: "max_osd": 3, 2020-09-08T15:30:25.724 INFO:tasks.workunit.client.0.smithi065.stdout: "require_min_compat_client": "luminous", 2020-09-08T15:30:25.724 INFO:tasks.workunit.client.0.smithi065.stdout: "min_compat_client": "jewel", 2020-09-08T15:30:25.725 INFO:tasks.workunit.client.0.smithi065.stdout: "require_osd_release": "pacific", 2020-09-08T15:30:25.725 INFO:tasks.workunit.client.0.smithi065.stdout: "pools": [ 2020-09-08T15:30:25.725 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.725 INFO:tasks.workunit.client.0.smithi065.stdout: "pool": 1, 2020-09-08T15:30:25.725 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_name": "test", 2020-09-08T15:30:25.726 INFO:tasks.workunit.client.0.smithi065.stdout: "create_time": "2020-09-08T15:28:53.922550+0000", 2020-09-08T15:30:25.726 INFO:tasks.workunit.client.0.smithi065.stdout: "flags": 1, 2020-09-08T15:30:25.726 INFO:tasks.workunit.client.0.smithi065.stdout: "flags_names": "hashpspool", 2020-09-08T15:30:25.726 INFO:tasks.workunit.client.0.smithi065.stdout: "type": 1, 2020-09-08T15:30:25.726 INFO:tasks.workunit.client.0.smithi065.stdout: "size": 3, 2020-09-08T15:30:25.727 INFO:tasks.workunit.client.0.smithi065.stdout: "min_size": 2, 2020-09-08T15:30:25.727 INFO:tasks.workunit.client.0.smithi065.stdout: "crush_rule": 0, 2020-09-08T15:30:25.727 INFO:tasks.workunit.client.0.smithi065.stdout: "object_hash": 2, 2020-09-08T15:30:25.727 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_autoscale_mode": "on", 2020-09-08T15:30:25.727 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_num": 32, 2020-09-08T15:30:25.728 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_placement_num": 1, 2020-09-08T15:30:25.728 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_placement_num_target": 32, 2020-09-08T15:30:25.728 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_num_target": 32, 2020-09-08T15:30:25.728 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_num_pending": 32, 2020-09-08T15:30:25.728 INFO:tasks.workunit.client.0.smithi065.stdout: "last_pg_merge_meta": { 2020-09-08T15:30:25.729 INFO:tasks.workunit.client.0.smithi065.stdout: "source_pgid": "0.0", 2020-09-08T15:30:25.729 INFO:tasks.workunit.client.0.smithi065.stdout: "ready_epoch": 0, 2020-09-08T15:30:25.731 INFO:tasks.workunit.client.0.smithi065.stdout: "last_epoch_started": 0, 2020-09-08T15:30:25.731 INFO:tasks.workunit.client.0.smithi065.stdout: "last_epoch_clean": 0, 2020-09-08T15:30:25.731 INFO:tasks.workunit.client.0.smithi065.stdout: "source_version": "0'0", 2020-09-08T15:30:25.732 INFO:tasks.workunit.client.0.smithi065.stdout: "target_version": "0'0" 2020-09-08T15:30:25.732 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.733 INFO:tasks.workunit.client.0.smithi065.stdout: "last_change": "33", 2020-09-08T15:30:25.733 INFO:tasks.workunit.client.0.smithi065.stdout: "last_force_op_resend": "0", 2020-09-08T15:30:25.734 INFO:tasks.workunit.client.0.smithi065.stdout: "last_force_op_resend_prenautilus": "0", 2020-09-08T15:30:25.734 INFO:tasks.workunit.client.0.smithi065.stdout: "last_force_op_resend_preluminous": "33", 2020-09-08T15:30:25.734 INFO:tasks.workunit.client.0.smithi065.stdout: "auid": 0, 2020-09-08T15:30:25.735 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_mode": "selfmanaged", 2020-09-08T15:30:25.735 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_seq": 0, 2020-09-08T15:30:25.736 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_epoch": 0, 2020-09-08T15:30:25.736 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_snaps": [], 2020-09-08T15:30:25.736 INFO:tasks.workunit.client.0.smithi065.stdout: "removed_snaps": "[]", 2020-09-08T15:30:25.737 INFO:tasks.workunit.client.0.smithi065.stdout: "quota_max_bytes": 0, 2020-09-08T15:30:25.737 INFO:tasks.workunit.client.0.smithi065.stdout: "quota_max_objects": 0, 2020-09-08T15:30:25.737 INFO:tasks.workunit.client.0.smithi065.stdout: "tiers": [], 2020-09-08T15:30:25.738 INFO:tasks.workunit.client.0.smithi065.stdout: "tier_of": -1, 2020-09-08T15:30:25.738 INFO:tasks.workunit.client.0.smithi065.stdout: "read_tier": -1, 2020-09-08T15:30:25.739 INFO:tasks.workunit.client.0.smithi065.stdout: "write_tier": -1, 2020-09-08T15:30:25.739 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_mode": "none", 2020-09-08T15:30:25.739 INFO:tasks.workunit.client.0.smithi065.stdout: "target_max_bytes": 0, 2020-09-08T15:30:25.740 INFO:tasks.workunit.client.0.smithi065.stdout: "target_max_objects": 0, 2020-09-08T15:30:25.740 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-09-08T15:30:25.741 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-09-08T15:30:25.741 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_target_full_ratio_micro": 800000, 2020-09-08T15:30:25.741 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_min_flush_age": 0, 2020-09-08T15:30:25.742 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_min_evict_age": 0, 2020-09-08T15:30:25.742 INFO:tasks.workunit.client.0.smithi065.stdout: "erasure_code_profile": "", 2020-09-08T15:30:25.743 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_params": { 2020-09-08T15:30:25.743 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "none" 2020-09-08T15:30:25.743 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.744 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_period": 0, 2020-09-08T15:30:25.744 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_count": 0, 2020-09-08T15:30:25.745 INFO:tasks.workunit.client.0.smithi065.stdout: "use_gmt_hitset": true, 2020-09-08T15:30:25.745 INFO:tasks.workunit.client.0.smithi065.stdout: "min_read_recency_for_promote": 0, 2020-09-08T15:30:25.745 INFO:tasks.workunit.client.0.smithi065.stdout: "min_write_recency_for_promote": 0, 2020-09-08T15:30:25.746 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_grade_decay_rate": 0, 2020-09-08T15:30:25.746 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_search_last_n": 0, 2020-09-08T15:30:25.747 INFO:tasks.workunit.client.0.smithi065.stdout: "grade_table": [], 2020-09-08T15:30:25.747 INFO:tasks.workunit.client.0.smithi065.stdout: "stripe_width": 0, 2020-09-08T15:30:25.747 INFO:tasks.workunit.client.0.smithi065.stdout: "expected_num_objects": 0, 2020-09-08T15:30:25.748 INFO:tasks.workunit.client.0.smithi065.stdout: "fast_read": false, 2020-09-08T15:30:25.748 INFO:tasks.workunit.client.0.smithi065.stdout: "options": {}, 2020-09-08T15:30:25.749 INFO:tasks.workunit.client.0.smithi065.stdout: "application_metadata": {} 2020-09-08T15:30:25.749 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.749 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:30:25.750 INFO:tasks.workunit.client.0.smithi065.stdout: "osds": [ 2020-09-08T15:30:25.750 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.751 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:30:25.751 INFO:tasks.workunit.client.0.smithi065.stdout: "uuid": "017c780f-0863-4f60-9e7f-475ba27124f2", 2020-09-08T15:30:25.751 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 1, 2020-09-08T15:30:25.752 INFO:tasks.workunit.client.0.smithi065.stdout: "in": 1, 2020-09-08T15:30:25.752 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 1, 2020-09-08T15:30:25.753 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_affinity": 1, 2020-09-08T15:30:25.753 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_begin": 5, 2020-09-08T15:30:25.753 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_end": 31, 2020-09-08T15:30:25.754 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 40, 2020-09-08T15:30:25.754 INFO:tasks.workunit.client.0.smithi065.stdout: "up_thru": 44, 2020-09-08T15:30:25.755 INFO:tasks.workunit.client.0.smithi065.stdout: "down_at": 35, 2020-09-08T15:30:25.755 INFO:tasks.workunit.client.0.smithi065.stdout: "lost_at": 0, 2020-09-08T15:30:25.755 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:30:25.762 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:30:25.762 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.762 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:30:25.763 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6802", 2020-09-08T15:30:25.763 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 58997 2020-09-08T15:30:25.764 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.764 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.765 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:30:25.765 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6803", 2020-09-08T15:30:25.765 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 58997 2020-09-08T15:30:25.766 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.766 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.767 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.767 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addrs": { 2020-09-08T15:30:25.767 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:30:25.768 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.768 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:30:25.769 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6804", 2020-09-08T15:30:25.769 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 58997 2020-09-08T15:30:25.769 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.770 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.770 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:30:25.771 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6805", 2020-09-08T15:30:25.771 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 58997 2020-09-08T15:30:25.771 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.772 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.772 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.772 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addrs": { 2020-09-08T15:30:25.773 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:30:25.773 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.773 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:30:25.774 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6808", 2020-09-08T15:30:25.774 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 58997 2020-09-08T15:30:25.774 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.775 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.775 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:30:25.775 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6809", 2020-09-08T15:30:25.776 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 58997 2020-09-08T15:30:25.776 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.777 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.777 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.778 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addrs": { 2020-09-08T15:30:25.778 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:30:25.778 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.779 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:30:25.779 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6806", 2020-09-08T15:30:25.779 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 58997 2020-09-08T15:30:25.779 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.779 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.780 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:30:25.780 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6807", 2020-09-08T15:30:25.780 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 58997 2020-09-08T15:30:25.780 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.781 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.781 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.781 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:6803/58997", 2020-09-08T15:30:25.782 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addr": "127.0.0.1:6805/58997", 2020-09-08T15:30:25.782 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addr": "127.0.0.1:6809/58997", 2020-09-08T15:30:25.782 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addr": "127.0.0.1:6807/58997", 2020-09-08T15:30:25.783 INFO:tasks.workunit.client.0.smithi065.stdout: "state": [ 2020-09-08T15:30:25.783 INFO:tasks.workunit.client.0.smithi065.stdout: "exists", 2020-09-08T15:30:25.783 INFO:tasks.workunit.client.0.smithi065.stdout: "up" 2020-09-08T15:30:25.784 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.784 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.784 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.785 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:30:25.785 INFO:tasks.workunit.client.0.smithi065.stdout: "uuid": "caaf9207-8d21-4a1e-ae34-2becc94a4d1f", 2020-09-08T15:30:25.785 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 0, 2020-09-08T15:30:25.786 INFO:tasks.workunit.client.0.smithi065.stdout: "in": 1, 2020-09-08T15:30:25.786 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 1, 2020-09-08T15:30:25.786 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_affinity": 1, 2020-09-08T15:30:25.787 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_begin": 0, 2020-09-08T15:30:25.787 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_end": 0, 2020-09-08T15:30:25.787 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 10, 2020-09-08T15:30:25.788 INFO:tasks.workunit.client.0.smithi065.stdout: "up_thru": 33, 2020-09-08T15:30:25.788 INFO:tasks.workunit.client.0.smithi065.stdout: "down_at": 36, 2020-09-08T15:30:25.788 INFO:tasks.workunit.client.0.smithi065.stdout: "lost_at": 0, 2020-09-08T15:30:25.789 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:30:25.789 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:30:25.789 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.790 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:30:25.790 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6810", 2020-09-08T15:30:25.790 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 54043 2020-09-08T15:30:25.791 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.791 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.791 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:30:25.792 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6811", 2020-09-08T15:30:25.792 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 54043 2020-09-08T15:30:25.792 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.793 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.793 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.793 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addrs": { 2020-09-08T15:30:25.794 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:30:25.794 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.795 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:30:25.795 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6812", 2020-09-08T15:30:25.795 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 54043 2020-09-08T15:30:25.796 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.796 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.796 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:30:25.797 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6813", 2020-09-08T15:30:25.797 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 54043 2020-09-08T15:30:25.798 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.798 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.798 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.799 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addrs": { 2020-09-08T15:30:25.799 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:30:25.799 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.800 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:30:25.800 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6816", 2020-09-08T15:30:25.800 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 54043 2020-09-08T15:30:25.800 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.801 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.801 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:30:25.801 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6817", 2020-09-08T15:30:25.802 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 54043 2020-09-08T15:30:25.802 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.802 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.802 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.803 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addrs": { 2020-09-08T15:30:25.803 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:30:25.803 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.804 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:30:25.804 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6814", 2020-09-08T15:30:25.805 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 54043 2020-09-08T15:30:25.805 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.805 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.806 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:30:25.806 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6815", 2020-09-08T15:30:25.806 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 54043 2020-09-08T15:30:25.807 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.807 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.807 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.808 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:6811/54043", 2020-09-08T15:30:25.808 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addr": "127.0.0.1:6813/54043", 2020-09-08T15:30:25.808 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addr": "127.0.0.1:6817/54043", 2020-09-08T15:30:25.808 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addr": "127.0.0.1:6815/54043", 2020-09-08T15:30:25.809 INFO:tasks.workunit.client.0.smithi065.stdout: "state": [ 2020-09-08T15:30:25.809 INFO:tasks.workunit.client.0.smithi065.stdout: "exists" 2020-09-08T15:30:25.809 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.810 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.810 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.810 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:30:25.811 INFO:tasks.workunit.client.0.smithi065.stdout: "uuid": "559be8ed-3798-4af1-85bb-af8664f6f09f", 2020-09-08T15:30:25.811 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 1, 2020-09-08T15:30:25.811 INFO:tasks.workunit.client.0.smithi065.stdout: "in": 1, 2020-09-08T15:30:25.812 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 1, 2020-09-08T15:30:25.812 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_affinity": 1, 2020-09-08T15:30:25.812 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_begin": 15, 2020-09-08T15:30:25.813 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_end": 31, 2020-09-08T15:30:25.813 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 41, 2020-09-08T15:30:25.813 INFO:tasks.workunit.client.0.smithi065.stdout: "up_thru": 0, 2020-09-08T15:30:25.814 INFO:tasks.workunit.client.0.smithi065.stdout: "down_at": 37, 2020-09-08T15:30:25.814 INFO:tasks.workunit.client.0.smithi065.stdout: "lost_at": 0, 2020-09-08T15:30:25.814 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:30:25.815 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:30:25.815 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.815 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:30:25.816 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6810", 2020-09-08T15:30:25.816 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 59396 2020-09-08T15:30:25.816 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.817 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.817 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:30:25.817 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6811", 2020-09-08T15:30:25.818 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 59396 2020-09-08T15:30:25.818 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.818 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.819 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.819 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addrs": { 2020-09-08T15:30:25.819 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:30:25.820 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.820 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:30:25.820 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6812", 2020-09-08T15:30:25.821 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 59396 2020-09-08T15:30:25.821 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.821 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.822 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:30:25.822 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6813", 2020-09-08T15:30:25.822 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 59396 2020-09-08T15:30:25.823 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.823 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.823 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.824 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addrs": { 2020-09-08T15:30:25.824 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:30:25.824 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.825 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:30:25.825 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6816", 2020-09-08T15:30:25.825 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 59396 2020-09-08T15:30:25.826 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.826 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.826 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:30:25.827 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6817", 2020-09-08T15:30:25.827 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 59396 2020-09-08T15:30:25.827 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.828 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.829 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.829 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addrs": { 2020-09-08T15:30:25.830 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:30:25.830 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.830 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:30:25.831 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6814", 2020-09-08T15:30:25.831 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 59396 2020-09-08T15:30:25.832 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.832 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.833 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:30:25.833 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6815", 2020-09-08T15:30:25.833 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 59396 2020-09-08T15:30:25.834 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.834 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.834 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.835 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:6811/59396", 2020-09-08T15:30:25.835 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addr": "127.0.0.1:6813/59396", 2020-09-08T15:30:25.835 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addr": "127.0.0.1:6817/59396", 2020-09-08T15:30:25.835 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addr": "127.0.0.1:6815/59396", 2020-09-08T15:30:25.836 INFO:tasks.workunit.client.0.smithi065.stdout: "state": [ 2020-09-08T15:30:25.836 INFO:tasks.workunit.client.0.smithi065.stdout: "exists", 2020-09-08T15:30:25.836 INFO:tasks.workunit.client.0.smithi065.stdout: "up" 2020-09-08T15:30:25.837 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.837 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.837 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:30:25.838 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_xinfo": [ 2020-09-08T15:30:25.838 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.838 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:30:25.839 INFO:tasks.workunit.client.0.smithi065.stdout: "down_stamp": "2020-09-08T15:29:39.972799+0000", 2020-09-08T15:30:25.839 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_probability": 0, 2020-09-08T15:30:25.839 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_interval": 0, 2020-09-08T15:30:25.840 INFO:tasks.workunit.client.0.smithi065.stdout: "features": 4540138292837744639, 2020-09-08T15:30:25.840 INFO:tasks.workunit.client.0.smithi065.stdout: "old_weight": 0, 2020-09-08T15:30:25.840 INFO:tasks.workunit.client.0.smithi065.stdout: "last_purged_snaps_scrub": "2020-09-08T15:28:35.118339+0000", 2020-09-08T15:30:25.841 INFO:tasks.workunit.client.0.smithi065.stdout: "dead_epoch": 0 2020-09-08T15:30:25.841 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.841 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.841 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:30:25.842 INFO:tasks.workunit.client.0.smithi065.stdout: "down_stamp": "2020-09-08T15:29:40.578605+0000", 2020-09-08T15:30:25.842 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_probability": 0, 2020-09-08T15:30:25.842 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_interval": 0, 2020-09-08T15:30:25.843 INFO:tasks.workunit.client.0.smithi065.stdout: "features": 4540138292837744639, 2020-09-08T15:30:25.843 INFO:tasks.workunit.client.0.smithi065.stdout: "old_weight": 0, 2020-09-08T15:30:25.843 INFO:tasks.workunit.client.0.smithi065.stdout: "last_purged_snaps_scrub": "2020-09-08T15:28:43.327391+0000", 2020-09-08T15:30:25.844 INFO:tasks.workunit.client.0.smithi065.stdout: "dead_epoch": 0 2020-09-08T15:30:25.844 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.844 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.845 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:30:25.845 INFO:tasks.workunit.client.0.smithi065.stdout: "down_stamp": "2020-09-08T15:29:41.140452+0000", 2020-09-08T15:30:25.845 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_probability": 0, 2020-09-08T15:30:25.846 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_interval": 0, 2020-09-08T15:30:25.846 INFO:tasks.workunit.client.0.smithi065.stdout: "features": 4540138292837744639, 2020-09-08T15:30:25.846 INFO:tasks.workunit.client.0.smithi065.stdout: "old_weight": 0, 2020-09-08T15:30:25.847 INFO:tasks.workunit.client.0.smithi065.stdout: "last_purged_snaps_scrub": "2020-09-08T15:28:51.407968+0000", 2020-09-08T15:30:25.847 INFO:tasks.workunit.client.0.smithi065.stdout: "dead_epoch": 0 2020-09-08T15:30:25.847 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.847 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:30:25.848 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_upmap": [], 2020-09-08T15:30:25.848 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_upmap_items": [], 2020-09-08T15:30:25.848 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_temp": [], 2020-09-08T15:30:25.848 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_temp": [], 2020-09-08T15:30:25.848 INFO:tasks.workunit.client.0.smithi065.stdout: "blocklist": {}, 2020-09-08T15:30:25.849 INFO:tasks.workunit.client.0.smithi065.stdout: "erasure_code_profiles": { 2020-09-08T15:30:25.849 INFO:tasks.workunit.client.0.smithi065.stdout: "default": { 2020-09-08T15:30:25.849 INFO:tasks.workunit.client.0.smithi065.stdout: "k": "2", 2020-09-08T15:30:25.849 INFO:tasks.workunit.client.0.smithi065.stdout: "m": "2", 2020-09-08T15:30:25.850 INFO:tasks.workunit.client.0.smithi065.stdout: "plugin": "jerasure", 2020-09-08T15:30:25.850 INFO:tasks.workunit.client.0.smithi065.stdout: "technique": "reed_sol_van" 2020-09-08T15:30:25.850 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.852 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.852 INFO:tasks.workunit.client.0.smithi065.stdout: "removed_snaps_queue": [], 2020-09-08T15:30:25.853 INFO:tasks.workunit.client.0.smithi065.stdout: "new_removed_snaps": [], 2020-09-08T15:30:25.853 INFO:tasks.workunit.client.0.smithi065.stdout: "new_purged_snaps": [], 2020-09-08T15:30:25.853 INFO:tasks.workunit.client.0.smithi065.stdout: "crush_node_flags": {}, 2020-09-08T15:30:25.854 INFO:tasks.workunit.client.0.smithi065.stdout: "device_class_flags": {} 2020-09-08T15:30:25.854 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.854 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_metadata": [ 2020-09-08T15:30:25.855 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.855 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:30:25.855 INFO:tasks.workunit.client.0.smithi065.stdout: "arch": "x86_64", 2020-09-08T15:30:25.856 INFO:tasks.workunit.client.0.smithi065.stdout: "back_addr": "[v2:127.0.0.1:6804/58997,v1:127.0.0.1:6805/58997]", 2020-09-08T15:30:25.856 INFO:tasks.workunit.client.0.smithi065.stdout: "back_iface": "", 2020-09-08T15:30:25.856 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs": "1", 2020-09-08T15:30:25.857 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_db": "0", 2020-09-08T15:30:25.857 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_wal": "0", 2020-09-08T15:30:25.857 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_single_shared_device": "1", 2020-09-08T15:30:25.858 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T15:30:25.858 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T15:30:25.858 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T15:30:25.859 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T15:30:25.859 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2020-09-08T15:30:25.859 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T15:30:25.860 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T15:30:25.860 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T15:30:25.860 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T15:30:25.861 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_release": "pacific", 2020-09-08T15:30:25.861 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version": "ceph version 16.0.0-5272-gdce4d291bd4 (dce4d291bd4243c9802c17d67b85a6da6bbc0f8f) pacific (dev)", 2020-09-08T15:30:25.861 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version_short": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:30:25.862 INFO:tasks.workunit.client.0.smithi065.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-09-08T15:30:25.862 INFO:tasks.workunit.client.0.smithi065.stdout: "default_device_class": "hdd", 2020-09-08T15:30:25.862 INFO:tasks.workunit.client.0.smithi065.stdout: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W4VHBH", 2020-09-08T15:30:25.862 INFO:tasks.workunit.client.0.smithi065.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2020-09-08T15:30:25.863 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": "sda", 2020-09-08T15:30:25.863 INFO:tasks.workunit.client.0.smithi065.stdout: "distro": "rhel", 2020-09-08T15:30:25.863 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_description": "Red Hat Enterprise Linux 8.1 (Ootpa)", 2020-09-08T15:30:25.864 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_version": "8.1", 2020-09-08T15:30:25.864 INFO:tasks.workunit.client.0.smithi065.stdout: "front_addr": "[v2:127.0.0.1:6802/58997,v1:127.0.0.1:6803/58997]", 2020-09-08T15:30:25.864 INFO:tasks.workunit.client.0.smithi065.stdout: "front_iface": "", 2020-09-08T15:30:25.865 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/58997,v1:127.0.0.1:6809/58997]", 2020-09-08T15:30:25.865 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/58997,v1:127.0.0.1:6807/58997]", 2020-09-08T15:30:25.865 INFO:tasks.workunit.client.0.smithi065.stdout: "hostname": "smithi065", 2020-09-08T15:30:25.866 INFO:tasks.workunit.client.0.smithi065.stdout: "journal_rotational": "1", 2020-09-08T15:30:25.866 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_description": "#1 SMP Fri Mar 27 14:35:58 UTC 2020", 2020-09-08T15:30:25.866 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_version": "4.18.0-193.el8.x86_64", 2020-09-08T15:30:25.867 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_swap_kb": "0", 2020-09-08T15:30:25.867 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_total_kb": "32653204", 2020-09-08T15:30:25.867 INFO:tasks.workunit.client.0.smithi065.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2020-09-08T15:30:25.868 INFO:tasks.workunit.client.0.smithi065.stdout: "objectstore_numa_unknown_devices": "sda", 2020-09-08T15:30:25.868 INFO:tasks.workunit.client.0.smithi065.stdout: "os": "Linux", 2020-09-08T15:30:25.868 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_data": "td/divergent-priors/0", 2020-09-08T15:30:25.869 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T15:30:25.869 INFO:tasks.workunit.client.0.smithi065.stdout: "osdspec_affinity": "", 2020-09-08T15:30:25.869 INFO:tasks.workunit.client.0.smithi065.stdout: "rotational": "1" 2020-09-08T15:30:25.869 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.870 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.870 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:30:25.870 INFO:tasks.workunit.client.0.smithi065.stdout: "arch": "x86_64", 2020-09-08T15:30:25.871 INFO:tasks.workunit.client.0.smithi065.stdout: "back_addr": "[v2:127.0.0.1:6812/54043,v1:127.0.0.1:6813/54043]", 2020-09-08T15:30:25.871 INFO:tasks.workunit.client.0.smithi065.stdout: "back_iface": "", 2020-09-08T15:30:25.871 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs": "1", 2020-09-08T15:30:25.872 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_db": "0", 2020-09-08T15:30:25.872 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_wal": "0", 2020-09-08T15:30:25.872 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_single_shared_device": "1", 2020-09-08T15:30:25.872 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T15:30:25.873 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T15:30:25.873 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T15:30:25.873 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T15:30:25.874 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2020-09-08T15:30:25.874 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T15:30:25.874 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T15:30:25.875 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T15:30:25.875 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T15:30:25.875 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_release": "pacific", 2020-09-08T15:30:25.875 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version": "ceph version 16.0.0-5272-gdce4d291bd4 (dce4d291bd4243c9802c17d67b85a6da6bbc0f8f) pacific (dev)", 2020-09-08T15:30:25.876 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version_short": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:30:25.876 INFO:tasks.workunit.client.0.smithi065.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-09-08T15:30:25.876 INFO:tasks.workunit.client.0.smithi065.stdout: "default_device_class": "hdd", 2020-09-08T15:30:25.877 INFO:tasks.workunit.client.0.smithi065.stdout: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W4VHBH", 2020-09-08T15:30:25.877 INFO:tasks.workunit.client.0.smithi065.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2020-09-08T15:30:25.877 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": "sda", 2020-09-08T15:30:25.877 INFO:tasks.workunit.client.0.smithi065.stdout: "distro": "rhel", 2020-09-08T15:30:25.878 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_description": "Red Hat Enterprise Linux 8.1 (Ootpa)", 2020-09-08T15:30:25.878 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_version": "8.1", 2020-09-08T15:30:25.878 INFO:tasks.workunit.client.0.smithi065.stdout: "front_addr": "[v2:127.0.0.1:6810/54043,v1:127.0.0.1:6811/54043]", 2020-09-08T15:30:25.878 INFO:tasks.workunit.client.0.smithi065.stdout: "front_iface": "", 2020-09-08T15:30:25.878 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/54043,v1:127.0.0.1:6817/54043]", 2020-09-08T15:30:25.879 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/54043,v1:127.0.0.1:6815/54043]", 2020-09-08T15:30:25.879 INFO:tasks.workunit.client.0.smithi065.stdout: "hostname": "smithi065", 2020-09-08T15:30:25.879 INFO:tasks.workunit.client.0.smithi065.stdout: "journal_rotational": "1", 2020-09-08T15:30:25.879 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_description": "#1 SMP Fri Mar 27 14:35:58 UTC 2020", 2020-09-08T15:30:25.879 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_version": "4.18.0-193.el8.x86_64", 2020-09-08T15:30:25.879 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_swap_kb": "0", 2020-09-08T15:30:25.880 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_total_kb": "32653204", 2020-09-08T15:30:25.880 INFO:tasks.workunit.client.0.smithi065.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2020-09-08T15:30:25.880 INFO:tasks.workunit.client.0.smithi065.stdout: "objectstore_numa_unknown_devices": "sda", 2020-09-08T15:30:25.880 INFO:tasks.workunit.client.0.smithi065.stdout: "os": "Linux", 2020-09-08T15:30:25.880 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_data": "td/divergent-priors/1", 2020-09-08T15:30:25.881 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T15:30:25.881 INFO:tasks.workunit.client.0.smithi065.stdout: "osdspec_affinity": "", 2020-09-08T15:30:25.881 INFO:tasks.workunit.client.0.smithi065.stdout: "rotational": "1" 2020-09-08T15:30:25.881 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.881 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.882 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:30:25.882 INFO:tasks.workunit.client.0.smithi065.stdout: "arch": "x86_64", 2020-09-08T15:30:25.882 INFO:tasks.workunit.client.0.smithi065.stdout: "back_addr": "[v2:127.0.0.1:6812/59396,v1:127.0.0.1:6813/59396]", 2020-09-08T15:30:25.882 INFO:tasks.workunit.client.0.smithi065.stdout: "back_iface": "", 2020-09-08T15:30:25.882 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs": "1", 2020-09-08T15:30:25.883 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_db": "0", 2020-09-08T15:30:25.883 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_wal": "0", 2020-09-08T15:30:25.883 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_single_shared_device": "1", 2020-09-08T15:30:25.883 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T15:30:25.883 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T15:30:25.883 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T15:30:25.884 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T15:30:25.884 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2020-09-08T15:30:25.884 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T15:30:25.884 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T15:30:25.884 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T15:30:25.885 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T15:30:25.885 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_release": "pacific", 2020-09-08T15:30:25.885 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version": "ceph version 16.0.0-5272-gdce4d291bd4 (dce4d291bd4243c9802c17d67b85a6da6bbc0f8f) pacific (dev)", 2020-09-08T15:30:25.885 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version_short": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:30:25.885 INFO:tasks.workunit.client.0.smithi065.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-09-08T15:30:25.886 INFO:tasks.workunit.client.0.smithi065.stdout: "default_device_class": "hdd", 2020-09-08T15:30:25.886 INFO:tasks.workunit.client.0.smithi065.stdout: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W4VHBH", 2020-09-08T15:30:25.886 INFO:tasks.workunit.client.0.smithi065.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2020-09-08T15:30:25.886 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": "sda", 2020-09-08T15:30:25.886 INFO:tasks.workunit.client.0.smithi065.stdout: "distro": "rhel", 2020-09-08T15:30:25.887 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_description": "Red Hat Enterprise Linux 8.1 (Ootpa)", 2020-09-08T15:30:25.887 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_version": "8.1", 2020-09-08T15:30:25.887 INFO:tasks.workunit.client.0.smithi065.stdout: "front_addr": "[v2:127.0.0.1:6810/59396,v1:127.0.0.1:6811/59396]", 2020-09-08T15:30:25.887 INFO:tasks.workunit.client.0.smithi065.stdout: "front_iface": "", 2020-09-08T15:30:25.887 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/59396,v1:127.0.0.1:6817/59396]", 2020-09-08T15:30:25.887 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/59396,v1:127.0.0.1:6815/59396]", 2020-09-08T15:30:25.888 INFO:tasks.workunit.client.0.smithi065.stdout: "hostname": "smithi065", 2020-09-08T15:30:25.888 INFO:tasks.workunit.client.0.smithi065.stdout: "journal_rotational": "1", 2020-09-08T15:30:25.888 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_description": "#1 SMP Fri Mar 27 14:35:58 UTC 2020", 2020-09-08T15:30:25.888 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_version": "4.18.0-193.el8.x86_64", 2020-09-08T15:30:25.888 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_swap_kb": "0", 2020-09-08T15:30:25.889 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_total_kb": "32653204", 2020-09-08T15:30:25.889 INFO:tasks.workunit.client.0.smithi065.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2020-09-08T15:30:25.889 INFO:tasks.workunit.client.0.smithi065.stdout: "objectstore_numa_unknown_devices": "sda", 2020-09-08T15:30:25.889 INFO:tasks.workunit.client.0.smithi065.stdout: "os": "Linux", 2020-09-08T15:30:25.889 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_data": "td/divergent-priors/2", 2020-09-08T15:30:25.890 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T15:30:25.890 INFO:tasks.workunit.client.0.smithi065.stdout: "osdspec_affinity": "", 2020-09-08T15:30:25.890 INFO:tasks.workunit.client.0.smithi065.stdout: "rotational": "1" 2020-09-08T15:30:25.890 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.890 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:30:25.890 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap_clean_epochs": { 2020-09-08T15:30:25.891 INFO:tasks.workunit.client.0.smithi065.stdout: "min_last_epoch_clean": 0, 2020-09-08T15:30:25.891 INFO:tasks.workunit.client.0.smithi065.stdout: "last_epoch_clean": { 2020-09-08T15:30:25.891 INFO:tasks.workunit.client.0.smithi065.stdout: "per_pool": [] 2020-09-08T15:30:25.891 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.891 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_epochs": [ 2020-09-08T15:30:25.892 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.892 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:30:25.892 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 40 2020-09-08T15:30:25.892 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.892 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.893 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:30:25.893 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 10 2020-09-08T15:30:25.893 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.893 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.893 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:30:25.893 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 42 2020-09-08T15:30:25.894 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.894 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.894 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.894 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap_first_committed": 1, 2020-09-08T15:30:25.894 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap_last_committed": 45, 2020-09-08T15:30:25.895 INFO:tasks.workunit.client.0.smithi065.stdout: "crushmap": { 2020-09-08T15:30:25.895 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": [ 2020-09-08T15:30:25.895 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.895 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:30:25.895 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd.0", 2020-09-08T15:30:25.895 INFO:tasks.workunit.client.0.smithi065.stdout: "class": "hdd" 2020-09-08T15:30:25.896 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.896 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.896 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:30:25.896 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd.1", 2020-09-08T15:30:25.896 INFO:tasks.workunit.client.0.smithi065.stdout: "class": "hdd" 2020-09-08T15:30:25.897 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.897 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.897 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:30:25.897 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd.2", 2020-09-08T15:30:25.897 INFO:tasks.workunit.client.0.smithi065.stdout: "class": "hdd" 2020-09-08T15:30:25.897 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.898 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:30:25.898 INFO:tasks.workunit.client.0.smithi065.stdout: "types": [ 2020-09-08T15:30:25.898 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.898 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 0, 2020-09-08T15:30:25.898 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd" 2020-09-08T15:30:25.899 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.899 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.899 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 1, 2020-09-08T15:30:25.899 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "host" 2020-09-08T15:30:25.899 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.900 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.900 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 2, 2020-09-08T15:30:25.900 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "chassis" 2020-09-08T15:30:25.900 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.900 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.900 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 3, 2020-09-08T15:30:25.901 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "rack" 2020-09-08T15:30:25.901 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.901 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.901 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 4, 2020-09-08T15:30:25.901 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "row" 2020-09-08T15:30:25.902 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.902 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.902 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 5, 2020-09-08T15:30:25.902 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "pdu" 2020-09-08T15:30:25.902 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.902 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.903 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 6, 2020-09-08T15:30:25.903 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "pod" 2020-09-08T15:30:25.903 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.903 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.903 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 7, 2020-09-08T15:30:25.904 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "room" 2020-09-08T15:30:25.904 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.904 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.904 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 8, 2020-09-08T15:30:25.904 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "datacenter" 2020-09-08T15:30:25.905 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.905 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.905 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 9, 2020-09-08T15:30:25.905 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "zone" 2020-09-08T15:30:25.905 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.905 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.906 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 10, 2020-09-08T15:30:25.906 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "region" 2020-09-08T15:30:25.906 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.906 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.906 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 11, 2020-09-08T15:30:25.907 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "root" 2020-09-08T15:30:25.907 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.907 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:30:25.907 INFO:tasks.workunit.client.0.smithi065.stdout: "buckets": [ 2020-09-08T15:30:25.907 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.907 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -1, 2020-09-08T15:30:25.908 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "default", 2020-09-08T15:30:25.908 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 11, 2020-09-08T15:30:25.908 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "root", 2020-09-08T15:30:25.908 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:30:25.908 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:30:25.909 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:30:25.909 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:30:25.909 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.909 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -3, 2020-09-08T15:30:25.909 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:30:25.910 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:30:25.910 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.910 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.910 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.910 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.910 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -2, 2020-09-08T15:30:25.911 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "default~hdd", 2020-09-08T15:30:25.911 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 11, 2020-09-08T15:30:25.911 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "root", 2020-09-08T15:30:25.911 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:30:25.911 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:30:25.912 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:30:25.912 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:30:25.912 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.912 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -4, 2020-09-08T15:30:25.912 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:30:25.913 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:30:25.913 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.913 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.913 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.913 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.913 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -3, 2020-09-08T15:30:25.914 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "smithi065", 2020-09-08T15:30:25.914 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 1, 2020-09-08T15:30:25.914 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "host", 2020-09-08T15:30:25.914 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:30:25.914 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:30:25.915 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:30:25.915 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:30:25.915 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.915 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:30:25.915 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:30:25.915 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:30:25.916 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.916 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.916 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:30:25.916 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:30:25.916 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 1 2020-09-08T15:30:25.917 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.917 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.917 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:30:25.917 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:30:25.917 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 2 2020-09-08T15:30:25.918 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.918 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.918 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.918 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.919 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -4, 2020-09-08T15:30:25.919 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "smithi065~hdd", 2020-09-08T15:30:25.919 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 1, 2020-09-08T15:30:25.919 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "host", 2020-09-08T15:30:25.919 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:30:25.919 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:30:25.920 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:30:25.920 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:30:25.920 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.920 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:30:25.920 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:30:25.921 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:30:25.921 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.921 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.921 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:30:25.921 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:30:25.922 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 1 2020-09-08T15:30:25.922 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.922 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.922 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:30:25.922 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:30:25.923 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 2 2020-09-08T15:30:25.923 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.923 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.923 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.923 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:30:25.923 INFO:tasks.workunit.client.0.smithi065.stdout: "rules": [ 2020-09-08T15:30:25.924 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.924 INFO:tasks.workunit.client.0.smithi065.stdout: "rule_id": 0, 2020-09-08T15:30:25.924 INFO:tasks.workunit.client.0.smithi065.stdout: "rule_name": "replicated_rule", 2020-09-08T15:30:25.924 INFO:tasks.workunit.client.0.smithi065.stdout: "ruleset": 0, 2020-09-08T15:30:25.925 INFO:tasks.workunit.client.0.smithi065.stdout: "type": 1, 2020-09-08T15:30:25.925 INFO:tasks.workunit.client.0.smithi065.stdout: "min_size": 1, 2020-09-08T15:30:25.925 INFO:tasks.workunit.client.0.smithi065.stdout: "max_size": 10, 2020-09-08T15:30:25.926 INFO:tasks.workunit.client.0.smithi065.stdout: "steps": [ 2020-09-08T15:30:25.926 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.926 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "take", 2020-09-08T15:30:25.926 INFO:tasks.workunit.client.0.smithi065.stdout: "item": -1, 2020-09-08T15:30:25.926 INFO:tasks.workunit.client.0.smithi065.stdout: "item_name": "default" 2020-09-08T15:30:25.927 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.927 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.927 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "choose_firstn", 2020-09-08T15:30:25.927 INFO:tasks.workunit.client.0.smithi065.stdout: "num": 0, 2020-09-08T15:30:25.927 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "osd" 2020-09-08T15:30:25.927 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.928 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.928 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "emit" 2020-09-08T15:30:25.928 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.928 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:30:25.928 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.929 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:30:25.929 INFO:tasks.workunit.client.0.smithi065.stdout: "tunables": { 2020-09-08T15:30:25.933 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_local_tries": 0, 2020-09-08T15:30:25.933 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_local_fallback_tries": 0, 2020-09-08T15:30:25.933 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_total_tries": 50, 2020-09-08T15:30:25.934 INFO:tasks.workunit.client.0.smithi065.stdout: "chooseleaf_descend_once": 1, 2020-09-08T15:30:25.934 INFO:tasks.workunit.client.0.smithi065.stdout: "chooseleaf_vary_r": 1, 2020-09-08T15:30:25.934 INFO:tasks.workunit.client.0.smithi065.stdout: "chooseleaf_stable": 1, 2020-09-08T15:30:25.934 INFO:tasks.workunit.client.0.smithi065.stdout: "straw_calc_version": 1, 2020-09-08T15:30:25.935 INFO:tasks.workunit.client.0.smithi065.stdout: "allowed_bucket_algs": 54, 2020-09-08T15:30:25.935 INFO:tasks.workunit.client.0.smithi065.stdout: "profile": "jewel", 2020-09-08T15:30:25.935 INFO:tasks.workunit.client.0.smithi065.stdout: "optimal_tunables": 1, 2020-09-08T15:30:25.935 INFO:tasks.workunit.client.0.smithi065.stdout: "legacy_tunables": 0, 2020-09-08T15:30:25.935 INFO:tasks.workunit.client.0.smithi065.stdout: "minimum_required_version": "jewel", 2020-09-08T15:30:25.936 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables": 1, 2020-09-08T15:30:25.936 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables2": 1, 2020-09-08T15:30:25.936 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v2_rules": 0, 2020-09-08T15:30:25.936 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables3": 1, 2020-09-08T15:30:25.936 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v3_rules": 0, 2020-09-08T15:30:25.937 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v4_buckets": 1, 2020-09-08T15:30:25.937 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables5": 1, 2020-09-08T15:30:25.937 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v5_rules": 0 2020-09-08T15:30:25.937 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.938 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_args": {} 2020-09-08T15:30:25.938 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.938 INFO:tasks.workunit.client.0.smithi065.stdout: "fsmap": { 2020-09-08T15:30:25.939 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 1, 2020-09-08T15:30:25.939 INFO:tasks.workunit.client.0.smithi065.stdout: "default_fscid": -1, 2020-09-08T15:30:25.939 INFO:tasks.workunit.client.0.smithi065.stdout: "compat": { 2020-09-08T15:30:25.939 INFO:tasks.workunit.client.0.smithi065.stdout: "compat": {}, 2020-09-08T15:30:25.940 INFO:tasks.workunit.client.0.smithi065.stdout: "ro_compat": {}, 2020-09-08T15:30:25.940 INFO:tasks.workunit.client.0.smithi065.stdout: "incompat": { 2020-09-08T15:30:25.940 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_1": "base v0.20", 2020-09-08T15:30:25.941 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_2": "client writeable ranges", 2020-09-08T15:30:25.941 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_3": "default file layouts on dirs", 2020-09-08T15:30:25.941 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_4": "dir inode in separate object", 2020-09-08T15:30:25.941 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_5": "mds uses versioned encoding", 2020-09-08T15:30:25.941 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_6": "dirfrag is stored in omap", 2020-09-08T15:30:25.942 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_8": "no anchor table", 2020-09-08T15:30:25.942 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_9": "file layout v2", 2020-09-08T15:30:25.942 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_10": "snaprealm v2" 2020-09-08T15:30:25.942 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.943 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.943 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_flags": { 2020-09-08T15:30:25.943 INFO:tasks.workunit.client.0.smithi065.stdout: "enable_multiple": false, 2020-09-08T15:30:25.943 INFO:tasks.workunit.client.0.smithi065.stdout: "ever_enabled_multiple": false 2020-09-08T15:30:25.943 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.944 INFO:tasks.workunit.client.0.smithi065.stdout: "standbys": [], 2020-09-08T15:30:25.944 INFO:tasks.workunit.client.0.smithi065.stdout: "filesystems": [] 2020-09-08T15:30:25.944 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.944 INFO:tasks.workunit.client.0.smithi065.stdout: "mdsmap_first_committed": 1, 2020-09-08T15:30:25.944 INFO:tasks.workunit.client.0.smithi065.stdout: "mdsmap_last_committed": 1, 2020-09-08T15:30:25.945 INFO:tasks.workunit.client.0.smithi065.stdout: "auth": { 2020-09-08T15:30:25.945 INFO:tasks.workunit.client.0.smithi065.stdout: "first_committed": 1, 2020-09-08T15:30:25.945 INFO:tasks.workunit.client.0.smithi065.stdout: "last_committed": 5, 2020-09-08T15:30:25.945 INFO:tasks.workunit.client.0.smithi065.stdout: "num_secrets": 3 2020-09-08T15:30:25.951 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.952 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg": 32, 2020-09-08T15:30:25.952 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_active": 32, 2020-09-08T15:30:25.952 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_unknown": 0, 2020-09-08T15:30:25.952 INFO:tasks.workunit.client.0.smithi065.stdout: "num_osd": 3, 2020-09-08T15:30:25.953 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_sum": { 2020-09-08T15:30:25.953 INFO:tasks.workunit.client.0.smithi065.stdout: "stat_sum": { 2020-09-08T15:30:25.953 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes": 48300, 2020-09-08T15:30:25.953 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects": 100, 2020-09-08T15:30:25.953 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_clones": 0, 2020-09-08T15:30:25.954 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_copies": 300, 2020-09-08T15:30:25.954 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing_on_primary": 0, 2020-09-08T15:30:25.954 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing": 0, 2020-09-08T15:30:25.954 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_degraded": 100, 2020-09-08T15:30:25.954 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_misplaced": 0, 2020-09-08T15:30:25.955 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_unfound": 0, 2020-09-08T15:30:25.955 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_dirty": 100, 2020-09-08T15:30:25.955 INFO:tasks.workunit.client.0.smithi065.stdout: "num_whiteouts": 0, 2020-09-08T15:30:25.955 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read": 0, 2020-09-08T15:30:25.956 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read_kb": 0, 2020-09-08T15:30:25.956 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write": 100, 2020-09-08T15:30:25.956 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write_kb": 100, 2020-09-08T15:30:25.956 INFO:tasks.workunit.client.0.smithi065.stdout: "num_scrub_errors": 0, 2020-09-08T15:30:25.956 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shallow_scrub_errors": 0, 2020-09-08T15:30:25.956 INFO:tasks.workunit.client.0.smithi065.stdout: "num_deep_scrub_errors": 0, 2020-09-08T15:30:25.957 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_recovered": 0, 2020-09-08T15:30:25.957 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_recovered": 0, 2020-09-08T15:30:25.958 INFO:tasks.workunit.client.0.smithi065.stdout: "num_keys_recovered": 0, 2020-09-08T15:30:25.958 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_omap": 0, 2020-09-08T15:30:25.958 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_hit_set_archive": 0, 2020-09-08T15:30:25.958 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_hit_set_archive": 0, 2020-09-08T15:30:25.964 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush": 0, 2020-09-08T15:30:25.964 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_kb": 0, 2020-09-08T15:30:25.965 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict": 0, 2020-09-08T15:30:25.965 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_kb": 0, 2020-09-08T15:30:25.965 INFO:tasks.workunit.client.0.smithi065.stdout: "num_promote": 0, 2020-09-08T15:30:25.966 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_high": 0, 2020-09-08T15:30:25.969 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_low": 0, 2020-09-08T15:30:25.970 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_some": 0, 2020-09-08T15:30:25.970 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_full": 0, 2020-09-08T15:30:25.970 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_pinned": 0, 2020-09-08T15:30:25.970 INFO:tasks.workunit.client.0.smithi065.stdout: "num_legacy_snapsets": 0, 2020-09-08T15:30:25.970 INFO:tasks.workunit.client.0.smithi065.stdout: "num_large_omap_objects": 0, 2020-09-08T15:30:25.971 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_manifest": 0, 2020-09-08T15:30:25.971 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_bytes": 0, 2020-09-08T15:30:25.971 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_keys": 0, 2020-09-08T15:30:25.971 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_repaired": 0 2020-09-08T15:30:25.971 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.972 INFO:tasks.workunit.client.0.smithi065.stdout: "store_stats": { 2020-09-08T15:30:25.972 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 0, 2020-09-08T15:30:25.972 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 0, 2020-09-08T15:30:25.972 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:30:25.972 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 0, 2020-09-08T15:30:25.972 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 0, 2020-09-08T15:30:25.973 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:30:25.973 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:30:25.973 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:30:25.973 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 0, 2020-09-08T15:30:25.974 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 0 2020-09-08T15:30:25.974 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.976 INFO:tasks.workunit.client.0.smithi065.stdout: "log_size": 512, 2020-09-08T15:30:25.976 INFO:tasks.workunit.client.0.smithi065.stdout: "ondisk_log_size": 512, 2020-09-08T15:30:25.977 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 64, 2020-09-08T15:30:25.977 INFO:tasks.workunit.client.0.smithi065.stdout: "acting": 64, 2020-09-08T15:30:25.977 INFO:tasks.workunit.client.0.smithi065.stdout: "num_store_stats": 0 2020-09-08T15:30:25.977 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.978 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_sum": { 2020-09-08T15:30:25.978 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 0, 2020-09-08T15:30:25.978 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 0, 2020-09-08T15:30:25.978 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pgs": 96, 2020-09-08T15:30:25.978 INFO:tasks.workunit.client.0.smithi065.stdout: "num_osds": 3, 2020-09-08T15:30:25.979 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_osds": 3, 2020-09-08T15:30:25.979 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_omap_osds": 3, 2020-09-08T15:30:25.979 INFO:tasks.workunit.client.0.smithi065.stdout: "kb": 314572800, 2020-09-08T15:30:25.979 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used": 19828, 2020-09-08T15:30:25.979 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_data": 2204, 2020-09-08T15:30:25.980 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_omap": 1, 2020-09-08T15:30:25.980 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_meta": 17598, 2020-09-08T15:30:25.980 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_avail": 314552972, 2020-09-08T15:30:25.980 INFO:tasks.workunit.client.0.smithi065.stdout: "statfs": { 2020-09-08T15:30:25.980 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 322122547200, 2020-09-08T15:30:25.980 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 322102243328, 2020-09-08T15:30:25.981 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:30:25.981 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 2256896, 2020-09-08T15:30:25.981 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 455443, 2020-09-08T15:30:25.981 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:30:25.981 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:30:25.982 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:30:25.982 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 1928, 2020-09-08T15:30:25.982 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 18020472 2020-09-08T15:30:25.983 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.983 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_peers": [], 2020-09-08T15:30:25.983 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_trim_queue_len": 0, 2020-09-08T15:30:25.983 INFO:tasks.workunit.client.0.smithi065.stdout: "num_snap_trimming": 0, 2020-09-08T15:30:25.984 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shards_repaired": 0, 2020-09-08T15:30:25.984 INFO:tasks.workunit.client.0.smithi065.stdout: "op_queue_age_hist": { 2020-09-08T15:30:25.984 INFO:tasks.workunit.client.0.smithi065.stdout: "histogram": [], 2020-09-08T15:30:25.984 INFO:tasks.workunit.client.0.smithi065.stdout: "upper_bound": 1 2020-09-08T15:30:25.984 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.984 INFO:tasks.workunit.client.0.smithi065.stdout: "perf_stat": { 2020-09-08T15:30:25.985 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ms": 0, 2020-09-08T15:30:25.985 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ms": 0, 2020-09-08T15:30:25.985 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ns": 0, 2020-09-08T15:30:25.985 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ns": 0 2020-09-08T15:30:25.986 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.986 INFO:tasks.workunit.client.0.smithi065.stdout: "alerts": [], 2020-09-08T15:30:25.986 INFO:tasks.workunit.client.0.smithi065.stdout: "network_ping_times": [] 2020-09-08T15:30:25.986 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.986 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_sum_by_class": { 2020-09-08T15:30:25.987 INFO:tasks.workunit.client.0.smithi065.stdout: "hdd": { 2020-09-08T15:30:25.987 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 0, 2020-09-08T15:30:25.987 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 0, 2020-09-08T15:30:25.987 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pgs": 96, 2020-09-08T15:30:25.987 INFO:tasks.workunit.client.0.smithi065.stdout: "num_osds": 3, 2020-09-08T15:30:25.987 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_osds": 3, 2020-09-08T15:30:25.988 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_omap_osds": 3, 2020-09-08T15:30:25.988 INFO:tasks.workunit.client.0.smithi065.stdout: "kb": 314572800, 2020-09-08T15:30:25.988 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used": 19828, 2020-09-08T15:30:25.988 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_data": 2204, 2020-09-08T15:30:25.988 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_omap": 1, 2020-09-08T15:30:25.989 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_meta": 17598, 2020-09-08T15:30:25.989 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_avail": 314552972, 2020-09-08T15:30:25.989 INFO:tasks.workunit.client.0.smithi065.stdout: "statfs": { 2020-09-08T15:30:25.989 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 322122547200, 2020-09-08T15:30:25.989 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 322102243328, 2020-09-08T15:30:25.990 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:30:25.990 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 2256896, 2020-09-08T15:30:25.990 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 455443, 2020-09-08T15:30:25.991 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:30:25.991 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:30:25.991 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:30:25.991 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 1928, 2020-09-08T15:30:25.991 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 18020472 2020-09-08T15:30:25.992 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.992 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_peers": [], 2020-09-08T15:30:25.992 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_trim_queue_len": 0, 2020-09-08T15:30:25.992 INFO:tasks.workunit.client.0.smithi065.stdout: "num_snap_trimming": 0, 2020-09-08T15:30:25.992 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shards_repaired": 0, 2020-09-08T15:30:25.992 INFO:tasks.workunit.client.0.smithi065.stdout: "op_queue_age_hist": { 2020-09-08T15:30:25.993 INFO:tasks.workunit.client.0.smithi065.stdout: "histogram": [], 2020-09-08T15:30:25.993 INFO:tasks.workunit.client.0.smithi065.stdout: "upper_bound": 1 2020-09-08T15:30:25.993 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.993 INFO:tasks.workunit.client.0.smithi065.stdout: "perf_stat": { 2020-09-08T15:30:25.993 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ms": 0, 2020-09-08T15:30:25.994 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ms": 0, 2020-09-08T15:30:25.994 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ns": 0, 2020-09-08T15:30:25.994 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ns": 0 2020-09-08T15:30:25.994 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.994 INFO:tasks.workunit.client.0.smithi065.stdout: "alerts": [], 2020-09-08T15:30:25.995 INFO:tasks.workunit.client.0.smithi065.stdout: "network_ping_times": [] 2020-09-08T15:30:25.995 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:25.995 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:25.995 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_stats": [ 2020-09-08T15:30:25.995 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:25.995 INFO:tasks.workunit.client.0.smithi065.stdout: "poolid": 1, 2020-09-08T15:30:25.996 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg": 32, 2020-09-08T15:30:25.996 INFO:tasks.workunit.client.0.smithi065.stdout: "stat_sum": { 2020-09-08T15:30:25.996 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes": 48300, 2020-09-08T15:30:25.996 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects": 100, 2020-09-08T15:30:25.997 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_clones": 0, 2020-09-08T15:30:25.997 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_copies": 300, 2020-09-08T15:30:25.997 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing_on_primary": 0, 2020-09-08T15:30:25.997 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing": 0, 2020-09-08T15:30:25.997 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_degraded": 100, 2020-09-08T15:30:25.998 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_misplaced": 0, 2020-09-08T15:30:25.998 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_unfound": 0, 2020-09-08T15:30:25.998 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_dirty": 100, 2020-09-08T15:30:25.998 INFO:tasks.workunit.client.0.smithi065.stdout: "num_whiteouts": 0, 2020-09-08T15:30:25.998 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read": 0, 2020-09-08T15:30:25.999 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read_kb": 0, 2020-09-08T15:30:25.999 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write": 100, 2020-09-08T15:30:25.999 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write_kb": 100, 2020-09-08T15:30:25.999 INFO:tasks.workunit.client.0.smithi065.stdout: "num_scrub_errors": 0, 2020-09-08T15:30:25.999 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shallow_scrub_errors": 0, 2020-09-08T15:30:25.999 INFO:tasks.workunit.client.0.smithi065.stdout: "num_deep_scrub_errors": 0, 2020-09-08T15:30:26.000 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_recovered": 0, 2020-09-08T15:30:26.000 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_recovered": 0, 2020-09-08T15:30:26.000 INFO:tasks.workunit.client.0.smithi065.stdout: "num_keys_recovered": 0, 2020-09-08T15:30:26.000 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_omap": 0, 2020-09-08T15:30:26.000 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_hit_set_archive": 0, 2020-09-08T15:30:26.001 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_hit_set_archive": 0, 2020-09-08T15:30:26.001 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush": 0, 2020-09-08T15:30:26.001 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_kb": 0, 2020-09-08T15:30:26.001 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict": 0, 2020-09-08T15:30:26.001 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_kb": 0, 2020-09-08T15:30:26.002 INFO:tasks.workunit.client.0.smithi065.stdout: "num_promote": 0, 2020-09-08T15:30:26.002 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_high": 0, 2020-09-08T15:30:26.002 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_low": 0, 2020-09-08T15:30:26.002 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_some": 0, 2020-09-08T15:30:26.002 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_full": 0, 2020-09-08T15:30:26.002 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_pinned": 0, 2020-09-08T15:30:26.003 INFO:tasks.workunit.client.0.smithi065.stdout: "num_legacy_snapsets": 0, 2020-09-08T15:30:26.003 INFO:tasks.workunit.client.0.smithi065.stdout: "num_large_omap_objects": 0, 2020-09-08T15:30:26.003 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_manifest": 0, 2020-09-08T15:30:26.003 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_bytes": 0, 2020-09-08T15:30:26.003 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_keys": 0, 2020-09-08T15:30:26.004 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_repaired": 0 2020-09-08T15:30:26.004 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:26.004 INFO:tasks.workunit.client.0.smithi065.stdout: "store_stats": { 2020-09-08T15:30:26.004 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 0, 2020-09-08T15:30:26.004 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 0, 2020-09-08T15:30:26.005 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:30:26.005 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 1220608, 2020-09-08T15:30:26.005 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 143228, 2020-09-08T15:30:26.005 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:30:26.005 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:30:26.006 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:30:26.006 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 0, 2020-09-08T15:30:26.006 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 0 2020-09-08T15:30:26.006 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:26.007 INFO:tasks.workunit.client.0.smithi065.stdout: "log_size": 512, 2020-09-08T15:30:26.007 INFO:tasks.workunit.client.0.smithi065.stdout: "ondisk_log_size": 512, 2020-09-08T15:30:26.007 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 64, 2020-09-08T15:30:26.007 INFO:tasks.workunit.client.0.smithi065.stdout: "acting": 64, 2020-09-08T15:30:26.007 INFO:tasks.workunit.client.0.smithi065.stdout: "num_store_stats": 3 2020-09-08T15:30:26.008 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:26.008 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:30:26.008 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_stats": [ 2020-09-08T15:30:26.008 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:26.008 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:30:26.008 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 171798691851 2020-09-08T15:30:26.009 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:26.009 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:26.010 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:30:26.010 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 42949672978 2020-09-08T15:30:26.010 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:26.010 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:26.010 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:30:26.011 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 176093659146 2020-09-08T15:30:26.011 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:26.011 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:30:26.011 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_by_state": [ 2020-09-08T15:30:26.011 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:26.012 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "active+undersized+degraded", 2020-09-08T15:30:26.012 INFO:tasks.workunit.client.0.smithi065.stdout: "num": 32 2020-09-08T15:30:26.012 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:26.012 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:30:26.012 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_by_osd": [ 2020-09-08T15:30:26.012 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:26.013 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:30:26.013 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 0, 2020-09-08T15:30:26.013 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 32, 2020-09-08T15:30:26.013 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:30:26.013 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:26.014 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:26.014 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:30:26.014 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 0, 2020-09-08T15:30:26.014 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 0, 2020-09-08T15:30:26.014 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:30:26.015 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:26.015 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:26.015 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:30:26.015 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 32, 2020-09-08T15:30:26.015 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 32, 2020-09-08T15:30:26.015 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:30:26.016 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:26.016 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:30:26.016 INFO:tasks.workunit.client.0.smithi065.stdout: "purged_snaps": [ 2020-09-08T15:30:26.016 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:30:26.016 INFO:tasks.workunit.client.0.smithi065.stdout: "pool": 1, 2020-09-08T15:30:26.017 INFO:tasks.workunit.client.0.smithi065.stdout: "purged_snaps": {} 2020-09-08T15:30:26.017 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:26.017 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:30:26.017 INFO:tasks.workunit.client.0.smithi065.stdout: "servicemap": { 2020-09-08T15:30:26.017 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 4, 2020-09-08T15:30:26.017 INFO:tasks.workunit.client.0.smithi065.stdout: "modified": "2020-09-08T15:29:44.858015+0000", 2020-09-08T15:30:26.018 INFO:tasks.workunit.client.0.smithi065.stdout: "services": { 2020-09-08T15:30:26.018 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": { 2020-09-08T15:30:26.018 INFO:tasks.workunit.client.0.smithi065.stdout: "daemons": { 2020-09-08T15:30:26.018 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": "", 2020-09-08T15:30:26.018 INFO:tasks.workunit.client.0.smithi065.stdout: "0": { 2020-09-08T15:30:26.019 INFO:tasks.workunit.client.0.smithi065.stdout: "start_epoch": 0, 2020-09-08T15:30:26.019 INFO:tasks.workunit.client.0.smithi065.stdout: "start_stamp": "0.000000", 2020-09-08T15:30:26.019 INFO:tasks.workunit.client.0.smithi065.stdout: "gid": 0, 2020-09-08T15:30:26.019 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "(unrecognized address family 0)/0", 2020-09-08T15:30:26.019 INFO:tasks.workunit.client.0.smithi065.stdout: "metadata": {}, 2020-09-08T15:30:26.020 INFO:tasks.workunit.client.0.smithi065.stdout: "task_status": {} 2020-09-08T15:30:26.020 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:26.020 INFO:tasks.workunit.client.0.smithi065.stdout: "2": { 2020-09-08T15:30:26.020 INFO:tasks.workunit.client.0.smithi065.stdout: "start_epoch": 0, 2020-09-08T15:30:26.020 INFO:tasks.workunit.client.0.smithi065.stdout: "start_stamp": "0.000000", 2020-09-08T15:30:26.020 INFO:tasks.workunit.client.0.smithi065.stdout: "gid": 0, 2020-09-08T15:30:26.021 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "(unrecognized address family 0)/0", 2020-09-08T15:30:26.021 INFO:tasks.workunit.client.0.smithi065.stdout: "metadata": {}, 2020-09-08T15:30:26.021 INFO:tasks.workunit.client.0.smithi065.stdout: "task_status": {} 2020-09-08T15:30:26.021 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:26.021 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:26.022 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:26.022 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:26.022 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:30:26.022 INFO:tasks.workunit.client.0.smithi065.stdout: "paxos": { 2020-09-08T15:30:26.022 INFO:tasks.workunit.client.0.smithi065.stdout: "first_committed": 1, 2020-09-08T15:30:26.023 INFO:tasks.workunit.client.0.smithi065.stdout: "last_committed": 370, 2020-09-08T15:30:26.023 INFO:tasks.workunit.client.0.smithi065.stdout: "last_pn": 0, 2020-09-08T15:30:26.023 INFO:tasks.workunit.client.0.smithi065.stdout: "accepted_pn": 0 2020-09-08T15:30:26.023 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:30:26.023 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:30:26.024 INFO:tasks.workunit.client.0.smithi065.stderr:report 1588365358 2020-09-08T15:30:26.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1604: wait_for_clean: return 1 2020-09-08T15:30:26.025 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:738: TEST_divergent_3: expr 2 + 2 2020-09-08T15:30:26.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:738: TEST_divergent_3: objname=existing_4 2020-09-08T15:30:26.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:739: TEST_divergent_3: echo 'writing non-divergent object existing_4' 2020-09-08T15:30:26.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:740: TEST_divergent_3: ceph pg dump pgs 2020-09-08T15:30:26.026 INFO:tasks.workunit.client.0.smithi065.stdout:writing non-divergent object existing_4 2020-09-08T15:30:26.046 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:30:26.046 INFO:tasks.workunit.client.0.smithi065.stdout:1.1f 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.351776+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.047 INFO:tasks.workunit.client.0.smithi065.stdout:1.1e 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349637+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.047 INFO:tasks.workunit.client.0.smithi065.stdout:1.1d 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.350525+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.047 INFO:tasks.workunit.client.0.smithi065.stdout:1.1c 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349938+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.047 INFO:tasks.workunit.client.0.smithi065.stdout:1.1b 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349689+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.047 INFO:tasks.workunit.client.0.smithi065.stdout:1.1a 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.347514+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.048 INFO:tasks.workunit.client.0.smithi065.stdout:1.19 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.347498+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.048 INFO:tasks.workunit.client.0.smithi065.stdout:1.18 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.350002+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.048 INFO:tasks.workunit.client.0.smithi065.stdout:1.17 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349386+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.049 INFO:tasks.workunit.client.0.smithi065.stdout:1.16 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349169+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.049 INFO:tasks.workunit.client.0.smithi065.stdout:1.15 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348612+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.049 INFO:tasks.workunit.client.0.smithi065.stdout:1.14 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348072+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.049 INFO:tasks.workunit.client.0.smithi065.stdout:1.13 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349510+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.050 INFO:tasks.workunit.client.0.smithi065.stdout:1.12 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348603+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.050 INFO:tasks.workunit.client.0.smithi065.stdout:1.11 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348630+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.050 INFO:tasks.workunit.client.0.smithi065.stdout:1.10 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349388+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.050 INFO:tasks.workunit.client.0.smithi065.stdout:1.5 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348609+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.050 INFO:tasks.workunit.client.0.smithi065.stdout:1.4 4 0 4 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349019+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.051 INFO:tasks.workunit.client.0.smithi065.stdout:1.3 4 0 4 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.347539+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.051 INFO:tasks.workunit.client.0.smithi065.stdout:1.2 4 0 4 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348074+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.051 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.350123+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.051 INFO:tasks.workunit.client.0.smithi065.stdout:1.1 4 0 4 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.350162+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.052 INFO:tasks.workunit.client.0.smithi065.stdout:1.6 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.351122+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.052 INFO:tasks.workunit.client.0.smithi065.stdout:1.7 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.296851+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.052 INFO:tasks.workunit.client.0.smithi065.stdout:1.8 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.296899+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.052 INFO:tasks.workunit.client.0.smithi065.stdout:1.9 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.347612+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.053 INFO:tasks.workunit.client.0.smithi065.stdout:1.a 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.350831+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.053 INFO:tasks.workunit.client.0.smithi065.stdout:1.b 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348076+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.053 INFO:tasks.workunit.client.0.smithi065.stdout:1.c 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.347497+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.053 INFO:tasks.workunit.client.0.smithi065.stdout:1.d 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348084+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.054 INFO:tasks.workunit.client.0.smithi065.stdout:1.e 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348125+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.054 INFO:tasks.workunit.client.0.smithi065.stdout:1.f 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349155+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:30:26.054 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:30:26.054 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:30:26.055 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:30:26.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:741: TEST_divergent_3: rados -p test put existing_4 /etc/resolv.conf 2020-09-08T15:30:26.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2020-09-08T15:30:26.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: wait_for_clean 2020-09-08T15:30:26.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:30:26.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:30:26.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:30:26.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:30:26.188 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 20 .1 2020-09-08T15:30:26.189 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:30:26.189 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:30:26.189 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:30:26.190 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:30:26.190 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:30:26.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:30:26.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:30:26.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:30:26.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:30:26.246 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:30:26.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:30:26.647 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:30:26.647 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:30:26.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:30:26.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:30:26.648 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:30:26.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=171798691853 2020-09-08T15:30:26.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 171798691853 2020-09-08T15:30:26.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-171798691853' 2020-09-08T15:30:26.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:30:26.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:30:26.994 INFO:tasks.workunit.client.0.smithi065.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-09-08T15:30:26.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq= 2020-09-08T15:30:26.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z '' 2020-09-08T15:30:26.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: continue 2020-09-08T15:30:26.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:30:26.996 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:30:27.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=176093659148 2020-09-08T15:30:27.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 176093659148 2020-09-08T15:30:27.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-171798691853 2-176093659148' 2020-09-08T15:30:27.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:30:27.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-171798691853 2020-09-08T15:30:27.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:30:27.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:30:27.129 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-171798691853 2020-09-08T15:30:27.129 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:30:27.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=171798691853 2020-09-08T15:30:27.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 171798691853' 2020-09-08T15:30:27.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:30:27.138 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 171798691853 2020-09-08T15:30:27.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 171798691853 -lt 171798691853 2020-09-08T15:30:27.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:30:27.534 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-176093659148 2020-09-08T15:30:27.534 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:30:27.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:30:27.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-176093659148 2020-09-08T15:30:27.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:30:27.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=176093659148 2020-09-08T15:30:27.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 176093659148' 2020-09-08T15:30:27.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:30:27.537 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 176093659148 2020-09-08T15:30:27.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 176093659146 -lt 176093659148 2020-09-08T15:30:27.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:30:28.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:30:28.947 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:30:29.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 176093659149 -lt 176093659148 2020-09-08T15:30:29.370 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:30:29.371 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:30:29.371 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:30:29.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 32 == 0 2020-09-08T15:30:29.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:30:29.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:30:29.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:30:29.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:30:29.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:30:29.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:30:29.901 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:30:30.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:30:30.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:30:30.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:30:30.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:30:30.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 32 2020-09-08T15:30:30.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T15:30:30.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T15:30:30.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T15:30:30.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:30:30.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:30:30.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:30:30.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:30:30.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:30:30.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:30:30.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:30:30.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:30:30.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:30:30.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:30:31.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:30:31.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:30:31.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:30:31.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:30:31.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 32 2020-09-08T15:30:31.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:30:31.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:30:31.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:30:31.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:30:31.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:30:31.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:30:31.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:30:31.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:30:32.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:30:32.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:30:32.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 1 >= 8 )) 2020-09-08T15:30:32.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:30:32.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.2 2020-09-08T15:30:32.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:30:32.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:30:32.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:30:32.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:30:32.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:30:32.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:30:32.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:30:32.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:30:32.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:30:32.951 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:30:32.951 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:30:32.951 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:30:33.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 32 2020-09-08T15:30:33.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:30:33.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:30:33.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:30:33.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:30:33.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:30:33.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:30:33.481 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:30:33.481 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:30:34.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:30:34.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:30:34.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 2 >= 8 )) 2020-09-08T15:30:34.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:30:34.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.4 2020-09-08T15:30:34.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:30:34.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:30:34.421 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:30:34.421 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:30:34.422 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:30:34.422 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:30:34.422 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:30:34.422 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:30:34.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:30:34.815 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:30:34.815 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:30:34.815 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:30:35.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 32 2020-09-08T15:30:35.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:30:35.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:30:35.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:30:35.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:30:35.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:30:35.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:30:35.335 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:30:35.335 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:30:35.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:30:35.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:30:35.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 3 >= 8 )) 2020-09-08T15:30:35.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:30:35.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.8 2020-09-08T15:30:36.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:30:36.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:30:36.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:30:36.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:30:36.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:30:36.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:30:36.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:30:36.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:30:37.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:30:37.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:30:37.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:30:37.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:30:37.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 32 2020-09-08T15:30:37.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:30:37.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:30:37.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:30:37.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:30:37.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:30:37.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:30:37.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:30:37.587 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:30:38.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:30:38.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:30:38.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 4 >= 8 )) 2020-09-08T15:30:38.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:30:38.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 1.6 2020-09-08T15:30:39.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:30:39.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:30:39.711 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:30:39.711 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:30:39.711 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:30:39.712 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:30:39.712 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:30:39.712 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:30:40.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:30:40.117 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:30:40.117 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:30:40.117 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:30:40.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 32 2020-09-08T15:30:40.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:30:40.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:30:40.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:30:40.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:30:40.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:30:40.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:30:40.681 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:30:40.681 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:30:41.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:30:41.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:30:41.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 5 >= 8 )) 2020-09-08T15:30:41.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:30:41.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 3.2 2020-09-08T15:30:44.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:30:44.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:30:44.487 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:30:44.487 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:30:44.488 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:30:44.488 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:30:44.488 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:30:44.488 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:30:44.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:30:44.895 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:30:44.895 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:30:44.895 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:30:45.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 32 2020-09-08T15:30:45.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:30:45.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:30:45.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:30:45.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:30:45.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:30:45.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:30:45.440 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:30:45.440 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:30:45.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:30:45.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:30:45.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 6 >= 8 )) 2020-09-08T15:30:45.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:30:45.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 6.4 2020-09-08T15:30:52.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:30:52.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:30:52.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:30:52.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:30:52.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:30:52.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:30:52.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:30:52.370 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:30:52.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:30:52.767 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:30:52.768 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:30:52.768 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:30:53.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 32 2020-09-08T15:30:53.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:30:53.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:30:53.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:30:53.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:30:53.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:30:53.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:30:53.295 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:30:53.295 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:30:53.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:30:53.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:30:53.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 7 >= 8 )) 2020-09-08T15:30:53.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:30:53.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 7.3 2020-09-08T15:31:01.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:31:01.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:31:01.121 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:31:01.121 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:31:01.121 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:31:01.121 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:31:01.121 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:31:01.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:31:01.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:31:01.553 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:31:01.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:31:01.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:31:02.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 32 2020-09-08T15:31:02.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:31:02.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:31:02.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:31:02.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:31:02.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:31:02.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:31:02.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:31:02.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:31:02.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:31:02.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:31:02.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 8 >= 8 )) 2020-09-08T15:31:02.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: wait_for_clean: ceph report 2020-09-08T15:31:03.142 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:31:03.143 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_fingerprint": "bdb0347a-3926-46bb-b508-196a91dbfaa0", 2020-09-08T15:31:03.146 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:31:03.146 INFO:tasks.workunit.client.0.smithi065.stdout: "commit": "dce4d291bd4243c9802c17d67b85a6da6bbc0f8f", 2020-09-08T15:31:03.146 INFO:tasks.workunit.client.0.smithi065.stdout: "timestamp": "2020-09-08T15:31:03.145950+0000", 2020-09-08T15:31:03.150 INFO:tasks.workunit.client.0.smithi065.stdout: "tag": "", 2020-09-08T15:31:03.150 INFO:tasks.workunit.client.0.smithi065.stdout: "health": { 2020-09-08T15:31:03.151 INFO:tasks.workunit.client.0.smithi065.stdout: "status": "HEALTH_WARN", 2020-09-08T15:31:03.151 INFO:tasks.workunit.client.0.smithi065.stdout: "checks": { 2020-09-08T15:31:03.151 INFO:tasks.workunit.client.0.smithi065.stdout: "OSDMAP_FLAGS": { 2020-09-08T15:31:03.151 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:31:03.151 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:31:03.152 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "nodown,noout,noin flag(s) set", 2020-09-08T15:31:03.152 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 17 2020-09-08T15:31:03.152 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.152 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [], 2020-09-08T15:31:03.152 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:31:03.153 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.154 INFO:tasks.workunit.client.0.smithi065.stdout: "OSD_DOWN": { 2020-09-08T15:31:03.154 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:31:03.154 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:31:03.155 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "1 osds down", 2020-09-08T15:31:03.155 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 1 2020-09-08T15:31:03.156 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.156 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [ 2020-09-08T15:31:03.156 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.156 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "osd.1 (root=default,host=smithi065) is down" 2020-09-08T15:31:03.156 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.157 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:31:03.157 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:31:03.158 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.158 INFO:tasks.workunit.client.0.smithi065.stdout: "PG_DEGRADED": { 2020-09-08T15:31:03.158 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:31:03.159 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:31:03.159 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded, 32 pgs undersized", 2020-09-08T15:31:03.159 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 64 2020-09-08T15:31:03.159 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.159 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [ 2020-09-08T15:31:03.160 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.160 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.0 is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.160 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.160 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.160 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.1 is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.161 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.161 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.161 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.2 is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.162 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.162 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.162 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.3 is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.162 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.162 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.163 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.4 is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.163 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.163 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.164 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.5 is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.164 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.164 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.164 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.6 is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.164 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.164 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.165 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.7 is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.165 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.165 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.166 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.8 is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.166 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.166 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.167 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.9 is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.167 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.167 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.167 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.a is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.167 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.168 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.168 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.b is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.168 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.169 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.169 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.c is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.169 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.169 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.169 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.d is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.170 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.170 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.170 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.e is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.170 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.170 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.171 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.f is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.171 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.171 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.171 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.10 is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.171 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.172 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.172 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.11 is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.172 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.172 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.172 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.12 is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.173 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.173 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.173 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.13 is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.173 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.173 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.174 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.14 is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.174 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.174 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.174 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.15 is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.174 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.175 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.175 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.16 is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.175 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.175 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.175 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.17 is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.176 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.177 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.177 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.18 is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.177 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.178 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.178 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.19 is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.180 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.180 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.181 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.1a is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.181 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.181 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.181 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.1b is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.181 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.182 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.182 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.1c is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.182 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.182 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.182 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.1d is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.183 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.183 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.183 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.1e is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.183 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.183 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.184 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.1f is stuck undersized for 73s, current state active+undersized+degraded, last acting [0,2]" 2020-09-08T15:31:03.184 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.184 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:31:03.184 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:31:03.184 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.184 INFO:tasks.workunit.client.0.smithi065.stdout: "POOL_APP_NOT_ENABLED": { 2020-09-08T15:31:03.185 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:31:03.185 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:31:03.185 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "1 pool(s) do not have an application enabled", 2020-09-08T15:31:03.185 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 1 2020-09-08T15:31:03.185 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.186 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [ 2020-09-08T15:31:03.186 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.186 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "application not enabled on pool 'test'" 2020-09-08T15:31:03.186 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.187 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.187 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." 2020-09-08T15:31:03.188 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.188 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:31:03.188 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:31:03.188 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.188 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.189 INFO:tasks.workunit.client.0.smithi065.stdout: "mutes": [] 2020-09-08T15:31:03.189 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.189 INFO:tasks.workunit.client.0.smithi065.stdout: "monmap_first_committed": 1, 2020-09-08T15:31:03.189 INFO:tasks.workunit.client.0.smithi065.stdout: "monmap_last_committed": 1, 2020-09-08T15:31:03.189 INFO:tasks.workunit.client.0.smithi065.stdout: "monmap": { 2020-09-08T15:31:03.190 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 1, 2020-09-08T15:31:03.190 INFO:tasks.workunit.client.0.smithi065.stdout: "fsid": "c25e19f6-e2e3-4d0b-8f34-71c93296ff3c", 2020-09-08T15:31:03.190 INFO:tasks.workunit.client.0.smithi065.stdout: "modified": "2020-09-08T15:28:25.484818Z", 2020-09-08T15:31:03.190 INFO:tasks.workunit.client.0.smithi065.stdout: "created": "2020-09-08T15:28:25.484818Z", 2020-09-08T15:31:03.190 INFO:tasks.workunit.client.0.smithi065.stdout: "min_mon_release": 16, 2020-09-08T15:31:03.191 INFO:tasks.workunit.client.0.smithi065.stdout: "min_mon_release_name": "pacific", 2020-09-08T15:31:03.191 INFO:tasks.workunit.client.0.smithi065.stdout: "features": { 2020-09-08T15:31:03.191 INFO:tasks.workunit.client.0.smithi065.stdout: "persistent": [ 2020-09-08T15:31:03.192 INFO:tasks.workunit.client.0.smithi065.stdout: "kraken", 2020-09-08T15:31:03.192 INFO:tasks.workunit.client.0.smithi065.stdout: "luminous", 2020-09-08T15:31:03.192 INFO:tasks.workunit.client.0.smithi065.stdout: "mimic", 2020-09-08T15:31:03.192 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap-prune", 2020-09-08T15:31:03.193 INFO:tasks.workunit.client.0.smithi065.stdout: "nautilus", 2020-09-08T15:31:03.193 INFO:tasks.workunit.client.0.smithi065.stdout: "octopus", 2020-09-08T15:31:03.193 INFO:tasks.workunit.client.0.smithi065.stdout: "pacific" 2020-09-08T15:31:03.193 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:31:03.193 INFO:tasks.workunit.client.0.smithi065.stdout: "optional": [] 2020-09-08T15:31:03.194 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.194 INFO:tasks.workunit.client.0.smithi065.stdout: "mons": [ 2020-09-08T15:31:03.194 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.194 INFO:tasks.workunit.client.0.smithi065.stdout: "rank": 0, 2020-09-08T15:31:03.194 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "a", 2020-09-08T15:31:03.195 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:31:03.195 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:31:03.195 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.195 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:31:03.195 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:7115", 2020-09-08T15:31:03.195 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 0 2020-09-08T15:31:03.196 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.196 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.196 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.196 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:7115/0", 2020-09-08T15:31:03.196 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:7115/0", 2020-09-08T15:31:03.197 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 0, 2020-09-08T15:31:03.197 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 0 2020-09-08T15:31:03.197 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.197 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.197 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.198 INFO:tasks.workunit.client.0.smithi065.stdout: "quorum": [ 2020-09-08T15:31:03.198 INFO:tasks.workunit.client.0.smithi065.stdout: 0 2020-09-08T15:31:03.198 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:31:03.198 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap": { 2020-09-08T15:31:03.199 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 45, 2020-09-08T15:31:03.199 INFO:tasks.workunit.client.0.smithi065.stdout: "fsid": "c25e19f6-e2e3-4d0b-8f34-71c93296ff3c", 2020-09-08T15:31:03.199 INFO:tasks.workunit.client.0.smithi065.stdout: "created": "2020-09-08T15:28:26.311819+0000", 2020-09-08T15:31:03.199 INFO:tasks.workunit.client.0.smithi065.stdout: "modified": "2020-09-08T15:29:48.794802+0000", 2020-09-08T15:31:03.199 INFO:tasks.workunit.client.0.smithi065.stdout: "last_up_change": "2020-09-08T15:29:47.361601+0000", 2020-09-08T15:31:03.200 INFO:tasks.workunit.client.0.smithi065.stdout: "last_in_change": "2020-09-08T15:29:48.431815+0000", 2020-09-08T15:31:03.200 INFO:tasks.workunit.client.0.smithi065.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-09-08T15:31:03.200 INFO:tasks.workunit.client.0.smithi065.stdout: "flags_num": 5800384, 2020-09-08T15:31:03.200 INFO:tasks.workunit.client.0.smithi065.stdout: "flags_set": [ 2020-09-08T15:31:03.200 INFO:tasks.workunit.client.0.smithi065.stdout: "nodown", 2020-09-08T15:31:03.200 INFO:tasks.workunit.client.0.smithi065.stdout: "noin", 2020-09-08T15:31:03.201 INFO:tasks.workunit.client.0.smithi065.stdout: "noout", 2020-09-08T15:31:03.201 INFO:tasks.workunit.client.0.smithi065.stdout: "pglog_hardlimit", 2020-09-08T15:31:03.201 INFO:tasks.workunit.client.0.smithi065.stdout: "purged_snapdirs", 2020-09-08T15:31:03.201 INFO:tasks.workunit.client.0.smithi065.stdout: "recovery_deletes", 2020-09-08T15:31:03.201 INFO:tasks.workunit.client.0.smithi065.stdout: "sortbitwise" 2020-09-08T15:31:03.202 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:31:03.202 INFO:tasks.workunit.client.0.smithi065.stdout: "crush_version": 7, 2020-09-08T15:31:03.202 INFO:tasks.workunit.client.0.smithi065.stdout: "full_ratio": 0.99000000953674316, 2020-09-08T15:31:03.202 INFO:tasks.workunit.client.0.smithi065.stdout: "backfillfull_ratio": 0.99000000953674316, 2020-09-08T15:31:03.202 INFO:tasks.workunit.client.0.smithi065.stdout: "nearfull_ratio": 0.85000002384185791, 2020-09-08T15:31:03.203 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_snapshot": "", 2020-09-08T15:31:03.203 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_max": 1, 2020-09-08T15:31:03.203 INFO:tasks.workunit.client.0.smithi065.stdout: "max_osd": 3, 2020-09-08T15:31:03.203 INFO:tasks.workunit.client.0.smithi065.stdout: "require_min_compat_client": "luminous", 2020-09-08T15:31:03.203 INFO:tasks.workunit.client.0.smithi065.stdout: "min_compat_client": "jewel", 2020-09-08T15:31:03.204 INFO:tasks.workunit.client.0.smithi065.stdout: "require_osd_release": "pacific", 2020-09-08T15:31:03.204 INFO:tasks.workunit.client.0.smithi065.stdout: "pools": [ 2020-09-08T15:31:03.204 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.204 INFO:tasks.workunit.client.0.smithi065.stdout: "pool": 1, 2020-09-08T15:31:03.204 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_name": "test", 2020-09-08T15:31:03.204 INFO:tasks.workunit.client.0.smithi065.stdout: "create_time": "2020-09-08T15:28:53.922550+0000", 2020-09-08T15:31:03.205 INFO:tasks.workunit.client.0.smithi065.stdout: "flags": 1, 2020-09-08T15:31:03.205 INFO:tasks.workunit.client.0.smithi065.stdout: "flags_names": "hashpspool", 2020-09-08T15:31:03.205 INFO:tasks.workunit.client.0.smithi065.stdout: "type": 1, 2020-09-08T15:31:03.205 INFO:tasks.workunit.client.0.smithi065.stdout: "size": 3, 2020-09-08T15:31:03.205 INFO:tasks.workunit.client.0.smithi065.stdout: "min_size": 2, 2020-09-08T15:31:03.206 INFO:tasks.workunit.client.0.smithi065.stdout: "crush_rule": 0, 2020-09-08T15:31:03.206 INFO:tasks.workunit.client.0.smithi065.stdout: "object_hash": 2, 2020-09-08T15:31:03.206 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_autoscale_mode": "on", 2020-09-08T15:31:03.206 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_num": 32, 2020-09-08T15:31:03.206 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_placement_num": 1, 2020-09-08T15:31:03.207 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_placement_num_target": 32, 2020-09-08T15:31:03.207 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_num_target": 32, 2020-09-08T15:31:03.207 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_num_pending": 32, 2020-09-08T15:31:03.207 INFO:tasks.workunit.client.0.smithi065.stdout: "last_pg_merge_meta": { 2020-09-08T15:31:03.207 INFO:tasks.workunit.client.0.smithi065.stdout: "source_pgid": "0.0", 2020-09-08T15:31:03.208 INFO:tasks.workunit.client.0.smithi065.stdout: "ready_epoch": 0, 2020-09-08T15:31:03.208 INFO:tasks.workunit.client.0.smithi065.stdout: "last_epoch_started": 0, 2020-09-08T15:31:03.209 INFO:tasks.workunit.client.0.smithi065.stdout: "last_epoch_clean": 0, 2020-09-08T15:31:03.209 INFO:tasks.workunit.client.0.smithi065.stdout: "source_version": "0'0", 2020-09-08T15:31:03.209 INFO:tasks.workunit.client.0.smithi065.stdout: "target_version": "0'0" 2020-09-08T15:31:03.209 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.209 INFO:tasks.workunit.client.0.smithi065.stdout: "last_change": "33", 2020-09-08T15:31:03.210 INFO:tasks.workunit.client.0.smithi065.stdout: "last_force_op_resend": "0", 2020-09-08T15:31:03.210 INFO:tasks.workunit.client.0.smithi065.stdout: "last_force_op_resend_prenautilus": "0", 2020-09-08T15:31:03.210 INFO:tasks.workunit.client.0.smithi065.stdout: "last_force_op_resend_preluminous": "33", 2020-09-08T15:31:03.210 INFO:tasks.workunit.client.0.smithi065.stdout: "auid": 0, 2020-09-08T15:31:03.210 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_mode": "selfmanaged", 2020-09-08T15:31:03.211 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_seq": 0, 2020-09-08T15:31:03.211 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_epoch": 0, 2020-09-08T15:31:03.211 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_snaps": [], 2020-09-08T15:31:03.211 INFO:tasks.workunit.client.0.smithi065.stdout: "removed_snaps": "[]", 2020-09-08T15:31:03.211 INFO:tasks.workunit.client.0.smithi065.stdout: "quota_max_bytes": 0, 2020-09-08T15:31:03.212 INFO:tasks.workunit.client.0.smithi065.stdout: "quota_max_objects": 0, 2020-09-08T15:31:03.212 INFO:tasks.workunit.client.0.smithi065.stdout: "tiers": [], 2020-09-08T15:31:03.212 INFO:tasks.workunit.client.0.smithi065.stdout: "tier_of": -1, 2020-09-08T15:31:03.212 INFO:tasks.workunit.client.0.smithi065.stdout: "read_tier": -1, 2020-09-08T15:31:03.212 INFO:tasks.workunit.client.0.smithi065.stdout: "write_tier": -1, 2020-09-08T15:31:03.212 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_mode": "none", 2020-09-08T15:31:03.213 INFO:tasks.workunit.client.0.smithi065.stdout: "target_max_bytes": 0, 2020-09-08T15:31:03.213 INFO:tasks.workunit.client.0.smithi065.stdout: "target_max_objects": 0, 2020-09-08T15:31:03.213 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-09-08T15:31:03.213 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-09-08T15:31:03.213 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_target_full_ratio_micro": 800000, 2020-09-08T15:31:03.214 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_min_flush_age": 0, 2020-09-08T15:31:03.214 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_min_evict_age": 0, 2020-09-08T15:31:03.214 INFO:tasks.workunit.client.0.smithi065.stdout: "erasure_code_profile": "", 2020-09-08T15:31:03.214 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_params": { 2020-09-08T15:31:03.214 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "none" 2020-09-08T15:31:03.215 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.215 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_period": 0, 2020-09-08T15:31:03.215 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_count": 0, 2020-09-08T15:31:03.215 INFO:tasks.workunit.client.0.smithi065.stdout: "use_gmt_hitset": true, 2020-09-08T15:31:03.215 INFO:tasks.workunit.client.0.smithi065.stdout: "min_read_recency_for_promote": 0, 2020-09-08T15:31:03.215 INFO:tasks.workunit.client.0.smithi065.stdout: "min_write_recency_for_promote": 0, 2020-09-08T15:31:03.216 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_grade_decay_rate": 0, 2020-09-08T15:31:03.216 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_search_last_n": 0, 2020-09-08T15:31:03.216 INFO:tasks.workunit.client.0.smithi065.stdout: "grade_table": [], 2020-09-08T15:31:03.216 INFO:tasks.workunit.client.0.smithi065.stdout: "stripe_width": 0, 2020-09-08T15:31:03.216 INFO:tasks.workunit.client.0.smithi065.stdout: "expected_num_objects": 0, 2020-09-08T15:31:03.217 INFO:tasks.workunit.client.0.smithi065.stdout: "fast_read": false, 2020-09-08T15:31:03.217 INFO:tasks.workunit.client.0.smithi065.stdout: "options": {}, 2020-09-08T15:31:03.217 INFO:tasks.workunit.client.0.smithi065.stdout: "application_metadata": {} 2020-09-08T15:31:03.217 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.217 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:31:03.218 INFO:tasks.workunit.client.0.smithi065.stdout: "osds": [ 2020-09-08T15:31:03.218 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.218 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:31:03.218 INFO:tasks.workunit.client.0.smithi065.stdout: "uuid": "017c780f-0863-4f60-9e7f-475ba27124f2", 2020-09-08T15:31:03.218 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 1, 2020-09-08T15:31:03.218 INFO:tasks.workunit.client.0.smithi065.stdout: "in": 1, 2020-09-08T15:31:03.219 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 1, 2020-09-08T15:31:03.219 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_affinity": 1, 2020-09-08T15:31:03.219 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_begin": 5, 2020-09-08T15:31:03.219 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_end": 31, 2020-09-08T15:31:03.219 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 40, 2020-09-08T15:31:03.220 INFO:tasks.workunit.client.0.smithi065.stdout: "up_thru": 44, 2020-09-08T15:31:03.220 INFO:tasks.workunit.client.0.smithi065.stdout: "down_at": 35, 2020-09-08T15:31:03.220 INFO:tasks.workunit.client.0.smithi065.stdout: "lost_at": 0, 2020-09-08T15:31:03.220 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:31:03.220 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:31:03.220 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.221 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:31:03.221 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6802", 2020-09-08T15:31:03.221 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 58997 2020-09-08T15:31:03.221 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.221 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.222 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:31:03.222 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6803", 2020-09-08T15:31:03.222 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 58997 2020-09-08T15:31:03.222 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.222 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.223 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.223 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addrs": { 2020-09-08T15:31:03.223 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:31:03.223 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.223 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:31:03.223 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6804", 2020-09-08T15:31:03.224 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 58997 2020-09-08T15:31:03.224 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.224 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.224 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:31:03.224 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6805", 2020-09-08T15:31:03.225 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 58997 2020-09-08T15:31:03.225 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.225 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.225 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.225 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addrs": { 2020-09-08T15:31:03.225 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:31:03.226 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.226 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:31:03.226 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6808", 2020-09-08T15:31:03.233 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 58997 2020-09-08T15:31:03.233 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.233 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.233 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:31:03.235 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6809", 2020-09-08T15:31:03.235 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 58997 2020-09-08T15:31:03.235 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.235 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.236 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.236 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addrs": { 2020-09-08T15:31:03.236 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:31:03.236 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.236 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:31:03.237 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6806", 2020-09-08T15:31:03.237 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 58997 2020-09-08T15:31:03.237 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.237 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.237 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:31:03.238 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6807", 2020-09-08T15:31:03.238 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 58997 2020-09-08T15:31:03.238 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.238 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.238 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.239 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:6803/58997", 2020-09-08T15:31:03.239 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addr": "127.0.0.1:6805/58997", 2020-09-08T15:31:03.239 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addr": "127.0.0.1:6809/58997", 2020-09-08T15:31:03.239 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addr": "127.0.0.1:6807/58997", 2020-09-08T15:31:03.239 INFO:tasks.workunit.client.0.smithi065.stdout: "state": [ 2020-09-08T15:31:03.239 INFO:tasks.workunit.client.0.smithi065.stdout: "exists", 2020-09-08T15:31:03.240 INFO:tasks.workunit.client.0.smithi065.stdout: "up" 2020-09-08T15:31:03.240 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.240 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.240 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.240 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:31:03.241 INFO:tasks.workunit.client.0.smithi065.stdout: "uuid": "caaf9207-8d21-4a1e-ae34-2becc94a4d1f", 2020-09-08T15:31:03.241 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 0, 2020-09-08T15:31:03.241 INFO:tasks.workunit.client.0.smithi065.stdout: "in": 1, 2020-09-08T15:31:03.241 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 1, 2020-09-08T15:31:03.241 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_affinity": 1, 2020-09-08T15:31:03.242 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_begin": 0, 2020-09-08T15:31:03.242 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_end": 0, 2020-09-08T15:31:03.242 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 10, 2020-09-08T15:31:03.242 INFO:tasks.workunit.client.0.smithi065.stdout: "up_thru": 33, 2020-09-08T15:31:03.242 INFO:tasks.workunit.client.0.smithi065.stdout: "down_at": 36, 2020-09-08T15:31:03.242 INFO:tasks.workunit.client.0.smithi065.stdout: "lost_at": 0, 2020-09-08T15:31:03.243 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:31:03.243 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:31:03.243 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.243 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:31:03.243 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6810", 2020-09-08T15:31:03.244 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 54043 2020-09-08T15:31:03.244 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.244 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.244 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:31:03.244 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6811", 2020-09-08T15:31:03.244 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 54043 2020-09-08T15:31:03.245 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.245 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.245 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.245 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addrs": { 2020-09-08T15:31:03.245 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:31:03.246 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.246 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:31:03.246 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6812", 2020-09-08T15:31:03.246 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 54043 2020-09-08T15:31:03.246 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.247 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.247 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:31:03.247 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6813", 2020-09-08T15:31:03.247 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 54043 2020-09-08T15:31:03.247 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.248 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.248 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.248 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addrs": { 2020-09-08T15:31:03.248 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:31:03.249 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.249 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:31:03.249 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6816", 2020-09-08T15:31:03.249 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 54043 2020-09-08T15:31:03.249 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.250 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.250 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:31:03.250 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6817", 2020-09-08T15:31:03.250 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 54043 2020-09-08T15:31:03.250 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.250 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.251 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.251 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addrs": { 2020-09-08T15:31:03.251 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:31:03.251 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.251 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:31:03.252 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6814", 2020-09-08T15:31:03.252 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 54043 2020-09-08T15:31:03.252 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.252 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.252 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:31:03.252 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6815", 2020-09-08T15:31:03.253 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 54043 2020-09-08T15:31:03.253 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.253 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.253 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.253 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:6811/54043", 2020-09-08T15:31:03.254 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addr": "127.0.0.1:6813/54043", 2020-09-08T15:31:03.254 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addr": "127.0.0.1:6817/54043", 2020-09-08T15:31:03.254 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addr": "127.0.0.1:6815/54043", 2020-09-08T15:31:03.254 INFO:tasks.workunit.client.0.smithi065.stdout: "state": [ 2020-09-08T15:31:03.254 INFO:tasks.workunit.client.0.smithi065.stdout: "exists" 2020-09-08T15:31:03.255 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.255 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.255 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.255 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:31:03.255 INFO:tasks.workunit.client.0.smithi065.stdout: "uuid": "559be8ed-3798-4af1-85bb-af8664f6f09f", 2020-09-08T15:31:03.255 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 1, 2020-09-08T15:31:03.256 INFO:tasks.workunit.client.0.smithi065.stdout: "in": 1, 2020-09-08T15:31:03.256 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 1, 2020-09-08T15:31:03.257 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_affinity": 1, 2020-09-08T15:31:03.257 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_begin": 15, 2020-09-08T15:31:03.257 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_end": 31, 2020-09-08T15:31:03.257 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 41, 2020-09-08T15:31:03.257 INFO:tasks.workunit.client.0.smithi065.stdout: "up_thru": 0, 2020-09-08T15:31:03.257 INFO:tasks.workunit.client.0.smithi065.stdout: "down_at": 37, 2020-09-08T15:31:03.258 INFO:tasks.workunit.client.0.smithi065.stdout: "lost_at": 0, 2020-09-08T15:31:03.258 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:31:03.258 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:31:03.258 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.258 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:31:03.259 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6810", 2020-09-08T15:31:03.259 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 59396 2020-09-08T15:31:03.259 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.259 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.259 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:31:03.260 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6811", 2020-09-08T15:31:03.260 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 59396 2020-09-08T15:31:03.260 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.260 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.260 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.261 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addrs": { 2020-09-08T15:31:03.261 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:31:03.261 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.261 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:31:03.261 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6812", 2020-09-08T15:31:03.262 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 59396 2020-09-08T15:31:03.262 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.262 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.262 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:31:03.262 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6813", 2020-09-08T15:31:03.263 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 59396 2020-09-08T15:31:03.263 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.263 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.263 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.263 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addrs": { 2020-09-08T15:31:03.264 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:31:03.264 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.264 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:31:03.264 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6816", 2020-09-08T15:31:03.264 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 59396 2020-09-08T15:31:03.264 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.265 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.265 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:31:03.265 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6817", 2020-09-08T15:31:03.265 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 59396 2020-09-08T15:31:03.265 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.266 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.266 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.266 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addrs": { 2020-09-08T15:31:03.266 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:31:03.266 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.267 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:31:03.267 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6814", 2020-09-08T15:31:03.267 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 59396 2020-09-08T15:31:03.267 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.267 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.268 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:31:03.268 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6815", 2020-09-08T15:31:03.268 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 59396 2020-09-08T15:31:03.268 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.268 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.268 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.269 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:6811/59396", 2020-09-08T15:31:03.269 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addr": "127.0.0.1:6813/59396", 2020-09-08T15:31:03.269 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addr": "127.0.0.1:6817/59396", 2020-09-08T15:31:03.269 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addr": "127.0.0.1:6815/59396", 2020-09-08T15:31:03.269 INFO:tasks.workunit.client.0.smithi065.stdout: "state": [ 2020-09-08T15:31:03.270 INFO:tasks.workunit.client.0.smithi065.stdout: "exists", 2020-09-08T15:31:03.270 INFO:tasks.workunit.client.0.smithi065.stdout: "up" 2020-09-08T15:31:03.270 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.270 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.270 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:31:03.271 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_xinfo": [ 2020-09-08T15:31:03.271 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.271 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:31:03.271 INFO:tasks.workunit.client.0.smithi065.stdout: "down_stamp": "2020-09-08T15:29:39.972799+0000", 2020-09-08T15:31:03.271 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_probability": 0, 2020-09-08T15:31:03.271 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_interval": 0, 2020-09-08T15:31:03.272 INFO:tasks.workunit.client.0.smithi065.stdout: "features": 4540138292837744639, 2020-09-08T15:31:03.272 INFO:tasks.workunit.client.0.smithi065.stdout: "old_weight": 0, 2020-09-08T15:31:03.272 INFO:tasks.workunit.client.0.smithi065.stdout: "last_purged_snaps_scrub": "2020-09-08T15:28:35.118339+0000", 2020-09-08T15:31:03.272 INFO:tasks.workunit.client.0.smithi065.stdout: "dead_epoch": 0 2020-09-08T15:31:03.272 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.273 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.273 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:31:03.273 INFO:tasks.workunit.client.0.smithi065.stdout: "down_stamp": "2020-09-08T15:29:40.578605+0000", 2020-09-08T15:31:03.273 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_probability": 0, 2020-09-08T15:31:03.273 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_interval": 0, 2020-09-08T15:31:03.274 INFO:tasks.workunit.client.0.smithi065.stdout: "features": 4540138292837744639, 2020-09-08T15:31:03.274 INFO:tasks.workunit.client.0.smithi065.stdout: "old_weight": 0, 2020-09-08T15:31:03.274 INFO:tasks.workunit.client.0.smithi065.stdout: "last_purged_snaps_scrub": "2020-09-08T15:28:43.327391+0000", 2020-09-08T15:31:03.274 INFO:tasks.workunit.client.0.smithi065.stdout: "dead_epoch": 0 2020-09-08T15:31:03.274 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.275 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.275 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:31:03.275 INFO:tasks.workunit.client.0.smithi065.stdout: "down_stamp": "2020-09-08T15:29:41.140452+0000", 2020-09-08T15:31:03.275 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_probability": 0, 2020-09-08T15:31:03.275 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_interval": 0, 2020-09-08T15:31:03.276 INFO:tasks.workunit.client.0.smithi065.stdout: "features": 4540138292837744639, 2020-09-08T15:31:03.276 INFO:tasks.workunit.client.0.smithi065.stdout: "old_weight": 0, 2020-09-08T15:31:03.276 INFO:tasks.workunit.client.0.smithi065.stdout: "last_purged_snaps_scrub": "2020-09-08T15:28:51.407968+0000", 2020-09-08T15:31:03.276 INFO:tasks.workunit.client.0.smithi065.stdout: "dead_epoch": 0 2020-09-08T15:31:03.276 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.276 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:31:03.277 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_upmap": [], 2020-09-08T15:31:03.277 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_upmap_items": [], 2020-09-08T15:31:03.277 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_temp": [], 2020-09-08T15:31:03.277 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_temp": [], 2020-09-08T15:31:03.277 INFO:tasks.workunit.client.0.smithi065.stdout: "blocklist": {}, 2020-09-08T15:31:03.278 INFO:tasks.workunit.client.0.smithi065.stdout: "erasure_code_profiles": { 2020-09-08T15:31:03.278 INFO:tasks.workunit.client.0.smithi065.stdout: "default": { 2020-09-08T15:31:03.278 INFO:tasks.workunit.client.0.smithi065.stdout: "k": "2", 2020-09-08T15:31:03.278 INFO:tasks.workunit.client.0.smithi065.stdout: "m": "2", 2020-09-08T15:31:03.278 INFO:tasks.workunit.client.0.smithi065.stdout: "plugin": "jerasure", 2020-09-08T15:31:03.279 INFO:tasks.workunit.client.0.smithi065.stdout: "technique": "reed_sol_van" 2020-09-08T15:31:03.279 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.279 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.279 INFO:tasks.workunit.client.0.smithi065.stdout: "removed_snaps_queue": [], 2020-09-08T15:31:03.279 INFO:tasks.workunit.client.0.smithi065.stdout: "new_removed_snaps": [], 2020-09-08T15:31:03.280 INFO:tasks.workunit.client.0.smithi065.stdout: "new_purged_snaps": [], 2020-09-08T15:31:03.280 INFO:tasks.workunit.client.0.smithi065.stdout: "crush_node_flags": {}, 2020-09-08T15:31:03.280 INFO:tasks.workunit.client.0.smithi065.stdout: "device_class_flags": {} 2020-09-08T15:31:03.280 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.280 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_metadata": [ 2020-09-08T15:31:03.280 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.281 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:31:03.281 INFO:tasks.workunit.client.0.smithi065.stdout: "arch": "x86_64", 2020-09-08T15:31:03.281 INFO:tasks.workunit.client.0.smithi065.stdout: "back_addr": "[v2:127.0.0.1:6804/58997,v1:127.0.0.1:6805/58997]", 2020-09-08T15:31:03.281 INFO:tasks.workunit.client.0.smithi065.stdout: "back_iface": "", 2020-09-08T15:31:03.281 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs": "1", 2020-09-08T15:31:03.282 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_db": "0", 2020-09-08T15:31:03.282 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_wal": "0", 2020-09-08T15:31:03.282 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_single_shared_device": "1", 2020-09-08T15:31:03.282 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T15:31:03.282 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T15:31:03.283 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T15:31:03.283 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T15:31:03.283 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2020-09-08T15:31:03.283 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T15:31:03.283 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T15:31:03.284 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T15:31:03.284 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T15:31:03.284 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_release": "pacific", 2020-09-08T15:31:03.284 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version": "ceph version 16.0.0-5272-gdce4d291bd4 (dce4d291bd4243c9802c17d67b85a6da6bbc0f8f) pacific (dev)", 2020-09-08T15:31:03.284 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version_short": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:31:03.284 INFO:tasks.workunit.client.0.smithi065.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-09-08T15:31:03.285 INFO:tasks.workunit.client.0.smithi065.stdout: "default_device_class": "hdd", 2020-09-08T15:31:03.285 INFO:tasks.workunit.client.0.smithi065.stdout: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W4VHBH", 2020-09-08T15:31:03.285 INFO:tasks.workunit.client.0.smithi065.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2020-09-08T15:31:03.285 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": "sda", 2020-09-08T15:31:03.285 INFO:tasks.workunit.client.0.smithi065.stdout: "distro": "rhel", 2020-09-08T15:31:03.286 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_description": "Red Hat Enterprise Linux 8.1 (Ootpa)", 2020-09-08T15:31:03.286 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_version": "8.1", 2020-09-08T15:31:03.286 INFO:tasks.workunit.client.0.smithi065.stdout: "front_addr": "[v2:127.0.0.1:6802/58997,v1:127.0.0.1:6803/58997]", 2020-09-08T15:31:03.286 INFO:tasks.workunit.client.0.smithi065.stdout: "front_iface": "", 2020-09-08T15:31:03.286 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/58997,v1:127.0.0.1:6809/58997]", 2020-09-08T15:31:03.286 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/58997,v1:127.0.0.1:6807/58997]", 2020-09-08T15:31:03.287 INFO:tasks.workunit.client.0.smithi065.stdout: "hostname": "smithi065", 2020-09-08T15:31:03.287 INFO:tasks.workunit.client.0.smithi065.stdout: "journal_rotational": "1", 2020-09-08T15:31:03.287 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_description": "#1 SMP Fri Mar 27 14:35:58 UTC 2020", 2020-09-08T15:31:03.287 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_version": "4.18.0-193.el8.x86_64", 2020-09-08T15:31:03.287 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_swap_kb": "0", 2020-09-08T15:31:03.288 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_total_kb": "32653204", 2020-09-08T15:31:03.288 INFO:tasks.workunit.client.0.smithi065.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2020-09-08T15:31:03.288 INFO:tasks.workunit.client.0.smithi065.stdout: "objectstore_numa_unknown_devices": "sda", 2020-09-08T15:31:03.288 INFO:tasks.workunit.client.0.smithi065.stdout: "os": "Linux", 2020-09-08T15:31:03.288 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_data": "td/divergent-priors/0", 2020-09-08T15:31:03.289 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T15:31:03.289 INFO:tasks.workunit.client.0.smithi065.stdout: "osdspec_affinity": "", 2020-09-08T15:31:03.289 INFO:tasks.workunit.client.0.smithi065.stdout: "rotational": "1" 2020-09-08T15:31:03.289 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.289 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.290 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:31:03.290 INFO:tasks.workunit.client.0.smithi065.stdout: "arch": "x86_64", 2020-09-08T15:31:03.290 INFO:tasks.workunit.client.0.smithi065.stdout: "back_addr": "[v2:127.0.0.1:6812/54043,v1:127.0.0.1:6813/54043]", 2020-09-08T15:31:03.290 INFO:tasks.workunit.client.0.smithi065.stdout: "back_iface": "", 2020-09-08T15:31:03.290 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs": "1", 2020-09-08T15:31:03.290 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_db": "0", 2020-09-08T15:31:03.291 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_wal": "0", 2020-09-08T15:31:03.291 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_single_shared_device": "1", 2020-09-08T15:31:03.291 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T15:31:03.291 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T15:31:03.291 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T15:31:03.292 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T15:31:03.292 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2020-09-08T15:31:03.294 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T15:31:03.294 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T15:31:03.294 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T15:31:03.294 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T15:31:03.295 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_release": "pacific", 2020-09-08T15:31:03.295 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version": "ceph version 16.0.0-5272-gdce4d291bd4 (dce4d291bd4243c9802c17d67b85a6da6bbc0f8f) pacific (dev)", 2020-09-08T15:31:03.295 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version_short": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:31:03.295 INFO:tasks.workunit.client.0.smithi065.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-09-08T15:31:03.295 INFO:tasks.workunit.client.0.smithi065.stdout: "default_device_class": "hdd", 2020-09-08T15:31:03.296 INFO:tasks.workunit.client.0.smithi065.stdout: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W4VHBH", 2020-09-08T15:31:03.296 INFO:tasks.workunit.client.0.smithi065.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2020-09-08T15:31:03.296 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": "sda", 2020-09-08T15:31:03.296 INFO:tasks.workunit.client.0.smithi065.stdout: "distro": "rhel", 2020-09-08T15:31:03.296 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_description": "Red Hat Enterprise Linux 8.1 (Ootpa)", 2020-09-08T15:31:03.297 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_version": "8.1", 2020-09-08T15:31:03.297 INFO:tasks.workunit.client.0.smithi065.stdout: "front_addr": "[v2:127.0.0.1:6810/54043,v1:127.0.0.1:6811/54043]", 2020-09-08T15:31:03.297 INFO:tasks.workunit.client.0.smithi065.stdout: "front_iface": "", 2020-09-08T15:31:03.297 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/54043,v1:127.0.0.1:6817/54043]", 2020-09-08T15:31:03.297 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/54043,v1:127.0.0.1:6815/54043]", 2020-09-08T15:31:03.298 INFO:tasks.workunit.client.0.smithi065.stdout: "hostname": "smithi065", 2020-09-08T15:31:03.298 INFO:tasks.workunit.client.0.smithi065.stdout: "journal_rotational": "1", 2020-09-08T15:31:03.298 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_description": "#1 SMP Fri Mar 27 14:35:58 UTC 2020", 2020-09-08T15:31:03.298 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_version": "4.18.0-193.el8.x86_64", 2020-09-08T15:31:03.298 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_swap_kb": "0", 2020-09-08T15:31:03.299 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_total_kb": "32653204", 2020-09-08T15:31:03.299 INFO:tasks.workunit.client.0.smithi065.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2020-09-08T15:31:03.299 INFO:tasks.workunit.client.0.smithi065.stdout: "objectstore_numa_unknown_devices": "sda", 2020-09-08T15:31:03.299 INFO:tasks.workunit.client.0.smithi065.stdout: "os": "Linux", 2020-09-08T15:31:03.299 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_data": "td/divergent-priors/1", 2020-09-08T15:31:03.299 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T15:31:03.300 INFO:tasks.workunit.client.0.smithi065.stdout: "osdspec_affinity": "", 2020-09-08T15:31:03.300 INFO:tasks.workunit.client.0.smithi065.stdout: "rotational": "1" 2020-09-08T15:31:03.300 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.300 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.302 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:31:03.302 INFO:tasks.workunit.client.0.smithi065.stdout: "arch": "x86_64", 2020-09-08T15:31:03.303 INFO:tasks.workunit.client.0.smithi065.stdout: "back_addr": "[v2:127.0.0.1:6812/59396,v1:127.0.0.1:6813/59396]", 2020-09-08T15:31:03.303 INFO:tasks.workunit.client.0.smithi065.stdout: "back_iface": "", 2020-09-08T15:31:03.303 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs": "1", 2020-09-08T15:31:03.303 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_db": "0", 2020-09-08T15:31:03.303 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_wal": "0", 2020-09-08T15:31:03.304 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_single_shared_device": "1", 2020-09-08T15:31:03.304 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T15:31:03.304 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T15:31:03.307 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T15:31:03.308 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T15:31:03.308 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2020-09-08T15:31:03.308 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T15:31:03.308 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T15:31:03.309 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T15:31:03.309 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T15:31:03.309 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_release": "pacific", 2020-09-08T15:31:03.309 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version": "ceph version 16.0.0-5272-gdce4d291bd4 (dce4d291bd4243c9802c17d67b85a6da6bbc0f8f) pacific (dev)", 2020-09-08T15:31:03.310 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version_short": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:31:03.310 INFO:tasks.workunit.client.0.smithi065.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-09-08T15:31:03.310 INFO:tasks.workunit.client.0.smithi065.stdout: "default_device_class": "hdd", 2020-09-08T15:31:03.310 INFO:tasks.workunit.client.0.smithi065.stdout: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W4VHBH", 2020-09-08T15:31:03.310 INFO:tasks.workunit.client.0.smithi065.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2020-09-08T15:31:03.311 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": "sda", 2020-09-08T15:31:03.311 INFO:tasks.workunit.client.0.smithi065.stdout: "distro": "rhel", 2020-09-08T15:31:03.311 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_description": "Red Hat Enterprise Linux 8.1 (Ootpa)", 2020-09-08T15:31:03.311 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_version": "8.1", 2020-09-08T15:31:03.312 INFO:tasks.workunit.client.0.smithi065.stdout: "front_addr": "[v2:127.0.0.1:6810/59396,v1:127.0.0.1:6811/59396]", 2020-09-08T15:31:03.312 INFO:tasks.workunit.client.0.smithi065.stdout: "front_iface": "", 2020-09-08T15:31:03.312 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/59396,v1:127.0.0.1:6817/59396]", 2020-09-08T15:31:03.312 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/59396,v1:127.0.0.1:6815/59396]", 2020-09-08T15:31:03.312 INFO:tasks.workunit.client.0.smithi065.stdout: "hostname": "smithi065", 2020-09-08T15:31:03.313 INFO:tasks.workunit.client.0.smithi065.stdout: "journal_rotational": "1", 2020-09-08T15:31:03.313 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_description": "#1 SMP Fri Mar 27 14:35:58 UTC 2020", 2020-09-08T15:31:03.313 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_version": "4.18.0-193.el8.x86_64", 2020-09-08T15:31:03.313 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_swap_kb": "0", 2020-09-08T15:31:03.313 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_total_kb": "32653204", 2020-09-08T15:31:03.314 INFO:tasks.workunit.client.0.smithi065.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2020-09-08T15:31:03.314 INFO:tasks.workunit.client.0.smithi065.stdout: "objectstore_numa_unknown_devices": "sda", 2020-09-08T15:31:03.314 INFO:tasks.workunit.client.0.smithi065.stdout: "os": "Linux", 2020-09-08T15:31:03.314 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_data": "td/divergent-priors/2", 2020-09-08T15:31:03.314 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T15:31:03.315 INFO:tasks.workunit.client.0.smithi065.stdout: "osdspec_affinity": "", 2020-09-08T15:31:03.315 INFO:tasks.workunit.client.0.smithi065.stdout: "rotational": "1" 2020-09-08T15:31:03.316 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.316 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:31:03.316 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap_clean_epochs": { 2020-09-08T15:31:03.317 INFO:tasks.workunit.client.0.smithi065.stdout: "min_last_epoch_clean": 0, 2020-09-08T15:31:03.317 INFO:tasks.workunit.client.0.smithi065.stdout: "last_epoch_clean": { 2020-09-08T15:31:03.317 INFO:tasks.workunit.client.0.smithi065.stdout: "per_pool": [] 2020-09-08T15:31:03.317 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.317 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_epochs": [ 2020-09-08T15:31:03.318 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.318 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:31:03.318 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 40 2020-09-08T15:31:03.318 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.318 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.319 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:31:03.319 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 10 2020-09-08T15:31:03.319 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.319 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.319 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:31:03.320 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 42 2020-09-08T15:31:03.320 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.320 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.320 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.320 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap_first_committed": 1, 2020-09-08T15:31:03.320 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap_last_committed": 45, 2020-09-08T15:31:03.321 INFO:tasks.workunit.client.0.smithi065.stdout: "crushmap": { 2020-09-08T15:31:03.321 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": [ 2020-09-08T15:31:03.321 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.321 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:31:03.322 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd.0", 2020-09-08T15:31:03.322 INFO:tasks.workunit.client.0.smithi065.stdout: "class": "hdd" 2020-09-08T15:31:03.322 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.322 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.323 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:31:03.323 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd.1", 2020-09-08T15:31:03.323 INFO:tasks.workunit.client.0.smithi065.stdout: "class": "hdd" 2020-09-08T15:31:03.323 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.323 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.324 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:31:03.324 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd.2", 2020-09-08T15:31:03.324 INFO:tasks.workunit.client.0.smithi065.stdout: "class": "hdd" 2020-09-08T15:31:03.324 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.324 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:31:03.324 INFO:tasks.workunit.client.0.smithi065.stdout: "types": [ 2020-09-08T15:31:03.325 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.325 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 0, 2020-09-08T15:31:03.325 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd" 2020-09-08T15:31:03.325 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.326 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.326 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 1, 2020-09-08T15:31:03.326 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "host" 2020-09-08T15:31:03.326 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.326 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.327 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 2, 2020-09-08T15:31:03.327 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "chassis" 2020-09-08T15:31:03.327 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.327 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.327 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 3, 2020-09-08T15:31:03.328 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "rack" 2020-09-08T15:31:03.328 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.328 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.328 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 4, 2020-09-08T15:31:03.328 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "row" 2020-09-08T15:31:03.328 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.329 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.329 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 5, 2020-09-08T15:31:03.329 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "pdu" 2020-09-08T15:31:03.329 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.329 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.330 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 6, 2020-09-08T15:31:03.330 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "pod" 2020-09-08T15:31:03.330 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.330 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.330 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 7, 2020-09-08T15:31:03.331 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "room" 2020-09-08T15:31:03.331 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.331 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.331 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 8, 2020-09-08T15:31:03.331 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "datacenter" 2020-09-08T15:31:03.331 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.332 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.332 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 9, 2020-09-08T15:31:03.332 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "zone" 2020-09-08T15:31:03.332 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.332 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.333 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 10, 2020-09-08T15:31:03.333 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "region" 2020-09-08T15:31:03.333 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.333 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.336 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 11, 2020-09-08T15:31:03.336 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "root" 2020-09-08T15:31:03.337 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.337 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:31:03.338 INFO:tasks.workunit.client.0.smithi065.stdout: "buckets": [ 2020-09-08T15:31:03.338 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.338 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -1, 2020-09-08T15:31:03.339 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "default", 2020-09-08T15:31:03.339 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 11, 2020-09-08T15:31:03.339 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "root", 2020-09-08T15:31:03.340 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:31:03.340 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:31:03.341 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:31:03.341 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:31:03.341 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.341 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -3, 2020-09-08T15:31:03.341 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:31:03.342 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:31:03.342 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.342 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.342 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.342 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.343 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -2, 2020-09-08T15:31:03.343 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "default~hdd", 2020-09-08T15:31:03.343 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 11, 2020-09-08T15:31:03.343 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "root", 2020-09-08T15:31:03.343 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:31:03.344 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:31:03.344 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:31:03.344 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:31:03.344 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.345 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -4, 2020-09-08T15:31:03.345 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:31:03.345 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:31:03.345 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.345 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.346 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.346 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.346 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -3, 2020-09-08T15:31:03.346 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "smithi065", 2020-09-08T15:31:03.346 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 1, 2020-09-08T15:31:03.347 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "host", 2020-09-08T15:31:03.347 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:31:03.347 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:31:03.347 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:31:03.347 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:31:03.348 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.348 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:31:03.348 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:31:03.348 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:31:03.348 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.348 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.349 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:31:03.349 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:31:03.349 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 1 2020-09-08T15:31:03.349 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.349 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.350 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:31:03.350 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:31:03.350 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 2 2020-09-08T15:31:03.351 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.351 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.351 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.352 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.352 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -4, 2020-09-08T15:31:03.352 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "smithi065~hdd", 2020-09-08T15:31:03.352 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 1, 2020-09-08T15:31:03.352 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "host", 2020-09-08T15:31:03.353 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:31:03.353 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:31:03.353 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:31:03.353 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:31:03.353 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.354 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:31:03.354 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:31:03.354 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:31:03.354 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.354 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.354 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:31:03.355 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:31:03.355 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 1 2020-09-08T15:31:03.355 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.355 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.355 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:31:03.356 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:31:03.356 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 2 2020-09-08T15:31:03.356 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.356 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.356 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.356 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:31:03.357 INFO:tasks.workunit.client.0.smithi065.stdout: "rules": [ 2020-09-08T15:31:03.357 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.357 INFO:tasks.workunit.client.0.smithi065.stdout: "rule_id": 0, 2020-09-08T15:31:03.357 INFO:tasks.workunit.client.0.smithi065.stdout: "rule_name": "replicated_rule", 2020-09-08T15:31:03.357 INFO:tasks.workunit.client.0.smithi065.stdout: "ruleset": 0, 2020-09-08T15:31:03.358 INFO:tasks.workunit.client.0.smithi065.stdout: "type": 1, 2020-09-08T15:31:03.358 INFO:tasks.workunit.client.0.smithi065.stdout: "min_size": 1, 2020-09-08T15:31:03.358 INFO:tasks.workunit.client.0.smithi065.stdout: "max_size": 10, 2020-09-08T15:31:03.359 INFO:tasks.workunit.client.0.smithi065.stdout: "steps": [ 2020-09-08T15:31:03.359 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.359 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "take", 2020-09-08T15:31:03.359 INFO:tasks.workunit.client.0.smithi065.stdout: "item": -1, 2020-09-08T15:31:03.359 INFO:tasks.workunit.client.0.smithi065.stdout: "item_name": "default" 2020-09-08T15:31:03.360 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.360 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.361 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "choose_firstn", 2020-09-08T15:31:03.361 INFO:tasks.workunit.client.0.smithi065.stdout: "num": 0, 2020-09-08T15:31:03.361 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "osd" 2020-09-08T15:31:03.361 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.361 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.362 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "emit" 2020-09-08T15:31:03.362 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.362 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:31:03.362 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.363 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:31:03.363 INFO:tasks.workunit.client.0.smithi065.stdout: "tunables": { 2020-09-08T15:31:03.363 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_local_tries": 0, 2020-09-08T15:31:03.363 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_local_fallback_tries": 0, 2020-09-08T15:31:03.363 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_total_tries": 50, 2020-09-08T15:31:03.364 INFO:tasks.workunit.client.0.smithi065.stdout: "chooseleaf_descend_once": 1, 2020-09-08T15:31:03.364 INFO:tasks.workunit.client.0.smithi065.stdout: "chooseleaf_vary_r": 1, 2020-09-08T15:31:03.364 INFO:tasks.workunit.client.0.smithi065.stdout: "chooseleaf_stable": 1, 2020-09-08T15:31:03.364 INFO:tasks.workunit.client.0.smithi065.stdout: "straw_calc_version": 1, 2020-09-08T15:31:03.364 INFO:tasks.workunit.client.0.smithi065.stdout: "allowed_bucket_algs": 54, 2020-09-08T15:31:03.365 INFO:tasks.workunit.client.0.smithi065.stdout: "profile": "jewel", 2020-09-08T15:31:03.365 INFO:tasks.workunit.client.0.smithi065.stdout: "optimal_tunables": 1, 2020-09-08T15:31:03.365 INFO:tasks.workunit.client.0.smithi065.stdout: "legacy_tunables": 0, 2020-09-08T15:31:03.365 INFO:tasks.workunit.client.0.smithi065.stdout: "minimum_required_version": "jewel", 2020-09-08T15:31:03.366 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables": 1, 2020-09-08T15:31:03.366 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables2": 1, 2020-09-08T15:31:03.366 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v2_rules": 0, 2020-09-08T15:31:03.366 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables3": 1, 2020-09-08T15:31:03.366 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v3_rules": 0, 2020-09-08T15:31:03.367 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v4_buckets": 1, 2020-09-08T15:31:03.367 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables5": 1, 2020-09-08T15:31:03.367 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v5_rules": 0 2020-09-08T15:31:03.367 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.368 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_args": {} 2020-09-08T15:31:03.368 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.368 INFO:tasks.workunit.client.0.smithi065.stdout: "fsmap": { 2020-09-08T15:31:03.368 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 1, 2020-09-08T15:31:03.368 INFO:tasks.workunit.client.0.smithi065.stdout: "default_fscid": -1, 2020-09-08T15:31:03.369 INFO:tasks.workunit.client.0.smithi065.stdout: "compat": { 2020-09-08T15:31:03.369 INFO:tasks.workunit.client.0.smithi065.stdout: "compat": {}, 2020-09-08T15:31:03.369 INFO:tasks.workunit.client.0.smithi065.stdout: "ro_compat": {}, 2020-09-08T15:31:03.369 INFO:tasks.workunit.client.0.smithi065.stdout: "incompat": { 2020-09-08T15:31:03.369 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_1": "base v0.20", 2020-09-08T15:31:03.370 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_2": "client writeable ranges", 2020-09-08T15:31:03.370 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_3": "default file layouts on dirs", 2020-09-08T15:31:03.370 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_4": "dir inode in separate object", 2020-09-08T15:31:03.370 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_5": "mds uses versioned encoding", 2020-09-08T15:31:03.370 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_6": "dirfrag is stored in omap", 2020-09-08T15:31:03.371 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_8": "no anchor table", 2020-09-08T15:31:03.371 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_9": "file layout v2", 2020-09-08T15:31:03.371 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_10": "snaprealm v2" 2020-09-08T15:31:03.371 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.372 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.372 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_flags": { 2020-09-08T15:31:03.372 INFO:tasks.workunit.client.0.smithi065.stdout: "enable_multiple": false, 2020-09-08T15:31:03.372 INFO:tasks.workunit.client.0.smithi065.stdout: "ever_enabled_multiple": false 2020-09-08T15:31:03.373 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.373 INFO:tasks.workunit.client.0.smithi065.stdout: "standbys": [], 2020-09-08T15:31:03.373 INFO:tasks.workunit.client.0.smithi065.stdout: "filesystems": [] 2020-09-08T15:31:03.373 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.373 INFO:tasks.workunit.client.0.smithi065.stdout: "mdsmap_first_committed": 1, 2020-09-08T15:31:03.380 INFO:tasks.workunit.client.0.smithi065.stdout: "mdsmap_last_committed": 1, 2020-09-08T15:31:03.380 INFO:tasks.workunit.client.0.smithi065.stdout: "auth": { 2020-09-08T15:31:03.380 INFO:tasks.workunit.client.0.smithi065.stdout: "first_committed": 1, 2020-09-08T15:31:03.380 INFO:tasks.workunit.client.0.smithi065.stdout: "last_committed": 5, 2020-09-08T15:31:03.381 INFO:tasks.workunit.client.0.smithi065.stdout: "num_secrets": 3 2020-09-08T15:31:03.381 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.381 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg": 32, 2020-09-08T15:31:03.381 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_active": 32, 2020-09-08T15:31:03.381 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_unknown": 0, 2020-09-08T15:31:03.382 INFO:tasks.workunit.client.0.smithi065.stdout: "num_osd": 3, 2020-09-08T15:31:03.382 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_sum": { 2020-09-08T15:31:03.382 INFO:tasks.workunit.client.0.smithi065.stdout: "stat_sum": { 2020-09-08T15:31:03.391 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes": 47947, 2020-09-08T15:31:03.391 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects": 100, 2020-09-08T15:31:03.391 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_clones": 0, 2020-09-08T15:31:03.392 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_copies": 300, 2020-09-08T15:31:03.392 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing_on_primary": 0, 2020-09-08T15:31:03.392 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing": 0, 2020-09-08T15:31:03.392 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_degraded": 100, 2020-09-08T15:31:03.392 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_misplaced": 0, 2020-09-08T15:31:03.393 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_unfound": 0, 2020-09-08T15:31:03.393 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_dirty": 100, 2020-09-08T15:31:03.393 INFO:tasks.workunit.client.0.smithi065.stdout: "num_whiteouts": 0, 2020-09-08T15:31:03.393 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read": 0, 2020-09-08T15:31:03.393 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read_kb": 0, 2020-09-08T15:31:03.396 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write": 101, 2020-09-08T15:31:03.396 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write_kb": 101, 2020-09-08T15:31:03.396 INFO:tasks.workunit.client.0.smithi065.stdout: "num_scrub_errors": 0, 2020-09-08T15:31:03.396 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shallow_scrub_errors": 0, 2020-09-08T15:31:03.396 INFO:tasks.workunit.client.0.smithi065.stdout: "num_deep_scrub_errors": 0, 2020-09-08T15:31:03.397 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_recovered": 0, 2020-09-08T15:31:03.397 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_recovered": 0, 2020-09-08T15:31:03.397 INFO:tasks.workunit.client.0.smithi065.stdout: "num_keys_recovered": 0, 2020-09-08T15:31:03.397 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_omap": 0, 2020-09-08T15:31:03.397 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_hit_set_archive": 0, 2020-09-08T15:31:03.398 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_hit_set_archive": 0, 2020-09-08T15:31:03.398 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush": 0, 2020-09-08T15:31:03.398 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_kb": 0, 2020-09-08T15:31:03.398 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict": 0, 2020-09-08T15:31:03.398 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_kb": 0, 2020-09-08T15:31:03.399 INFO:tasks.workunit.client.0.smithi065.stdout: "num_promote": 0, 2020-09-08T15:31:03.400 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_high": 0, 2020-09-08T15:31:03.401 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_low": 0, 2020-09-08T15:31:03.401 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_some": 0, 2020-09-08T15:31:03.401 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_full": 0, 2020-09-08T15:31:03.401 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_pinned": 0, 2020-09-08T15:31:03.401 INFO:tasks.workunit.client.0.smithi065.stdout: "num_legacy_snapsets": 0, 2020-09-08T15:31:03.405 INFO:tasks.workunit.client.0.smithi065.stdout: "num_large_omap_objects": 0, 2020-09-08T15:31:03.406 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_manifest": 0, 2020-09-08T15:31:03.406 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_bytes": 0, 2020-09-08T15:31:03.406 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_keys": 0, 2020-09-08T15:31:03.407 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_repaired": 0 2020-09-08T15:31:03.407 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.407 INFO:tasks.workunit.client.0.smithi065.stdout: "store_stats": { 2020-09-08T15:31:03.408 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 0, 2020-09-08T15:31:03.408 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 0, 2020-09-08T15:31:03.408 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:31:03.408 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 0, 2020-09-08T15:31:03.408 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 0, 2020-09-08T15:31:03.410 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:31:03.410 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:31:03.411 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:31:03.411 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 0, 2020-09-08T15:31:03.412 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 0 2020-09-08T15:31:03.412 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.412 INFO:tasks.workunit.client.0.smithi065.stdout: "log_size": 513, 2020-09-08T15:31:03.412 INFO:tasks.workunit.client.0.smithi065.stdout: "ondisk_log_size": 513, 2020-09-08T15:31:03.412 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 64, 2020-09-08T15:31:03.413 INFO:tasks.workunit.client.0.smithi065.stdout: "acting": 64, 2020-09-08T15:31:03.413 INFO:tasks.workunit.client.0.smithi065.stdout: "num_store_stats": 0 2020-09-08T15:31:03.416 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.416 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_sum": { 2020-09-08T15:31:03.417 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 0, 2020-09-08T15:31:03.417 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 0, 2020-09-08T15:31:03.417 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pgs": 96, 2020-09-08T15:31:03.417 INFO:tasks.workunit.client.0.smithi065.stdout: "num_osds": 3, 2020-09-08T15:31:03.419 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_osds": 3, 2020-09-08T15:31:03.419 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_omap_osds": 3, 2020-09-08T15:31:03.419 INFO:tasks.workunit.client.0.smithi065.stdout: "kb": 314572800, 2020-09-08T15:31:03.420 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used": 19828, 2020-09-08T15:31:03.420 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_data": 2204, 2020-09-08T15:31:03.421 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_omap": 1, 2020-09-08T15:31:03.421 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_meta": 17598, 2020-09-08T15:31:03.421 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_avail": 314552972, 2020-09-08T15:31:03.421 INFO:tasks.workunit.client.0.smithi065.stdout: "statfs": { 2020-09-08T15:31:03.421 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 322122547200, 2020-09-08T15:31:03.422 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 322102243328, 2020-09-08T15:31:03.422 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:31:03.423 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 2256896, 2020-09-08T15:31:03.423 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 454737, 2020-09-08T15:31:03.423 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:31:03.423 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:31:03.423 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:31:03.424 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 1928, 2020-09-08T15:31:03.424 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 18020472 2020-09-08T15:31:03.425 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.425 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_peers": [], 2020-09-08T15:31:03.425 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_trim_queue_len": 0, 2020-09-08T15:31:03.425 INFO:tasks.workunit.client.0.smithi065.stdout: "num_snap_trimming": 0, 2020-09-08T15:31:03.425 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shards_repaired": 0, 2020-09-08T15:31:03.426 INFO:tasks.workunit.client.0.smithi065.stdout: "op_queue_age_hist": { 2020-09-08T15:31:03.426 INFO:tasks.workunit.client.0.smithi065.stdout: "histogram": [], 2020-09-08T15:31:03.426 INFO:tasks.workunit.client.0.smithi065.stdout: "upper_bound": 1 2020-09-08T15:31:03.426 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.426 INFO:tasks.workunit.client.0.smithi065.stdout: "perf_stat": { 2020-09-08T15:31:03.427 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ms": 0, 2020-09-08T15:31:03.427 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ms": 0, 2020-09-08T15:31:03.428 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ns": 0, 2020-09-08T15:31:03.428 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ns": 0 2020-09-08T15:31:03.428 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.428 INFO:tasks.workunit.client.0.smithi065.stdout: "alerts": [], 2020-09-08T15:31:03.428 INFO:tasks.workunit.client.0.smithi065.stdout: "network_ping_times": [] 2020-09-08T15:31:03.429 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.429 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_sum_by_class": { 2020-09-08T15:31:03.430 INFO:tasks.workunit.client.0.smithi065.stdout: "hdd": { 2020-09-08T15:31:03.430 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 0, 2020-09-08T15:31:03.430 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 0, 2020-09-08T15:31:03.430 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pgs": 96, 2020-09-08T15:31:03.430 INFO:tasks.workunit.client.0.smithi065.stdout: "num_osds": 3, 2020-09-08T15:31:03.431 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_osds": 3, 2020-09-08T15:31:03.431 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_omap_osds": 3, 2020-09-08T15:31:03.431 INFO:tasks.workunit.client.0.smithi065.stdout: "kb": 314572800, 2020-09-08T15:31:03.432 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used": 19828, 2020-09-08T15:31:03.432 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_data": 2204, 2020-09-08T15:31:03.432 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_omap": 1, 2020-09-08T15:31:03.432 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_meta": 17598, 2020-09-08T15:31:03.433 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_avail": 314552972, 2020-09-08T15:31:03.433 INFO:tasks.workunit.client.0.smithi065.stdout: "statfs": { 2020-09-08T15:31:03.433 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 322122547200, 2020-09-08T15:31:03.447 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 322102243328, 2020-09-08T15:31:03.447 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:31:03.447 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 2256896, 2020-09-08T15:31:03.447 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 454737, 2020-09-08T15:31:03.448 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:31:03.448 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:31:03.448 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:31:03.448 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 1928, 2020-09-08T15:31:03.448 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 18020472 2020-09-08T15:31:03.448 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.449 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_peers": [], 2020-09-08T15:31:03.449 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_trim_queue_len": 0, 2020-09-08T15:31:03.449 INFO:tasks.workunit.client.0.smithi065.stdout: "num_snap_trimming": 0, 2020-09-08T15:31:03.449 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shards_repaired": 0, 2020-09-08T15:31:03.449 INFO:tasks.workunit.client.0.smithi065.stdout: "op_queue_age_hist": { 2020-09-08T15:31:03.450 INFO:tasks.workunit.client.0.smithi065.stdout: "histogram": [], 2020-09-08T15:31:03.450 INFO:tasks.workunit.client.0.smithi065.stdout: "upper_bound": 1 2020-09-08T15:31:03.450 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.450 INFO:tasks.workunit.client.0.smithi065.stdout: "perf_stat": { 2020-09-08T15:31:03.450 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ms": 0, 2020-09-08T15:31:03.451 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ms": 0, 2020-09-08T15:31:03.451 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ns": 0, 2020-09-08T15:31:03.451 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ns": 0 2020-09-08T15:31:03.451 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.451 INFO:tasks.workunit.client.0.smithi065.stdout: "alerts": [], 2020-09-08T15:31:03.452 INFO:tasks.workunit.client.0.smithi065.stdout: "network_ping_times": [] 2020-09-08T15:31:03.452 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.452 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.452 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_stats": [ 2020-09-08T15:31:03.452 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.453 INFO:tasks.workunit.client.0.smithi065.stdout: "poolid": 1, 2020-09-08T15:31:03.453 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg": 32, 2020-09-08T15:31:03.453 INFO:tasks.workunit.client.0.smithi065.stdout: "stat_sum": { 2020-09-08T15:31:03.453 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes": 47947, 2020-09-08T15:31:03.453 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects": 100, 2020-09-08T15:31:03.456 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_clones": 0, 2020-09-08T15:31:03.456 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_copies": 300, 2020-09-08T15:31:03.457 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing_on_primary": 0, 2020-09-08T15:31:03.457 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing": 0, 2020-09-08T15:31:03.457 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_degraded": 100, 2020-09-08T15:31:03.458 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_misplaced": 0, 2020-09-08T15:31:03.458 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_unfound": 0, 2020-09-08T15:31:03.458 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_dirty": 100, 2020-09-08T15:31:03.458 INFO:tasks.workunit.client.0.smithi065.stdout: "num_whiteouts": 0, 2020-09-08T15:31:03.459 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read": 0, 2020-09-08T15:31:03.459 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read_kb": 0, 2020-09-08T15:31:03.459 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write": 101, 2020-09-08T15:31:03.459 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write_kb": 101, 2020-09-08T15:31:03.460 INFO:tasks.workunit.client.0.smithi065.stdout: "num_scrub_errors": 0, 2020-09-08T15:31:03.460 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shallow_scrub_errors": 0, 2020-09-08T15:31:03.460 INFO:tasks.workunit.client.0.smithi065.stdout: "num_deep_scrub_errors": 0, 2020-09-08T15:31:03.460 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_recovered": 0, 2020-09-08T15:31:03.460 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_recovered": 0, 2020-09-08T15:31:03.461 INFO:tasks.workunit.client.0.smithi065.stdout: "num_keys_recovered": 0, 2020-09-08T15:31:03.461 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_omap": 0, 2020-09-08T15:31:03.461 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_hit_set_archive": 0, 2020-09-08T15:31:03.461 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_hit_set_archive": 0, 2020-09-08T15:31:03.461 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush": 0, 2020-09-08T15:31:03.464 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_kb": 0, 2020-09-08T15:31:03.464 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict": 0, 2020-09-08T15:31:03.465 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_kb": 0, 2020-09-08T15:31:03.465 INFO:tasks.workunit.client.0.smithi065.stdout: "num_promote": 0, 2020-09-08T15:31:03.466 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_high": 0, 2020-09-08T15:31:03.466 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_low": 0, 2020-09-08T15:31:03.466 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_some": 0, 2020-09-08T15:31:03.466 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_full": 0, 2020-09-08T15:31:03.466 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_pinned": 0, 2020-09-08T15:31:03.467 INFO:tasks.workunit.client.0.smithi065.stdout: "num_legacy_snapsets": 0, 2020-09-08T15:31:03.467 INFO:tasks.workunit.client.0.smithi065.stdout: "num_large_omap_objects": 0, 2020-09-08T15:31:03.467 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_manifest": 0, 2020-09-08T15:31:03.467 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_bytes": 0, 2020-09-08T15:31:03.467 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_keys": 0, 2020-09-08T15:31:03.468 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_repaired": 0 2020-09-08T15:31:03.468 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.468 INFO:tasks.workunit.client.0.smithi065.stdout: "store_stats": { 2020-09-08T15:31:03.468 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 0, 2020-09-08T15:31:03.469 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 0, 2020-09-08T15:31:03.469 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:31:03.469 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 1220608, 2020-09-08T15:31:03.470 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 142522, 2020-09-08T15:31:03.470 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:31:03.470 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:31:03.470 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:31:03.470 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 0, 2020-09-08T15:31:03.471 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 0 2020-09-08T15:31:03.471 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.472 INFO:tasks.workunit.client.0.smithi065.stdout: "log_size": 513, 2020-09-08T15:31:03.472 INFO:tasks.workunit.client.0.smithi065.stdout: "ondisk_log_size": 513, 2020-09-08T15:31:03.472 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 64, 2020-09-08T15:31:03.472 INFO:tasks.workunit.client.0.smithi065.stdout: "acting": 64, 2020-09-08T15:31:03.472 INFO:tasks.workunit.client.0.smithi065.stdout: "num_store_stats": 3 2020-09-08T15:31:03.473 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.473 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:31:03.477 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_stats": [ 2020-09-08T15:31:03.477 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.477 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:31:03.477 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 171798691860 2020-09-08T15:31:03.478 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.478 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.479 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:31:03.479 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 42949672978 2020-09-08T15:31:03.479 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.479 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.479 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:31:03.480 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 176093659156 2020-09-08T15:31:03.480 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.480 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:31:03.481 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_by_state": [ 2020-09-08T15:31:03.481 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.481 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "active+undersized+degraded", 2020-09-08T15:31:03.481 INFO:tasks.workunit.client.0.smithi065.stdout: "num": 32 2020-09-08T15:31:03.482 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.482 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:31:03.482 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_by_osd": [ 2020-09-08T15:31:03.483 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.483 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:31:03.484 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 0, 2020-09-08T15:31:03.484 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 32, 2020-09-08T15:31:03.484 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:31:03.484 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.484 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.485 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:31:03.486 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 0, 2020-09-08T15:31:03.486 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 0, 2020-09-08T15:31:03.486 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:31:03.486 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.487 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.487 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:31:03.487 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 32, 2020-09-08T15:31:03.488 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 32, 2020-09-08T15:31:03.488 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:31:03.488 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.488 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:31:03.489 INFO:tasks.workunit.client.0.smithi065.stdout: "purged_snaps": [ 2020-09-08T15:31:03.489 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:31:03.489 INFO:tasks.workunit.client.0.smithi065.stdout: "pool": 1, 2020-09-08T15:31:03.489 INFO:tasks.workunit.client.0.smithi065.stdout: "purged_snaps": {} 2020-09-08T15:31:03.491 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.491 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:31:03.491 INFO:tasks.workunit.client.0.smithi065.stdout: "servicemap": { 2020-09-08T15:31:03.491 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 6, 2020-09-08T15:31:03.492 INFO:tasks.workunit.client.0.smithi065.stdout: "modified": "2020-09-08T15:30:48.874354+0000", 2020-09-08T15:31:03.492 INFO:tasks.workunit.client.0.smithi065.stdout: "services": {} 2020-09-08T15:31:03.492 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:31:03.493 INFO:tasks.workunit.client.0.smithi065.stdout: "paxos": { 2020-09-08T15:31:03.493 INFO:tasks.workunit.client.0.smithi065.stdout: "first_committed": 1, 2020-09-08T15:31:03.493 INFO:tasks.workunit.client.0.smithi065.stdout: "last_committed": 464, 2020-09-08T15:31:03.493 INFO:tasks.workunit.client.0.smithi065.stdout: "last_pn": 0, 2020-09-08T15:31:03.494 INFO:tasks.workunit.client.0.smithi065.stdout: "accepted_pn": 0 2020-09-08T15:31:03.494 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:31:03.494 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:31:03.496 INFO:tasks.workunit.client.0.smithi065.stderr:report 2905446964 2020-09-08T15:31:03.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1604: wait_for_clean: return 1 2020-09-08T15:31:03.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:746: TEST_divergent_3: echo 'delay recovery' 2020-09-08T15:31:03.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: ceph pg dump pgs 2020-09-08T15:31:03.497 INFO:tasks.workunit.client.0.smithi065.stdout:delay recovery 2020-09-08T15:31:03.529 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:31:03.529 INFO:tasks.workunit.client.0.smithi065.stdout:1.1f 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.351776+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.529 INFO:tasks.workunit.client.0.smithi065.stdout:1.1e 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349637+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.530 INFO:tasks.workunit.client.0.smithi065.stdout:1.1d 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.350525+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.530 INFO:tasks.workunit.client.0.smithi065.stdout:1.1c 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349938+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.530 INFO:tasks.workunit.client.0.smithi065.stdout:1.1b 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349689+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.530 INFO:tasks.workunit.client.0.smithi065.stdout:1.1a 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.347514+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.530 INFO:tasks.workunit.client.0.smithi065.stdout:1.19 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.347498+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.531 INFO:tasks.workunit.client.0.smithi065.stdout:1.18 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.350002+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.531 INFO:tasks.workunit.client.0.smithi065.stdout:1.17 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349386+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.531 INFO:tasks.workunit.client.0.smithi065.stdout:1.16 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349169+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.531 INFO:tasks.workunit.client.0.smithi065.stdout:1.15 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348612+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.531 INFO:tasks.workunit.client.0.smithi065.stdout:1.14 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348072+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.532 INFO:tasks.workunit.client.0.smithi065.stdout:1.13 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349510+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.532 INFO:tasks.workunit.client.0.smithi065.stdout:1.12 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348603+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.535 INFO:tasks.workunit.client.0.smithi065.stdout:1.11 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348630+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.535 INFO:tasks.workunit.client.0.smithi065.stdout:1.10 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349388+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.536 INFO:tasks.workunit.client.0.smithi065.stdout:1.5 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348609+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.536 INFO:tasks.workunit.client.0.smithi065.stdout:1.4 4 0 4 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349019+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.537 INFO:tasks.workunit.client.0.smithi065.stdout:1.3 4 0 4 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.347539+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.537 INFO:tasks.workunit.client.0.smithi065.stdout:1.2 4 0 4 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348074+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.537 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.350123+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.538 INFO:tasks.workunit.client.0.smithi065.stdout:1.1 4 0 4 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.350162+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.538 INFO:tasks.workunit.client.0.smithi065.stdout:1.6 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.351122+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.539 INFO:tasks.workunit.client.0.smithi065.stdout:1.7 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.296851+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.539 INFO:tasks.workunit.client.0.smithi065.stdout:1.8 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.296899+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.539 INFO:tasks.workunit.client.0.smithi065.stdout:1.9 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.347612+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.540 INFO:tasks.workunit.client.0.smithi065.stdout:1.a 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.350831+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.540 INFO:tasks.workunit.client.0.smithi065.stdout:1.b 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348076+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.540 INFO:tasks.workunit.client.0.smithi065.stdout:1.c 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.347497+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.541 INFO:tasks.workunit.client.0.smithi065.stdout:1.d 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348084+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.548 INFO:tasks.workunit.client.0.smithi065.stdout:1.e 3 0 3 0 0 1156 0 0 17 17 active+undersized+degraded 2020-09-08T15:29:49.348125+0000 45'101 45:123 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.548 INFO:tasks.workunit.client.0.smithi065.stdout:1.f 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349155+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:03.549 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:31:03.549 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:31:03.554 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:31:03.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:748: TEST_divergent_3: for i in $non_divergent 2020-09-08T15:31:03.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:750: TEST_divergent_3: get_asok_path osd.0 2020-09-08T15:31:03.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-09-08T15:31:03.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-09-08T15:31:03.560 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:31:03.560 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:31:03.560 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:31:03.562 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.0.asok 2020-09-08T15:31:03.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:750: TEST_divergent_3: CEPH_ARGS= 2020-09-08T15:31:03.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:750: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.0.asok set_recovery_delay 100000 2020-09-08T15:31:03.637 INFO:tasks.workunit.client.0.smithi065.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2020-09-08T15:31:03.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:748: TEST_divergent_3: for i in $non_divergent 2020-09-08T15:31:03.653 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:750: TEST_divergent_3: get_asok_path osd.2 2020-09-08T15:31:03.653 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-09-08T15:31:03.653 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-09-08T15:31:03.654 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:31:03.654 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:31:03.654 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:31:03.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.2.asok 2020-09-08T15:31:03.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:750: TEST_divergent_3: CEPH_ARGS= 2020-09-08T15:31:03.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:750: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.2.asok set_recovery_delay 100000 2020-09-08T15:31:03.742 INFO:tasks.workunit.client.0.smithi065.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2020-09-08T15:31:03.750 INFO:tasks.workunit.client.0.smithi065.stdout:revive divergent 1 2020-09-08T15:31:03.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:754: TEST_divergent_3: echo 'revive divergent 1' 2020-09-08T15:31:03.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: ceph pg dump pgs 2020-09-08T15:31:04.123 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:31:04.124 INFO:tasks.workunit.client.0.smithi065.stdout:1.1f 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.351776+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.124 INFO:tasks.workunit.client.0.smithi065.stdout:1.1e 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349637+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.124 INFO:tasks.workunit.client.0.smithi065.stdout:1.1d 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.350525+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.124 INFO:tasks.workunit.client.0.smithi065.stdout:1.1c 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349938+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.124 INFO:tasks.workunit.client.0.smithi065.stdout:1.1b 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349689+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.125 INFO:tasks.workunit.client.0.smithi065.stdout:1.1a 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.347514+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.125 INFO:tasks.workunit.client.0.smithi065.stdout:1.19 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.347498+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.125 INFO:tasks.workunit.client.0.smithi065.stdout:1.18 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.350002+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.125 INFO:tasks.workunit.client.0.smithi065.stdout:1.17 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349386+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.126 INFO:tasks.workunit.client.0.smithi065.stdout:1.16 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349169+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.126 INFO:tasks.workunit.client.0.smithi065.stdout:1.15 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348612+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.126 INFO:tasks.workunit.client.0.smithi065.stdout:1.14 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348072+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.126 INFO:tasks.workunit.client.0.smithi065.stdout:1.13 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349510+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.126 INFO:tasks.workunit.client.0.smithi065.stdout:1.12 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348603+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.127 INFO:tasks.workunit.client.0.smithi065.stdout:1.11 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348630+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.127 INFO:tasks.workunit.client.0.smithi065.stdout:1.10 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349388+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.127 INFO:tasks.workunit.client.0.smithi065.stdout:1.5 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348609+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.127 INFO:tasks.workunit.client.0.smithi065.stdout:1.4 4 0 4 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349019+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.127 INFO:tasks.workunit.client.0.smithi065.stdout:1.3 4 0 4 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.347539+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.128 INFO:tasks.workunit.client.0.smithi065.stdout:1.2 4 0 4 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348074+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.128 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.350123+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.128 INFO:tasks.workunit.client.0.smithi065.stdout:1.1 4 0 4 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.350162+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.128 INFO:tasks.workunit.client.0.smithi065.stdout:1.6 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.351122+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.128 INFO:tasks.workunit.client.0.smithi065.stdout:1.7 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.296851+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.129 INFO:tasks.workunit.client.0.smithi065.stdout:1.8 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.296899+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.129 INFO:tasks.workunit.client.0.smithi065.stdout:1.9 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.347612+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.129 INFO:tasks.workunit.client.0.smithi065.stdout:1.a 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.350831+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.129 INFO:tasks.workunit.client.0.smithi065.stdout:1.b 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348076+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.129 INFO:tasks.workunit.client.0.smithi065.stdout:1.c 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.347497+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.131 INFO:tasks.workunit.client.0.smithi065.stdout:1.d 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348084+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.131 INFO:tasks.workunit.client.0.smithi065.stdout:1.e 3 0 3 0 0 1156 0 0 17 17 active+undersized+degraded 2020-09-08T15:29:49.348125+0000 45'101 45:123 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.131 INFO:tasks.workunit.client.0.smithi065.stdout:1.f 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349155+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:04.131 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:31:04.132 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:31:04.132 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:31:04.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:756: TEST_divergent_3: ceph osd set noup 2020-09-08T15:31:04.888 INFO:tasks.workunit.client.0.smithi065.stderr:noup is set 2020-09-08T15:31:04.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:757: TEST_divergent_3: activate_osd td/divergent-priors 1 2020-09-08T15:31:04.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/divergent-priors 2020-09-08T15:31:04.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:31:04.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=1 2020-09-08T15:31:04.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:31:04.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/divergent-priors/1 2020-09-08T15:31:04.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:31:04.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:31:04.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:31:04.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:31:04.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2020-09-08T15:31:04.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2020-09-08T15:31:04.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:31:04.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:31:04.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:31:04.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:31:04.915 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:31:04.915 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:31:04.915 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:31:04.915 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:31:04.916 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:31:04.916 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:31:04.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:31:04.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:31:04.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:31:04.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:31:04.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:31:04.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:31:04.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:31:04.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:31:04.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:31:04.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/divergent-priors/1 2020-09-08T15:31:04.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.1 2020-09-08T15:31:04.919 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:31:04.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 1 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:31:04.920 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/divergent-priors/1/whoami 2020-09-08T15:31:04.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 1 = 1 ']' 2020-09-08T15:31:04.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:31:04.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:31:04.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:31:04.933 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:31:04.933+0000 7f56c91deec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:31:04.943 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:31:04.940+0000 7f56c91deec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:31:04.943 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:31:04.941+0000 7f56c91deec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:31:05.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:877: activate_osd: return 0 2020-09-08T15:31:05.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:758: TEST_divergent_3: sleep 5 2020-09-08T15:31:05.456 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:31:05.460+0000 7f56c91deec0 -1 Falling back to public interface 2020-09-08T15:31:07.422 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:31:07.423+0000 7f56c91deec0 -1 osd.1 34 log_to_monitors {default=true} 2020-09-08T15:31:10.303 INFO:tasks.workunit.client.0.smithi065.stdout:delay recovery divergent 2020-09-08T15:31:10.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:760: TEST_divergent_3: echo 'delay recovery divergent' 2020-09-08T15:31:10.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:761: TEST_divergent_3: ceph pg dump pgs 2020-09-08T15:31:10.694 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:31:10.695 INFO:tasks.workunit.client.0.smithi065.stdout:1.1f 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.351776+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.695 INFO:tasks.workunit.client.0.smithi065.stdout:1.1e 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349637+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.695 INFO:tasks.workunit.client.0.smithi065.stdout:1.1d 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.350525+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.695 INFO:tasks.workunit.client.0.smithi065.stdout:1.1c 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349938+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.696 INFO:tasks.workunit.client.0.smithi065.stdout:1.1b 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349689+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.696 INFO:tasks.workunit.client.0.smithi065.stdout:1.1a 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.347514+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.696 INFO:tasks.workunit.client.0.smithi065.stdout:1.19 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.347498+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.696 INFO:tasks.workunit.client.0.smithi065.stdout:1.18 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.350002+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.696 INFO:tasks.workunit.client.0.smithi065.stdout:1.17 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349386+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.697 INFO:tasks.workunit.client.0.smithi065.stdout:1.16 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349169+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.697 INFO:tasks.workunit.client.0.smithi065.stdout:1.15 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348612+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.697 INFO:tasks.workunit.client.0.smithi065.stdout:1.14 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348072+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.697 INFO:tasks.workunit.client.0.smithi065.stdout:1.13 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349510+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.697 INFO:tasks.workunit.client.0.smithi065.stdout:1.12 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348603+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.698 INFO:tasks.workunit.client.0.smithi065.stdout:1.11 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348630+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.698 INFO:tasks.workunit.client.0.smithi065.stdout:1.10 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349388+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.698 INFO:tasks.workunit.client.0.smithi065.stdout:1.5 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348609+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.698 INFO:tasks.workunit.client.0.smithi065.stdout:1.4 4 0 4 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349019+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.698 INFO:tasks.workunit.client.0.smithi065.stdout:1.3 4 0 4 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.347539+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.699 INFO:tasks.workunit.client.0.smithi065.stdout:1.2 4 0 4 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348074+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.699 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.350123+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.699 INFO:tasks.workunit.client.0.smithi065.stdout:1.1 4 0 4 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.350162+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.699 INFO:tasks.workunit.client.0.smithi065.stdout:1.6 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.351122+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.699 INFO:tasks.workunit.client.0.smithi065.stdout:1.7 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.296851+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.700 INFO:tasks.workunit.client.0.smithi065.stdout:1.8 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.296899+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.700 INFO:tasks.workunit.client.0.smithi065.stdout:1.9 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.347612+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.700 INFO:tasks.workunit.client.0.smithi065.stdout:1.a 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.350831+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.700 INFO:tasks.workunit.client.0.smithi065.stdout:1.b 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348076+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.700 INFO:tasks.workunit.client.0.smithi065.stdout:1.c 3 0 3 0 0 1510 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.347497+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.701 INFO:tasks.workunit.client.0.smithi065.stdout:1.d 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.348084+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.701 INFO:tasks.workunit.client.0.smithi065.stdout:1.e 3 0 3 0 0 1156 0 0 17 17 active+undersized+degraded 2020-09-08T15:29:49.348125+0000 45'101 45:123 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.701 INFO:tasks.workunit.client.0.smithi065.stdout:1.f 3 0 3 0 0 1509 0 0 16 16 active+undersized+degraded 2020-09-08T15:29:49.349155+0000 31'100 45:122 [0,2] 0 [0,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:10.701 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:31:10.701 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:31:10.718 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:31:10.719 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:762: TEST_divergent_3: get_asok_path osd.1 2020-09-08T15:31:10.720 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-09-08T15:31:10.720 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-09-08T15:31:10.721 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:31:10.721 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:31:10.721 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:31:10.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.1.asok 2020-09-08T15:31:10.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:762: TEST_divergent_3: CEPH_ARGS= 2020-09-08T15:31:10.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:762: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.1.asok set_recovery_delay 100000 2020-09-08T15:31:10.800 INFO:tasks.workunit.client.0.smithi065.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2020-09-08T15:31:10.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:764: TEST_divergent_3: ceph osd unset noup 2020-09-08T15:31:11.482 INFO:tasks.workunit.client.0.smithi065.stderr:noup is unset 2020-09-08T15:31:11.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:766: TEST_divergent_3: wait_for_osd up 0 2020-09-08T15:31:11.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:31:11.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:31:11.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:31:11.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:31:11.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:31:11.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:31:11.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:31:11.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:31:11.492 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:31:12.037 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 40 up_thru 44 down_at 35 last_clean_interval [5,31) [v2:127.0.0.1:6802/58997,v1:127.0.0.1:6803/58997] [v2:127.0.0.1:6804/58997,v1:127.0.0.1:6805/58997] exists,up 017c780f-0863-4f60-9e7f-475ba27124f2 2020-09-08T15:31:12.037 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:31:12.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:31:12.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:31:12.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:31:12.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: wait_for_osd up 1 2020-09-08T15:31:12.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:31:12.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:31:12.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:31:12.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:31:12.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:31:12.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:31:12.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:31:12.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:31:12.463 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 49 up_thru 49 down_at 36 last_clean_interval [10,34) [v2:127.0.0.1:6818/61940,v1:127.0.0.1:6819/61940] [v2:127.0.0.1:6820/61940,v1:127.0.0.1:6821/61940] exists,up caaf9207-8d21-4a1e-ae34-2becc94a4d1f 2020-09-08T15:31:12.464 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:31:12.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:31:12.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:31:12.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:31:12.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:768: TEST_divergent_3: wait_for_osd up 2 2020-09-08T15:31:12.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:31:12.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:31:12.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:31:12.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:31:12.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:31:12.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:31:12.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:31:12.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:31:12.852 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 41 up_thru 0 down_at 37 last_clean_interval [15,31) [v2:127.0.0.1:6810/59396,v1:127.0.0.1:6811/59396] [v2:127.0.0.1:6812/59396,v1:127.0.0.1:6813/59396] exists,up 559be8ed-3798-4af1-85bb-af8664f6f09f 2020-09-08T15:31:12.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:31:12.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:31:12.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:31:12.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:770: TEST_divergent_3: ceph pg dump pgs 2020-09-08T15:31:13.281 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:31:13.281 INFO:tasks.workunit.client.0.smithi065.stdout:1.1f 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.345503+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.281 INFO:tasks.workunit.client.0.smithi065.stdout:1.1e 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.345916+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.282 INFO:tasks.workunit.client.0.smithi065.stdout:1.1d 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.346438+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.282 INFO:tasks.workunit.client.0.smithi065.stdout:1.1c 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.344421+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.282 INFO:tasks.workunit.client.0.smithi065.stdout:1.1b 3 1 1 0 0 1509 0 0 10 10 active+recovery_wait+degraded+wait 2020-09-08T15:31:12.344361+0000 31'100 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.282 INFO:tasks.workunit.client.0.smithi065.stdout:1.1a 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.269490+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.283 INFO:tasks.workunit.client.0.smithi065.stdout:1.19 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.269467+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.283 INFO:tasks.workunit.client.0.smithi065.stdout:1.18 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.346194+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.283 INFO:tasks.workunit.client.0.smithi065.stdout:1.17 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.344173+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.283 INFO:tasks.workunit.client.0.smithi065.stdout:1.16 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.344141+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.283 INFO:tasks.workunit.client.0.smithi065.stdout:1.15 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.343918+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.284 INFO:tasks.workunit.client.0.smithi065.stdout:1.14 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.343437+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.284 INFO:tasks.workunit.client.0.smithi065.stdout:1.13 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.345950+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.284 INFO:tasks.workunit.client.0.smithi065.stdout:1.12 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.343803+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.284 INFO:tasks.workunit.client.0.smithi065.stdout:1.11 3 1 1 0 0 1509 0 0 16 16 active+recovery_wait+degraded+wait 2020-09-08T15:31:12.343829+0000 31'100 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.285 INFO:tasks.workunit.client.0.smithi065.stdout:1.10 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.344301+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.285 INFO:tasks.workunit.client.0.smithi065.stdout:1.5 3 0 0 0 0 1510 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.343803+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.285 INFO:tasks.workunit.client.0.smithi065.stdout:1.4 4 0 0 0 0 1510 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.341583+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.285 INFO:tasks.workunit.client.0.smithi065.stdout:1.3 4 0 0 0 0 1510 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.343297+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.285 INFO:tasks.workunit.client.0.smithi065.stdout:1.2 4 0 0 0 0 1510 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.341912+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.286 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.346812+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.286 INFO:tasks.workunit.client.0.smithi065.stdout:1.1 4 0 0 0 0 1510 0 0 15 15 active+clean+wait 2020-09-08T15:31:12.344653+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.286 INFO:tasks.workunit.client.0.smithi065.stdout:1.6 3 0 0 0 0 1510 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.345160+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.286 INFO:tasks.workunit.client.0.smithi065.stdout:1.7 3 0 0 0 0 1510 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.269223+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.287 INFO:tasks.workunit.client.0.smithi065.stdout:1.8 3 0 0 0 0 1510 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.339714+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.287 INFO:tasks.workunit.client.0.smithi065.stdout:1.9 3 1 1 0 0 1510 0 0 11 11 active+recovering+degraded+wait 2020-09-08T15:31:12.347576+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.287 INFO:tasks.workunit.client.0.smithi065.stdout:1.a 3 0 0 0 0 1510 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.347255+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.287 INFO:tasks.workunit.client.0.smithi065.stdout:1.b 3 0 0 0 0 1510 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.339763+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.287 INFO:tasks.workunit.client.0.smithi065.stdout:1.c 3 0 0 0 0 1510 0 0 14 14 active+clean+wait 2020-09-08T15:31:12.341674+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.288 INFO:tasks.workunit.client.0.smithi065.stdout:1.d 3 0 0 0 0 1509 0 0 12 12 active+clean+wait 2020-09-08T15:31:12.343546+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.288 INFO:tasks.workunit.client.0.smithi065.stdout:1.e 3 1 1 0 0 1156 0 0 14 14 active+recovery_wait+degraded+wait 2020-09-08T15:31:12.341253+0000 45'101 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.288 INFO:tasks.workunit.client.0.smithi065.stdout:1.f 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.344080+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.288 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:31:13.288 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:31:13.289 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:31:13.290 INFO:tasks.workunit.client.0.smithi065.stdout:wait for peering 2020-09-08T15:31:13.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:771: TEST_divergent_3: echo 'wait for peering' 2020-09-08T15:31:13.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:772: TEST_divergent_3: ceph pg dump pgs 2020-09-08T15:31:13.670 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:31:13.671 INFO:tasks.workunit.client.0.smithi065.stdout:1.1f 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.345503+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.671 INFO:tasks.workunit.client.0.smithi065.stdout:1.1e 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.345916+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.671 INFO:tasks.workunit.client.0.smithi065.stdout:1.1d 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.346438+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.671 INFO:tasks.workunit.client.0.smithi065.stdout:1.1c 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.344421+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.672 INFO:tasks.workunit.client.0.smithi065.stdout:1.1b 3 1 1 0 0 1509 0 0 10 10 active+recovery_wait+degraded+wait 2020-09-08T15:31:12.344361+0000 31'100 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.672 INFO:tasks.workunit.client.0.smithi065.stdout:1.1a 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.269490+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.672 INFO:tasks.workunit.client.0.smithi065.stdout:1.19 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.269467+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.672 INFO:tasks.workunit.client.0.smithi065.stdout:1.18 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.346194+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.672 INFO:tasks.workunit.client.0.smithi065.stdout:1.17 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.344173+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.673 INFO:tasks.workunit.client.0.smithi065.stdout:1.16 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.344141+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.673 INFO:tasks.workunit.client.0.smithi065.stdout:1.15 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.343918+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.673 INFO:tasks.workunit.client.0.smithi065.stdout:1.14 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.343437+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.673 INFO:tasks.workunit.client.0.smithi065.stdout:1.13 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.345950+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.674 INFO:tasks.workunit.client.0.smithi065.stdout:1.12 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.343803+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.674 INFO:tasks.workunit.client.0.smithi065.stdout:1.11 3 1 1 0 0 1509 0 0 16 16 active+recovery_wait+degraded+wait 2020-09-08T15:31:12.343829+0000 31'100 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.674 INFO:tasks.workunit.client.0.smithi065.stdout:1.10 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.344301+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.674 INFO:tasks.workunit.client.0.smithi065.stdout:1.5 3 0 0 0 0 1510 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.343803+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.675 INFO:tasks.workunit.client.0.smithi065.stdout:1.4 4 0 0 0 0 1510 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.341583+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.675 INFO:tasks.workunit.client.0.smithi065.stdout:1.3 4 0 0 0 0 1510 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.343297+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.675 INFO:tasks.workunit.client.0.smithi065.stdout:1.2 4 0 0 0 0 1510 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.341912+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.675 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.346812+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.675 INFO:tasks.workunit.client.0.smithi065.stdout:1.1 4 0 0 0 0 1510 0 0 15 15 active+clean+wait 2020-09-08T15:31:12.344653+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.676 INFO:tasks.workunit.client.0.smithi065.stdout:1.6 3 0 0 0 0 1510 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.345160+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.676 INFO:tasks.workunit.client.0.smithi065.stdout:1.7 3 0 0 0 0 1510 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.269223+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.676 INFO:tasks.workunit.client.0.smithi065.stdout:1.8 3 0 0 0 0 1510 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.339714+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.676 INFO:tasks.workunit.client.0.smithi065.stdout:1.9 3 1 1 0 0 1510 0 0 11 11 active+recovering+degraded+wait 2020-09-08T15:31:12.347576+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.676 INFO:tasks.workunit.client.0.smithi065.stdout:1.a 3 0 0 0 0 1510 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.347255+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.677 INFO:tasks.workunit.client.0.smithi065.stdout:1.b 3 0 0 0 0 1510 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.339763+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.677 INFO:tasks.workunit.client.0.smithi065.stdout:1.c 3 0 0 0 0 1510 0 0 14 14 active+clean+wait 2020-09-08T15:31:12.341674+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.677 INFO:tasks.workunit.client.0.smithi065.stdout:1.d 3 0 0 0 0 1509 0 0 12 12 active+clean+wait 2020-09-08T15:31:12.343546+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.677 INFO:tasks.workunit.client.0.smithi065.stdout:1.e 3 1 1 0 0 1156 0 0 14 14 active+recovery_wait+degraded+wait 2020-09-08T15:31:12.341253+0000 45'101 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.677 INFO:tasks.workunit.client.0.smithi065.stdout:1.f 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.344080+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:13.678 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:31:13.678 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:31:13.678 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:31:13.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:773: TEST_divergent_3: rados -p test put foo /etc/fstab 2020-09-08T15:31:25.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:777: TEST_divergent_3: echo 'killing divergent 1' 2020-09-08T15:31:25.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:778: TEST_divergent_3: ceph pg dump pgs 2020-09-08T15:31:25.492 INFO:tasks.workunit.client.0.smithi065.stdout:killing divergent 1 2020-09-08T15:31:25.879 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:31:25.879 INFO:tasks.workunit.client.0.smithi065.stdout:1.1f 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.345503+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.880 INFO:tasks.workunit.client.0.smithi065.stdout:1.1e 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.345916+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.880 INFO:tasks.workunit.client.0.smithi065.stdout:1.1d 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.346438+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.880 INFO:tasks.workunit.client.0.smithi065.stdout:1.1c 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.344421+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.880 INFO:tasks.workunit.client.0.smithi065.stdout:1.1b 3 1 1 0 0 1509 0 0 10 10 active+recovery_wait+degraded+wait 2020-09-08T15:31:12.344361+0000 31'100 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.880 INFO:tasks.workunit.client.0.smithi065.stdout:1.1a 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.269490+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.881 INFO:tasks.workunit.client.0.smithi065.stdout:1.19 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.269467+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.881 INFO:tasks.workunit.client.0.smithi065.stdout:1.18 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.346194+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.881 INFO:tasks.workunit.client.0.smithi065.stdout:1.17 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.344173+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.881 INFO:tasks.workunit.client.0.smithi065.stdout:1.16 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.344141+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.882 INFO:tasks.workunit.client.0.smithi065.stdout:1.15 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.343918+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.882 INFO:tasks.workunit.client.0.smithi065.stdout:1.14 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.343437+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.882 INFO:tasks.workunit.client.0.smithi065.stdout:1.13 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.345950+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.882 INFO:tasks.workunit.client.0.smithi065.stdout:1.12 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.343803+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.882 INFO:tasks.workunit.client.0.smithi065.stdout:1.11 3 1 1 0 0 1509 0 0 16 16 active+recovery_wait+degraded+wait 2020-09-08T15:31:12.343829+0000 31'100 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.883 INFO:tasks.workunit.client.0.smithi065.stdout:1.10 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.344301+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.883 INFO:tasks.workunit.client.0.smithi065.stdout:1.5 3 0 0 0 0 1510 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.343803+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.883 INFO:tasks.workunit.client.0.smithi065.stdout:1.4 4 0 0 0 0 1510 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.341583+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.883 INFO:tasks.workunit.client.0.smithi065.stdout:1.3 4 0 0 0 0 1510 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.343297+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.883 INFO:tasks.workunit.client.0.smithi065.stdout:1.2 4 0 0 0 0 1510 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.341912+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.884 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.346812+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.884 INFO:tasks.workunit.client.0.smithi065.stdout:1.1 4 0 0 0 0 1510 0 0 15 15 active+clean+wait 2020-09-08T15:31:12.344653+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.884 INFO:tasks.workunit.client.0.smithi065.stdout:1.6 3 0 0 0 0 1510 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.345160+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.884 INFO:tasks.workunit.client.0.smithi065.stdout:1.7 3 0 0 0 0 1510 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.269223+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.884 INFO:tasks.workunit.client.0.smithi065.stdout:1.8 3 0 0 0 0 1510 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.339714+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.885 INFO:tasks.workunit.client.0.smithi065.stdout:1.9 3 1 1 0 0 1510 0 0 11 11 active+recovering+degraded+wait 2020-09-08T15:31:12.347576+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.886 INFO:tasks.workunit.client.0.smithi065.stdout:1.a 3 0 0 0 0 1510 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.347255+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.887 INFO:tasks.workunit.client.0.smithi065.stdout:1.b 3 0 0 0 0 1510 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.339763+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.887 INFO:tasks.workunit.client.0.smithi065.stdout:1.c 3 0 0 0 0 1510 0 0 14 14 active+clean+wait 2020-09-08T15:31:12.341674+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.887 INFO:tasks.workunit.client.0.smithi065.stdout:1.d 3 0 0 0 0 1509 0 0 12 12 active+clean+wait 2020-09-08T15:31:12.343546+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.887 INFO:tasks.workunit.client.0.smithi065.stdout:1.e 3 1 1 0 0 1156 0 0 14 14 active+recovery_wait+degraded+wait 2020-09-08T15:31:12.341253+0000 45'101 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.888 INFO:tasks.workunit.client.0.smithi065.stdout:1.f 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.344080+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:25.888 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:31:25.888 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:31:25.888 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:31:25.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd.1 2020-09-08T15:31:25.890 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:31:25.890 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:31:25.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:31:25.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:31:25.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:31:25.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:31:25.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:782: TEST_divergent_3: expfile=td/divergent-priors/exp.30667.out 2020-09-08T15:31:26.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:783: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.30667.out 2020-09-08T15:31:26.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local dir=td/divergent-priors 2020-09-08T15:31:26.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2020-09-08T15:31:26.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local id=1 2020-09-08T15:31:26.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1198: _objectstore_tool_nodown: shift 2020-09-08T15:31:26.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2020-09-08T15:31:26.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1202: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.30667.out 2020-09-08T15:31:26.909 INFO:tasks.workunit.client.0.smithi065.stderr:Exporting 1.0 info 1.0( v 31'100 (31'90,31'100] local-lis/les=49/50 n=3 ec=23/23 lis/c=49/49 les/c/f=50/50/0 sis=49 pruub=13.005874069s) 2020-09-08T15:31:26.918 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:023dd3d2:::existing_12:head# 2020-09-08T15:31:26.930 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:04c40a0c:::existing_93:head# 2020-09-08T15:31:26.931 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:064ff5fb:::existing_36:head# 2020-09-08T15:31:26.935 INFO:tasks.workunit.client.0.smithi065.stderr:Export successful 2020-09-08T15:31:26.936 INFO:tasks.workunit.client.0.smithi065.stdout: marking collection for removal 2020-09-08T15:31:26.936 INFO:tasks.workunit.client.0.smithi065.stdout:setting '_remove' omap key 2020-09-08T15:31:26.936 INFO:tasks.workunit.client.0.smithi065.stdout:finish_remove_pgs 1.0_head removing 1.0 2020-09-08T15:31:27.108 INFO:tasks.workunit.client.0.smithi065.stderr:Remove successful 2020-09-08T15:31:27.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:784: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.30667.out 2020-09-08T15:31:27.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local dir=td/divergent-priors 2020-09-08T15:31:27.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2020-09-08T15:31:27.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local id=1 2020-09-08T15:31:27.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1198: _objectstore_tool_nodown: shift 2020-09-08T15:31:27.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2020-09-08T15:31:27.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1202: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.30667.out 2020-09-08T15:31:28.096 INFO:tasks.workunit.client.0.smithi065.stdout:get_pg_num_history pg_num_history pg_num_history(e50 pg_nums {1={23=1,33=32}} deleted_pools ) 2020-09-08T15:31:28.097 INFO:tasks.workunit.client.0.smithi065.stdout:Importing pgid 1.0 2020-09-08T15:31:28.097 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:023dd3d2:::existing_12:head# 2020-09-08T15:31:28.097 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:31:28.160 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:04c40a0c:::existing_93:head# 2020-09-08T15:31:28.160 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:31:28.194 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:064ff5fb:::existing_36:head# 2020-09-08T15:31:28.194 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:31:28.260 INFO:tasks.workunit.client.0.smithi065.stdout:write_pg epoch 50 info 1.0( v 31'100 (31'90,31'100] local-lis/les=49/50 n=3 ec=23/23 lis/c=49/49 les/c/f=50/50/0 sis=49 pruub=13.005874069s) 2020-09-08T15:31:28.307 INFO:tasks.workunit.client.0.smithi065.stdout:Import successful 2020-09-08T15:31:28.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:786: TEST_divergent_3: echo 'reviving divergent 1' 2020-09-08T15:31:28.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:787: TEST_divergent_3: ceph pg dump pgs 2020-09-08T15:31:28.811 INFO:tasks.workunit.client.0.smithi065.stdout:reviving divergent 1 2020-09-08T15:31:29.206 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:31:29.206 INFO:tasks.workunit.client.0.smithi065.stdout:1.1f 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.345503+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.206 INFO:tasks.workunit.client.0.smithi065.stdout:1.1e 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.345916+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.207 INFO:tasks.workunit.client.0.smithi065.stdout:1.1d 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.346438+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.207 INFO:tasks.workunit.client.0.smithi065.stdout:1.1c 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.344421+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.207 INFO:tasks.workunit.client.0.smithi065.stdout:1.1b 3 1 1 0 0 1509 0 0 10 10 active+recovery_wait+degraded+wait 2020-09-08T15:31:12.344361+0000 31'100 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.207 INFO:tasks.workunit.client.0.smithi065.stdout:1.1a 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.269490+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.208 INFO:tasks.workunit.client.0.smithi065.stdout:1.19 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.269467+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.208 INFO:tasks.workunit.client.0.smithi065.stdout:1.18 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.346194+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.208 INFO:tasks.workunit.client.0.smithi065.stdout:1.17 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.344173+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.208 INFO:tasks.workunit.client.0.smithi065.stdout:1.16 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.344141+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.208 INFO:tasks.workunit.client.0.smithi065.stdout:1.15 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.343918+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.209 INFO:tasks.workunit.client.0.smithi065.stdout:1.14 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.343437+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.209 INFO:tasks.workunit.client.0.smithi065.stdout:1.13 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.345950+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.209 INFO:tasks.workunit.client.0.smithi065.stdout:1.12 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.343803+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.209 INFO:tasks.workunit.client.0.smithi065.stdout:1.11 3 1 1 0 0 1509 0 0 16 16 active+recovery_wait+degraded+wait 2020-09-08T15:31:12.343829+0000 31'100 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.212 INFO:tasks.workunit.client.0.smithi065.stdout:1.10 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.344301+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.212 INFO:tasks.workunit.client.0.smithi065.stdout:1.5 3 0 0 0 0 1510 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.343803+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.212 INFO:tasks.workunit.client.0.smithi065.stdout:1.4 4 0 0 0 0 1510 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.341583+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.213 INFO:tasks.workunit.client.0.smithi065.stdout:1.3 4 0 0 0 0 1510 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.343297+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.213 INFO:tasks.workunit.client.0.smithi065.stdout:1.2 4 0 0 0 0 1510 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.341912+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.213 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 3 0 0 0 0 1509 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.346812+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.213 INFO:tasks.workunit.client.0.smithi065.stdout:1.1 4 0 0 0 0 1510 0 0 15 15 active+clean+wait 2020-09-08T15:31:12.344653+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.214 INFO:tasks.workunit.client.0.smithi065.stdout:1.6 3 0 0 0 0 1510 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.345160+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.214 INFO:tasks.workunit.client.0.smithi065.stdout:1.7 3 0 0 0 0 1510 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.269223+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.214 INFO:tasks.workunit.client.0.smithi065.stdout:1.8 3 0 0 0 0 1510 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.339714+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.214 INFO:tasks.workunit.client.0.smithi065.stdout:1.9 3 1 1 0 0 1510 0 0 11 11 active+recovering+degraded+wait 2020-09-08T15:31:12.347576+0000 31'100 50:133 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.214 INFO:tasks.workunit.client.0.smithi065.stdout:1.a 3 0 0 0 0 1510 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.347255+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.215 INFO:tasks.workunit.client.0.smithi065.stdout:1.b 3 0 0 0 0 1510 0 0 10 10 active+clean+wait 2020-09-08T15:31:12.339763+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.215 INFO:tasks.workunit.client.0.smithi065.stdout:1.c 3 0 0 0 0 1510 0 0 14 14 active+clean+wait 2020-09-08T15:31:12.341674+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.215 INFO:tasks.workunit.client.0.smithi065.stdout:1.d 3 0 0 0 0 1509 0 0 12 12 active+clean+wait 2020-09-08T15:31:12.343546+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.215 INFO:tasks.workunit.client.0.smithi065.stdout:1.e 3 1 1 0 0 1156 0 0 14 14 active+recovery_wait+degraded+wait 2020-09-08T15:31:12.341253+0000 45'101 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.215 INFO:tasks.workunit.client.0.smithi065.stdout:1.f 3 0 0 0 0 1509 0 0 16 16 active+clean+wait 2020-09-08T15:31:12.344080+0000 31'100 50:134 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:29.216 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:31:29.216 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:31:29.216 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:31:29.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:788: TEST_divergent_3: activate_osd td/divergent-priors 1 2020-09-08T15:31:29.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/divergent-priors 2020-09-08T15:31:29.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:31:29.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=1 2020-09-08T15:31:29.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:31:29.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/divergent-priors/1 2020-09-08T15:31:29.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:31:29.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:31:29.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:31:29.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:31:29.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2020-09-08T15:31:29.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2020-09-08T15:31:29.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:31:29.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:31:29.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:31:29.232 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:31:29.232 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:31:29.232 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:31:29.232 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:31:29.232 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:31:29.233 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:31:29.233 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:31:29.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:31:29.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:31:29.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:31:29.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:31:29.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:31:29.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:31:29.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:31:29.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:31:29.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:31:29.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/divergent-priors/1 2020-09-08T15:31:29.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.1 2020-09-08T15:31:29.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 1 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:31:29.237 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/divergent-priors/1/whoami 2020-09-08T15:31:29.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 1 = 1 ']' 2020-09-08T15:31:29.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:31:29.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:31:29.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:31:29.238 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:31:29.240 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:31:29.244+0000 7fbd1c14aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:31:29.253 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:31:29.257+0000 7fbd1c14aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:31:29.256 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:31:29.259+0000 7fbd1c14aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:31:29.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 1 2020-09-08T15:31:29.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:31:29.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:31:29.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:31:29.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:31:29.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:31:29.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:31:29.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:31:29.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:31:29.617 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:31:29.782 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:31:29.782+0000 7fbd1c14aec0 -1 Falling back to public interface 2020-09-08T15:31:30.023 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 49 up_thru 49 down_at 36 last_clean_interval [10,34) [v2:127.0.0.1:6818/61940,v1:127.0.0.1:6819/61940] [v2:127.0.0.1:6820/61940,v1:127.0.0.1:6821/61940] exists,up caaf9207-8d21-4a1e-ae34-2becc94a4d1f 2020-09-08T15:31:30.024 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:31:30.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:31:30.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:31:30.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:31:30.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:789: TEST_divergent_3: wait_for_osd up 1 2020-09-08T15:31:30.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:31:30.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:31:30.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:31:30.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:31:30.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:31:30.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:31:30.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:31:30.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:31:30.459 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 49 up_thru 49 down_at 36 last_clean_interval [10,34) [v2:127.0.0.1:6818/61940,v1:127.0.0.1:6819/61940] [v2:127.0.0.1:6820/61940,v1:127.0.0.1:6821/61940] exists,up caaf9207-8d21-4a1e-ae34-2becc94a4d1f 2020-09-08T15:31:30.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:31:30.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:31:30.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:31:30.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:791: TEST_divergent_3: sleep 20 2020-09-08T15:31:31.477 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:31:31.481+0000 7fbd1c14aec0 -1 osd.1 50 log_to_monitors {default=true} 2020-09-08T15:31:50.461 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:792: TEST_divergent_3: get_asok_path osd.1 2020-09-08T15:31:50.462 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-09-08T15:31:50.463 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-09-08T15:31:50.463 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:31:50.463 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:31:50.463 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:31:50.463 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.1.asok 2020-09-08T15:31:50.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:792: TEST_divergent_3: CEPH_ARGS= 2020-09-08T15:31:50.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:792: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.1.asok dump_ops_in_flight 2020-09-08T15:31:50.563 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:31:50.563 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [], 2020-09-08T15:31:50.563 INFO:tasks.workunit.client.0.smithi065.stdout: "num_ops": 0 2020-09-08T15:31:50.564 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:31:50.571 INFO:tasks.workunit.client.0.smithi065.stdout:allowing recovery 2020-09-08T15:31:50.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:794: TEST_divergent_3: echo 'allowing recovery' 2020-09-08T15:31:50.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:795: TEST_divergent_3: ceph pg dump pgs 2020-09-08T15:31:50.951 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:31:50.952 INFO:tasks.workunit.client.0.smithi065.stdout:1.1f 3 0 0 0 0 1509 0 0 16 16 active+clean 2020-09-08T15:31:46.095109+0000 31'100 59:155 [1,2,0] 1 [1,2,0] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.952 INFO:tasks.workunit.client.0.smithi065.stdout:1.1e 3 0 0 0 0 1449 0 0 16 16 active+clean 2020-09-08T15:31:46.326012+0000 31'100 59:143 [0,1,2] 0 [0,1,2] 0 31'100 2020-09-08T15:31:46.325963+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.952 INFO:tasks.workunit.client.0.smithi065.stdout:1.1d 3 0 0 0 0 1509 0 0 16 16 active+clean 2020-09-08T15:31:37.996684+0000 31'100 59:127 [2,0,1] 2 [2,0,1] 2 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.952 INFO:tasks.workunit.client.0.smithi065.stdout:1.1c 2 0 0 0 0 966 0 0 16 16 active+clean 2020-09-08T15:31:45.650070+0000 31'100 59:153 [1,0,2] 1 [1,0,2] 1 31'100 2020-09-08T15:31:45.650027+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.952 INFO:tasks.workunit.client.0.smithi065.stdout:1.1b 3 0 0 0 0 1509 0 0 10 10 active+clean 2020-09-08T15:31:46.094194+0000 31'100 59:159 [1,2,0] 1 [1,2,0] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.953 INFO:tasks.workunit.client.0.smithi065.stdout:1.1a 3 0 0 0 0 1509 0 0 16 16 active+clean 2020-09-08T15:31:43.969472+0000 31'100 59:140 [0,1,2] 0 [0,1,2] 0 31'100 2020-09-08T15:31:37.540735+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.953 INFO:tasks.workunit.client.0.smithi065.stdout:1.19 3 0 0 0 0 1509 0 0 16 16 active+clean 2020-09-08T15:31:37.995875+0000 31'100 59:127 [2,0,1] 2 [2,0,1] 2 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.953 INFO:tasks.workunit.client.0.smithi065.stdout:1.18 3 0 0 0 0 1509 0 0 10 10 active+clean 2020-09-08T15:31:33.053720+0000 31'100 58:151 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.953 INFO:tasks.workunit.client.0.smithi065.stdout:1.17 3 0 0 0 0 1509 0 0 16 16 active+clean 2020-09-08T15:31:46.094905+0000 31'100 59:155 [1,2,0] 1 [1,2,0] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.954 INFO:tasks.workunit.client.0.smithi065.stdout:1.16 3 0 0 0 0 1509 0 0 16 16 active+clean 2020-09-08T15:31:43.969276+0000 31'100 59:140 [0,1,2] 0 [0,1,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.954 INFO:tasks.workunit.client.0.smithi065.stdout:1.15 3 0 0 0 0 1449 0 0 16 16 active+clean 2020-09-08T15:31:40.333107+0000 31'100 59:130 [2,0,1] 2 [2,0,1] 2 31'100 2020-09-08T15:31:40.333050+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.954 INFO:tasks.workunit.client.0.smithi065.stdout:1.14 3 0 0 0 0 1509 0 0 10 10 active+clean 2020-09-08T15:31:33.051340+0000 31'100 58:151 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.954 INFO:tasks.workunit.client.0.smithi065.stdout:1.13 3 0 0 0 0 1509 0 0 10 10 active+clean 2020-09-08T15:31:46.093819+0000 31'100 59:157 [1,2,0] 1 [1,2,0] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.954 INFO:tasks.workunit.client.0.smithi065.stdout:1.12 1 0 0 0 0 483 0 0 16 16 active+clean 2020-09-08T15:31:45.398295+0000 31'100 59:143 [0,1,2] 0 [0,1,2] 0 31'100 2020-09-08T15:31:45.398245+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.955 INFO:tasks.workunit.client.0.smithi065.stdout:1.11 3 0 0 0 0 1509 0 0 16 16 active+clean 2020-09-08T15:31:37.995815+0000 31'100 59:127 [2,0,1] 2 [2,0,1] 2 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.955 INFO:tasks.workunit.client.0.smithi065.stdout:1.10 3 0 0 0 0 1509 0 0 10 10 active+clean 2020-09-08T15:31:33.050366+0000 31'100 58:151 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.955 INFO:tasks.workunit.client.0.smithi065.stdout:1.5 3 0 0 0 0 1510 0 0 16 16 active+clean 2020-09-08T15:31:37.996285+0000 31'100 59:127 [2,0,1] 2 [2,0,1] 2 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.955 INFO:tasks.workunit.client.0.smithi065.stdout:1.4 4 0 0 0 0 1510 0 0 16 16 active+clean 2020-09-08T15:31:33.052856+0000 31'100 58:150 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.956 INFO:tasks.workunit.client.0.smithi065.stdout:1.3 4 0 0 0 0 1510 0 0 10 10 active+clean 2020-09-08T15:31:46.094515+0000 31'100 59:157 [1,2,0] 1 [1,2,0] 1 31'100 2020-09-08T15:31:38.313419+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.956 INFO:tasks.workunit.client.0.smithi065.stdout:1.2 4 0 0 0 0 1510 0 0 16 16 active+clean 2020-09-08T15:31:43.968946+0000 31'100 59:140 [0,1,2] 0 [0,1,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.956 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 3 0 0 0 0 1509 0 0 10 10 active+clean 2020-09-08T15:31:33.053454+0000 31'100 58:151 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.956 INFO:tasks.workunit.client.0.smithi065.stdout:1.1 4 0 0 0 0 1510 0 0 16 16 active+clean 2020-09-08T15:31:37.996571+0000 31'100 59:127 [2,0,1] 2 [2,0,1] 2 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.956 INFO:tasks.workunit.client.0.smithi065.stdout:1.6 4 0 0 0 0 1993 0 0 17 17 active+clean 2020-09-08T15:31:43.969870+0000 50'101 59:151 [0,1,2] 0 [0,1,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.957 INFO:tasks.workunit.client.0.smithi065.stdout:1.7 2 0 0 0 0 966 0 0 16 16 active+clean 2020-09-08T15:31:46.007809+0000 31'100 59:158 [1,2,0] 1 [1,2,0] 1 31'100 2020-09-08T15:31:35.585135+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.957 INFO:tasks.workunit.client.0.smithi065.stdout:1.8 3 0 0 0 0 1510 0 0 10 10 active+clean 2020-09-08T15:31:33.053970+0000 31'100 58:151 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.957 INFO:tasks.workunit.client.0.smithi065.stdout:1.9 3 0 0 0 0 1510 0 0 16 16 active+clean 2020-09-08T15:31:37.996147+0000 31'100 59:127 [2,0,1] 2 [2,0,1] 2 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.957 INFO:tasks.workunit.client.0.smithi065.stdout:1.a 3 0 0 0 0 1510 0 0 16 16 active+clean 2020-09-08T15:31:43.969558+0000 31'100 59:140 [0,1,2] 0 [0,1,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.957 INFO:tasks.workunit.client.0.smithi065.stdout:1.b 3 0 0 0 0 1510 0 0 10 10 active+clean 2020-09-08T15:31:46.094638+0000 31'100 59:157 [1,2,0] 1 [1,2,0] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.958 INFO:tasks.workunit.client.0.smithi065.stdout:1.c 3 0 0 0 0 1510 0 0 14 14 active+clean 2020-09-08T15:31:33.052571+0000 31'100 58:151 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.958 INFO:tasks.workunit.client.0.smithi065.stdout:1.d 3 0 0 0 0 1509 0 0 16 16 active+clean 2020-09-08T15:31:37.996512+0000 31'100 59:127 [2,0,1] 2 [2,0,1] 2 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.958 INFO:tasks.workunit.client.0.smithi065.stdout:1.e 3 0 0 0 0 1156 0 0 17 17 active+clean 2020-09-08T15:31:43.934446+0000 45'101 59:141 [0,1,2] 0 [0,1,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.958 INFO:tasks.workunit.client.0.smithi065.stdout:1.f 3 0 0 0 0 1509 0 0 16 16 active+clean 2020-09-08T15:31:46.093437+0000 31'100 59:155 [1,2,0] 1 [1,2,0] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:50.958 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:31:50.959 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:31:50.959 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:31:50.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:797: TEST_divergent_3: for i in $osds 2020-09-08T15:31:50.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:799: TEST_divergent_3: ceph tell osd.0 debug kick_recovery_wq 0 2020-09-08T15:31:51.089 INFO:tasks.workunit.client.0.smithi065.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2020-09-08T15:31:51.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:797: TEST_divergent_3: for i in $osds 2020-09-08T15:31:51.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:799: TEST_divergent_3: ceph tell osd.1 debug kick_recovery_wq 0 2020-09-08T15:31:51.236 INFO:tasks.workunit.client.0.smithi065.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2020-09-08T15:31:51.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:797: TEST_divergent_3: for i in $osds 2020-09-08T15:31:51.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:799: TEST_divergent_3: ceph tell osd.2 debug kick_recovery_wq 0 2020-09-08T15:31:51.374 INFO:tasks.workunit.client.0.smithi065.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2020-09-08T15:31:51.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:802: TEST_divergent_3: echo 'reading divergent objects' 2020-09-08T15:31:51.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:803: TEST_divergent_3: ceph pg dump pgs 2020-09-08T15:31:51.382 INFO:tasks.workunit.client.0.smithi065.stdout:reading divergent objects 2020-09-08T15:31:51.798 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:31:51.798 INFO:tasks.workunit.client.0.smithi065.stdout:1.1f 3 0 0 0 0 1509 0 0 16 16 active+clean 2020-09-08T15:31:46.095109+0000 31'100 59:155 [1,2,0] 1 [1,2,0] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.798 INFO:tasks.workunit.client.0.smithi065.stdout:1.1e 3 0 0 0 0 1449 0 0 16 16 active+clean 2020-09-08T15:31:46.326012+0000 31'100 59:143 [0,1,2] 0 [0,1,2] 0 31'100 2020-09-08T15:31:46.325963+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.799 INFO:tasks.workunit.client.0.smithi065.stdout:1.1d 3 0 0 0 0 1509 0 0 16 16 active+clean 2020-09-08T15:31:37.996684+0000 31'100 59:127 [2,0,1] 2 [2,0,1] 2 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.799 INFO:tasks.workunit.client.0.smithi065.stdout:1.1c 2 0 0 0 0 966 0 0 16 16 active+clean 2020-09-08T15:31:45.650070+0000 31'100 59:153 [1,0,2] 1 [1,0,2] 1 31'100 2020-09-08T15:31:45.650027+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.799 INFO:tasks.workunit.client.0.smithi065.stdout:1.1b 3 0 0 0 0 1509 0 0 10 10 active+clean 2020-09-08T15:31:46.094194+0000 31'100 59:159 [1,2,0] 1 [1,2,0] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.799 INFO:tasks.workunit.client.0.smithi065.stdout:1.1a 3 0 0 0 0 1509 0 0 16 16 active+clean 2020-09-08T15:31:43.969472+0000 31'100 59:140 [0,1,2] 0 [0,1,2] 0 31'100 2020-09-08T15:31:37.540735+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.800 INFO:tasks.workunit.client.0.smithi065.stdout:1.19 3 0 0 0 0 1509 0 0 16 16 active+clean 2020-09-08T15:31:37.995875+0000 31'100 59:127 [2,0,1] 2 [2,0,1] 2 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.800 INFO:tasks.workunit.client.0.smithi065.stdout:1.18 3 0 0 0 0 1509 0 0 10 10 active+clean 2020-09-08T15:31:33.053720+0000 31'100 58:151 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.800 INFO:tasks.workunit.client.0.smithi065.stdout:1.17 3 0 0 0 0 1509 0 0 16 16 active+clean 2020-09-08T15:31:46.094905+0000 31'100 59:155 [1,2,0] 1 [1,2,0] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.800 INFO:tasks.workunit.client.0.smithi065.stdout:1.16 3 0 0 0 0 1509 0 0 16 16 active+clean 2020-09-08T15:31:43.969276+0000 31'100 59:140 [0,1,2] 0 [0,1,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.801 INFO:tasks.workunit.client.0.smithi065.stdout:1.15 3 0 0 0 0 1449 0 0 16 16 active+clean 2020-09-08T15:31:40.333107+0000 31'100 59:130 [2,0,1] 2 [2,0,1] 2 31'100 2020-09-08T15:31:40.333050+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.801 INFO:tasks.workunit.client.0.smithi065.stdout:1.14 3 0 0 0 0 1509 0 0 10 10 active+clean 2020-09-08T15:31:33.051340+0000 31'100 58:151 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.801 INFO:tasks.workunit.client.0.smithi065.stdout:1.13 3 0 0 0 0 1509 0 0 10 10 active+clean 2020-09-08T15:31:46.093819+0000 31'100 59:157 [1,2,0] 1 [1,2,0] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.801 INFO:tasks.workunit.client.0.smithi065.stdout:1.12 1 0 0 0 0 483 0 0 16 16 active+clean 2020-09-08T15:31:45.398295+0000 31'100 59:143 [0,1,2] 0 [0,1,2] 0 31'100 2020-09-08T15:31:45.398245+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.802 INFO:tasks.workunit.client.0.smithi065.stdout:1.11 3 0 0 0 0 1509 0 0 16 16 active+clean 2020-09-08T15:31:37.995815+0000 31'100 59:127 [2,0,1] 2 [2,0,1] 2 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.802 INFO:tasks.workunit.client.0.smithi065.stdout:1.10 3 0 0 0 0 1509 0 0 10 10 active+clean 2020-09-08T15:31:33.050366+0000 31'100 58:151 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.802 INFO:tasks.workunit.client.0.smithi065.stdout:1.5 3 0 0 0 0 1510 0 0 16 16 active+clean 2020-09-08T15:31:37.996285+0000 31'100 59:127 [2,0,1] 2 [2,0,1] 2 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.803 INFO:tasks.workunit.client.0.smithi065.stdout:1.4 4 0 0 0 0 1510 0 0 16 16 active+clean 2020-09-08T15:31:33.052856+0000 31'100 58:150 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.803 INFO:tasks.workunit.client.0.smithi065.stdout:1.3 4 0 0 0 0 1510 0 0 10 10 active+clean 2020-09-08T15:31:46.094515+0000 31'100 59:157 [1,2,0] 1 [1,2,0] 1 31'100 2020-09-08T15:31:38.313419+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.803 INFO:tasks.workunit.client.0.smithi065.stdout:1.2 4 0 0 0 0 1510 0 0 16 16 active+clean 2020-09-08T15:31:43.968946+0000 31'100 59:140 [0,1,2] 0 [0,1,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.803 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 3 0 0 0 0 1509 0 0 10 10 active+clean 2020-09-08T15:31:33.053454+0000 31'100 58:151 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.804 INFO:tasks.workunit.client.0.smithi065.stdout:1.1 4 0 0 0 0 1510 0 0 16 16 active+clean 2020-09-08T15:31:37.996571+0000 31'100 59:127 [2,0,1] 2 [2,0,1] 2 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.804 INFO:tasks.workunit.client.0.smithi065.stdout:1.6 4 0 0 0 0 1993 0 0 17 17 active+clean 2020-09-08T15:31:43.969870+0000 50'101 59:151 [0,1,2] 0 [0,1,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.804 INFO:tasks.workunit.client.0.smithi065.stdout:1.7 2 0 0 0 0 966 0 0 16 16 active+clean 2020-09-08T15:31:46.007809+0000 31'100 59:158 [1,2,0] 1 [1,2,0] 1 31'100 2020-09-08T15:31:35.585135+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.804 INFO:tasks.workunit.client.0.smithi065.stdout:1.8 3 0 0 0 0 1510 0 0 10 10 active+clean 2020-09-08T15:31:33.053970+0000 31'100 58:151 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.805 INFO:tasks.workunit.client.0.smithi065.stdout:1.9 3 0 0 0 0 1510 0 0 16 16 active+clean 2020-09-08T15:31:37.996147+0000 31'100 59:127 [2,0,1] 2 [2,0,1] 2 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.805 INFO:tasks.workunit.client.0.smithi065.stdout:1.a 3 0 0 0 0 1510 0 0 16 16 active+clean 2020-09-08T15:31:43.969558+0000 31'100 59:140 [0,1,2] 0 [0,1,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.805 INFO:tasks.workunit.client.0.smithi065.stdout:1.b 3 0 0 0 0 1510 0 0 10 10 active+clean 2020-09-08T15:31:46.094638+0000 31'100 59:157 [1,2,0] 1 [1,2,0] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.805 INFO:tasks.workunit.client.0.smithi065.stdout:1.c 3 0 0 0 0 1510 0 0 14 14 active+clean 2020-09-08T15:31:33.052571+0000 31'100 58:151 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.805 INFO:tasks.workunit.client.0.smithi065.stdout:1.d 3 0 0 0 0 1509 0 0 16 16 active+clean 2020-09-08T15:31:37.996512+0000 31'100 59:127 [2,0,1] 2 [2,0,1] 2 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.806 INFO:tasks.workunit.client.0.smithi065.stdout:1.e 3 0 0 0 0 1156 0 0 17 17 active+clean 2020-09-08T15:31:43.934446+0000 45'101 59:141 [0,1,2] 0 [0,1,2] 0 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.806 INFO:tasks.workunit.client.0.smithi065.stdout:1.f 3 0 0 0 0 1509 0 0 16 16 active+clean 2020-09-08T15:31:46.093437+0000 31'100 59:155 [1,2,0] 1 [1,2,0] 1 0'0 2020-09-08T15:28:54.008832+0000 0'0 2020-09-08T15:28:54.008832+0000 0 2020-09-08T15:31:51.806 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:31:51.806 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:31:51.823 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:31:51.824 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:804: TEST_divergent_3: expr 2 + 2 2020-09-08T15:31:51.824 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:804: TEST_divergent_3: seq 1 4 2020-09-08T15:31:51.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:804: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2020-09-08T15:31:51.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:806: TEST_divergent_3: rados -p test get existing_1 td/divergent-priors/existing 2020-09-08T15:31:51.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:804: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2020-09-08T15:31:51.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:806: TEST_divergent_3: rados -p test get existing_2 td/divergent-priors/existing 2020-09-08T15:31:51.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:804: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2020-09-08T15:31:51.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:806: TEST_divergent_3: rados -p test get existing_3 td/divergent-priors/existing 2020-09-08T15:31:51.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:804: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2020-09-08T15:31:51.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:806: TEST_divergent_3: rados -p test get existing_4 td/divergent-priors/existing 2020-09-08T15:31:52.028 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:808: TEST_divergent_3: seq 1 2 2020-09-08T15:31:52.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:808: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2020-09-08T15:31:52.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:810: TEST_divergent_3: rados -p test get newobject_1 td/divergent-priors/existing 2020-09-08T15:31:52.057 INFO:tasks.workunit.client.0.smithi065.stderr:error getting test/newobject_1: (2) No such file or directory 2020-09-08T15:31:52.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:808: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2020-09-08T15:31:52.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:810: TEST_divergent_3: rados -p test get newobject_2 td/divergent-priors/existing 2020-09-08T15:31:52.088 INFO:tasks.workunit.client.0.smithi065.stderr:error getting test/newobject_2: (2) No such file or directory 2020-09-08T15:31:52.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:812: TEST_divergent_3: rm -f td/divergent-priors/existing 2020-09-08T15:31:52.091 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:814: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2020-09-08T15:31:52.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:814: TEST_divergent_3: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2020-09-08T15:31:52.095 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.728+0000 7f56a4b15700 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 31'104 (31'2) modify 1:97db2a0f:::existing_2:head by client.4540.0:1 2020-09-08T15:29:29.144730+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:31:52.095 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.728+0000 7f56a4b15700 20 _merge_object_divergent_entries: keeping 31'104 (31'2) modify 1:97db2a0f:::existing_2:head by client.4540.0:1 2020-09-08T15:29:29.144730+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:31:52.096 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.728+0000 7f56a4b15700 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2020-09-08T15:31:52.096 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.728+0000 7f56a4b15700 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 31'2 first_divergent_update: 31'104 last_divergent_update: 31'104 2020-09-08T15:31:52.096 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.728+0000 7f56a4b15700 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2020-09-08T15:31:52.096 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.728+0000 7f56a4b15700 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2020-09-08T15:31:52.096 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.728+0000 7f56a4b15700 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 31'106 2020-09-08T15:31:52.097 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.728+0000 7f56a4b15700 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 31'104 (31'2) modify 1:97db2a0f:::existing_2:head by client.4540.0:1 2020-09-08T15:29:29.144730+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:31:52.097 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.728+0000 7f56a4b15700 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2020-09-08T15:31:52.097 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.728+0000 7f56a4b15700 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 31'2 <= info.log_tail 31'89 2020-09-08T15:31:52.097 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.880+0000 7f56a4b15700 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 31'105 (31'4) delete 1:70b3bf12:::existing_4:head by client.4542.0:1 2020-09-08T15:29:29.146492+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 0, new_object: 0 2020-09-08T15:31:52.098 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.880+0000 7f56a4b15700 20 _merge_object_divergent_entries: keeping 31'105 (31'4) delete 1:70b3bf12:::existing_4:head by client.4542.0:1 2020-09-08T15:29:29.146492+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 0, new_object: 0 2020-09-08T15:31:52.098 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.880+0000 7f56a4b15700 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2020-09-08T15:31:52.098 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.880+0000 7f56a4b15700 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 31'4 first_divergent_update: 31'105 last_divergent_update: 31'105 2020-09-08T15:31:52.098 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.880+0000 7f56a4b15700 10 _merge_object_divergent_entries: more recent entry found: 45'101 (31'4) modify 1:70b3bf12:::existing_4:head by client.4652.0:1 2020-09-08T15:30:26.089747+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0, already merged 2020-09-08T15:31:52.099 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.880+0000 7f56a4b15700 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 31'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4529.0:1 2020-09-08T15:29:29.127195+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 2020-09-08T15:31:52.099 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.880+0000 7f56a4b15700 20 _merge_object_divergent_entries: keeping 31'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4529.0:1 2020-09-08T15:29:29.127195+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 2020-09-08T15:31:52.099 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.880+0000 7f56a4b15700 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2020-09-08T15:31:52.099 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.880+0000 7f56a4b15700 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 31'101 last_divergent_update: 31'101 2020-09-08T15:31:52.099 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.880+0000 7f56a4b15700 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2020-09-08T15:31:52.100 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.880+0000 7f56a4b15700 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2020-09-08T15:31:52.100 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.880+0000 7f56a5b17700 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 31'106 (31'3) delete 1:8881e6d8:::existing_3:head by client.4543.0:1 2020-09-08T15:29:29.147454+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 0, new_object: 0 2020-09-08T15:31:52.100 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.880+0000 7f56a5b17700 20 _merge_object_divergent_entries: keeping 31'106 (31'3) delete 1:8881e6d8:::existing_3:head by client.4543.0:1 2020-09-08T15:29:29.147454+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 0, new_object: 0 2020-09-08T15:31:52.100 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.880+0000 7f56a5b17700 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2020-09-08T15:31:52.101 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.880+0000 7f56a5b17700 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 31'3 first_divergent_update: 31'106 last_divergent_update: 31'106 2020-09-08T15:31:52.101 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.880+0000 7f56a5b17700 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2020-09-08T15:31:52.102 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.880+0000 7f56a5b17700 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2020-09-08T15:31:52.102 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.880+0000 7f56a5b17700 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 31'106 2020-09-08T15:31:52.102 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.880+0000 7f56a5b17700 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 31'106 (31'3) delete 1:8881e6d8:::existing_3:head by client.4543.0:1 2020-09-08T15:29:29.147454+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 0, new_object: 0 2020-09-08T15:31:52.102 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.880+0000 7f56a5b17700 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2020-09-08T15:31:52.103 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.880+0000 7f56a5b17700 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 31'3 <= info.log_tail 31'84 2020-09-08T15:31:52.103 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.881+0000 7f56a5b17700 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 31'102 (31'1) modify 1:d858c035:::existing_1:head by client.4531.0:1 2020-09-08T15:29:29.131100+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:31:52.103 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.881+0000 7f56a5b17700 20 _merge_object_divergent_entries: keeping 31'102 (31'1) modify 1:d858c035:::existing_1:head by client.4531.0:1 2020-09-08T15:29:29.131100+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:31:52.103 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.881+0000 7f56a5b17700 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2020-09-08T15:31:52.108 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.881+0000 7f56a5b17700 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 31'1 first_divergent_update: 31'102 last_divergent_update: 31'102 2020-09-08T15:31:52.109 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.881+0000 7f56a5b17700 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2020-09-08T15:31:52.109 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.881+0000 7f56a5b17700 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2020-09-08T15:31:52.109 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.881+0000 7f56a5b17700 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 31'106 2020-09-08T15:31:52.109 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.881+0000 7f56a5b17700 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 31'102 (31'1) modify 1:d858c035:::existing_1:head by client.4531.0:1 2020-09-08T15:29:29.131100+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:31:52.110 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.881+0000 7f56a5b17700 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2020-09-08T15:31:52.110 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.881+0000 7f56a5b17700 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 31'1 <= info.log_tail 31'90 2020-09-08T15:31:52.110 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.881+0000 7f56a5b17700 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 31'103 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4535.0:1 2020-09-08T15:29:29.140278+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 2020-09-08T15:31:52.110 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.881+0000 7f56a5b17700 20 _merge_object_divergent_entries: keeping 31'103 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4535.0:1 2020-09-08T15:29:29.140278+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 2020-09-08T15:31:52.110 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.881+0000 7f56a5b17700 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2020-09-08T15:31:52.111 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.881+0000 7f56a5b17700 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 31'103 last_divergent_update: 31'103 2020-09-08T15:31:52.111 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.881+0000 7f56a5b17700 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2020-09-08T15:31:52.111 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:31:11.881+0000 7f56a5b17700 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2020-09-08T15:31:52.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2020-09-08T15:31:52.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2020-09-08T15:31:52.114 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:822: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2020-09-08T15:31:52.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:822: TEST_divergent_3: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2020-09-08T15:31:52.118 INFO:tasks.workunit.client.0.smithi065.stdout:success 2020-09-08T15:31:52.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: echo success 2020-09-08T15:31:52.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: rm td/divergent-priors/td/divergent-priors/exp.30667.out 2020-09-08T15:31:52.120 INFO:tasks.workunit.client.0.smithi065.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.30667.out': No such file or directory 2020-09-08T15:31:52.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:831: TEST_divergent_3: delete_pool test 2020-09-08T15:31:52.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test 2020-09-08T15:31:52.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2020-09-08T15:31:52.762 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' does not exist 2020-09-08T15:31:52.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:832: TEST_divergent_3: kill_daemons td/divergent-priors 2020-09-08T15:31:52.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:31:52.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:31:52.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:31:52.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:31:52.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:31:52.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:31:52.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2020-09-08T15:31:52.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/divergent-priors 2020-09-08T15:31:52.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:31:52.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/divergent-priors KILL 2020-09-08T15:31:52.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:31:52.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:31:52.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:31:52.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:31:52.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:31:52.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:31:52.884 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:31:52.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:31:52.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:31:52.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:31:52.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:31:52.887 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:31:52.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:31:52.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:31:52.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:31:52.889 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:31:52.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:31:52.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:31:52.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/divergent-priors 2020-09-08T15:31:52.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:31:52.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:31:52.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:31:52.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30667 2020-09-08T15:31:52.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:31:52.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:31:52.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2020-09-08T15:31:52.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2020-09-08T15:31:52.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/divergent-priors 2020-09-08T15:31:52.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/divergent-priors 2020-09-08T15:31:52.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/divergent-priors 2020-09-08T15:31:52.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:31:52.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/divergent-priors KILL 2020-09-08T15:31:52.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:31:52.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:31:52.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:31:52.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:31:52.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:31:52.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:31:52.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:31:52.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:31:52.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:31:52.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:31:52.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:31:52.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:31:52.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:31:52.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:31:52.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:31:52.915 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:31:52.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:31:52.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:31:52.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/divergent-priors 2020-09-08T15:31:52.917 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:31:52.919 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:31:52.919 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:31:52.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30667 2020-09-08T15:31:52.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:31:52.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:31:52.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/divergent-priors 2020-09-08T15:31:52.921 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T15:31:52.922 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:31:52.922 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:31:52.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.30667 2020-09-08T15:31:52.922 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T15:31:52.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T15:31:52.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T15:31:52.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2020-09-08T15:31:52.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_ec td/divergent-priors 2020-09-08T15:31:52.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:228: TEST_divergent_ec: local dir=td/divergent-priors 2020-09-08T15:31:52.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: local dummyfile=/etc/fstab 2020-09-08T15:31:52.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:232: TEST_divergent_ec: local dummyfile2=/etc/resolv.conf 2020-09-08T15:31:52.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: local num_osds=3 2020-09-08T15:31:52.927 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:235: TEST_divergent_ec: expr 3 - 1 2020-09-08T15:31:52.927 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:235: TEST_divergent_ec: seq 0 2 2020-09-08T15:31:52.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:235: TEST_divergent_ec: local 'osds=0 2020-09-08T15:31:52.928 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:31:52.928 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:31:52.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:236: TEST_divergent_ec: run_mon td/divergent-priors a 2020-09-08T15:31:52.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/divergent-priors 2020-09-08T15:31:52.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T15:31:52.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T15:31:52.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T15:31:52.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/divergent-priors/a 2020-09-08T15:31:52.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2020-09-08T15:31:53.276 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T15:31:53.277 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:31:53.277 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:31:53.277 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:31:53.277 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:31:53.278 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:31:53.278 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:31:53.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T15:31:53.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T15:31:53.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T15:31:53.470 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:31:53.470 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:31:53.470 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T15:31:53.470 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T15:31:53.470 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:31:53.471 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:31:53.471 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:31:53.472 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:31:53.472 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:31:53.472 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:31:53.472 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-mon.a.asok 2020-09-08T15:31:53.472 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:31:53.473 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30667/ceph-mon.a.asok config get fsid 2020-09-08T15:31:53.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T15:31:53.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:31:53.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:31:53.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T15:31:53.565 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T15:31:53.565 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:31:53.565 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:31:53.565 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:31:53.566 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:31:53.566 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:31:53.567 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:31:53.567 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-mon.a.asok 2020-09-08T15:31:53.567 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:31:53.567 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30667/ceph-mon.a.asok config get mon_host 2020-09-08T15:31:53.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: run_mgr td/divergent-priors x 2020-09-08T15:31:53.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/divergent-priors 2020-09-08T15:31:53.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T15:31:53.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T15:31:53.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T15:31:53.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/divergent-priors/x 2020-09-08T15:31:53.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T15:31:54.155 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T15:31:54.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:31:54.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:31:54.156 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:31:54.156 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:31:54.157 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:31:54.157 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:31:54.157 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:31:54.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:31:54.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:238: TEST_divergent_ec: for i in $osds 2020-09-08T15:31:54.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:240: TEST_divergent_ec: run_osd td/divergent-priors 0 2020-09-08T15:31:54.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/divergent-priors 2020-09-08T15:31:54.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:31:54.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T15:31:54.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:31:54.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/divergent-priors/0 2020-09-08T15:31:54.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:31:54.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:31:54.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:31:54.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:31:54.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2020-09-08T15:31:54.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2020-09-08T15:31:54.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:31:54.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:31:54.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:31:54.190 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:31:54.191 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:31:54.191 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:31:54.191 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:31:54.191 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:31:54.191 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:31:54.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:31:54.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:31:54.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:31:54.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:31:54.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:31:54.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:31:54.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:31:54.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:31:54.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:31:54.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:31:54.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:31:54.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:31:54.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/divergent-priors/0 2020-09-08T15:31:54.197 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:31:54.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=bf9e879c-7aad-47a6-b313-d798e2659805 2020-09-08T15:31:54.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 bf9e879c-7aad-47a6-b313-d798e2659805' 2020-09-08T15:31:54.198 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:31:54.198 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 bf9e879c-7aad-47a6-b313-d798e2659805 2020-09-08T15:31:54.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDqo1df3pKqDBAAXqlxGMHNsLZgDpZv18KQug== 2020-09-08T15:31:54.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDqo1df3pKqDBAAXqlxGMHNsLZgDpZv18KQug=="}' 2020-09-08T15:31:54.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new bf9e879c-7aad-47a6-b313-d798e2659805 -i td/divergent-priors/0/new.json 2020-09-08T15:31:54.598 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:31:54.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/divergent-priors/0/new.json 2020-09-08T15:31:54.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDqo1df3pKqDBAAXqlxGMHNsLZgDpZv18KQug== --osd-uuid bf9e879c-7aad-47a6-b313-d798e2659805 2020-09-08T15:31:54.642 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:31:54.643+0000 7fb32e207ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:31:54.643 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:31:54.645+0000 7fb32e207ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:31:54.643 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:31:54.647+0000 7fb32e207ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:31:54.643 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:31:54.647+0000 7fb32e207ec0 -1 bluestore(td/divergent-priors/0/block) _read_bdev_label failed to open td/divergent-priors/0/block: (2) No such file or directory 2020-09-08T15:31:54.644 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:31:54.647+0000 7fb32e207ec0 -1 bluestore(td/divergent-priors/0/block) _read_bdev_label failed to open td/divergent-priors/0/block: (2) No such file or directory 2020-09-08T15:31:54.644 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:31:54.647+0000 7fb32e207ec0 -1 bluestore(td/divergent-priors/0/block) _read_bdev_label failed to open td/divergent-priors/0/block: (2) No such file or directory 2020-09-08T15:31:54.712 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:31:54.712+0000 7fb32e207ec0 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2020-09-08T15:31:59.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/divergent-priors/0/keyring 2020-09-08T15:31:59.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:31:59.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T15:31:59.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:31:59.267 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T15:31:59.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T15:32:00.102 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T15:32:00.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:32:00.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:32:00.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:32:00.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:32:00.105 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:31:59.838+0000 7fd7a6039ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:32:00.105 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:31:59.879+0000 7fd7a6039ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:32:00.105 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:31:59.881+0000 7fd7a6039ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:32:00.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T15:32:00.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:32:00.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:32:00.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:32:00.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:32:00.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:32:00.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:32:00.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:32:00.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:32:00.254 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:32:00.391 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:00.395+0000 7fd7a6039ec0 -1 Falling back to public interface 2020-09-08T15:32:00.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:32:01.234 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:01.237+0000 7fd7a6039ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T15:32:01.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:32:01.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:32:01.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:32:01.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:32:01.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:32:01.645 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:32:02.091 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/64655,v1:127.0.0.1:6803/64655] [v2:127.0.0.1:6804/64655,v1:127.0.0.1:6805/64655] exists,up bf9e879c-7aad-47a6-b313-d798e2659805 2020-09-08T15:32:02.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:32:02.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:32:02.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:32:02.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:238: TEST_divergent_ec: for i in $osds 2020-09-08T15:32:02.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:240: TEST_divergent_ec: run_osd td/divergent-priors 1 2020-09-08T15:32:02.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/divergent-priors 2020-09-08T15:32:02.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:32:02.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T15:32:02.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:32:02.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/divergent-priors/1 2020-09-08T15:32:02.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:32:02.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:32:02.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:32:02.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:32:02.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2020-09-08T15:32:02.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2020-09-08T15:32:02.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:32:02.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:32:02.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:32:02.095 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:32:02.095 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:32:02.095 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:32:02.096 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:32:02.096 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:32:02.096 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:32:02.096 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:32:02.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:32:02.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:32:02.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:32:02.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:32:02.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:32:02.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:32:02.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:32:02.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:32:02.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:32:02.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:32:02.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:32:02.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/divergent-priors/1 2020-09-08T15:32:02.100 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:32:02.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=9638912c-2705-4309-bba1-4a617ae644ec 2020-09-08T15:32:02.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 9638912c-2705-4309-bba1-4a617ae644ec' 2020-09-08T15:32:02.102 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:32:02.102 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 9638912c-2705-4309-bba1-4a617ae644ec 2020-09-08T15:32:02.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDyo1dfwRLnBhAAwh57j5ckAMOp5D87Uj/Tag== 2020-09-08T15:32:02.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDyo1dfwRLnBhAAwh57j5ckAMOp5D87Uj/Tag=="}' 2020-09-08T15:32:02.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 9638912c-2705-4309-bba1-4a617ae644ec -i td/divergent-priors/1/new.json 2020-09-08T15:32:02.649 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:32:02.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/divergent-priors/1/new.json 2020-09-08T15:32:02.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDyo1dfwRLnBhAAwh57j5ckAMOp5D87Uj/Tag== --osd-uuid 9638912c-2705-4309-bba1-4a617ae644ec 2020-09-08T15:32:02.695 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:02.699+0000 7fc3c1f79ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:32:02.696 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:02.701+0000 7fc3c1f79ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:32:02.699 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:02.703+0000 7fc3c1f79ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:32:02.699 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:02.703+0000 7fc3c1f79ec0 -1 bluestore(td/divergent-priors/1/block) _read_bdev_label failed to open td/divergent-priors/1/block: (2) No such file or directory 2020-09-08T15:32:02.700 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:02.703+0000 7fc3c1f79ec0 -1 bluestore(td/divergent-priors/1/block) _read_bdev_label failed to open td/divergent-priors/1/block: (2) No such file or directory 2020-09-08T15:32:02.700 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:02.703+0000 7fc3c1f79ec0 -1 bluestore(td/divergent-priors/1/block) _read_bdev_label failed to open td/divergent-priors/1/block: (2) No such file or directory 2020-09-08T15:32:02.862 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:02.861+0000 7fc3c1f79ec0 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2020-09-08T15:32:07.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/divergent-priors/1/keyring 2020-09-08T15:32:07.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:32:07.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T15:32:07.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:32:07.492 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T15:32:08.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T15:32:08.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:32:08.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:32:08.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:32:08.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:32:08.040 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:32:08.068 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:08.072+0000 7f3801bf9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:32:08.069 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:08.074+0000 7f3801bf9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:32:08.079 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:08.075+0000 7f3801bf9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:32:08.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T15:32:08.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:32:08.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:32:08.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:32:08.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:32:08.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:32:08.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:32:08.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:32:08.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:32:08.467 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:32:08.594 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:08.598+0000 7f3801bf9ec0 -1 Falling back to public interface 2020-09-08T15:32:08.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:32:09.367 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:09.367+0000 7f3801bf9ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T15:32:09.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:32:09.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:32:09.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:32:09.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:32:09.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:32:09.913 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:32:10.323 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/65648,v1:127.0.0.1:6811/65648] [v2:127.0.0.1:6812/65648,v1:127.0.0.1:6813/65648] exists,up 9638912c-2705-4309-bba1-4a617ae644ec 2020-09-08T15:32:10.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:32:10.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:32:10.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:32:10.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:238: TEST_divergent_ec: for i in $osds 2020-09-08T15:32:10.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:240: TEST_divergent_ec: run_osd td/divergent-priors 2 2020-09-08T15:32:10.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/divergent-priors 2020-09-08T15:32:10.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:32:10.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T15:32:10.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:32:10.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/divergent-priors/2 2020-09-08T15:32:10.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:32:10.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:32:10.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:32:10.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:32:10.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2020-09-08T15:32:10.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2020-09-08T15:32:10.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:32:10.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:32:10.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:32:10.329 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:32:10.330 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:32:10.330 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:32:10.330 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:32:10.330 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:32:10.331 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:32:10.331 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:32:10.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:32:10.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:32:10.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:32:10.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:32:10.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:32:10.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:32:10.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:32:10.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:32:10.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:32:10.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:32:10.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:32:10.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/divergent-priors/2 2020-09-08T15:32:10.335 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:32:10.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=e537af10-6bdf-47c4-9f94-34575593ecc4 2020-09-08T15:32:10.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 e537af10-6bdf-47c4-9f94-34575593ecc4' 2020-09-08T15:32:10.336 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:32:10.336 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 e537af10-6bdf-47c4-9f94-34575593ecc4 2020-09-08T15:32:10.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQD6o1dfTpHHFBAAda4FFNyCNfaR+CCB+xxb+w== 2020-09-08T15:32:10.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQD6o1dfTpHHFBAAda4FFNyCNfaR+CCB+xxb+w=="}' 2020-09-08T15:32:10.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new e537af10-6bdf-47c4-9f94-34575593ecc4 -i td/divergent-priors/2/new.json 2020-09-08T15:32:10.919 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T15:32:10.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/divergent-priors/2/new.json 2020-09-08T15:32:10.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQD6o1dfTpHHFBAAda4FFNyCNfaR+CCB+xxb+w== --osd-uuid e537af10-6bdf-47c4-9f94-34575593ecc4 2020-09-08T15:32:10.961 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:10.966+0000 7f1b565f2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:32:10.963 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:10.968+0000 7f1b565f2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:32:10.963 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:10.968+0000 7f1b565f2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:32:10.964 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:10.969+0000 7f1b565f2ec0 -1 bluestore(td/divergent-priors/2/block) _read_bdev_label failed to open td/divergent-priors/2/block: (2) No such file or directory 2020-09-08T15:32:10.964 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:10.969+0000 7f1b565f2ec0 -1 bluestore(td/divergent-priors/2/block) _read_bdev_label failed to open td/divergent-priors/2/block: (2) No such file or directory 2020-09-08T15:32:10.965 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:10.969+0000 7f1b565f2ec0 -1 bluestore(td/divergent-priors/2/block) _read_bdev_label failed to open td/divergent-priors/2/block: (2) No such file or directory 2020-09-08T15:32:11.045 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:11.050+0000 7f1b565f2ec0 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2020-09-08T15:32:15.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/divergent-priors/2/keyring 2020-09-08T15:32:15.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:32:15.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T15:32:15.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:32:15.549 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T15:32:16.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T15:32:16.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:32:16.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:32:16.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:32:16.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:32:16.096 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T15:32:16.121 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:16.126+0000 7f7477109ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:32:16.123 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:16.128+0000 7f7477109ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:32:16.124 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:16.129+0000 7f7477109ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:32:16.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T15:32:16.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:32:16.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:32:16.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:32:16.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:32:16.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:32:16.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:32:16.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:32:16.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:32:16.495 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:32:16.641 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:16.646+0000 7f7477109ec0 -1 Falling back to public interface 2020-09-08T15:32:16.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:32:17.511 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:32:17.514+0000 7f7477109ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T15:32:17.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:32:17.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:32:17.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:32:17.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:32:17.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:32:17.896 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:32:18.343 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/66642,v1:127.0.0.1:6819/66642] [v2:127.0.0.1:6820/66642,v1:127.0.0.1:6821/66642] exists,up e537af10-6bdf-47c4-9f94-34575593ecc4 2020-09-08T15:32:18.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:32:18.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:32:18.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:32:18.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:243: TEST_divergent_ec: ceph osd set noout 2020-09-08T15:32:19.380 INFO:tasks.workunit.client.0.smithi065.stderr:noout is set 2020-09-08T15:32:19.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:244: TEST_divergent_ec: ceph osd set noin 2020-09-08T15:32:20.149 INFO:tasks.workunit.client.0.smithi065.stderr:noin is set 2020-09-08T15:32:20.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:245: TEST_divergent_ec: ceph osd set nodown 2020-09-08T15:32:20.851 INFO:tasks.workunit.client.0.smithi065.stderr:nodown is set 2020-09-08T15:32:20.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:246: TEST_divergent_ec: create_ec_pool test true k=2 m=1 2020-09-08T15:32:20.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: create_ec_pool: local pool_name=test 2020-09-08T15:32:20.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: create_ec_pool: shift 2020-09-08T15:32:20.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: create_ec_pool: local allow_overwrites=true 2020-09-08T15:32:20.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: create_ec_pool: shift 2020-09-08T15:32:20.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2020-09-08T15:32:21.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: create_ec_pool: create_pool test 1 1 erasure myprofile 2020-09-08T15:32:21.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test 1 1 erasure myprofile 2020-09-08T15:32:22.184 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' already exists 2020-09-08T15:32:22.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:32:23.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2281: create_ec_pool: '[' true = true ']' 2020-09-08T15:32:23.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2282: create_ec_pool: ceph osd pool set test allow_ec_overwrites true 2020-09-08T15:32:23.936 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 allow_ec_overwrites to true 2020-09-08T15:32:23.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: create_ec_pool: wait_for_clean 2020-09-08T15:32:23.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:32:23.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:32:23.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:32:23.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:32:23.946 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T15:32:23.947 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:32:23.947 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:32:23.947 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:32:23.947 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:32:23.948 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:32:24.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:32:24.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:32:24.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:32:24.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:32:24.041 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:32:24.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:32:24.453 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:32:24.453 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:32:24.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:32:24.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:32:24.454 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:32:24.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836487 2020-09-08T15:32:24.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836487 2020-09-08T15:32:24.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836487' 2020-09-08T15:32:24.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:32:24.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:32:24.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672965 2020-09-08T15:32:24.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672965 2020-09-08T15:32:24.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836487 1-42949672965' 2020-09-08T15:32:24.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:32:24.726 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:32:24.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509444 2020-09-08T15:32:24.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509444 2020-09-08T15:32:24.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836487 1-42949672965 2-64424509444' 2020-09-08T15:32:24.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:32:24.863 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836487 2020-09-08T15:32:24.863 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:32:24.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:32:24.864 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836487 2020-09-08T15:32:24.864 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:32:24.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836487 2020-09-08T15:32:24.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2020-09-08T15:32:24.866 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:32:24.866 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836487 2020-09-08T15:32:25.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836485 -lt 21474836487 2020-09-08T15:32:25.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:32:26.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:32:26.264 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:32:26.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836487 -lt 21474836487 2020-09-08T15:32:26.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:32:26.672 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672965 2020-09-08T15:32:26.672 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:32:26.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:32:26.673 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672965 2020-09-08T15:32:26.673 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:32:26.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672965 2020-09-08T15:32:26.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672965' 2020-09-08T15:32:26.674 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:32:26.675 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672965 2020-09-08T15:32:27.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672966 -lt 42949672965 2020-09-08T15:32:27.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:32:27.127 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509444 2020-09-08T15:32:27.127 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:32:27.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:32:27.127 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509444 2020-09-08T15:32:27.127 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:32:27.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509444 2020-09-08T15:32:27.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509444' 2020-09-08T15:32:27.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:32:27.129 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509444 2020-09-08T15:32:27.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509444 -lt 64424509444 2020-09-08T15:32:27.519 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:32:27.520 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:32:27.520 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:32:28.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T15:32:28.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:32:28.043 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:32:28.043 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:32:28.044 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:32:28.044 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:32:28.044 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:32:28.044 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:32:28.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:32:28.426 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:32:28.430 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:32:28.431 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:32:28.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T15:32:28.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:32:28.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:32:28.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: create_ec_pool: return 0 2020-09-08T15:32:28.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:248: TEST_divergent_ec: flush_pg_stats 2020-09-08T15:32:28.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:32:28.952 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:32:29.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:32:29.349 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:32:29.350 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:32:29.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:32:29.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:32:29.350 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:32:29.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836490 2020-09-08T15:32:29.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836490 2020-09-08T15:32:29.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836490' 2020-09-08T15:32:29.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:32:29.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:32:29.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672968 2020-09-08T15:32:29.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672968 2020-09-08T15:32:29.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836490 1-42949672968' 2020-09-08T15:32:29.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:32:29.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:32:29.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509447 2020-09-08T15:32:29.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509447 2020-09-08T15:32:29.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836490 1-42949672968 2-64424509447' 2020-09-08T15:32:29.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:32:29.773 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836490 2020-09-08T15:32:29.773 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:32:29.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:32:29.773 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836490 2020-09-08T15:32:29.773 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:32:29.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836490 2020-09-08T15:32:29.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2020-09-08T15:32:29.775 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:32:29.775 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836490 2020-09-08T15:32:30.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836490 -lt 21474836490 2020-09-08T15:32:30.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:32:30.171 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672968 2020-09-08T15:32:30.171 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:32:30.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:32:30.172 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672968 2020-09-08T15:32:30.173 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:32:30.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672968 2020-09-08T15:32:30.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672968' 2020-09-08T15:32:30.174 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:32:30.174 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672968 2020-09-08T15:32:30.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672968 -lt 42949672968 2020-09-08T15:32:30.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:32:30.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509447 2020-09-08T15:32:30.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:32:30.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:32:30.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509447 2020-09-08T15:32:30.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:32:30.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509447 2020-09-08T15:32:30.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509447' 2020-09-08T15:32:30.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:32:30.631 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509447 2020-09-08T15:32:31.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509447 -lt 64424509447 2020-09-08T15:32:31.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:249: TEST_divergent_ec: wait_for_clean 2020-09-08T15:32:31.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:32:31.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:32:31.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:32:31.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:32:31.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T15:32:31.404 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:32:31.405 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:32:31.405 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:32:31.406 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:32:31.406 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:32:31.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:32:31.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:32:31.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:32:31.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:32:31.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:32:31.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:32:31.525 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:32:31.525 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:32:31.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:32:31.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:32:31.526 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:32:31.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836492 2020-09-08T15:32:31.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836492 2020-09-08T15:32:31.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836492' 2020-09-08T15:32:31.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:32:31.662 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:32:31.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672971 2020-09-08T15:32:31.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672971 2020-09-08T15:32:31.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836492 1-42949672971' 2020-09-08T15:32:31.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:32:31.800 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:32:31.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509449 2020-09-08T15:32:31.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509449 2020-09-08T15:32:31.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836492 1-42949672971 2-64424509449' 2020-09-08T15:32:31.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:32:31.936 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836492 2020-09-08T15:32:31.936 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:32:31.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:32:31.937 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836492 2020-09-08T15:32:31.937 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:32:31.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836492 2020-09-08T15:32:31.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2020-09-08T15:32:31.938 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:32:31.939 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836492 2020-09-08T15:32:32.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836492 -lt 21474836492 2020-09-08T15:32:32.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:32:32.333 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672971 2020-09-08T15:32:32.333 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:32:32.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:32:32.334 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672971 2020-09-08T15:32:32.334 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:32:32.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672971 2020-09-08T15:32:32.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672971' 2020-09-08T15:32:32.335 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:32:32.336 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672971 2020-09-08T15:32:32.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672971 -lt 42949672971 2020-09-08T15:32:32.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:32:32.739 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509449 2020-09-08T15:32:32.739 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:32:32.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:32:32.740 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509449 2020-09-08T15:32:32.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:32:32.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509449 2020-09-08T15:32:32.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509449' 2020-09-08T15:32:32.742 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509449 2020-09-08T15:32:32.742 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:32:33.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509447 -lt 64424509449 2020-09-08T15:32:33.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:32:34.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:32:34.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:32:34.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509450 -lt 64424509449 2020-09-08T15:32:34.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:32:34.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:32:34.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:32:35.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T15:32:35.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:32:35.117 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:32:35.117 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:32:35.118 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:32:35.118 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:32:35.118 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:32:35.118 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:32:35.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:32:35.502 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:32:35.502 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:32:35.502 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:32:36.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T15:32:36.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:32:36.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:32:36.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:252: TEST_divergent_ec: ceph pg dump pgs --format=json 2020-09-08T15:32:36.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:252: TEST_divergent_ec: jq '.pg_stats[0].up_primary' 2020-09-08T15:32:36.408 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:32:36.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:252: TEST_divergent_ec: local divergent=1 2020-09-08T15:32:36.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:253: TEST_divergent_ec: echo 'primary and soon to be divergent is 1' 2020-09-08T15:32:36.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:254: TEST_divergent_ec: ceph pg dump pgs 2020-09-08T15:32:36.429 INFO:tasks.workunit.client.0.smithi065.stdout:primary and soon to be divergent is 1 2020-09-08T15:32:36.796 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:32:36.796 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:32:22.977120+0000 0'0 28:11 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:32:21.938326+0000 0'0 2020-09-08T15:32:21.938326+0000 0 2020-09-08T15:32:36.796 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:32:36.796 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:32:36.797 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:32:36.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: local non_divergent= 2020-09-08T15:32:36.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:256: TEST_divergent_ec: for i in $osds 2020-09-08T15:32:36.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:258: TEST_divergent_ec: '[' 0 = 1 ']' 2020-09-08T15:32:36.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:261: TEST_divergent_ec: non_divergent=' 0' 2020-09-08T15:32:36.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:256: TEST_divergent_ec: for i in $osds 2020-09-08T15:32:36.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:258: TEST_divergent_ec: '[' 1 = 1 ']' 2020-09-08T15:32:36.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:259: TEST_divergent_ec: continue 2020-09-08T15:32:36.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:256: TEST_divergent_ec: for i in $osds 2020-09-08T15:32:36.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:258: TEST_divergent_ec: '[' 2 = 1 ']' 2020-09-08T15:32:36.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:261: TEST_divergent_ec: non_divergent=' 0 2' 2020-09-08T15:32:36.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:264: TEST_divergent_ec: echo 'writing initial objects' 2020-09-08T15:32:36.809 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: seq 1 100 2020-09-08T15:32:36.809 INFO:tasks.workunit.client.0.smithi065.stdout:writing initial objects 2020-09-08T15:32:36.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:36.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_1 /etc/fstab 2020-09-08T15:32:36.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:36.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_2 /etc/fstab 2020-09-08T15:32:37.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:37.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_3 /etc/fstab 2020-09-08T15:32:37.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:37.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_4 /etc/fstab 2020-09-08T15:32:37.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:37.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_5 /etc/fstab 2020-09-08T15:32:37.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:37.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_6 /etc/fstab 2020-09-08T15:32:38.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:38.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_7 /etc/fstab 2020-09-08T15:32:38.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:38.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_8 /etc/fstab 2020-09-08T15:32:38.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:38.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_9 /etc/fstab 2020-09-08T15:32:38.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:38.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_10 /etc/fstab 2020-09-08T15:32:39.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:39.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_11 /etc/fstab 2020-09-08T15:32:39.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:39.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_12 /etc/fstab 2020-09-08T15:32:39.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:39.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_13 /etc/fstab 2020-09-08T15:32:39.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:39.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_14 /etc/fstab 2020-09-08T15:32:40.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:40.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_15 /etc/fstab 2020-09-08T15:32:40.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:40.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_16 /etc/fstab 2020-09-08T15:32:40.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:40.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_17 /etc/fstab 2020-09-08T15:32:40.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:40.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_18 /etc/fstab 2020-09-08T15:32:40.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:40.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_19 /etc/fstab 2020-09-08T15:32:41.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:41.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_20 /etc/fstab 2020-09-08T15:32:41.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:41.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_21 /etc/fstab 2020-09-08T15:32:41.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:41.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_22 /etc/fstab 2020-09-08T15:32:41.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:41.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_23 /etc/fstab 2020-09-08T15:32:42.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:42.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_24 /etc/fstab 2020-09-08T15:32:42.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:42.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_25 /etc/fstab 2020-09-08T15:32:42.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:42.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_26 /etc/fstab 2020-09-08T15:32:42.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:42.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_27 /etc/fstab 2020-09-08T15:32:42.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:42.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_28 /etc/fstab 2020-09-08T15:32:43.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:43.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_29 /etc/fstab 2020-09-08T15:32:43.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:43.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_30 /etc/fstab 2020-09-08T15:32:43.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:43.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_31 /etc/fstab 2020-09-08T15:32:43.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:43.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_32 /etc/fstab 2020-09-08T15:32:44.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:44.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_33 /etc/fstab 2020-09-08T15:32:44.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:44.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_34 /etc/fstab 2020-09-08T15:32:44.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:44.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_35 /etc/fstab 2020-09-08T15:32:44.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:44.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_36 /etc/fstab 2020-09-08T15:32:45.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:45.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_37 /etc/fstab 2020-09-08T15:32:45.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:45.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_38 /etc/fstab 2020-09-08T15:32:45.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:45.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_39 /etc/fstab 2020-09-08T15:32:45.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:45.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_40 /etc/fstab 2020-09-08T15:32:46.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:46.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_41 /etc/fstab 2020-09-08T15:32:46.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:46.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_42 /etc/fstab 2020-09-08T15:32:46.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:46.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_43 /etc/fstab 2020-09-08T15:32:46.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:46.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_44 /etc/fstab 2020-09-08T15:32:46.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:46.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_45 /etc/fstab 2020-09-08T15:32:47.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:47.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_46 /etc/fstab 2020-09-08T15:32:47.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:47.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_47 /etc/fstab 2020-09-08T15:32:47.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:47.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_48 /etc/fstab 2020-09-08T15:32:47.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:47.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_49 /etc/fstab 2020-09-08T15:32:48.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:48.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_50 /etc/fstab 2020-09-08T15:32:48.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:48.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_51 /etc/fstab 2020-09-08T15:32:48.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:48.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_52 /etc/fstab 2020-09-08T15:32:48.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:48.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_53 /etc/fstab 2020-09-08T15:32:48.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:48.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_54 /etc/fstab 2020-09-08T15:32:49.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:49.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_55 /etc/fstab 2020-09-08T15:32:49.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:49.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_56 /etc/fstab 2020-09-08T15:32:49.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:49.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_57 /etc/fstab 2020-09-08T15:32:49.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:49.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_58 /etc/fstab 2020-09-08T15:32:50.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:50.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_59 /etc/fstab 2020-09-08T15:32:50.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:50.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_60 /etc/fstab 2020-09-08T15:32:50.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:50.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_61 /etc/fstab 2020-09-08T15:32:50.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:50.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_62 /etc/fstab 2020-09-08T15:32:50.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:50.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_63 /etc/fstab 2020-09-08T15:32:51.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:51.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_64 /etc/fstab 2020-09-08T15:32:51.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:51.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_65 /etc/fstab 2020-09-08T15:32:51.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:51.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_66 /etc/fstab 2020-09-08T15:32:51.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:51.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_67 /etc/fstab 2020-09-08T15:32:52.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:52.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_68 /etc/fstab 2020-09-08T15:32:52.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:52.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_69 /etc/fstab 2020-09-08T15:32:52.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:52.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_70 /etc/fstab 2020-09-08T15:32:52.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:52.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_71 /etc/fstab 2020-09-08T15:32:53.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:53.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_72 /etc/fstab 2020-09-08T15:32:53.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:53.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_73 /etc/fstab 2020-09-08T15:32:53.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:53.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_74 /etc/fstab 2020-09-08T15:32:53.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:53.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_75 /etc/fstab 2020-09-08T15:32:54.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:54.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_76 /etc/fstab 2020-09-08T15:32:54.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:54.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_77 /etc/fstab 2020-09-08T15:32:54.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:54.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_78 /etc/fstab 2020-09-08T15:32:54.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:54.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_79 /etc/fstab 2020-09-08T15:32:55.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:55.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_80 /etc/fstab 2020-09-08T15:32:55.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:55.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_81 /etc/fstab 2020-09-08T15:32:55.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:55.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_82 /etc/fstab 2020-09-08T15:32:55.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:55.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_83 /etc/fstab 2020-09-08T15:32:55.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:55.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_84 /etc/fstab 2020-09-08T15:32:56.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:56.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_85 /etc/fstab 2020-09-08T15:32:56.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:56.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_86 /etc/fstab 2020-09-08T15:32:56.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:56.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_87 /etc/fstab 2020-09-08T15:32:56.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:56.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_88 /etc/fstab 2020-09-08T15:32:57.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:57.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_89 /etc/fstab 2020-09-08T15:32:57.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:57.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_90 /etc/fstab 2020-09-08T15:32:57.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:57.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_91 /etc/fstab 2020-09-08T15:32:57.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:57.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_92 /etc/fstab 2020-09-08T15:32:58.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:58.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_93 /etc/fstab 2020-09-08T15:32:58.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:58.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_94 /etc/fstab 2020-09-08T15:32:58.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:58.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_95 /etc/fstab 2020-09-08T15:32:58.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:58.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_96 /etc/fstab 2020-09-08T15:32:58.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:58.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_97 /etc/fstab 2020-09-08T15:32:59.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:59.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_98 /etc/fstab 2020-09-08T15:32:59.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:59.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_99 /etc/fstab 2020-09-08T15:32:59.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2020-09-08T15:32:59.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_100 /etc/fstab 2020-09-08T15:32:59.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:271: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2020-09-08T15:32:59.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:271: TEST_divergent_ec: wait_for_clean 2020-09-08T15:32:59.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:32:59.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:32:59.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:32:59.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:32:59.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 20 .1 2020-09-08T15:32:59.907 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:32:59.908 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:32:59.908 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:32:59.908 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:32:59.908 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:32:59.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:32:59.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:32:59.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:32:59.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:32:59.977 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:33:00.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:33:00.433 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:33:00.433 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:33:00.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:33:00.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:33:00.434 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:33:00.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836500 2020-09-08T15:33:00.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836500 2020-09-08T15:33:00.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836500' 2020-09-08T15:33:00.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:33:00.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:33:00.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672978 2020-09-08T15:33:00.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672978 2020-09-08T15:33:00.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836500 1-42949672978' 2020-09-08T15:33:00.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:33:00.706 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:33:00.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509457 2020-09-08T15:33:00.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509457 2020-09-08T15:33:00.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836500 1-42949672978 2-64424509457' 2020-09-08T15:33:00.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:33:00.841 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836500 2020-09-08T15:33:00.841 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:33:00.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:33:00.841 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836500 2020-09-08T15:33:00.842 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:33:00.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836500 2020-09-08T15:33:00.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836500' 2020-09-08T15:33:00.843 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:33:00.844 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836500 2020-09-08T15:33:01.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836498 -lt 21474836500 2020-09-08T15:33:01.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:33:02.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:33:02.236 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:33:02.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836500 -lt 21474836500 2020-09-08T15:33:02.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:33:02.657 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672978 2020-09-08T15:33:02.666 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:33:02.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:33:02.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672978 2020-09-08T15:33:02.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:33:02.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672978 2020-09-08T15:33:02.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672978' 2020-09-08T15:33:02.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:33:02.668 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672978 2020-09-08T15:33:03.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672979 -lt 42949672978 2020-09-08T15:33:03.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:33:03.049 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509457 2020-09-08T15:33:03.049 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:33:03.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:33:03.050 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509457 2020-09-08T15:33:03.050 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:33:03.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509457 2020-09-08T15:33:03.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509457' 2020-09-08T15:33:03.051 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:33:03.051 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509457 2020-09-08T15:33:03.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509457 -lt 64424509457 2020-09-08T15:33:03.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:33:03.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:33:03.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:33:04.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T15:33:04.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:33:04.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:33:04.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:33:04.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:33:04.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:33:04.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:33:04.037 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:33:04.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:33:04.425 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:33:04.426 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:33:04.426 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:33:04.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T15:33:04.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:33:04.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:33:04.946 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:273: TEST_divergent_ec: get_pg test existing_1 2020-09-08T15:33:04.946 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1031: get_pg: local poolname=test 2020-09-08T15:33:04.947 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: local objectname=existing_1 2020-09-08T15:33:04.947 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: ceph --format json osd map test existing_1 2020-09-08T15:33:04.947 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: jq -r .pgid 2020-09-08T15:33:05.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:273: TEST_divergent_ec: local pgid=1.0 2020-09-08T15:33:05.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:276: TEST_divergent_ec: echo 'blackholing osds 0 2' 2020-09-08T15:33:05.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: ceph pg dump pgs 2020-09-08T15:33:05.351 INFO:tasks.workunit.client.0.smithi065.stdout:blackholing osds 0 2 2020-09-08T15:33:05.726 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:33:05.726 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 0 0 0 0 48300 0 0 16 16 active+clean 2020-09-08T15:32:22.977120+0000 29'100 29:111 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:32:21.938326+0000 0'0 2020-09-08T15:32:21.938326+0000 0 2020-09-08T15:33:05.726 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:33:05.727 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:33:05.728 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:33:05.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:278: TEST_divergent_ec: for i in $non_divergent 2020-09-08T15:33:05.737 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:280: TEST_divergent_ec: get_asok_path osd.0 2020-09-08T15:33:05.737 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-09-08T15:33:05.737 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-09-08T15:33:05.738 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:33:05.738 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:33:05.738 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:33:05.738 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.0.asok 2020-09-08T15:33:05.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:280: TEST_divergent_ec: CEPH_ARGS= 2020-09-08T15:33:05.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:280: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.0.asok config set objectstore_blackhole 1 2020-09-08T15:33:05.829 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:33:05.829 INFO:tasks.workunit.client.0.smithi065.stdout: "success": "objectstore_blackhole = 'true' (not observed, change may require restart) " 2020-09-08T15:33:05.830 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:33:05.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:278: TEST_divergent_ec: for i in $non_divergent 2020-09-08T15:33:05.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:280: TEST_divergent_ec: get_asok_path osd.2 2020-09-08T15:33:05.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-09-08T15:33:05.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-09-08T15:33:05.838 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:33:05.839 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:33:05.839 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:33:05.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.2.asok 2020-09-08T15:33:05.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:280: TEST_divergent_ec: CEPH_ARGS= 2020-09-08T15:33:05.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:280: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.2.asok config set objectstore_blackhole 1 2020-09-08T15:33:05.929 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:33:05.930 INFO:tasks.workunit.client.0.smithi065.stdout: "success": "objectstore_blackhole = 'true' (not observed, change may require restart) " 2020-09-08T15:33:05.930 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:33:05.937 INFO:tasks.workunit.client.0.smithi065.stdout:writing divergent object 2020-09-08T15:33:05.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:284: TEST_divergent_ec: echo 'writing divergent object' 2020-09-08T15:33:05.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:286: TEST_divergent_ec: sleep 1 2020-09-08T15:33:05.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:285: TEST_divergent_ec: rados -p test put existing_100 /etc/resolv.conf 2020-09-08T15:33:06.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: rados -p test mksnap snap1 2020-09-08T15:33:06.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:287: TEST_divergent_ec: rados -p test put existing_100 /etc/fstab 2020-09-08T15:33:07.185 INFO:tasks.workunit.client.0.smithi065.stdout:created pool test snap snap1 2020-09-08T15:33:07.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:290: TEST_divergent_ec: sleep 10 2020-09-08T15:33:07.188 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:289: TEST_divergent_ec: expr 100 - 1 2020-09-08T15:33:07.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:289: TEST_divergent_ec: rados -p test put existing_99 /etc/fstab 2020-09-08T15:33:17.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:291: TEST_divergent_ec: killall -9 rados 2020-09-08T15:33:17.192 INFO:tasks.workunit.client.0.smithi065.stderr:rados: no process found 2020-09-08T15:33:17.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:294: TEST_divergent_ec: echo 'killing all the osds' 2020-09-08T15:33:17.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:295: TEST_divergent_ec: ceph pg dump pgs 2020-09-08T15:33:17.193 INFO:tasks.workunit.client.0.smithi065.stdout:killing all the osds 2020-09-08T15:33:17.576 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:33:17.577 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 101 0 0 0 0 48783 0 0 14 14 active+clean 2020-09-08T15:32:22.977120+0000 30'104 30:115 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:32:21.938326+0000 0'0 2020-09-08T15:32:21.938326+0000 0 2020-09-08T15:33:17.577 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:33:17.577 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:33:17.578 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:33:17.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd 2020-09-08T15:33:17.587 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:33:17.587 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:33:17.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:33:17.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:33:17.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:33:17.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:33:17.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:297: TEST_divergent_ec: for i in $osds 2020-09-08T15:33:17.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:299: TEST_divergent_ec: ceph osd down osd.0 2020-09-08T15:33:18.273 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already down. 2020-09-08T15:33:18.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:297: TEST_divergent_ec: for i in $osds 2020-09-08T15:33:18.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:299: TEST_divergent_ec: ceph osd down osd.1 2020-09-08T15:33:18.830 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already down. 2020-09-08T15:33:18.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:297: TEST_divergent_ec: for i in $osds 2020-09-08T15:33:18.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:299: TEST_divergent_ec: ceph osd down osd.2 2020-09-08T15:33:19.390 INFO:tasks.workunit.client.0.smithi065.stderr:osd.2 is already down. 2020-09-08T15:33:19.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:301: TEST_divergent_ec: for i in $non_divergent 2020-09-08T15:33:19.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:303: TEST_divergent_ec: ceph osd out osd.0 2020-09-08T15:33:20.001 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already out. 2020-09-08T15:33:20.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:301: TEST_divergent_ec: for i in $non_divergent 2020-09-08T15:33:20.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:303: TEST_divergent_ec: ceph osd out osd.2 2020-09-08T15:33:20.539 INFO:tasks.workunit.client.0.smithi065.stderr:osd.2 is already out. 2020-09-08T15:33:20.548 INFO:tasks.workunit.client.0.smithi065.stdout:bringing up non_divergent 0 2 2020-09-08T15:33:20.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:307: TEST_divergent_ec: echo 'bringing up non_divergent 0 2' 2020-09-08T15:33:20.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: ceph pg dump pgs 2020-09-08T15:33:20.922 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:33:20.923 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 101 0 0 0 0 48783 0 0 14 14 stale+active+clean 2020-09-08T15:32:22.977120+0000 30'104 30:115 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:32:21.938326+0000 0'0 2020-09-08T15:32:21.938326+0000 0 2020-09-08T15:33:20.923 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:33:20.923 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:33:20.924 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:33:20.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:309: TEST_divergent_ec: for i in $non_divergent 2020-09-08T15:33:20.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:311: TEST_divergent_ec: activate_osd td/divergent-priors 0 2020-09-08T15:33:20.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/divergent-priors 2020-09-08T15:33:20.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:33:20.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=0 2020-09-08T15:33:20.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:33:20.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/divergent-priors/0 2020-09-08T15:33:20.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:33:20.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:33:20.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:33:20.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:33:20.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2020-09-08T15:33:20.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2020-09-08T15:33:20.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:33:20.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:33:20.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:33:20.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:33:20.955 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:33:20.955 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:33:20.955 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:33:20.955 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:33:20.955 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:33:20.956 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:33:20.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:33:20.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:33:20.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:33:20.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:33:20.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:33:20.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:33:20.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:33:20.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:33:20.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:33:20.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/divergent-priors/0 2020-09-08T15:33:20.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.0 2020-09-08T15:33:20.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 0 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:33:20.959 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/divergent-priors/0/whoami 2020-09-08T15:33:20.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 0 = 0 ']' 2020-09-08T15:33:20.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:33:20.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:33:20.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:33:20.960 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T15:33:20.964 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:33:20.969+0000 7f4870180ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:33:20.965 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:33:20.970+0000 7f4870180ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:33:20.967 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:33:20.972+0000 7f4870180ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:33:21.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 0 2020-09-08T15:33:21.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:33:21.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:33:21.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:33:21.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:33:21.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:33:21.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:33:21.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:33:21.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:33:21.341 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:33:21.483 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:33:21.488+0000 7f4870180ec0 -1 Falling back to public interface 2020-09-08T15:33:21.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:33:22.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:33:22.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:33:22.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:33:22.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:33:22.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:33:22.751 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:33:22.866 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:33:22.869+0000 7f4870180ec0 -1 osd.0 29 log_to_monitors {default=true} 2020-09-08T15:33:23.160 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up out weight 0 up_from 36 up_thru 0 down_at 31 last_clean_interval [5,29) [v2:127.0.0.1:6802/70901,v1:127.0.0.1:6803/70901] [v2:127.0.0.1:6804/70901,v1:127.0.0.1:6805/70901] exists,up bf9e879c-7aad-47a6-b313-d798e2659805 2020-09-08T15:33:23.161 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T15:33:23.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:33:23.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:33:23.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:33:23.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:309: TEST_divergent_ec: for i in $non_divergent 2020-09-08T15:33:23.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:311: TEST_divergent_ec: activate_osd td/divergent-priors 2 2020-09-08T15:33:23.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/divergent-priors 2020-09-08T15:33:23.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:33:23.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=2 2020-09-08T15:33:23.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:33:23.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/divergent-priors/2 2020-09-08T15:33:23.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:33:23.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:33:23.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:33:23.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:33:23.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2020-09-08T15:33:23.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2020-09-08T15:33:23.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:33:23.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:33:23.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:33:23.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:33:23.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:33:23.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:33:23.168 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:33:23.168 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:33:23.169 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:33:23.169 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:33:23.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:33:23.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:33:23.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:33:23.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:33:23.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:33:23.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:33:23.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:33:23.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:33:23.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:33:23.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/divergent-priors/2 2020-09-08T15:33:23.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.2 2020-09-08T15:33:23.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 2 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:33:23.172 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/divergent-priors/2/whoami 2020-09-08T15:33:23.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 2 = 2 ']' 2020-09-08T15:33:23.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:33:23.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:33:23.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:33:23.192 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:33:23.192+0000 7ffab6dd1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:33:23.192 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:33:23.194+0000 7ffab6dd1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:33:23.192 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:33:23.195+0000 7ffab6dd1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:33:23.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 2 2020-09-08T15:33:23.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:33:23.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:33:23.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:33:23.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:33:23.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:33:23.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:33:23.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:33:23.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:33:23.566 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:33:23.706 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:33:23.710+0000 7ffab6dd1ec0 -1 Falling back to public interface 2020-09-08T15:33:23.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:33:24.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:33:24.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:33:24.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:33:24.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:33:24.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:33:24.953 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:33:25.085 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:33:25.090+0000 7ffab6dd1ec0 -1 osd.2 29 log_to_monitors {default=true} 2020-09-08T15:33:25.458 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up out weight 0 up_from 37 up_thru 0 down_at 33 last_clean_interval [15,29) [v2:127.0.0.1:6810/71300,v1:127.0.0.1:6811/71300] [v2:127.0.0.1:6812/71300,v1:127.0.0.1:6813/71300] exists,up e537af10-6bdf-47c4-9f94-34575593ecc4 2020-09-08T15:33:25.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:33:25.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:33:25.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:33:25.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:313: TEST_divergent_ec: for i in $non_divergent 2020-09-08T15:33:25.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:315: TEST_divergent_ec: ceph osd in osd.0 2020-09-08T15:33:26.026 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already in. 2020-09-08T15:33:26.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:313: TEST_divergent_ec: for i in $non_divergent 2020-09-08T15:33:26.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:315: TEST_divergent_ec: ceph osd in osd.2 2020-09-08T15:33:26.572 INFO:tasks.workunit.client.0.smithi065.stderr:osd.2 is already in. 2020-09-08T15:33:26.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:318: TEST_divergent_ec: sleep 5 2020-09-08T15:33:31.584 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:322: TEST_divergent_ec: expr 2 + 2 2020-09-08T15:33:31.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:322: TEST_divergent_ec: objname=existing_4 2020-09-08T15:33:31.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:323: TEST_divergent_ec: echo 'writing non-divergent object existing_4' 2020-09-08T15:33:31.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:324: TEST_divergent_ec: ceph pg dump pgs 2020-09-08T15:33:31.585 INFO:tasks.workunit.client.0.smithi065.stdout:writing non-divergent object existing_4 2020-09-08T15:33:31.972 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:33:31.973 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 100 0 100 0 0 48300 0 0 16 16 active+undersized+degraded 2020-09-08T15:33:26.988502+0000 29'100 40:120 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2020-09-08T15:32:21.938326+0000 0'0 2020-09-08T15:32:21.938326+0000 0 2020-09-08T15:33:31.973 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:33:31.973 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:33:31.974 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:33:31.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:325: TEST_divergent_ec: rados -p test put existing_4 /etc/resolv.conf 2020-09-08T15:33:32.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2020-09-08T15:33:32.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: wait_for_clean 2020-09-08T15:33:32.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:33:32.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:33:32.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:33:32.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:33:32.139 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 20 .1 2020-09-08T15:33:32.139 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:33:32.140 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:33:32.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:33:32.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:33:32.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:33:32.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:33:32.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:33:32.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:33:32.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:33:32.201 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:33:32.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:33:32.600 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:33:32.600 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:33:32.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:33:32.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:33:32.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:33:32.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=154618822660 2020-09-08T15:33:32.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 154618822660 2020-09-08T15:33:32.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-154618822660' 2020-09-08T15:33:32.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:33:32.782 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:33:32.878 INFO:tasks.workunit.client.0.smithi065.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-09-08T15:33:32.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq= 2020-09-08T15:33:32.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z '' 2020-09-08T15:33:32.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: continue 2020-09-08T15:33:32.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:33:32.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:33:33.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=158913789956 2020-09-08T15:33:33.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 158913789956 2020-09-08T15:33:33.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-154618822660 2-158913789956' 2020-09-08T15:33:33.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:33:33.419 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-154618822660 2020-09-08T15:33:33.419 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:33:33.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:33:33.419 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-154618822660 2020-09-08T15:33:33.420 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:33:33.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=154618822660 2020-09-08T15:33:33.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 154618822660' 2020-09-08T15:33:33.420 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:33:33.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 154618822658 -lt 154618822660 2020-09-08T15:33:33.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:33:33.421 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 154618822660 2020-09-08T15:33:34.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:33:34.422 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:33:34.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 154618822661 -lt 154618822660 2020-09-08T15:33:34.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:33:34.820 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-158913789956 2020-09-08T15:33:34.821 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:33:34.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:33:34.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-158913789956 2020-09-08T15:33:34.834 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:33:34.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=158913789956 2020-09-08T15:33:34.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 158913789956' 2020-09-08T15:33:34.836 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:33:34.836 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 158913789956 2020-09-08T15:33:35.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 158913789956 -lt 158913789956 2020-09-08T15:33:35.216 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:33:35.216 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:33:35.216 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:33:35.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T15:33:35.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:33:35.743 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:33:35.743 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:33:35.744 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:33:35.744 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:33:35.744 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:33:35.744 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:33:36.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:33:36.127 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:33:36.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:33:36.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:33:36.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:33:36.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T15:33:36.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T15:33:36.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T15:33:36.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:33:36.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:33:36.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:33:36.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:33:36.755 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:33:36.755 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:33:36.755 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:33:36.755 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:33:36.756 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:33:36.756 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:33:37.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:33:37.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:33:37.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:33:37.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:33:37.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:33:37.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:33:37.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:33:37.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:33:37.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:33:37.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:33:37.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:33:37.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:33:37.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:33:38.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:33:38.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:33:38.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 1 >= 8 )) 2020-09-08T15:33:38.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:33:38.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.2 2020-09-08T15:33:38.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:33:38.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:33:38.384 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:33:38.384 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:33:38.385 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:33:38.385 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:33:38.385 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:33:38.385 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:33:38.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:33:38.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:33:38.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:33:38.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:33:39.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:33:39.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:33:39.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:33:39.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:33:39.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:33:39.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:33:39.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:33:39.303 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:33:39.303 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:33:39.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:33:39.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:33:39.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 2 >= 8 )) 2020-09-08T15:33:39.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:33:39.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.4 2020-09-08T15:33:40.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:33:40.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:33:40.228 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:33:40.228 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:33:40.229 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:33:40.229 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:33:40.229 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:33:40.229 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:33:40.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:33:40.618 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:33:40.618 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:33:40.618 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:33:41.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:33:41.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:33:41.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:33:41.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:33:41.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:33:41.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:33:41.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:33:41.146 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:33:41.146 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:33:41.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:33:41.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:33:41.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 3 >= 8 )) 2020-09-08T15:33:41.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:33:41.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.8 2020-09-08T15:33:42.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:33:42.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:33:42.473 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:33:42.473 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:33:42.474 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:33:42.474 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:33:42.474 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:33:42.475 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:33:42.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:33:42.868 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:33:42.868 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:33:42.869 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:33:43.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:33:43.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:33:43.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:33:43.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:33:43.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:33:43.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:33:43.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:33:43.390 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:33:43.390 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:33:43.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:33:43.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:33:43.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 4 >= 8 )) 2020-09-08T15:33:43.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:33:43.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 1.6 2020-09-08T15:33:45.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:33:45.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:33:45.522 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:33:45.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:33:45.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:33:45.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:33:45.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:33:45.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:33:45.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:33:45.918 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:33:45.918 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:33:45.918 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:33:46.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:33:46.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:33:46.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:33:46.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:33:46.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:33:46.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:33:46.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:33:46.495 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:33:46.495 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:33:47.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:33:47.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:33:47.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 5 >= 8 )) 2020-09-08T15:33:47.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:33:47.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 3.2 2020-09-08T15:33:50.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:33:50.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:33:50.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:33:50.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:33:50.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:33:50.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:33:50.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:33:50.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:33:50.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:33:50.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:33:50.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:33:50.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:33:51.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:33:51.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:33:51.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:33:51.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:33:51.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:33:51.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:33:51.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:33:51.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:33:51.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:33:51.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:33:51.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:33:51.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 6 >= 8 )) 2020-09-08T15:33:51.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:33:51.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 6.4 2020-09-08T15:33:58.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:33:58.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:33:58.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:33:58.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:33:58.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:33:58.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:33:58.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:33:58.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:33:58.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:33:58.489 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:33:58.489 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:33:58.489 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:33:59.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:33:59.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:33:59.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:33:59.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:33:59.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:33:59.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:33:59.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:33:59.026 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:33:59.026 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:33:59.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:33:59.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:33:59.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 7 >= 8 )) 2020-09-08T15:33:59.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:33:59.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 7.3 2020-09-08T15:34:06.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:34:06.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:34:06.830 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:34:06.830 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:34:06.830 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:34:06.830 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:34:06.830 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:34:06.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:34:07.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:34:07.232 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:34:07.232 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:34:07.233 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:34:07.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:34:07.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:34:07.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:34:07.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:34:07.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:34:07.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:34:07.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:34:07.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:34:07.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:34:08.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:34:08.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:34:08.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 8 >= 8 )) 2020-09-08T15:34:08.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: wait_for_clean: ceph report 2020-09-08T15:34:08.831 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:34:08.832 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_fingerprint": "617d39a4-6b2a-459f-bf12-8598f6cb73ba", 2020-09-08T15:34:08.832 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:34:08.832 INFO:tasks.workunit.client.0.smithi065.stdout: "commit": "dce4d291bd4243c9802c17d67b85a6da6bbc0f8f", 2020-09-08T15:34:08.832 INFO:tasks.workunit.client.0.smithi065.stdout: "timestamp": "2020-09-08T15:34:08.835373+0000", 2020-09-08T15:34:08.832 INFO:tasks.workunit.client.0.smithi065.stdout: "tag": "", 2020-09-08T15:34:08.833 INFO:tasks.workunit.client.0.smithi065.stdout: "health": { 2020-09-08T15:34:08.833 INFO:tasks.workunit.client.0.smithi065.stdout: "status": "HEALTH_WARN", 2020-09-08T15:34:08.833 INFO:tasks.workunit.client.0.smithi065.stdout: "checks": { 2020-09-08T15:34:08.833 INFO:tasks.workunit.client.0.smithi065.stdout: "OSDMAP_FLAGS": { 2020-09-08T15:34:08.834 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:34:08.834 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:34:08.834 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "nodown,noout,noin flag(s) set", 2020-09-08T15:34:08.834 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 17 2020-09-08T15:34:08.834 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.847 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [], 2020-09-08T15:34:08.847 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:34:08.847 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.847 INFO:tasks.workunit.client.0.smithi065.stdout: "OSD_DOWN": { 2020-09-08T15:34:08.847 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:34:08.848 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:34:08.848 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "1 osds down", 2020-09-08T15:34:08.848 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 1 2020-09-08T15:34:08.848 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.848 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [ 2020-09-08T15:34:08.849 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.849 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "osd.1 (root=default,host=smithi065) is down" 2020-09-08T15:34:08.849 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.849 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:08.849 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:34:08.851 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.852 INFO:tasks.workunit.client.0.smithi065.stdout: "PG_DEGRADED": { 2020-09-08T15:34:08.852 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:34:08.852 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:34:08.852 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2020-09-08T15:34:08.852 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 1 2020-09-08T15:34:08.853 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.853 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [ 2020-09-08T15:34:08.853 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.853 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [2147483647,0,2]" 2020-09-08T15:34:08.853 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.853 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:08.854 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:34:08.854 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.854 INFO:tasks.workunit.client.0.smithi065.stdout: "POOL_APP_NOT_ENABLED": { 2020-09-08T15:34:08.854 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:34:08.856 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:34:08.857 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "1 pool(s) do not have an application enabled", 2020-09-08T15:34:08.857 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 1 2020-09-08T15:34:08.857 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.857 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [ 2020-09-08T15:34:08.857 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.858 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "application not enabled on pool 'test'" 2020-09-08T15:34:08.858 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.858 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.858 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." 2020-09-08T15:34:08.859 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.859 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:08.859 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:34:08.860 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.860 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.860 INFO:tasks.workunit.client.0.smithi065.stdout: "mutes": [] 2020-09-08T15:34:08.861 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.861 INFO:tasks.workunit.client.0.smithi065.stdout: "monmap_first_committed": 1, 2020-09-08T15:34:08.861 INFO:tasks.workunit.client.0.smithi065.stdout: "monmap_last_committed": 1, 2020-09-08T15:34:08.861 INFO:tasks.workunit.client.0.smithi065.stdout: "monmap": { 2020-09-08T15:34:08.862 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 1, 2020-09-08T15:34:08.862 INFO:tasks.workunit.client.0.smithi065.stdout: "fsid": "c25e19f6-e2e3-4d0b-8f34-71c93296ff3c", 2020-09-08T15:34:08.862 INFO:tasks.workunit.client.0.smithi065.stdout: "modified": "2020-09-08T15:31:52.952774Z", 2020-09-08T15:34:08.862 INFO:tasks.workunit.client.0.smithi065.stdout: "created": "2020-09-08T15:31:52.952774Z", 2020-09-08T15:34:08.862 INFO:tasks.workunit.client.0.smithi065.stdout: "min_mon_release": 16, 2020-09-08T15:34:08.862 INFO:tasks.workunit.client.0.smithi065.stdout: "min_mon_release_name": "pacific", 2020-09-08T15:34:08.863 INFO:tasks.workunit.client.0.smithi065.stdout: "features": { 2020-09-08T15:34:08.863 INFO:tasks.workunit.client.0.smithi065.stdout: "persistent": [ 2020-09-08T15:34:08.863 INFO:tasks.workunit.client.0.smithi065.stdout: "kraken", 2020-09-08T15:34:08.863 INFO:tasks.workunit.client.0.smithi065.stdout: "luminous", 2020-09-08T15:34:08.863 INFO:tasks.workunit.client.0.smithi065.stdout: "mimic", 2020-09-08T15:34:08.864 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap-prune", 2020-09-08T15:34:08.864 INFO:tasks.workunit.client.0.smithi065.stdout: "nautilus", 2020-09-08T15:34:08.864 INFO:tasks.workunit.client.0.smithi065.stdout: "octopus", 2020-09-08T15:34:08.864 INFO:tasks.workunit.client.0.smithi065.stdout: "pacific" 2020-09-08T15:34:08.864 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:08.865 INFO:tasks.workunit.client.0.smithi065.stdout: "optional": [] 2020-09-08T15:34:08.865 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.865 INFO:tasks.workunit.client.0.smithi065.stdout: "mons": [ 2020-09-08T15:34:08.865 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.865 INFO:tasks.workunit.client.0.smithi065.stdout: "rank": 0, 2020-09-08T15:34:08.866 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "a", 2020-09-08T15:34:08.866 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:34:08.866 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:08.866 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.866 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:08.866 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:7115", 2020-09-08T15:34:08.867 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 0 2020-09-08T15:34:08.867 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.867 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:08.867 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.867 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:7115/0", 2020-09-08T15:34:08.868 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:7115/0", 2020-09-08T15:34:08.868 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 0, 2020-09-08T15:34:08.868 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 0 2020-09-08T15:34:08.868 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.868 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:08.869 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.869 INFO:tasks.workunit.client.0.smithi065.stdout: "quorum": [ 2020-09-08T15:34:08.869 INFO:tasks.workunit.client.0.smithi065.stdout: 0 2020-09-08T15:34:08.869 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:08.869 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap": { 2020-09-08T15:34:08.870 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 40, 2020-09-08T15:34:08.870 INFO:tasks.workunit.client.0.smithi065.stdout: "fsid": "c25e19f6-e2e3-4d0b-8f34-71c93296ff3c", 2020-09-08T15:34:08.870 INFO:tasks.workunit.client.0.smithi065.stdout: "created": "2020-09-08T15:31:53.745739+0000", 2020-09-08T15:34:08.871 INFO:tasks.workunit.client.0.smithi065.stdout: "modified": "2020-09-08T15:33:26.660617+0000", 2020-09-08T15:34:08.871 INFO:tasks.workunit.client.0.smithi065.stdout: "last_up_change": "2020-09-08T15:33:25.332786+0000", 2020-09-08T15:34:08.871 INFO:tasks.workunit.client.0.smithi065.stdout: "last_in_change": "2020-09-08T15:33:26.334856+0000", 2020-09-08T15:34:08.871 INFO:tasks.workunit.client.0.smithi065.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-09-08T15:34:08.872 INFO:tasks.workunit.client.0.smithi065.stdout: "flags_num": 5800384, 2020-09-08T15:34:08.872 INFO:tasks.workunit.client.0.smithi065.stdout: "flags_set": [ 2020-09-08T15:34:08.872 INFO:tasks.workunit.client.0.smithi065.stdout: "nodown", 2020-09-08T15:34:08.872 INFO:tasks.workunit.client.0.smithi065.stdout: "noin", 2020-09-08T15:34:08.872 INFO:tasks.workunit.client.0.smithi065.stdout: "noout", 2020-09-08T15:34:08.873 INFO:tasks.workunit.client.0.smithi065.stdout: "pglog_hardlimit", 2020-09-08T15:34:08.873 INFO:tasks.workunit.client.0.smithi065.stdout: "purged_snapdirs", 2020-09-08T15:34:08.873 INFO:tasks.workunit.client.0.smithi065.stdout: "recovery_deletes", 2020-09-08T15:34:08.873 INFO:tasks.workunit.client.0.smithi065.stdout: "sortbitwise" 2020-09-08T15:34:08.873 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:08.874 INFO:tasks.workunit.client.0.smithi065.stdout: "crush_version": 8, 2020-09-08T15:34:08.874 INFO:tasks.workunit.client.0.smithi065.stdout: "full_ratio": 0.99000000953674316, 2020-09-08T15:34:08.874 INFO:tasks.workunit.client.0.smithi065.stdout: "backfillfull_ratio": 0.99000000953674316, 2020-09-08T15:34:08.874 INFO:tasks.workunit.client.0.smithi065.stdout: "nearfull_ratio": 0.85000002384185791, 2020-09-08T15:34:08.874 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_snapshot": "", 2020-09-08T15:34:08.875 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_max": 1, 2020-09-08T15:34:08.875 INFO:tasks.workunit.client.0.smithi065.stdout: "max_osd": 3, 2020-09-08T15:34:08.875 INFO:tasks.workunit.client.0.smithi065.stdout: "require_min_compat_client": "luminous", 2020-09-08T15:34:08.875 INFO:tasks.workunit.client.0.smithi065.stdout: "min_compat_client": "jewel", 2020-09-08T15:34:08.875 INFO:tasks.workunit.client.0.smithi065.stdout: "require_osd_release": "pacific", 2020-09-08T15:34:08.876 INFO:tasks.workunit.client.0.smithi065.stdout: "pools": [ 2020-09-08T15:34:08.876 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.876 INFO:tasks.workunit.client.0.smithi065.stdout: "pool": 1, 2020-09-08T15:34:08.876 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_name": "test", 2020-09-08T15:34:08.876 INFO:tasks.workunit.client.0.smithi065.stdout: "create_time": "2020-09-08T15:32:21.860598+0000", 2020-09-08T15:34:08.877 INFO:tasks.workunit.client.0.smithi065.stdout: "flags": 16389, 2020-09-08T15:34:08.877 INFO:tasks.workunit.client.0.smithi065.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2020-09-08T15:34:08.877 INFO:tasks.workunit.client.0.smithi065.stdout: "type": 3, 2020-09-08T15:34:08.877 INFO:tasks.workunit.client.0.smithi065.stdout: "size": 3, 2020-09-08T15:34:08.877 INFO:tasks.workunit.client.0.smithi065.stdout: "min_size": 2, 2020-09-08T15:34:08.878 INFO:tasks.workunit.client.0.smithi065.stdout: "crush_rule": 1, 2020-09-08T15:34:08.878 INFO:tasks.workunit.client.0.smithi065.stdout: "object_hash": 2, 2020-09-08T15:34:08.878 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_autoscale_mode": "off", 2020-09-08T15:34:08.878 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_num": 1, 2020-09-08T15:34:08.879 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_placement_num": 1, 2020-09-08T15:34:08.879 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_placement_num_target": 1, 2020-09-08T15:34:08.879 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_num_target": 1, 2020-09-08T15:34:08.879 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_num_pending": 1, 2020-09-08T15:34:08.879 INFO:tasks.workunit.client.0.smithi065.stdout: "last_pg_merge_meta": { 2020-09-08T15:34:08.880 INFO:tasks.workunit.client.0.smithi065.stdout: "source_pgid": "0.0", 2020-09-08T15:34:08.880 INFO:tasks.workunit.client.0.smithi065.stdout: "ready_epoch": 0, 2020-09-08T15:34:08.880 INFO:tasks.workunit.client.0.smithi065.stdout: "last_epoch_started": 0, 2020-09-08T15:34:08.880 INFO:tasks.workunit.client.0.smithi065.stdout: "last_epoch_clean": 0, 2020-09-08T15:34:08.880 INFO:tasks.workunit.client.0.smithi065.stdout: "source_version": "0'0", 2020-09-08T15:34:08.881 INFO:tasks.workunit.client.0.smithi065.stdout: "target_version": "0'0" 2020-09-08T15:34:08.881 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.881 INFO:tasks.workunit.client.0.smithi065.stdout: "last_change": "30", 2020-09-08T15:34:08.881 INFO:tasks.workunit.client.0.smithi065.stdout: "last_force_op_resend": "0", 2020-09-08T15:34:08.882 INFO:tasks.workunit.client.0.smithi065.stdout: "last_force_op_resend_prenautilus": "0", 2020-09-08T15:34:08.882 INFO:tasks.workunit.client.0.smithi065.stdout: "last_force_op_resend_preluminous": "0", 2020-09-08T15:34:08.882 INFO:tasks.workunit.client.0.smithi065.stdout: "auid": 0, 2020-09-08T15:34:08.882 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_mode": "pool", 2020-09-08T15:34:08.882 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_seq": 1, 2020-09-08T15:34:08.883 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_epoch": 30, 2020-09-08T15:34:08.883 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_snaps": [ 2020-09-08T15:34:08.883 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.883 INFO:tasks.workunit.client.0.smithi065.stdout: "snapid": 1, 2020-09-08T15:34:08.883 INFO:tasks.workunit.client.0.smithi065.stdout: "stamp": "2020-09-08T15:33:06.977271+0000", 2020-09-08T15:34:08.883 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "snap1" 2020-09-08T15:34:08.884 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.884 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:08.884 INFO:tasks.workunit.client.0.smithi065.stdout: "removed_snaps": "[]", 2020-09-08T15:34:08.884 INFO:tasks.workunit.client.0.smithi065.stdout: "quota_max_bytes": 0, 2020-09-08T15:34:08.884 INFO:tasks.workunit.client.0.smithi065.stdout: "quota_max_objects": 0, 2020-09-08T15:34:08.885 INFO:tasks.workunit.client.0.smithi065.stdout: "tiers": [], 2020-09-08T15:34:08.885 INFO:tasks.workunit.client.0.smithi065.stdout: "tier_of": -1, 2020-09-08T15:34:08.885 INFO:tasks.workunit.client.0.smithi065.stdout: "read_tier": -1, 2020-09-08T15:34:08.885 INFO:tasks.workunit.client.0.smithi065.stdout: "write_tier": -1, 2020-09-08T15:34:08.885 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_mode": "none", 2020-09-08T15:34:08.886 INFO:tasks.workunit.client.0.smithi065.stdout: "target_max_bytes": 0, 2020-09-08T15:34:08.886 INFO:tasks.workunit.client.0.smithi065.stdout: "target_max_objects": 0, 2020-09-08T15:34:08.886 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-09-08T15:34:08.886 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-09-08T15:34:08.886 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_target_full_ratio_micro": 800000, 2020-09-08T15:34:08.887 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_min_flush_age": 0, 2020-09-08T15:34:08.887 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_min_evict_age": 0, 2020-09-08T15:34:08.887 INFO:tasks.workunit.client.0.smithi065.stdout: "erasure_code_profile": "myprofile", 2020-09-08T15:34:08.887 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_params": { 2020-09-08T15:34:08.887 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "none" 2020-09-08T15:34:08.888 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.888 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_period": 0, 2020-09-08T15:34:08.888 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_count": 0, 2020-09-08T15:34:08.888 INFO:tasks.workunit.client.0.smithi065.stdout: "use_gmt_hitset": true, 2020-09-08T15:34:08.888 INFO:tasks.workunit.client.0.smithi065.stdout: "min_read_recency_for_promote": 0, 2020-09-08T15:34:08.888 INFO:tasks.workunit.client.0.smithi065.stdout: "min_write_recency_for_promote": 0, 2020-09-08T15:34:08.889 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_grade_decay_rate": 0, 2020-09-08T15:34:08.889 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_search_last_n": 0, 2020-09-08T15:34:08.889 INFO:tasks.workunit.client.0.smithi065.stdout: "grade_table": [], 2020-09-08T15:34:08.889 INFO:tasks.workunit.client.0.smithi065.stdout: "stripe_width": 8192, 2020-09-08T15:34:08.889 INFO:tasks.workunit.client.0.smithi065.stdout: "expected_num_objects": 0, 2020-09-08T15:34:08.891 INFO:tasks.workunit.client.0.smithi065.stdout: "fast_read": false, 2020-09-08T15:34:08.891 INFO:tasks.workunit.client.0.smithi065.stdout: "options": {}, 2020-09-08T15:34:08.891 INFO:tasks.workunit.client.0.smithi065.stdout: "application_metadata": {} 2020-09-08T15:34:08.891 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.892 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:08.892 INFO:tasks.workunit.client.0.smithi065.stdout: "osds": [ 2020-09-08T15:34:08.892 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.896 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:34:08.896 INFO:tasks.workunit.client.0.smithi065.stdout: "uuid": "bf9e879c-7aad-47a6-b313-d798e2659805", 2020-09-08T15:34:08.896 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 1, 2020-09-08T15:34:08.896 INFO:tasks.workunit.client.0.smithi065.stdout: "in": 1, 2020-09-08T15:34:08.896 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 1, 2020-09-08T15:34:08.897 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_affinity": 1, 2020-09-08T15:34:08.897 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_begin": 5, 2020-09-08T15:34:08.897 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_end": 29, 2020-09-08T15:34:08.897 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 36, 2020-09-08T15:34:08.898 INFO:tasks.workunit.client.0.smithi065.stdout: "up_thru": 39, 2020-09-08T15:34:08.898 INFO:tasks.workunit.client.0.smithi065.stdout: "down_at": 31, 2020-09-08T15:34:08.898 INFO:tasks.workunit.client.0.smithi065.stdout: "lost_at": 0, 2020-09-08T15:34:08.899 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:34:08.899 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:08.899 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.899 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:08.900 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6802", 2020-09-08T15:34:08.901 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 70901 2020-09-08T15:34:08.901 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.901 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.901 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:08.901 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6803", 2020-09-08T15:34:08.902 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 70901 2020-09-08T15:34:08.902 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.903 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:08.903 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.903 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addrs": { 2020-09-08T15:34:08.904 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:08.908 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.908 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:08.908 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6804", 2020-09-08T15:34:08.908 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 70901 2020-09-08T15:34:08.908 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.909 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.909 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:08.909 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6805", 2020-09-08T15:34:08.909 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 70901 2020-09-08T15:34:08.909 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.910 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:08.910 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.910 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addrs": { 2020-09-08T15:34:08.910 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:08.911 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.911 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:08.911 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6808", 2020-09-08T15:34:08.911 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 70901 2020-09-08T15:34:08.911 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.911 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.912 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:08.912 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6809", 2020-09-08T15:34:08.912 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 70901 2020-09-08T15:34:08.912 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.912 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:08.913 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.913 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addrs": { 2020-09-08T15:34:08.913 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:08.913 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.913 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:08.914 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6806", 2020-09-08T15:34:08.915 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 70901 2020-09-08T15:34:08.915 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.915 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.915 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:08.915 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6807", 2020-09-08T15:34:08.916 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 70901 2020-09-08T15:34:08.916 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.916 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:08.916 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.916 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:6803/70901", 2020-09-08T15:34:08.917 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addr": "127.0.0.1:6805/70901", 2020-09-08T15:34:08.917 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addr": "127.0.0.1:6809/70901", 2020-09-08T15:34:08.917 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addr": "127.0.0.1:6807/70901", 2020-09-08T15:34:08.917 INFO:tasks.workunit.client.0.smithi065.stdout: "state": [ 2020-09-08T15:34:08.917 INFO:tasks.workunit.client.0.smithi065.stdout: "exists", 2020-09-08T15:34:08.917 INFO:tasks.workunit.client.0.smithi065.stdout: "up" 2020-09-08T15:34:08.918 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:08.918 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.918 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.918 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:34:08.918 INFO:tasks.workunit.client.0.smithi065.stdout: "uuid": "9638912c-2705-4309-bba1-4a617ae644ec", 2020-09-08T15:34:08.919 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 0, 2020-09-08T15:34:08.919 INFO:tasks.workunit.client.0.smithi065.stdout: "in": 1, 2020-09-08T15:34:08.919 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 1, 2020-09-08T15:34:08.919 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_affinity": 1, 2020-09-08T15:34:08.919 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_begin": 0, 2020-09-08T15:34:08.920 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_end": 0, 2020-09-08T15:34:08.920 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 10, 2020-09-08T15:34:08.920 INFO:tasks.workunit.client.0.smithi065.stdout: "up_thru": 25, 2020-09-08T15:34:08.920 INFO:tasks.workunit.client.0.smithi065.stdout: "down_at": 32, 2020-09-08T15:34:08.920 INFO:tasks.workunit.client.0.smithi065.stdout: "lost_at": 0, 2020-09-08T15:34:08.920 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:34:08.921 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:08.921 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.921 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:08.921 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6810", 2020-09-08T15:34:08.921 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 65648 2020-09-08T15:34:08.922 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.922 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.922 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:08.922 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6811", 2020-09-08T15:34:08.922 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 65648 2020-09-08T15:34:08.923 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.923 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:08.923 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.923 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addrs": { 2020-09-08T15:34:08.923 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:08.923 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.924 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:08.924 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6812", 2020-09-08T15:34:08.924 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 65648 2020-09-08T15:34:08.924 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.924 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.925 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:08.925 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6813", 2020-09-08T15:34:08.925 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 65648 2020-09-08T15:34:08.925 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.925 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:08.926 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.926 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addrs": { 2020-09-08T15:34:08.926 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:08.926 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.926 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:08.926 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6816", 2020-09-08T15:34:08.927 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 65648 2020-09-08T15:34:08.927 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.927 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.927 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:08.927 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6817", 2020-09-08T15:34:08.928 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 65648 2020-09-08T15:34:08.928 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.928 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:08.928 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.928 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addrs": { 2020-09-08T15:34:08.928 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:08.929 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.929 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:08.929 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6814", 2020-09-08T15:34:08.929 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 65648 2020-09-08T15:34:08.929 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.930 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.930 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:08.930 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6815", 2020-09-08T15:34:08.930 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 65648 2020-09-08T15:34:08.930 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.931 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:08.931 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.931 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:6811/65648", 2020-09-08T15:34:08.931 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addr": "127.0.0.1:6813/65648", 2020-09-08T15:34:08.931 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addr": "127.0.0.1:6817/65648", 2020-09-08T15:34:08.931 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addr": "127.0.0.1:6815/65648", 2020-09-08T15:34:08.932 INFO:tasks.workunit.client.0.smithi065.stdout: "state": [ 2020-09-08T15:34:08.932 INFO:tasks.workunit.client.0.smithi065.stdout: "exists" 2020-09-08T15:34:08.932 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:08.932 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.932 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.933 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:34:08.933 INFO:tasks.workunit.client.0.smithi065.stdout: "uuid": "e537af10-6bdf-47c4-9f94-34575593ecc4", 2020-09-08T15:34:08.933 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 1, 2020-09-08T15:34:08.933 INFO:tasks.workunit.client.0.smithi065.stdout: "in": 1, 2020-09-08T15:34:08.933 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 1, 2020-09-08T15:34:08.934 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_affinity": 1, 2020-09-08T15:34:08.934 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_begin": 15, 2020-09-08T15:34:08.934 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_end": 29, 2020-09-08T15:34:08.934 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 37, 2020-09-08T15:34:08.934 INFO:tasks.workunit.client.0.smithi065.stdout: "up_thru": 0, 2020-09-08T15:34:08.934 INFO:tasks.workunit.client.0.smithi065.stdout: "down_at": 33, 2020-09-08T15:34:08.935 INFO:tasks.workunit.client.0.smithi065.stdout: "lost_at": 0, 2020-09-08T15:34:08.935 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:34:08.935 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:08.935 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.935 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:08.936 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6810", 2020-09-08T15:34:08.936 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 71300 2020-09-08T15:34:08.936 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.936 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.936 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:08.936 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6811", 2020-09-08T15:34:08.937 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 71300 2020-09-08T15:34:08.937 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.937 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:08.937 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.937 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addrs": { 2020-09-08T15:34:08.938 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:08.938 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.938 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:08.938 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6812", 2020-09-08T15:34:08.938 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 71300 2020-09-08T15:34:08.938 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.939 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.939 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:08.939 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6813", 2020-09-08T15:34:08.939 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 71300 2020-09-08T15:34:08.939 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.940 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:08.940 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.940 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addrs": { 2020-09-08T15:34:08.940 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:08.940 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.941 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:08.941 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6816", 2020-09-08T15:34:08.941 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 71300 2020-09-08T15:34:08.941 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.941 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.941 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:08.942 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6817", 2020-09-08T15:34:08.942 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 71300 2020-09-08T15:34:08.942 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.942 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:08.942 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.943 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addrs": { 2020-09-08T15:34:08.943 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:08.943 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.943 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:08.943 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6814", 2020-09-08T15:34:08.944 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 71300 2020-09-08T15:34:08.944 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.944 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.944 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:08.944 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6815", 2020-09-08T15:34:08.944 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 71300 2020-09-08T15:34:08.945 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.945 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:08.945 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.945 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:6811/71300", 2020-09-08T15:34:08.945 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addr": "127.0.0.1:6813/71300", 2020-09-08T15:34:08.946 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addr": "127.0.0.1:6817/71300", 2020-09-08T15:34:08.946 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addr": "127.0.0.1:6815/71300", 2020-09-08T15:34:08.946 INFO:tasks.workunit.client.0.smithi065.stdout: "state": [ 2020-09-08T15:34:08.946 INFO:tasks.workunit.client.0.smithi065.stdout: "exists", 2020-09-08T15:34:08.947 INFO:tasks.workunit.client.0.smithi065.stdout: "up" 2020-09-08T15:34:08.947 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:08.947 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.947 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:08.947 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_xinfo": [ 2020-09-08T15:34:08.948 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.948 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:34:08.948 INFO:tasks.workunit.client.0.smithi065.stdout: "down_stamp": "2020-09-08T15:33:18.038924+0000", 2020-09-08T15:34:08.948 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_probability": 0, 2020-09-08T15:34:08.948 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_interval": 0, 2020-09-08T15:34:08.948 INFO:tasks.workunit.client.0.smithi065.stdout: "features": 4540138292837744639, 2020-09-08T15:34:08.949 INFO:tasks.workunit.client.0.smithi065.stdout: "old_weight": 0, 2020-09-08T15:34:08.949 INFO:tasks.workunit.client.0.smithi065.stdout: "last_purged_snaps_scrub": "2020-09-08T15:32:02.225707+0000", 2020-09-08T15:34:08.949 INFO:tasks.workunit.client.0.smithi065.stdout: "dead_epoch": 0 2020-09-08T15:34:08.949 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.949 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.950 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:34:08.950 INFO:tasks.workunit.client.0.smithi065.stdout: "down_stamp": "2020-09-08T15:33:18.622517+0000", 2020-09-08T15:34:08.950 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_probability": 0, 2020-09-08T15:34:08.950 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_interval": 0, 2020-09-08T15:34:08.950 INFO:tasks.workunit.client.0.smithi065.stdout: "features": 4540138292837744639, 2020-09-08T15:34:08.951 INFO:tasks.workunit.client.0.smithi065.stdout: "old_weight": 0, 2020-09-08T15:34:08.951 INFO:tasks.workunit.client.0.smithi065.stdout: "last_purged_snaps_scrub": "2020-09-08T15:32:10.387487+0000", 2020-09-08T15:34:08.951 INFO:tasks.workunit.client.0.smithi065.stdout: "dead_epoch": 0 2020-09-08T15:34:08.951 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.951 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.951 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:34:08.952 INFO:tasks.workunit.client.0.smithi065.stdout: "down_stamp": "2020-09-08T15:33:19.174102+0000", 2020-09-08T15:34:08.952 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_probability": 0, 2020-09-08T15:34:08.952 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_interval": 0, 2020-09-08T15:34:08.952 INFO:tasks.workunit.client.0.smithi065.stdout: "features": 4540138292837744639, 2020-09-08T15:34:08.952 INFO:tasks.workunit.client.0.smithi065.stdout: "old_weight": 0, 2020-09-08T15:34:08.953 INFO:tasks.workunit.client.0.smithi065.stdout: "last_purged_snaps_scrub": "2020-09-08T15:32:18.562920+0000", 2020-09-08T15:34:08.953 INFO:tasks.workunit.client.0.smithi065.stdout: "dead_epoch": 0 2020-09-08T15:34:08.953 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.953 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:08.953 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_upmap": [], 2020-09-08T15:34:08.954 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_upmap_items": [], 2020-09-08T15:34:08.954 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_temp": [], 2020-09-08T15:34:08.954 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_temp": [], 2020-09-08T15:34:08.955 INFO:tasks.workunit.client.0.smithi065.stdout: "blocklist": {}, 2020-09-08T15:34:08.955 INFO:tasks.workunit.client.0.smithi065.stdout: "erasure_code_profiles": { 2020-09-08T15:34:08.955 INFO:tasks.workunit.client.0.smithi065.stdout: "default": { 2020-09-08T15:34:08.955 INFO:tasks.workunit.client.0.smithi065.stdout: "k": "2", 2020-09-08T15:34:08.955 INFO:tasks.workunit.client.0.smithi065.stdout: "m": "2", 2020-09-08T15:34:08.955 INFO:tasks.workunit.client.0.smithi065.stdout: "plugin": "jerasure", 2020-09-08T15:34:08.956 INFO:tasks.workunit.client.0.smithi065.stdout: "technique": "reed_sol_van" 2020-09-08T15:34:08.956 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.956 INFO:tasks.workunit.client.0.smithi065.stdout: "myprofile": { 2020-09-08T15:34:08.956 INFO:tasks.workunit.client.0.smithi065.stdout: "crush-device-class": "", 2020-09-08T15:34:08.956 INFO:tasks.workunit.client.0.smithi065.stdout: "crush-failure-domain": "osd", 2020-09-08T15:34:08.957 INFO:tasks.workunit.client.0.smithi065.stdout: "crush-root": "default", 2020-09-08T15:34:08.957 INFO:tasks.workunit.client.0.smithi065.stdout: "jerasure-per-chunk-alignment": "false", 2020-09-08T15:34:08.957 INFO:tasks.workunit.client.0.smithi065.stdout: "k": "2", 2020-09-08T15:34:08.957 INFO:tasks.workunit.client.0.smithi065.stdout: "m": "1", 2020-09-08T15:34:08.957 INFO:tasks.workunit.client.0.smithi065.stdout: "plugin": "jerasure", 2020-09-08T15:34:08.958 INFO:tasks.workunit.client.0.smithi065.stdout: "technique": "reed_sol_van", 2020-09-08T15:34:08.958 INFO:tasks.workunit.client.0.smithi065.stdout: "w": "8" 2020-09-08T15:34:08.958 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.958 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.958 INFO:tasks.workunit.client.0.smithi065.stdout: "removed_snaps_queue": [], 2020-09-08T15:34:08.959 INFO:tasks.workunit.client.0.smithi065.stdout: "new_removed_snaps": [], 2020-09-08T15:34:08.959 INFO:tasks.workunit.client.0.smithi065.stdout: "new_purged_snaps": [], 2020-09-08T15:34:08.959 INFO:tasks.workunit.client.0.smithi065.stdout: "crush_node_flags": {}, 2020-09-08T15:34:08.959 INFO:tasks.workunit.client.0.smithi065.stdout: "device_class_flags": {} 2020-09-08T15:34:08.959 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.960 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_metadata": [ 2020-09-08T15:34:08.960 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.960 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:34:08.960 INFO:tasks.workunit.client.0.smithi065.stdout: "arch": "x86_64", 2020-09-08T15:34:08.960 INFO:tasks.workunit.client.0.smithi065.stdout: "back_addr": "[v2:127.0.0.1:6804/70901,v1:127.0.0.1:6805/70901]", 2020-09-08T15:34:08.960 INFO:tasks.workunit.client.0.smithi065.stdout: "back_iface": "", 2020-09-08T15:34:08.961 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs": "1", 2020-09-08T15:34:08.961 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_db": "0", 2020-09-08T15:34:08.961 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_wal": "0", 2020-09-08T15:34:08.961 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_single_shared_device": "1", 2020-09-08T15:34:08.961 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T15:34:08.962 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T15:34:08.962 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T15:34:08.962 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T15:34:08.962 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2020-09-08T15:34:08.962 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T15:34:08.963 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T15:34:08.963 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T15:34:08.963 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T15:34:08.963 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_release": "pacific", 2020-09-08T15:34:08.963 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version": "ceph version 16.0.0-5272-gdce4d291bd4 (dce4d291bd4243c9802c17d67b85a6da6bbc0f8f) pacific (dev)", 2020-09-08T15:34:08.963 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version_short": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:34:08.964 INFO:tasks.workunit.client.0.smithi065.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-09-08T15:34:08.964 INFO:tasks.workunit.client.0.smithi065.stdout: "default_device_class": "hdd", 2020-09-08T15:34:08.964 INFO:tasks.workunit.client.0.smithi065.stdout: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W4VHBH", 2020-09-08T15:34:08.964 INFO:tasks.workunit.client.0.smithi065.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2020-09-08T15:34:08.964 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": "sda", 2020-09-08T15:34:08.965 INFO:tasks.workunit.client.0.smithi065.stdout: "distro": "rhel", 2020-09-08T15:34:08.965 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_description": "Red Hat Enterprise Linux 8.1 (Ootpa)", 2020-09-08T15:34:08.965 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_version": "8.1", 2020-09-08T15:34:08.965 INFO:tasks.workunit.client.0.smithi065.stdout: "front_addr": "[v2:127.0.0.1:6802/70901,v1:127.0.0.1:6803/70901]", 2020-09-08T15:34:08.965 INFO:tasks.workunit.client.0.smithi065.stdout: "front_iface": "", 2020-09-08T15:34:08.966 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/70901,v1:127.0.0.1:6809/70901]", 2020-09-08T15:34:08.966 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/70901,v1:127.0.0.1:6807/70901]", 2020-09-08T15:34:08.966 INFO:tasks.workunit.client.0.smithi065.stdout: "hostname": "smithi065", 2020-09-08T15:34:08.966 INFO:tasks.workunit.client.0.smithi065.stdout: "journal_rotational": "1", 2020-09-08T15:34:08.966 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_description": "#1 SMP Fri Mar 27 14:35:58 UTC 2020", 2020-09-08T15:34:08.966 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_version": "4.18.0-193.el8.x86_64", 2020-09-08T15:34:08.967 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_swap_kb": "0", 2020-09-08T15:34:08.967 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_total_kb": "32653204", 2020-09-08T15:34:08.967 INFO:tasks.workunit.client.0.smithi065.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2020-09-08T15:34:08.967 INFO:tasks.workunit.client.0.smithi065.stdout: "objectstore_numa_unknown_devices": "sda", 2020-09-08T15:34:08.967 INFO:tasks.workunit.client.0.smithi065.stdout: "os": "Linux", 2020-09-08T15:34:08.968 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_data": "td/divergent-priors/0", 2020-09-08T15:34:08.968 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T15:34:08.968 INFO:tasks.workunit.client.0.smithi065.stdout: "osdspec_affinity": "", 2020-09-08T15:34:08.968 INFO:tasks.workunit.client.0.smithi065.stdout: "rotational": "1" 2020-09-08T15:34:08.968 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.968 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.969 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:34:08.969 INFO:tasks.workunit.client.0.smithi065.stdout: "arch": "x86_64", 2020-09-08T15:34:08.969 INFO:tasks.workunit.client.0.smithi065.stdout: "back_addr": "[v2:127.0.0.1:6812/65648,v1:127.0.0.1:6813/65648]", 2020-09-08T15:34:08.969 INFO:tasks.workunit.client.0.smithi065.stdout: "back_iface": "", 2020-09-08T15:34:08.969 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs": "1", 2020-09-08T15:34:08.970 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_db": "0", 2020-09-08T15:34:08.970 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_wal": "0", 2020-09-08T15:34:08.970 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_single_shared_device": "1", 2020-09-08T15:34:08.970 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T15:34:08.970 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T15:34:08.971 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T15:34:08.971 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T15:34:08.971 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2020-09-08T15:34:08.971 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T15:34:08.971 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T15:34:08.971 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T15:34:08.972 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T15:34:08.972 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_release": "pacific", 2020-09-08T15:34:08.972 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version": "ceph version 16.0.0-5272-gdce4d291bd4 (dce4d291bd4243c9802c17d67b85a6da6bbc0f8f) pacific (dev)", 2020-09-08T15:34:08.972 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version_short": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:34:08.972 INFO:tasks.workunit.client.0.smithi065.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-09-08T15:34:08.973 INFO:tasks.workunit.client.0.smithi065.stdout: "default_device_class": "hdd", 2020-09-08T15:34:08.973 INFO:tasks.workunit.client.0.smithi065.stdout: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W4VHBH", 2020-09-08T15:34:08.973 INFO:tasks.workunit.client.0.smithi065.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2020-09-08T15:34:08.973 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": "sda", 2020-09-08T15:34:08.973 INFO:tasks.workunit.client.0.smithi065.stdout: "distro": "rhel", 2020-09-08T15:34:08.974 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_description": "Red Hat Enterprise Linux 8.1 (Ootpa)", 2020-09-08T15:34:08.974 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_version": "8.1", 2020-09-08T15:34:08.974 INFO:tasks.workunit.client.0.smithi065.stdout: "front_addr": "[v2:127.0.0.1:6810/65648,v1:127.0.0.1:6811/65648]", 2020-09-08T15:34:08.974 INFO:tasks.workunit.client.0.smithi065.stdout: "front_iface": "", 2020-09-08T15:34:08.974 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/65648,v1:127.0.0.1:6817/65648]", 2020-09-08T15:34:08.974 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/65648,v1:127.0.0.1:6815/65648]", 2020-09-08T15:34:08.975 INFO:tasks.workunit.client.0.smithi065.stdout: "hostname": "smithi065", 2020-09-08T15:34:08.975 INFO:tasks.workunit.client.0.smithi065.stdout: "journal_rotational": "1", 2020-09-08T15:34:08.975 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_description": "#1 SMP Fri Mar 27 14:35:58 UTC 2020", 2020-09-08T15:34:08.975 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_version": "4.18.0-193.el8.x86_64", 2020-09-08T15:34:08.975 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_swap_kb": "0", 2020-09-08T15:34:08.976 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_total_kb": "32653204", 2020-09-08T15:34:08.976 INFO:tasks.workunit.client.0.smithi065.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2020-09-08T15:34:08.976 INFO:tasks.workunit.client.0.smithi065.stdout: "objectstore_numa_unknown_devices": "sda", 2020-09-08T15:34:08.976 INFO:tasks.workunit.client.0.smithi065.stdout: "os": "Linux", 2020-09-08T15:34:08.976 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_data": "td/divergent-priors/1", 2020-09-08T15:34:08.976 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T15:34:08.977 INFO:tasks.workunit.client.0.smithi065.stdout: "osdspec_affinity": "", 2020-09-08T15:34:08.977 INFO:tasks.workunit.client.0.smithi065.stdout: "rotational": "1" 2020-09-08T15:34:08.977 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.977 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.977 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:34:08.978 INFO:tasks.workunit.client.0.smithi065.stdout: "arch": "x86_64", 2020-09-08T15:34:08.978 INFO:tasks.workunit.client.0.smithi065.stdout: "back_addr": "[v2:127.0.0.1:6812/71300,v1:127.0.0.1:6813/71300]", 2020-09-08T15:34:08.978 INFO:tasks.workunit.client.0.smithi065.stdout: "back_iface": "", 2020-09-08T15:34:08.978 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs": "1", 2020-09-08T15:34:08.978 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_db": "0", 2020-09-08T15:34:08.979 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_wal": "0", 2020-09-08T15:34:08.979 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_single_shared_device": "1", 2020-09-08T15:34:08.979 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T15:34:08.979 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T15:34:08.979 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T15:34:08.979 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T15:34:08.980 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2020-09-08T15:34:08.980 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T15:34:08.980 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T15:34:08.980 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T15:34:08.980 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T15:34:08.981 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_release": "pacific", 2020-09-08T15:34:08.981 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version": "ceph version 16.0.0-5272-gdce4d291bd4 (dce4d291bd4243c9802c17d67b85a6da6bbc0f8f) pacific (dev)", 2020-09-08T15:34:08.981 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version_short": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:34:08.981 INFO:tasks.workunit.client.0.smithi065.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-09-08T15:34:08.981 INFO:tasks.workunit.client.0.smithi065.stdout: "default_device_class": "hdd", 2020-09-08T15:34:08.982 INFO:tasks.workunit.client.0.smithi065.stdout: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W4VHBH", 2020-09-08T15:34:08.982 INFO:tasks.workunit.client.0.smithi065.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2020-09-08T15:34:08.982 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": "sda", 2020-09-08T15:34:08.982 INFO:tasks.workunit.client.0.smithi065.stdout: "distro": "rhel", 2020-09-08T15:34:08.982 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_description": "Red Hat Enterprise Linux 8.1 (Ootpa)", 2020-09-08T15:34:08.982 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_version": "8.1", 2020-09-08T15:34:08.983 INFO:tasks.workunit.client.0.smithi065.stdout: "front_addr": "[v2:127.0.0.1:6810/71300,v1:127.0.0.1:6811/71300]", 2020-09-08T15:34:08.983 INFO:tasks.workunit.client.0.smithi065.stdout: "front_iface": "", 2020-09-08T15:34:08.983 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/71300,v1:127.0.0.1:6817/71300]", 2020-09-08T15:34:08.983 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/71300,v1:127.0.0.1:6815/71300]", 2020-09-08T15:34:08.983 INFO:tasks.workunit.client.0.smithi065.stdout: "hostname": "smithi065", 2020-09-08T15:34:08.984 INFO:tasks.workunit.client.0.smithi065.stdout: "journal_rotational": "1", 2020-09-08T15:34:08.984 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_description": "#1 SMP Fri Mar 27 14:35:58 UTC 2020", 2020-09-08T15:34:08.984 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_version": "4.18.0-193.el8.x86_64", 2020-09-08T15:34:08.984 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_swap_kb": "0", 2020-09-08T15:34:08.984 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_total_kb": "32653204", 2020-09-08T15:34:08.984 INFO:tasks.workunit.client.0.smithi065.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2020-09-08T15:34:08.985 INFO:tasks.workunit.client.0.smithi065.stdout: "objectstore_numa_unknown_devices": "sda", 2020-09-08T15:34:08.985 INFO:tasks.workunit.client.0.smithi065.stdout: "os": "Linux", 2020-09-08T15:34:08.985 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_data": "td/divergent-priors/2", 2020-09-08T15:34:08.985 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T15:34:08.985 INFO:tasks.workunit.client.0.smithi065.stdout: "osdspec_affinity": "", 2020-09-08T15:34:08.986 INFO:tasks.workunit.client.0.smithi065.stdout: "rotational": "1" 2020-09-08T15:34:08.986 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.986 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:08.986 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap_clean_epochs": { 2020-09-08T15:34:08.986 INFO:tasks.workunit.client.0.smithi065.stdout: "min_last_epoch_clean": 0, 2020-09-08T15:34:08.987 INFO:tasks.workunit.client.0.smithi065.stdout: "last_epoch_clean": { 2020-09-08T15:34:08.987 INFO:tasks.workunit.client.0.smithi065.stdout: "per_pool": [] 2020-09-08T15:34:08.987 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.987 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_epochs": [ 2020-09-08T15:34:08.987 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.987 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:34:08.988 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 36 2020-09-08T15:34:08.988 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.988 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.988 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:34:08.988 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 10 2020-09-08T15:34:08.989 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.989 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.989 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:34:08.989 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 38 2020-09-08T15:34:08.989 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.990 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:08.990 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.990 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap_first_committed": 1, 2020-09-08T15:34:08.990 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap_last_committed": 40, 2020-09-08T15:34:08.990 INFO:tasks.workunit.client.0.smithi065.stdout: "crushmap": { 2020-09-08T15:34:08.991 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": [ 2020-09-08T15:34:08.991 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.991 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:34:08.991 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd.0", 2020-09-08T15:34:08.991 INFO:tasks.workunit.client.0.smithi065.stdout: "class": "hdd" 2020-09-08T15:34:08.991 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.992 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.992 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:34:08.992 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd.1", 2020-09-08T15:34:08.992 INFO:tasks.workunit.client.0.smithi065.stdout: "class": "hdd" 2020-09-08T15:34:08.992 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.993 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.993 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:34:08.993 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd.2", 2020-09-08T15:34:08.993 INFO:tasks.workunit.client.0.smithi065.stdout: "class": "hdd" 2020-09-08T15:34:08.993 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:08.993 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:08.994 INFO:tasks.workunit.client.0.smithi065.stdout: "types": [ 2020-09-08T15:34:08.994 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.994 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 0, 2020-09-08T15:34:08.994 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd" 2020-09-08T15:34:08.994 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.995 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.995 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 1, 2020-09-08T15:34:08.995 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "host" 2020-09-08T15:34:08.995 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.995 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.996 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 2, 2020-09-08T15:34:08.996 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "chassis" 2020-09-08T15:34:08.996 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.996 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.996 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 3, 2020-09-08T15:34:08.996 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "rack" 2020-09-08T15:34:08.997 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.997 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.997 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 4, 2020-09-08T15:34:08.997 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "row" 2020-09-08T15:34:08.997 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.998 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.998 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 5, 2020-09-08T15:34:08.998 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "pdu" 2020-09-08T15:34:08.998 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.998 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.998 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 6, 2020-09-08T15:34:08.999 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "pod" 2020-09-08T15:34:08.999 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:08.999 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:08.999 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 7, 2020-09-08T15:34:08.999 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "room" 2020-09-08T15:34:09.000 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.000 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.000 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 8, 2020-09-08T15:34:09.000 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "datacenter" 2020-09-08T15:34:09.000 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.001 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.001 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 9, 2020-09-08T15:34:09.001 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "zone" 2020-09-08T15:34:09.001 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.001 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.001 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 10, 2020-09-08T15:34:09.002 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "region" 2020-09-08T15:34:09.002 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.002 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.002 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 11, 2020-09-08T15:34:09.002 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "root" 2020-09-08T15:34:09.003 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:09.003 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:09.003 INFO:tasks.workunit.client.0.smithi065.stdout: "buckets": [ 2020-09-08T15:34:09.003 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.003 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -1, 2020-09-08T15:34:09.003 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "default", 2020-09-08T15:34:09.004 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 11, 2020-09-08T15:34:09.004 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "root", 2020-09-08T15:34:09.004 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:34:09.004 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:34:09.004 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:34:09.005 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:34:09.005 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.005 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -3, 2020-09-08T15:34:09.005 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:34:09.005 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:34:09.006 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:09.006 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:09.006 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.006 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.006 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -2, 2020-09-08T15:34:09.006 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "default~hdd", 2020-09-08T15:34:09.007 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 11, 2020-09-08T15:34:09.007 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "root", 2020-09-08T15:34:09.007 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:34:09.007 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:34:09.007 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:34:09.008 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:34:09.008 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.008 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -4, 2020-09-08T15:34:09.008 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:34:09.008 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:34:09.008 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:09.009 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:09.009 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.009 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.009 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -3, 2020-09-08T15:34:09.009 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "smithi065", 2020-09-08T15:34:09.010 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 1, 2020-09-08T15:34:09.010 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "host", 2020-09-08T15:34:09.010 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:34:09.010 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:34:09.010 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:34:09.011 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:34:09.011 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.011 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:34:09.011 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:34:09.011 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:34:09.011 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.012 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.012 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:34:09.012 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:34:09.012 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 1 2020-09-08T15:34:09.012 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.013 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.013 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:34:09.013 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:34:09.013 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 2 2020-09-08T15:34:09.013 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:09.013 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:09.014 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.014 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.014 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -4, 2020-09-08T15:34:09.014 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "smithi065~hdd", 2020-09-08T15:34:09.014 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 1, 2020-09-08T15:34:09.015 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "host", 2020-09-08T15:34:09.015 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:34:09.015 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:34:09.015 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:34:09.015 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:34:09.015 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.016 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:34:09.016 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:34:09.016 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:34:09.016 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.016 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.017 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:34:09.017 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:34:09.017 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 1 2020-09-08T15:34:09.017 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.017 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.018 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:34:09.018 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:34:09.018 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 2 2020-09-08T15:34:09.018 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:09.018 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:09.018 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:09.019 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:09.019 INFO:tasks.workunit.client.0.smithi065.stdout: "rules": [ 2020-09-08T15:34:09.019 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.019 INFO:tasks.workunit.client.0.smithi065.stdout: "rule_id": 0, 2020-09-08T15:34:09.019 INFO:tasks.workunit.client.0.smithi065.stdout: "rule_name": "replicated_rule", 2020-09-08T15:34:09.020 INFO:tasks.workunit.client.0.smithi065.stdout: "ruleset": 0, 2020-09-08T15:34:09.020 INFO:tasks.workunit.client.0.smithi065.stdout: "type": 1, 2020-09-08T15:34:09.020 INFO:tasks.workunit.client.0.smithi065.stdout: "min_size": 1, 2020-09-08T15:34:09.020 INFO:tasks.workunit.client.0.smithi065.stdout: "max_size": 10, 2020-09-08T15:34:09.020 INFO:tasks.workunit.client.0.smithi065.stdout: "steps": [ 2020-09-08T15:34:09.020 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.021 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "take", 2020-09-08T15:34:09.021 INFO:tasks.workunit.client.0.smithi065.stdout: "item": -1, 2020-09-08T15:34:09.021 INFO:tasks.workunit.client.0.smithi065.stdout: "item_name": "default" 2020-09-08T15:34:09.021 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.021 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.022 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "choose_firstn", 2020-09-08T15:34:09.022 INFO:tasks.workunit.client.0.smithi065.stdout: "num": 0, 2020-09-08T15:34:09.022 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "osd" 2020-09-08T15:34:09.022 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.022 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.023 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "emit" 2020-09-08T15:34:09.023 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:09.023 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:09.023 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.023 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.023 INFO:tasks.workunit.client.0.smithi065.stdout: "rule_id": 1, 2020-09-08T15:34:09.024 INFO:tasks.workunit.client.0.smithi065.stdout: "rule_name": "test", 2020-09-08T15:34:09.024 INFO:tasks.workunit.client.0.smithi065.stdout: "ruleset": 1, 2020-09-08T15:34:09.024 INFO:tasks.workunit.client.0.smithi065.stdout: "type": 3, 2020-09-08T15:34:09.024 INFO:tasks.workunit.client.0.smithi065.stdout: "min_size": 3, 2020-09-08T15:34:09.024 INFO:tasks.workunit.client.0.smithi065.stdout: "max_size": 3, 2020-09-08T15:34:09.025 INFO:tasks.workunit.client.0.smithi065.stdout: "steps": [ 2020-09-08T15:34:09.025 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.025 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "set_chooseleaf_tries", 2020-09-08T15:34:09.025 INFO:tasks.workunit.client.0.smithi065.stdout: "num": 5 2020-09-08T15:34:09.025 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.025 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.026 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "set_choose_tries", 2020-09-08T15:34:09.026 INFO:tasks.workunit.client.0.smithi065.stdout: "num": 100 2020-09-08T15:34:09.026 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.026 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.026 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "take", 2020-09-08T15:34:09.027 INFO:tasks.workunit.client.0.smithi065.stdout: "item": -1, 2020-09-08T15:34:09.027 INFO:tasks.workunit.client.0.smithi065.stdout: "item_name": "default" 2020-09-08T15:34:09.027 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.027 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.027 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "choose_indep", 2020-09-08T15:34:09.027 INFO:tasks.workunit.client.0.smithi065.stdout: "num": 0, 2020-09-08T15:34:09.028 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "osd" 2020-09-08T15:34:09.028 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.028 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.028 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "emit" 2020-09-08T15:34:09.028 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:09.029 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:09.029 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:09.029 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:09.029 INFO:tasks.workunit.client.0.smithi065.stdout: "tunables": { 2020-09-08T15:34:09.029 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_local_tries": 0, 2020-09-08T15:34:09.030 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_local_fallback_tries": 0, 2020-09-08T15:34:09.030 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_total_tries": 50, 2020-09-08T15:34:09.030 INFO:tasks.workunit.client.0.smithi065.stdout: "chooseleaf_descend_once": 1, 2020-09-08T15:34:09.030 INFO:tasks.workunit.client.0.smithi065.stdout: "chooseleaf_vary_r": 1, 2020-09-08T15:34:09.030 INFO:tasks.workunit.client.0.smithi065.stdout: "chooseleaf_stable": 1, 2020-09-08T15:34:09.030 INFO:tasks.workunit.client.0.smithi065.stdout: "straw_calc_version": 1, 2020-09-08T15:34:09.031 INFO:tasks.workunit.client.0.smithi065.stdout: "allowed_bucket_algs": 54, 2020-09-08T15:34:09.031 INFO:tasks.workunit.client.0.smithi065.stdout: "profile": "jewel", 2020-09-08T15:34:09.031 INFO:tasks.workunit.client.0.smithi065.stdout: "optimal_tunables": 1, 2020-09-08T15:34:09.031 INFO:tasks.workunit.client.0.smithi065.stdout: "legacy_tunables": 0, 2020-09-08T15:34:09.031 INFO:tasks.workunit.client.0.smithi065.stdout: "minimum_required_version": "jewel", 2020-09-08T15:34:09.032 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables": 1, 2020-09-08T15:34:09.032 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables2": 1, 2020-09-08T15:34:09.032 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v2_rules": 1, 2020-09-08T15:34:09.032 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables3": 1, 2020-09-08T15:34:09.032 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v3_rules": 0, 2020-09-08T15:34:09.032 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v4_buckets": 1, 2020-09-08T15:34:09.033 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables5": 1, 2020-09-08T15:34:09.033 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v5_rules": 0 2020-09-08T15:34:09.033 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.033 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_args": {} 2020-09-08T15:34:09.033 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.034 INFO:tasks.workunit.client.0.smithi065.stdout: "fsmap": { 2020-09-08T15:34:09.034 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 1, 2020-09-08T15:34:09.034 INFO:tasks.workunit.client.0.smithi065.stdout: "default_fscid": -1, 2020-09-08T15:34:09.034 INFO:tasks.workunit.client.0.smithi065.stdout: "compat": { 2020-09-08T15:34:09.034 INFO:tasks.workunit.client.0.smithi065.stdout: "compat": {}, 2020-09-08T15:34:09.034 INFO:tasks.workunit.client.0.smithi065.stdout: "ro_compat": {}, 2020-09-08T15:34:09.035 INFO:tasks.workunit.client.0.smithi065.stdout: "incompat": { 2020-09-08T15:34:09.035 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_1": "base v0.20", 2020-09-08T15:34:09.035 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_2": "client writeable ranges", 2020-09-08T15:34:09.035 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_3": "default file layouts on dirs", 2020-09-08T15:34:09.035 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_4": "dir inode in separate object", 2020-09-08T15:34:09.036 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_5": "mds uses versioned encoding", 2020-09-08T15:34:09.036 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_6": "dirfrag is stored in omap", 2020-09-08T15:34:09.036 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_8": "no anchor table", 2020-09-08T15:34:09.036 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_9": "file layout v2", 2020-09-08T15:34:09.036 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_10": "snaprealm v2" 2020-09-08T15:34:09.037 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:09.037 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.037 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_flags": { 2020-09-08T15:34:09.037 INFO:tasks.workunit.client.0.smithi065.stdout: "enable_multiple": false, 2020-09-08T15:34:09.037 INFO:tasks.workunit.client.0.smithi065.stdout: "ever_enabled_multiple": false 2020-09-08T15:34:09.037 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.038 INFO:tasks.workunit.client.0.smithi065.stdout: "standbys": [], 2020-09-08T15:34:09.038 INFO:tasks.workunit.client.0.smithi065.stdout: "filesystems": [] 2020-09-08T15:34:09.038 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.038 INFO:tasks.workunit.client.0.smithi065.stdout: "mdsmap_first_committed": 1, 2020-09-08T15:34:09.038 INFO:tasks.workunit.client.0.smithi065.stdout: "mdsmap_last_committed": 1, 2020-09-08T15:34:09.039 INFO:tasks.workunit.client.0.smithi065.stdout: "auth": { 2020-09-08T15:34:09.039 INFO:tasks.workunit.client.0.smithi065.stdout: "first_committed": 1, 2020-09-08T15:34:09.039 INFO:tasks.workunit.client.0.smithi065.stdout: "last_committed": 5, 2020-09-08T15:34:09.039 INFO:tasks.workunit.client.0.smithi065.stdout: "num_secrets": 3 2020-09-08T15:34:09.039 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.039 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg": 1, 2020-09-08T15:34:09.040 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_active": 1, 2020-09-08T15:34:09.040 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_unknown": 0, 2020-09-08T15:34:09.040 INFO:tasks.workunit.client.0.smithi065.stdout: "num_osd": 3, 2020-09-08T15:34:09.040 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_sum": { 2020-09-08T15:34:09.040 INFO:tasks.workunit.client.0.smithi065.stdout: "stat_sum": { 2020-09-08T15:34:09.041 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes": 48430, 2020-09-08T15:34:09.041 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects": 101, 2020-09-08T15:34:09.041 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_clones": 1, 2020-09-08T15:34:09.041 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_copies": 303, 2020-09-08T15:34:09.041 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing_on_primary": 0, 2020-09-08T15:34:09.042 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing": 0, 2020-09-08T15:34:09.042 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_degraded": 101, 2020-09-08T15:34:09.042 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_misplaced": 0, 2020-09-08T15:34:09.042 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_unfound": 0, 2020-09-08T15:34:09.042 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_dirty": 101, 2020-09-08T15:34:09.042 INFO:tasks.workunit.client.0.smithi065.stdout: "num_whiteouts": 0, 2020-09-08T15:34:09.049 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read": 0, 2020-09-08T15:34:09.049 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read_kb": 0, 2020-09-08T15:34:09.049 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write": 101, 2020-09-08T15:34:09.049 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write_kb": 101, 2020-09-08T15:34:09.049 INFO:tasks.workunit.client.0.smithi065.stdout: "num_scrub_errors": 0, 2020-09-08T15:34:09.050 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shallow_scrub_errors": 0, 2020-09-08T15:34:09.050 INFO:tasks.workunit.client.0.smithi065.stdout: "num_deep_scrub_errors": 0, 2020-09-08T15:34:09.050 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_recovered": 0, 2020-09-08T15:34:09.050 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_recovered": 0, 2020-09-08T15:34:09.050 INFO:tasks.workunit.client.0.smithi065.stdout: "num_keys_recovered": 0, 2020-09-08T15:34:09.050 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_omap": 0, 2020-09-08T15:34:09.051 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_hit_set_archive": 0, 2020-09-08T15:34:09.051 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_hit_set_archive": 0, 2020-09-08T15:34:09.051 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush": 0, 2020-09-08T15:34:09.051 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_kb": 0, 2020-09-08T15:34:09.051 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict": 0, 2020-09-08T15:34:09.052 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_kb": 0, 2020-09-08T15:34:09.052 INFO:tasks.workunit.client.0.smithi065.stdout: "num_promote": 0, 2020-09-08T15:34:09.052 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_high": 0, 2020-09-08T15:34:09.052 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_low": 0, 2020-09-08T15:34:09.052 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_some": 0, 2020-09-08T15:34:09.053 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_full": 0, 2020-09-08T15:34:09.053 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_pinned": 0, 2020-09-08T15:34:09.053 INFO:tasks.workunit.client.0.smithi065.stdout: "num_legacy_snapsets": 0, 2020-09-08T15:34:09.053 INFO:tasks.workunit.client.0.smithi065.stdout: "num_large_omap_objects": 0, 2020-09-08T15:34:09.053 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_manifest": 0, 2020-09-08T15:34:09.053 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_bytes": 0, 2020-09-08T15:34:09.054 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_keys": 0, 2020-09-08T15:34:09.054 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_repaired": 0 2020-09-08T15:34:09.054 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.054 INFO:tasks.workunit.client.0.smithi065.stdout: "store_stats": { 2020-09-08T15:34:09.054 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 0, 2020-09-08T15:34:09.055 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 0, 2020-09-08T15:34:09.055 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:34:09.055 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 0, 2020-09-08T15:34:09.055 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 0, 2020-09-08T15:34:09.055 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:34:09.055 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:34:09.056 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:34:09.056 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 0, 2020-09-08T15:34:09.056 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 0 2020-09-08T15:34:09.056 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.056 INFO:tasks.workunit.client.0.smithi065.stdout: "log_size": 18, 2020-09-08T15:34:09.057 INFO:tasks.workunit.client.0.smithi065.stdout: "ondisk_log_size": 18, 2020-09-08T15:34:09.057 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 3, 2020-09-08T15:34:09.057 INFO:tasks.workunit.client.0.smithi065.stdout: "acting": 3, 2020-09-08T15:34:09.057 INFO:tasks.workunit.client.0.smithi065.stdout: "num_store_stats": 0 2020-09-08T15:34:09.057 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.058 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_sum": { 2020-09-08T15:34:09.058 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 0, 2020-09-08T15:34:09.058 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 0, 2020-09-08T15:34:09.058 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pgs": 3, 2020-09-08T15:34:09.058 INFO:tasks.workunit.client.0.smithi065.stdout: "num_osds": 3, 2020-09-08T15:34:09.058 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_osds": 3, 2020-09-08T15:34:09.059 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_omap_osds": 3, 2020-09-08T15:34:09.059 INFO:tasks.workunit.client.0.smithi065.stdout: "kb": 314572800, 2020-09-08T15:34:09.059 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used": 18400, 2020-09-08T15:34:09.059 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_data": 2116, 2020-09-08T15:34:09.059 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_omap": 1, 2020-09-08T15:34:09.060 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_meta": 16254, 2020-09-08T15:34:09.060 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_avail": 314554400, 2020-09-08T15:34:09.060 INFO:tasks.workunit.client.0.smithi065.stdout: "statfs": { 2020-09-08T15:34:09.060 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 322122547200, 2020-09-08T15:34:09.060 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 322103705600, 2020-09-08T15:34:09.060 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:34:09.061 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 2166784, 2020-09-08T15:34:09.061 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 1523781, 2020-09-08T15:34:09.061 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:34:09.061 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:34:09.061 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:34:09.062 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 1928, 2020-09-08T15:34:09.062 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 16644216 2020-09-08T15:34:09.062 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.062 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_peers": [], 2020-09-08T15:34:09.062 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_trim_queue_len": 0, 2020-09-08T15:34:09.063 INFO:tasks.workunit.client.0.smithi065.stdout: "num_snap_trimming": 0, 2020-09-08T15:34:09.063 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shards_repaired": 0, 2020-09-08T15:34:09.063 INFO:tasks.workunit.client.0.smithi065.stdout: "op_queue_age_hist": { 2020-09-08T15:34:09.063 INFO:tasks.workunit.client.0.smithi065.stdout: "histogram": [], 2020-09-08T15:34:09.063 INFO:tasks.workunit.client.0.smithi065.stdout: "upper_bound": 1 2020-09-08T15:34:09.063 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.064 INFO:tasks.workunit.client.0.smithi065.stdout: "perf_stat": { 2020-09-08T15:34:09.064 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ms": 0, 2020-09-08T15:34:09.064 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ms": 0, 2020-09-08T15:34:09.064 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ns": 0, 2020-09-08T15:34:09.064 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ns": 0 2020-09-08T15:34:09.065 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.065 INFO:tasks.workunit.client.0.smithi065.stdout: "alerts": [], 2020-09-08T15:34:09.065 INFO:tasks.workunit.client.0.smithi065.stdout: "network_ping_times": [] 2020-09-08T15:34:09.065 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.065 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_sum_by_class": { 2020-09-08T15:34:09.066 INFO:tasks.workunit.client.0.smithi065.stdout: "hdd": { 2020-09-08T15:34:09.066 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 0, 2020-09-08T15:34:09.066 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 0, 2020-09-08T15:34:09.066 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pgs": 3, 2020-09-08T15:34:09.066 INFO:tasks.workunit.client.0.smithi065.stdout: "num_osds": 3, 2020-09-08T15:34:09.066 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_osds": 3, 2020-09-08T15:34:09.067 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_omap_osds": 3, 2020-09-08T15:34:09.067 INFO:tasks.workunit.client.0.smithi065.stdout: "kb": 314572800, 2020-09-08T15:34:09.067 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used": 18400, 2020-09-08T15:34:09.067 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_data": 2116, 2020-09-08T15:34:09.067 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_omap": 1, 2020-09-08T15:34:09.068 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_meta": 16254, 2020-09-08T15:34:09.068 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_avail": 314554400, 2020-09-08T15:34:09.068 INFO:tasks.workunit.client.0.smithi065.stdout: "statfs": { 2020-09-08T15:34:09.068 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 322122547200, 2020-09-08T15:34:09.068 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 322103705600, 2020-09-08T15:34:09.068 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:34:09.069 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 2166784, 2020-09-08T15:34:09.069 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 1523781, 2020-09-08T15:34:09.069 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:34:09.069 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:34:09.069 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:34:09.070 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 1928, 2020-09-08T15:34:09.070 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 16644216 2020-09-08T15:34:09.070 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.070 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_peers": [], 2020-09-08T15:34:09.070 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_trim_queue_len": 0, 2020-09-08T15:34:09.070 INFO:tasks.workunit.client.0.smithi065.stdout: "num_snap_trimming": 0, 2020-09-08T15:34:09.071 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shards_repaired": 0, 2020-09-08T15:34:09.071 INFO:tasks.workunit.client.0.smithi065.stdout: "op_queue_age_hist": { 2020-09-08T15:34:09.071 INFO:tasks.workunit.client.0.smithi065.stdout: "histogram": [], 2020-09-08T15:34:09.071 INFO:tasks.workunit.client.0.smithi065.stdout: "upper_bound": 1 2020-09-08T15:34:09.071 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.072 INFO:tasks.workunit.client.0.smithi065.stdout: "perf_stat": { 2020-09-08T15:34:09.072 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ms": 0, 2020-09-08T15:34:09.072 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ms": 0, 2020-09-08T15:34:09.072 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ns": 0, 2020-09-08T15:34:09.072 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ns": 0 2020-09-08T15:34:09.073 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.073 INFO:tasks.workunit.client.0.smithi065.stdout: "alerts": [], 2020-09-08T15:34:09.073 INFO:tasks.workunit.client.0.smithi065.stdout: "network_ping_times": [] 2020-09-08T15:34:09.073 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:09.073 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.073 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_stats": [ 2020-09-08T15:34:09.074 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.074 INFO:tasks.workunit.client.0.smithi065.stdout: "poolid": 1, 2020-09-08T15:34:09.074 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg": 1, 2020-09-08T15:34:09.074 INFO:tasks.workunit.client.0.smithi065.stdout: "stat_sum": { 2020-09-08T15:34:09.074 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes": 48430, 2020-09-08T15:34:09.075 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects": 101, 2020-09-08T15:34:09.075 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_clones": 1, 2020-09-08T15:34:09.075 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_copies": 303, 2020-09-08T15:34:09.075 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing_on_primary": 0, 2020-09-08T15:34:09.075 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing": 0, 2020-09-08T15:34:09.075 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_degraded": 101, 2020-09-08T15:34:09.076 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_misplaced": 0, 2020-09-08T15:34:09.076 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_unfound": 0, 2020-09-08T15:34:09.076 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_dirty": 101, 2020-09-08T15:34:09.076 INFO:tasks.workunit.client.0.smithi065.stdout: "num_whiteouts": 0, 2020-09-08T15:34:09.076 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read": 0, 2020-09-08T15:34:09.077 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read_kb": 0, 2020-09-08T15:34:09.077 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write": 101, 2020-09-08T15:34:09.077 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write_kb": 101, 2020-09-08T15:34:09.077 INFO:tasks.workunit.client.0.smithi065.stdout: "num_scrub_errors": 0, 2020-09-08T15:34:09.077 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shallow_scrub_errors": 0, 2020-09-08T15:34:09.077 INFO:tasks.workunit.client.0.smithi065.stdout: "num_deep_scrub_errors": 0, 2020-09-08T15:34:09.078 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_recovered": 0, 2020-09-08T15:34:09.078 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_recovered": 0, 2020-09-08T15:34:09.078 INFO:tasks.workunit.client.0.smithi065.stdout: "num_keys_recovered": 0, 2020-09-08T15:34:09.078 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_omap": 0, 2020-09-08T15:34:09.078 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_hit_set_archive": 0, 2020-09-08T15:34:09.079 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_hit_set_archive": 0, 2020-09-08T15:34:09.079 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush": 0, 2020-09-08T15:34:09.079 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_kb": 0, 2020-09-08T15:34:09.079 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict": 0, 2020-09-08T15:34:09.079 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_kb": 0, 2020-09-08T15:34:09.080 INFO:tasks.workunit.client.0.smithi065.stdout: "num_promote": 0, 2020-09-08T15:34:09.080 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_high": 0, 2020-09-08T15:34:09.080 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_low": 0, 2020-09-08T15:34:09.080 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_some": 0, 2020-09-08T15:34:09.080 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_full": 0, 2020-09-08T15:34:09.080 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_pinned": 0, 2020-09-08T15:34:09.081 INFO:tasks.workunit.client.0.smithi065.stdout: "num_legacy_snapsets": 0, 2020-09-08T15:34:09.081 INFO:tasks.workunit.client.0.smithi065.stdout: "num_large_omap_objects": 0, 2020-09-08T15:34:09.081 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_manifest": 0, 2020-09-08T15:34:09.081 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_bytes": 0, 2020-09-08T15:34:09.081 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_keys": 0, 2020-09-08T15:34:09.082 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_repaired": 0 2020-09-08T15:34:09.082 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.082 INFO:tasks.workunit.client.0.smithi065.stdout: "store_stats": { 2020-09-08T15:34:09.082 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 0, 2020-09-08T15:34:09.082 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 0, 2020-09-08T15:34:09.082 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:34:09.083 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 1241088, 2020-09-08T15:34:09.083 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 1241088, 2020-09-08T15:34:09.083 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:34:09.083 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:34:09.083 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:34:09.084 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 0, 2020-09-08T15:34:09.084 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 0 2020-09-08T15:34:09.084 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.084 INFO:tasks.workunit.client.0.smithi065.stdout: "log_size": 18, 2020-09-08T15:34:09.084 INFO:tasks.workunit.client.0.smithi065.stdout: "ondisk_log_size": 18, 2020-09-08T15:34:09.084 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 3, 2020-09-08T15:34:09.085 INFO:tasks.workunit.client.0.smithi065.stdout: "acting": 3, 2020-09-08T15:34:09.085 INFO:tasks.workunit.client.0.smithi065.stdout: "num_store_stats": 3 2020-09-08T15:34:09.085 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:09.085 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:09.085 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_stats": [ 2020-09-08T15:34:09.086 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.086 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:34:09.086 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 154618822668 2020-09-08T15:34:09.086 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.086 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.087 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:34:09.087 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 42949672982 2020-09-08T15:34:09.087 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.087 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.087 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:34:09.087 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 158913789963 2020-09-08T15:34:09.088 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:09.088 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:09.088 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_by_state": [ 2020-09-08T15:34:09.088 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.088 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "active+undersized+degraded", 2020-09-08T15:34:09.089 INFO:tasks.workunit.client.0.smithi065.stdout: "num": 1 2020-09-08T15:34:09.089 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:09.089 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:09.089 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_by_osd": [ 2020-09-08T15:34:09.089 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.089 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:34:09.090 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 0, 2020-09-08T15:34:09.090 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 1, 2020-09-08T15:34:09.090 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:34:09.090 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.090 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.091 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2147483647, 2020-09-08T15:34:09.091 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 0, 2020-09-08T15:34:09.091 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 1, 2020-09-08T15:34:09.091 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:34:09.091 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.092 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.092 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:34:09.092 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 0, 2020-09-08T15:34:09.092 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 0, 2020-09-08T15:34:09.092 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:34:09.093 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.093 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.093 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:34:09.093 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 1, 2020-09-08T15:34:09.093 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 1, 2020-09-08T15:34:09.093 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:34:09.094 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:09.094 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:09.094 INFO:tasks.workunit.client.0.smithi065.stdout: "purged_snaps": [ 2020-09-08T15:34:09.094 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:09.094 INFO:tasks.workunit.client.0.smithi065.stdout: "pool": 1, 2020-09-08T15:34:09.095 INFO:tasks.workunit.client.0.smithi065.stdout: "purged_snaps": {} 2020-09-08T15:34:09.095 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:09.095 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:09.095 INFO:tasks.workunit.client.0.smithi065.stdout: "servicemap": { 2020-09-08T15:34:09.095 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 5, 2020-09-08T15:34:09.096 INFO:tasks.workunit.client.0.smithi065.stdout: "modified": "2020-09-08T15:33:19.890788+0000", 2020-09-08T15:34:09.096 INFO:tasks.workunit.client.0.smithi065.stdout: "services": {} 2020-09-08T15:34:09.096 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:09.096 INFO:tasks.workunit.client.0.smithi065.stdout: "paxos": { 2020-09-08T15:34:09.096 INFO:tasks.workunit.client.0.smithi065.stdout: "first_committed": 1, 2020-09-08T15:34:09.096 INFO:tasks.workunit.client.0.smithi065.stdout: "last_committed": 389, 2020-09-08T15:34:09.097 INFO:tasks.workunit.client.0.smithi065.stdout: "last_pn": 0, 2020-09-08T15:34:09.097 INFO:tasks.workunit.client.0.smithi065.stdout: "accepted_pn": 0 2020-09-08T15:34:09.097 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:09.097 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:34:09.099 INFO:tasks.workunit.client.0.smithi065.stderr:report 3792856514 2020-09-08T15:34:09.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1604: wait_for_clean: return 1 2020-09-08T15:34:09.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2020-09-08T15:34:09.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.0 2020-09-08T15:34:09.100 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:34:09.100 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:34:09.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:34:09.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:34:09.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:34:09.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:34:09.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 0 --op log --pgid 1.0 2020-09-08T15:34:09.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local dir=td/divergent-priors 2020-09-08T15:34:09.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2020-09-08T15:34:09.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local id=0 2020-09-08T15:34:09.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1198: _objectstore_tool_nodown: shift 2020-09-08T15:34:09.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: _objectstore_tool_nodown: local osd_data=td/divergent-priors/0 2020-09-08T15:34:09.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1202: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/0 --op log --pgid 1.0 2020-09-08T15:34:09.939 INFO:tasks.workunit.client.0.smithi065.stderr:PG '1.0' not found 2020-09-08T15:34:10.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1203: _objectstore_tool_nodown: return 1 2020-09-08T15:34:10.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 0 2020-09-08T15:34:10.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/divergent-priors 2020-09-08T15:34:10.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:34:10.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=0 2020-09-08T15:34:10.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:34:10.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/divergent-priors/0 2020-09-08T15:34:10.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:34:10.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:34:10.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:34:10.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:34:10.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2020-09-08T15:34:10.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2020-09-08T15:34:10.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:34:10.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:34:10.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:34:10.216 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:34:10.216 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:34:10.216 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:34:10.217 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:34:10.217 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:34:10.217 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:34:10.217 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:34:10.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:34:10.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:34:10.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:34:10.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:34:10.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:34:10.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:34:10.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:34:10.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:34:10.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:34:10.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/divergent-priors/0 2020-09-08T15:34:10.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.0 2020-09-08T15:34:10.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 0 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:34:10.220 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/divergent-priors/0/whoami 2020-09-08T15:34:10.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 0 = 0 ']' 2020-09-08T15:34:10.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:34:10.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:34:10.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:34:10.221 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T15:34:10.240 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:34:10.244+0000 7f0f89708ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:34:10.242 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:34:10.247+0000 7f0f89708ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:34:10.244 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:34:10.249+0000 7f0f89708ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:34:10.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 0 2020-09-08T15:34:10.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:34:10.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:34:10.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:34:10.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:34:10.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:34:10.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:34:10.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:34:10.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:34:10.617 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:34:10.764 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:34:10.768+0000 7f0f89708ec0 -1 Falling back to public interface 2020-09-08T15:34:11.056 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 36 up_thru 39 down_at 31 last_clean_interval [5,29) [v2:127.0.0.1:6802/70901,v1:127.0.0.1:6803/70901] [v2:127.0.0.1:6804/70901,v1:127.0.0.1:6805/70901] exists,up bf9e879c-7aad-47a6-b313-d798e2659805 2020-09-08T15:34:11.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:34:11.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:34:11.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:34:11.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2020-09-08T15:34:11.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.2 2020-09-08T15:34:11.066 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:34:11.066 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:34:11.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:34:11.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:34:11.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:34:11.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:34:11.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 2 --op log --pgid 1.0 2020-09-08T15:34:11.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local dir=td/divergent-priors 2020-09-08T15:34:11.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2020-09-08T15:34:11.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local id=2 2020-09-08T15:34:11.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1198: _objectstore_tool_nodown: shift 2020-09-08T15:34:11.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: _objectstore_tool_nodown: local osd_data=td/divergent-priors/2 2020-09-08T15:34:11.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1202: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/2 --op log --pgid 1.0 2020-09-08T15:34:11.798 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:34:11.798+0000 7f0f89708ec0 -1 osd.0 40 log_to_monitors {default=true} 2020-09-08T15:34:12.486 INFO:tasks.workunit.client.0.smithi065.stderr:PG '1.0' not found 2020-09-08T15:34:13.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1203: _objectstore_tool_nodown: return 1 2020-09-08T15:34:13.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 2 2020-09-08T15:34:13.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/divergent-priors 2020-09-08T15:34:13.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:34:13.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=2 2020-09-08T15:34:13.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:34:13.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/divergent-priors/2 2020-09-08T15:34:13.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:34:13.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:34:13.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:34:13.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:34:13.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2020-09-08T15:34:13.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2020-09-08T15:34:13.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:34:13.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:34:13.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:34:13.008 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:34:13.008 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:34:13.008 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:34:13.009 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:34:13.009 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:34:13.009 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:34:13.009 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:34:13.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:34:13.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:34:13.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:34:13.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:34:13.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:34:13.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:34:13.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:34:13.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:34:13.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:34:13.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/divergent-priors/2 2020-09-08T15:34:13.013 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T15:34:13.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.2 2020-09-08T15:34:13.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 2 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:34:13.014 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/divergent-priors/2/whoami 2020-09-08T15:34:13.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 2 = 2 ']' 2020-09-08T15:34:13.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:34:13.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:34:13.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:34:13.042 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:34:13.043+0000 7fd689456ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:34:13.042 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:34:13.045+0000 7fd689456ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:34:13.043 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:34:13.047+0000 7fd689456ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:34:13.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 2 2020-09-08T15:34:13.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:34:13.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:34:13.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:34:13.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:34:13.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:34:13.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:34:13.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:34:13.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:34:13.427 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:34:13.565 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:34:13.564+0000 7fd689456ec0 -1 Falling back to public interface 2020-09-08T15:34:13.820 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 37 up_thru 0 down_at 33 last_clean_interval [15,29) [v2:127.0.0.1:6810/71300,v1:127.0.0.1:6811/71300] [v2:127.0.0.1:6812/71300,v1:127.0.0.1:6813/71300] exists,up e537af10-6bdf-47c4-9f94-34575593ecc4 2020-09-08T15:34:13.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:34:13.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:34:13.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:34:13.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:336: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 1 --op log --pgid 1.0 2020-09-08T15:34:13.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local dir=td/divergent-priors 2020-09-08T15:34:13.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2020-09-08T15:34:13.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local id=1 2020-09-08T15:34:13.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1198: _objectstore_tool_nodown: shift 2020-09-08T15:34:13.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2020-09-08T15:34:13.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1202: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op log --pgid 1.0 2020-09-08T15:34:14.658 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:34:14.663+0000 7fd689456ec0 -1 osd.2 40 log_to_monitors {default=true} 2020-09-08T15:34:15.628 INFO:tasks.workunit.client.0.smithi065.stderr:PG '1.0' not found 2020-09-08T15:34:15.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1203: _objectstore_tool_nodown: return 1 2020-09-08T15:34:15.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2020-09-08T15:34:15.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: wait_for_clean 2020-09-08T15:34:15.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:34:15.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:34:15.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:34:15.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:34:15.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 20 .1 2020-09-08T15:34:15.901 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:34:15.902 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:34:15.902 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:34:15.902 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:34:15.902 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:34:15.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:34:15.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:34:15.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:34:15.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:34:15.970 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:34:16.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:34:16.371 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:34:16.371 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:34:16.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:34:16.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:34:16.372 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:34:16.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=180388626435 2020-09-08T15:34:16.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 180388626435 2020-09-08T15:34:16.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-180388626435' 2020-09-08T15:34:16.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:34:16.510 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:34:16.605 INFO:tasks.workunit.client.0.smithi065.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-09-08T15:34:16.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq= 2020-09-08T15:34:16.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z '' 2020-09-08T15:34:16.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: continue 2020-09-08T15:34:16.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:34:16.607 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:34:16.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=193273528323 2020-09-08T15:34:16.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 193273528323 2020-09-08T15:34:16.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-180388626435 2-193273528323' 2020-09-08T15:34:16.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:34:16.744 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-180388626435 2020-09-08T15:34:16.744 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:34:16.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:34:16.745 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-180388626435 2020-09-08T15:34:16.745 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:34:16.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=180388626435 2020-09-08T15:34:16.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 180388626435' 2020-09-08T15:34:16.746 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:34:16.747 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 180388626435 2020-09-08T15:34:17.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 1 -lt 180388626435 2020-09-08T15:34:17.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:34:18.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:34:18.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:34:18.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 180388626436 -lt 180388626435 2020-09-08T15:34:18.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:34:18.569 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-193273528323 2020-09-08T15:34:18.569 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:34:18.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:34:18.570 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-193273528323 2020-09-08T15:34:18.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:34:18.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=193273528323 2020-09-08T15:34:18.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 193273528323' 2020-09-08T15:34:18.572 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:34:18.572 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 193273528323 2020-09-08T15:34:18.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 193273528323 -lt 193273528323 2020-09-08T15:34:18.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:34:18.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:34:18.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:34:19.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T15:34:19.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:34:19.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:34:19.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:34:19.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:34:19.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:34:19.494 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:34:19.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:34:19.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:34:19.878 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:34:19.878 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:34:19.878 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:34:20.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:34:20.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T15:34:20.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T15:34:20.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T15:34:20.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:34:20.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:34:20.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:34:20.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:34:20.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:34:20.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:34:20.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:34:20.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:34:20.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:34:20.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:34:20.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:34:20.901 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:34:20.902 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:34:20.902 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:34:21.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:34:21.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:34:21.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:34:21.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:34:21.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:34:21.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:34:21.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:34:21.462 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:34:21.462 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:34:21.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:34:21.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:34:21.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 1 >= 8 )) 2020-09-08T15:34:21.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:34:21.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.2 2020-09-08T15:34:22.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:34:22.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:34:22.193 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:34:22.193 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:34:22.194 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:34:22.194 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:34:22.194 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:34:22.194 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:34:22.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:34:22.580 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:34:22.581 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:34:22.581 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:34:23.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:34:23.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:34:23.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:34:23.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:34:23.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:34:23.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:34:23.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:34:23.103 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:34:23.104 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:34:23.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:34:23.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:34:23.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 2 >= 8 )) 2020-09-08T15:34:23.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:34:23.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.4 2020-09-08T15:34:24.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:34:24.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:34:24.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:34:24.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:34:24.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:34:24.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:34:24.028 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:34:24.028 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:34:24.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:34:24.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:34:24.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:34:24.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:34:24.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:34:24.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:34:24.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:34:24.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:34:24.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:34:24.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:34:24.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:34:24.948 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:34:24.948 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:34:25.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:34:25.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:34:25.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 3 >= 8 )) 2020-09-08T15:34:25.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:34:25.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.8 2020-09-08T15:34:26.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:34:26.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:34:26.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:34:26.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:34:26.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:34:26.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:34:26.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:34:26.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:34:26.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:34:26.682 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:34:26.683 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:34:26.683 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:34:27.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:34:27.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:34:27.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:34:27.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:34:27.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:34:27.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:34:27.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:34:27.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:34:27.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:34:27.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:34:27.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:34:27.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 4 >= 8 )) 2020-09-08T15:34:27.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:34:27.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 1.6 2020-09-08T15:34:29.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:34:29.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:34:29.343 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:34:29.344 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:34:29.344 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:34:29.344 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:34:29.344 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:34:29.345 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:34:29.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:34:29.738 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:34:29.739 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:34:29.739 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:34:30.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:34:30.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:34:30.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:34:30.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:34:30.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:34:30.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:34:30.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:34:30.285 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:34:30.285 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:34:30.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:34:30.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:34:30.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 5 >= 8 )) 2020-09-08T15:34:30.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:34:30.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 3.2 2020-09-08T15:34:34.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:34:34.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:34:34.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:34:34.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:34:34.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:34:34.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:34:34.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:34:34.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:34:34.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:34:34.401 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:34:34.402 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:34:34.402 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:34:34.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:34:34.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:34:34.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:34:34.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:34:34.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:34:34.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:34:34.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:34:34.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:34:34.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:34:35.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:34:35.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:34:35.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 6 >= 8 )) 2020-09-08T15:34:35.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:34:35.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 6.4 2020-09-08T15:34:41.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:34:41.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:34:41.854 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:34:41.854 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:34:41.854 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:34:41.854 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:34:41.855 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:34:41.855 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:34:42.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:34:42.275 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:34:42.276 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:34:42.276 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:34:42.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:34:42.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:34:42.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:34:42.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:34:42.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:34:42.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:34:42.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:34:42.801 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:34:42.801 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:34:43.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:34:43.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:34:43.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 7 >= 8 )) 2020-09-08T15:34:43.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:34:43.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 7.3 2020-09-08T15:34:50.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:34:50.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:34:50.625 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:34:50.625 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:34:50.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:34:50.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:34:50.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:34:50.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:34:51.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:34:51.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:34:51.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:34:51.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:34:51.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:34:51.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:34:51.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:34:51.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:34:51.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:34:51.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:34:51.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:34:51.548 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:34:51.548 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:34:52.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T15:34:52.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T15:34:52.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 8 >= 8 )) 2020-09-08T15:34:52.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: wait_for_clean: ceph report 2020-09-08T15:34:52.663 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:34:52.664 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_fingerprint": "617d39a4-6b2a-459f-bf12-8598f6cb73ba", 2020-09-08T15:34:52.664 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:34:52.664 INFO:tasks.workunit.client.0.smithi065.stdout: "commit": "dce4d291bd4243c9802c17d67b85a6da6bbc0f8f", 2020-09-08T15:34:52.664 INFO:tasks.workunit.client.0.smithi065.stdout: "timestamp": "2020-09-08T15:34:52.667656+0000", 2020-09-08T15:34:52.665 INFO:tasks.workunit.client.0.smithi065.stdout: "tag": "", 2020-09-08T15:34:52.665 INFO:tasks.workunit.client.0.smithi065.stdout: "health": { 2020-09-08T15:34:52.665 INFO:tasks.workunit.client.0.smithi065.stdout: "status": "HEALTH_WARN", 2020-09-08T15:34:52.665 INFO:tasks.workunit.client.0.smithi065.stdout: "checks": { 2020-09-08T15:34:52.666 INFO:tasks.workunit.client.0.smithi065.stdout: "OSDMAP_FLAGS": { 2020-09-08T15:34:52.666 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:34:52.666 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:34:52.666 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "nodown,noout,noin flag(s) set", 2020-09-08T15:34:52.666 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 17 2020-09-08T15:34:52.667 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.667 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [], 2020-09-08T15:34:52.667 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:34:52.667 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.667 INFO:tasks.workunit.client.0.smithi065.stdout: "OSD_DOWN": { 2020-09-08T15:34:52.668 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:34:52.668 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:34:52.668 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "1 osds down", 2020-09-08T15:34:52.668 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 1 2020-09-08T15:34:52.668 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.668 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [ 2020-09-08T15:34:52.669 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.669 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "osd.1 (root=default,host=smithi065) is down" 2020-09-08T15:34:52.669 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.669 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:52.669 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:34:52.670 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.670 INFO:tasks.workunit.client.0.smithi065.stdout: "PG_DEGRADED": { 2020-09-08T15:34:52.670 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:34:52.670 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:34:52.670 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2020-09-08T15:34:52.671 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 1 2020-09-08T15:34:52.671 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.671 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [ 2020-09-08T15:34:52.671 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.671 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [2147483647,0,2]" 2020-09-08T15:34:52.672 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.672 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:52.672 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:34:52.672 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.672 INFO:tasks.workunit.client.0.smithi065.stdout: "POOL_APP_NOT_ENABLED": { 2020-09-08T15:34:52.672 INFO:tasks.workunit.client.0.smithi065.stdout: "severity": "HEALTH_WARN", 2020-09-08T15:34:52.673 INFO:tasks.workunit.client.0.smithi065.stdout: "summary": { 2020-09-08T15:34:52.673 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "1 pool(s) do not have an application enabled", 2020-09-08T15:34:52.673 INFO:tasks.workunit.client.0.smithi065.stdout: "count": 1 2020-09-08T15:34:52.673 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.673 INFO:tasks.workunit.client.0.smithi065.stdout: "detail": [ 2020-09-08T15:34:52.674 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.674 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "application not enabled on pool 'test'" 2020-09-08T15:34:52.674 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.674 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.674 INFO:tasks.workunit.client.0.smithi065.stdout: "message": "use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." 2020-09-08T15:34:52.675 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.676 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:52.676 INFO:tasks.workunit.client.0.smithi065.stdout: "muted": false 2020-09-08T15:34:52.676 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.677 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.677 INFO:tasks.workunit.client.0.smithi065.stdout: "mutes": [] 2020-09-08T15:34:52.677 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.677 INFO:tasks.workunit.client.0.smithi065.stdout: "monmap_first_committed": 1, 2020-09-08T15:34:52.677 INFO:tasks.workunit.client.0.smithi065.stdout: "monmap_last_committed": 1, 2020-09-08T15:34:52.678 INFO:tasks.workunit.client.0.smithi065.stdout: "monmap": { 2020-09-08T15:34:52.678 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 1, 2020-09-08T15:34:52.678 INFO:tasks.workunit.client.0.smithi065.stdout: "fsid": "c25e19f6-e2e3-4d0b-8f34-71c93296ff3c", 2020-09-08T15:34:52.679 INFO:tasks.workunit.client.0.smithi065.stdout: "modified": "2020-09-08T15:31:52.952774Z", 2020-09-08T15:34:52.679 INFO:tasks.workunit.client.0.smithi065.stdout: "created": "2020-09-08T15:31:52.952774Z", 2020-09-08T15:34:52.679 INFO:tasks.workunit.client.0.smithi065.stdout: "min_mon_release": 16, 2020-09-08T15:34:52.679 INFO:tasks.workunit.client.0.smithi065.stdout: "min_mon_release_name": "pacific", 2020-09-08T15:34:52.679 INFO:tasks.workunit.client.0.smithi065.stdout: "features": { 2020-09-08T15:34:52.679 INFO:tasks.workunit.client.0.smithi065.stdout: "persistent": [ 2020-09-08T15:34:52.680 INFO:tasks.workunit.client.0.smithi065.stdout: "kraken", 2020-09-08T15:34:52.680 INFO:tasks.workunit.client.0.smithi065.stdout: "luminous", 2020-09-08T15:34:52.680 INFO:tasks.workunit.client.0.smithi065.stdout: "mimic", 2020-09-08T15:34:52.680 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap-prune", 2020-09-08T15:34:52.680 INFO:tasks.workunit.client.0.smithi065.stdout: "nautilus", 2020-09-08T15:34:52.681 INFO:tasks.workunit.client.0.smithi065.stdout: "octopus", 2020-09-08T15:34:52.681 INFO:tasks.workunit.client.0.smithi065.stdout: "pacific" 2020-09-08T15:34:52.681 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:52.681 INFO:tasks.workunit.client.0.smithi065.stdout: "optional": [] 2020-09-08T15:34:52.681 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.682 INFO:tasks.workunit.client.0.smithi065.stdout: "mons": [ 2020-09-08T15:34:52.682 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.682 INFO:tasks.workunit.client.0.smithi065.stdout: "rank": 0, 2020-09-08T15:34:52.682 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "a", 2020-09-08T15:34:52.684 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:34:52.684 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:52.685 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.685 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:52.685 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:7115", 2020-09-08T15:34:52.685 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 0 2020-09-08T15:34:52.685 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.686 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.686 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.686 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:7115/0", 2020-09-08T15:34:52.686 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:7115/0", 2020-09-08T15:34:52.686 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 0, 2020-09-08T15:34:52.687 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 0 2020-09-08T15:34:52.687 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.687 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.687 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.688 INFO:tasks.workunit.client.0.smithi065.stdout: "quorum": [ 2020-09-08T15:34:52.688 INFO:tasks.workunit.client.0.smithi065.stdout: 0 2020-09-08T15:34:52.688 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:52.688 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap": { 2020-09-08T15:34:52.688 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 47, 2020-09-08T15:34:52.689 INFO:tasks.workunit.client.0.smithi065.stdout: "fsid": "c25e19f6-e2e3-4d0b-8f34-71c93296ff3c", 2020-09-08T15:34:52.689 INFO:tasks.workunit.client.0.smithi065.stdout: "created": "2020-09-08T15:31:53.745739+0000", 2020-09-08T15:34:52.689 INFO:tasks.workunit.client.0.smithi065.stdout: "modified": "2020-09-08T15:34:15.591318+0000", 2020-09-08T15:34:52.689 INFO:tasks.workunit.client.0.smithi065.stdout: "last_up_change": "2020-09-08T15:34:14.996510+0000", 2020-09-08T15:34:52.689 INFO:tasks.workunit.client.0.smithi065.stdout: "last_in_change": "2020-09-08T15:33:26.334856+0000", 2020-09-08T15:34:52.690 INFO:tasks.workunit.client.0.smithi065.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-09-08T15:34:52.690 INFO:tasks.workunit.client.0.smithi065.stdout: "flags_num": 5800384, 2020-09-08T15:34:52.690 INFO:tasks.workunit.client.0.smithi065.stdout: "flags_set": [ 2020-09-08T15:34:52.690 INFO:tasks.workunit.client.0.smithi065.stdout: "nodown", 2020-09-08T15:34:52.690 INFO:tasks.workunit.client.0.smithi065.stdout: "noin", 2020-09-08T15:34:52.690 INFO:tasks.workunit.client.0.smithi065.stdout: "noout", 2020-09-08T15:34:52.691 INFO:tasks.workunit.client.0.smithi065.stdout: "pglog_hardlimit", 2020-09-08T15:34:52.691 INFO:tasks.workunit.client.0.smithi065.stdout: "purged_snapdirs", 2020-09-08T15:34:52.691 INFO:tasks.workunit.client.0.smithi065.stdout: "recovery_deletes", 2020-09-08T15:34:52.694 INFO:tasks.workunit.client.0.smithi065.stdout: "sortbitwise" 2020-09-08T15:34:52.694 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:52.695 INFO:tasks.workunit.client.0.smithi065.stdout: "crush_version": 8, 2020-09-08T15:34:52.695 INFO:tasks.workunit.client.0.smithi065.stdout: "full_ratio": 0.99000000953674316, 2020-09-08T15:34:52.695 INFO:tasks.workunit.client.0.smithi065.stdout: "backfillfull_ratio": 0.99000000953674316, 2020-09-08T15:34:52.695 INFO:tasks.workunit.client.0.smithi065.stdout: "nearfull_ratio": 0.85000002384185791, 2020-09-08T15:34:52.695 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_snapshot": "", 2020-09-08T15:34:52.696 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_max": 1, 2020-09-08T15:34:52.696 INFO:tasks.workunit.client.0.smithi065.stdout: "max_osd": 3, 2020-09-08T15:34:52.696 INFO:tasks.workunit.client.0.smithi065.stdout: "require_min_compat_client": "luminous", 2020-09-08T15:34:52.696 INFO:tasks.workunit.client.0.smithi065.stdout: "min_compat_client": "jewel", 2020-09-08T15:34:52.696 INFO:tasks.workunit.client.0.smithi065.stdout: "require_osd_release": "pacific", 2020-09-08T15:34:52.697 INFO:tasks.workunit.client.0.smithi065.stdout: "pools": [ 2020-09-08T15:34:52.697 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.697 INFO:tasks.workunit.client.0.smithi065.stdout: "pool": 1, 2020-09-08T15:34:52.697 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_name": "test", 2020-09-08T15:34:52.697 INFO:tasks.workunit.client.0.smithi065.stdout: "create_time": "2020-09-08T15:32:21.860598+0000", 2020-09-08T15:34:52.698 INFO:tasks.workunit.client.0.smithi065.stdout: "flags": 16389, 2020-09-08T15:34:52.705 INFO:tasks.workunit.client.0.smithi065.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2020-09-08T15:34:52.705 INFO:tasks.workunit.client.0.smithi065.stdout: "type": 3, 2020-09-08T15:34:52.705 INFO:tasks.workunit.client.0.smithi065.stdout: "size": 3, 2020-09-08T15:34:52.706 INFO:tasks.workunit.client.0.smithi065.stdout: "min_size": 2, 2020-09-08T15:34:52.706 INFO:tasks.workunit.client.0.smithi065.stdout: "crush_rule": 1, 2020-09-08T15:34:52.706 INFO:tasks.workunit.client.0.smithi065.stdout: "object_hash": 2, 2020-09-08T15:34:52.706 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_autoscale_mode": "off", 2020-09-08T15:34:52.707 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_num": 1, 2020-09-08T15:34:52.707 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_placement_num": 1, 2020-09-08T15:34:52.707 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_placement_num_target": 1, 2020-09-08T15:34:52.707 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_num_target": 1, 2020-09-08T15:34:52.708 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_num_pending": 1, 2020-09-08T15:34:52.708 INFO:tasks.workunit.client.0.smithi065.stdout: "last_pg_merge_meta": { 2020-09-08T15:34:52.709 INFO:tasks.workunit.client.0.smithi065.stdout: "source_pgid": "0.0", 2020-09-08T15:34:52.709 INFO:tasks.workunit.client.0.smithi065.stdout: "ready_epoch": 0, 2020-09-08T15:34:52.709 INFO:tasks.workunit.client.0.smithi065.stdout: "last_epoch_started": 0, 2020-09-08T15:34:52.709 INFO:tasks.workunit.client.0.smithi065.stdout: "last_epoch_clean": 0, 2020-09-08T15:34:52.710 INFO:tasks.workunit.client.0.smithi065.stdout: "source_version": "0'0", 2020-09-08T15:34:52.710 INFO:tasks.workunit.client.0.smithi065.stdout: "target_version": "0'0" 2020-09-08T15:34:52.710 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.710 INFO:tasks.workunit.client.0.smithi065.stdout: "last_change": "30", 2020-09-08T15:34:52.710 INFO:tasks.workunit.client.0.smithi065.stdout: "last_force_op_resend": "0", 2020-09-08T15:34:52.711 INFO:tasks.workunit.client.0.smithi065.stdout: "last_force_op_resend_prenautilus": "0", 2020-09-08T15:34:52.711 INFO:tasks.workunit.client.0.smithi065.stdout: "last_force_op_resend_preluminous": "0", 2020-09-08T15:34:52.711 INFO:tasks.workunit.client.0.smithi065.stdout: "auid": 0, 2020-09-08T15:34:52.711 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_mode": "pool", 2020-09-08T15:34:52.711 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_seq": 1, 2020-09-08T15:34:52.711 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_epoch": 30, 2020-09-08T15:34:52.712 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_snaps": [ 2020-09-08T15:34:52.712 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.712 INFO:tasks.workunit.client.0.smithi065.stdout: "snapid": 1, 2020-09-08T15:34:52.712 INFO:tasks.workunit.client.0.smithi065.stdout: "stamp": "2020-09-08T15:33:06.977271+0000", 2020-09-08T15:34:52.712 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "snap1" 2020-09-08T15:34:52.713 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.713 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:52.713 INFO:tasks.workunit.client.0.smithi065.stdout: "removed_snaps": "[]", 2020-09-08T15:34:52.713 INFO:tasks.workunit.client.0.smithi065.stdout: "quota_max_bytes": 0, 2020-09-08T15:34:52.713 INFO:tasks.workunit.client.0.smithi065.stdout: "quota_max_objects": 0, 2020-09-08T15:34:52.714 INFO:tasks.workunit.client.0.smithi065.stdout: "tiers": [], 2020-09-08T15:34:52.714 INFO:tasks.workunit.client.0.smithi065.stdout: "tier_of": -1, 2020-09-08T15:34:52.714 INFO:tasks.workunit.client.0.smithi065.stdout: "read_tier": -1, 2020-09-08T15:34:52.714 INFO:tasks.workunit.client.0.smithi065.stdout: "write_tier": -1, 2020-09-08T15:34:52.714 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_mode": "none", 2020-09-08T15:34:52.715 INFO:tasks.workunit.client.0.smithi065.stdout: "target_max_bytes": 0, 2020-09-08T15:34:52.715 INFO:tasks.workunit.client.0.smithi065.stdout: "target_max_objects": 0, 2020-09-08T15:34:52.715 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-09-08T15:34:52.715 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-09-08T15:34:52.715 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_target_full_ratio_micro": 800000, 2020-09-08T15:34:52.715 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_min_flush_age": 0, 2020-09-08T15:34:52.716 INFO:tasks.workunit.client.0.smithi065.stdout: "cache_min_evict_age": 0, 2020-09-08T15:34:52.716 INFO:tasks.workunit.client.0.smithi065.stdout: "erasure_code_profile": "myprofile", 2020-09-08T15:34:52.716 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_params": { 2020-09-08T15:34:52.716 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "none" 2020-09-08T15:34:52.716 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.717 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_period": 0, 2020-09-08T15:34:52.717 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_count": 0, 2020-09-08T15:34:52.717 INFO:tasks.workunit.client.0.smithi065.stdout: "use_gmt_hitset": true, 2020-09-08T15:34:52.717 INFO:tasks.workunit.client.0.smithi065.stdout: "min_read_recency_for_promote": 0, 2020-09-08T15:34:52.717 INFO:tasks.workunit.client.0.smithi065.stdout: "min_write_recency_for_promote": 0, 2020-09-08T15:34:52.718 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_grade_decay_rate": 0, 2020-09-08T15:34:52.718 INFO:tasks.workunit.client.0.smithi065.stdout: "hit_set_search_last_n": 0, 2020-09-08T15:34:52.718 INFO:tasks.workunit.client.0.smithi065.stdout: "grade_table": [], 2020-09-08T15:34:52.718 INFO:tasks.workunit.client.0.smithi065.stdout: "stripe_width": 8192, 2020-09-08T15:34:52.718 INFO:tasks.workunit.client.0.smithi065.stdout: "expected_num_objects": 0, 2020-09-08T15:34:52.718 INFO:tasks.workunit.client.0.smithi065.stdout: "fast_read": false, 2020-09-08T15:34:52.719 INFO:tasks.workunit.client.0.smithi065.stdout: "options": {}, 2020-09-08T15:34:52.719 INFO:tasks.workunit.client.0.smithi065.stdout: "application_metadata": {} 2020-09-08T15:34:52.719 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.719 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:52.719 INFO:tasks.workunit.client.0.smithi065.stdout: "osds": [ 2020-09-08T15:34:52.720 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.720 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:34:52.720 INFO:tasks.workunit.client.0.smithi065.stdout: "uuid": "bf9e879c-7aad-47a6-b313-d798e2659805", 2020-09-08T15:34:52.720 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 1, 2020-09-08T15:34:52.720 INFO:tasks.workunit.client.0.smithi065.stdout: "in": 1, 2020-09-08T15:34:52.720 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 1, 2020-09-08T15:34:52.721 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_affinity": 1, 2020-09-08T15:34:52.721 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_begin": 36, 2020-09-08T15:34:52.721 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_end": 40, 2020-09-08T15:34:52.721 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 42, 2020-09-08T15:34:52.721 INFO:tasks.workunit.client.0.smithi065.stdout: "up_thru": 45, 2020-09-08T15:34:52.722 INFO:tasks.workunit.client.0.smithi065.stdout: "down_at": 41, 2020-09-08T15:34:52.722 INFO:tasks.workunit.client.0.smithi065.stdout: "lost_at": 0, 2020-09-08T15:34:52.722 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:34:52.722 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:52.722 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.722 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:52.723 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6802", 2020-09-08T15:34:52.723 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 73053 2020-09-08T15:34:52.723 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.723 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.723 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:52.724 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6803", 2020-09-08T15:34:52.724 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 73053 2020-09-08T15:34:52.724 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.724 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.724 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.725 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addrs": { 2020-09-08T15:34:52.725 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:52.725 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.725 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:52.725 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6804", 2020-09-08T15:34:52.725 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 73053 2020-09-08T15:34:52.726 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.726 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.726 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:52.726 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6805", 2020-09-08T15:34:52.726 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 73053 2020-09-08T15:34:52.727 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.727 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.727 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.727 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addrs": { 2020-09-08T15:34:52.727 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:52.728 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.728 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:52.728 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6808", 2020-09-08T15:34:52.728 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 73053 2020-09-08T15:34:52.728 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.728 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.729 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:52.729 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6809", 2020-09-08T15:34:52.729 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 73053 2020-09-08T15:34:52.729 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.729 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.730 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.730 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addrs": { 2020-09-08T15:34:52.730 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:52.730 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.730 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:52.731 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6806", 2020-09-08T15:34:52.731 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 73053 2020-09-08T15:34:52.731 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.731 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.731 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:52.731 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6807", 2020-09-08T15:34:52.732 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 73053 2020-09-08T15:34:52.732 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.732 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.732 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.732 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:6803/73053", 2020-09-08T15:34:52.733 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addr": "127.0.0.1:6805/73053", 2020-09-08T15:34:52.733 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addr": "127.0.0.1:6809/73053", 2020-09-08T15:34:52.733 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addr": "127.0.0.1:6807/73053", 2020-09-08T15:34:52.733 INFO:tasks.workunit.client.0.smithi065.stdout: "state": [ 2020-09-08T15:34:52.733 INFO:tasks.workunit.client.0.smithi065.stdout: "exists", 2020-09-08T15:34:52.734 INFO:tasks.workunit.client.0.smithi065.stdout: "up" 2020-09-08T15:34:52.734 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.734 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.734 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.734 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:34:52.735 INFO:tasks.workunit.client.0.smithi065.stdout: "uuid": "9638912c-2705-4309-bba1-4a617ae644ec", 2020-09-08T15:34:52.735 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 0, 2020-09-08T15:34:52.735 INFO:tasks.workunit.client.0.smithi065.stdout: "in": 1, 2020-09-08T15:34:52.735 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 1, 2020-09-08T15:34:52.735 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_affinity": 1, 2020-09-08T15:34:52.735 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_begin": 0, 2020-09-08T15:34:52.736 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_end": 0, 2020-09-08T15:34:52.736 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 10, 2020-09-08T15:34:52.736 INFO:tasks.workunit.client.0.smithi065.stdout: "up_thru": 25, 2020-09-08T15:34:52.736 INFO:tasks.workunit.client.0.smithi065.stdout: "down_at": 32, 2020-09-08T15:34:52.736 INFO:tasks.workunit.client.0.smithi065.stdout: "lost_at": 0, 2020-09-08T15:34:52.737 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:34:52.737 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:52.737 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.737 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:52.737 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6810", 2020-09-08T15:34:52.737 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 65648 2020-09-08T15:34:52.738 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.738 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.738 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:52.738 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6811", 2020-09-08T15:34:52.738 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 65648 2020-09-08T15:34:52.739 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.739 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.739 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.739 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addrs": { 2020-09-08T15:34:52.739 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:52.740 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.740 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:52.740 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6812", 2020-09-08T15:34:52.740 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 65648 2020-09-08T15:34:52.740 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.740 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.741 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:52.741 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6813", 2020-09-08T15:34:52.741 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 65648 2020-09-08T15:34:52.741 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.741 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.742 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.742 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addrs": { 2020-09-08T15:34:52.742 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:52.742 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.742 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:52.742 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6816", 2020-09-08T15:34:52.743 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 65648 2020-09-08T15:34:52.743 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.743 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.743 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:52.743 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6817", 2020-09-08T15:34:52.744 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 65648 2020-09-08T15:34:52.744 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.744 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.744 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.744 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addrs": { 2020-09-08T15:34:52.744 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:52.745 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.745 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:52.745 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6814", 2020-09-08T15:34:52.745 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 65648 2020-09-08T15:34:52.745 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.746 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.746 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:52.746 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6815", 2020-09-08T15:34:52.746 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 65648 2020-09-08T15:34:52.746 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.747 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.747 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.747 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:6811/65648", 2020-09-08T15:34:52.747 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addr": "127.0.0.1:6813/65648", 2020-09-08T15:34:52.747 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addr": "127.0.0.1:6817/65648", 2020-09-08T15:34:52.748 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addr": "127.0.0.1:6815/65648", 2020-09-08T15:34:52.748 INFO:tasks.workunit.client.0.smithi065.stdout: "state": [ 2020-09-08T15:34:52.748 INFO:tasks.workunit.client.0.smithi065.stdout: "exists" 2020-09-08T15:34:52.748 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.749 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.749 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.749 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:34:52.749 INFO:tasks.workunit.client.0.smithi065.stdout: "uuid": "e537af10-6bdf-47c4-9f94-34575593ecc4", 2020-09-08T15:34:52.749 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 1, 2020-09-08T15:34:52.749 INFO:tasks.workunit.client.0.smithi065.stdout: "in": 1, 2020-09-08T15:34:52.750 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 1, 2020-09-08T15:34:52.750 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_affinity": 1, 2020-09-08T15:34:52.750 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_begin": 37, 2020-09-08T15:34:52.750 INFO:tasks.workunit.client.0.smithi065.stdout: "last_clean_end": 40, 2020-09-08T15:34:52.750 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 45, 2020-09-08T15:34:52.751 INFO:tasks.workunit.client.0.smithi065.stdout: "up_thru": 0, 2020-09-08T15:34:52.751 INFO:tasks.workunit.client.0.smithi065.stdout: "down_at": 44, 2020-09-08T15:34:52.751 INFO:tasks.workunit.client.0.smithi065.stdout: "lost_at": 0, 2020-09-08T15:34:52.751 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addrs": { 2020-09-08T15:34:52.751 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:52.751 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.752 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:52.752 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6810", 2020-09-08T15:34:52.752 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 73702 2020-09-08T15:34:52.752 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.752 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.753 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:52.753 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6811", 2020-09-08T15:34:52.753 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 73702 2020-09-08T15:34:52.753 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.753 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.754 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.754 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addrs": { 2020-09-08T15:34:52.754 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:52.754 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.754 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:52.754 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6812", 2020-09-08T15:34:52.755 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 73702 2020-09-08T15:34:52.755 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.755 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.755 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:52.755 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6813", 2020-09-08T15:34:52.756 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 73702 2020-09-08T15:34:52.756 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.756 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.756 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.756 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addrs": { 2020-09-08T15:34:52.756 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:52.757 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.757 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:52.757 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6816", 2020-09-08T15:34:52.757 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 73702 2020-09-08T15:34:52.757 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.758 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.758 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:52.758 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6817", 2020-09-08T15:34:52.758 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 73702 2020-09-08T15:34:52.758 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.758 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.759 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.759 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addrs": { 2020-09-08T15:34:52.759 INFO:tasks.workunit.client.0.smithi065.stdout: "addrvec": [ 2020-09-08T15:34:52.759 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.759 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v2", 2020-09-08T15:34:52.760 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6814", 2020-09-08T15:34:52.760 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 73702 2020-09-08T15:34:52.760 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.760 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.760 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "v1", 2020-09-08T15:34:52.760 INFO:tasks.workunit.client.0.smithi065.stdout: "addr": "127.0.0.1:6815", 2020-09-08T15:34:52.761 INFO:tasks.workunit.client.0.smithi065.stdout: "nonce": 73702 2020-09-08T15:34:52.761 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.761 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.761 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.761 INFO:tasks.workunit.client.0.smithi065.stdout: "public_addr": "127.0.0.1:6811/73702", 2020-09-08T15:34:52.762 INFO:tasks.workunit.client.0.smithi065.stdout: "cluster_addr": "127.0.0.1:6813/73702", 2020-09-08T15:34:52.762 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_back_addr": "127.0.0.1:6817/73702", 2020-09-08T15:34:52.762 INFO:tasks.workunit.client.0.smithi065.stdout: "heartbeat_front_addr": "127.0.0.1:6815/73702", 2020-09-08T15:34:52.762 INFO:tasks.workunit.client.0.smithi065.stdout: "state": [ 2020-09-08T15:34:52.762 INFO:tasks.workunit.client.0.smithi065.stdout: "exists", 2020-09-08T15:34:52.763 INFO:tasks.workunit.client.0.smithi065.stdout: "up" 2020-09-08T15:34:52.763 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.763 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.763 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:52.763 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_xinfo": [ 2020-09-08T15:34:52.763 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.764 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:34:52.764 INFO:tasks.workunit.client.0.smithi065.stdout: "down_stamp": "2020-09-08T15:34:11.910619+0000", 2020-09-08T15:34:52.764 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_probability": 0, 2020-09-08T15:34:52.764 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_interval": 0, 2020-09-08T15:34:52.764 INFO:tasks.workunit.client.0.smithi065.stdout: "features": 4540138292837744639, 2020-09-08T15:34:52.765 INFO:tasks.workunit.client.0.smithi065.stdout: "old_weight": 0, 2020-09-08T15:34:52.765 INFO:tasks.workunit.client.0.smithi065.stdout: "last_purged_snaps_scrub": "2020-09-08T15:32:02.225707+0000", 2020-09-08T15:34:52.765 INFO:tasks.workunit.client.0.smithi065.stdout: "dead_epoch": 0 2020-09-08T15:34:52.765 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.765 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.765 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:34:52.766 INFO:tasks.workunit.client.0.smithi065.stdout: "down_stamp": "2020-09-08T15:33:18.622517+0000", 2020-09-08T15:34:52.766 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_probability": 0, 2020-09-08T15:34:52.766 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_interval": 0, 2020-09-08T15:34:52.766 INFO:tasks.workunit.client.0.smithi065.stdout: "features": 4540138292837744639, 2020-09-08T15:34:52.766 INFO:tasks.workunit.client.0.smithi065.stdout: "old_weight": 0, 2020-09-08T15:34:52.767 INFO:tasks.workunit.client.0.smithi065.stdout: "last_purged_snaps_scrub": "2020-09-08T15:32:10.387487+0000", 2020-09-08T15:34:52.767 INFO:tasks.workunit.client.0.smithi065.stdout: "dead_epoch": 0 2020-09-08T15:34:52.767 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.767 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.767 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:34:52.768 INFO:tasks.workunit.client.0.smithi065.stdout: "down_stamp": "2020-09-08T15:34:14.812464+0000", 2020-09-08T15:34:52.768 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_probability": 0, 2020-09-08T15:34:52.768 INFO:tasks.workunit.client.0.smithi065.stdout: "laggy_interval": 0, 2020-09-08T15:34:52.768 INFO:tasks.workunit.client.0.smithi065.stdout: "features": 4540138292837744639, 2020-09-08T15:34:52.768 INFO:tasks.workunit.client.0.smithi065.stdout: "old_weight": 0, 2020-09-08T15:34:52.768 INFO:tasks.workunit.client.0.smithi065.stdout: "last_purged_snaps_scrub": "2020-09-08T15:32:18.562920+0000", 2020-09-08T15:34:52.769 INFO:tasks.workunit.client.0.smithi065.stdout: "dead_epoch": 0 2020-09-08T15:34:52.769 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.769 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:52.769 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_upmap": [], 2020-09-08T15:34:52.769 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_upmap_items": [], 2020-09-08T15:34:52.770 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_temp": [], 2020-09-08T15:34:52.770 INFO:tasks.workunit.client.0.smithi065.stdout: "primary_temp": [], 2020-09-08T15:34:52.770 INFO:tasks.workunit.client.0.smithi065.stdout: "blocklist": {}, 2020-09-08T15:34:52.770 INFO:tasks.workunit.client.0.smithi065.stdout: "erasure_code_profiles": { 2020-09-08T15:34:52.770 INFO:tasks.workunit.client.0.smithi065.stdout: "default": { 2020-09-08T15:34:52.770 INFO:tasks.workunit.client.0.smithi065.stdout: "k": "2", 2020-09-08T15:34:52.771 INFO:tasks.workunit.client.0.smithi065.stdout: "m": "2", 2020-09-08T15:34:52.771 INFO:tasks.workunit.client.0.smithi065.stdout: "plugin": "jerasure", 2020-09-08T15:34:52.771 INFO:tasks.workunit.client.0.smithi065.stdout: "technique": "reed_sol_van" 2020-09-08T15:34:52.771 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.771 INFO:tasks.workunit.client.0.smithi065.stdout: "myprofile": { 2020-09-08T15:34:52.772 INFO:tasks.workunit.client.0.smithi065.stdout: "crush-device-class": "", 2020-09-08T15:34:52.772 INFO:tasks.workunit.client.0.smithi065.stdout: "crush-failure-domain": "osd", 2020-09-08T15:34:52.772 INFO:tasks.workunit.client.0.smithi065.stdout: "crush-root": "default", 2020-09-08T15:34:52.772 INFO:tasks.workunit.client.0.smithi065.stdout: "jerasure-per-chunk-alignment": "false", 2020-09-08T15:34:52.772 INFO:tasks.workunit.client.0.smithi065.stdout: "k": "2", 2020-09-08T15:34:52.772 INFO:tasks.workunit.client.0.smithi065.stdout: "m": "1", 2020-09-08T15:34:52.773 INFO:tasks.workunit.client.0.smithi065.stdout: "plugin": "jerasure", 2020-09-08T15:34:52.773 INFO:tasks.workunit.client.0.smithi065.stdout: "technique": "reed_sol_van", 2020-09-08T15:34:52.773 INFO:tasks.workunit.client.0.smithi065.stdout: "w": "8" 2020-09-08T15:34:52.773 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.773 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.774 INFO:tasks.workunit.client.0.smithi065.stdout: "removed_snaps_queue": [], 2020-09-08T15:34:52.774 INFO:tasks.workunit.client.0.smithi065.stdout: "new_removed_snaps": [], 2020-09-08T15:34:52.774 INFO:tasks.workunit.client.0.smithi065.stdout: "new_purged_snaps": [], 2020-09-08T15:34:52.774 INFO:tasks.workunit.client.0.smithi065.stdout: "crush_node_flags": {}, 2020-09-08T15:34:52.774 INFO:tasks.workunit.client.0.smithi065.stdout: "device_class_flags": {} 2020-09-08T15:34:52.775 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.775 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_metadata": [ 2020-09-08T15:34:52.775 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.775 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:34:52.775 INFO:tasks.workunit.client.0.smithi065.stdout: "arch": "x86_64", 2020-09-08T15:34:52.775 INFO:tasks.workunit.client.0.smithi065.stdout: "back_addr": "[v2:127.0.0.1:6804/73053,v1:127.0.0.1:6805/73053]", 2020-09-08T15:34:52.776 INFO:tasks.workunit.client.0.smithi065.stdout: "back_iface": "", 2020-09-08T15:34:52.776 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs": "1", 2020-09-08T15:34:52.776 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_db": "0", 2020-09-08T15:34:52.776 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_wal": "0", 2020-09-08T15:34:52.777 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_single_shared_device": "1", 2020-09-08T15:34:52.777 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T15:34:52.777 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T15:34:52.777 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T15:34:52.777 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T15:34:52.778 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2020-09-08T15:34:52.778 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T15:34:52.778 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T15:34:52.778 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T15:34:52.778 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T15:34:52.779 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_release": "pacific", 2020-09-08T15:34:52.779 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version": "ceph version 16.0.0-5272-gdce4d291bd4 (dce4d291bd4243c9802c17d67b85a6da6bbc0f8f) pacific (dev)", 2020-09-08T15:34:52.779 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version_short": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:34:52.779 INFO:tasks.workunit.client.0.smithi065.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-09-08T15:34:52.779 INFO:tasks.workunit.client.0.smithi065.stdout: "default_device_class": "hdd", 2020-09-08T15:34:52.779 INFO:tasks.workunit.client.0.smithi065.stdout: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W4VHBH", 2020-09-08T15:34:52.780 INFO:tasks.workunit.client.0.smithi065.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2020-09-08T15:34:52.780 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": "sda", 2020-09-08T15:34:52.780 INFO:tasks.workunit.client.0.smithi065.stdout: "distro": "rhel", 2020-09-08T15:34:52.780 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_description": "Red Hat Enterprise Linux 8.1 (Ootpa)", 2020-09-08T15:34:52.780 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_version": "8.1", 2020-09-08T15:34:52.781 INFO:tasks.workunit.client.0.smithi065.stdout: "front_addr": "[v2:127.0.0.1:6802/73053,v1:127.0.0.1:6803/73053]", 2020-09-08T15:34:52.781 INFO:tasks.workunit.client.0.smithi065.stdout: "front_iface": "", 2020-09-08T15:34:52.781 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/73053,v1:127.0.0.1:6809/73053]", 2020-09-08T15:34:52.781 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/73053,v1:127.0.0.1:6807/73053]", 2020-09-08T15:34:52.781 INFO:tasks.workunit.client.0.smithi065.stdout: "hostname": "smithi065", 2020-09-08T15:34:52.781 INFO:tasks.workunit.client.0.smithi065.stdout: "journal_rotational": "1", 2020-09-08T15:34:52.782 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_description": "#1 SMP Fri Mar 27 14:35:58 UTC 2020", 2020-09-08T15:34:52.782 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_version": "4.18.0-193.el8.x86_64", 2020-09-08T15:34:52.782 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_swap_kb": "0", 2020-09-08T15:34:52.782 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_total_kb": "32653204", 2020-09-08T15:34:52.782 INFO:tasks.workunit.client.0.smithi065.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2020-09-08T15:34:52.783 INFO:tasks.workunit.client.0.smithi065.stdout: "objectstore_numa_unknown_devices": "sda", 2020-09-08T15:34:52.783 INFO:tasks.workunit.client.0.smithi065.stdout: "os": "Linux", 2020-09-08T15:34:52.783 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_data": "td/divergent-priors/0", 2020-09-08T15:34:52.783 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T15:34:52.783 INFO:tasks.workunit.client.0.smithi065.stdout: "osdspec_affinity": "", 2020-09-08T15:34:52.784 INFO:tasks.workunit.client.0.smithi065.stdout: "rotational": "1" 2020-09-08T15:34:52.784 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.784 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.784 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:34:52.784 INFO:tasks.workunit.client.0.smithi065.stdout: "arch": "x86_64", 2020-09-08T15:34:52.784 INFO:tasks.workunit.client.0.smithi065.stdout: "back_addr": "[v2:127.0.0.1:6812/65648,v1:127.0.0.1:6813/65648]", 2020-09-08T15:34:52.785 INFO:tasks.workunit.client.0.smithi065.stdout: "back_iface": "", 2020-09-08T15:34:52.785 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs": "1", 2020-09-08T15:34:52.785 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_db": "0", 2020-09-08T15:34:52.785 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_wal": "0", 2020-09-08T15:34:52.785 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_single_shared_device": "1", 2020-09-08T15:34:52.786 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T15:34:52.786 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T15:34:52.786 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T15:34:52.786 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T15:34:52.786 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2020-09-08T15:34:52.787 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T15:34:52.787 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T15:34:52.787 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T15:34:52.787 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T15:34:52.787 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_release": "pacific", 2020-09-08T15:34:52.788 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version": "ceph version 16.0.0-5272-gdce4d291bd4 (dce4d291bd4243c9802c17d67b85a6da6bbc0f8f) pacific (dev)", 2020-09-08T15:34:52.788 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version_short": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:34:52.788 INFO:tasks.workunit.client.0.smithi065.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-09-08T15:34:52.788 INFO:tasks.workunit.client.0.smithi065.stdout: "default_device_class": "hdd", 2020-09-08T15:34:52.788 INFO:tasks.workunit.client.0.smithi065.stdout: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W4VHBH", 2020-09-08T15:34:52.789 INFO:tasks.workunit.client.0.smithi065.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2020-09-08T15:34:52.789 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": "sda", 2020-09-08T15:34:52.789 INFO:tasks.workunit.client.0.smithi065.stdout: "distro": "rhel", 2020-09-08T15:34:52.789 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_description": "Red Hat Enterprise Linux 8.1 (Ootpa)", 2020-09-08T15:34:52.789 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_version": "8.1", 2020-09-08T15:34:52.790 INFO:tasks.workunit.client.0.smithi065.stdout: "front_addr": "[v2:127.0.0.1:6810/65648,v1:127.0.0.1:6811/65648]", 2020-09-08T15:34:52.790 INFO:tasks.workunit.client.0.smithi065.stdout: "front_iface": "", 2020-09-08T15:34:52.790 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/65648,v1:127.0.0.1:6817/65648]", 2020-09-08T15:34:52.790 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/65648,v1:127.0.0.1:6815/65648]", 2020-09-08T15:34:52.790 INFO:tasks.workunit.client.0.smithi065.stdout: "hostname": "smithi065", 2020-09-08T15:34:52.791 INFO:tasks.workunit.client.0.smithi065.stdout: "journal_rotational": "1", 2020-09-08T15:34:52.791 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_description": "#1 SMP Fri Mar 27 14:35:58 UTC 2020", 2020-09-08T15:34:52.791 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_version": "4.18.0-193.el8.x86_64", 2020-09-08T15:34:52.791 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_swap_kb": "0", 2020-09-08T15:34:52.791 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_total_kb": "32653204", 2020-09-08T15:34:52.791 INFO:tasks.workunit.client.0.smithi065.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2020-09-08T15:34:52.792 INFO:tasks.workunit.client.0.smithi065.stdout: "objectstore_numa_unknown_devices": "sda", 2020-09-08T15:34:52.792 INFO:tasks.workunit.client.0.smithi065.stdout: "os": "Linux", 2020-09-08T15:34:52.792 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_data": "td/divergent-priors/1", 2020-09-08T15:34:52.792 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T15:34:52.792 INFO:tasks.workunit.client.0.smithi065.stdout: "osdspec_affinity": "", 2020-09-08T15:34:52.793 INFO:tasks.workunit.client.0.smithi065.stdout: "rotational": "1" 2020-09-08T15:34:52.793 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.793 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.793 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:34:52.793 INFO:tasks.workunit.client.0.smithi065.stdout: "arch": "x86_64", 2020-09-08T15:34:52.794 INFO:tasks.workunit.client.0.smithi065.stdout: "back_addr": "[v2:127.0.0.1:6812/73702,v1:127.0.0.1:6813/73702]", 2020-09-08T15:34:52.794 INFO:tasks.workunit.client.0.smithi065.stdout: "back_iface": "", 2020-09-08T15:34:52.794 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs": "1", 2020-09-08T15:34:52.795 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_db": "0", 2020-09-08T15:34:52.795 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_dedicated_wal": "0", 2020-09-08T15:34:52.795 INFO:tasks.workunit.client.0.smithi065.stdout: "bluefs_single_shared_device": "1", 2020-09-08T15:34:52.795 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T15:34:52.796 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T15:34:52.796 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T15:34:52.796 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T15:34:52.796 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2020-09-08T15:34:52.796 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T15:34:52.797 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T15:34:52.797 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T15:34:52.797 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T15:34:52.797 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_release": "pacific", 2020-09-08T15:34:52.797 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version": "ceph version 16.0.0-5272-gdce4d291bd4 (dce4d291bd4243c9802c17d67b85a6da6bbc0f8f) pacific (dev)", 2020-09-08T15:34:52.798 INFO:tasks.workunit.client.0.smithi065.stdout: "ceph_version_short": "16.0.0-5272-gdce4d291bd4", 2020-09-08T15:34:52.798 INFO:tasks.workunit.client.0.smithi065.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2020-09-08T15:34:52.798 INFO:tasks.workunit.client.0.smithi065.stdout: "default_device_class": "hdd", 2020-09-08T15:34:52.798 INFO:tasks.workunit.client.0.smithi065.stdout: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W4VHBH", 2020-09-08T15:34:52.798 INFO:tasks.workunit.client.0.smithi065.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2020-09-08T15:34:52.798 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": "sda", 2020-09-08T15:34:52.799 INFO:tasks.workunit.client.0.smithi065.stdout: "distro": "rhel", 2020-09-08T15:34:52.799 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_description": "Red Hat Enterprise Linux 8.1 (Ootpa)", 2020-09-08T15:34:52.799 INFO:tasks.workunit.client.0.smithi065.stdout: "distro_version": "8.1", 2020-09-08T15:34:52.799 INFO:tasks.workunit.client.0.smithi065.stdout: "front_addr": "[v2:127.0.0.1:6810/73702,v1:127.0.0.1:6811/73702]", 2020-09-08T15:34:52.799 INFO:tasks.workunit.client.0.smithi065.stdout: "front_iface": "", 2020-09-08T15:34:52.800 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/73702,v1:127.0.0.1:6817/73702]", 2020-09-08T15:34:52.800 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/73702,v1:127.0.0.1:6815/73702]", 2020-09-08T15:34:52.800 INFO:tasks.workunit.client.0.smithi065.stdout: "hostname": "smithi065", 2020-09-08T15:34:52.800 INFO:tasks.workunit.client.0.smithi065.stdout: "journal_rotational": "1", 2020-09-08T15:34:52.800 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_description": "#1 SMP Fri Mar 27 14:35:58 UTC 2020", 2020-09-08T15:34:52.800 INFO:tasks.workunit.client.0.smithi065.stdout: "kernel_version": "4.18.0-193.el8.x86_64", 2020-09-08T15:34:52.801 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_swap_kb": "0", 2020-09-08T15:34:52.801 INFO:tasks.workunit.client.0.smithi065.stdout: "mem_total_kb": "32653204", 2020-09-08T15:34:52.801 INFO:tasks.workunit.client.0.smithi065.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2020-09-08T15:34:52.801 INFO:tasks.workunit.client.0.smithi065.stdout: "objectstore_numa_unknown_devices": "sda", 2020-09-08T15:34:52.801 INFO:tasks.workunit.client.0.smithi065.stdout: "os": "Linux", 2020-09-08T15:34:52.802 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_data": "td/divergent-priors/2", 2020-09-08T15:34:52.802 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T15:34:52.802 INFO:tasks.workunit.client.0.smithi065.stdout: "osdspec_affinity": "", 2020-09-08T15:34:52.802 INFO:tasks.workunit.client.0.smithi065.stdout: "rotational": "1" 2020-09-08T15:34:52.802 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.803 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:52.803 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap_clean_epochs": { 2020-09-08T15:34:52.803 INFO:tasks.workunit.client.0.smithi065.stdout: "min_last_epoch_clean": 0, 2020-09-08T15:34:52.803 INFO:tasks.workunit.client.0.smithi065.stdout: "last_epoch_clean": { 2020-09-08T15:34:52.803 INFO:tasks.workunit.client.0.smithi065.stdout: "per_pool": [] 2020-09-08T15:34:52.804 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.804 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_epochs": [ 2020-09-08T15:34:52.804 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.804 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:34:52.804 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 43 2020-09-08T15:34:52.805 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.805 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.805 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:34:52.805 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 10 2020-09-08T15:34:52.806 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.806 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.806 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:34:52.806 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 46 2020-09-08T15:34:52.807 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.807 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.807 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.807 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap_first_committed": 1, 2020-09-08T15:34:52.808 INFO:tasks.workunit.client.0.smithi065.stdout: "osdmap_last_committed": 47, 2020-09-08T15:34:52.808 INFO:tasks.workunit.client.0.smithi065.stdout: "crushmap": { 2020-09-08T15:34:52.808 INFO:tasks.workunit.client.0.smithi065.stdout: "devices": [ 2020-09-08T15:34:52.808 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.809 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:34:52.809 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd.0", 2020-09-08T15:34:52.810 INFO:tasks.workunit.client.0.smithi065.stdout: "class": "hdd" 2020-09-08T15:34:52.810 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.810 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.810 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:34:52.810 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd.1", 2020-09-08T15:34:52.811 INFO:tasks.workunit.client.0.smithi065.stdout: "class": "hdd" 2020-09-08T15:34:52.811 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.811 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.811 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:34:52.811 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd.2", 2020-09-08T15:34:52.812 INFO:tasks.workunit.client.0.smithi065.stdout: "class": "hdd" 2020-09-08T15:34:52.812 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.812 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:52.812 INFO:tasks.workunit.client.0.smithi065.stdout: "types": [ 2020-09-08T15:34:52.812 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.813 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 0, 2020-09-08T15:34:52.813 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "osd" 2020-09-08T15:34:52.813 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.813 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.813 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 1, 2020-09-08T15:34:52.813 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "host" 2020-09-08T15:34:52.814 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.814 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.814 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 2, 2020-09-08T15:34:52.814 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "chassis" 2020-09-08T15:34:52.814 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.815 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.815 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 3, 2020-09-08T15:34:52.815 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "rack" 2020-09-08T15:34:52.815 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.815 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.815 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 4, 2020-09-08T15:34:52.816 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "row" 2020-09-08T15:34:52.816 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.816 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.816 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 5, 2020-09-08T15:34:52.816 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "pdu" 2020-09-08T15:34:52.817 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.817 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.817 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 6, 2020-09-08T15:34:52.817 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "pod" 2020-09-08T15:34:52.817 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.818 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.818 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 7, 2020-09-08T15:34:52.818 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "room" 2020-09-08T15:34:52.818 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.818 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.818 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 8, 2020-09-08T15:34:52.819 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "datacenter" 2020-09-08T15:34:52.819 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.819 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.819 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 9, 2020-09-08T15:34:52.819 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "zone" 2020-09-08T15:34:52.820 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.820 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.820 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 10, 2020-09-08T15:34:52.820 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "region" 2020-09-08T15:34:52.820 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.820 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.821 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 11, 2020-09-08T15:34:52.821 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "root" 2020-09-08T15:34:52.821 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.821 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:52.821 INFO:tasks.workunit.client.0.smithi065.stdout: "buckets": [ 2020-09-08T15:34:52.822 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.822 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -1, 2020-09-08T15:34:52.822 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "default", 2020-09-08T15:34:52.822 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 11, 2020-09-08T15:34:52.822 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "root", 2020-09-08T15:34:52.822 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:34:52.823 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:34:52.823 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:34:52.823 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:34:52.823 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.823 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -3, 2020-09-08T15:34:52.824 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:34:52.824 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:34:52.824 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.824 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.824 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.825 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.825 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -2, 2020-09-08T15:34:52.825 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "default~hdd", 2020-09-08T15:34:52.825 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 11, 2020-09-08T15:34:52.825 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "root", 2020-09-08T15:34:52.825 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:34:52.826 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:34:52.826 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:34:52.826 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:34:52.826 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.826 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -4, 2020-09-08T15:34:52.827 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:34:52.827 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:34:52.827 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.827 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.827 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.827 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.828 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -3, 2020-09-08T15:34:52.828 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "smithi065", 2020-09-08T15:34:52.828 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 1, 2020-09-08T15:34:52.828 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "host", 2020-09-08T15:34:52.828 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:34:52.829 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:34:52.829 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:34:52.829 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:34:52.829 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.829 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:34:52.829 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:34:52.830 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:34:52.830 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.830 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.830 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:34:52.830 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:34:52.831 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 1 2020-09-08T15:34:52.831 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.831 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.831 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:34:52.831 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:34:52.832 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 2 2020-09-08T15:34:52.832 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.832 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.832 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.832 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.832 INFO:tasks.workunit.client.0.smithi065.stdout: "id": -4, 2020-09-08T15:34:52.833 INFO:tasks.workunit.client.0.smithi065.stdout: "name": "smithi065~hdd", 2020-09-08T15:34:52.833 INFO:tasks.workunit.client.0.smithi065.stdout: "type_id": 1, 2020-09-08T15:34:52.833 INFO:tasks.workunit.client.0.smithi065.stdout: "type_name": "host", 2020-09-08T15:34:52.833 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 19206, 2020-09-08T15:34:52.833 INFO:tasks.workunit.client.0.smithi065.stdout: "alg": "straw2", 2020-09-08T15:34:52.834 INFO:tasks.workunit.client.0.smithi065.stdout: "hash": "rjenkins1", 2020-09-08T15:34:52.834 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:34:52.834 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.834 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 0, 2020-09-08T15:34:52.834 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:34:52.834 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 0 2020-09-08T15:34:52.835 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.835 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.835 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 1, 2020-09-08T15:34:52.835 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:34:52.835 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 1 2020-09-08T15:34:52.836 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.836 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.836 INFO:tasks.workunit.client.0.smithi065.stdout: "id": 2, 2020-09-08T15:34:52.836 INFO:tasks.workunit.client.0.smithi065.stdout: "weight": 6402, 2020-09-08T15:34:52.836 INFO:tasks.workunit.client.0.smithi065.stdout: "pos": 2 2020-09-08T15:34:52.836 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.837 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.837 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.837 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:52.837 INFO:tasks.workunit.client.0.smithi065.stdout: "rules": [ 2020-09-08T15:34:52.837 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.838 INFO:tasks.workunit.client.0.smithi065.stdout: "rule_id": 0, 2020-09-08T15:34:52.838 INFO:tasks.workunit.client.0.smithi065.stdout: "rule_name": "replicated_rule", 2020-09-08T15:34:52.838 INFO:tasks.workunit.client.0.smithi065.stdout: "ruleset": 0, 2020-09-08T15:34:52.838 INFO:tasks.workunit.client.0.smithi065.stdout: "type": 1, 2020-09-08T15:34:52.838 INFO:tasks.workunit.client.0.smithi065.stdout: "min_size": 1, 2020-09-08T15:34:52.838 INFO:tasks.workunit.client.0.smithi065.stdout: "max_size": 10, 2020-09-08T15:34:52.839 INFO:tasks.workunit.client.0.smithi065.stdout: "steps": [ 2020-09-08T15:34:52.839 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.839 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "take", 2020-09-08T15:34:52.839 INFO:tasks.workunit.client.0.smithi065.stdout: "item": -1, 2020-09-08T15:34:52.839 INFO:tasks.workunit.client.0.smithi065.stdout: "item_name": "default" 2020-09-08T15:34:52.840 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.840 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.840 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "choose_firstn", 2020-09-08T15:34:52.840 INFO:tasks.workunit.client.0.smithi065.stdout: "num": 0, 2020-09-08T15:34:52.840 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "osd" 2020-09-08T15:34:52.840 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.841 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.841 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "emit" 2020-09-08T15:34:52.841 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.841 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.841 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.842 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.842 INFO:tasks.workunit.client.0.smithi065.stdout: "rule_id": 1, 2020-09-08T15:34:52.842 INFO:tasks.workunit.client.0.smithi065.stdout: "rule_name": "test", 2020-09-08T15:34:52.842 INFO:tasks.workunit.client.0.smithi065.stdout: "ruleset": 1, 2020-09-08T15:34:52.842 INFO:tasks.workunit.client.0.smithi065.stdout: "type": 3, 2020-09-08T15:34:52.842 INFO:tasks.workunit.client.0.smithi065.stdout: "min_size": 3, 2020-09-08T15:34:52.843 INFO:tasks.workunit.client.0.smithi065.stdout: "max_size": 3, 2020-09-08T15:34:52.843 INFO:tasks.workunit.client.0.smithi065.stdout: "steps": [ 2020-09-08T15:34:52.843 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.843 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "set_chooseleaf_tries", 2020-09-08T15:34:52.843 INFO:tasks.workunit.client.0.smithi065.stdout: "num": 5 2020-09-08T15:34:52.844 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.844 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.844 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "set_choose_tries", 2020-09-08T15:34:52.844 INFO:tasks.workunit.client.0.smithi065.stdout: "num": 100 2020-09-08T15:34:52.844 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.844 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.845 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "take", 2020-09-08T15:34:52.845 INFO:tasks.workunit.client.0.smithi065.stdout: "item": -1, 2020-09-08T15:34:52.845 INFO:tasks.workunit.client.0.smithi065.stdout: "item_name": "default" 2020-09-08T15:34:52.845 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.845 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.846 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "choose_indep", 2020-09-08T15:34:52.846 INFO:tasks.workunit.client.0.smithi065.stdout: "num": 0, 2020-09-08T15:34:52.846 INFO:tasks.workunit.client.0.smithi065.stdout: "type": "osd" 2020-09-08T15:34:52.846 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.846 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.847 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "emit" 2020-09-08T15:34:52.847 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.847 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:34:52.847 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.847 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:52.847 INFO:tasks.workunit.client.0.smithi065.stdout: "tunables": { 2020-09-08T15:34:52.848 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_local_tries": 0, 2020-09-08T15:34:52.848 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_local_fallback_tries": 0, 2020-09-08T15:34:52.848 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_total_tries": 50, 2020-09-08T15:34:52.848 INFO:tasks.workunit.client.0.smithi065.stdout: "chooseleaf_descend_once": 1, 2020-09-08T15:34:52.848 INFO:tasks.workunit.client.0.smithi065.stdout: "chooseleaf_vary_r": 1, 2020-09-08T15:34:52.849 INFO:tasks.workunit.client.0.smithi065.stdout: "chooseleaf_stable": 1, 2020-09-08T15:34:52.849 INFO:tasks.workunit.client.0.smithi065.stdout: "straw_calc_version": 1, 2020-09-08T15:34:52.849 INFO:tasks.workunit.client.0.smithi065.stdout: "allowed_bucket_algs": 54, 2020-09-08T15:34:52.849 INFO:tasks.workunit.client.0.smithi065.stdout: "profile": "jewel", 2020-09-08T15:34:52.850 INFO:tasks.workunit.client.0.smithi065.stdout: "optimal_tunables": 1, 2020-09-08T15:34:52.850 INFO:tasks.workunit.client.0.smithi065.stdout: "legacy_tunables": 0, 2020-09-08T15:34:52.850 INFO:tasks.workunit.client.0.smithi065.stdout: "minimum_required_version": "jewel", 2020-09-08T15:34:52.850 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables": 1, 2020-09-08T15:34:52.850 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables2": 1, 2020-09-08T15:34:52.850 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v2_rules": 1, 2020-09-08T15:34:52.851 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables3": 1, 2020-09-08T15:34:52.852 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v3_rules": 0, 2020-09-08T15:34:52.852 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v4_buckets": 1, 2020-09-08T15:34:52.852 INFO:tasks.workunit.client.0.smithi065.stdout: "require_feature_tunables5": 1, 2020-09-08T15:34:52.852 INFO:tasks.workunit.client.0.smithi065.stdout: "has_v5_rules": 0 2020-09-08T15:34:52.853 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.853 INFO:tasks.workunit.client.0.smithi065.stdout: "choose_args": {} 2020-09-08T15:34:52.853 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.853 INFO:tasks.workunit.client.0.smithi065.stdout: "fsmap": { 2020-09-08T15:34:52.853 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 1, 2020-09-08T15:34:52.854 INFO:tasks.workunit.client.0.smithi065.stdout: "default_fscid": -1, 2020-09-08T15:34:52.854 INFO:tasks.workunit.client.0.smithi065.stdout: "compat": { 2020-09-08T15:34:52.854 INFO:tasks.workunit.client.0.smithi065.stdout: "compat": {}, 2020-09-08T15:34:52.854 INFO:tasks.workunit.client.0.smithi065.stdout: "ro_compat": {}, 2020-09-08T15:34:52.854 INFO:tasks.workunit.client.0.smithi065.stdout: "incompat": { 2020-09-08T15:34:52.854 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_1": "base v0.20", 2020-09-08T15:34:52.855 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_2": "client writeable ranges", 2020-09-08T15:34:52.855 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_3": "default file layouts on dirs", 2020-09-08T15:34:52.855 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_4": "dir inode in separate object", 2020-09-08T15:34:52.855 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_5": "mds uses versioned encoding", 2020-09-08T15:34:52.855 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_6": "dirfrag is stored in omap", 2020-09-08T15:34:52.856 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_8": "no anchor table", 2020-09-08T15:34:52.856 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_9": "file layout v2", 2020-09-08T15:34:52.856 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_10": "snaprealm v2" 2020-09-08T15:34:52.856 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.856 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.857 INFO:tasks.workunit.client.0.smithi065.stdout: "feature_flags": { 2020-09-08T15:34:52.857 INFO:tasks.workunit.client.0.smithi065.stdout: "enable_multiple": false, 2020-09-08T15:34:52.857 INFO:tasks.workunit.client.0.smithi065.stdout: "ever_enabled_multiple": false 2020-09-08T15:34:52.857 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.857 INFO:tasks.workunit.client.0.smithi065.stdout: "standbys": [], 2020-09-08T15:34:52.857 INFO:tasks.workunit.client.0.smithi065.stdout: "filesystems": [] 2020-09-08T15:34:52.858 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.858 INFO:tasks.workunit.client.0.smithi065.stdout: "mdsmap_first_committed": 1, 2020-09-08T15:34:52.858 INFO:tasks.workunit.client.0.smithi065.stdout: "mdsmap_last_committed": 1, 2020-09-08T15:34:52.858 INFO:tasks.workunit.client.0.smithi065.stdout: "auth": { 2020-09-08T15:34:52.859 INFO:tasks.workunit.client.0.smithi065.stdout: "first_committed": 1, 2020-09-08T15:34:52.860 INFO:tasks.workunit.client.0.smithi065.stdout: "last_committed": 5, 2020-09-08T15:34:52.860 INFO:tasks.workunit.client.0.smithi065.stdout: "num_secrets": 3 2020-09-08T15:34:52.860 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.860 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg": 1, 2020-09-08T15:34:52.861 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_active": 1, 2020-09-08T15:34:52.861 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_unknown": 0, 2020-09-08T15:34:52.861 INFO:tasks.workunit.client.0.smithi065.stdout: "num_osd": 3, 2020-09-08T15:34:52.861 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_sum": { 2020-09-08T15:34:52.861 INFO:tasks.workunit.client.0.smithi065.stdout: "stat_sum": { 2020-09-08T15:34:52.861 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes": 48430, 2020-09-08T15:34:52.862 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects": 101, 2020-09-08T15:34:52.862 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_clones": 1, 2020-09-08T15:34:52.862 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_copies": 303, 2020-09-08T15:34:52.862 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing_on_primary": 0, 2020-09-08T15:34:52.862 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing": 0, 2020-09-08T15:34:52.863 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_degraded": 101, 2020-09-08T15:34:52.863 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_misplaced": 0, 2020-09-08T15:34:52.863 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_unfound": 0, 2020-09-08T15:34:52.863 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_dirty": 101, 2020-09-08T15:34:52.863 INFO:tasks.workunit.client.0.smithi065.stdout: "num_whiteouts": 0, 2020-09-08T15:34:52.864 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read": 0, 2020-09-08T15:34:52.864 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read_kb": 0, 2020-09-08T15:34:52.864 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write": 101, 2020-09-08T15:34:52.864 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write_kb": 101, 2020-09-08T15:34:52.864 INFO:tasks.workunit.client.0.smithi065.stdout: "num_scrub_errors": 0, 2020-09-08T15:34:52.864 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shallow_scrub_errors": 0, 2020-09-08T15:34:52.865 INFO:tasks.workunit.client.0.smithi065.stdout: "num_deep_scrub_errors": 0, 2020-09-08T15:34:52.865 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_recovered": 0, 2020-09-08T15:34:52.865 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_recovered": 0, 2020-09-08T15:34:52.865 INFO:tasks.workunit.client.0.smithi065.stdout: "num_keys_recovered": 0, 2020-09-08T15:34:52.865 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_omap": 0, 2020-09-08T15:34:52.866 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_hit_set_archive": 0, 2020-09-08T15:34:52.866 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_hit_set_archive": 0, 2020-09-08T15:34:52.866 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush": 0, 2020-09-08T15:34:52.866 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_kb": 0, 2020-09-08T15:34:52.866 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict": 0, 2020-09-08T15:34:52.867 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_kb": 0, 2020-09-08T15:34:52.867 INFO:tasks.workunit.client.0.smithi065.stdout: "num_promote": 0, 2020-09-08T15:34:52.867 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_high": 0, 2020-09-08T15:34:52.867 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_low": 0, 2020-09-08T15:34:52.867 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_some": 0, 2020-09-08T15:34:52.867 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_full": 0, 2020-09-08T15:34:52.868 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_pinned": 0, 2020-09-08T15:34:52.868 INFO:tasks.workunit.client.0.smithi065.stdout: "num_legacy_snapsets": 0, 2020-09-08T15:34:52.868 INFO:tasks.workunit.client.0.smithi065.stdout: "num_large_omap_objects": 0, 2020-09-08T15:34:52.868 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_manifest": 0, 2020-09-08T15:34:52.868 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_bytes": 0, 2020-09-08T15:34:52.869 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_keys": 0, 2020-09-08T15:34:52.869 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_repaired": 0 2020-09-08T15:34:52.869 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.869 INFO:tasks.workunit.client.0.smithi065.stdout: "store_stats": { 2020-09-08T15:34:52.869 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 0, 2020-09-08T15:34:52.869 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 0, 2020-09-08T15:34:52.870 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:34:52.870 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 0, 2020-09-08T15:34:52.870 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 0, 2020-09-08T15:34:52.870 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:34:52.870 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:34:52.871 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:34:52.871 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 0, 2020-09-08T15:34:52.871 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 0 2020-09-08T15:34:52.871 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.871 INFO:tasks.workunit.client.0.smithi065.stdout: "log_size": 18, 2020-09-08T15:34:52.872 INFO:tasks.workunit.client.0.smithi065.stdout: "ondisk_log_size": 18, 2020-09-08T15:34:52.872 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 3, 2020-09-08T15:34:52.872 INFO:tasks.workunit.client.0.smithi065.stdout: "acting": 3, 2020-09-08T15:34:52.872 INFO:tasks.workunit.client.0.smithi065.stdout: "num_store_stats": 0 2020-09-08T15:34:52.872 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.872 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_sum": { 2020-09-08T15:34:52.873 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 0, 2020-09-08T15:34:52.873 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 0, 2020-09-08T15:34:52.873 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pgs": 3, 2020-09-08T15:34:52.873 INFO:tasks.workunit.client.0.smithi065.stdout: "num_osds": 3, 2020-09-08T15:34:52.873 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_osds": 3, 2020-09-08T15:34:52.874 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_omap_osds": 3, 2020-09-08T15:34:52.874 INFO:tasks.workunit.client.0.smithi065.stdout: "kb": 314572800, 2020-09-08T15:34:52.874 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used": 19216, 2020-09-08T15:34:52.874 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_data": 2228, 2020-09-08T15:34:52.874 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_omap": 7, 2020-09-08T15:34:52.875 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_meta": 16952, 2020-09-08T15:34:52.875 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_avail": 314553584, 2020-09-08T15:34:52.875 INFO:tasks.workunit.client.0.smithi065.stdout: "statfs": { 2020-09-08T15:34:52.875 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 322122547200, 2020-09-08T15:34:52.875 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 322102870016, 2020-09-08T15:34:52.875 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:34:52.876 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 2281472, 2020-09-08T15:34:52.876 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 1568297, 2020-09-08T15:34:52.876 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:34:52.876 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:34:52.876 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:34:52.877 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 7442, 2020-09-08T15:34:52.877 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 17359598 2020-09-08T15:34:52.877 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.877 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_peers": [], 2020-09-08T15:34:52.878 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_trim_queue_len": 0, 2020-09-08T15:34:52.878 INFO:tasks.workunit.client.0.smithi065.stdout: "num_snap_trimming": 0, 2020-09-08T15:34:52.878 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shards_repaired": 0, 2020-09-08T15:34:52.878 INFO:tasks.workunit.client.0.smithi065.stdout: "op_queue_age_hist": { 2020-09-08T15:34:52.878 INFO:tasks.workunit.client.0.smithi065.stdout: "histogram": [], 2020-09-08T15:34:52.879 INFO:tasks.workunit.client.0.smithi065.stdout: "upper_bound": 1 2020-09-08T15:34:52.879 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.879 INFO:tasks.workunit.client.0.smithi065.stdout: "perf_stat": { 2020-09-08T15:34:52.879 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ms": 0, 2020-09-08T15:34:52.879 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ms": 0, 2020-09-08T15:34:52.879 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ns": 0, 2020-09-08T15:34:52.880 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ns": 0 2020-09-08T15:34:52.880 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.880 INFO:tasks.workunit.client.0.smithi065.stdout: "alerts": [], 2020-09-08T15:34:52.880 INFO:tasks.workunit.client.0.smithi065.stdout: "network_ping_times": [] 2020-09-08T15:34:52.880 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.881 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_sum_by_class": { 2020-09-08T15:34:52.881 INFO:tasks.workunit.client.0.smithi065.stdout: "hdd": { 2020-09-08T15:34:52.881 INFO:tasks.workunit.client.0.smithi065.stdout: "up_from": 0, 2020-09-08T15:34:52.881 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 0, 2020-09-08T15:34:52.881 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pgs": 3, 2020-09-08T15:34:52.881 INFO:tasks.workunit.client.0.smithi065.stdout: "num_osds": 3, 2020-09-08T15:34:52.882 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_osds": 3, 2020-09-08T15:34:52.882 INFO:tasks.workunit.client.0.smithi065.stdout: "num_per_pool_omap_osds": 3, 2020-09-08T15:34:52.882 INFO:tasks.workunit.client.0.smithi065.stdout: "kb": 314572800, 2020-09-08T15:34:52.882 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used": 19216, 2020-09-08T15:34:52.882 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_data": 2228, 2020-09-08T15:34:52.883 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_omap": 7, 2020-09-08T15:34:52.883 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_used_meta": 16952, 2020-09-08T15:34:52.883 INFO:tasks.workunit.client.0.smithi065.stdout: "kb_avail": 314553584, 2020-09-08T15:34:52.883 INFO:tasks.workunit.client.0.smithi065.stdout: "statfs": { 2020-09-08T15:34:52.883 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 322122547200, 2020-09-08T15:34:52.884 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 322102870016, 2020-09-08T15:34:52.884 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:34:52.884 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 2281472, 2020-09-08T15:34:52.884 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 1568297, 2020-09-08T15:34:52.884 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:34:52.884 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:34:52.885 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:34:52.885 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 7442, 2020-09-08T15:34:52.885 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 17359598 2020-09-08T15:34:52.885 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.885 INFO:tasks.workunit.client.0.smithi065.stdout: "hb_peers": [], 2020-09-08T15:34:52.886 INFO:tasks.workunit.client.0.smithi065.stdout: "snap_trim_queue_len": 0, 2020-09-08T15:34:52.886 INFO:tasks.workunit.client.0.smithi065.stdout: "num_snap_trimming": 0, 2020-09-08T15:34:52.886 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shards_repaired": 0, 2020-09-08T15:34:52.886 INFO:tasks.workunit.client.0.smithi065.stdout: "op_queue_age_hist": { 2020-09-08T15:34:52.886 INFO:tasks.workunit.client.0.smithi065.stdout: "histogram": [], 2020-09-08T15:34:52.886 INFO:tasks.workunit.client.0.smithi065.stdout: "upper_bound": 1 2020-09-08T15:34:52.887 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.887 INFO:tasks.workunit.client.0.smithi065.stdout: "perf_stat": { 2020-09-08T15:34:52.887 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ms": 0, 2020-09-08T15:34:52.887 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ms": 0, 2020-09-08T15:34:52.888 INFO:tasks.workunit.client.0.smithi065.stdout: "commit_latency_ns": 0, 2020-09-08T15:34:52.888 INFO:tasks.workunit.client.0.smithi065.stdout: "apply_latency_ns": 0 2020-09-08T15:34:52.888 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.888 INFO:tasks.workunit.client.0.smithi065.stdout: "alerts": [], 2020-09-08T15:34:52.888 INFO:tasks.workunit.client.0.smithi065.stdout: "network_ping_times": [] 2020-09-08T15:34:52.889 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.889 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.889 INFO:tasks.workunit.client.0.smithi065.stdout: "pool_stats": [ 2020-09-08T15:34:52.889 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.889 INFO:tasks.workunit.client.0.smithi065.stdout: "poolid": 1, 2020-09-08T15:34:52.889 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg": 1, 2020-09-08T15:34:52.890 INFO:tasks.workunit.client.0.smithi065.stdout: "stat_sum": { 2020-09-08T15:34:52.890 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes": 48430, 2020-09-08T15:34:52.890 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects": 101, 2020-09-08T15:34:52.890 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_clones": 1, 2020-09-08T15:34:52.890 INFO:tasks.workunit.client.0.smithi065.stdout: "num_object_copies": 303, 2020-09-08T15:34:52.891 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing_on_primary": 0, 2020-09-08T15:34:52.891 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_missing": 0, 2020-09-08T15:34:52.891 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_degraded": 101, 2020-09-08T15:34:52.891 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_misplaced": 0, 2020-09-08T15:34:52.891 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_unfound": 0, 2020-09-08T15:34:52.891 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_dirty": 101, 2020-09-08T15:34:52.892 INFO:tasks.workunit.client.0.smithi065.stdout: "num_whiteouts": 0, 2020-09-08T15:34:52.892 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read": 0, 2020-09-08T15:34:52.892 INFO:tasks.workunit.client.0.smithi065.stdout: "num_read_kb": 0, 2020-09-08T15:34:52.892 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write": 101, 2020-09-08T15:34:52.892 INFO:tasks.workunit.client.0.smithi065.stdout: "num_write_kb": 101, 2020-09-08T15:34:52.893 INFO:tasks.workunit.client.0.smithi065.stdout: "num_scrub_errors": 0, 2020-09-08T15:34:52.893 INFO:tasks.workunit.client.0.smithi065.stdout: "num_shallow_scrub_errors": 0, 2020-09-08T15:34:52.893 INFO:tasks.workunit.client.0.smithi065.stdout: "num_deep_scrub_errors": 0, 2020-09-08T15:34:52.893 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_recovered": 0, 2020-09-08T15:34:52.893 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_recovered": 0, 2020-09-08T15:34:52.894 INFO:tasks.workunit.client.0.smithi065.stdout: "num_keys_recovered": 0, 2020-09-08T15:34:52.894 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_omap": 0, 2020-09-08T15:34:52.894 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_hit_set_archive": 0, 2020-09-08T15:34:52.894 INFO:tasks.workunit.client.0.smithi065.stdout: "num_bytes_hit_set_archive": 0, 2020-09-08T15:34:52.894 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush": 0, 2020-09-08T15:34:52.895 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_kb": 0, 2020-09-08T15:34:52.895 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict": 0, 2020-09-08T15:34:52.895 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_kb": 0, 2020-09-08T15:34:52.896 INFO:tasks.workunit.client.0.smithi065.stdout: "num_promote": 0, 2020-09-08T15:34:52.896 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_high": 0, 2020-09-08T15:34:52.896 INFO:tasks.workunit.client.0.smithi065.stdout: "num_flush_mode_low": 0, 2020-09-08T15:34:52.896 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_some": 0, 2020-09-08T15:34:52.897 INFO:tasks.workunit.client.0.smithi065.stdout: "num_evict_mode_full": 0, 2020-09-08T15:34:52.897 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_pinned": 0, 2020-09-08T15:34:52.897 INFO:tasks.workunit.client.0.smithi065.stdout: "num_legacy_snapsets": 0, 2020-09-08T15:34:52.897 INFO:tasks.workunit.client.0.smithi065.stdout: "num_large_omap_objects": 0, 2020-09-08T15:34:52.897 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_manifest": 0, 2020-09-08T15:34:52.897 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_bytes": 0, 2020-09-08T15:34:52.898 INFO:tasks.workunit.client.0.smithi065.stdout: "num_omap_keys": 0, 2020-09-08T15:34:52.898 INFO:tasks.workunit.client.0.smithi065.stdout: "num_objects_repaired": 0 2020-09-08T15:34:52.898 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.898 INFO:tasks.workunit.client.0.smithi065.stdout: "store_stats": { 2020-09-08T15:34:52.898 INFO:tasks.workunit.client.0.smithi065.stdout: "total": 0, 2020-09-08T15:34:52.899 INFO:tasks.workunit.client.0.smithi065.stdout: "available": 0, 2020-09-08T15:34:52.899 INFO:tasks.workunit.client.0.smithi065.stdout: "internally_reserved": 0, 2020-09-08T15:34:52.899 INFO:tasks.workunit.client.0.smithi065.stdout: "allocated": 1241088, 2020-09-08T15:34:52.899 INFO:tasks.workunit.client.0.smithi065.stdout: "data_stored": 1241088, 2020-09-08T15:34:52.899 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed": 0, 2020-09-08T15:34:52.899 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_allocated": 0, 2020-09-08T15:34:52.900 INFO:tasks.workunit.client.0.smithi065.stdout: "data_compressed_original": 0, 2020-09-08T15:34:52.900 INFO:tasks.workunit.client.0.smithi065.stdout: "omap_allocated": 0, 2020-09-08T15:34:52.900 INFO:tasks.workunit.client.0.smithi065.stdout: "internal_metadata": 0 2020-09-08T15:34:52.900 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.900 INFO:tasks.workunit.client.0.smithi065.stdout: "log_size": 18, 2020-09-08T15:34:52.901 INFO:tasks.workunit.client.0.smithi065.stdout: "ondisk_log_size": 18, 2020-09-08T15:34:52.901 INFO:tasks.workunit.client.0.smithi065.stdout: "up": 3, 2020-09-08T15:34:52.901 INFO:tasks.workunit.client.0.smithi065.stdout: "acting": 3, 2020-09-08T15:34:52.901 INFO:tasks.workunit.client.0.smithi065.stdout: "num_store_stats": 3 2020-09-08T15:34:52.901 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.902 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:52.902 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_stats": [ 2020-09-08T15:34:52.902 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.902 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:34:52.902 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 180388626443 2020-09-08T15:34:52.902 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.903 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.903 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:34:52.903 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 42949672982 2020-09-08T15:34:52.903 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.903 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.904 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:34:52.904 INFO:tasks.workunit.client.0.smithi065.stdout: "seq": 193273528330 2020-09-08T15:34:52.904 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.904 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:52.904 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_by_state": [ 2020-09-08T15:34:52.904 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.905 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "active+undersized+degraded", 2020-09-08T15:34:52.905 INFO:tasks.workunit.client.0.smithi065.stdout: "num": 1 2020-09-08T15:34:52.905 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.905 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:52.906 INFO:tasks.workunit.client.0.smithi065.stdout: "num_pg_by_osd": [ 2020-09-08T15:34:52.906 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.906 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2, 2020-09-08T15:34:52.906 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 0, 2020-09-08T15:34:52.906 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 1, 2020-09-08T15:34:52.907 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:34:52.907 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.907 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.907 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 2147483647, 2020-09-08T15:34:52.908 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 0, 2020-09-08T15:34:52.908 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 1, 2020-09-08T15:34:52.908 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:34:52.909 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.909 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.909 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 1, 2020-09-08T15:34:52.909 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 0, 2020-09-08T15:34:52.910 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 0, 2020-09-08T15:34:52.910 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:34:52.911 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.911 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.911 INFO:tasks.workunit.client.0.smithi065.stdout: "osd": 0, 2020-09-08T15:34:52.911 INFO:tasks.workunit.client.0.smithi065.stdout: "num_primary_pg": 1, 2020-09-08T15:34:52.911 INFO:tasks.workunit.client.0.smithi065.stdout: "num_acting_pg": 1, 2020-09-08T15:34:52.912 INFO:tasks.workunit.client.0.smithi065.stdout: "num_up_not_acting_pg": 0 2020-09-08T15:34:52.912 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.912 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:52.912 INFO:tasks.workunit.client.0.smithi065.stdout: "purged_snaps": [ 2020-09-08T15:34:52.912 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:34:52.912 INFO:tasks.workunit.client.0.smithi065.stdout: "pool": 1, 2020-09-08T15:34:52.913 INFO:tasks.workunit.client.0.smithi065.stdout: "purged_snaps": {} 2020-09-08T15:34:52.913 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.913 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:34:52.913 INFO:tasks.workunit.client.0.smithi065.stdout: "servicemap": { 2020-09-08T15:34:52.913 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": 5, 2020-09-08T15:34:52.914 INFO:tasks.workunit.client.0.smithi065.stdout: "modified": "2020-09-08T15:33:19.890788+0000", 2020-09-08T15:34:52.914 INFO:tasks.workunit.client.0.smithi065.stdout: "services": {} 2020-09-08T15:34:52.914 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:34:52.914 INFO:tasks.workunit.client.0.smithi065.stdout: "paxos": { 2020-09-08T15:34:52.914 INFO:tasks.workunit.client.0.smithi065.stdout: "first_committed": 1, 2020-09-08T15:34:52.914 INFO:tasks.workunit.client.0.smithi065.stdout: "last_committed": 511, 2020-09-08T15:34:52.915 INFO:tasks.workunit.client.0.smithi065.stdout: "last_pn": 0, 2020-09-08T15:34:52.915 INFO:tasks.workunit.client.0.smithi065.stdout: "accepted_pn": 0 2020-09-08T15:34:52.915 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:34:52.915 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:34:52.916 INFO:tasks.workunit.client.0.smithi065.stderr:report 3262249118 2020-09-08T15:34:52.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1604: wait_for_clean: return 1 2020-09-08T15:34:52.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:341: TEST_divergent_ec: echo 'delay recovery' 2020-09-08T15:34:52.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:342: TEST_divergent_ec: ceph pg dump pgs 2020-09-08T15:34:52.917 INFO:tasks.workunit.client.0.smithi065.stdout:delay recovery 2020-09-08T15:34:53.049 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:34:53.050 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 101 0 101 0 0 48430 0 0 18 18 active+undersized+degraded 2020-09-08T15:34:15.876674+0000 40'102 47:136 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2020-09-08T15:32:21.938326+0000 0'0 2020-09-08T15:32:21.938326+0000 0 2020-09-08T15:34:53.050 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:34:53.050 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:34:53.051 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:34:53.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2020-09-08T15:34:53.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.0 2020-09-08T15:34:53.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-09-08T15:34:53.064 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-09-08T15:34:53.064 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:34:53.064 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:34:53.064 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:34:53.064 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.0.asok 2020-09-08T15:34:53.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2020-09-08T15:34:53.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.0.asok set_recovery_delay 100000 2020-09-08T15:34:53.158 INFO:tasks.workunit.client.0.smithi065.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2020-09-08T15:34:53.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2020-09-08T15:34:53.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.2 2020-09-08T15:34:53.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-09-08T15:34:53.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-09-08T15:34:53.167 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:34:53.168 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:34:53.168 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:34:53.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.2.asok 2020-09-08T15:34:53.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2020-09-08T15:34:53.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.2.asok set_recovery_delay 100000 2020-09-08T15:34:53.264 INFO:tasks.workunit.client.0.smithi065.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2020-09-08T15:34:53.271 INFO:tasks.workunit.client.0.smithi065.stdout:revive divergent 1 2020-09-08T15:34:53.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:349: TEST_divergent_ec: echo 'revive divergent 1' 2020-09-08T15:34:53.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:350: TEST_divergent_ec: ceph pg dump pgs 2020-09-08T15:34:53.648 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:34:53.649 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 101 0 101 0 0 48430 0 0 18 18 active+undersized+degraded 2020-09-08T15:34:15.876674+0000 40'102 47:136 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2020-09-08T15:32:21.938326+0000 0'0 2020-09-08T15:32:21.938326+0000 0 2020-09-08T15:34:53.649 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:34:53.649 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:34:53.650 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:34:53.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:351: TEST_divergent_ec: ceph osd set noup 2020-09-08T15:34:54.438 INFO:tasks.workunit.client.0.smithi065.stderr:noup is set 2020-09-08T15:34:54.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:352: TEST_divergent_ec: activate_osd td/divergent-priors 1 2020-09-08T15:34:54.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/divergent-priors 2020-09-08T15:34:54.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:34:54.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=1 2020-09-08T15:34:54.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:34:54.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/divergent-priors/1 2020-09-08T15:34:54.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:34:54.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:34:54.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:34:54.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:34:54.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2020-09-08T15:34:54.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2020-09-08T15:34:54.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:34:54.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:34:54.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:34:54.454 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:34:54.454 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:34:54.454 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:34:54.454 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:34:54.454 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:34:54.455 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:34:54.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:34:54.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:34:54.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:34:54.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:34:54.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:34:54.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:34:54.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:34:54.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:34:54.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:34:54.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:34:54.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/divergent-priors/1 2020-09-08T15:34:54.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.1 2020-09-08T15:34:54.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 1 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:34:54.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/divergent-priors/1/whoami 2020-09-08T15:34:54.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 1 = 1 ']' 2020-09-08T15:34:54.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:34:54.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:34:54.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:34:54.465 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:34:54.474 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:34:54.478+0000 7f6efb2a4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:34:54.475 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:34:54.480+0000 7f6efb2a4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:34:54.476 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:34:54.481+0000 7f6efb2a4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:34:54.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:877: activate_osd: return 0 2020-09-08T15:34:54.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:353: TEST_divergent_ec: sleep 5 2020-09-08T15:34:54.996 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:34:54.997+0000 7f6efb2a4ec0 -1 Falling back to public interface 2020-09-08T15:34:55.911 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:34:55.916+0000 7f6efb2a4ec0 -1 osd.1 30 log_to_monitors {default=true} 2020-09-08T15:34:59.844 INFO:tasks.workunit.client.0.smithi065.stdout:delay recovery divergent 2020-09-08T15:34:59.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:355: TEST_divergent_ec: echo 'delay recovery divergent' 2020-09-08T15:34:59.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:356: TEST_divergent_ec: ceph pg dump pgs 2020-09-08T15:35:00.231 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:35:00.232 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 101 0 101 0 0 48430 0 0 18 18 active+undersized+degraded 2020-09-08T15:34:15.876674+0000 40'102 47:137 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2020-09-08T15:32:21.938326+0000 0'0 2020-09-08T15:32:21.938326+0000 0 2020-09-08T15:35:00.232 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:35:00.232 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:35:00.233 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:35:00.242 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: get_asok_path osd.1 2020-09-08T15:35:00.242 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-09-08T15:35:00.243 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-09-08T15:35:00.243 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:35:00.243 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:35:00.243 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:35:00.243 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30667/ceph-osd.1.asok 2020-09-08T15:35:00.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: CEPH_ARGS= 2020-09-08T15:35:00.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.30667/ceph-osd.1.asok set_recovery_delay 100000 2020-09-08T15:35:00.340 INFO:tasks.workunit.client.0.smithi065.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2020-09-08T15:35:00.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:359: TEST_divergent_ec: ceph osd unset noup 2020-09-08T15:35:00.948 INFO:tasks.workunit.client.0.smithi065.stderr:noup is unset 2020-09-08T15:35:00.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:361: TEST_divergent_ec: wait_for_osd up 0 2020-09-08T15:35:00.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:35:00.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:35:00.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:35:00.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:35:00.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:35:00.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:35:00.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:35:00.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:35:00.959 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:35:01.385 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 42 up_thru 45 down_at 41 last_clean_interval [36,40) [v2:127.0.0.1:6802/73053,v1:127.0.0.1:6803/73053] [v2:127.0.0.1:6804/73053,v1:127.0.0.1:6805/73053] exists,up bf9e879c-7aad-47a6-b313-d798e2659805 2020-09-08T15:35:01.385 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:35:01.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:35:01.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:35:01.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:35:01.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:362: TEST_divergent_ec: wait_for_osd up 1 2020-09-08T15:35:01.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:35:01.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:35:01.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:35:01.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:35:01.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:35:01.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:35:01.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:35:01.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:35:01.819 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 51 up_thru 51 down_at 32 last_clean_interval [10,30) [v2:127.0.0.1:6818/75406,v1:127.0.0.1:6819/75406] [v2:127.0.0.1:6820/75406,v1:127.0.0.1:6821/75406] exists,up 9638912c-2705-4309-bba1-4a617ae644ec 2020-09-08T15:35:01.819 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:35:01.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:35:01.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:35:01.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:35:01.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:363: TEST_divergent_ec: wait_for_osd up 2 2020-09-08T15:35:01.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:35:01.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:35:01.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:35:01.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:35:01.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:35:01.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:35:01.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:35:01.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:35:02.218 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 45 up_thru 0 down_at 44 last_clean_interval [37,40) [v2:127.0.0.1:6810/73702,v1:127.0.0.1:6811/73702] [v2:127.0.0.1:6812/73702,v1:127.0.0.1:6813/73702] exists,up e537af10-6bdf-47c4-9f94-34575593ecc4 2020-09-08T15:35:02.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:35:02.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:35:02.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:35:02.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:365: TEST_divergent_ec: ceph pg dump pgs 2020-09-08T15:35:02.598 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:35:02.599 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 101 0 101 0 0 48430 0 0 18 18 active+undersized+degraded 2020-09-08T15:34:15.876674+0000 40'102 47:137 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2020-09-08T15:32:21.938326+0000 0'0 2020-09-08T15:32:21.938326+0000 0 2020-09-08T15:35:02.599 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:35:02.599 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:35:02.599 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:35:02.608 INFO:tasks.workunit.client.0.smithi065.stdout:wait for peering 2020-09-08T15:35:02.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:366: TEST_divergent_ec: echo 'wait for peering' 2020-09-08T15:35:02.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:367: TEST_divergent_ec: ceph pg dump pgs 2020-09-08T15:35:02.982 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:35:02.982 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 101 0 101 0 0 48430 0 0 18 18 active+undersized+degraded 2020-09-08T15:34:15.876674+0000 40'102 47:137 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2020-09-08T15:32:21.938326+0000 0'0 2020-09-08T15:32:21.938326+0000 0 2020-09-08T15:35:02.982 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:35:02.983 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:35:02.983 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:35:02.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:368: TEST_divergent_ec: rados -p test put foo /etc/fstab 2020-09-08T15:35:11.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:370: TEST_divergent_ec: echo 'killing divergent 1' 2020-09-08T15:35:11.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:371: TEST_divergent_ec: ceph pg dump pgs 2020-09-08T15:35:11.955 INFO:tasks.workunit.client.0.smithi065.stdout:killing divergent 1 2020-09-08T15:35:12.340 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:35:12.341 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 101 4 4 0 0 48430 0 0 12 12 active+recovering+degraded+wait 2020-09-08T15:35:01.613537+0000 40'102 52:128 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:32:21.938326+0000 0'0 2020-09-08T15:32:21.938326+0000 0 2020-09-08T15:35:12.352 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:35:12.352 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:35:12.353 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:35:12.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:372: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.1 2020-09-08T15:35:12.361 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:35:12.361 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:35:12.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:35:12.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:35:12.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:35:12.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:35:12.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:374: TEST_divergent_ec: echo 'reviving divergent 1' 2020-09-08T15:35:12.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:375: TEST_divergent_ec: ceph pg dump pgs 2020-09-08T15:35:12.456 INFO:tasks.workunit.client.0.smithi065.stdout:reviving divergent 1 2020-09-08T15:35:12.834 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:35:12.835 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 101 4 4 0 0 48430 0 0 12 12 active+recovering+degraded+wait 2020-09-08T15:35:01.613537+0000 40'102 52:128 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:32:21.938326+0000 0'0 2020-09-08T15:32:21.938326+0000 0 2020-09-08T15:35:12.835 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:35:12.835 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:35:12.836 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:35:12.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:376: TEST_divergent_ec: activate_osd td/divergent-priors 1 2020-09-08T15:35:12.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/divergent-priors 2020-09-08T15:35:12.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:35:12.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=1 2020-09-08T15:35:12.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:35:12.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/divergent-priors/1 2020-09-08T15:35:12.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2020-09-08T15:35:12.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:35:12.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:35:12.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:35:12.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2020-09-08T15:35:12.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2020-09-08T15:35:12.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:35:12.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:35:12.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2020-09-08T15:35:12.865 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:35:12.865 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:35:12.872 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:35:12.872 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:35:12.872 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:35:12.872 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:35:12.872 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:35:12.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' 2020-09-08T15:35:12.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:35:12.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2020-09-08T15:35:12.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2020-09-08T15:35:12.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:35:12.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:35:12.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:35:12.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:35:12.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:35:12.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/divergent-priors/1 2020-09-08T15:35:12.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.1 2020-09-08T15:35:12.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 1 --fsid=c25e19f6-e2e3-4d0b-8f34-71c93296ff3c --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.30667/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:35:12.876 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/divergent-priors/1/whoami 2020-09-08T15:35:12.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 1 = 1 ']' 2020-09-08T15:35:12.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:35:12.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:35:12.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:35:12.881 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:35:12.883 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:12.880+0000 7f32b644fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:35:12.883 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:12.882+0000 7f32b644fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:35:12.885 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:12.884+0000 7f32b644fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:35:13.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 1 2020-09-08T15:35:13.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:35:13.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:35:13.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:35:13.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:35:13.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:35:13.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:35:13.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:35:13.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:35:13.254 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:35:13.395 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:13.399+0000 7f32b644fec0 -1 Falling back to public interface 2020-09-08T15:35:13.645 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 51 up_thru 51 down_at 32 last_clean_interval [10,30) [v2:127.0.0.1:6818/75406,v1:127.0.0.1:6819/75406] [v2:127.0.0.1:6820/75406,v1:127.0.0.1:6821/75406] exists,up 9638912c-2705-4309-bba1-4a617ae644ec 2020-09-08T15:35:13.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:35:13.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:35:13.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:35:13.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:378: TEST_divergent_ec: sleep 20 2020-09-08T15:35:14.541 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:14.546+0000 7f32b644fec0 -1 osd.1 52 log_to_monitors {default=true} 2020-09-08T15:35:33.648 INFO:tasks.workunit.client.0.smithi065.stdout:allowing recovery 2020-09-08T15:35:33.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:380: TEST_divergent_ec: echo 'allowing recovery' 2020-09-08T15:35:33.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:381: TEST_divergent_ec: ceph pg dump pgs 2020-09-08T15:35:34.033 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:35:34.033 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 102 0 0 0 0 48913 0 0 13 13 active+clean 2020-09-08T15:35:16.258842+0000 52'103 55:152 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:32:21.938326+0000 0'0 2020-09-08T15:32:21.938326+0000 0 2020-09-08T15:35:34.033 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:35:34.034 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:35:34.035 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:35:34.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:383: TEST_divergent_ec: for i in $osds 2020-09-08T15:35:34.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:385: TEST_divergent_ec: ceph tell osd.0 debug kick_recovery_wq 0 2020-09-08T15:35:34.170 INFO:tasks.workunit.client.0.smithi065.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2020-09-08T15:35:34.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:383: TEST_divergent_ec: for i in $osds 2020-09-08T15:35:34.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:385: TEST_divergent_ec: ceph tell osd.1 debug kick_recovery_wq 0 2020-09-08T15:35:34.339 INFO:tasks.workunit.client.0.smithi065.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2020-09-08T15:35:34.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:383: TEST_divergent_ec: for i in $osds 2020-09-08T15:35:34.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:385: TEST_divergent_ec: ceph tell osd.2 debug kick_recovery_wq 0 2020-09-08T15:35:34.474 INFO:tasks.workunit.client.0.smithi065.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2020-09-08T15:35:34.482 INFO:tasks.workunit.client.0.smithi065.stdout:reading divergent objects 2020-09-08T15:35:34.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:388: TEST_divergent_ec: echo 'reading divergent objects' 2020-09-08T15:35:34.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:389: TEST_divergent_ec: ceph pg dump pgs 2020-09-08T15:35:34.856 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:35:34.857 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 102 0 0 0 0 48913 0 0 13 13 active+clean 2020-09-08T15:35:16.258842+0000 52'103 55:152 [1,0,2] 1 [1,0,2] 1 0'0 2020-09-08T15:32:21.938326+0000 0'0 2020-09-08T15:32:21.938326+0000 0 2020-09-08T15:35:34.857 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:35:34.857 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:35:34.858 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:35:34.867 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: expr 2 + 2 2020-09-08T15:35:34.868 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: seq 1 4 2020-09-08T15:35:34.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2020-09-08T15:35:34.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:392: TEST_divergent_ec: rados -p test get existing_1 td/divergent-priors/existing 2020-09-08T15:35:34.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2020-09-08T15:35:34.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:392: TEST_divergent_ec: rados -p test get existing_2 td/divergent-priors/existing 2020-09-08T15:35:34.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2020-09-08T15:35:34.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:392: TEST_divergent_ec: rados -p test get existing_3 td/divergent-priors/existing 2020-09-08T15:35:35.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2020-09-08T15:35:35.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:392: TEST_divergent_ec: rados -p test get existing_4 td/divergent-priors/existing 2020-09-08T15:35:35.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:394: TEST_divergent_ec: rm -f td/divergent-priors/existing 2020-09-08T15:35:35.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:396: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2020-09-08T15:35:35.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:396: TEST_divergent_ec: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2020-09-08T15:35:35.066 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:1 entries: 30'103 (29'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2020-09-08T15:32:59.465328+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 2020-09-08T15:35:35.066 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 20 _merge_object_divergent_entries: keeping 30'103 (29'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2020-09-08T15:32:59.465328+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 2020-09-08T15:35:35.067 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2020-09-08T15:35:35.067 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version: 29'99 first_divergent_update: 30'103 last_divergent_update: 30'103 2020-09-08T15:35:35.067 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 has no more recent entries in log 2020-09-08T15:35:35.067 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version or op type indicates creation, deleting 2020-09-08T15:35:35.067 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:head entries: 30'104 (29'99) modify 1:7a80c0d5:::existing_99:head by client.4555.0:1 2020-09-08T15:33:07.226615+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:35:35.068 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 20 _merge_object_divergent_entries: keeping 30'104 (29'99) modify 1:7a80c0d5:::existing_99:head by client.4555.0:1 2020-09-08T15:33:07.226615+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:35:35.068 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2020-09-08T15:35:35.068 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head prior_version: 29'99 first_divergent_update: 30'104 last_divergent_update: 30'104 2020-09-08T15:35:35.068 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head has no more recent entries in log 2020-09-08T15:35:35.069 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head must be rolled back or recovered, attempting to rollback 2020-09-08T15:35:35.069 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head olog_can_rollback_to: 30'104 2020-09-08T15:35:35.069 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot rollback 30'104 (29'99) modify 1:7a80c0d5:::existing_99:head by client.4555.0:1 2020-09-08T15:33:07.226615+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:35:35.069 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot roll back, removing and adding to missing 2020-09-08T15:35:35.069 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 29'101 (29'100) modify 1:c156033e:::existing_100:head by client.4546.0:1 2020-09-08T15:33:05.982685+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0,29'102 (29'101) modify 1:c156033e:::existing_100:head by client.4552.0:1 2020-09-08T15:33:06.977617+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:35:35.070 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 20 _merge_object_divergent_entries: keeping 29'101 (29'100) modify 1:c156033e:::existing_100:head by client.4546.0:1 2020-09-08T15:33:05.982685+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:35:35.070 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 20 _merge_object_divergent_entries: keeping 29'102 (29'101) modify 1:c156033e:::existing_100:head by client.4552.0:1 2020-09-08T15:33:06.977617+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:35:35.071 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2020-09-08T15:35:35.071 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 29'100 first_divergent_update: 29'101 last_divergent_update: 29'102 2020-09-08T15:35:35.071 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2020-09-08T15:35:35.071 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2020-09-08T15:35:35.071 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 30'104 2020-09-08T15:35:35.072 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 29'102 (29'101) modify 1:c156033e:::existing_100:head by client.4552.0:1 2020-09-08T15:33:06.977617+0000 0 ObjectCleanRegions clean_offsets: [483~18446744073709551132], clean_omap: 1, new_object: 0 2020-09-08T15:35:35.072 INFO:tasks.workunit.client.0.smithi065.stdout:td/divergent-priors/osd.1.log:2020-09-08T15:35:01.402+0000 7f6ed8bdf700 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2020-09-08T15:35:35.072 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:405: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2020-09-08T15:35:35.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:405: TEST_divergent_ec: grep -q '_merge_object_divergent_entries.*rolled back' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2020-09-08T15:35:35.073 INFO:tasks.workunit.client.0.smithi065.stdout:success 2020-09-08T15:35:35.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:410: TEST_divergent_ec: echo success 2020-09-08T15:35:35.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:412: TEST_divergent_ec: delete_pool test 2020-09-08T15:35:35.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test 2020-09-08T15:35:35.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2020-09-08T15:35:35.686 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' does not exist 2020-09-08T15:35:35.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:413: TEST_divergent_ec: kill_daemons td/divergent-priors 2020-09-08T15:35:35.694 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:35:35.694 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:35:35.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:35:35.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:35:35.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:35:36.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:35:36.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2020-09-08T15:35:36.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/divergent-priors 2020-09-08T15:35:36.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:35:36.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/divergent-priors KILL 2020-09-08T15:35:36.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:35:36.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:35:36.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:35:36.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:35:36.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:35:36.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:35:36.008 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:35:36.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:35:36.009 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:35:36.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:35:36.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:35:36.010 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:35:36.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:35:36.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:35:36.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:35:36.012 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:35:36.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:35:36.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:35:36.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/divergent-priors 2020-09-08T15:35:36.026 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:35:36.026 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:35:36.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:35:36.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30667 2020-09-08T15:35:36.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:35:36.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:35:36.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2151: main: code=0 2020-09-08T15:35:36.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2155: main: teardown td/divergent-priors 0 2020-09-08T15:35:36.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/divergent-priors 2020-09-08T15:35:36.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2020-09-08T15:35:36.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/divergent-priors KILL 2020-09-08T15:35:36.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:35:36.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:35:36.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:35:36.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:35:36.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:35:36.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:35:36.033 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:35:36.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:35:36.034 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:35:36.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:35:36.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:35:36.034 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:35:36.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:35:36.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:35:36.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:35:36.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:35:36.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:35:36.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2020-09-08T15:35:36.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/divergent-priors 2020-09-08T15:35:36.038 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:35:36.038 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:35:36.038 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30667 2020-09-08T15:35:36.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30667 2020-09-08T15:35:36.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:35:36.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:35:36.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2156: main: return 0 2020-09-08T15:35:36.041 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-09-08T15:35:36.043 INFO:teuthology.orchestra.run.smithi065:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-09-08T15:35:36.086 INFO:tasks.workunit:Running workunit osd/ec-error-rollforward.sh... 2020-09-08T15:35:36.086 INFO:teuthology.orchestra.run.smithi065:workunit test osd/ec-error-rollforward.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dce4d291bd4243c9802c17d67b85a6da6bbc0f8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh 2020-09-08T15:35:36.147 INFO:tasks.workunit.client.0.smithi065.stderr:stty: 'standard input': Inappropriate ioctl for device 2020-09-08T15:35:36.156 INFO:tasks.workunit.client.0.smithi065.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2020-09-08T15:35:36.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T15:35:36.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T15:35:36.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: export PYTHONWARNINGS=ignore 2020-09-08T15:35:36.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: PYTHONWARNINGS=ignore 2020-09-08T15:35:36.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: export CEPH_CONF=/dev/null 2020-09-08T15:35:36.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: CEPH_CONF=/dev/null 2020-09-08T15:35:36.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2147: main: unset CEPH_ARGS 2020-09-08T15:35:36.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2149: main: local code 2020-09-08T15:35:36.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2150: main: run td/ec-error-rollforward 2020-09-08T15:35:36.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:6: run: local dir=td/ec-error-rollforward 2020-09-08T15:35:36.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:7: run: shift 2020-09-08T15:35:36.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: export CEPH_MON=127.0.0.1:7132 2020-09-08T15:35:36.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: CEPH_MON=127.0.0.1:7132 2020-09-08T15:35:36.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:11: run: export CEPH_ARGS 2020-09-08T15:35:36.159 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: uuidgen 2020-09-08T15:35:36.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: CEPH_ARGS+='--fsid=2f05732e-bc58-4241-932d-08bf792e4516 --auth-supported=none ' 2020-09-08T15:35:36.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:13: run: CEPH_ARGS+='--mon-host=127.0.0.1:7132 ' 2020-09-08T15:35:36.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: export margin=10 2020-09-08T15:35:36.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: margin=10 2020-09-08T15:35:36.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: export objects=200 2020-09-08T15:35:36.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: objects=200 2020-09-08T15:35:36.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: export poolname=test 2020-09-08T15:35:36.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: poolname=test 2020-09-08T15:35:36.161 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: set 2020-09-08T15:35:36.161 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2020-09-08T15:35:36.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: local funcs=TEST_ec_error_rollforward 2020-09-08T15:35:36.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:19: run: for func in $funcs 2020-09-08T15:35:36.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:20: run: setup td/ec-error-rollforward 2020-09-08T15:35:36.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ec-error-rollforward 2020-09-08T15:35:36.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ec-error-rollforward 2020-09-08T15:35:36.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ec-error-rollforward 2020-09-08T15:35:36.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:35:36.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ec-error-rollforward KILL 2020-09-08T15:35:36.200 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:35:36.200 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:35:36.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:35:36.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:35:36.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:35:36.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:35:36.201 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:35:36.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:35:36.202 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:35:36.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:35:36.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:35:36.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:35:36.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:35:36.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:35:36.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:35:36.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:35:36.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:35:36.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:35:36.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ec-error-rollforward 2020-09-08T15:35:36.205 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:35:36.205 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:35:36.206 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.76703 2020-09-08T15:35:36.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.76703 2020-09-08T15:35:36.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:35:36.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:35:36.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ec-error-rollforward 2020-09-08T15:35:36.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T15:35:36.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:35:36.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.76703 2020-09-08T15:35:36.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.76703 2020-09-08T15:35:36.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T15:35:36.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2020-09-08T15:35:36.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2020-09-08T15:35:36.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T15:35:36.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ec-error-rollforward 1' TERM HUP INT 2020-09-08T15:35:36.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:21: run: TEST_ec_error_rollforward td/ec-error-rollforward 2020-09-08T15:35:36.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:27: TEST_ec_error_rollforward: local dir=td/ec-error-rollforward 2020-09-08T15:35:36.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:28: TEST_ec_error_rollforward: run_mon td/ec-error-rollforward a 2020-09-08T15:35:36.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ec-error-rollforward 2020-09-08T15:35:36.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T15:35:36.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T15:35:36.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T15:35:36.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ec-error-rollforward/a 2020-09-08T15:35:36.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ec-error-rollforward/a --run-dir=td/ec-error-rollforward 2020-09-08T15:35:36.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T15:35:36.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:35:36.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:35:36.492 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:35:36.493 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:35:36.493 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.76703 2020-09-08T15:35:36.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.76703/$cluster-$name.asok' 2020-09-08T15:35:36.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ec-error-rollforward/a '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' --mon-cluster-log-file=td/ec-error-rollforward/log --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T15:35:36.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T15:35:36.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T15:35:36.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:35:36.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:35:36.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T15:35:36.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T15:35:36.688 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:35:36.688 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:35:36.688 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:35:36.689 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:35:36.689 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:35:36.689 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.76703 2020-09-08T15:35:36.689 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.76703/ceph-mon.a.asok 2020-09-08T15:35:36.689 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:35:36.691 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.76703/ceph-mon.a.asok config get fsid 2020-09-08T15:35:36.780 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T15:35:36.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:35:36.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:35:36.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T15:35:36.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T15:35:36.781 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:35:36.782 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:35:36.782 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:35:36.782 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:35:36.782 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:35:36.783 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.76703 2020-09-08T15:35:36.783 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.76703/ceph-mon.a.asok 2020-09-08T15:35:36.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:35:36.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.76703/ceph-mon.a.asok config get mon_host 2020-09-08T15:35:36.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:29: TEST_ec_error_rollforward: run_mgr td/ec-error-rollforward x 2020-09-08T15:35:36.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ec-error-rollforward 2020-09-08T15:35:36.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T15:35:36.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T15:35:36.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T15:35:36.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ec-error-rollforward/x 2020-09-08T15:35:36.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T15:35:37.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T15:35:37.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:35:37.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:35:37.797 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:35:37.797 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:35:37.797 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.76703 2020-09-08T15:35:37.797 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.76703/$cluster-$name.asok' 2020-09-08T15:35:37.798 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:35:37.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ec-error-rollforward/x '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:35:37.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:30: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 0 2020-09-08T15:35:37.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ec-error-rollforward 2020-09-08T15:35:37.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:35:37.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T15:35:37.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:35:37.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ec-error-rollforward/0 2020-09-08T15:35:37.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=2f05732e-bc58-4241-932d-08bf792e4516 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2020-09-08T15:35:37.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:35:37.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:35:37.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:35:37.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2020-09-08T15:35:37.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2020-09-08T15:35:37.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:35:37.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:35:37.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2020-09-08T15:35:37.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:35:37.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:35:37.828 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:35:37.833 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:35:37.833 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:35:37.834 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.76703 2020-09-08T15:35:37.834 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.76703/$cluster-$name.asok' 2020-09-08T15:35:37.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' 2020-09-08T15:35:37.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:35:37.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:35:37.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:35:37.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2020-09-08T15:35:37.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2020-09-08T15:35:37.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:35:37.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:35:37.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:35:37.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:35:37.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:35:37.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ec-error-rollforward/0 2020-09-08T15:35:37.837 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:35:37.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=8307ccc3-0739-4482-8aa6-c39e9b0c281b 2020-09-08T15:35:37.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 8307ccc3-0739-4482-8aa6-c39e9b0c281b' 2020-09-08T15:35:37.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:35:37.838 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 8307ccc3-0739-4482-8aa6-c39e9b0c281b 2020-09-08T15:35:37.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDJpFdf3WSAMhAAheYiNa7JgwoYh5goL8AyFQ== 2020-09-08T15:35:37.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDJpFdf3WSAMhAAheYiNa7JgwoYh5goL8AyFQ=="}' 2020-09-08T15:35:37.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 8307ccc3-0739-4482-8aa6-c39e9b0c281b -i td/ec-error-rollforward/0/new.json 2020-09-08T15:35:38.180 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:35:38.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ec-error-rollforward/0/new.json 2020-09-08T15:35:38.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=2f05732e-bc58-4241-932d-08bf792e4516 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDJpFdf3WSAMhAAheYiNa7JgwoYh5goL8AyFQ== --osd-uuid 8307ccc3-0739-4482-8aa6-c39e9b0c281b 2020-09-08T15:35:38.212 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:38.216+0000 7f5eb8182ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:35:38.214 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:38.218+0000 7f5eb8182ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:35:38.215 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:38.219+0000 7f5eb8182ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:35:38.216 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:38.220+0000 7f5eb8182ec0 -1 bluestore(td/ec-error-rollforward/0/block) _read_bdev_label failed to open td/ec-error-rollforward/0/block: (2) No such file or directory 2020-09-08T15:35:38.216 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:38.220+0000 7f5eb8182ec0 -1 bluestore(td/ec-error-rollforward/0/block) _read_bdev_label failed to open td/ec-error-rollforward/0/block: (2) No such file or directory 2020-09-08T15:35:38.216 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:38.220+0000 7f5eb8182ec0 -1 bluestore(td/ec-error-rollforward/0/block) _read_bdev_label failed to open td/ec-error-rollforward/0/block: (2) No such file or directory 2020-09-08T15:35:38.267 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:38.271+0000 7f5eb8182ec0 -1 bluestore(td/ec-error-rollforward/0) _read_fsid unparsable uuid 2020-09-08T15:35:42.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ec-error-rollforward/0/keyring 2020-09-08T15:35:42.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:35:42.887 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T15:35:42.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T15:35:42.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ec-error-rollforward/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:35:43.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T15:35:43.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:35:43.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=2f05732e-bc58-4241-932d-08bf792e4516 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:35:43.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:35:43.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:35:43.427 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T15:35:43.446 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:43.450+0000 7fc5486ecec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:35:43.498 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:43.503+0000 7fc5486ecec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:35:43.499 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:43.503+0000 7fc5486ecec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:35:43.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T15:35:43.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:35:43.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:35:43.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:35:43.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:35:43.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:35:43.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:35:43.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:35:43.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:35:43.817 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:35:44.015 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:44.020+0000 7fc5486ecec0 -1 Falling back to public interface 2020-09-08T15:35:44.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:35:44.848 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:44.852+0000 7fc5486ecec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T15:35:45.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:35:45.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:35:45.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:35:45.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:35:45.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:35:45.237 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:35:45.657 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/77562,v1:127.0.0.1:6803/77562] [v2:127.0.0.1:6804/77562,v1:127.0.0.1:6805/77562] exists,up 8307ccc3-0739-4482-8aa6-c39e9b0c281b 2020-09-08T15:35:45.657 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 d4330b67-1f43-4c25-a480-6a764ec865c1 2020-09-08T15:35:45.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:35:45.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:35:45.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:35:45.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:31: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 1 2020-09-08T15:35:45.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ec-error-rollforward 2020-09-08T15:35:45.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:35:45.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T15:35:45.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:35:45.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ec-error-rollforward/1 2020-09-08T15:35:45.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=2f05732e-bc58-4241-932d-08bf792e4516 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2020-09-08T15:35:45.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:35:45.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:35:45.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:35:45.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2020-09-08T15:35:45.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2020-09-08T15:35:45.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:35:45.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:35:45.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2020-09-08T15:35:45.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:35:45.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:35:45.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:35:45.664 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:35:45.664 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:35:45.664 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.76703 2020-09-08T15:35:45.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.76703/$cluster-$name.asok' 2020-09-08T15:35:45.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' 2020-09-08T15:35:45.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:35:45.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:35:45.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:35:45.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2020-09-08T15:35:45.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2020-09-08T15:35:45.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:35:45.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:35:45.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:35:45.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:35:45.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:35:45.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ec-error-rollforward/1 2020-09-08T15:35:45.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:35:45.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=d4330b67-1f43-4c25-a480-6a764ec865c1 2020-09-08T15:35:45.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 d4330b67-1f43-4c25-a480-6a764ec865c1' 2020-09-08T15:35:45.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:35:45.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDRpFdfhlM5KBAAuRncH7D1Z7DpX1k4VPJLIA== 2020-09-08T15:35:45.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDRpFdfhlM5KBAAuRncH7D1Z7DpX1k4VPJLIA=="}' 2020-09-08T15:35:45.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new d4330b67-1f43-4c25-a480-6a764ec865c1 -i td/ec-error-rollforward/1/new.json 2020-09-08T15:35:46.258 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:35:46.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ec-error-rollforward/1/new.json 2020-09-08T15:35:46.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=2f05732e-bc58-4241-932d-08bf792e4516 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDRpFdfhlM5KBAAuRncH7D1Z7DpX1k4VPJLIA== --osd-uuid d4330b67-1f43-4c25-a480-6a764ec865c1 2020-09-08T15:35:46.287 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:46.292+0000 7fe0a323dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:35:46.289 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:46.294+0000 7fe0a323dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:35:46.290 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:46.295+0000 7fe0a323dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:35:46.291 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:46.296+0000 7fe0a323dec0 -1 bluestore(td/ec-error-rollforward/1/block) _read_bdev_label failed to open td/ec-error-rollforward/1/block: (2) No such file or directory 2020-09-08T15:35:46.291 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:46.296+0000 7fe0a323dec0 -1 bluestore(td/ec-error-rollforward/1/block) _read_bdev_label failed to open td/ec-error-rollforward/1/block: (2) No such file or directory 2020-09-08T15:35:46.292 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:46.296+0000 7fe0a323dec0 -1 bluestore(td/ec-error-rollforward/1/block) _read_bdev_label failed to open td/ec-error-rollforward/1/block: (2) No such file or directory 2020-09-08T15:35:46.321 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:46.326+0000 7fe0a323dec0 -1 bluestore(td/ec-error-rollforward/1) _read_fsid unparsable uuid 2020-09-08T15:35:50.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ec-error-rollforward/1/keyring 2020-09-08T15:35:50.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:35:50.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T15:35:50.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ec-error-rollforward/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:35:50.954 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T15:35:51.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T15:35:51.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=2f05732e-bc58-4241-932d-08bf792e4516 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:35:51.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:35:51.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:35:51.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:35:51.488 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:35:51.506 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:51.510+0000 7fc9a8b55ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:35:51.508 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:51.512+0000 7fc9a8b55ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:35:51.513 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:51.513+0000 7fc9a8b55ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:35:51.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T15:35:51.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:35:51.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:35:51.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:35:51.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:35:51.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:35:51.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:35:51.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:35:51.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:35:51.901 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:35:52.025 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:52.029+0000 7fc9a8b55ec0 -1 Falling back to public interface 2020-09-08T15:35:52.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:35:52.862 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:52.866+0000 7fc9a8b55ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T15:35:53.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:35:53.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:35:53.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:35:53.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:35:53.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:35:53.290 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:35:53.688 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/78563,v1:127.0.0.1:6811/78563] [v2:127.0.0.1:6812/78563,v1:127.0.0.1:6813/78563] exists,up d4330b67-1f43-4c25-a480-6a764ec865c1 2020-09-08T15:35:53.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:35:53.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:35:53.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:35:53.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:32: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 2 2020-09-08T15:35:53.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ec-error-rollforward 2020-09-08T15:35:53.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:35:53.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T15:35:53.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:35:53.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ec-error-rollforward/2 2020-09-08T15:35:53.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=2f05732e-bc58-4241-932d-08bf792e4516 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2020-09-08T15:35:53.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:35:53.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:35:53.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:35:53.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2020-09-08T15:35:53.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2020-09-08T15:35:53.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:35:53.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:35:53.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2020-09-08T15:35:53.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:35:53.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:35:53.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:35:53.699 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:35:53.699 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:35:53.700 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.76703 2020-09-08T15:35:53.700 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.76703/$cluster-$name.asok' 2020-09-08T15:35:53.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' 2020-09-08T15:35:53.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:35:53.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:35:53.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:35:53.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2020-09-08T15:35:53.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2020-09-08T15:35:53.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:35:53.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:35:53.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:35:53.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:35:53.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:35:53.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ec-error-rollforward/2 2020-09-08T15:35:53.702 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:35:53.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=684b2fb8-45fa-4c2d-a54b-fb30a8431e40 2020-09-08T15:35:53.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 684b2fb8-45fa-4c2d-a54b-fb30a8431e40' 2020-09-08T15:35:53.704 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:35:53.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDZpFdfvQpCKhAAjpfZlIFR7oDOqQxtf8FbjA== 2020-09-08T15:35:53.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDZpFdfvQpCKhAAjpfZlIFR7oDOqQxtf8FbjA=="}' 2020-09-08T15:35:53.704 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 684b2fb8-45fa-4c2d-a54b-fb30a8431e40 2020-09-08T15:35:53.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 684b2fb8-45fa-4c2d-a54b-fb30a8431e40 -i td/ec-error-rollforward/2/new.json 2020-09-08T15:35:54.385 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T15:35:54.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ec-error-rollforward/2/new.json 2020-09-08T15:35:54.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=2f05732e-bc58-4241-932d-08bf792e4516 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDZpFdfvQpCKhAAjpfZlIFR7oDOqQxtf8FbjA== --osd-uuid 684b2fb8-45fa-4c2d-a54b-fb30a8431e40 2020-09-08T15:35:54.418 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:54.422+0000 7fa9a9572ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:35:54.422 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:54.424+0000 7fa9a9572ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:35:54.422 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:54.426+0000 7fa9a9572ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:35:54.423 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:54.427+0000 7fa9a9572ec0 -1 bluestore(td/ec-error-rollforward/2/block) _read_bdev_label failed to open td/ec-error-rollforward/2/block: (2) No such file or directory 2020-09-08T15:35:54.423 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:54.427+0000 7fa9a9572ec0 -1 bluestore(td/ec-error-rollforward/2/block) _read_bdev_label failed to open td/ec-error-rollforward/2/block: (2) No such file or directory 2020-09-08T15:35:54.423 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:54.427+0000 7fa9a9572ec0 -1 bluestore(td/ec-error-rollforward/2/block) _read_bdev_label failed to open td/ec-error-rollforward/2/block: (2) No such file or directory 2020-09-08T15:35:54.475 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:54.480+0000 7fa9a9572ec0 -1 bluestore(td/ec-error-rollforward/2) _read_fsid unparsable uuid 2020-09-08T15:35:59.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ec-error-rollforward/2/keyring 2020-09-08T15:35:59.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:35:59.145 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T15:35:59.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T15:35:59.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ec-error-rollforward/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:35:59.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T15:35:59.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:35:59.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:35:59.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:35:59.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=2f05732e-bc58-4241-932d-08bf792e4516 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:35:59.687 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T15:35:59.704 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:59.709+0000 7fb4a12e6ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:35:59.758 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:59.763+0000 7fb4a12e6ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:35:59.759 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:35:59.764+0000 7fb4a12e6ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:00.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T15:36:00.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:36:00.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:36:00.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:36:00.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:36:00.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:36:00.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:36:00.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:36:00.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:36:00.140 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:36:00.278 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:00.282+0000 7fb4a12e6ec0 -1 Falling back to public interface 2020-09-08T15:36:00.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:36:01.099 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:01.104+0000 7fb4a12e6ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T15:36:01.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:36:01.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:36:01.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:36:01.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:36:01.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:36:01.529 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:36:01.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:36:02.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:36:02.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:36:02.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T15:36:02.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:36:02.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:36:02.941 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T15:36:03.337 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/79558,v1:127.0.0.1:6819/79558] [v2:127.0.0.1:6820/79558,v1:127.0.0.1:6821/79558] exists,up 684b2fb8-45fa-4c2d-a54b-fb30a8431e40 2020-09-08T15:36:03.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:36:03.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:36:03.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:36:03.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:33: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 3 2020-09-08T15:36:03.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ec-error-rollforward 2020-09-08T15:36:03.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:36:03.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T15:36:03.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:36:03.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ec-error-rollforward/3 2020-09-08T15:36:03.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=2f05732e-bc58-4241-932d-08bf792e4516 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2020-09-08T15:36:03.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:36:03.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:36:03.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:36:03.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2020-09-08T15:36:03.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2020-09-08T15:36:03.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:36:03.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:36:03.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2020-09-08T15:36:03.342 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:36:03.342 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:36:03.342 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:36:03.343 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:36:03.343 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:36:03.343 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.76703 2020-09-08T15:36:03.343 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.76703/$cluster-$name.asok' 2020-09-08T15:36:03.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' 2020-09-08T15:36:03.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:36:03.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:36:03.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:36:03.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2020-09-08T15:36:03.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2020-09-08T15:36:03.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:36:03.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:36:03.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:36:03.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:36:03.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:36:03.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ec-error-rollforward/3 2020-09-08T15:36:03.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:36:03.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=d3492dd1-cbab-4462-9e5d-4cfef7295339 2020-09-08T15:36:03.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 d3492dd1-cbab-4462-9e5d-4cfef7295339' 2020-09-08T15:36:03.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:36:03.348 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 d3492dd1-cbab-4462-9e5d-4cfef7295339 2020-09-08T15:36:03.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDjpFdf/W5TFRAApYLAirUQ+LbjFiWtjVK0Nw== 2020-09-08T15:36:03.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDjpFdf/W5TFRAApYLAirUQ+LbjFiWtjVK0Nw=="}' 2020-09-08T15:36:03.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new d3492dd1-cbab-4462-9e5d-4cfef7295339 -i td/ec-error-rollforward/3/new.json 2020-09-08T15:36:03.915 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T15:36:03.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ec-error-rollforward/3/new.json 2020-09-08T15:36:03.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=2f05732e-bc58-4241-932d-08bf792e4516 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDjpFdf/W5TFRAApYLAirUQ+LbjFiWtjVK0Nw== --osd-uuid d3492dd1-cbab-4462-9e5d-4cfef7295339 2020-09-08T15:36:03.942 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:03.947+0000 7f1064b5cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:03.944 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:03.949+0000 7f1064b5cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:03.945 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:03.949+0000 7f1064b5cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:03.946 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:03.950+0000 7f1064b5cec0 -1 bluestore(td/ec-error-rollforward/3/block) _read_bdev_label failed to open td/ec-error-rollforward/3/block: (2) No such file or directory 2020-09-08T15:36:03.946 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:03.950+0000 7f1064b5cec0 -1 bluestore(td/ec-error-rollforward/3/block) _read_bdev_label failed to open td/ec-error-rollforward/3/block: (2) No such file or directory 2020-09-08T15:36:03.947 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:03.950+0000 7f1064b5cec0 -1 bluestore(td/ec-error-rollforward/3/block) _read_bdev_label failed to open td/ec-error-rollforward/3/block: (2) No such file or directory 2020-09-08T15:36:04.048 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:04.053+0000 7f1064b5cec0 -1 bluestore(td/ec-error-rollforward/3) _read_fsid unparsable uuid 2020-09-08T15:36:08.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ec-error-rollforward/3/keyring 2020-09-08T15:36:08.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:36:08.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T15:36:08.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ec-error-rollforward/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:36:08.517 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T15:36:09.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T15:36:09.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=2f05732e-bc58-4241-932d-08bf792e4516 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:36:09.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:36:09.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:36:09.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:36:09.049 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T15:36:09.066 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:09.071+0000 7f6158818ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:09.068 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:09.073+0000 7f6158818ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:09.070 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:09.074+0000 7f6158818ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:09.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T15:36:09.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:36:09.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T15:36:09.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:36:09.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:36:09.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:36:09.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:36:09.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:36:09.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T15:36:09.460 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:36:09.586 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:09.591+0000 7f6158818ec0 -1 Falling back to public interface 2020-09-08T15:36:09.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:36:10.430 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:10.435+0000 7f6158818ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T15:36:10.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:36:10.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:36:10.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:36:10.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:36:10.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T15:36:10.848 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:36:11.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:36:12.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:36:12.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:36:12.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T15:36:12.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:36:12.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T15:36:12.256 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T15:36:12.732 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/80577,v1:127.0.0.1:6827/80577] [v2:127.0.0.1:6828/80577,v1:127.0.0.1:6829/80577] exists,up d3492dd1-cbab-4462-9e5d-4cfef7295339 2020-09-08T15:36:12.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:36:12.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:36:12.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:36:12.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:35: TEST_ec_error_rollforward: ceph osd erasure-code-profile set ec-profile m=2 k=2 crush-failure-domain=osd 2020-09-08T15:36:13.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:36: TEST_ec_error_rollforward: ceph osd pool create ec 1 1 erasure ec-profile 2020-09-08T15:36:14.364 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'ec' already exists 2020-09-08T15:36:14.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:38: TEST_ec_error_rollforward: rados -p ec put foo /etc/passwd 2020-09-08T15:36:16.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: cat td/ec-error-rollforward/osd.2.pid 2020-09-08T15:36:16.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: kill -STOP 79558 2020-09-08T15:36:16.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:43: TEST_ec_error_rollforward: pids=81057 2020-09-08T15:36:16.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:42: TEST_ec_error_rollforward: rados -p ec rm foo 2020-09-08T15:36:16.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:44: TEST_ec_error_rollforward: sleep 1 2020-09-08T15:36:17.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:46: TEST_ec_error_rollforward: pids+=' 81078' 2020-09-08T15:36:17.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:45: TEST_ec_error_rollforward: rados -p ec rm a 2020-09-08T15:36:17.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:48: TEST_ec_error_rollforward: pids+=' 81079' 2020-09-08T15:36:17.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:47: TEST_ec_error_rollforward: rados -p ec rm b 2020-09-08T15:36:17.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:50: TEST_ec_error_rollforward: pids+=' 81080' 2020-09-08T15:36:17.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:51: TEST_ec_error_rollforward: sleep 1 2020-09-08T15:36:17.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:49: TEST_ec_error_rollforward: rados -p ec rm c 2020-09-08T15:36:18.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:54: TEST_ec_error_rollforward: kill_daemons td/ec-error-rollforward KILL osd 2020-09-08T15:36:18.077 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:36:18.077 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:36:18.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:36:18.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:36:18.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:36:18.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:36:18.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:55: TEST_ec_error_rollforward: kill 81057 81078 81079 81080 2020-09-08T15:36:18.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:56: TEST_ec_error_rollforward: wait 2020-09-08T15:36:18.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:58: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 0 2020-09-08T15:36:18.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/ec-error-rollforward 2020-09-08T15:36:18.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:36:18.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=0 2020-09-08T15:36:18.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:36:18.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/ec-error-rollforward/0 2020-09-08T15:36:18.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=2f05732e-bc58-4241-932d-08bf792e4516 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2020-09-08T15:36:18.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:36:18.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:36:18.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:36:18.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2020-09-08T15:36:18.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2020-09-08T15:36:18.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:36:18.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:36:18.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2020-09-08T15:36:18.195 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:36:18.195 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:36:18.195 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:36:18.196 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:36:18.196 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:36:18.196 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.76703 2020-09-08T15:36:18.197 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.76703/$cluster-$name.asok' 2020-09-08T15:36:18.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' 2020-09-08T15:36:18.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:36:18.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2020-09-08T15:36:18.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2020-09-08T15:36:18.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:36:18.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:36:18.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:36:18.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:36:18.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:36:18.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/ec-error-rollforward/0 2020-09-08T15:36:18.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.0 2020-09-08T15:36:18.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 0 --fsid=2f05732e-bc58-4241-932d-08bf792e4516 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:36:18.199 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/ec-error-rollforward/0/whoami 2020-09-08T15:36:18.200 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T15:36:18.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 0 = 0 ']' 2020-09-08T15:36:18.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:36:18.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:36:18.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:36:18.213 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:18.218+0000 7f7eede36ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:18.219 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:18.220+0000 7f7eede36ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:18.219 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:18.221+0000 7f7eede36ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:18.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 0 2020-09-08T15:36:18.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:36:18.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:36:18.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:36:18.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:36:18.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:36:18.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:36:18.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:36:18.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:36:18.592 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:36:18.735 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:18.740+0000 7f7eede36ec0 -1 Falling back to public interface 2020-09-08T15:36:18.985 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/77562,v1:127.0.0.1:6803/77562] [v2:127.0.0.1:6804/77562,v1:127.0.0.1:6805/77562] exists,up 8307ccc3-0739-4482-8aa6-c39e9b0c281b 2020-09-08T15:36:18.985 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:36:18.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:36:18.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:36:18.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:36:18.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:59: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 1 2020-09-08T15:36:18.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/ec-error-rollforward 2020-09-08T15:36:18.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:36:18.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=1 2020-09-08T15:36:18.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:36:18.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/ec-error-rollforward/1 2020-09-08T15:36:18.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=2f05732e-bc58-4241-932d-08bf792e4516 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2020-09-08T15:36:18.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:36:18.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:36:18.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:36:18.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2020-09-08T15:36:18.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2020-09-08T15:36:18.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:36:18.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:36:18.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2020-09-08T15:36:18.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:36:18.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:36:18.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:36:18.990 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:36:18.990 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:36:18.991 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.76703 2020-09-08T15:36:18.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.76703/$cluster-$name.asok' 2020-09-08T15:36:18.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' 2020-09-08T15:36:18.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:36:18.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2020-09-08T15:36:18.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2020-09-08T15:36:18.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:36:18.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:36:18.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:36:18.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:36:18.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:36:18.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/ec-error-rollforward/1 2020-09-08T15:36:18.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.1 2020-09-08T15:36:18.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 1 --fsid=2f05732e-bc58-4241-932d-08bf792e4516 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:36:18.993 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/ec-error-rollforward/1/whoami 2020-09-08T15:36:18.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 1 = 1 ']' 2020-09-08T15:36:18.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:36:18.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:36:18.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:36:19.003 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:19.008+0000 7f214062bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:19.005 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:19.010+0000 7f214062bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:19.006 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:19.011+0000 7f214062bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:19.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 1 2020-09-08T15:36:19.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:36:19.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:36:19.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:36:19.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:36:19.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:36:19.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:36:19.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:36:19.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:36:19.432 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:36:19.526 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:19.531+0000 7f214062bec0 -1 Falling back to public interface 2020-09-08T15:36:19.887 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/78563,v1:127.0.0.1:6811/78563] [v2:127.0.0.1:6812/78563,v1:127.0.0.1:6813/78563] exists,up d4330b67-1f43-4c25-a480-6a764ec865c1 2020-09-08T15:36:19.887 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T15:36:19.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:36:19.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:36:19.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:36:19.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:60: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 2 2020-09-08T15:36:19.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/ec-error-rollforward 2020-09-08T15:36:19.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:36:19.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=2 2020-09-08T15:36:19.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:36:19.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/ec-error-rollforward/2 2020-09-08T15:36:19.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=2f05732e-bc58-4241-932d-08bf792e4516 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2020-09-08T15:36:19.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:36:19.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:36:19.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:36:19.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2020-09-08T15:36:19.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2020-09-08T15:36:19.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:36:19.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:36:19.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2020-09-08T15:36:19.892 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:36:19.892 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:36:19.892 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:36:19.892 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:36:19.893 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:36:19.893 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.76703 2020-09-08T15:36:19.893 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.76703/$cluster-$name.asok' 2020-09-08T15:36:19.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' 2020-09-08T15:36:19.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:36:19.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2020-09-08T15:36:19.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2020-09-08T15:36:19.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:36:19.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:36:19.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:36:19.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:36:19.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:36:19.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/ec-error-rollforward/2 2020-09-08T15:36:19.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.2 2020-09-08T15:36:19.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 2 --fsid=2f05732e-bc58-4241-932d-08bf792e4516 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:36:19.896 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/ec-error-rollforward/2/whoami 2020-09-08T15:36:19.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 2 = 2 ']' 2020-09-08T15:36:19.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:36:19.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:36:19.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:36:19.905 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:19.910+0000 7f3af6909ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:19.907 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:19.912+0000 7f3af6909ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:19.908 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:19.913+0000 7f3af6909ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:20.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 2 2020-09-08T15:36:20.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:36:20.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:36:20.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:36:20.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:36:20.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:36:20.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:36:20.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:36:20.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:36:20.371 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:36:20.421 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:20.426+0000 7f7eede36ec0 -1 osd.0 26 log_to_monitors {default=true} 2020-09-08T15:36:20.428 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:20.432+0000 7f3af6909ec0 -1 Falling back to public interface 2020-09-08T15:36:20.848 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/79558,v1:127.0.0.1:6819/79558] [v2:127.0.0.1:6820/79558,v1:127.0.0.1:6821/79558] exists,up 684b2fb8-45fa-4c2d-a54b-fb30a8431e40 2020-09-08T15:36:20.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:36:20.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:36:20.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:36:20.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:61: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 3 2020-09-08T15:36:20.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/ec-error-rollforward 2020-09-08T15:36:20.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:36:20.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=3 2020-09-08T15:36:20.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:36:20.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/ec-error-rollforward/3 2020-09-08T15:36:20.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=2f05732e-bc58-4241-932d-08bf792e4516 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2020-09-08T15:36:20.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:36:20.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:36:20.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:36:20.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2020-09-08T15:36:20.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2020-09-08T15:36:20.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:36:20.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:36:20.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2020-09-08T15:36:20.852 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:36:20.853 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:36:20.854 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:36:20.854 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:36:20.854 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:36:20.854 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.76703 2020-09-08T15:36:20.855 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.76703/$cluster-$name.asok' 2020-09-08T15:36:20.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' 2020-09-08T15:36:20.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:36:20.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2020-09-08T15:36:20.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2020-09-08T15:36:20.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:36:20.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:36:20.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:36:20.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:36:20.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:36:20.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/ec-error-rollforward/3 2020-09-08T15:36:20.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.3 2020-09-08T15:36:20.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 3 --fsid=2f05732e-bc58-4241-932d-08bf792e4516 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.76703/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:36:20.860 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/ec-error-rollforward/3/whoami 2020-09-08T15:36:20.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 3 = 3 ']' 2020-09-08T15:36:20.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:36:20.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:36:20.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:36:20.862 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T15:36:20.879 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:20.884+0000 7fee20cffec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:20.881 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:20.886+0000 7fee20cffec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:20.882 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:20.887+0000 7fee20cffec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:21.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 3 2020-09-08T15:36:21.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:36:21.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T15:36:21.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:36:21.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:36:21.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:36:21.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:36:21.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:36:21.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T15:36:21.283 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:36:21.407 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:21.405+0000 7fee20cffec0 -1 Falling back to public interface 2020-09-08T15:36:21.596 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:21.591+0000 7f214062bec0 -1 osd.1 26 log_to_monitors {default=true} 2020-09-08T15:36:21.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:36:22.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:36:22.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:36:22.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:36:22.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:36:22.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T15:36:22.716 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:36:23.029 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:23.033+0000 7f3af6909ec0 -1 osd.2 25 log_to_monitors {default=true} 2020-09-08T15:36:23.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:36:23.827 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:23.830+0000 7fee20cffec0 -1 osd.3 26 log_to_monitors {default=true} 2020-09-08T15:36:24.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:36:24.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:36:24.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T15:36:24.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T15:36:24.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:36:24.142 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T15:36:24.653 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 37 up_thru 0 down_at 29 last_clean_interval [20,26) [v2:127.0.0.1:6826/82107,v1:127.0.0.1:6827/82107] [v2:127.0.0.1:6828/82107,v1:127.0.0.1:6829/82107] exists,up d3492dd1-cbab-4462-9e5d-4cfef7295339 2020-09-08T15:36:24.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:36:24.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:36:24.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:36:24.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:63: TEST_ec_error_rollforward: wait_for_clean 2020-09-08T15:36:24.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:36:24.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:36:24.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:36:24.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:36:24.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T15:36:24.656 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:36:24.656 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:36:24.656 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:36:24.656 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:36:24.657 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:36:24.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:36:24.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:36:24.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:36:24.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:36:24.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:36:25.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:36:25.201 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:36:25.202 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T15:36:25.202 INFO:tasks.workunit.client.0.smithi065.stderr:3' 2020-09-08T15:36:25.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:36:25.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:36:25.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:36:25.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=120259084291 2020-09-08T15:36:25.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 120259084291 2020-09-08T15:36:25.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-120259084291' 2020-09-08T15:36:25.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:36:25.331 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:36:25.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=133143986179 2020-09-08T15:36:25.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 133143986179 2020-09-08T15:36:25.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-120259084291 1-133143986179' 2020-09-08T15:36:25.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:36:25.468 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:36:25.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=150323855363 2020-09-08T15:36:25.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 150323855363 2020-09-08T15:36:25.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-120259084291 1-133143986179 2-150323855363' 2020-09-08T15:36:25.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:36:25.595 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T15:36:25.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=158913789955 2020-09-08T15:36:25.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 158913789955 2020-09-08T15:36:25.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-120259084291 1-133143986179 2-150323855363 3-158913789955' 2020-09-08T15:36:25.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:36:25.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-120259084291 2020-09-08T15:36:25.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:36:25.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:36:25.728 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-120259084291 2020-09-08T15:36:25.728 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:36:25.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=120259084291 2020-09-08T15:36:25.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 120259084291' 2020-09-08T15:36:25.735 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 120259084291 2020-09-08T15:36:25.736 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:36:26.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 120259084292 -lt 120259084291 2020-09-08T15:36:26.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:36:26.118 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-133143986179 2020-09-08T15:36:26.118 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:36:26.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:36:26.120 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-133143986179 2020-09-08T15:36:26.120 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:36:26.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=133143986179 2020-09-08T15:36:26.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 133143986179' 2020-09-08T15:36:26.122 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 133143986179 2020-09-08T15:36:26.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:36:26.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 133143986179 -lt 133143986179 2020-09-08T15:36:26.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:36:26.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-150323855363 2020-09-08T15:36:26.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:36:26.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:36:26.509 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-150323855363 2020-09-08T15:36:26.509 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:36:26.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=150323855363 2020-09-08T15:36:26.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 150323855363' 2020-09-08T15:36:26.510 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 150323855363 2020-09-08T15:36:26.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:36:26.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 150323855363 -lt 150323855363 2020-09-08T15:36:26.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:36:26.904 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-158913789955 2020-09-08T15:36:26.904 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:36:26.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T15:36:26.905 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-158913789955 2020-09-08T15:36:26.906 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:36:26.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=158913789955 2020-09-08T15:36:26.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 158913789955' 2020-09-08T15:36:26.907 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 158913789955 2020-09-08T15:36:26.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T15:36:27.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 1 -lt 158913789955 2020-09-08T15:36:27.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:36:28.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:36:28.316 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T15:36:28.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 158913789955 -lt 158913789955 2020-09-08T15:36:28.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:36:28.722 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:36:28.722 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:36:29.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T15:36:29.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:36:29.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:36:29.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:36:29.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:36:29.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:36:29.312 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:36:29.312 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:36:29.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:36:29.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:36:29.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:36:29.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:36:30.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T15:36:30.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:36:30.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:36:30.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:22: run: teardown td/ec-error-rollforward 2020-09-08T15:36:30.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ec-error-rollforward 2020-09-08T15:36:30.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:36:30.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ec-error-rollforward KILL 2020-09-08T15:36:30.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:36:30.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:36:30.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:36:30.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:36:30.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:36:30.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:36:30.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:36:30.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:36:30.312 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:36:30.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:36:30.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:36:30.313 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:36:30.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:36:30.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:36:30.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:36:30.315 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:36:30.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:36:30.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:36:30.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ec-error-rollforward 2020-09-08T15:36:30.322 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:36:30.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:36:30.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.76703 2020-09-08T15:36:30.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.76703 2020-09-08T15:36:30.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:36:30.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:36:30.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2151: main: code=0 2020-09-08T15:36:30.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2155: main: teardown td/ec-error-rollforward 0 2020-09-08T15:36:30.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ec-error-rollforward 2020-09-08T15:36:30.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2020-09-08T15:36:30.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ec-error-rollforward KILL 2020-09-08T15:36:30.326 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:36:30.326 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:36:30.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:36:30.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:36:30.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:36:30.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:36:30.328 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:36:30.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:36:30.328 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:36:30.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:36:30.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:36:30.329 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:36:30.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:36:30.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:36:30.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:36:30.330 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:36:30.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:36:30.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2020-09-08T15:36:30.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ec-error-rollforward 2020-09-08T15:36:30.333 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:36:30.333 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:36:30.333 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.76703 2020-09-08T15:36:30.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.76703 2020-09-08T15:36:30.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:36:30.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:36:30.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2156: main: return 0 2020-09-08T15:36:30.336 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-09-08T15:36:30.337 INFO:teuthology.orchestra.run.smithi065:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-09-08T15:36:30.410 INFO:tasks.workunit:Running workunit osd/osd-backfill-prio.sh... 2020-09-08T15:36:30.411 INFO:teuthology.orchestra.run.smithi065:workunit test osd/osd-backfill-prio.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dce4d291bd4243c9802c17d67b85a6da6bbc0f8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh 2020-09-08T15:36:30.472 INFO:tasks.workunit.client.0.smithi065.stderr:stty: 'standard input': Inappropriate ioctl for device 2020-09-08T15:36:30.516 INFO:tasks.workunit.client.0.smithi065.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2020-09-08T15:36:30.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T15:36:30.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T15:36:30.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: export PYTHONWARNINGS=ignore 2020-09-08T15:36:30.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: PYTHONWARNINGS=ignore 2020-09-08T15:36:30.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: export CEPH_CONF=/dev/null 2020-09-08T15:36:30.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: CEPH_CONF=/dev/null 2020-09-08T15:36:30.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2147: main: unset CEPH_ARGS 2020-09-08T15:36:30.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2149: main: local code 2020-09-08T15:36:30.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2150: main: run td/osd-backfill-prio 2020-09-08T15:36:30.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:21: run: local dir=td/osd-backfill-prio 2020-09-08T15:36:30.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:22: run: shift 2020-09-08T15:36:30.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:25: run: export CEPH_MON=127.0.0.1:7114 2020-09-08T15:36:30.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:25: run: CEPH_MON=127.0.0.1:7114 2020-09-08T15:36:30.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:26: run: export CEPH_ARGS 2020-09-08T15:36:30.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:27: run: uuidgen 2020-09-08T15:36:30.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:27: run: CEPH_ARGS+='--fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none ' 2020-09-08T15:36:30.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:36:30.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:29: run: CEPH_ARGS+='--osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T15:36:30.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:30: run: export objects=50 2020-09-08T15:36:30.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:30: run: objects=50 2020-09-08T15:36:30.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:31: run: export poolprefix=test 2020-09-08T15:36:30.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:31: run: poolprefix=test 2020-09-08T15:36:30.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:32: run: export FORCE_PRIO=254 2020-09-08T15:36:30.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:32: run: FORCE_PRIO=254 2020-09-08T15:36:30.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:33: run: export DEGRADED_PRIO=150 2020-09-08T15:36:30.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:33: run: DEGRADED_PRIO=150 2020-09-08T15:36:30.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:34: run: export NORMAL_PRIO=110 2020-09-08T15:36:30.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:34: run: NORMAL_PRIO=110 2020-09-08T15:36:30.531 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:36: run: set 2020-09-08T15:36:30.531 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:36: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2020-09-08T15:36:30.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:36: run: local 'funcs=TEST_backfill_pool_priority 2020-09-08T15:36:30.532 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_backfill_priority' 2020-09-08T15:36:30.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:37: run: for func in $funcs 2020-09-08T15:36:30.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:38: run: setup td/osd-backfill-prio 2020-09-08T15:36:30.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-prio 2020-09-08T15:36:30.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-prio 2020-09-08T15:36:30.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-prio 2020-09-08T15:36:30.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:36:30.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-prio KILL 2020-09-08T15:36:30.534 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:36:30.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:36:30.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:36:30.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:36:30.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:36:30.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:36:30.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:36:30.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:36:30.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:36:30.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:36:30.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:36:30.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:36:30.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:36:30.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:36:30.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:36:30.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:36:30.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:36:30.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:36:30.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-prio 2020-09-08T15:36:30.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:36:30.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:36:30.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:36:30.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83246 2020-09-08T15:36:30.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:36:30.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:36:30.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-prio 2020-09-08T15:36:30.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T15:36:30.540 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:36:30.540 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:36:30.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83246 2020-09-08T15:36:30.540 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T15:36:30.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2020-09-08T15:36:30.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2020-09-08T15:36:30.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T15:36:30.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-prio 1' TERM HUP INT 2020-09-08T15:36:30.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:39: run: TEST_backfill_pool_priority td/osd-backfill-prio 2020-09-08T15:36:30.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:326: TEST_backfill_pool_priority: local dir=td/osd-backfill-prio 2020-09-08T15:36:30.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:327: TEST_backfill_pool_priority: local pools=3 2020-09-08T15:36:30.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:328: TEST_backfill_pool_priority: local OSDS=2 2020-09-08T15:36:30.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:330: TEST_backfill_pool_priority: run_mon td/osd-backfill-prio a 2020-09-08T15:36:30.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-prio 2020-09-08T15:36:30.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T15:36:30.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T15:36:30.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T15:36:30.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-prio/a 2020-09-08T15:36:30.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-prio/a --run-dir=td/osd-backfill-prio 2020-09-08T15:36:30.814 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T15:36:30.814 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:36:30.814 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:36:30.815 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:36:30.815 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:36:30.815 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:36:30.815 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83246/$cluster-$name.asok' 2020-09-08T15:36:30.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-prio/a '--log-file=td/osd-backfill-prio/$name.log' '--admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-prio/log --run-dir=td/osd-backfill-prio '--pid-file=td/osd-backfill-prio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T15:36:31.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T15:36:31.032 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T15:36:31.032 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:36:31.032 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:36:31.033 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T15:36:31.033 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T15:36:31.033 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:36:31.033 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:36:31.035 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:36:31.035 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:36:31.035 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:36:31.035 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:36:31.036 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83246/ceph-mon.a.asok 2020-09-08T15:36:31.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:36:31.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.83246/ceph-mon.a.asok config get fsid 2020-09-08T15:36:31.129 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T15:36:31.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:36:31.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:36:31.133 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T15:36:31.133 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T15:36:31.133 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:36:31.133 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:36:31.134 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:36:31.134 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:36:31.134 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:36:31.135 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:36:31.135 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83246/ceph-mon.a.asok 2020-09-08T15:36:31.135 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:36:31.135 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.83246/ceph-mon.a.asok config get mon_host 2020-09-08T15:36:31.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:331: TEST_backfill_pool_priority: run_mgr td/osd-backfill-prio x 2020-09-08T15:36:31.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-prio 2020-09-08T15:36:31.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T15:36:31.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T15:36:31.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T15:36:31.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-prio/x 2020-09-08T15:36:31.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T15:36:32.155 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T15:36:32.155 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:36:32.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:36:32.156 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:36:32.156 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:36:32.156 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:36:32.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83246/$cluster-$name.asok' 2020-09-08T15:36:32.157 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:36:32.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-prio/x '--log-file=td/osd-backfill-prio/$name.log' '--admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' --run-dir=td/osd-backfill-prio '--pid-file=td/osd-backfill-prio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:36:32.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:332: TEST_backfill_pool_priority: export CEPH_ARGS 2020-09-08T15:36:32.180 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:334: TEST_backfill_pool_priority: expr 2 - 1 2020-09-08T15:36:32.180 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:334: TEST_backfill_pool_priority: seq 0 1 2020-09-08T15:36:32.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:334: TEST_backfill_pool_priority: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:36:32.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:336: TEST_backfill_pool_priority: run_osd td/osd-backfill-prio 0 2020-09-08T15:36:32.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-prio 2020-09-08T15:36:32.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:36:32.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T15:36:32.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:36:32.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-prio/0 2020-09-08T15:36:32.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T15:36:32.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:36:32.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:36:32.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:36:32.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-prio/0' 2020-09-08T15:36:32.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-prio/0/journal' 2020-09-08T15:36:32.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:36:32.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:36:32.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-prio' 2020-09-08T15:36:32.187 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:36:32.187 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:36:32.188 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:36:32.188 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:36:32.188 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:36:32.188 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:36:32.188 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83246/$cluster-$name.asok' 2020-09-08T15:36:32.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' 2020-09-08T15:36:32.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:36:32.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:36:32.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:36:32.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-prio/$name.log' 2020-09-08T15:36:32.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-prio/$name.pid' 2020-09-08T15:36:32.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:36:32.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:36:32.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:36:32.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:36:32.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:36:32.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-prio/0 2020-09-08T15:36:32.191 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:36:32.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=eea94262-27c0-4913-b307-d4a78e94da8b 2020-09-08T15:36:32.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 eea94262-27c0-4913-b307-d4a78e94da8b' 2020-09-08T15:36:32.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:36:32.193 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 eea94262-27c0-4913-b307-d4a78e94da8b 2020-09-08T15:36:32.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAApVdfBvxYDBAAZCzMTu7QGdSXLGghmY+HOg== 2020-09-08T15:36:32.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAApVdfBvxYDBAAZCzMTu7QGdSXLGghmY+HOg=="}' 2020-09-08T15:36:32.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new eea94262-27c0-4913-b307-d4a78e94da8b -i td/osd-backfill-prio/0/new.json 2020-09-08T15:36:32.524 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:36:32.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-prio/0/new.json 2020-09-08T15:36:32.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/0 --osd-journal=td/osd-backfill-prio/0/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAApVdfBvxYDBAAZCzMTu7QGdSXLGghmY+HOg== --osd-uuid eea94262-27c0-4913-b307-d4a78e94da8b 2020-09-08T15:36:32.563 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:32.567+0000 7f3fd91caec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:32.564 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:32.569+0000 7f3fd91caec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:32.566 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:32.571+0000 7f3fd91caec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:32.567 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:32.572+0000 7f3fd91caec0 -1 bluestore(td/osd-backfill-prio/0/block) _read_bdev_label failed to open td/osd-backfill-prio/0/block: (2) No such file or directory 2020-09-08T15:36:32.567 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:32.572+0000 7f3fd91caec0 -1 bluestore(td/osd-backfill-prio/0/block) _read_bdev_label failed to open td/osd-backfill-prio/0/block: (2) No such file or directory 2020-09-08T15:36:32.567 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:32.572+0000 7f3fd91caec0 -1 bluestore(td/osd-backfill-prio/0/block) _read_bdev_label failed to open td/osd-backfill-prio/0/block: (2) No such file or directory 2020-09-08T15:36:32.620 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:32.624+0000 7f3fd91caec0 -1 bluestore(td/osd-backfill-prio/0) _read_fsid unparsable uuid 2020-09-08T15:36:37.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-prio/0/keyring 2020-09-08T15:36:37.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:36:37.344 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T15:36:37.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T15:36:37.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-prio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:36:37.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T15:36:37.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/0 --osd-journal=td/osd-backfill-prio/0/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:36:37.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:36:37.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:36:37.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:36:37.884 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T15:36:37.909 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:37.912+0000 7f15be487ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:37.984 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:37.989+0000 7f15be487ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:37.986 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:37.990+0000 7f15be487ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:38.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T15:36:38.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:36:38.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:36:38.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:36:38.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:36:38.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:36:38.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:36:38.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:36:38.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:36:38.337 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:36:38.502 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:38.507+0000 7f15be487ec0 -1 Falling back to public interface 2020-09-08T15:36:38.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:36:39.377 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:39.380+0000 7f15be487ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T15:36:39.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:36:39.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:36:39.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:36:39.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:36:39.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:36:39.739 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:36:40.141 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/84125,v1:127.0.0.1:6803/84125] [v2:127.0.0.1:6804/84125,v1:127.0.0.1:6805/84125] exists,up eea94262-27c0-4913-b307-d4a78e94da8b 2020-09-08T15:36:40.142 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 bc980c3f-3a9c-4ea7-9c0f-6f85a51b362a 2020-09-08T15:36:40.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:36:40.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:36:40.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:36:40.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:334: TEST_backfill_pool_priority: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:36:40.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:336: TEST_backfill_pool_priority: run_osd td/osd-backfill-prio 1 2020-09-08T15:36:40.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-prio 2020-09-08T15:36:40.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:36:40.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T15:36:40.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:36:40.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-prio/1 2020-09-08T15:36:40.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T15:36:40.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:36:40.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:36:40.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:36:40.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-prio/1' 2020-09-08T15:36:40.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-prio/1/journal' 2020-09-08T15:36:40.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:36:40.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:36:40.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-prio' 2020-09-08T15:36:40.150 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:36:40.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:36:40.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:36:40.151 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:36:40.151 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:36:40.151 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:36:40.152 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83246/$cluster-$name.asok' 2020-09-08T15:36:40.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' 2020-09-08T15:36:40.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:36:40.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:36:40.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:36:40.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-prio/$name.log' 2020-09-08T15:36:40.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-prio/$name.pid' 2020-09-08T15:36:40.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:36:40.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:36:40.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:36:40.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:36:40.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:36:40.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-prio/1 2020-09-08T15:36:40.155 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:36:40.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=bc980c3f-3a9c-4ea7-9c0f-6f85a51b362a 2020-09-08T15:36:40.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 bc980c3f-3a9c-4ea7-9c0f-6f85a51b362a' 2020-09-08T15:36:40.155 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:36:40.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAIpVdfrfazCRAANVQ9z7DkEskVO5PTimu+RA== 2020-09-08T15:36:40.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAIpVdfrfazCRAANVQ9z7DkEskVO5PTimu+RA=="}' 2020-09-08T15:36:40.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new bc980c3f-3a9c-4ea7-9c0f-6f85a51b362a -i td/osd-backfill-prio/1/new.json 2020-09-08T15:36:40.717 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:36:40.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-prio/1/new.json 2020-09-08T15:36:40.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/1 --osd-journal=td/osd-backfill-prio/1/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAIpVdfrfazCRAANVQ9z7DkEskVO5PTimu+RA== --osd-uuid bc980c3f-3a9c-4ea7-9c0f-6f85a51b362a 2020-09-08T15:36:40.756 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:40.761+0000 7f19ccdc3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:40.758 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:40.762+0000 7f19ccdc3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:40.760 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:40.764+0000 7f19ccdc3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:40.760 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:40.764+0000 7f19ccdc3ec0 -1 bluestore(td/osd-backfill-prio/1/block) _read_bdev_label failed to open td/osd-backfill-prio/1/block: (2) No such file or directory 2020-09-08T15:36:40.761 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:40.765+0000 7f19ccdc3ec0 -1 bluestore(td/osd-backfill-prio/1/block) _read_bdev_label failed to open td/osd-backfill-prio/1/block: (2) No such file or directory 2020-09-08T15:36:40.761 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:40.765+0000 7f19ccdc3ec0 -1 bluestore(td/osd-backfill-prio/1/block) _read_bdev_label failed to open td/osd-backfill-prio/1/block: (2) No such file or directory 2020-09-08T15:36:40.857 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:40.861+0000 7f19ccdc3ec0 -1 bluestore(td/osd-backfill-prio/1) _read_fsid unparsable uuid 2020-09-08T15:36:45.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-prio/1/keyring 2020-09-08T15:36:45.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:36:45.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T15:36:45.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-prio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:36:45.658 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T15:36:46.217 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:36:46.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T15:36:46.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/1 --osd-journal=td/osd-backfill-prio/1/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:36:46.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:36:46.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:36:46.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:36:46.237 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:46.241+0000 7f321913bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:46.238 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:46.243+0000 7f321913bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:46.240 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:46.245+0000 7f321913bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:36:46.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T15:36:46.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:36:46.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:36:46.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:36:46.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:36:46.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:36:46.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:36:46.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:36:46.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:36:46.610 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:36:46.765 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:46.769+0000 7f321913bec0 -1 Falling back to public interface 2020-09-08T15:36:47.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:36:47.638 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:36:47.642+0000 7f321913bec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T15:36:48.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:36:48.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:36:48.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:36:48.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:36:48.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:36:48.019 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:36:48.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:36:49.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:36:49.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:36:49.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T15:36:49.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:36:49.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:36:49.422 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T15:36:49.829 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/85101,v1:127.0.0.1:6811/85101] [v2:127.0.0.1:6812/85101,v1:127.0.0.1:6813/85101] exists,up bc980c3f-3a9c-4ea7-9c0f-6f85a51b362a 2020-09-08T15:36:49.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:36:49.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:36:49.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:36:49.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:339: TEST_backfill_pool_priority: seq 1 3 2020-09-08T15:36:49.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:339: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2020-09-08T15:36:49.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:341: TEST_backfill_pool_priority: create_pool test1 1 1 2020-09-08T15:36:49.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test1 1 1 2020-09-08T15:36:50.410 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test1' already exists 2020-09-08T15:36:50.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:36:51.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:342: TEST_backfill_pool_priority: ceph osd pool set test1 size 2 2020-09-08T15:36:52.263 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 2 2020-09-08T15:36:52.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:339: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2020-09-08T15:36:52.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:341: TEST_backfill_pool_priority: create_pool test2 1 1 2020-09-08T15:36:52.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test2 1 1 2020-09-08T15:36:52.979 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test2' already exists 2020-09-08T15:36:52.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:36:53.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:342: TEST_backfill_pool_priority: ceph osd pool set test2 size 2 2020-09-08T15:36:54.726 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 2 size to 2 2020-09-08T15:36:54.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:339: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2020-09-08T15:36:54.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:341: TEST_backfill_pool_priority: create_pool test3 1 1 2020-09-08T15:36:54.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test3 1 1 2020-09-08T15:36:55.330 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test3' already exists 2020-09-08T15:36:55.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:36:56.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:342: TEST_backfill_pool_priority: ceph osd pool set test3 size 2 2020-09-08T15:36:57.189 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 3 size to 2 2020-09-08T15:36:57.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:344: TEST_backfill_pool_priority: sleep 5 2020-09-08T15:37:02.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:346: TEST_backfill_pool_priority: wait_for_clean 2020-09-08T15:37:02.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:37:02.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:37:02.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:37:02.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:37:02.201 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T15:37:02.202 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:37:02.202 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:37:02.202 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:37:02.202 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:37:02.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:37:02.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:37:02.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:37:02.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:37:02.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:37:02.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:37:02.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:37:02.705 INFO:tasks.workunit.client.0.smithi065.stderr:1' 2020-09-08T15:37:02.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:37:02.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:37:02.707 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:37:02.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836487 2020-09-08T15:37:02.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836487 2020-09-08T15:37:02.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836487' 2020-09-08T15:37:02.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:37:02.840 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:37:02.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672965 2020-09-08T15:37:02.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672965 2020-09-08T15:37:02.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836487 1-42949672965' 2020-09-08T15:37:02.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:37:02.973 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836487 2020-09-08T15:37:02.973 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:37:02.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:37:02.975 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836487 2020-09-08T15:37:02.975 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:37:02.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836487 2020-09-08T15:37:02.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2020-09-08T15:37:02.976 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836487 2020-09-08T15:37:02.977 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:37:03.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836485 -lt 21474836487 2020-09-08T15:37:03.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:37:04.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:37:04.373 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:37:04.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836487 -lt 21474836487 2020-09-08T15:37:04.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:37:04.774 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672965 2020-09-08T15:37:04.775 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:37:04.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:37:04.776 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672965 2020-09-08T15:37:04.777 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:37:04.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672965 2020-09-08T15:37:04.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672965' 2020-09-08T15:37:04.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:37:04.781 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672965 2020-09-08T15:37:05.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672965 -lt 42949672965 2020-09-08T15:37:05.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:37:05.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:37:05.193 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:37:05.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 3 == 0 2020-09-08T15:37:05.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:37:05.864 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:37:05.864 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:37:05.864 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:37:05.864 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:37:05.864 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:37:05.865 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:37:06.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=3 2020-09-08T15:37:06.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:37:06.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:37:06.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:37:06.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 3 = 3 2020-09-08T15:37:06.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:37:06.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:37:06.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:348: TEST_backfill_pool_priority: ceph pg dump pgs 2020-09-08T15:37:07.139 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:37:07.139 INFO:tasks.workunit.client.0.smithi065.stdout:3.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:36:57.509495+0000 0'0 27:17 [1,0] 1 [1,0] 1 0'0 2020-09-08T15:36:55.086344+0000 0'0 2020-09-08T15:36:55.086344+0000 0 2020-09-08T15:37:07.140 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:36:52.709037+0000 0'0 26:27 [1,0] 1 [1,0] 1 0'0 2020-09-08T15:36:50.191928+0000 0'0 2020-09-08T15:36:50.191928+0000 0 2020-09-08T15:37:07.140 INFO:tasks.workunit.client.0.smithi065.stdout:2.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:36:54.908898+0000 0'0 26:22 [0,1] 0 [0,1] 0 0'0 2020-09-08T15:36:52.702843+0000 0'0 2020-09-08T15:36:52.702843+0000 0 2020-09-08T15:37:07.140 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:37:07.140 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:37:07.141 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:37:07.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:352: TEST_backfill_pool_priority: local PG1 2020-09-08T15:37:07.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:353: TEST_backfill_pool_priority: local POOLNUM1 2020-09-08T15:37:07.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:354: TEST_backfill_pool_priority: local pool1 2020-09-08T15:37:07.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:355: TEST_backfill_pool_priority: local chk_osd1_1 2020-09-08T15:37:07.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:356: TEST_backfill_pool_priority: local chk_osd1_2 2020-09-08T15:37:07.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:358: TEST_backfill_pool_priority: local PG2 2020-09-08T15:37:07.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:359: TEST_backfill_pool_priority: local POOLNUM2 2020-09-08T15:37:07.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:360: TEST_backfill_pool_priority: local pool2 2020-09-08T15:37:07.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:361: TEST_backfill_pool_priority: local chk_osd2_1 2020-09-08T15:37:07.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:362: TEST_backfill_pool_priority: local chk_osd2_2 2020-09-08T15:37:07.152 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:364: TEST_backfill_pool_priority: seq 1 3 2020-09-08T15:37:07.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:364: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2020-09-08T15:37:07.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:366: TEST_backfill_pool_priority: ceph pg map 1.0 --format=json 2020-09-08T15:37:07.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:366: TEST_backfill_pool_priority: jq '.acting[]' 2020-09-08T15:37:07.573 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:367: TEST_backfill_pool_priority: head -1 td/osd-backfill-prio/acting 2020-09-08T15:37:07.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:367: TEST_backfill_pool_priority: local test_osd1=1 2020-09-08T15:37:07.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:368: TEST_backfill_pool_priority: tail -1 td/osd-backfill-prio/acting 2020-09-08T15:37:07.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:368: TEST_backfill_pool_priority: local test_osd2=0 2020-09-08T15:37:07.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:369: TEST_backfill_pool_priority: '[' -z '' ']' 2020-09-08T15:37:07.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:371: TEST_backfill_pool_priority: PG1=1.0 2020-09-08T15:37:07.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:372: TEST_backfill_pool_priority: POOLNUM1=1 2020-09-08T15:37:07.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:373: TEST_backfill_pool_priority: pool1=test1 2020-09-08T15:37:07.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:374: TEST_backfill_pool_priority: chk_osd1_1=1 2020-09-08T15:37:07.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:375: TEST_backfill_pool_priority: chk_osd1_2=0 2020-09-08T15:37:07.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:364: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2020-09-08T15:37:07.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:366: TEST_backfill_pool_priority: ceph pg map 2.0 --format=json 2020-09-08T15:37:07.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:366: TEST_backfill_pool_priority: jq '.acting[]' 2020-09-08T15:37:07.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:367: TEST_backfill_pool_priority: head -1 td/osd-backfill-prio/acting 2020-09-08T15:37:07.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:367: TEST_backfill_pool_priority: local test_osd1=0 2020-09-08T15:37:07.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:368: TEST_backfill_pool_priority: tail -1 td/osd-backfill-prio/acting 2020-09-08T15:37:07.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:368: TEST_backfill_pool_priority: local test_osd2=1 2020-09-08T15:37:07.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:369: TEST_backfill_pool_priority: '[' -z 1.0 ']' 2020-09-08T15:37:07.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:376: TEST_backfill_pool_priority: '[' 1 '!=' 0 ']' 2020-09-08T15:37:07.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:378: TEST_backfill_pool_priority: PG2=2.0 2020-09-08T15:37:07.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:379: TEST_backfill_pool_priority: POOLNUM2=2 2020-09-08T15:37:07.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:380: TEST_backfill_pool_priority: pool2=test2 2020-09-08T15:37:07.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:381: TEST_backfill_pool_priority: chk_osd2_1=0 2020-09-08T15:37:07.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:382: TEST_backfill_pool_priority: chk_osd2_2=1 2020-09-08T15:37:07.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:383: TEST_backfill_pool_priority: break 2020-09-08T15:37:07.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:386: TEST_backfill_pool_priority: rm -f td/osd-backfill-prio/acting 2020-09-08T15:37:07.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:388: TEST_backfill_pool_priority: '[' test2 = '' ']' 2020-09-08T15:37:07.998 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:394: TEST_backfill_pool_priority: seq 1 3 2020-09-08T15:37:07.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:394: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2020-09-08T15:37:07.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:396: TEST_backfill_pool_priority: '[' 1 '!=' 1 -a 1 '!=' 2 ']' 2020-09-08T15:37:07.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:394: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2020-09-08T15:37:07.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:396: TEST_backfill_pool_priority: '[' 2 '!=' 1 -a 2 '!=' 2 ']' 2020-09-08T15:37:08.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:394: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2020-09-08T15:37:08.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:396: TEST_backfill_pool_priority: '[' 3 '!=' 1 -a 3 '!=' 2 ']' 2020-09-08T15:37:08.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:398: TEST_backfill_pool_priority: delete_pool test3 2020-09-08T15:37:08.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test3 2020-09-08T15:37:08.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test3 test3 --yes-i-really-really-mean-it 2020-09-08T15:37:08.543 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test3' does not exist 2020-09-08T15:37:08.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:402: TEST_backfill_pool_priority: pool1_extra_prio=1 2020-09-08T15:37:08.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:403: TEST_backfill_pool_priority: pool2_extra_prio=2 2020-09-08T15:37:08.552 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:405: TEST_backfill_pool_priority: expr 150 + 1 + 1 2020-09-08T15:37:08.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:405: TEST_backfill_pool_priority: pool1_prio=152 2020-09-08T15:37:08.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:406: TEST_backfill_pool_priority: expr 150 + 1 + 2 2020-09-08T15:37:08.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:406: TEST_backfill_pool_priority: pool2_prio=153 2020-09-08T15:37:08.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:408: TEST_backfill_pool_priority: ceph osd pool set test1 size 1 --yes-i-really-mean-it 2020-09-08T15:37:09.303 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 1 2020-09-08T15:37:09.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:409: TEST_backfill_pool_priority: ceph osd pool set test1 recovery_priority 1 2020-09-08T15:37:10.216 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 recovery_priority to 1 2020-09-08T15:37:10.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:410: TEST_backfill_pool_priority: ceph osd pool set test2 size 1 --yes-i-really-mean-it 2020-09-08T15:37:10.998 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 2 size to 1 2020-09-08T15:37:11.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:411: TEST_backfill_pool_priority: ceph osd pool set test2 recovery_priority 2 2020-09-08T15:37:11.775 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 2 recovery_priority to 2 2020-09-08T15:37:11.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:412: TEST_backfill_pool_priority: wait_for_clean 2020-09-08T15:37:11.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:37:11.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:37:11.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:37:11.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:37:11.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T15:37:11.786 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:37:11.786 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:37:11.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:37:11.787 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:37:11.787 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:37:11.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:37:11.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:37:11.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:37:11.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:37:11.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:37:12.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:37:12.351 INFO:tasks.workunit.client.0.smithi065.stderr:1' 2020-09-08T15:37:12.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:37:12.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:37:12.352 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:37:12.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836491 2020-09-08T15:37:12.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836491 2020-09-08T15:37:12.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491' 2020-09-08T15:37:12.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:37:12.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:37:12.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672969 2020-09-08T15:37:12.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672969 2020-09-08T15:37:12.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969' 2020-09-08T15:37:12.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:37:12.620 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836491 2020-09-08T15:37:12.620 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:37:12.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:37:12.623 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836491 2020-09-08T15:37:12.623 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:37:12.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836491 2020-09-08T15:37:12.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2020-09-08T15:37:12.624 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:37:12.625 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836491 2020-09-08T15:37:13.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836489 -lt 21474836491 2020-09-08T15:37:13.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:37:14.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:37:14.020 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:37:14.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836491 -lt 21474836491 2020-09-08T15:37:14.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:37:14.471 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672969 2020-09-08T15:37:14.471 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:37:14.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:37:14.473 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672969 2020-09-08T15:37:14.473 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:37:14.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672969 2020-09-08T15:37:14.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672969' 2020-09-08T15:37:14.475 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672969 2020-09-08T15:37:14.475 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:37:14.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672969 -lt 42949672969 2020-09-08T15:37:14.870 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:37:14.875 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:37:14.876 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:37:15.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 2 == 0 2020-09-08T15:37:15.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:37:15.390 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:37:15.391 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:37:15.391 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:37:15.391 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:37:15.391 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:37:15.391 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:37:15.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=2 2020-09-08T15:37:15.778 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:37:15.779 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:37:15.779 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:37:16.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 2 = 2 2020-09-08T15:37:16.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:37:16.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:37:16.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:414: TEST_backfill_pool_priority: dd if=/dev/urandom of=td/osd-backfill-prio/data bs=1M count=10 2020-09-08T15:37:16.359 INFO:tasks.workunit.client.0.smithi065.stderr:10+0 records in 2020-09-08T15:37:16.359 INFO:tasks.workunit.client.0.smithi065.stderr:10+0 records out 2020-09-08T15:37:16.360 INFO:tasks.workunit.client.0.smithi065.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0444042 s, 236 MB/s 2020-09-08T15:37:16.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:415: TEST_backfill_pool_priority: p=1 2020-09-08T15:37:16.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:416: TEST_backfill_pool_priority: for pname in $pool1 $pool2 2020-09-08T15:37:16.361 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: seq 1 50 2020-09-08T15:37:16.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:16.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj1-p1 td/osd-backfill-prio/data 2020-09-08T15:37:16.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:16.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj2-p1 td/osd-backfill-prio/data 2020-09-08T15:37:16.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:16.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj3-p1 td/osd-backfill-prio/data 2020-09-08T15:37:17.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:17.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj4-p1 td/osd-backfill-prio/data 2020-09-08T15:37:17.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:17.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj5-p1 td/osd-backfill-prio/data 2020-09-08T15:37:18.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:18.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj6-p1 td/osd-backfill-prio/data 2020-09-08T15:37:18.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:18.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj7-p1 td/osd-backfill-prio/data 2020-09-08T15:37:19.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:19.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj8-p1 td/osd-backfill-prio/data 2020-09-08T15:37:19.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:19.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj9-p1 td/osd-backfill-prio/data 2020-09-08T15:37:19.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:19.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj10-p1 td/osd-backfill-prio/data 2020-09-08T15:37:20.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:20.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj11-p1 td/osd-backfill-prio/data 2020-09-08T15:37:20.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:20.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj12-p1 td/osd-backfill-prio/data 2020-09-08T15:37:21.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:21.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj13-p1 td/osd-backfill-prio/data 2020-09-08T15:37:22.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:22.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj14-p1 td/osd-backfill-prio/data 2020-09-08T15:37:22.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:22.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj15-p1 td/osd-backfill-prio/data 2020-09-08T15:37:22.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:22.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj16-p1 td/osd-backfill-prio/data 2020-09-08T15:37:23.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:23.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj17-p1 td/osd-backfill-prio/data 2020-09-08T15:37:23.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:23.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj18-p1 td/osd-backfill-prio/data 2020-09-08T15:37:23.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:23.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj19-p1 td/osd-backfill-prio/data 2020-09-08T15:37:24.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:24.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj20-p1 td/osd-backfill-prio/data 2020-09-08T15:37:25.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:25.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj21-p1 td/osd-backfill-prio/data 2020-09-08T15:37:25.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:25.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj22-p1 td/osd-backfill-prio/data 2020-09-08T15:37:25.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:25.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj23-p1 td/osd-backfill-prio/data 2020-09-08T15:37:26.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:26.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj24-p1 td/osd-backfill-prio/data 2020-09-08T15:37:27.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:27.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj25-p1 td/osd-backfill-prio/data 2020-09-08T15:37:28.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:28.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj26-p1 td/osd-backfill-prio/data 2020-09-08T15:37:28.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:28.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj27-p1 td/osd-backfill-prio/data 2020-09-08T15:37:28.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:28.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj28-p1 td/osd-backfill-prio/data 2020-09-08T15:37:29.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:29.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj29-p1 td/osd-backfill-prio/data 2020-09-08T15:37:29.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:29.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj30-p1 td/osd-backfill-prio/data 2020-09-08T15:37:29.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:29.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj31-p1 td/osd-backfill-prio/data 2020-09-08T15:37:30.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:30.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj32-p1 td/osd-backfill-prio/data 2020-09-08T15:37:31.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:31.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj33-p1 td/osd-backfill-prio/data 2020-09-08T15:37:31.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:31.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj34-p1 td/osd-backfill-prio/data 2020-09-08T15:37:32.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:32.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj35-p1 td/osd-backfill-prio/data 2020-09-08T15:37:32.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:32.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj36-p1 td/osd-backfill-prio/data 2020-09-08T15:37:32.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:32.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj37-p1 td/osd-backfill-prio/data 2020-09-08T15:37:33.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:33.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj38-p1 td/osd-backfill-prio/data 2020-09-08T15:37:34.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:34.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj39-p1 td/osd-backfill-prio/data 2020-09-08T15:37:34.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:34.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj40-p1 td/osd-backfill-prio/data 2020-09-08T15:37:34.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:34.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj41-p1 td/osd-backfill-prio/data 2020-09-08T15:37:35.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:35.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj42-p1 td/osd-backfill-prio/data 2020-09-08T15:37:35.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:35.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj43-p1 td/osd-backfill-prio/data 2020-09-08T15:37:35.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:35.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj44-p1 td/osd-backfill-prio/data 2020-09-08T15:37:36.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:36.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj45-p1 td/osd-backfill-prio/data 2020-09-08T15:37:37.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:37.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj46-p1 td/osd-backfill-prio/data 2020-09-08T15:37:37.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:37.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj47-p1 td/osd-backfill-prio/data 2020-09-08T15:37:38.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:38.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj48-p1 td/osd-backfill-prio/data 2020-09-08T15:37:38.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:38.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj49-p1 td/osd-backfill-prio/data 2020-09-08T15:37:38.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:38.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test1 put obj50-p1 td/osd-backfill-prio/data 2020-09-08T15:37:39.312 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:422: TEST_backfill_pool_priority: expr 1 + 1 2020-09-08T15:37:39.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:422: TEST_backfill_pool_priority: p=2 2020-09-08T15:37:39.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:416: TEST_backfill_pool_priority: for pname in $pool1 $pool2 2020-09-08T15:37:39.313 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: seq 1 50 2020-09-08T15:37:39.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:39.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj1-p2 td/osd-backfill-prio/data 2020-09-08T15:37:40.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:40.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj2-p2 td/osd-backfill-prio/data 2020-09-08T15:37:40.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:40.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj3-p2 td/osd-backfill-prio/data 2020-09-08T15:37:40.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:40.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj4-p2 td/osd-backfill-prio/data 2020-09-08T15:37:41.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:41.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj5-p2 td/osd-backfill-prio/data 2020-09-08T15:37:41.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:41.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj6-p2 td/osd-backfill-prio/data 2020-09-08T15:37:42.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:42.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj7-p2 td/osd-backfill-prio/data 2020-09-08T15:37:42.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:42.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj8-p2 td/osd-backfill-prio/data 2020-09-08T15:37:43.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:43.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj9-p2 td/osd-backfill-prio/data 2020-09-08T15:37:43.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:43.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj10-p2 td/osd-backfill-prio/data 2020-09-08T15:37:43.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:43.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj11-p2 td/osd-backfill-prio/data 2020-09-08T15:37:44.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:44.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj12-p2 td/osd-backfill-prio/data 2020-09-08T15:37:44.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:44.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj13-p2 td/osd-backfill-prio/data 2020-09-08T15:37:45.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:45.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj14-p2 td/osd-backfill-prio/data 2020-09-08T15:37:45.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:45.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj15-p2 td/osd-backfill-prio/data 2020-09-08T15:37:46.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:46.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj16-p2 td/osd-backfill-prio/data 2020-09-08T15:37:46.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:46.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj17-p2 td/osd-backfill-prio/data 2020-09-08T15:37:47.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:47.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj18-p2 td/osd-backfill-prio/data 2020-09-08T15:37:47.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:47.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj19-p2 td/osd-backfill-prio/data 2020-09-08T15:37:47.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:47.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj20-p2 td/osd-backfill-prio/data 2020-09-08T15:37:48.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:48.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj21-p2 td/osd-backfill-prio/data 2020-09-08T15:37:48.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:48.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj22-p2 td/osd-backfill-prio/data 2020-09-08T15:37:49.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:49.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj23-p2 td/osd-backfill-prio/data 2020-09-08T15:37:49.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:49.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj24-p2 td/osd-backfill-prio/data 2020-09-08T15:37:50.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:50.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj25-p2 td/osd-backfill-prio/data 2020-09-08T15:37:51.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:51.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj26-p2 td/osd-backfill-prio/data 2020-09-08T15:37:51.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:51.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj27-p2 td/osd-backfill-prio/data 2020-09-08T15:37:51.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:51.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj28-p2 td/osd-backfill-prio/data 2020-09-08T15:37:52.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:52.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj29-p2 td/osd-backfill-prio/data 2020-09-08T15:37:52.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:53.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj30-p2 td/osd-backfill-prio/data 2020-09-08T15:37:53.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:53.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj31-p2 td/osd-backfill-prio/data 2020-09-08T15:37:53.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:53.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj32-p2 td/osd-backfill-prio/data 2020-09-08T15:37:54.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:54.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj33-p2 td/osd-backfill-prio/data 2020-09-08T15:37:54.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:54.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj34-p2 td/osd-backfill-prio/data 2020-09-08T15:37:54.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:54.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj35-p2 td/osd-backfill-prio/data 2020-09-08T15:37:55.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:55.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj36-p2 td/osd-backfill-prio/data 2020-09-08T15:37:55.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:55.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj37-p2 td/osd-backfill-prio/data 2020-09-08T15:37:56.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:56.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj38-p2 td/osd-backfill-prio/data 2020-09-08T15:37:56.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:56.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj39-p2 td/osd-backfill-prio/data 2020-09-08T15:37:57.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:57.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj40-p2 td/osd-backfill-prio/data 2020-09-08T15:37:57.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:57.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj41-p2 td/osd-backfill-prio/data 2020-09-08T15:37:58.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:58.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj42-p2 td/osd-backfill-prio/data 2020-09-08T15:37:58.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:58.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj43-p2 td/osd-backfill-prio/data 2020-09-08T15:37:59.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:59.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj44-p2 td/osd-backfill-prio/data 2020-09-08T15:37:59.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:59.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj45-p2 td/osd-backfill-prio/data 2020-09-08T15:37:59.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:37:59.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj46-p2 td/osd-backfill-prio/data 2020-09-08T15:38:00.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:38:00.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj47-p2 td/osd-backfill-prio/data 2020-09-08T15:38:01.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:38:01.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj48-p2 td/osd-backfill-prio/data 2020-09-08T15:38:02.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:38:02.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj49-p2 td/osd-backfill-prio/data 2020-09-08T15:38:02.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2020-09-08T15:38:02.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:420: TEST_backfill_pool_priority: rados -p test2 put obj50-p2 td/osd-backfill-prio/data 2020-09-08T15:38:03.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:422: TEST_backfill_pool_priority: expr 2 + 1 2020-09-08T15:38:03.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:422: TEST_backfill_pool_priority: p=3 2020-09-08T15:38:03.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:425: TEST_backfill_pool_priority: get_not_primary test1 obj1-p1 2020-09-08T15:38:03.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1167: get_not_primary: local poolname=test1 2020-09-08T15:38:03.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: get_not_primary: local objectname=obj1-p1 2020-09-08T15:38:03.006 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: get_primary test1 obj1-p1 2020-09-08T15:38:03.006 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test1 2020-09-08T15:38:03.006 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1-p1 2020-09-08T15:38:03.007 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test1 obj1-p1 2020-09-08T15:38:03.007 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T15:38:03.409 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: local primary=1 2020-09-08T15:38:03.410 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1171: get_not_primary: ceph --format json osd map test1 obj1-p1 2020-09-08T15:38:03.410 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1172: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2020-09-08T15:38:03.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:425: TEST_backfill_pool_priority: local otherosd=null 2020-09-08T15:38:03.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:427: TEST_backfill_pool_priority: ceph pg dump pgs 2020-09-08T15:38:04.279 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:38:04.280 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 50 0 0 0 0 524288000 0 0 50 50 active+clean 2020-09-08T15:37:09.787564+0000 37'150 37:194 [1] 1 [1] 1 0'0 2020-09-08T15:36:50.191928+0000 0'0 2020-09-08T15:36:50.191928+0000 0 2020-09-08T15:38:04.280 INFO:tasks.workunit.client.0.smithi065.stdout:2.0 47 0 0 0 0 486539264 0 0 39 39 active+clean 2020-09-08T15:37:11.184202+0000 37'139 37:176 [0] 0 [0] 0 0'0 2020-09-08T15:36:52.702843+0000 0'0 2020-09-08T15:36:52.702843+0000 0 2020-09-08T15:38:04.280 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:38:04.280 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:38:04.281 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:38:04.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:428: TEST_backfill_pool_priority: ERRORS=0 2020-09-08T15:38:04.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:430: TEST_backfill_pool_priority: ceph osd pool set test1 size 2 2020-09-08T15:38:05.013 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 2 2020-09-08T15:38:05.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:431: TEST_backfill_pool_priority: ceph osd pool set test2 size 2 2020-09-08T15:38:05.901 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 2 size to 2 2020-09-08T15:38:05.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:432: TEST_backfill_pool_priority: sleep 5 2020-09-08T15:38:10.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:433: TEST_backfill_pool_priority: get_asok_path osd.1 2020-09-08T15:38:10.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-09-08T15:38:10.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-09-08T15:38:10.914 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:38:10.914 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:38:10.914 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:38:10.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83246/ceph-osd.1.asok 2020-09-08T15:38:10.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:433: TEST_backfill_pool_priority: CEPH_ARGS= 2020-09-08T15:38:10.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:433: TEST_backfill_pool_priority: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:38:11.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:434: TEST_backfill_pool_priority: echo osd.1 2020-09-08T15:38:11.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:435: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.1.out 2020-09-08T15:38:11.016 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 2020-09-08T15:38:11.017 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:38:11.017 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:38:11.017 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:38:11.018 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:38:11.018 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:38:11.018 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:38:11.018 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:38:11.019 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:38:11.019 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 152, 2020-09-08T15:38:11.019 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:38:11.019 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:38:11.019 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:38:11.020 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:38:11.020 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:38:11.020 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:38:11.020 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:38:11.020 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:38:11.021 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:38:11.021 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:38:11.021 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "2.0", 2020-09-08T15:38:11.021 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 153, 2020-09-08T15:38:11.021 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:38:11.022 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:38:11.022 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:38:11.022 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:38:11.022 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:38:11.022 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:436: TEST_backfill_pool_priority: get_asok_path osd.0 2020-09-08T15:38:11.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-09-08T15:38:11.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-09-08T15:38:11.023 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:38:11.023 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:38:11.024 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:38:11.024 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83246/ceph-osd.0.asok 2020-09-08T15:38:11.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:436: TEST_backfill_pool_priority: CEPH_ARGS= 2020-09-08T15:38:11.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:436: TEST_backfill_pool_priority: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.0.asok dump_recovery_reservations 2020-09-08T15:38:11.117 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 2020-09-08T15:38:11.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:437: TEST_backfill_pool_priority: echo osd.0 2020-09-08T15:38:11.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:438: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.0.out 2020-09-08T15:38:11.119 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:38:11.119 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:38:11.119 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:38:11.120 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:38:11.120 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:38:11.120 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:38:11.120 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:38:11.120 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "2.0", 2020-09-08T15:38:11.121 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 153, 2020-09-08T15:38:11.121 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:38:11.121 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:38:11.121 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:38:11.122 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:38:11.122 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:38:11.122 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:38:11.122 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:38:11.122 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:38:11.123 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:38:11.123 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:38:11.123 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:38:11.123 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 152, 2020-09-08T15:38:11.123 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:38:11.124 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:38:11.124 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:38:11.124 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:38:11.124 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:38:11.124 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:441: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.1.out 2020-09-08T15:38:11.125 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:441: TEST_backfill_pool_priority: jq '.local_reservations.in_progress[0].item' 2020-09-08T15:38:11.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:441: TEST_backfill_pool_priority: eval 'ITEM="1.0"' 2020-09-08T15:38:11.126 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:441: TEST_backfill_pool_priority: ITEM=1.0 2020-09-08T15:38:11.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:442: TEST_backfill_pool_priority: '[' 1.0 '!=' 1.0 ']' 2020-09-08T15:38:11.127 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:447: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.1.out 2020-09-08T15:38:11.127 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:447: TEST_backfill_pool_priority: jq '.local_reservations.in_progress[0].prio' 2020-09-08T15:38:11.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:447: TEST_backfill_pool_priority: PRIO=152 2020-09-08T15:38:11.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:448: TEST_backfill_pool_priority: '[' 152 '!=' 152 ']' 2020-09-08T15:38:11.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:456: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.0.out 2020-09-08T15:38:11.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:456: TEST_backfill_pool_priority: jq '.remote_reservations.in_progress[0].item' 2020-09-08T15:38:11.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:456: TEST_backfill_pool_priority: eval 'ITEM="1.0"' 2020-09-08T15:38:11.129 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:456: TEST_backfill_pool_priority: ITEM=1.0 2020-09-08T15:38:11.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:457: TEST_backfill_pool_priority: '[' 1.0 '!=' 1.0 ']' 2020-09-08T15:38:11.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:462: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.0.out 2020-09-08T15:38:11.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:462: TEST_backfill_pool_priority: jq '.remote_reservations.in_progress[0].prio' 2020-09-08T15:38:11.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:462: TEST_backfill_pool_priority: PRIO=152 2020-09-08T15:38:11.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:463: TEST_backfill_pool_priority: '[' 152 '!=' 152 ']' 2020-09-08T15:38:11.133 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:471: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.0.out 2020-09-08T15:38:11.133 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:471: TEST_backfill_pool_priority: jq '.local_reservations.in_progress[0].item' 2020-09-08T15:38:11.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:471: TEST_backfill_pool_priority: eval 'ITEM="2.0"' 2020-09-08T15:38:11.135 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:471: TEST_backfill_pool_priority: ITEM=2.0 2020-09-08T15:38:11.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:472: TEST_backfill_pool_priority: '[' 2.0 '!=' 2.0 ']' 2020-09-08T15:38:11.136 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:477: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.0.out 2020-09-08T15:38:11.136 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:477: TEST_backfill_pool_priority: jq '.local_reservations.in_progress[0].prio' 2020-09-08T15:38:11.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:477: TEST_backfill_pool_priority: PRIO=153 2020-09-08T15:38:11.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:478: TEST_backfill_pool_priority: '[' 153 '!=' 153 ']' 2020-09-08T15:38:11.139 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:486: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.1.out 2020-09-08T15:38:11.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:486: TEST_backfill_pool_priority: jq '.remote_reservations.in_progress[0].item' 2020-09-08T15:38:11.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:486: TEST_backfill_pool_priority: eval 'ITEM="2.0"' 2020-09-08T15:38:11.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:486: TEST_backfill_pool_priority: ITEM=2.0 2020-09-08T15:38:11.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:487: TEST_backfill_pool_priority: '[' 2.0 '!=' 2.0 ']' 2020-09-08T15:38:11.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:492: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.1.out 2020-09-08T15:38:11.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:492: TEST_backfill_pool_priority: jq '.remote_reservations.in_progress[0].prio' 2020-09-08T15:38:11.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:492: TEST_backfill_pool_priority: PRIO=153 2020-09-08T15:38:11.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:493: TEST_backfill_pool_priority: '[' 153 '!=' 153 ']' 2020-09-08T15:38:11.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:500: TEST_backfill_pool_priority: wait_for_clean 2020-09-08T15:38:11.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:38:11.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:38:11.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:38:11.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:38:11.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T15:38:11.149 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:38:11.149 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:38:11.149 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:38:11.149 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:38:11.150 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:38:11.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:38:11.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:38:11.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:38:11.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:38:11.241 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:38:11.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:38:11.683 INFO:tasks.workunit.client.0.smithi065.stderr:1' 2020-09-08T15:38:11.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:38:11.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:38:11.684 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:38:11.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836505 2020-09-08T15:38:11.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836505 2020-09-08T15:38:11.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836505' 2020-09-08T15:38:11.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:38:11.821 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:38:12.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672983 2020-09-08T15:38:12.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672983 2020-09-08T15:38:12.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836505 1-42949672983' 2020-09-08T15:38:12.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:38:12.041 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836505 2020-09-08T15:38:12.041 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:38:12.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:38:12.042 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836505 2020-09-08T15:38:12.042 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:38:12.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836505 2020-09-08T15:38:12.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836505' 2020-09-08T15:38:12.043 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836505 2020-09-08T15:38:12.044 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:38:12.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836505 -lt 21474836505 2020-09-08T15:38:12.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:38:12.600 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672983 2020-09-08T15:38:12.600 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:38:12.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:38:12.602 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672983 2020-09-08T15:38:12.602 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:38:12.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672983 2020-09-08T15:38:12.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672983' 2020-09-08T15:38:12.603 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672983 2020-09-08T15:38:12.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:38:13.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672981 -lt 42949672983 2020-09-08T15:38:13.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:38:14.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:38:14.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:38:14.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672983 -lt 42949672983 2020-09-08T15:38:14.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:38:14.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:14.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:15.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 2 == 0 2020-09-08T15:38:15.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:15.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:15.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:15.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:15.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:15.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:15.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:15.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:15.598 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:15.598 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:15.599 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:16.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:16.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T15:38:16.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T15:38:16.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T15:38:16.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:16.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:16.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:16.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:16.231 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:16.231 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:16.231 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:16.231 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:16.232 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:16.232 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:16.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:16.789 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:16.790 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:16.790 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:17.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:17.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:17.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:17.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:17.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:17.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:17.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:17.400 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:17.400 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:18.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=17856224 2020-09-08T15:38:18.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 17856224 '!=' null 2020-09-08T15:38:18.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:18.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:18.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:18.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:18.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:18.195 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:18.195 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:18.195 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:18.196 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:18.196 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:18.196 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:18.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:18.583 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:18.583 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:18.584 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:19.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:19.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:19.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:19.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:19.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:19.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:19.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:19.627 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:19.627 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:20.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=15500281 2020-09-08T15:38:20.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 15500281 '!=' null 2020-09-08T15:38:20.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:20.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:20.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:20.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:20.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:20.263 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:20.263 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:20.263 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:20.264 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:20.264 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:20.264 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:20.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:20.676 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:20.676 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:20.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:21.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:21.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:21.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:21.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:21.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:21.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:21.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:21.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:21.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:21.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=18346191 2020-09-08T15:38:21.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 18346191 '!=' null 2020-09-08T15:38:21.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:21.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:21.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:22.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:22.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:22.041 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:22.041 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:22.041 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:22.042 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:22.042 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:22.042 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:22.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:22.447 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:22.447 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:22.447 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:23.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:23.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:23.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:23.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:23.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:23.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:23.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:23.259 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:23.260 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:23.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=20093630 2020-09-08T15:38:23.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 20093630 '!=' null 2020-09-08T15:38:23.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:23.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:23.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:23.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:23.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:23.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:23.926 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:23.926 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:23.926 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:23.927 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:23.927 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:24.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:24.393 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:24.394 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:24.394 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:25.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:25.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:25.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:25.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:25.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:25.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:25.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:25.147 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:25.147 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:25.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=16599342 2020-09-08T15:38:25.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 16599342 '!=' null 2020-09-08T15:38:25.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:25.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:25.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:26.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:26.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:26.083 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:26.083 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:26.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:26.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:26.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:26.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:26.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:26.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:26.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:26.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:27.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:27.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:27.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:27.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:27.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:27.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:27.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:27.182 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:27.182 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:27.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=18346985 2020-09-08T15:38:27.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 18346985 '!=' null 2020-09-08T15:38:27.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:27.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:27.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:27.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:27.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:27.853 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:27.853 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:27.853 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:27.853 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:27.853 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:27.854 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:28.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:28.238 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:28.239 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:28.239 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:28.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:28.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:28.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:28.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:28.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:28.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:28.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:28.895 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:28.895 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:29.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=17473025 2020-09-08T15:38:29.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 17473025 '!=' null 2020-09-08T15:38:29.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:29.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:29.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:29.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:29.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:29.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:29.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:29.587 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:29.587 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:29.587 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:29.588 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:30.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:30.042 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:30.042 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:30.042 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:30.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:30.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:30.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:30.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:30.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:30.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:30.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:30.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:30.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:31.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=20967644 2020-09-08T15:38:31.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 20967644 '!=' null 2020-09-08T15:38:31.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:31.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:31.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:31.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:31.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:31.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:31.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:31.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:31.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:31.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:31.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:31.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:31.983 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:31.983 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:31.983 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:32.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:32.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:32.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:32.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:32.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:32.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:32.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:32.661 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:32.661 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:33.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=20093973 2020-09-08T15:38:33.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 20093973 '!=' null 2020-09-08T15:38:33.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:33.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:33.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:33.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:33.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:33.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:33.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:33.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:33.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:33.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:33.300 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:33.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:33.684 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:33.685 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:33.685 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:34.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:34.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:34.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:34.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:34.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:34.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:34.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:34.398 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:34.399 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:34.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=15725714 2020-09-08T15:38:34.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 15725714 '!=' null 2020-09-08T15:38:34.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:34.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:34.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:35.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:35.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:35.016 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:35.016 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:35.016 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:35.016 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:35.016 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:35.017 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:35.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:35.401 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:35.402 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:35.402 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:35.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:35.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:35.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:35.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:35.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:35.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:35.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:35.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:35.993 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:36.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=20093918 2020-09-08T15:38:36.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 20093918 '!=' null 2020-09-08T15:38:36.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:36.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:36.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:36.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:36.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:36.897 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:36.897 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:36.897 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:36.897 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:36.898 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:36.898 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:37.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:37.283 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:37.283 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:37.283 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:37.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:37.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:37.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:37.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:37.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:37.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:37.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:37.803 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:37.803 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:38.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=20094004 2020-09-08T15:38:38.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 20094004 '!=' null 2020-09-08T15:38:38.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:38.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:38.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:38.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:38.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:38.501 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:38.501 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:38.501 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:38.501 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:38.502 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:38.502 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:38.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:38.924 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:38.924 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:38.924 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:39.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:39.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:39.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:39.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:39.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:39.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:39.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:39.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:39.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:40.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=20094004 2020-09-08T15:38:40.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 20094004 '!=' null 2020-09-08T15:38:40.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:40.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:40.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:40.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:40.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:40.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:40.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:40.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:40.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:40.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:40.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:40.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:40.949 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:40.949 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:40.950 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:41.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:41.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:41.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:41.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:41.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:41.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:41.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:41.576 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:41.576 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:42.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=20094360 2020-09-08T15:38:42.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 20094360 '!=' null 2020-09-08T15:38:42.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:42.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:42.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:42.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:42.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:42.196 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:42.197 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:42.197 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:42.197 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:42.197 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:42.197 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:42.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:42.589 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:42.589 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:42.589 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:43.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:43.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:43.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:43.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:43.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:43.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:43.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:43.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:43.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:44.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=20967941 2020-09-08T15:38:44.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 20967941 '!=' null 2020-09-08T15:38:44.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:44.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:44.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:44.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:44.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:44.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:44.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:44.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:44.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:44.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:44.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:44.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:45.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:45.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:45.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:45.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:45.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:45.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:45.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:45.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:45.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:45.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:45.233 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:45.233 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:45.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=17473254 2020-09-08T15:38:45.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 17473254 '!=' null 2020-09-08T15:38:45.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:45.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:45.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:45.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:45.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:45.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:45.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:45.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:45.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:45.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:45.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:46.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:46.582 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:46.582 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:46.582 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:47.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:47.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:47.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:47.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:47.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:47.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:47.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:47.212 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:47.212 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:47.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=21841654 2020-09-08T15:38:47.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 21841654 '!=' null 2020-09-08T15:38:47.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:47.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:47.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:47.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:47.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:47.908 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:47.908 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:47.908 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:47.908 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:47.908 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:47.909 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:48.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:48.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:48.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:48.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:49.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:49.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:49.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:49.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:49.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:49.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:49.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:49.174 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:49.174 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:49.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=21841766 2020-09-08T15:38:49.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 21841766 '!=' null 2020-09-08T15:38:49.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:49.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:49.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:50.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:50.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:50.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:50.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:50.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:50.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:50.064 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:50.064 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:50.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:50.446 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:50.447 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:50.447 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:51.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:51.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:51.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:51.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:51.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:51.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:51.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:51.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:51.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:51.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=21841609 2020-09-08T15:38:51.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 21841609 '!=' null 2020-09-08T15:38:51.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:51.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:51.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:51.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:51.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:51.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:51.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:51.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:51.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:51.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:51.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:52.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:52.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:52.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:52.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:53.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:53.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:53.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:53.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:53.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:53.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:53.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:53.468 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:53.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:54.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=21841461 2020-09-08T15:38:54.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 21841461 '!=' null 2020-09-08T15:38:54.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:54.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:54.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:54.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:54.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:54.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:54.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:54.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:54.324 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:54.324 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:54.324 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:54.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:54.712 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:54.712 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:54.712 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:55.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:55.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:55.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:55.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:55.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:55.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:55.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:55.359 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:55.360 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:56.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=17473064 2020-09-08T15:38:56.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 17473064 '!=' null 2020-09-08T15:38:56.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:56.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:56.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:56.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:56.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:56.225 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:56.226 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:56.226 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:56.226 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:56.227 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:56.227 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:56.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:56.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:56.615 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:56.615 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:57.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:57.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:57.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:57.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:57.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:57.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:57.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:57.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:57.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:57.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=20967633 2020-09-08T15:38:57.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 20967633 '!=' null 2020-09-08T15:38:57.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:57.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:57.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:58.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:58.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:58.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:58.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:58.056 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:58.056 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:58.056 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:58.056 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:38:58.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:38:58.443 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:38:58.444 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:38:58.444 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:38:59.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:38:59.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:38:59.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:38:59.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:38:59.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:38:59.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:38:59.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:38:59.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:38:59.100 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:38:59.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=19220062 2020-09-08T15:38:59.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 19220062 '!=' null 2020-09-08T15:38:59.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:38:59.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:38:59.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:38:59.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:38:59.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:38:59.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:38:59.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:38:59.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:38:59.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:38:59.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:38:59.857 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:39:00.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:39:00.249 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:39:00.249 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:39:00.249 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:39:00.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:39:00.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:39:00.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:39:00.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:39:00.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:39:00.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:39:00.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:39:00.810 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:39:00.810 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:39:01.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=17472802 2020-09-08T15:39:01.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 17472802 '!=' null 2020-09-08T15:39:01.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:39:01.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:39:01.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:39:01.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:39:01.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:39:01.806 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:39:01.807 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:39:01.807 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:39:01.807 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:39:01.807 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:39:01.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:39:02.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:39:02.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:39:02.193 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:39:02.193 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:39:02.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:39:02.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:39:02.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:39:02.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:39:02.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:39:02.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:39:02.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:39:02.784 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:39:02.784 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:39:03.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=18346523 2020-09-08T15:39:03.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 18346523 '!=' null 2020-09-08T15:39:03.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:39:03.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:39:03.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:39:03.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:39:03.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:39:03.412 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:39:03.412 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:39:03.413 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:39:03.413 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:39:03.413 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:39:03.414 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:39:03.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:39:03.795 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:39:03.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:39:03.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:39:04.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:39:04.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:39:04.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:39:04.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:39:04.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:39:04.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:39:04.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:39:04.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:39:04.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:39:04.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=10483800 2020-09-08T15:39:04.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 10483800 '!=' null 2020-09-08T15:39:04.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:39:04.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:39:04.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:39:04.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:39:04.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:39:04.947 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:39:04.947 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:39:04.947 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:39:04.947 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:39:04.947 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:39:04.948 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:39:05.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:39:05.329 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:39:05.330 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:39:05.330 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:39:05.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 2 2020-09-08T15:39:05.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:39:05.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:39:05.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:39:05.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:39:05.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:39:05.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:39:05.853 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:39:05.853 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:39:06.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=9550955 2020-09-08T15:39:06.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 9550955 '!=' null 2020-09-08T15:39:06.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:39:06.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:39:06.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:39:06.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:39:06.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:39:06.473 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:39:06.473 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:39:06.474 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:39:06.474 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:39:06.474 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:39:06.475 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:39:06.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:39:06.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:39:06.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:39:06.857 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:39:07.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 2 2020-09-08T15:39:07.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 1 '!=' 0 2020-09-08T15:39:07.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T15:39:07.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=1 2020-09-08T15:39:07.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:39:07.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:39:07.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:39:07.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:39:07.475 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:39:07.475 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:39:07.476 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:39:07.476 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:39:07.476 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:39:07.477 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:39:07.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:39:07.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:39:07.857 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:39:07.857 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:39:08.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 2 2020-09-08T15:39:08.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 1 '!=' 1 2020-09-08T15:39:08.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:39:08.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:39:08.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:39:08.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:39:08.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:39:08.396 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:39:08.396 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:39:08.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=8907630 2020-09-08T15:39:08.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 8907630 '!=' null 2020-09-08T15:39:08.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:39:08.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:39:08.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:39:09.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:39:09.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:39:09.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:39:09.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:39:09.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:39:09.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:39:09.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:39:09.031 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:39:09.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=2 2020-09-08T15:39:09.412 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:39:09.412 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:39:09.413 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:39:09.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 2 = 2 2020-09-08T15:39:09.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:39:09.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:39:09.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:502: TEST_backfill_pool_priority: '[' 0 '!=' 0 ']' 2020-09-08T15:39:09.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:506: TEST_backfill_pool_priority: echo TEST PASSED 2020-09-08T15:39:09.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:509: TEST_backfill_pool_priority: delete_pool test1 2020-09-08T15:39:09.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test1 2020-09-08T15:39:09.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2020-09-08T15:39:09.946 INFO:tasks.workunit.client.0.smithi065.stdout:TEST PASSED 2020-09-08T15:39:10.502 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test1' does not exist 2020-09-08T15:39:10.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:510: TEST_backfill_pool_priority: delete_pool test2 2020-09-08T15:39:10.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test2 2020-09-08T15:39:10.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test2 test2 --yes-i-really-really-mean-it 2020-09-08T15:39:11.080 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test2' does not exist 2020-09-08T15:39:11.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:511: TEST_backfill_pool_priority: kill_daemons td/osd-backfill-prio 2020-09-08T15:39:11.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:39:11.540 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:39:11.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:39:11.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:39:11.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:39:11.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:39:11.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:512: TEST_backfill_pool_priority: return 0 2020-09-08T15:39:11.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:40: run: teardown td/osd-backfill-prio 2020-09-08T15:39:11.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-prio 2020-09-08T15:39:11.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:39:11.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-prio KILL 2020-09-08T15:39:11.542 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:39:11.542 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:39:11.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:39:11.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:39:11.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:39:11.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:39:11.543 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:39:11.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:39:11.543 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:39:11.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:39:11.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:39:11.544 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:39:11.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:39:11.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:39:11.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:39:11.545 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:39:11.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:39:11.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:39:11.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-prio 2020-09-08T15:39:11.545 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:39:11.546 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:39:11.546 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:39:11.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83246 2020-09-08T15:39:11.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:39:11.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:39:11.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:37: run: for func in $funcs 2020-09-08T15:39:11.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:38: run: setup td/osd-backfill-prio 2020-09-08T15:39:11.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-prio 2020-09-08T15:39:11.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-prio 2020-09-08T15:39:11.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-prio 2020-09-08T15:39:11.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:39:11.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-prio KILL 2020-09-08T15:39:11.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:39:11.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:39:11.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:39:11.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:39:11.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:39:11.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:39:11.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:39:11.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:39:11.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:39:11.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:39:11.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:39:11.551 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:39:11.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:39:11.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:39:11.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:39:11.551 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:39:11.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:39:11.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:39:11.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-prio 2020-09-08T15:39:11.552 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:39:11.552 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:39:11.553 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:39:11.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83246 2020-09-08T15:39:11.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:39:11.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:39:11.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-prio 2020-09-08T15:39:11.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T15:39:11.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:39:11.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:39:11.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83246 2020-09-08T15:39:11.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T15:39:11.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T15:39:11.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T15:39:11.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-prio 1' TERM HUP INT 2020-09-08T15:39:11.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:39: run: TEST_backfill_priority td/osd-backfill-prio 2020-09-08T15:39:11.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:46: TEST_backfill_priority: local dir=td/osd-backfill-prio 2020-09-08T15:39:11.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:47: TEST_backfill_priority: local pools=10 2020-09-08T15:39:11.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:48: TEST_backfill_priority: local OSDS=5 2020-09-08T15:39:11.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:50: TEST_backfill_priority: expr 150 + 1 2020-09-08T15:39:11.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:50: TEST_backfill_priority: local degraded_prio=151 2020-09-08T15:39:11.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:51: TEST_backfill_priority: local max_tries=10 2020-09-08T15:39:11.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:53: TEST_backfill_priority: run_mon td/osd-backfill-prio a 2020-09-08T15:39:11.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-prio 2020-09-08T15:39:11.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T15:39:11.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T15:39:11.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T15:39:11.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-prio/a 2020-09-08T15:39:11.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-prio/a --run-dir=td/osd-backfill-prio 2020-09-08T15:39:12.049 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T15:39:12.050 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:39:12.050 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:39:12.050 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:39:12.050 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:39:12.050 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:39:12.051 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83246/$cluster-$name.asok' 2020-09-08T15:39:12.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-prio/a '--log-file=td/osd-backfill-prio/$name.log' '--admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-prio/log --run-dir=td/osd-backfill-prio '--pid-file=td/osd-backfill-prio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T15:39:12.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T15:39:12.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T15:39:12.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:39:12.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:39:12.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T15:39:12.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T15:39:12.287 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:39:12.287 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:39:12.287 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:39:12.288 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:39:12.288 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:39:12.289 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:39:12.289 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83246/ceph-mon.a.asok 2020-09-08T15:39:12.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:39:12.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.83246/ceph-mon.a.asok config get fsid 2020-09-08T15:39:12.385 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T15:39:12.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:39:12.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:39:12.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T15:39:12.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T15:39:12.387 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:39:12.387 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:39:12.387 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:39:12.388 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:39:12.388 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:39:12.388 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:39:12.389 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83246/ceph-mon.a.asok 2020-09-08T15:39:12.389 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:39:12.389 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.83246/ceph-mon.a.asok config get mon_host 2020-09-08T15:39:12.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:54: TEST_backfill_priority: run_mgr td/osd-backfill-prio x 2020-09-08T15:39:12.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-prio 2020-09-08T15:39:12.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T15:39:12.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T15:39:12.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T15:39:12.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-prio/x 2020-09-08T15:39:12.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T15:39:13.379 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T15:39:13.380 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:39:13.380 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:39:13.380 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:39:13.380 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:39:13.381 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:39:13.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83246/$cluster-$name.asok' 2020-09-08T15:39:13.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:39:13.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-prio/x '--log-file=td/osd-backfill-prio/$name.log' '--admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' --run-dir=td/osd-backfill-prio '--pid-file=td/osd-backfill-prio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:39:13.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:55: TEST_backfill_priority: export CEPH_ARGS 2020-09-08T15:39:13.405 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:57: TEST_backfill_priority: expr 5 - 1 2020-09-08T15:39:13.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:57: TEST_backfill_priority: seq 0 4 2020-09-08T15:39:13.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:57: TEST_backfill_priority: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:39:13.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:59: TEST_backfill_priority: run_osd td/osd-backfill-prio 0 2020-09-08T15:39:13.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-prio 2020-09-08T15:39:13.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:39:13.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T15:39:13.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:39:13.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-prio/0 2020-09-08T15:39:13.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T15:39:13.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:39:13.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:39:13.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:39:13.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-prio/0' 2020-09-08T15:39:13.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-prio/0/journal' 2020-09-08T15:39:13.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:39:13.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:39:13.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-prio' 2020-09-08T15:39:13.413 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:39:13.413 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:39:13.414 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:39:13.414 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:39:13.414 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:39:13.414 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:39:13.414 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83246/$cluster-$name.asok' 2020-09-08T15:39:13.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' 2020-09-08T15:39:13.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:39:13.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:39:13.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:39:13.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-prio/$name.log' 2020-09-08T15:39:13.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-prio/$name.pid' 2020-09-08T15:39:13.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:39:13.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:39:13.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:39:13.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:39:13.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:39:13.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-prio/0 2020-09-08T15:39:13.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:39:13.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=174b9e38-dfff-4c91-beea-772e524b2547 2020-09-08T15:39:13.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 174b9e38-dfff-4c91-beea-772e524b2547' 2020-09-08T15:39:13.418 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:39:13.418 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 174b9e38-dfff-4c91-beea-772e524b2547 2020-09-08T15:39:13.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQChpVdf1GfVGRAAW17Uhl1zBBC8XbMbaJSSpg== 2020-09-08T15:39:13.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQChpVdf1GfVGRAAW17Uhl1zBBC8XbMbaJSSpg=="}' 2020-09-08T15:39:13.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 174b9e38-dfff-4c91-beea-772e524b2547 -i td/osd-backfill-prio/0/new.json 2020-09-08T15:39:13.786 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:39:13.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-prio/0/new.json 2020-09-08T15:39:13.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/0 --osd-journal=td/osd-backfill-prio/0/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQChpVdf1GfVGRAAW17Uhl1zBBC8XbMbaJSSpg== --osd-uuid 174b9e38-dfff-4c91-beea-772e524b2547 2020-09-08T15:39:13.824 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:13.829+0000 7efe50d4eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:13.826 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:13.831+0000 7efe50d4eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:13.827 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:13.832+0000 7efe50d4eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:13.828 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:13.833+0000 7efe50d4eec0 -1 bluestore(td/osd-backfill-prio/0/block) _read_bdev_label failed to open td/osd-backfill-prio/0/block: (2) No such file or directory 2020-09-08T15:39:13.828 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:13.833+0000 7efe50d4eec0 -1 bluestore(td/osd-backfill-prio/0/block) _read_bdev_label failed to open td/osd-backfill-prio/0/block: (2) No such file or directory 2020-09-08T15:39:13.828 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:13.833+0000 7efe50d4eec0 -1 bluestore(td/osd-backfill-prio/0/block) _read_bdev_label failed to open td/osd-backfill-prio/0/block: (2) No such file or directory 2020-09-08T15:39:13.942 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:13.947+0000 7efe50d4eec0 -1 bluestore(td/osd-backfill-prio/0) _read_fsid unparsable uuid 2020-09-08T15:39:18.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-prio/0/keyring 2020-09-08T15:39:18.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:39:18.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T15:39:18.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-prio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:39:18.586 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T15:39:19.122 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T15:39:19.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T15:39:19.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/0 --osd-journal=td/osd-backfill-prio/0/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:39:19.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:39:19.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:39:19.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:39:19.148 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:19.152+0000 7fcfc69efec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:19.155 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:19.159+0000 7fcfc69efec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:19.158 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:19.161+0000 7fcfc69efec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:19.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T15:39:19.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:39:19.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:39:19.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:39:19.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:39:19.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:39:19.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:39:19.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:39:19.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:39:19.521 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:39:19.673 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:19.677+0000 7fcfc69efec0 -1 Falling back to public interface 2020-09-08T15:39:19.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:39:20.547 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:20.551+0000 7fcfc69efec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T15:39:20.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:39:20.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:39:20.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:39:20.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:39:20.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:39:20.951 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:39:21.358 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/92354,v1:127.0.0.1:6803/92354] [v2:127.0.0.1:6804/92354,v1:127.0.0.1:6805/92354] exists,up 174b9e38-dfff-4c91-beea-772e524b2547 2020-09-08T15:39:21.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:39:21.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:39:21.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:39:21.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:57: TEST_backfill_priority: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:39:21.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:59: TEST_backfill_priority: run_osd td/osd-backfill-prio 1 2020-09-08T15:39:21.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-prio 2020-09-08T15:39:21.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:39:21.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T15:39:21.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:39:21.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-prio/1 2020-09-08T15:39:21.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T15:39:21.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:39:21.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:39:21.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:39:21.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-prio/1' 2020-09-08T15:39:21.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-prio/1/journal' 2020-09-08T15:39:21.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:39:21.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:39:21.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-prio' 2020-09-08T15:39:21.363 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:39:21.363 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:39:21.363 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:39:21.363 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:39:21.363 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:39:21.363 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:39:21.364 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83246/$cluster-$name.asok' 2020-09-08T15:39:21.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' 2020-09-08T15:39:21.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:39:21.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:39:21.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:39:21.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-prio/$name.log' 2020-09-08T15:39:21.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-prio/$name.pid' 2020-09-08T15:39:21.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:39:21.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:39:21.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:39:21.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:39:21.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:39:21.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-prio/1 2020-09-08T15:39:21.366 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:39:21.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=cd5c7d17-54dc-46f4-a628-886b1a687a0d 2020-09-08T15:39:21.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 cd5c7d17-54dc-46f4-a628-886b1a687a0d' 2020-09-08T15:39:21.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:39:21.368 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 cd5c7d17-54dc-46f4-a628-886b1a687a0d 2020-09-08T15:39:21.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCppVdf1Be0FhAA9bOtn3xjUDZjzrGAxliOVw== 2020-09-08T15:39:21.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCppVdf1Be0FhAA9bOtn3xjUDZjzrGAxliOVw=="}' 2020-09-08T15:39:21.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new cd5c7d17-54dc-46f4-a628-886b1a687a0d -i td/osd-backfill-prio/1/new.json 2020-09-08T15:39:21.979 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:39:21.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-prio/1/new.json 2020-09-08T15:39:21.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/1 --osd-journal=td/osd-backfill-prio/1/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCppVdf1Be0FhAA9bOtn3xjUDZjzrGAxliOVw== --osd-uuid cd5c7d17-54dc-46f4-a628-886b1a687a0d 2020-09-08T15:39:22.018 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:22.023+0000 7fa92e261ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:22.019 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:22.024+0000 7fa92e261ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:22.020 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:22.025+0000 7fa92e261ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:22.021 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:22.026+0000 7fa92e261ec0 -1 bluestore(td/osd-backfill-prio/1/block) _read_bdev_label failed to open td/osd-backfill-prio/1/block: (2) No such file or directory 2020-09-08T15:39:22.021 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:22.026+0000 7fa92e261ec0 -1 bluestore(td/osd-backfill-prio/1/block) _read_bdev_label failed to open td/osd-backfill-prio/1/block: (2) No such file or directory 2020-09-08T15:39:22.021 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:22.026+0000 7fa92e261ec0 -1 bluestore(td/osd-backfill-prio/1/block) _read_bdev_label failed to open td/osd-backfill-prio/1/block: (2) No such file or directory 2020-09-08T15:39:22.071 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:22.076+0000 7fa92e261ec0 -1 bluestore(td/osd-backfill-prio/1) _read_fsid unparsable uuid 2020-09-08T15:39:27.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-prio/1/keyring 2020-09-08T15:39:27.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:39:27.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T15:39:27.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-prio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:39:27.003 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T15:39:27.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T15:39:27.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/1 --osd-journal=td/osd-backfill-prio/1/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:39:27.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:39:27.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:39:27.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:39:27.539 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:39:27.564 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:27.568+0000 7fc23c1ffec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:27.584 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:27.589+0000 7fc23c1ffec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:27.585 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:27.590+0000 7fc23c1ffec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:27.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T15:39:27.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:39:27.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:39:27.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:39:27.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:39:27.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:39:27.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:39:27.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:39:27.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:39:27.935 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:39:28.101 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:28.105+0000 7fc23c1ffec0 -1 Falling back to public interface 2020-09-08T15:39:28.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:39:28.977 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:28.982+0000 7fc23c1ffec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T15:39:29.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:39:29.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:39:29.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:39:29.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:39:29.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:39:29.336 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:39:29.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:39:30.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:39:30.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:39:30.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T15:39:30.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:39:30.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:39:30.815 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T15:39:31.237 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/93348,v1:127.0.0.1:6811/93348] [v2:127.0.0.1:6812/93348,v1:127.0.0.1:6813/93348] exists,up cd5c7d17-54dc-46f4-a628-886b1a687a0d 2020-09-08T15:39:31.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:39:31.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:39:31.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:39:31.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:57: TEST_backfill_priority: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:39:31.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:59: TEST_backfill_priority: run_osd td/osd-backfill-prio 2 2020-09-08T15:39:31.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-prio 2020-09-08T15:39:31.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:39:31.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T15:39:31.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:39:31.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-prio/2 2020-09-08T15:39:31.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T15:39:31.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:39:31.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:39:31.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:39:31.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-prio/2' 2020-09-08T15:39:31.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-prio/2/journal' 2020-09-08T15:39:31.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:39:31.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:39:31.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-prio' 2020-09-08T15:39:31.243 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:39:31.243 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:39:31.243 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:39:31.243 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:39:31.244 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:39:31.244 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:39:31.244 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83246/$cluster-$name.asok' 2020-09-08T15:39:31.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' 2020-09-08T15:39:31.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:39:31.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:39:31.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:39:31.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-prio/$name.log' 2020-09-08T15:39:31.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-prio/$name.pid' 2020-09-08T15:39:31.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:39:31.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:39:31.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:39:31.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:39:31.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:39:31.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-prio/2 2020-09-08T15:39:31.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:39:31.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=f37ada4a-afb8-4c7c-b018-b40acdf5ec06 2020-09-08T15:39:31.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 f37ada4a-afb8-4c7c-b018-b40acdf5ec06' 2020-09-08T15:39:31.248 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:39:31.248 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 f37ada4a-afb8-4c7c-b018-b40acdf5ec06 2020-09-08T15:39:31.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCzpVdf0HKEDxAAtMylrV953A3uWvwkF9YxGw== 2020-09-08T15:39:31.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCzpVdf0HKEDxAAtMylrV953A3uWvwkF9YxGw=="}' 2020-09-08T15:39:31.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new f37ada4a-afb8-4c7c-b018-b40acdf5ec06 -i td/osd-backfill-prio/2/new.json 2020-09-08T15:39:31.769 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T15:39:31.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-prio/2/new.json 2020-09-08T15:39:31.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/2 --osd-journal=td/osd-backfill-prio/2/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCzpVdf0HKEDxAAtMylrV953A3uWvwkF9YxGw== --osd-uuid f37ada4a-afb8-4c7c-b018-b40acdf5ec06 2020-09-08T15:39:31.809 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:31.813+0000 7f4c89cd4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:31.810 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:31.815+0000 7f4c89cd4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:31.811 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:31.816+0000 7f4c89cd4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:31.812 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:31.817+0000 7f4c89cd4ec0 -1 bluestore(td/osd-backfill-prio/2/block) _read_bdev_label failed to open td/osd-backfill-prio/2/block: (2) No such file or directory 2020-09-08T15:39:31.812 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:31.817+0000 7f4c89cd4ec0 -1 bluestore(td/osd-backfill-prio/2/block) _read_bdev_label failed to open td/osd-backfill-prio/2/block: (2) No such file or directory 2020-09-08T15:39:31.812 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:31.817+0000 7f4c89cd4ec0 -1 bluestore(td/osd-backfill-prio/2/block) _read_bdev_label failed to open td/osd-backfill-prio/2/block: (2) No such file or directory 2020-09-08T15:39:31.847 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:31.852+0000 7f4c89cd4ec0 -1 bluestore(td/osd-backfill-prio/2) _read_fsid unparsable uuid 2020-09-08T15:39:36.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-prio/2/keyring 2020-09-08T15:39:36.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:39:36.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T15:39:36.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-prio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:39:36.699 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T15:39:37.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T15:39:37.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/2 --osd-journal=td/osd-backfill-prio/2/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:39:37.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:39:37.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:39:37.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:39:37.247 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T15:39:37.271 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:37.275+0000 7f6ccc667ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:37.273 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:37.276+0000 7f6ccc667ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:37.274 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:37.278+0000 7f6ccc667ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:37.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T15:39:37.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:39:37.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:39:37.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:39:37.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:39:37.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:39:37.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:39:37.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:39:37.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:39:37.684 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:39:37.796 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:37.799+0000 7f6ccc667ec0 -1 Falling back to public interface 2020-09-08T15:39:38.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:39:38.636 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:38.640+0000 7f6ccc667ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T15:39:39.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:39:39.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:39:39.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:39:39.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:39:39.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:39:39.076 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:39:39.509 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/94368,v1:127.0.0.1:6819/94368] [v2:127.0.0.1:6820/94368,v1:127.0.0.1:6821/94368] exists,up f37ada4a-afb8-4c7c-b018-b40acdf5ec06 2020-09-08T15:39:39.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:39:39.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:39:39.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:39:39.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:57: TEST_backfill_priority: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:39:39.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:59: TEST_backfill_priority: run_osd td/osd-backfill-prio 3 2020-09-08T15:39:39.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-prio 2020-09-08T15:39:39.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:39:39.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T15:39:39.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:39:39.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-prio/3 2020-09-08T15:39:39.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T15:39:39.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:39:39.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:39:39.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:39:39.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-prio/3' 2020-09-08T15:39:39.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-prio/3/journal' 2020-09-08T15:39:39.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:39:39.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:39:39.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-prio' 2020-09-08T15:39:39.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:39:39.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:39:39.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:39:39.514 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:39:39.515 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:39:39.515 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:39:39.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83246/$cluster-$name.asok' 2020-09-08T15:39:39.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' 2020-09-08T15:39:39.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:39:39.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:39:39.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:39:39.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-prio/$name.log' 2020-09-08T15:39:39.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-prio/$name.pid' 2020-09-08T15:39:39.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:39:39.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:39:39.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:39:39.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:39:39.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:39:39.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-prio/3 2020-09-08T15:39:39.521 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:39:39.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=7ba1c851-6b61-44ea-aa13-87c2de96d448 2020-09-08T15:39:39.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 7ba1c851-6b61-44ea-aa13-87c2de96d448' 2020-09-08T15:39:39.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:39:39.523 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 7ba1c851-6b61-44ea-aa13-87c2de96d448 2020-09-08T15:39:39.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQC7pVdfuwq4HxAAGr+3w1MUf1dfHNbAX/FUIQ== 2020-09-08T15:39:39.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQC7pVdfuwq4HxAAGr+3w1MUf1dfHNbAX/FUIQ=="}' 2020-09-08T15:39:39.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 7ba1c851-6b61-44ea-aa13-87c2de96d448 -i td/osd-backfill-prio/3/new.json 2020-09-08T15:39:40.146 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T15:39:40.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-prio/3/new.json 2020-09-08T15:39:40.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/3 --osd-journal=td/osd-backfill-prio/3/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQC7pVdfuwq4HxAAGr+3w1MUf1dfHNbAX/FUIQ== --osd-uuid 7ba1c851-6b61-44ea-aa13-87c2de96d448 2020-09-08T15:39:40.184 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:40.187+0000 7f0f787c3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:40.185 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:40.189+0000 7f0f787c3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:40.186 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:40.190+0000 7f0f787c3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:40.187 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:40.191+0000 7f0f787c3ec0 -1 bluestore(td/osd-backfill-prio/3/block) _read_bdev_label failed to open td/osd-backfill-prio/3/block: (2) No such file or directory 2020-09-08T15:39:40.187 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:40.191+0000 7f0f787c3ec0 -1 bluestore(td/osd-backfill-prio/3/block) _read_bdev_label failed to open td/osd-backfill-prio/3/block: (2) No such file or directory 2020-09-08T15:39:40.188 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:40.191+0000 7f0f787c3ec0 -1 bluestore(td/osd-backfill-prio/3/block) _read_bdev_label failed to open td/osd-backfill-prio/3/block: (2) No such file or directory 2020-09-08T15:39:40.293 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:40.298+0000 7f0f787c3ec0 -1 bluestore(td/osd-backfill-prio/3) _read_fsid unparsable uuid 2020-09-08T15:39:45.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-prio/3/keyring 2020-09-08T15:39:45.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:39:45.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T15:39:45.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-prio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:39:45.152 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T15:39:45.695 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T15:39:45.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T15:39:45.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/3 --osd-journal=td/osd-backfill-prio/3/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:39:45.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:39:45.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:39:45.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:39:45.720 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:45.725+0000 7f52d671eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:45.724 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:45.729+0000 7f52d671eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:45.726 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:45.731+0000 7f52d671eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:46.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T15:39:46.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:39:46.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T15:39:46.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:39:46.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:39:46.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:39:46.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:39:46.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:39:46.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T15:39:46.093 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:39:46.243 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:46.247+0000 7f52d671eec0 -1 Falling back to public interface 2020-09-08T15:39:46.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:39:47.150 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:47.155+0000 7f52d671eec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T15:39:47.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:39:47.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:39:47.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:39:47.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:39:47.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T15:39:47.523 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:39:48.076 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/95362,v1:127.0.0.1:6827/95362] [v2:127.0.0.1:6828/95362,v1:127.0.0.1:6829/95362] exists,up 7ba1c851-6b61-44ea-aa13-87c2de96d448 2020-09-08T15:39:48.076 INFO:tasks.workunit.client.0.smithi065.stdout:add osd4 33a8ce82-1a1a-43c4-bce6-efeb166557e0 2020-09-08T15:39:48.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:39:48.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:39:48.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:39:48.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:57: TEST_backfill_priority: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:39:48.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:59: TEST_backfill_priority: run_osd td/osd-backfill-prio 4 2020-09-08T15:39:48.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-prio 2020-09-08T15:39:48.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:39:48.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=4 2020-09-08T15:39:48.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:39:48.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-prio/4 2020-09-08T15:39:48.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T15:39:48.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:39:48.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:39:48.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:39:48.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-prio/4' 2020-09-08T15:39:48.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-prio/4/journal' 2020-09-08T15:39:48.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:39:48.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:39:48.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-prio' 2020-09-08T15:39:48.080 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:39:48.080 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:39:48.081 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:39:48.081 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:39:48.081 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:39:48.081 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:39:48.081 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83246/$cluster-$name.asok' 2020-09-08T15:39:48.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' 2020-09-08T15:39:48.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:39:48.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:39:48.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:39:48.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-prio/$name.log' 2020-09-08T15:39:48.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-prio/$name.pid' 2020-09-08T15:39:48.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:39:48.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:39:48.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:39:48.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:39:48.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:39:48.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-prio/4 2020-09-08T15:39:48.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:39:48.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=33a8ce82-1a1a-43c4-bce6-efeb166557e0 2020-09-08T15:39:48.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd4 33a8ce82-1a1a-43c4-bce6-efeb166557e0' 2020-09-08T15:39:48.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:39:48.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDEpVdflGffBRAA1H3VB2OFzkk+s8hMCIwOlQ== 2020-09-08T15:39:48.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDEpVdflGffBRAA1H3VB2OFzkk+s8hMCIwOlQ=="}' 2020-09-08T15:39:48.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 33a8ce82-1a1a-43c4-bce6-efeb166557e0 -i td/osd-backfill-prio/4/new.json 2020-09-08T15:39:48.680 INFO:tasks.workunit.client.0.smithi065.stdout:4 2020-09-08T15:39:48.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-prio/4/new.json 2020-09-08T15:39:48.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 4 --fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/4 --osd-journal=td/osd-backfill-prio/4/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDEpVdflGffBRAA1H3VB2OFzkk+s8hMCIwOlQ== --osd-uuid 33a8ce82-1a1a-43c4-bce6-efeb166557e0 2020-09-08T15:39:48.718 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:48.723+0000 7fa7358c8ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:48.720 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:48.725+0000 7fa7358c8ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:48.721 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:48.726+0000 7fa7358c8ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:48.722 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:48.727+0000 7fa7358c8ec0 -1 bluestore(td/osd-backfill-prio/4/block) _read_bdev_label failed to open td/osd-backfill-prio/4/block: (2) No such file or directory 2020-09-08T15:39:48.722 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:48.727+0000 7fa7358c8ec0 -1 bluestore(td/osd-backfill-prio/4/block) _read_bdev_label failed to open td/osd-backfill-prio/4/block: (2) No such file or directory 2020-09-08T15:39:48.723 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:48.727+0000 7fa7358c8ec0 -1 bluestore(td/osd-backfill-prio/4/block) _read_bdev_label failed to open td/osd-backfill-prio/4/block: (2) No such file or directory 2020-09-08T15:39:48.814 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:48.819+0000 7fa7358c8ec0 -1 bluestore(td/osd-backfill-prio/4) _read_fsid unparsable uuid 2020-09-08T15:39:53.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-prio/4/keyring 2020-09-08T15:39:53.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:39:53.432 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd4 key to auth repository 2020-09-08T15:39:53.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd4 key to auth repository 2020-09-08T15:39:53.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-prio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:39:53.976 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.4 2020-09-08T15:39:53.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.4 2020-09-08T15:39:53.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 4 --fsid=0d46a2e7-a31e-459e-894e-54d31621164d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/4 --osd-journal=td/osd-backfill-prio/4/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.83246/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:39:53.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:39:53.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:39:53.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:39:54.002 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:54.006+0000 7f08584a3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:54.003 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:54.008+0000 7f08584a3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:54.005 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:54.010+0000 7f08584a3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:39:54.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 4 2020-09-08T15:39:54.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:39:54.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=4 2020-09-08T15:39:54.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:39:54.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:39:54.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:39:54.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:39:54.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T15:39:54.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:39:54.375 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:39:54.521 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:54.526+0000 7f08584a3ec0 -1 Falling back to public interface 2020-09-08T15:39:54.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:39:55.407 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:39:55.412+0000 7f08584a3ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-09-08T15:39:55.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:39:55.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:39:55.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:39:55.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T15:39:55.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:39:55.775 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:39:56.294 INFO:tasks.workunit.client.0.smithi065.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/96364,v1:127.0.0.1:6835/96364] [v2:127.0.0.1:6836/96364,v1:127.0.0.1:6837/96364] exists,up 33a8ce82-1a1a-43c4-bce6-efeb166557e0 2020-09-08T15:39:56.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:39:56.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:39:56.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:39:56.295 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:62: TEST_backfill_priority: seq 1 10 2020-09-08T15:39:56.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:62: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:39:56.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:64: TEST_backfill_priority: create_pool test1 1 1 2020-09-08T15:39:56.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test1 1 1 2020-09-08T15:39:56.953 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test1' already exists 2020-09-08T15:39:56.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:39:57.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:65: TEST_backfill_priority: ceph osd pool set test1 size 2 2020-09-08T15:39:58.747 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 2 2020-09-08T15:39:58.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:62: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:39:58.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:64: TEST_backfill_priority: create_pool test2 1 1 2020-09-08T15:39:58.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test2 1 1 2020-09-08T15:39:59.519 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test2' already exists 2020-09-08T15:39:59.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:40:00.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:65: TEST_backfill_priority: ceph osd pool set test2 size 2 2020-09-08T15:40:01.426 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 2 size to 2 2020-09-08T15:40:01.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:62: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:01.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:64: TEST_backfill_priority: create_pool test3 1 1 2020-09-08T15:40:01.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test3 1 1 2020-09-08T15:40:02.213 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test3' already exists 2020-09-08T15:40:02.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:40:03.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:65: TEST_backfill_priority: ceph osd pool set test3 size 2 2020-09-08T15:40:04.028 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 3 size to 2 2020-09-08T15:40:04.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:62: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:04.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:64: TEST_backfill_priority: create_pool test4 1 1 2020-09-08T15:40:04.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test4 1 1 2020-09-08T15:40:04.910 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test4' already exists 2020-09-08T15:40:04.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:40:05.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:65: TEST_backfill_priority: ceph osd pool set test4 size 2 2020-09-08T15:40:06.758 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 4 size to 2 2020-09-08T15:40:06.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:62: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:06.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:64: TEST_backfill_priority: create_pool test5 1 1 2020-09-08T15:40:06.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test5 1 1 2020-09-08T15:40:07.402 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test5' already exists 2020-09-08T15:40:07.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:40:08.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:65: TEST_backfill_priority: ceph osd pool set test5 size 2 2020-09-08T15:40:09.378 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 5 size to 2 2020-09-08T15:40:09.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:62: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:09.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:64: TEST_backfill_priority: create_pool test6 1 1 2020-09-08T15:40:09.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test6 1 1 2020-09-08T15:40:10.002 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test6' already exists 2020-09-08T15:40:10.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:40:11.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:65: TEST_backfill_priority: ceph osd pool set test6 size 2 2020-09-08T15:40:11.945 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 6 size to 2 2020-09-08T15:40:11.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:62: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:11.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:64: TEST_backfill_priority: create_pool test7 1 1 2020-09-08T15:40:11.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test7 1 1 2020-09-08T15:40:12.556 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test7' already exists 2020-09-08T15:40:12.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:40:13.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:65: TEST_backfill_priority: ceph osd pool set test7 size 2 2020-09-08T15:40:14.628 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 7 size to 2 2020-09-08T15:40:14.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:62: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:14.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:64: TEST_backfill_priority: create_pool test8 1 1 2020-09-08T15:40:14.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test8 1 1 2020-09-08T15:40:15.546 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test8' already exists 2020-09-08T15:40:15.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:40:16.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:65: TEST_backfill_priority: ceph osd pool set test8 size 2 2020-09-08T15:40:17.554 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 8 size to 2 2020-09-08T15:40:17.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:62: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:17.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:64: TEST_backfill_priority: create_pool test9 1 1 2020-09-08T15:40:17.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test9 1 1 2020-09-08T15:40:18.222 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test9' already exists 2020-09-08T15:40:18.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:40:19.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:65: TEST_backfill_priority: ceph osd pool set test9 size 2 2020-09-08T15:40:20.412 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 9 size to 2 2020-09-08T15:40:20.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:62: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:20.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:64: TEST_backfill_priority: create_pool test10 1 1 2020-09-08T15:40:20.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test10 1 1 2020-09-08T15:40:21.297 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test10' already exists 2020-09-08T15:40:21.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:40:22.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:65: TEST_backfill_priority: ceph osd pool set test10 size 2 2020-09-08T15:40:23.249 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 10 size to 2 2020-09-08T15:40:23.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:67: TEST_backfill_priority: sleep 5 2020-09-08T15:40:28.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:69: TEST_backfill_priority: wait_for_clean 2020-09-08T15:40:28.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:40:28.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:40:28.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:40:28.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:40:28.263 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T15:40:28.263 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:40:28.263 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:40:28.264 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:40:28.264 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:40:28.264 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:40:28.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:40:28.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:40:28.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:40:28.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:40:28.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:40:28.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:40:28.769 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:40:28.769 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T15:40:28.769 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T15:40:28.770 INFO:tasks.workunit.client.0.smithi065.stderr:4' 2020-09-08T15:40:28.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:40:28.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:40:28.770 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:40:28.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836496 2020-09-08T15:40:28.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836496 2020-09-08T15:40:28.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836496' 2020-09-08T15:40:28.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:40:28.902 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:40:29.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672974 2020-09-08T15:40:29.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672974 2020-09-08T15:40:29.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836496 1-42949672974' 2020-09-08T15:40:29.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:40:29.037 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:40:29.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509452 2020-09-08T15:40:29.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509452 2020-09-08T15:40:29.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836496 1-42949672974 2-64424509452' 2020-09-08T15:40:29.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:40:29.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T15:40:29.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345931 2020-09-08T15:40:29.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345931 2020-09-08T15:40:29.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836496 1-42949672974 2-64424509452 3-85899345931' 2020-09-08T15:40:29.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:40:29.302 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T15:40:29.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182409 2020-09-08T15:40:29.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182409 2020-09-08T15:40:29.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836496 1-42949672974 2-64424509452 3-85899345931 4-107374182409' 2020-09-08T15:40:29.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:40:29.434 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836496 2020-09-08T15:40:29.434 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:40:29.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:40:29.436 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836496 2020-09-08T15:40:29.436 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:40:29.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836496 2020-09-08T15:40:29.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836496' 2020-09-08T15:40:29.437 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:40:29.437 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836496 2020-09-08T15:40:29.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836496 -lt 21474836496 2020-09-08T15:40:29.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:40:29.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672974 2020-09-08T15:40:29.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:40:29.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:40:29.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672974 2020-09-08T15:40:29.833 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:40:29.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672974 2020-09-08T15:40:29.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672974' 2020-09-08T15:40:29.834 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:40:29.834 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672974 2020-09-08T15:40:30.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672974 -lt 42949672974 2020-09-08T15:40:30.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:40:30.227 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509452 2020-09-08T15:40:30.228 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:40:30.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:40:30.228 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509452 2020-09-08T15:40:30.229 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:40:30.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509452 2020-09-08T15:40:30.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509452' 2020-09-08T15:40:30.230 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:40:30.230 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509452 2020-09-08T15:40:30.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509450 -lt 64424509452 2020-09-08T15:40:30.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:40:31.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:40:31.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:40:32.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509453 -lt 64424509452 2020-09-08T15:40:32.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:40:32.034 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345931 2020-09-08T15:40:32.034 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:40:32.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T15:40:32.035 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345931 2020-09-08T15:40:32.035 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:40:32.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345931 2020-09-08T15:40:32.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345931' 2020-09-08T15:40:32.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T15:40:32.037 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345931 2020-09-08T15:40:32.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345931 -lt 85899345931 2020-09-08T15:40:32.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:40:32.434 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182409 2020-09-08T15:40:32.434 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:40:32.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T15:40:32.435 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182409 2020-09-08T15:40:32.436 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:40:32.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182409 2020-09-08T15:40:32.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182409' 2020-09-08T15:40:32.436 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T15:40:32.437 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182409 2020-09-08T15:40:32.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182409 -lt 107374182409 2020-09-08T15:40:32.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:40:32.840 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:40:32.840 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:40:33.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 10 == 0 2020-09-08T15:40:33.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:40:33.395 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:40:33.395 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:40:33.395 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:40:33.395 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:40:33.396 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:40:33.396 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:40:33.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=10 2020-09-08T15:40:33.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:40:33.787 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:40:33.787 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:40:34.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 10 = 10 2020-09-08T15:40:34.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:40:34.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:40:34.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:71: TEST_backfill_priority: ceph pg dump pgs 2020-09-08T15:40:34.687 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:40:34.687 INFO:tasks.workunit.client.0.smithi065.stdout:10.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:40:23.758728+0000 0'0 81:19 [2,1] 2 [2,1] 2 0'0 2020-09-08T15:40:20.935027+0000 0'0 2020-09-08T15:40:20.935027+0000 0 2020-09-08T15:40:34.688 INFO:tasks.workunit.client.0.smithi065.stdout:9.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:40:21.560473+0000 0'0 80:26 [1,2] 1 [1,2] 1 0'0 2020-09-08T15:40:17.985240+0000 0'0 2020-09-08T15:40:17.985240+0000 0 2020-09-08T15:40:34.688 INFO:tasks.workunit.client.0.smithi065.stdout:8.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:40:18.488783+0000 0'0 80:22 [3,4] 3 [3,4] 3 0'0 2020-09-08T15:40:15.215763+0000 0'0 2020-09-08T15:40:15.215763+0000 0 2020-09-08T15:40:34.688 INFO:tasks.workunit.client.0.smithi065.stdout:7.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:40:15.568379+0000 0'0 80:33 [1,4] 1 [1,4] 1 0'0 2020-09-08T15:40:12.298606+0000 0'0 2020-09-08T15:40:12.298606+0000 0 2020-09-08T15:40:34.688 INFO:tasks.workunit.client.0.smithi065.stdout:2.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:40:02.357286+0000 0'0 80:45 [3,1] 3 [3,1] 3 0'0 2020-09-08T15:39:59.195795+0000 0'0 2020-09-08T15:39:59.195795+0000 0 2020-09-08T15:40:34.689 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:39:59.732362+0000 0'0 80:52 [1,0] 1 [1,0] 1 0'0 2020-09-08T15:39:56.706146+0000 0'0 2020-09-08T15:39:56.706146+0000 0 2020-09-08T15:40:34.689 INFO:tasks.workunit.client.0.smithi065.stdout:3.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:40:05.087186+0000 0'0 80:44 [1,2] 1 [1,2] 1 0'0 2020-09-08T15:40:01.870430+0000 0'0 2020-09-08T15:40:01.870430+0000 0 2020-09-08T15:40:34.689 INFO:tasks.workunit.client.0.smithi065.stdout:4.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:40:07.975478+0000 0'0 79:41 [4,0] 4 [4,0] 4 0'0 2020-09-08T15:40:04.592920+0000 0'0 2020-09-08T15:40:04.592920+0000 0 2020-09-08T15:40:34.689 INFO:tasks.workunit.client.0.smithi065.stdout:5.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:40:09.665659+0000 0'0 80:33 [3,4] 3 [3,4] 3 0'0 2020-09-08T15:40:07.194289+0000 0'0 2020-09-08T15:40:07.194289+0000 0 2020-09-08T15:40:34.689 INFO:tasks.workunit.client.0.smithi065.stdout:6.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:40:13.750576+0000 0'0 79:34 [4,2] 4 [4,2] 4 0'0 2020-09-08T15:40:09.731226+0000 0'0 2020-09-08T15:40:09.731226+0000 0 2020-09-08T15:40:34.690 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:40:34.690 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:40:34.690 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:40:34.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:75: TEST_backfill_priority: local PG1 2020-09-08T15:40:34.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:76: TEST_backfill_priority: local POOLNUM1 2020-09-08T15:40:34.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:77: TEST_backfill_priority: local pool1 2020-09-08T15:40:34.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:78: TEST_backfill_priority: local chk_osd1_1 2020-09-08T15:40:34.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:79: TEST_backfill_priority: local chk_osd1_2 2020-09-08T15:40:34.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:81: TEST_backfill_priority: local PG2 2020-09-08T15:40:34.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:82: TEST_backfill_priority: local POOLNUM2 2020-09-08T15:40:34.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:83: TEST_backfill_priority: local pool2 2020-09-08T15:40:34.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:84: TEST_backfill_priority: local chk_osd2 2020-09-08T15:40:34.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:86: TEST_backfill_priority: local PG3 2020-09-08T15:40:34.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:87: TEST_backfill_priority: local POOLNUM3 2020-09-08T15:40:34.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:88: TEST_backfill_priority: local pool3 2020-09-08T15:40:34.701 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:90: TEST_backfill_priority: seq 1 10 2020-09-08T15:40:34.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:90: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:34.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:92: TEST_backfill_priority: ceph pg map 1.0 --format=json 2020-09-08T15:40:34.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:92: TEST_backfill_priority: jq '.acting[]' 2020-09-08T15:40:35.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:93: TEST_backfill_priority: head -1 td/osd-backfill-prio/acting 2020-09-08T15:40:35.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:93: TEST_backfill_priority: local test_osd1=1 2020-09-08T15:40:35.087 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:94: TEST_backfill_priority: tail -1 td/osd-backfill-prio/acting 2020-09-08T15:40:35.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:94: TEST_backfill_priority: local test_osd2=0 2020-09-08T15:40:35.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:95: TEST_backfill_priority: '[' -z '' ']' 2020-09-08T15:40:35.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:97: TEST_backfill_priority: PG1=1.0 2020-09-08T15:40:35.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:98: TEST_backfill_priority: POOLNUM1=1 2020-09-08T15:40:35.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:99: TEST_backfill_priority: pool1=test1 2020-09-08T15:40:35.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:100: TEST_backfill_priority: chk_osd1_1=1 2020-09-08T15:40:35.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:101: TEST_backfill_priority: chk_osd1_2=0 2020-09-08T15:40:35.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:90: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:35.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:92: TEST_backfill_priority: ceph pg map 2.0 --format=json 2020-09-08T15:40:35.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:92: TEST_backfill_priority: jq '.acting[]' 2020-09-08T15:40:35.484 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:93: TEST_backfill_priority: head -1 td/osd-backfill-prio/acting 2020-09-08T15:40:35.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:93: TEST_backfill_priority: local test_osd1=3 2020-09-08T15:40:35.485 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:94: TEST_backfill_priority: tail -1 td/osd-backfill-prio/acting 2020-09-08T15:40:35.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:94: TEST_backfill_priority: local test_osd2=1 2020-09-08T15:40:35.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:95: TEST_backfill_priority: '[' -z 1.0 ']' 2020-09-08T15:40:35.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:102: TEST_backfill_priority: '[' -z '' -a 1 = 3 -a 0 '!=' 1 ']' 2020-09-08T15:40:35.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:108: TEST_backfill_priority: '[' -n '' -a 1 = 3 -a 0 '!=' 1 -a '' '!=' 1 ']' 2020-09-08T15:40:35.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:90: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:35.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:92: TEST_backfill_priority: ceph pg map 3.0 --format=json 2020-09-08T15:40:35.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:92: TEST_backfill_priority: jq '.acting[]' 2020-09-08T15:40:35.888 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:93: TEST_backfill_priority: head -1 td/osd-backfill-prio/acting 2020-09-08T15:40:35.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:93: TEST_backfill_priority: local test_osd1=1 2020-09-08T15:40:35.889 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:94: TEST_backfill_priority: tail -1 td/osd-backfill-prio/acting 2020-09-08T15:40:35.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:94: TEST_backfill_priority: local test_osd2=2 2020-09-08T15:40:35.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:95: TEST_backfill_priority: '[' -z 1.0 ']' 2020-09-08T15:40:35.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:102: TEST_backfill_priority: '[' -z '' -a 1 = 1 -a 0 '!=' 2 ']' 2020-09-08T15:40:35.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:104: TEST_backfill_priority: PG2=3.0 2020-09-08T15:40:35.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:105: TEST_backfill_priority: POOLNUM2=3 2020-09-08T15:40:35.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:106: TEST_backfill_priority: pool2=test3 2020-09-08T15:40:35.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:107: TEST_backfill_priority: chk_osd2=2 2020-09-08T15:40:35.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:90: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:35.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:92: TEST_backfill_priority: ceph pg map 4.0 --format=json 2020-09-08T15:40:35.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:92: TEST_backfill_priority: jq '.acting[]' 2020-09-08T15:40:36.280 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:93: TEST_backfill_priority: head -1 td/osd-backfill-prio/acting 2020-09-08T15:40:36.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:93: TEST_backfill_priority: local test_osd1=4 2020-09-08T15:40:36.281 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:94: TEST_backfill_priority: tail -1 td/osd-backfill-prio/acting 2020-09-08T15:40:36.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:94: TEST_backfill_priority: local test_osd2=0 2020-09-08T15:40:36.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:95: TEST_backfill_priority: '[' -z 1.0 ']' 2020-09-08T15:40:36.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:102: TEST_backfill_priority: '[' -z 3.0 -a 1 = 4 -a 0 '!=' 0 ']' 2020-09-08T15:40:36.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:108: TEST_backfill_priority: '[' -n 3.0 -a 1 = 4 -a 0 '!=' 0 -a 2 '!=' 0 ']' 2020-09-08T15:40:36.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:90: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:36.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:92: TEST_backfill_priority: ceph pg map 5.0 --format=json 2020-09-08T15:40:36.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:92: TEST_backfill_priority: jq '.acting[]' 2020-09-08T15:40:36.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:93: TEST_backfill_priority: head -1 td/osd-backfill-prio/acting 2020-09-08T15:40:36.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:93: TEST_backfill_priority: local test_osd1=3 2020-09-08T15:40:36.671 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:94: TEST_backfill_priority: tail -1 td/osd-backfill-prio/acting 2020-09-08T15:40:36.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:94: TEST_backfill_priority: local test_osd2=4 2020-09-08T15:40:36.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:95: TEST_backfill_priority: '[' -z 1.0 ']' 2020-09-08T15:40:36.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:102: TEST_backfill_priority: '[' -z 3.0 -a 1 = 3 -a 0 '!=' 4 ']' 2020-09-08T15:40:36.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:108: TEST_backfill_priority: '[' -n 3.0 -a 1 = 3 -a 0 '!=' 4 -a 2 '!=' 4 ']' 2020-09-08T15:40:36.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:90: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:36.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:92: TEST_backfill_priority: ceph pg map 6.0 --format=json 2020-09-08T15:40:36.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:92: TEST_backfill_priority: jq '.acting[]' 2020-09-08T15:40:37.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:93: TEST_backfill_priority: head -1 td/osd-backfill-prio/acting 2020-09-08T15:40:37.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:93: TEST_backfill_priority: local test_osd1=4 2020-09-08T15:40:37.059 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:94: TEST_backfill_priority: tail -1 td/osd-backfill-prio/acting 2020-09-08T15:40:37.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:94: TEST_backfill_priority: local test_osd2=2 2020-09-08T15:40:37.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:95: TEST_backfill_priority: '[' -z 1.0 ']' 2020-09-08T15:40:37.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:102: TEST_backfill_priority: '[' -z 3.0 -a 1 = 4 -a 0 '!=' 2 ']' 2020-09-08T15:40:37.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:108: TEST_backfill_priority: '[' -n 3.0 -a 1 = 4 -a 0 '!=' 2 -a 2 '!=' 2 ']' 2020-09-08T15:40:37.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:90: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:37.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:92: TEST_backfill_priority: ceph pg map 7.0 --format=json 2020-09-08T15:40:37.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:92: TEST_backfill_priority: jq '.acting[]' 2020-09-08T15:40:37.479 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:93: TEST_backfill_priority: head -1 td/osd-backfill-prio/acting 2020-09-08T15:40:37.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:93: TEST_backfill_priority: local test_osd1=1 2020-09-08T15:40:37.480 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:94: TEST_backfill_priority: tail -1 td/osd-backfill-prio/acting 2020-09-08T15:40:37.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:94: TEST_backfill_priority: local test_osd2=4 2020-09-08T15:40:37.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:95: TEST_backfill_priority: '[' -z 1.0 ']' 2020-09-08T15:40:37.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:102: TEST_backfill_priority: '[' -z 3.0 -a 1 = 1 -a 0 '!=' 4 ']' 2020-09-08T15:40:37.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:108: TEST_backfill_priority: '[' -n 3.0 -a 1 = 1 -a 0 '!=' 4 -a 2 '!=' 4 ']' 2020-09-08T15:40:37.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:110: TEST_backfill_priority: PG3=7.0 2020-09-08T15:40:37.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:111: TEST_backfill_priority: POOLNUM3=7 2020-09-08T15:40:37.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:112: TEST_backfill_priority: pool3=test7 2020-09-08T15:40:37.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:113: TEST_backfill_priority: break 2020-09-08T15:40:37.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:116: TEST_backfill_priority: rm -f td/osd-backfill-prio/acting 2020-09-08T15:40:37.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:118: TEST_backfill_priority: '[' test3 = '' -o pool3 = '' ']' 2020-09-08T15:40:37.483 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:124: TEST_backfill_priority: seq 1 10 2020-09-08T15:40:37.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:124: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:37.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:126: TEST_backfill_priority: '[' 1 '!=' 1 -a 1 '!=' 3 -a 1 '!=' 7 ']' 2020-09-08T15:40:37.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:124: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:37.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:126: TEST_backfill_priority: '[' 2 '!=' 1 -a 2 '!=' 3 -a 2 '!=' 7 ']' 2020-09-08T15:40:37.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:128: TEST_backfill_priority: delete_pool test2 2020-09-08T15:40:37.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test2 2020-09-08T15:40:37.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test2 test2 --yes-i-really-really-mean-it 2020-09-08T15:40:38.036 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test2' does not exist 2020-09-08T15:40:38.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:124: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:38.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:126: TEST_backfill_priority: '[' 3 '!=' 1 -a 3 '!=' 3 -a 3 '!=' 7 ']' 2020-09-08T15:40:38.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:124: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:38.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:126: TEST_backfill_priority: '[' 4 '!=' 1 -a 4 '!=' 3 -a 4 '!=' 7 ']' 2020-09-08T15:40:38.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:128: TEST_backfill_priority: delete_pool test4 2020-09-08T15:40:38.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test4 2020-09-08T15:40:38.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test4 test4 --yes-i-really-really-mean-it 2020-09-08T15:40:38.658 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test4' does not exist 2020-09-08T15:40:38.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:124: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:38.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:126: TEST_backfill_priority: '[' 5 '!=' 1 -a 5 '!=' 3 -a 5 '!=' 7 ']' 2020-09-08T15:40:38.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:128: TEST_backfill_priority: delete_pool test5 2020-09-08T15:40:38.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test5 2020-09-08T15:40:38.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test5 test5 --yes-i-really-really-mean-it 2020-09-08T15:40:39.216 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test5' does not exist 2020-09-08T15:40:39.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:124: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:39.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:126: TEST_backfill_priority: '[' 6 '!=' 1 -a 6 '!=' 3 -a 6 '!=' 7 ']' 2020-09-08T15:40:39.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:128: TEST_backfill_priority: delete_pool test6 2020-09-08T15:40:39.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test6 2020-09-08T15:40:39.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test6 test6 --yes-i-really-really-mean-it 2020-09-08T15:40:39.761 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test6' does not exist 2020-09-08T15:40:39.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:124: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:39.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:126: TEST_backfill_priority: '[' 7 '!=' 1 -a 7 '!=' 3 -a 7 '!=' 7 ']' 2020-09-08T15:40:39.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:124: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:39.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:126: TEST_backfill_priority: '[' 8 '!=' 1 -a 8 '!=' 3 -a 8 '!=' 7 ']' 2020-09-08T15:40:39.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:128: TEST_backfill_priority: delete_pool test8 2020-09-08T15:40:39.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test8 2020-09-08T15:40:39.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test8 test8 --yes-i-really-really-mean-it 2020-09-08T15:40:40.336 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test8' does not exist 2020-09-08T15:40:40.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:124: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:40.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:126: TEST_backfill_priority: '[' 9 '!=' 1 -a 9 '!=' 3 -a 9 '!=' 7 ']' 2020-09-08T15:40:40.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:128: TEST_backfill_priority: delete_pool test9 2020-09-08T15:40:40.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test9 2020-09-08T15:40:40.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test9 test9 --yes-i-really-really-mean-it 2020-09-08T15:40:40.882 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test9' does not exist 2020-09-08T15:40:40.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:124: TEST_backfill_priority: for p in $(seq 1 $pools) 2020-09-08T15:40:40.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:126: TEST_backfill_priority: '[' 10 '!=' 1 -a 10 '!=' 3 -a 10 '!=' 7 ']' 2020-09-08T15:40:40.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:128: TEST_backfill_priority: delete_pool test10 2020-09-08T15:40:40.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test10 2020-09-08T15:40:40.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test10 test10 --yes-i-really-really-mean-it 2020-09-08T15:40:41.476 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test10' does not exist 2020-09-08T15:40:41.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:132: TEST_backfill_priority: ceph osd pool set test3 size 1 --yes-i-really-mean-it 2020-09-08T15:40:42.187 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 3 size to 1 2020-09-08T15:40:42.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:133: TEST_backfill_priority: ceph osd pool set test7 size 1 --yes-i-really-mean-it 2020-09-08T15:40:42.864 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 7 size to 1 2020-09-08T15:40:42.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:134: TEST_backfill_priority: wait_for_clean 2020-09-08T15:40:42.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:40:42.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:40:42.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:40:42.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:40:42.875 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T15:40:42.876 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:40:42.876 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:40:42.876 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:40:42.877 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:40:42.877 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:40:42.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:40:42.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:40:42.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:40:42.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:40:42.971 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:40:43.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:40:43.405 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:40:43.405 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T15:40:43.406 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T15:40:43.406 INFO:tasks.workunit.client.0.smithi065.stderr:4' 2020-09-08T15:40:43.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:40:43.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:40:43.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:40:43.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836501 2020-09-08T15:40:43.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836501 2020-09-08T15:40:43.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836501' 2020-09-08T15:40:43.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:40:43.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:40:43.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672979 2020-09-08T15:40:43.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672979 2020-09-08T15:40:43.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836501 1-42949672979' 2020-09-08T15:40:43.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:40:43.701 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:40:43.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509457 2020-09-08T15:40:43.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509457 2020-09-08T15:40:43.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836501 1-42949672979 2-64424509457' 2020-09-08T15:40:43.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:40:43.834 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T15:40:43.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345936 2020-09-08T15:40:43.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345936 2020-09-08T15:40:43.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836501 1-42949672979 2-64424509457 3-85899345936' 2020-09-08T15:40:43.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:40:43.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T15:40:44.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182414 2020-09-08T15:40:44.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182414 2020-09-08T15:40:44.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836501 1-42949672979 2-64424509457 3-85899345936 4-107374182414' 2020-09-08T15:40:44.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:40:44.100 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836501 2020-09-08T15:40:44.100 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:40:44.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:40:44.101 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836501 2020-09-08T15:40:44.101 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:40:44.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836501 2020-09-08T15:40:44.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836501' 2020-09-08T15:40:44.102 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:40:44.102 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836501 2020-09-08T15:40:44.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836499 -lt 21474836501 2020-09-08T15:40:44.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:40:45.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:40:45.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:40:45.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836501 -lt 21474836501 2020-09-08T15:40:45.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:40:45.908 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672979 2020-09-08T15:40:45.908 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:40:45.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:40:45.909 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672979 2020-09-08T15:40:45.909 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:40:45.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672979 2020-09-08T15:40:45.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672979' 2020-09-08T15:40:45.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:40:45.911 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672979 2020-09-08T15:40:46.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672979 -lt 42949672979 2020-09-08T15:40:46.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:40:46.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509457 2020-09-08T15:40:46.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:40:46.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:40:46.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509457 2020-09-08T15:40:46.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:40:46.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509457 2020-09-08T15:40:46.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509457' 2020-09-08T15:40:46.324 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:40:46.324 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509457 2020-09-08T15:40:46.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509458 -lt 64424509457 2020-09-08T15:40:46.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:40:46.732 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345936 2020-09-08T15:40:46.732 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:40:46.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T15:40:46.733 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345936 2020-09-08T15:40:46.733 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:40:46.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345936 2020-09-08T15:40:46.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345936' 2020-09-08T15:40:46.734 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T15:40:46.734 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345936 2020-09-08T15:40:47.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345936 -lt 85899345936 2020-09-08T15:40:47.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:40:47.150 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182414 2020-09-08T15:40:47.150 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:40:47.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T15:40:47.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182414 2020-09-08T15:40:47.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:40:47.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182414 2020-09-08T15:40:47.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182414' 2020-09-08T15:40:47.152 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T15:40:47.152 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182414 2020-09-08T15:40:47.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182415 -lt 107374182414 2020-09-08T15:40:47.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:40:47.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:40:47.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:40:48.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 3 == 0 2020-09-08T15:40:48.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:40:48.118 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:40:48.119 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:40:48.119 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:40:48.119 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:40:48.119 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:40:48.119 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:40:48.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=3 2020-09-08T15:40:48.517 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:40:48.517 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:40:48.518 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:40:49.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 3 = 3 2020-09-08T15:40:49.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:40:49.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:40:49.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:136: TEST_backfill_priority: dd if=/dev/urandom of=td/osd-backfill-prio/data bs=1M count=10 2020-09-08T15:40:49.079 INFO:tasks.workunit.client.0.smithi065.stderr:10+0 records in 2020-09-08T15:40:49.079 INFO:tasks.workunit.client.0.smithi065.stderr:10+0 records out 2020-09-08T15:40:49.079 INFO:tasks.workunit.client.0.smithi065.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0445028 s, 236 MB/s 2020-09-08T15:40:49.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:137: TEST_backfill_priority: p=1 2020-09-08T15:40:49.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:138: TEST_backfill_priority: for pname in $pool1 $pool2 $pool3 2020-09-08T15:40:49.080 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: seq 1 50 2020-09-08T15:40:49.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:40:49.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj1-p1 td/osd-backfill-prio/data 2020-09-08T15:40:49.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:40:49.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj2-p1 td/osd-backfill-prio/data 2020-09-08T15:40:50.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:40:50.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj3-p1 td/osd-backfill-prio/data 2020-09-08T15:40:50.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:40:50.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj4-p1 td/osd-backfill-prio/data 2020-09-08T15:40:51.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:40:51.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj5-p1 td/osd-backfill-prio/data 2020-09-08T15:40:51.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:40:51.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj6-p1 td/osd-backfill-prio/data 2020-09-08T15:40:52.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:40:52.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj7-p1 td/osd-backfill-prio/data 2020-09-08T15:40:52.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:40:52.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj8-p1 td/osd-backfill-prio/data 2020-09-08T15:40:54.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:40:54.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj9-p1 td/osd-backfill-prio/data 2020-09-08T15:40:54.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:40:54.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj10-p1 td/osd-backfill-prio/data 2020-09-08T15:40:55.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:40:55.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj11-p1 td/osd-backfill-prio/data 2020-09-08T15:40:55.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:40:55.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj12-p1 td/osd-backfill-prio/data 2020-09-08T15:40:56.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:40:56.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj13-p1 td/osd-backfill-prio/data 2020-09-08T15:40:57.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:40:57.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj14-p1 td/osd-backfill-prio/data 2020-09-08T15:40:58.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:40:58.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj15-p1 td/osd-backfill-prio/data 2020-09-08T15:40:58.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:40:58.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj16-p1 td/osd-backfill-prio/data 2020-09-08T15:40:59.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:40:59.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj17-p1 td/osd-backfill-prio/data 2020-09-08T15:41:00.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:00.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj18-p1 td/osd-backfill-prio/data 2020-09-08T15:41:00.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:00.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj19-p1 td/osd-backfill-prio/data 2020-09-08T15:41:01.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:01.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj20-p1 td/osd-backfill-prio/data 2020-09-08T15:41:01.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:01.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj21-p1 td/osd-backfill-prio/data 2020-09-08T15:41:02.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:02.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj22-p1 td/osd-backfill-prio/data 2020-09-08T15:41:03.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:03.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj23-p1 td/osd-backfill-prio/data 2020-09-08T15:41:04.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:04.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj24-p1 td/osd-backfill-prio/data 2020-09-08T15:41:05.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:05.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj25-p1 td/osd-backfill-prio/data 2020-09-08T15:41:06.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:06.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj26-p1 td/osd-backfill-prio/data 2020-09-08T15:41:06.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:06.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj27-p1 td/osd-backfill-prio/data 2020-09-08T15:41:07.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:07.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj28-p1 td/osd-backfill-prio/data 2020-09-08T15:41:07.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:07.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj29-p1 td/osd-backfill-prio/data 2020-09-08T15:41:08.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:08.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj30-p1 td/osd-backfill-prio/data 2020-09-08T15:41:09.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:09.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj31-p1 td/osd-backfill-prio/data 2020-09-08T15:41:10.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:10.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj32-p1 td/osd-backfill-prio/data 2020-09-08T15:41:10.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:10.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj33-p1 td/osd-backfill-prio/data 2020-09-08T15:41:11.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:11.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj34-p1 td/osd-backfill-prio/data 2020-09-08T15:41:12.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:12.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj35-p1 td/osd-backfill-prio/data 2020-09-08T15:41:13.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:13.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj36-p1 td/osd-backfill-prio/data 2020-09-08T15:41:13.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:13.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj37-p1 td/osd-backfill-prio/data 2020-09-08T15:41:14.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:14.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj38-p1 td/osd-backfill-prio/data 2020-09-08T15:41:15.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:15.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj39-p1 td/osd-backfill-prio/data 2020-09-08T15:41:15.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:15.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj40-p1 td/osd-backfill-prio/data 2020-09-08T15:41:16.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:16.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj41-p1 td/osd-backfill-prio/data 2020-09-08T15:41:16.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:16.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj42-p1 td/osd-backfill-prio/data 2020-09-08T15:41:17.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:17.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj43-p1 td/osd-backfill-prio/data 2020-09-08T15:41:18.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:18.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj44-p1 td/osd-backfill-prio/data 2020-09-08T15:41:19.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:19.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj45-p1 td/osd-backfill-prio/data 2020-09-08T15:41:19.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:19.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj46-p1 td/osd-backfill-prio/data 2020-09-08T15:41:20.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:20.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj47-p1 td/osd-backfill-prio/data 2020-09-08T15:41:22.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:22.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj48-p1 td/osd-backfill-prio/data 2020-09-08T15:41:22.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:22.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj49-p1 td/osd-backfill-prio/data 2020-09-08T15:41:23.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:23.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test1 put obj50-p1 td/osd-backfill-prio/data 2020-09-08T15:41:24.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:144: TEST_backfill_priority: expr 1 + 1 2020-09-08T15:41:24.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:144: TEST_backfill_priority: p=2 2020-09-08T15:41:24.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:138: TEST_backfill_priority: for pname in $pool1 $pool2 $pool3 2020-09-08T15:41:24.616 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: seq 1 50 2020-09-08T15:41:24.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:24.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj1-p2 td/osd-backfill-prio/data 2020-09-08T15:41:24.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:24.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj2-p2 td/osd-backfill-prio/data 2020-09-08T15:41:25.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:25.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj3-p2 td/osd-backfill-prio/data 2020-09-08T15:41:25.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:25.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj4-p2 td/osd-backfill-prio/data 2020-09-08T15:41:25.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:25.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj5-p2 td/osd-backfill-prio/data 2020-09-08T15:41:26.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:26.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj6-p2 td/osd-backfill-prio/data 2020-09-08T15:41:26.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:26.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj7-p2 td/osd-backfill-prio/data 2020-09-08T15:41:27.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:27.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj8-p2 td/osd-backfill-prio/data 2020-09-08T15:41:27.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:27.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj9-p2 td/osd-backfill-prio/data 2020-09-08T15:41:28.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:28.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj10-p2 td/osd-backfill-prio/data 2020-09-08T15:41:28.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:28.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj11-p2 td/osd-backfill-prio/data 2020-09-08T15:41:28.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:28.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj12-p2 td/osd-backfill-prio/data 2020-09-08T15:41:28.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:28.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj13-p2 td/osd-backfill-prio/data 2020-09-08T15:41:29.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:29.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj14-p2 td/osd-backfill-prio/data 2020-09-08T15:41:29.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:29.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj15-p2 td/osd-backfill-prio/data 2020-09-08T15:41:30.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:30.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj16-p2 td/osd-backfill-prio/data 2020-09-08T15:41:30.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:30.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj17-p2 td/osd-backfill-prio/data 2020-09-08T15:41:31.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:31.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj18-p2 td/osd-backfill-prio/data 2020-09-08T15:41:31.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:31.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj19-p2 td/osd-backfill-prio/data 2020-09-08T15:41:31.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:31.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj20-p2 td/osd-backfill-prio/data 2020-09-08T15:41:31.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:31.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj21-p2 td/osd-backfill-prio/data 2020-09-08T15:41:33.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:33.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj22-p2 td/osd-backfill-prio/data 2020-09-08T15:41:33.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:33.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj23-p2 td/osd-backfill-prio/data 2020-09-08T15:41:34.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:34.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj24-p2 td/osd-backfill-prio/data 2020-09-08T15:41:34.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:34.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj25-p2 td/osd-backfill-prio/data 2020-09-08T15:41:34.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:34.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj26-p2 td/osd-backfill-prio/data 2020-09-08T15:41:35.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:35.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj27-p2 td/osd-backfill-prio/data 2020-09-08T15:41:35.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:35.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj28-p2 td/osd-backfill-prio/data 2020-09-08T15:41:35.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:35.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj29-p2 td/osd-backfill-prio/data 2020-09-08T15:41:36.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:36.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj30-p2 td/osd-backfill-prio/data 2020-09-08T15:41:36.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:36.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj31-p2 td/osd-backfill-prio/data 2020-09-08T15:41:37.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:37.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj32-p2 td/osd-backfill-prio/data 2020-09-08T15:41:37.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:37.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj33-p2 td/osd-backfill-prio/data 2020-09-08T15:41:37.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:37.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj34-p2 td/osd-backfill-prio/data 2020-09-08T15:41:38.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:38.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj35-p2 td/osd-backfill-prio/data 2020-09-08T15:41:38.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:38.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj36-p2 td/osd-backfill-prio/data 2020-09-08T15:41:38.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:38.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj37-p2 td/osd-backfill-prio/data 2020-09-08T15:41:39.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:39.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj38-p2 td/osd-backfill-prio/data 2020-09-08T15:41:39.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:39.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj39-p2 td/osd-backfill-prio/data 2020-09-08T15:41:40.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:40.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj40-p2 td/osd-backfill-prio/data 2020-09-08T15:41:40.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:40.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj41-p2 td/osd-backfill-prio/data 2020-09-08T15:41:40.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:40.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj42-p2 td/osd-backfill-prio/data 2020-09-08T15:41:41.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:41.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj43-p2 td/osd-backfill-prio/data 2020-09-08T15:41:41.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:41.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj44-p2 td/osd-backfill-prio/data 2020-09-08T15:41:42.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:42.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj45-p2 td/osd-backfill-prio/data 2020-09-08T15:41:43.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:43.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj46-p2 td/osd-backfill-prio/data 2020-09-08T15:41:44.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:44.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj47-p2 td/osd-backfill-prio/data 2020-09-08T15:41:44.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:44.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj48-p2 td/osd-backfill-prio/data 2020-09-08T15:41:46.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:46.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj49-p2 td/osd-backfill-prio/data 2020-09-08T15:41:46.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:46.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test3 put obj50-p2 td/osd-backfill-prio/data 2020-09-08T15:41:47.115 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:144: TEST_backfill_priority: expr 2 + 1 2020-09-08T15:41:47.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:144: TEST_backfill_priority: p=3 2020-09-08T15:41:47.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:138: TEST_backfill_priority: for pname in $pool1 $pool2 $pool3 2020-09-08T15:41:47.116 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: seq 1 50 2020-09-08T15:41:47.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:47.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj1-p3 td/osd-backfill-prio/data 2020-09-08T15:41:47.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:47.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj2-p3 td/osd-backfill-prio/data 2020-09-08T15:41:47.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:47.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj3-p3 td/osd-backfill-prio/data 2020-09-08T15:41:48.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:48.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj4-p3 td/osd-backfill-prio/data 2020-09-08T15:41:49.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:49.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj5-p3 td/osd-backfill-prio/data 2020-09-08T15:41:49.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:49.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj6-p3 td/osd-backfill-prio/data 2020-09-08T15:41:49.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:49.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj7-p3 td/osd-backfill-prio/data 2020-09-08T15:41:50.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:50.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj8-p3 td/osd-backfill-prio/data 2020-09-08T15:41:50.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:50.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj9-p3 td/osd-backfill-prio/data 2020-09-08T15:41:50.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:50.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj10-p3 td/osd-backfill-prio/data 2020-09-08T15:41:51.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:51.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj11-p3 td/osd-backfill-prio/data 2020-09-08T15:41:51.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:51.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj12-p3 td/osd-backfill-prio/data 2020-09-08T15:41:52.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:52.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj13-p3 td/osd-backfill-prio/data 2020-09-08T15:41:52.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:52.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj14-p3 td/osd-backfill-prio/data 2020-09-08T15:41:52.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:52.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj15-p3 td/osd-backfill-prio/data 2020-09-08T15:41:53.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:53.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj16-p3 td/osd-backfill-prio/data 2020-09-08T15:41:53.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:53.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj17-p3 td/osd-backfill-prio/data 2020-09-08T15:41:53.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:53.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj18-p3 td/osd-backfill-prio/data 2020-09-08T15:41:55.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:55.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj19-p3 td/osd-backfill-prio/data 2020-09-08T15:41:55.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:55.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj20-p3 td/osd-backfill-prio/data 2020-09-08T15:41:55.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:55.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj21-p3 td/osd-backfill-prio/data 2020-09-08T15:41:56.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:56.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj22-p3 td/osd-backfill-prio/data 2020-09-08T15:41:56.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:56.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj23-p3 td/osd-backfill-prio/data 2020-09-08T15:41:56.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:56.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj24-p3 td/osd-backfill-prio/data 2020-09-08T15:41:57.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:57.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj25-p3 td/osd-backfill-prio/data 2020-09-08T15:41:57.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:57.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj26-p3 td/osd-backfill-prio/data 2020-09-08T15:41:58.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:58.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj27-p3 td/osd-backfill-prio/data 2020-09-08T15:41:58.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:58.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj28-p3 td/osd-backfill-prio/data 2020-09-08T15:41:58.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:58.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj29-p3 td/osd-backfill-prio/data 2020-09-08T15:41:59.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:59.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj30-p3 td/osd-backfill-prio/data 2020-09-08T15:41:59.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:59.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj31-p3 td/osd-backfill-prio/data 2020-09-08T15:41:59.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:41:59.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj32-p3 td/osd-backfill-prio/data 2020-09-08T15:42:00.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:42:00.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj33-p3 td/osd-backfill-prio/data 2020-09-08T15:42:00.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:42:00.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj34-p3 td/osd-backfill-prio/data 2020-09-08T15:42:01.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:42:01.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj35-p3 td/osd-backfill-prio/data 2020-09-08T15:42:01.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:42:01.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj36-p3 td/osd-backfill-prio/data 2020-09-08T15:42:01.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:42:01.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj37-p3 td/osd-backfill-prio/data 2020-09-08T15:42:02.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:42:02.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj38-p3 td/osd-backfill-prio/data 2020-09-08T15:42:02.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:42:02.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj39-p3 td/osd-backfill-prio/data 2020-09-08T15:42:02.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:42:02.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj40-p3 td/osd-backfill-prio/data 2020-09-08T15:42:03.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:42:03.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj41-p3 td/osd-backfill-prio/data 2020-09-08T15:42:03.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:42:03.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj42-p3 td/osd-backfill-prio/data 2020-09-08T15:42:05.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:42:05.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj43-p3 td/osd-backfill-prio/data 2020-09-08T15:42:05.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:42:05.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj44-p3 td/osd-backfill-prio/data 2020-09-08T15:42:05.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:42:05.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj45-p3 td/osd-backfill-prio/data 2020-09-08T15:42:06.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:42:06.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj46-p3 td/osd-backfill-prio/data 2020-09-08T15:42:06.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:42:06.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj47-p3 td/osd-backfill-prio/data 2020-09-08T15:42:06.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:42:06.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj48-p3 td/osd-backfill-prio/data 2020-09-08T15:42:06.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:42:06.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj49-p3 td/osd-backfill-prio/data 2020-09-08T15:42:07.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:140: TEST_backfill_priority: for i in $(seq 1 $objects) 2020-09-08T15:42:07.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:142: TEST_backfill_priority: rados -p test7 put obj50-p3 td/osd-backfill-prio/data 2020-09-08T15:42:07.488 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:144: TEST_backfill_priority: expr 3 + 1 2020-09-08T15:42:07.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:144: TEST_backfill_priority: p=4 2020-09-08T15:42:07.490 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:147: TEST_backfill_priority: get_not_primary test1 obj1-p1 2020-09-08T15:42:07.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1167: get_not_primary: local poolname=test1 2020-09-08T15:42:07.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: get_not_primary: local objectname=obj1-p1 2020-09-08T15:42:07.491 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: get_primary test1 obj1-p1 2020-09-08T15:42:07.491 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test1 2020-09-08T15:42:07.491 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1-p1 2020-09-08T15:42:07.492 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test1 obj1-p1 2020-09-08T15:42:07.492 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T15:42:08.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: local primary=1 2020-09-08T15:42:08.056 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1171: get_not_primary: ceph --format json osd map test1 obj1-p1 2020-09-08T15:42:08.056 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1172: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2020-09-08T15:42:08.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:147: TEST_backfill_priority: local otherosd=0 2020-09-08T15:42:08.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:149: TEST_backfill_priority: ceph pg dump pgs 2020-09-08T15:42:08.859 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:42:08.860 INFO:tasks.workunit.client.0.smithi065.stdout:7.0 43 0 0 0 0 450887680 0 0 29 29 active+clean 2020-09-08T15:40:43.498193+0000 93'129 93:174 [1] 1 [1] 1 0'0 2020-09-08T15:40:12.298606+0000 0'0 2020-09-08T15:40:12.298606+0000 0 2020-09-08T15:42:08.860 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 50 0 0 0 0 524288000 0 0 50 50 active+clean 2020-09-08T15:39:59.732362+0000 93'150 93:207 [1,0] 1 [1,0] 1 0'0 2020-09-08T15:39:56.706146+0000 0'0 2020-09-08T15:39:56.706146+0000 0 2020-09-08T15:42:08.860 INFO:tasks.workunit.client.0.smithi065.stdout:3.0 50 0 0 0 0 524288000 0 0 50 50 active+clean 2020-09-08T15:40:43.563175+0000 93'150 93:206 [1] 1 [1] 1 0'0 2020-09-08T15:40:01.870430+0000 0'0 2020-09-08T15:40:01.870430+0000 0 2020-09-08T15:42:08.860 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:42:08.860 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:42:08.861 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:42:08.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:150: TEST_backfill_priority: ERRORS=0 2020-09-08T15:42:08.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:152: TEST_backfill_priority: ceph osd set nobackfill 2020-09-08T15:42:09.633 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is set 2020-09-08T15:42:09.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:153: TEST_backfill_priority: ceph osd set noout 2020-09-08T15:42:10.388 INFO:tasks.workunit.client.0.smithi065.stderr:noout is set 2020-09-08T15:42:10.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:157: TEST_backfill_priority: ceph osd pool set test7 size 2 2020-09-08T15:42:11.097 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 7 size to 2 2020-09-08T15:42:11.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:158: TEST_backfill_priority: sleep 2 2020-09-08T15:42:13.108 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:160: TEST_backfill_priority: get_asok_path osd.1 2020-09-08T15:42:13.108 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-09-08T15:42:13.109 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-09-08T15:42:13.109 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:42:13.109 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:42:13.109 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:42:13.109 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83246/ceph-osd.1.asok 2020-09-08T15:42:13.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:160: TEST_backfill_priority: CEPH_ARGS= 2020-09-08T15:42:13.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:160: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:42:13.212 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:42:13.213 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:42:13.213 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:42:13.213 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:42:13.214 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:42:13.214 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:42:13.214 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:13.214 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:42:13.214 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:42:13.215 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:42:13.215 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:13.215 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:42:13.215 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:42:13.215 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:42:13.216 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:42:13.216 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:42:13.216 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:42:13.216 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:42:13.216 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:13.216 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:42:13.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:163: TEST_backfill_priority: seq 1 10 2020-09-08T15:42:13.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:163: TEST_backfill_priority: for i in $(seq 1 $max_tries) 2020-09-08T15:42:13.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:165: TEST_backfill_priority: ceph pg force-backfill 7.0 2020-09-08T15:42:13.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:165: TEST_backfill_priority: grep -q 'doesn'\''t require backfilling' 2020-09-08T15:42:13.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:168: TEST_backfill_priority: '[' 1 = 10 ']' 2020-09-08T15:42:13.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:172: TEST_backfill_priority: sleep 2 2020-09-08T15:42:15.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:163: TEST_backfill_priority: for i in $(seq 1 $max_tries) 2020-09-08T15:42:15.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:165: TEST_backfill_priority: ceph pg force-backfill 7.0 2020-09-08T15:42:15.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:165: TEST_backfill_priority: grep -q 'doesn'\''t require backfilling' 2020-09-08T15:42:16.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:168: TEST_backfill_priority: '[' 2 = 10 ']' 2020-09-08T15:42:16.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:172: TEST_backfill_priority: sleep 2 2020-09-08T15:42:18.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:163: TEST_backfill_priority: for i in $(seq 1 $max_tries) 2020-09-08T15:42:18.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:165: TEST_backfill_priority: ceph pg force-backfill 7.0 2020-09-08T15:42:18.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:165: TEST_backfill_priority: grep -q 'doesn'\''t require backfilling' 2020-09-08T15:42:18.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:166: TEST_backfill_priority: break 2020-09-08T15:42:18.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:174: TEST_backfill_priority: flush_pg_stats 2020-09-08T15:42:18.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:42:18.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:42:18.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:42:18.834 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:42:18.834 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T15:42:18.834 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T15:42:18.835 INFO:tasks.workunit.client.0.smithi065.stderr:4' 2020-09-08T15:42:18.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:42:18.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:18.835 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:42:18.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836522 2020-09-08T15:42:18.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836522 2020-09-08T15:42:18.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836522' 2020-09-08T15:42:18.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:18.974 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:42:19.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949673000 2020-09-08T15:42:19.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949673000 2020-09-08T15:42:19.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836522 1-42949673000' 2020-09-08T15:42:19.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:19.108 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:42:19.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509478 2020-09-08T15:42:19.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509478 2020-09-08T15:42:19.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836522 1-42949673000 2-64424509478' 2020-09-08T15:42:19.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:19.274 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T15:42:19.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345957 2020-09-08T15:42:19.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345957 2020-09-08T15:42:19.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836522 1-42949673000 2-64424509478 3-85899345957' 2020-09-08T15:42:19.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:19.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T15:42:19.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182435 2020-09-08T15:42:19.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182435 2020-09-08T15:42:19.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836522 1-42949673000 2-64424509478 3-85899345957 4-107374182435' 2020-09-08T15:42:19.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:19.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836522 2020-09-08T15:42:19.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:19.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:42:19.570 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836522 2020-09-08T15:42:19.570 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:19.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836522 2020-09-08T15:42:19.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836522' 2020-09-08T15:42:19.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:42:19.572 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836522 2020-09-08T15:42:19.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836522 -lt 21474836522 2020-09-08T15:42:19.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:19.958 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949673000 2020-09-08T15:42:19.959 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:19.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:42:19.960 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949673000 2020-09-08T15:42:19.961 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:19.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949673000 2020-09-08T15:42:19.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949673000' 2020-09-08T15:42:19.961 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:42:19.962 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949673000 2020-09-08T15:42:20.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949673000 -lt 42949673000 2020-09-08T15:42:20.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:20.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509478 2020-09-08T15:42:20.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:20.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:42:20.371 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509478 2020-09-08T15:42:20.371 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:20.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509478 2020-09-08T15:42:20.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509478' 2020-09-08T15:42:20.373 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:42:20.373 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509478 2020-09-08T15:42:20.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509476 -lt 64424509478 2020-09-08T15:42:20.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:42:21.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:42:21.768 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:42:22.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509479 -lt 64424509478 2020-09-08T15:42:22.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:22.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345957 2020-09-08T15:42:22.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:22.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T15:42:22.176 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345957 2020-09-08T15:42:22.176 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:22.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345957 2020-09-08T15:42:22.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345957' 2020-09-08T15:42:22.177 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T15:42:22.177 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345957 2020-09-08T15:42:22.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345957 -lt 85899345957 2020-09-08T15:42:22.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:22.573 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182435 2020-09-08T15:42:22.573 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:22.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T15:42:22.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182435 2020-09-08T15:42:22.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:22.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182435 2020-09-08T15:42:22.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182435' 2020-09-08T15:42:22.575 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T15:42:22.575 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182435 2020-09-08T15:42:22.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182435 -lt 107374182435 2020-09-08T15:42:22.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:175: TEST_backfill_priority: get_asok_path osd.1 2020-09-08T15:42:22.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-09-08T15:42:22.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-09-08T15:42:22.993 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:42:22.993 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:42:22.993 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:42:22.993 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83246/ceph-osd.1.asok 2020-09-08T15:42:22.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:175: TEST_backfill_priority: CEPH_ARGS= 2020-09-08T15:42:22.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:175: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:42:23.085 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:42:23.085 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:42:23.085 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:42:23.086 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:42:23.086 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:42:23.086 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:42:23.086 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:23.086 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:42:23.087 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:42:23.087 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:42:23.087 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:23.087 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:42:23.087 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:42:23.088 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:42:23.088 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:42:23.088 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:42:23.088 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:42:23.088 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:42:23.088 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:23.089 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:42:23.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:177: TEST_backfill_priority: ceph osd out osd.0 2020-09-08T15:42:23.637 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already out. 2020-09-08T15:42:23.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:178: TEST_backfill_priority: sleep 2 2020-09-08T15:42:25.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:179: TEST_backfill_priority: flush_pg_stats 2020-09-08T15:42:25.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:42:25.647 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:42:26.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:42:26.054 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:42:26.055 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T15:42:26.055 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T15:42:26.055 INFO:tasks.workunit.client.0.smithi065.stderr:4' 2020-09-08T15:42:26.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:42:26.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:26.056 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:42:26.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836525 2020-09-08T15:42:26.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836525 2020-09-08T15:42:26.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836525' 2020-09-08T15:42:26.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:26.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:42:26.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949673004 2020-09-08T15:42:26.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949673004 2020-09-08T15:42:26.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836525 1-42949673004' 2020-09-08T15:42:26.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:26.346 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:42:26.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509482 2020-09-08T15:42:26.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509482 2020-09-08T15:42:26.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836525 1-42949673004 2-64424509482' 2020-09-08T15:42:26.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:26.479 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T15:42:26.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345960 2020-09-08T15:42:26.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345960 2020-09-08T15:42:26.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836525 1-42949673004 2-64424509482 3-85899345960' 2020-09-08T15:42:26.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:26.612 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T15:42:26.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182439 2020-09-08T15:42:26.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182439 2020-09-08T15:42:26.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836525 1-42949673004 2-64424509482 3-85899345960 4-107374182439' 2020-09-08T15:42:26.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:26.752 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836525 2020-09-08T15:42:26.752 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:26.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:42:26.752 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836525 2020-09-08T15:42:26.753 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:26.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836525 2020-09-08T15:42:26.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836525' 2020-09-08T15:42:26.754 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:42:26.754 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836525 2020-09-08T15:42:27.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 0 -lt 21474836525 2020-09-08T15:42:27.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:42:28.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:42:28.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:42:28.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836526 -lt 21474836525 2020-09-08T15:42:28.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:28.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949673004 2020-09-08T15:42:28.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:28.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:42:28.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949673004 2020-09-08T15:42:28.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:28.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949673004 2020-09-08T15:42:28.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949673004' 2020-09-08T15:42:28.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:42:28.557 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949673004 2020-09-08T15:42:28.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949673004 -lt 42949673004 2020-09-08T15:42:28.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:28.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509482 2020-09-08T15:42:28.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:28.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:42:28.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509482 2020-09-08T15:42:28.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:28.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509482 2020-09-08T15:42:28.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509482' 2020-09-08T15:42:28.987 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:42:28.987 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509482 2020-09-08T15:42:29.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509482 -lt 64424509482 2020-09-08T15:42:29.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:29.419 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345960 2020-09-08T15:42:29.419 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:29.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T15:42:29.420 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345960 2020-09-08T15:42:29.420 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:29.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345960 2020-09-08T15:42:29.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345960' 2020-09-08T15:42:29.421 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T15:42:29.421 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345960 2020-09-08T15:42:29.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345961 -lt 85899345960 2020-09-08T15:42:29.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:29.815 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182439 2020-09-08T15:42:29.815 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:29.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T15:42:29.815 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182439 2020-09-08T15:42:29.816 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:29.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182439 2020-09-08T15:42:29.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182439' 2020-09-08T15:42:29.816 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T15:42:29.816 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182439 2020-09-08T15:42:30.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182439 -lt 107374182439 2020-09-08T15:42:30.226 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:180: TEST_backfill_priority: get_asok_path osd.1 2020-09-08T15:42:30.227 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-09-08T15:42:30.227 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-09-08T15:42:30.227 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:42:30.227 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:42:30.227 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:42:30.228 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83246/ceph-osd.1.asok 2020-09-08T15:42:30.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:180: TEST_backfill_priority: CEPH_ARGS= 2020-09-08T15:42:30.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:180: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:42:30.319 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:42:30.319 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:42:30.319 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:42:30.320 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:42:30.320 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:42:30.320 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:30.320 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:42:30.320 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:42:30.321 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:30.321 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:42:30.321 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:42:30.322 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:42:30.322 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:30.322 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:42:30.322 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:30.323 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:42:30.323 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:42:30.323 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:30.323 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:42:30.324 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:42:30.324 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:42:30.324 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:30.325 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:42:30.325 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:42:30.325 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:42:30.325 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:42:30.326 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:42:30.327 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:42:30.327 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:42:30.327 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:30.328 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:42:30.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:181: TEST_backfill_priority: ceph pg dump pgs 2020-09-08T15:42:30.700 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:42:30.701 INFO:tasks.workunit.client.0.smithi065.stdout:7.0 50 0 50 0 0 524288000 0 0 50 50 active+undersized+degraded+remapped+backfilling+forced_backfill 2020-09-08T15:42:18.291361+0000 93'150 105:215 [1,4] 1 [1] 1 0'0 2020-09-08T15:40:12.298606+0000 0'0 2020-09-08T15:40:12.298606+0000 0 2020-09-08T15:42:30.701 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 50 0 0 50 0 524288000 0 0 50 50 active+remapped+backfill_wait 2020-09-08T15:42:24.999011+0000 93'150 106:225 [1,2] 1 [1,0] 1 0'0 2020-09-08T15:39:56.706146+0000 0'0 2020-09-08T15:39:56.706146+0000 0 2020-09-08T15:42:30.701 INFO:tasks.workunit.client.0.smithi065.stdout:3.0 50 0 0 0 0 524288000 0 0 50 50 active+clean 2020-09-08T15:40:43.563175+0000 93'150 105:216 [1] 1 [1] 1 0'0 2020-09-08T15:40:01.870430+0000 0'0 2020-09-08T15:40:01.870430+0000 0 2020-09-08T15:42:30.702 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:42:30.702 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:42:30.702 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:42:30.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:183: TEST_backfill_priority: ceph osd pool set test3 size 2 2020-09-08T15:42:31.377 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 3 size to 2 2020-09-08T15:42:31.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:184: TEST_backfill_priority: sleep 2 2020-09-08T15:42:33.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:185: TEST_backfill_priority: flush_pg_stats 2020-09-08T15:42:33.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:42:33.388 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:42:33.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:42:33.824 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:42:33.824 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T15:42:33.824 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T15:42:33.825 INFO:tasks.workunit.client.0.smithi065.stderr:4' 2020-09-08T15:42:33.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:42:33.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:33.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:42:33.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836529 2020-09-08T15:42:33.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836529 2020-09-08T15:42:33.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836529' 2020-09-08T15:42:33.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:33.957 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:42:34.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949673007 2020-09-08T15:42:34.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949673007 2020-09-08T15:42:34.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836529 1-42949673007' 2020-09-08T15:42:34.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:34.090 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:42:34.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509485 2020-09-08T15:42:34.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509485 2020-09-08T15:42:34.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836529 1-42949673007 2-64424509485' 2020-09-08T15:42:34.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:34.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T15:42:34.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345964 2020-09-08T15:42:34.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345964 2020-09-08T15:42:34.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836529 1-42949673007 2-64424509485 3-85899345964' 2020-09-08T15:42:34.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:34.356 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T15:42:34.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182442 2020-09-08T15:42:34.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182442 2020-09-08T15:42:34.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836529 1-42949673007 2-64424509485 3-85899345964 4-107374182442' 2020-09-08T15:42:34.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:34.490 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836529 2020-09-08T15:42:34.490 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:34.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:42:34.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836529 2020-09-08T15:42:34.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:34.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836529 2020-09-08T15:42:34.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836529' 2020-09-08T15:42:34.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:42:34.492 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836529 2020-09-08T15:42:34.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836527 -lt 21474836529 2020-09-08T15:42:34.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:42:35.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:42:35.887 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:42:36.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836529 -lt 21474836529 2020-09-08T15:42:36.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:36.302 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949673007 2020-09-08T15:42:36.303 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:36.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:42:36.304 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949673007 2020-09-08T15:42:36.304 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:36.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949673007 2020-09-08T15:42:36.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949673007' 2020-09-08T15:42:36.305 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:42:36.305 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949673007 2020-09-08T15:42:36.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949673007 -lt 42949673007 2020-09-08T15:42:36.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:36.720 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509485 2020-09-08T15:42:36.720 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:36.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:42:36.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509485 2020-09-08T15:42:36.722 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:36.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509485 2020-09-08T15:42:36.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509485' 2020-09-08T15:42:36.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:42:36.723 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509485 2020-09-08T15:42:37.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509486 -lt 64424509485 2020-09-08T15:42:37.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:37.114 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345964 2020-09-08T15:42:37.115 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:37.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T15:42:37.116 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345964 2020-09-08T15:42:37.116 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:37.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345964 2020-09-08T15:42:37.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345964' 2020-09-08T15:42:37.117 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T15:42:37.117 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345964 2020-09-08T15:42:37.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345964 -lt 85899345964 2020-09-08T15:42:37.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:37.513 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182442 2020-09-08T15:42:37.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:37.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T15:42:37.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182442 2020-09-08T15:42:37.516 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:37.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182442 2020-09-08T15:42:37.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182442' 2020-09-08T15:42:37.517 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T15:42:37.517 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182442 2020-09-08T15:42:37.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182443 -lt 107374182442 2020-09-08T15:42:37.919 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:186: TEST_backfill_priority: get_asok_path osd.1 2020-09-08T15:42:37.919 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-09-08T15:42:37.919 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-09-08T15:42:37.920 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:42:37.920 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:42:37.920 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:42:37.920 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83246/ceph-osd.1.asok 2020-09-08T15:42:37.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:186: TEST_backfill_priority: CEPH_ARGS= 2020-09-08T15:42:37.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:186: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:42:38.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:187: TEST_backfill_priority: cat td/osd-backfill-prio/out 2020-09-08T15:42:38.019 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:42:38.019 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:42:38.019 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:42:38.019 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:42:38.020 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:42:38.020 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:38.020 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:42:38.022 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:42:38.026 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:38.026 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:42:38.027 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:42:38.027 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:42:38.027 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:38.027 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:42:38.027 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:42:38.028 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:38.028 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 151, 2020-09-08T15:42:38.028 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:42:38.028 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:38.028 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:42:38.029 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:42:38.029 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:42:38.029 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:38.029 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:42:38.029 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:38.030 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:42:38.030 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:42:38.030 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:38.030 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:42:38.030 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:42:38.030 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:42:38.031 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:38.031 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:42:38.033 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:42:38.033 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:42:38.034 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:42:38.034 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:42:38.034 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:42:38.034 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:42:38.034 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:38.035 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:42:38.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:188: TEST_backfill_priority: ceph pg dump pgs 2020-09-08T15:42:38.390 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:42:38.391 INFO:tasks.workunit.client.0.smithi065.stdout:7.0 50 0 50 0 0 524288000 0 0 50 50 active+undersized+degraded+remapped+backfilling+forced_backfill 2020-09-08T15:42:18.291361+0000 93'150 109:218 [1,4] 1 [1] 1 0'0 2020-09-08T15:40:12.298606+0000 0'0 2020-09-08T15:40:12.298606+0000 0 2020-09-08T15:42:38.391 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 50 0 0 50 0 524288000 0 0 50 50 active+remapped+backfill_wait 2020-09-08T15:42:24.999011+0000 93'150 109:228 [1,2] 1 [1,0] 1 0'0 2020-09-08T15:39:56.706146+0000 0'0 2020-09-08T15:39:56.706146+0000 0 2020-09-08T15:42:38.391 INFO:tasks.workunit.client.0.smithi065.stdout:3.0 50 0 50 0 0 524288000 0 0 50 50 active+undersized+degraded+remapped+backfill_wait 2020-09-08T15:42:33.745772+0000 93'150 110:226 [1,2] 1 [1] 1 0'0 2020-09-08T15:40:01.870430+0000 0'0 2020-09-08T15:40:01.870430+0000 0 2020-09-08T15:42:38.391 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:42:38.391 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:42:38.392 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:42:38.401 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:190: TEST_backfill_priority: cat td/osd-backfill-prio/out 2020-09-08T15:42:38.401 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:190: TEST_backfill_priority: jq '(.local_reservations.queues[].items[] | select(.item == "1.0")).prio' 2020-09-08T15:42:38.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:190: TEST_backfill_priority: PRIO=110 2020-09-08T15:42:38.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:191: TEST_backfill_priority: '[' 110 '!=' 110 ']' 2020-09-08T15:42:38.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:198: TEST_backfill_priority: cat td/osd-backfill-prio/out 2020-09-08T15:42:38.405 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:198: TEST_backfill_priority: jq '.local_reservations.in_progress[0].item' 2020-09-08T15:42:38.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:198: TEST_backfill_priority: eval 'ITEM="7.0"' 2020-09-08T15:42:38.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:198: TEST_backfill_priority: ITEM=7.0 2020-09-08T15:42:38.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:199: TEST_backfill_priority: '[' 7.0 '!=' 7.0 ']' 2020-09-08T15:42:38.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:204: TEST_backfill_priority: cat td/osd-backfill-prio/out 2020-09-08T15:42:38.408 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:204: TEST_backfill_priority: jq '.local_reservations.in_progress[0].prio' 2020-09-08T15:42:38.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:204: TEST_backfill_priority: PRIO=254 2020-09-08T15:42:38.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:205: TEST_backfill_priority: '[' 254 '!=' 254 ']' 2020-09-08T15:42:38.410 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:213: TEST_backfill_priority: seq 1 10 2020-09-08T15:42:38.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:213: TEST_backfill_priority: for i in $(seq 1 $max_tries) 2020-09-08T15:42:38.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:215: TEST_backfill_priority: ceph pg force-backfill 3.0 2020-09-08T15:42:38.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:215: TEST_backfill_priority: grep -q 'doesn'\''t require backfilling' 2020-09-08T15:42:38.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:216: TEST_backfill_priority: break 2020-09-08T15:42:38.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:224: TEST_backfill_priority: sleep 2 2020-09-08T15:42:40.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:225: TEST_backfill_priority: get_asok_path osd.1 2020-09-08T15:42:40.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-09-08T15:42:40.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-09-08T15:42:40.823 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:42:40.823 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:42:40.823 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:42:40.824 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83246/ceph-osd.1.asok 2020-09-08T15:42:40.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:225: TEST_backfill_priority: CEPH_ARGS= 2020-09-08T15:42:40.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:225: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:42:40.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:226: TEST_backfill_priority: cat td/osd-backfill-prio/out 2020-09-08T15:42:40.933 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:42:40.933 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:42:40.933 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:42:40.933 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:42:40.934 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:42:40.934 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:40.934 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:42:40.934 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:42:40.934 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:40.935 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:42:40.935 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:42:40.935 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:42:40.935 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:40.935 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:42:40.936 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:42:40.936 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:40.936 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 254, 2020-09-08T15:42:40.936 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:42:40.936 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:40.937 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:42:40.937 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:42:40.937 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:42:40.937 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:40.937 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:42:40.938 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:40.938 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:42:40.938 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:42:40.938 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:40.938 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:42:40.939 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:42:40.939 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:42:40.939 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:40.939 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:42:40.939 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:42:40.939 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:42:40.940 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:42:40.940 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:42:40.940 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:42:40.943 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:42:40.943 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:40.944 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:42:40.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:227: TEST_backfill_priority: cat td/osd-backfill-prio/out 2020-09-08T15:42:40.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:227: TEST_backfill_priority: jq '(.local_reservations.queues[].items[] | select(.item == "3.0")).prio' 2020-09-08T15:42:40.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:227: TEST_backfill_priority: PRIO=254 2020-09-08T15:42:40.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:228: TEST_backfill_priority: '[' 254 '!=' 254 ']' 2020-09-08T15:42:40.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:233: TEST_backfill_priority: flush_pg_stats 2020-09-08T15:42:40.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:42:40.946 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:42:41.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:42:41.355 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:42:41.355 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T15:42:41.356 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T15:42:41.356 INFO:tasks.workunit.client.0.smithi065.stderr:4' 2020-09-08T15:42:41.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:42:41.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:41.356 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:42:41.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836532 2020-09-08T15:42:41.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836532 2020-09-08T15:42:41.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836532' 2020-09-08T15:42:41.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:41.489 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:42:41.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949673011 2020-09-08T15:42:41.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949673011 2020-09-08T15:42:41.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836532 1-42949673011' 2020-09-08T15:42:41.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:41.622 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:42:41.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509489 2020-09-08T15:42:41.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509489 2020-09-08T15:42:41.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836532 1-42949673011 2-64424509489' 2020-09-08T15:42:41.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:41.763 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T15:42:41.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345967 2020-09-08T15:42:41.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345967 2020-09-08T15:42:41.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836532 1-42949673011 2-64424509489 3-85899345967' 2020-09-08T15:42:41.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:41.887 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T15:42:42.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182446 2020-09-08T15:42:42.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182446 2020-09-08T15:42:42.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836532 1-42949673011 2-64424509489 3-85899345967 4-107374182446' 2020-09-08T15:42:42.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:42.020 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836532 2020-09-08T15:42:42.021 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:42.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:42:42.022 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836532 2020-09-08T15:42:42.022 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:42.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836532 2020-09-08T15:42:42.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836532' 2020-09-08T15:42:42.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:42:42.023 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836532 2020-09-08T15:42:42.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836530 -lt 21474836532 2020-09-08T15:42:42.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:42:43.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:42:43.419 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:42:43.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836533 -lt 21474836532 2020-09-08T15:42:43.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:43.823 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949673011 2020-09-08T15:42:43.824 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:43.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:42:43.824 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949673011 2020-09-08T15:42:43.825 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:43.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949673011 2020-09-08T15:42:43.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949673011' 2020-09-08T15:42:43.826 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:42:43.826 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949673011 2020-09-08T15:42:44.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949673011 -lt 42949673011 2020-09-08T15:42:44.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:44.239 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509489 2020-09-08T15:42:44.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:44.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:42:44.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509489 2020-09-08T15:42:44.241 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:44.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509489 2020-09-08T15:42:44.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509489' 2020-09-08T15:42:44.242 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:42:44.242 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509489 2020-09-08T15:42:44.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509489 -lt 64424509489 2020-09-08T15:42:44.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:44.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345967 2020-09-08T15:42:44.650 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:44.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T15:42:44.651 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345967 2020-09-08T15:42:44.651 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:44.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345967 2020-09-08T15:42:44.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345967' 2020-09-08T15:42:44.652 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T15:42:44.652 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345967 2020-09-08T15:42:45.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345967 -lt 85899345967 2020-09-08T15:42:45.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:45.042 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182446 2020-09-08T15:42:45.043 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:45.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T15:42:45.043 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182446 2020-09-08T15:42:45.044 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:45.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182446 2020-09-08T15:42:45.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182446' 2020-09-08T15:42:45.045 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T15:42:45.045 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182446 2020-09-08T15:42:45.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182446 -lt 107374182446 2020-09-08T15:42:45.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:236: TEST_backfill_priority: ceph pg cancel-force-backfill 7.0 2020-09-08T15:42:45.868 INFO:tasks.workunit.client.0.smithi065.stderr:instructing pg(s) [7.0] on osd.1 to cancel-force-backfill; 2020-09-08T15:42:45.868 INFO:tasks.workunit.client.0.smithi065.stderr: 2020-09-08T15:42:45.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:237: TEST_backfill_priority: sleep 2 2020-09-08T15:42:47.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:238: TEST_backfill_priority: get_asok_path osd.1 2020-09-08T15:42:47.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-09-08T15:42:47.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-09-08T15:42:47.880 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:42:47.880 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:42:47.880 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:42:47.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83246/ceph-osd.1.asok 2020-09-08T15:42:47.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:238: TEST_backfill_priority: CEPH_ARGS= 2020-09-08T15:42:47.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:238: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:42:47.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:239: TEST_backfill_priority: cat td/osd-backfill-prio/out 2020-09-08T15:42:47.992 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:42:47.992 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:42:47.992 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:42:47.993 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:42:47.993 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:42:47.993 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:47.993 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:42:47.994 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:42:47.994 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:47.994 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:42:47.994 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:42:47.994 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:42:47.995 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:47.995 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:42:47.995 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:42:47.995 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:47.995 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 151, 2020-09-08T15:42:47.995 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:42:47.996 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:47.996 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:42:47.996 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:42:47.996 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:42:47.996 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:47.997 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:42:47.997 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:47.997 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:42:47.997 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:42:47.997 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:47.998 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:42:47.998 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:42:47.998 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:42:47.998 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:47.999 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:42:47.999 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:42:47.999 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:42:47.999 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:42:47.999 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:42:47.999 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:42:48.000 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:42:48.000 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:48.000 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:42:48.002 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:240: TEST_backfill_priority: cat td/osd-backfill-prio/out 2020-09-08T15:42:48.002 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:240: TEST_backfill_priority: jq '(.local_reservations.queues[].items[] | select(.item == "7.0")).prio' 2020-09-08T15:42:48.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:240: TEST_backfill_priority: PRIO=151 2020-09-08T15:42:48.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:241: TEST_backfill_priority: '[' 151 '!=' 151 ']' 2020-09-08T15:42:48.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:247: TEST_backfill_priority: cat td/osd-backfill-prio/out 2020-09-08T15:42:48.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:247: TEST_backfill_priority: jq '.local_reservations.in_progress[0].item' 2020-09-08T15:42:48.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:247: TEST_backfill_priority: eval 'ITEM="3.0"' 2020-09-08T15:42:48.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:247: TEST_backfill_priority: ITEM=3.0 2020-09-08T15:42:48.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:248: TEST_backfill_priority: '[' 3.0 '!=' 3.0 ']' 2020-09-08T15:42:48.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:253: TEST_backfill_priority: cat td/osd-backfill-prio/out 2020-09-08T15:42:48.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:253: TEST_backfill_priority: jq '.local_reservations.in_progress[0].prio' 2020-09-08T15:42:48.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:253: TEST_backfill_priority: PRIO=254 2020-09-08T15:42:48.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:254: TEST_backfill_priority: '[' 254 '!=' 254 ']' 2020-09-08T15:42:48.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:261: TEST_backfill_priority: ceph pg cancel-force-backfill 3.0 2020-09-08T15:42:48.382 INFO:tasks.workunit.client.0.smithi065.stderr:instructing pg(s) [3.0] on osd.1 to cancel-force-backfill; 2020-09-08T15:42:48.383 INFO:tasks.workunit.client.0.smithi065.stderr: 2020-09-08T15:42:48.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:262: TEST_backfill_priority: sleep 5 2020-09-08T15:42:53.393 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:263: TEST_backfill_priority: get_asok_path osd.1 2020-09-08T15:42:53.394 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-09-08T15:42:53.394 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-09-08T15:42:53.394 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:42:53.395 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:42:53.395 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:42:53.395 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83246/ceph-osd.1.asok 2020-09-08T15:42:53.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:263: TEST_backfill_priority: CEPH_ARGS= 2020-09-08T15:42:53.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:263: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:42:53.497 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:42:53.498 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:42:53.498 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:42:53.498 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:42:53.498 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:42:53.498 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:53.499 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:42:53.499 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:42:53.499 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:53.499 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:42:53.499 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:42:53.500 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:42:53.500 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:53.500 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:42:53.500 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:42:53.500 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:53.501 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 151, 2020-09-08T15:42:53.501 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:42:53.501 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:53.501 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:42:53.501 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:42:53.501 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:42:53.502 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:53.502 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:42:53.502 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:53.502 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:42:53.502 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:42:53.503 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:42:53.503 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:42:53.503 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:42:53.503 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:42:53.504 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:53.504 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:42:53.504 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:42:53.504 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:42:53.504 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:42:53.505 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:42:53.505 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:42:53.505 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:42:53.505 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:42:53.505 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:42:53.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:266: TEST_backfill_priority: flush_pg_stats 2020-09-08T15:42:53.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:42:53.506 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:42:53.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:42:53.903 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:42:53.903 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T15:42:53.903 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T15:42:53.903 INFO:tasks.workunit.client.0.smithi065.stderr:4' 2020-09-08T15:42:53.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:42:53.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:53.904 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:42:54.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836537 2020-09-08T15:42:54.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836537 2020-09-08T15:42:54.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836537' 2020-09-08T15:42:54.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:54.054 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:42:54.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949673015 2020-09-08T15:42:54.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949673015 2020-09-08T15:42:54.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836537 1-42949673015' 2020-09-08T15:42:54.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:54.195 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:42:54.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509493 2020-09-08T15:42:54.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509493 2020-09-08T15:42:54.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836537 1-42949673015 2-64424509493' 2020-09-08T15:42:54.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:54.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T15:42:54.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345972 2020-09-08T15:42:54.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345972 2020-09-08T15:42:54.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836537 1-42949673015 2-64424509493 3-85899345972' 2020-09-08T15:42:54.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:42:54.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T15:42:54.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182450 2020-09-08T15:42:54.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182450 2020-09-08T15:42:54.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836537 1-42949673015 2-64424509493 3-85899345972 4-107374182450' 2020-09-08T15:42:54.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:54.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836537 2020-09-08T15:42:54.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:54.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:42:54.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836537 2020-09-08T15:42:54.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:54.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836537 2020-09-08T15:42:54.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836537' 2020-09-08T15:42:54.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:42:54.592 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836537 2020-09-08T15:42:54.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836535 -lt 21474836537 2020-09-08T15:42:54.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:42:55.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:42:55.980 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:42:56.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836537 -lt 21474836537 2020-09-08T15:42:56.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:56.387 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949673015 2020-09-08T15:42:56.387 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:56.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:42:56.388 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949673015 2020-09-08T15:42:56.388 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:56.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949673015 2020-09-08T15:42:56.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949673015' 2020-09-08T15:42:56.390 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:42:56.390 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949673015 2020-09-08T15:42:56.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949673015 -lt 42949673015 2020-09-08T15:42:56.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:56.810 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509493 2020-09-08T15:42:56.811 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:56.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:42:56.811 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509493 2020-09-08T15:42:56.812 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:56.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509493 2020-09-08T15:42:56.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509493' 2020-09-08T15:42:56.813 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:42:56.813 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509493 2020-09-08T15:42:57.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509494 -lt 64424509493 2020-09-08T15:42:57.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:57.220 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345972 2020-09-08T15:42:57.221 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:57.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T15:42:57.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345972 2020-09-08T15:42:57.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:57.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345972 2020-09-08T15:42:57.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345972' 2020-09-08T15:42:57.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T15:42:57.223 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345972 2020-09-08T15:42:57.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345972 -lt 85899345972 2020-09-08T15:42:57.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:42:57.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182450 2020-09-08T15:42:57.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:42:57.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T15:42:57.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182450 2020-09-08T15:42:57.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:42:57.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182450 2020-09-08T15:42:57.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182450' 2020-09-08T15:42:57.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T15:42:57.665 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182450 2020-09-08T15:42:58.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182451 -lt 107374182450 2020-09-08T15:42:58.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:267: TEST_backfill_priority: ceph pg force-backfill 7.0 2020-09-08T15:42:58.454 INFO:tasks.workunit.client.0.smithi065.stderr:instructing pg(s) [7.0] on osd.1 to force-backfill; 2020-09-08T15:42:58.454 INFO:tasks.workunit.client.0.smithi065.stderr: 2020-09-08T15:42:58.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:268: TEST_backfill_priority: sleep 2 2020-09-08T15:43:00.465 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:270: TEST_backfill_priority: get_asok_path osd.1 2020-09-08T15:43:00.465 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-09-08T15:43:00.466 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-09-08T15:43:00.466 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:43:00.466 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:43:00.466 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:43:00.466 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83246/ceph-osd.1.asok 2020-09-08T15:43:00.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:270: TEST_backfill_priority: CEPH_ARGS= 2020-09-08T15:43:00.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:270: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:00.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:271: TEST_backfill_priority: cat td/osd-backfill-prio/out 2020-09-08T15:43:00.577 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:00.578 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:00.578 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:00.578 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:00.585 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:00.586 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:00.586 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:00.586 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:00.586 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:00.586 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:00.587 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:00.587 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:00.587 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:00.587 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:00.587 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:00.588 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:00.588 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 151, 2020-09-08T15:43:00.588 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:00.588 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:00.588 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:00.589 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:00.589 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:00.589 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:00.589 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:00.589 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:00.589 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:00.590 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:00.590 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:00.590 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:43:00.590 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:43:00.590 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:00.591 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:00.591 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:00.591 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:00.591 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:00.591 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:00.591 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:00.592 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:00.592 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:00.592 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:00.592 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:00.598 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:272: TEST_backfill_priority: cat td/osd-backfill-prio/out 2020-09-08T15:43:00.599 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:272: TEST_backfill_priority: jq '(.local_reservations.queues[].items[] | select(.item == "3.0")).prio' 2020-09-08T15:43:00.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:272: TEST_backfill_priority: PRIO=151 2020-09-08T15:43:00.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:273: TEST_backfill_priority: '[' 151 '!=' 151 ']' 2020-09-08T15:43:00.599 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:279: TEST_backfill_priority: cat td/osd-backfill-prio/out 2020-09-08T15:43:00.600 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:279: TEST_backfill_priority: jq '.local_reservations.in_progress[0].item' 2020-09-08T15:43:00.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:279: TEST_backfill_priority: eval 'ITEM="7.0"' 2020-09-08T15:43:00.600 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:279: TEST_backfill_priority: ITEM=7.0 2020-09-08T15:43:00.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:280: TEST_backfill_priority: '[' 7.0 '!=' 7.0 ']' 2020-09-08T15:43:00.600 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:285: TEST_backfill_priority: cat td/osd-backfill-prio/out 2020-09-08T15:43:00.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:285: TEST_backfill_priority: jq '.local_reservations.in_progress[0].prio' 2020-09-08T15:43:00.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:285: TEST_backfill_priority: PRIO=254 2020-09-08T15:43:00.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:286: TEST_backfill_priority: '[' 254 '!=' 254 ']' 2020-09-08T15:43:00.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:293: TEST_backfill_priority: ceph osd unset noout 2020-09-08T15:43:01.369 INFO:tasks.workunit.client.0.smithi065.stderr:noout is unset 2020-09-08T15:43:01.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:294: TEST_backfill_priority: ceph osd unset nobackfill 2020-09-08T15:43:02.187 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is unset 2020-09-08T15:43:02.196 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:296: TEST_backfill_priority: get_asok_path osd.1 2020-09-08T15:43:02.197 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-09-08T15:43:02.197 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-09-08T15:43:02.197 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:43:02.197 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:43:02.198 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:43:02.198 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83246/ceph-osd.1.asok 2020-09-08T15:43:02.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:296: TEST_backfill_priority: wait_for_clean 'CEPH_ARGS='\'''\'' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations' 2020-09-08T15:43:02.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local 'cmd=CEPH_ARGS='\'''\'' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations' 2020-09-08T15:43:02.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:43:02.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:43:02.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:43:02.200 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T15:43:02.201 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:43:02.201 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:43:02.201 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:43:02.201 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:43:02.201 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:43:02.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:43:02.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:43:02.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:43:02.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:43:02.296 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:43:02.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:43:02.689 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:43:02.689 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T15:43:02.689 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T15:43:02.690 INFO:tasks.workunit.client.0.smithi065.stderr:4' 2020-09-08T15:43:02.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:43:02.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:43:02.690 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:43:02.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836541 2020-09-08T15:43:02.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836541 2020-09-08T15:43:02.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836541' 2020-09-08T15:43:02.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:43:02.840 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:43:02.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949673019 2020-09-08T15:43:02.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949673019 2020-09-08T15:43:02.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836541 1-42949673019' 2020-09-08T15:43:02.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:43:02.979 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:43:03.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509497 2020-09-08T15:43:03.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509497 2020-09-08T15:43:03.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836541 1-42949673019 2-64424509497' 2020-09-08T15:43:03.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:43:03.106 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T15:43:03.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345975 2020-09-08T15:43:03.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345975 2020-09-08T15:43:03.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836541 1-42949673019 2-64424509497 3-85899345975' 2020-09-08T15:43:03.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:43:03.242 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T15:43:03.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182454 2020-09-08T15:43:03.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182454 2020-09-08T15:43:03.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836541 1-42949673019 2-64424509497 3-85899345975 4-107374182454' 2020-09-08T15:43:03.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:43:03.374 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836541 2020-09-08T15:43:03.374 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:43:03.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:43:03.375 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836541 2020-09-08T15:43:03.375 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:43:03.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836541 2020-09-08T15:43:03.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836541' 2020-09-08T15:43:03.376 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836541 2020-09-08T15:43:03.376 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:43:03.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836541 -lt 21474836541 2020-09-08T15:43:03.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:43:03.770 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949673019 2020-09-08T15:43:03.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:43:03.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:43:03.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949673019 2020-09-08T15:43:03.772 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:43:03.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949673019 2020-09-08T15:43:03.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949673019' 2020-09-08T15:43:03.773 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:43:03.773 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949673019 2020-09-08T15:43:04.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949673019 -lt 42949673019 2020-09-08T15:43:04.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:43:04.164 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509497 2020-09-08T15:43:04.164 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:43:04.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:43:04.165 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509497 2020-09-08T15:43:04.165 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:43:04.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509497 2020-09-08T15:43:04.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509497' 2020-09-08T15:43:04.166 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:43:04.167 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509497 2020-09-08T15:43:04.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509497 -lt 64424509497 2020-09-08T15:43:04.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:43:04.599 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345975 2020-09-08T15:43:04.599 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:43:04.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T15:43:04.600 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345975 2020-09-08T15:43:04.600 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:43:04.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345975 2020-09-08T15:43:04.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345975' 2020-09-08T15:43:04.602 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T15:43:04.609 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345975 2020-09-08T15:43:05.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345973 -lt 85899345975 2020-09-08T15:43:05.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:43:06.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:43:06.006 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T15:43:06.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345976 -lt 85899345975 2020-09-08T15:43:06.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:43:06.414 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182454 2020-09-08T15:43:06.415 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:43:06.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T15:43:06.415 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182454 2020-09-08T15:43:06.416 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:43:06.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182454 2020-09-08T15:43:06.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182454' 2020-09-08T15:43:06.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T15:43:06.417 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182454 2020-09-08T15:43:06.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182454 -lt 107374182454 2020-09-08T15:43:06.817 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:43:06.817 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:06.817 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:07.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 3 == 0 2020-09-08T15:43:07.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:07.339 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:07.348 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:07.348 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:07.348 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:07.349 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:07.349 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:07.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:43:07.729 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:07.729 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:07.730 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:08.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 3 2020-09-08T15:43:08.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T15:43:08.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T15:43:08.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T15:43:08.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:08.364 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:08.364 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:08.456 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:08.457 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:08.457 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:08.457 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:08.457 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:08.457 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:08.458 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:08.458 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:08.458 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:08.458 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:08.458 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:08.459 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:08.459 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:08.459 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:08.459 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:08.459 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:08.460 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 151, 2020-09-08T15:43:08.460 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:08.460 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:08.460 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:08.461 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:08.461 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:08.461 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:08.461 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:08.461 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:08.462 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:08.462 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:08.462 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:08.462 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:43:08.462 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:43:08.463 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:08.463 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:08.463 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:08.463 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:08.463 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:08.463 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:08.464 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:08.464 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:08.464 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:08.464 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:08.464 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:08.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:08.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:08.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:08.566 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:08.566 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:08.566 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:08.567 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:08.567 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:08.567 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:08.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:43:08.957 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:08.957 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:08.958 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:09.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 3 2020-09-08T15:43:09.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:43:09.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:09.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:09.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:09.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:09.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:09.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:09.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:10.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=1345783 2020-09-08T15:43:10.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 1345783 '!=' null 2020-09-08T15:43:10.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:10.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:10.039 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:10.039 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:10.136 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:10.137 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:10.137 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:10.137 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:10.137 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:10.138 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:10.138 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:10.138 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:10.138 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:10.138 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:10.139 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:10.139 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:10.139 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:10.139 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:10.139 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:10.140 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:10.140 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 151, 2020-09-08T15:43:10.140 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:10.140 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:10.140 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:10.140 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:10.141 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:10.141 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:10.141 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:10.141 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:10.141 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:10.142 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:10.142 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:10.142 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:43:10.142 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:43:10.142 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:10.142 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:10.143 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:10.143 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:10.143 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:10.143 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:10.143 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:10.144 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:10.144 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:10.144 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:10.144 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:10.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:10.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:10.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:10.239 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:10.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:10.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:10.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:10.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:10.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:10.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:43:10.625 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:10.625 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:10.626 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:11.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 3 2020-09-08T15:43:11.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:43:11.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:11.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:11.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:11.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:11.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:11.392 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:11.393 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:11.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=12414886 2020-09-08T15:43:11.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 12414886 '!=' null 2020-09-08T15:43:11.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:11.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:11.938 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:11.938 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:12.031 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:12.031 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:12.032 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:12.032 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:12.032 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:12.032 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:12.032 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:12.033 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:12.033 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:12.033 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:12.033 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:12.033 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:12.034 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:12.034 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:12.034 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:12.034 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:12.034 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 151, 2020-09-08T15:43:12.035 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:12.035 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:12.035 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:12.035 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:12.035 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:12.036 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:12.036 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:12.036 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:12.036 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:12.036 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:12.036 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:12.037 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:43:12.037 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:43:12.037 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:12.037 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:12.037 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:12.038 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:12.038 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:12.038 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:12.038 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:12.042 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:12.042 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:12.043 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:12.043 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:12.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:12.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:12.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:12.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:12.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:12.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:12.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:12.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:12.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:12.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:43:12.527 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:12.527 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:12.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:13.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 3 2020-09-08T15:43:13.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:43:13.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:13.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:13.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:13.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:13.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:13.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:13.056 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:13.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=10511284 2020-09-08T15:43:13.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 10511284 '!=' null 2020-09-08T15:43:13.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:13.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:13.589 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:13.590 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:13.680 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:13.681 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:13.681 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:13.681 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:13.682 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:13.682 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:13.682 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:13.682 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:13.682 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:13.683 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:13.683 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:13.683 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:13.683 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:13.683 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:13.684 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:13.684 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:13.684 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 151, 2020-09-08T15:43:13.684 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:13.684 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:13.685 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:13.685 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:13.685 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:13.685 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:13.685 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:13.687 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:13.687 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:13.687 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:13.687 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:13.687 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:43:13.688 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:43:13.688 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:13.688 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:13.688 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:13.689 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:13.689 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:13.689 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:13.689 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:13.689 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:13.690 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:13.690 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:13.690 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:13.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:13.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:13.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:13.791 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:13.791 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:13.792 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:13.792 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:13.792 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:13.792 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:14.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:43:14.173 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:14.174 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:14.174 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:14.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 3 2020-09-08T15:43:14.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:43:14.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:14.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:14.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:14.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:14.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:14.842 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:14.842 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:15.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=9610234 2020-09-08T15:43:15.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 9610234 '!=' null 2020-09-08T15:43:15.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:15.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:15.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:15.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:15.459 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:15.459 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:15.460 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:15.462 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:15.462 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:15.462 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:15.462 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:15.463 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:15.463 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:15.463 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:15.463 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:15.463 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:15.464 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:15.464 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:15.464 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:15.464 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:15.464 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 151, 2020-09-08T15:43:15.465 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:15.465 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:15.465 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:15.465 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:15.465 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:15.466 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:15.466 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:15.466 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:15.466 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:15.466 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:15.467 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:15.467 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:43:15.467 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:43:15.467 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:15.467 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:15.467 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:15.468 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:15.468 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:15.468 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:15.468 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:15.468 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:15.469 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:15.469 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:15.469 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:15.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:15.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:15.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:15.570 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:15.570 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:15.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:15.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:15.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:15.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:15.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:43:15.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:15.969 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:15.969 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:16.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 3 2020-09-08T15:43:16.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:43:16.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:16.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:16.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:16.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:16.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:16.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:16.501 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:17.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=9610234 2020-09-08T15:43:17.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 9610234 '!=' null 2020-09-08T15:43:17.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:17.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:17.026 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:17.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:17.117 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:17.118 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:17.118 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:17.118 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:17.118 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:17.119 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:17.119 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:17.119 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:17.119 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:17.119 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:17.120 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:17.120 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:17.120 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:17.120 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:17.120 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:17.121 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:17.121 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 151, 2020-09-08T15:43:17.121 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:17.121 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:17.121 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:17.121 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:17.122 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:17.122 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:17.122 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:17.122 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:17.123 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:17.123 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:17.123 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:17.123 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:43:17.123 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:43:17.124 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:17.124 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:17.124 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:17.124 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:17.124 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:17.125 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:17.125 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:17.125 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:17.125 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:17.126 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:17.126 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:17.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:17.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:17.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:17.227 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:17.228 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:17.228 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:17.228 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:17.228 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:17.229 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:17.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:43:17.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:17.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:17.615 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:18.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 3 2020-09-08T15:43:18.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:43:18.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:18.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:18.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:18.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:18.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:18.139 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:18.139 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:18.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=17473135 2020-09-08T15:43:18.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 17473135 '!=' null 2020-09-08T15:43:18.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:18.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:18.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:18.670 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:18.762 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:18.763 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:18.763 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:18.763 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:18.763 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:18.764 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:18.764 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:18.764 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:18.764 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:18.764 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:18.765 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:18.765 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:18.765 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:18.765 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:18.765 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:18.766 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:18.766 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 151, 2020-09-08T15:43:18.766 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:18.766 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:18.766 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:18.767 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:18.767 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:18.767 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:18.767 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:18.767 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:18.767 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:18.768 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:18.768 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:18.768 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:43:18.768 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:43:18.768 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:18.769 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:18.769 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:18.769 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:18.769 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:18.769 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:18.770 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:18.770 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:18.770 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:18.770 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:18.770 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:18.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:18.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:18.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:18.875 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:18.875 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:18.875 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:18.875 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:18.876 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:18.876 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:19.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:43:19.269 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:19.269 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:19.269 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:19.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 3 2020-09-08T15:43:19.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:43:19.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:19.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:19.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:19.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:19.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:19.798 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:19.798 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:20.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=16599498 2020-09-08T15:43:20.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 16599498 '!=' null 2020-09-08T15:43:20.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:20.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:20.505 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:20.505 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:20.597 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:20.598 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:20.598 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:20.598 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:20.598 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:20.598 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:20.599 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:20.599 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:20.599 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:20.599 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:20.600 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:20.600 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:20.600 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:20.600 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:20.601 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:20.601 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:20.601 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 151, 2020-09-08T15:43:20.601 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:20.601 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:20.602 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:20.602 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:20.602 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:20.602 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:20.603 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:20.603 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:20.603 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:20.603 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:20.603 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:20.604 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:43:20.604 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:43:20.604 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:20.605 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:20.606 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:20.606 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:20.606 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:20.606 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:20.607 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:20.608 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:20.608 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:20.608 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:20.608 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:20.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:20.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:20.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:20.707 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:20.707 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:20.707 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:20.708 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:20.708 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:20.708 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:21.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:43:21.094 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:21.095 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:21.095 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:21.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 3 2020-09-08T15:43:21.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:43:21.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:21.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:21.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:21.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:21.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:21.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:21.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:22.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=23588573 2020-09-08T15:43:22.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 23588573 '!=' null 2020-09-08T15:43:22.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:22.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:22.259 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:22.259 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:22.354 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:22.354 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:22.354 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:22.355 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:22.355 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:22.355 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:22.355 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:22.355 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:22.356 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:22.356 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:22.356 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:22.356 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:22.356 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:22.357 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:22.357 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:22.357 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:22.357 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 151, 2020-09-08T15:43:22.357 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:22.360 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:22.360 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:22.362 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:22.362 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:22.362 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:22.363 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:22.363 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:22.363 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:22.363 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:22.363 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:22.364 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:43:22.364 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:43:22.364 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:22.364 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:22.364 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:22.365 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:22.365 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:22.365 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:22.365 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:22.365 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:22.366 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:22.366 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:22.366 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:22.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:22.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:22.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:22.463 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:22.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:22.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:22.465 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:22.466 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:22.466 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:22.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:43:22.849 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:22.850 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:22.850 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:23.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 3 2020-09-08T15:43:23.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:43:23.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:23.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:23.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:23.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:23.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:23.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:23.533 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:24.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=14852102 2020-09-08T15:43:24.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 14852102 '!=' null 2020-09-08T15:43:24.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:24.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:24.089 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:24.089 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:24.180 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:24.181 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:24.181 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:24.181 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:24.182 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:24.182 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:24.182 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:24.183 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:24.183 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:24.183 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:24.183 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:24.184 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:24.184 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:24.184 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:24.184 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:24.184 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:24.185 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 151, 2020-09-08T15:43:24.185 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:24.185 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:24.185 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:24.186 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:24.186 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:24.186 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:24.186 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:24.186 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:24.190 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:24.190 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:24.191 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:24.191 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:43:24.191 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:43:24.191 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:24.191 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:24.192 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:24.192 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:24.192 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:24.192 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:24.192 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:24.193 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:24.193 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:24.193 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:24.193 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:24.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:24.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:24.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:24.291 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:24.291 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:24.291 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:24.291 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:24.292 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:24.292 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:24.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:43:24.708 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:24.709 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:24.709 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:25.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 3 2020-09-08T15:43:25.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:43:25.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:25.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:25.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:25.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:25.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:25.221 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:25.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:25.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=14852212 2020-09-08T15:43:25.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 14852212 '!=' null 2020-09-08T15:43:25.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:25.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:25.748 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:25.748 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:25.839 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:25.839 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:25.839 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:25.840 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:25.840 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:25.840 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:25.840 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:25.840 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:25.841 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:25.842 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:25.843 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:25.843 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:25.843 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:25.843 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:25.843 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:25.844 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:25.844 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 151, 2020-09-08T15:43:25.844 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:25.844 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:25.844 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:25.845 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:25.845 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:25.845 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:25.845 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:25.845 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:25.846 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:25.846 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:25.846 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:25.846 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:43:25.846 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:43:25.846 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:25.847 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:25.847 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:25.847 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:25.847 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:25.847 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:25.848 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:25.848 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:25.848 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:25.848 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:25.848 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:25.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:25.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:25.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:25.949 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:25.949 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:25.950 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:25.950 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:25.950 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:25.950 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:26.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:43:26.336 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:26.336 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:26.336 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:26.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 3 2020-09-08T15:43:26.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:43:26.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:26.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:26.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:26.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:26.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:26.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:26.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:27.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=22715130 2020-09-08T15:43:27.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 22715130 '!=' null 2020-09-08T15:43:27.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:27.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:27.462 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:27.462 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:27.552 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:27.553 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:27.553 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:27.553 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:27.553 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:27.554 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:27.554 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:27.554 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:27.554 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:27.554 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:27.555 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:27.555 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:27.555 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:27.555 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:27.555 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:27.556 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:27.556 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 151, 2020-09-08T15:43:27.556 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:27.557 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:27.557 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:27.557 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:27.557 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:27.557 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:27.558 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:27.558 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:27.558 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:27.558 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:27.558 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:27.558 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:43:27.559 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:43:27.559 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:27.559 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:27.559 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:27.559 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:27.560 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:27.560 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:27.560 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:27.560 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:27.560 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:27.560 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:27.561 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:27.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:27.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:27.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:27.662 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:27.662 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:27.662 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:27.662 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:27.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:27.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:28.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:43:28.052 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:28.052 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:28.053 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:28.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 3 2020-09-08T15:43:28.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:43:28.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:28.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:28.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:28.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:28.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:28.579 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:28.579 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:29.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=22715130 2020-09-08T15:43:29.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 22715130 '!=' null 2020-09-08T15:43:29.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:29.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:29.100 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:29.100 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:29.192 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:29.193 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:29.193 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:29.193 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:29.193 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:29.193 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:29.194 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:29.194 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:29.194 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:29.194 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:29.194 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:29.195 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:29.195 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:29.195 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:29.195 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:29.195 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:29.196 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 151, 2020-09-08T15:43:29.196 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:29.196 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:29.196 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:29.196 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:29.196 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:29.197 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:29.197 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:29.197 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:29.197 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:29.197 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:29.219 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:29.219 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:43:29.219 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:43:29.220 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:29.220 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:29.220 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:29.220 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:29.220 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:29.221 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:29.221 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:29.221 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:29.221 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:29.221 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:29.222 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:29.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:29.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:29.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:29.302 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:29.302 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:29.303 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:29.303 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:29.303 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:29.303 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:29.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:43:29.845 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:29.846 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:29.846 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:30.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 3 2020-09-08T15:43:30.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:43:30.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:30.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:30.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:30.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:30.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:30.384 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:30.384 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:30.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=14852263 2020-09-08T15:43:30.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 14852263 '!=' null 2020-09-08T15:43:30.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:30.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:30.947 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:30.948 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:31.039 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:31.040 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:31.040 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:31.040 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:31.040 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:31.041 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:31.041 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:31.042 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:31.042 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:31.042 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:31.042 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:31.050 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:31.050 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:31.050 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:31.051 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:31.054 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:31.054 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 151, 2020-09-08T15:43:31.055 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:31.056 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:31.056 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:31.056 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:31.056 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:31.057 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:31.057 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:31.057 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:31.057 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:31.058 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:31.058 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:31.058 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:43:31.058 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:43:31.059 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:31.059 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:31.059 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:31.059 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:31.059 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:31.060 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:31.060 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:31.060 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:31.060 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:31.061 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:31.061 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:31.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:31.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:31.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:31.150 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:31.150 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:31.150 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:31.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:31.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:31.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:31.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:43:31.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:31.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:31.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:32.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 3 2020-09-08T15:43:32.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:43:32.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:32.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:32.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:32.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:32.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:32.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:32.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:32.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=22715152 2020-09-08T15:43:32.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 22715152 '!=' null 2020-09-08T15:43:32.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:32.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:32.893 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:32.893 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:32.952 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:32.952 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:32.952 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:32.952 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:32.953 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:32.953 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:32.953 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:32.953 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:32.954 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:32.954 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:32.954 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:32.954 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:32.954 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:32.955 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:32.955 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:32.955 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:32.955 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 151, 2020-09-08T15:43:32.955 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:32.956 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:32.956 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:32.956 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:32.956 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:32.956 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:32.959 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:32.959 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:32.959 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:32.960 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:32.960 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:32.960 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "7.0", 2020-09-08T15:43:32.960 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 254, 2020-09-08T15:43:32.963 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:32.963 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:32.963 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:32.964 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:32.964 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:32.965 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:32.965 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:32.965 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:32.966 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:32.966 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:32.966 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:32.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:33.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:33.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:33.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:33.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:33.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:33.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:33.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:33.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:33.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:43:33.468 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:33.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:33.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:34.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 3 2020-09-08T15:43:34.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:43:34.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:34.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:34.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:34.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:34.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:34.172 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:34.173 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:34.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=15725932 2020-09-08T15:43:34.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 15725932 '!=' null 2020-09-08T15:43:34.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:34.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:34.690 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:34.690 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:34.782 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:34.783 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:34.783 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:34.783 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:34.783 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:34.783 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:34.784 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:34.784 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:34.784 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:34.784 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:34.784 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:34.784 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:34.785 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:34.785 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:34.785 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:34.785 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:34.785 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:34.786 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:34.786 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:34.786 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:34.786 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:34.786 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:34.787 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:34.787 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:34.787 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:34.787 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:34.787 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:34.788 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:34.789 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:34.789 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:34.790 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:34.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:34.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:34.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:34.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:34.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:34.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:34.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:34.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:34.901 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:35.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:43:35.285 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:35.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:35.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:35.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 3 2020-09-08T15:43:35.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:43:35.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:35.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:35.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:35.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:35.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:35.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:35.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:36.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=11794427 2020-09-08T15:43:36.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 11794427 '!=' null 2020-09-08T15:43:36.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:36.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:36.644 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:36.644 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:36.738 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:36.738 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:36.739 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:36.739 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:36.739 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:36.740 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:36.740 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:36.740 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:36.741 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:36.741 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:36.741 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:36.753 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:36.754 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:36.754 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:36.754 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:36.755 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:36.755 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:36.755 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:36.756 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:36.756 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:36.763 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:36.763 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:36.764 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:36.764 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:36.764 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:36.765 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:36.765 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:36.765 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:36.766 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:36.766 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:36.766 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:36.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:36.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:36.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:36.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:36.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:36.848 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:36.848 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:36.849 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:36.849 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:37.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:43:37.237 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:37.237 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:37.239 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:37.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 3 2020-09-08T15:43:37.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 1 '!=' 0 2020-09-08T15:43:37.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T15:43:37.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=1 2020-09-08T15:43:37.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:37.759 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:37.759 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:37.850 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:37.851 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:37.851 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:37.851 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:37.851 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:37.852 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:37.852 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:37.852 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:37.852 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:37.852 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:37.853 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:37.853 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:37.853 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:37.853 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:37.853 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:37.858 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:37.858 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:37.858 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:37.858 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:37.859 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:37.859 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:37.859 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:37.859 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:37.859 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:37.860 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:37.860 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:37.860 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:37.860 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:37.860 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:37.861 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:37.861 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:37.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:37.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:37.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:37.960 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:37.961 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:37.961 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:37.961 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:37.961 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:37.961 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:38.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:43:38.343 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:38.343 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:38.343 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:38.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 3 2020-09-08T15:43:38.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 1 '!=' 1 2020-09-08T15:43:38.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:38.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:38.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:38.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:38.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:38.864 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:38.864 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:39.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=9173380 2020-09-08T15:43:39.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 9173380 '!=' null 2020-09-08T15:43:39.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:39.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:39.857 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:39.857 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:39.955 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:39.955 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:39.955 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:39.956 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:39.956 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:39.956 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:39.956 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:39.956 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:39.957 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:39.957 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:39.957 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:39.957 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:39.957 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:39.958 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:39.958 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:39.958 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:39.958 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:39.958 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:39.959 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:39.959 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:39.959 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:39.959 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:39.959 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:39.960 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:39.960 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:39.960 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:39.960 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:39.960 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:39.961 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:39.961 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:39.961 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:39.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:40.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:40.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:40.068 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:40.068 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:40.070 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:40.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:40.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:40.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:40.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:43:40.461 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:40.461 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:40.461 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:40.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 3 2020-09-08T15:43:41.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 1 '!=' 1 2020-09-08T15:43:41.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:41.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:41.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:41.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:41.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:41.001 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:41.001 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:41.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=20967562 2020-09-08T15:43:41.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 20967562 '!=' null 2020-09-08T15:43:41.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:41.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:41.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:41.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:41.616 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:41.617 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:41.617 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:41.617 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:41.617 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:41.618 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:41.618 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:41.618 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:41.618 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:41.618 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:41.619 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:41.619 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:41.619 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:41.619 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:41.620 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:41.620 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:41.620 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:41.620 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:41.620 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:41.621 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:41.621 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:41.621 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:41.621 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:41.622 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:41.622 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:41.622 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:41.622 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:41.622 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:41.623 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:41.623 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:41.623 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:41.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:41.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:41.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:41.726 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:41.726 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:41.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:41.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:41.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:41.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:42.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:43:42.121 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:42.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:42.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:42.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 3 2020-09-08T15:43:42.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 1 '!=' 1 2020-09-08T15:43:42.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:42.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:42.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:42.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:42.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:42.737 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:42.737 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:43.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=20967562 2020-09-08T15:43:43.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 20967562 '!=' null 2020-09-08T15:43:43.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:43.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:43.296 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:43.297 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:43.387 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:43.388 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:43.388 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:43.388 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:43.389 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:43.389 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:43.389 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:43.389 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:43.389 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:43.390 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:43.390 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:43.390 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:43.390 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:43.390 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:43.391 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:43.391 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:43.391 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:43.391 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:43.391 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:43.392 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:43.392 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:43.392 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:43.392 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:43.392 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:43.392 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:43.393 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:43.393 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:43.393 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:43.393 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:43.393 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:43.394 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:43.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:43.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:43.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:43.498 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:43.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:43.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:43.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:43.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:43.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:43.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:43:43.973 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:43.973 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:43.973 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:44.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 3 2020-09-08T15:43:44.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 1 '!=' 1 2020-09-08T15:43:44.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:44.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:44.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:44.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:44.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:44.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:44.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:45.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=16921402 2020-09-08T15:43:45.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 16921402 '!=' null 2020-09-08T15:43:45.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:45.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:45.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:45.037 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:45.128 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:45.128 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:45.128 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:45.129 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:45.129 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:45.129 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:45.129 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:45.129 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:45.130 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:45.130 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:45.130 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:45.130 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:45.130 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:45.131 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:45.131 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:45.131 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:45.131 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:45.132 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:45.132 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:45.132 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:45.132 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:45.132 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:45.133 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:45.133 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:45.133 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:45.133 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:45.133 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:45.134 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:45.134 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:45.134 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:45.134 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:45.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:45.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:45.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:45.238 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:45.238 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:45.238 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:45.238 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:45.239 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:45.239 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:45.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:43:45.625 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:45.625 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:45.626 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:46.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 3 2020-09-08T15:43:46.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 1 '!=' 1 2020-09-08T15:43:46.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:46.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:46.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:46.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:46.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:46.245 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:46.245 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:46.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=14812119 2020-09-08T15:43:46.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 14812119 '!=' null 2020-09-08T15:43:46.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:46.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:46.823 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:46.823 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:46.913 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:46.914 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:46.914 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:46.914 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:46.914 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:46.915 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:46.915 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:46.915 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:46.915 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:46.915 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:46.916 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:46.916 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:46.916 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:46.916 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:46.916 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:46.917 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:46.917 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:46.917 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:46.917 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:46.917 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:46.918 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:46.918 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:46.918 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:46.918 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:46.918 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:46.918 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:46.919 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:46.919 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:46.919 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:46.919 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:46.930 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:46.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:47.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:47.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:47.024 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:47.024 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:47.024 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:47.024 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:47.024 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:47.025 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:47.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:43:47.425 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:47.426 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:47.426 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:47.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 3 2020-09-08T15:43:47.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 1 '!=' 1 2020-09-08T15:43:47.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:47.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:47.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:47.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:47.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:47.996 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:47.996 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:48.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=22714932 2020-09-08T15:43:48.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 22714932 '!=' null 2020-09-08T15:43:48.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:48.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:48.776 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:48.776 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:48.868 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:48.869 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:48.869 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:48.869 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:48.870 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:48.870 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:48.870 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:48.870 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:48.870 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:48.871 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:48.871 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:48.871 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:48.871 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:48.871 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:48.872 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:48.872 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:48.872 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:48.872 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:48.872 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:48.872 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:48.873 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:48.873 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:48.873 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:48.873 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:48.873 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:48.875 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:48.876 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:48.876 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:48.876 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:48.876 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:48.876 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:48.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:48.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:48.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:48.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:48.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:48.979 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:48.979 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:48.979 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:48.980 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:49.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:43:49.365 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:49.365 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:49.366 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:49.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 3 2020-09-08T15:43:49.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 1 '!=' 1 2020-09-08T15:43:49.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:49.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:49.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:49.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:49.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:49.895 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:49.895 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:50.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=16599307 2020-09-08T15:43:50.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 16599307 '!=' null 2020-09-08T15:43:50.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:50.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:50.424 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:50.425 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:50.518 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:50.518 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:50.518 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:50.518 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:50.519 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:50.519 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:50.519 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:50.519 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:50.519 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:50.520 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:50.520 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:50.520 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:50.520 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:50.524 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:50.524 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:50.524 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:50.525 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:50.525 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:50.525 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:50.525 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:50.525 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:50.526 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:50.526 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:50.526 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:50.526 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:50.530 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:50.531 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:50.531 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:50.531 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:50.532 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:50.532 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:50.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:50.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:50.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:50.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:50.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:50.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:50.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:50.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:50.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:51.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:43:51.013 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:51.014 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:51.014 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:51.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 3 2020-09-08T15:43:51.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 1 '!=' 1 2020-09-08T15:43:51.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:51.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:51.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:51.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:51.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:51.782 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:51.782 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:52.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=24462139 2020-09-08T15:43:52.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 24462139 '!=' null 2020-09-08T15:43:52.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:52.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:52.346 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:52.346 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:52.436 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:52.436 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:52.436 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:52.437 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:52.437 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:52.437 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:52.437 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:52.437 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:52.438 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:52.438 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:52.438 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:52.438 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:52.438 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:52.438 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:52.439 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:52.439 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:52.440 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:52.440 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:52.440 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:52.440 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:52.440 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:52.441 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:52.441 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:52.441 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:52.441 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:52.441 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:52.442 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:52.442 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:52.443 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:52.443 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:52.445 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:52.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:52.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:52.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:52.545 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:52.546 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:52.546 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:52.546 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:52.546 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:52.546 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:52.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:43:52.938 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:52.939 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:52.939 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:53.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 3 2020-09-08T15:43:53.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 1 '!=' 1 2020-09-08T15:43:53.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:53.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:53.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:53.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:53.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:53.474 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:53.475 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:54.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=16599153 2020-09-08T15:43:54.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 16599153 '!=' null 2020-09-08T15:43:54.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:54.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:54.047 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:54.047 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:54.138 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:54.139 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:54.139 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:54.139 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:54.140 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:54.140 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:54.140 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:54.140 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:54.141 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:54.141 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:54.141 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:54.141 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:54.141 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:54.142 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:54.142 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:54.142 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:54.142 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:54.142 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:54.143 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:54.143 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:54.143 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:54.143 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:54.143 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:54.144 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:54.144 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:54.144 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:54.144 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:54.145 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:54.145 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:54.146 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:54.146 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:54.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:54.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:54.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:54.249 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:54.250 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:54.250 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:54.250 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:54.251 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:54.251 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:54.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:43:54.633 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:54.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:54.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:55.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 3 2020-09-08T15:43:55.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 1 '!=' 1 2020-09-08T15:43:55.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:55.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:55.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:55.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:55.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:55.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:55.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:55.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=16599216 2020-09-08T15:43:55.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 16599216 '!=' null 2020-09-08T15:43:55.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:55.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:55.815 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:55.816 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:55.906 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:55.907 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:55.907 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:55.907 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:55.907 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:55.907 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:55.908 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:55.908 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:55.908 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:55.908 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:55.908 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:55.909 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:55.909 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:55.909 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:55.909 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:55.909 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:55.909 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:55.910 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:55.910 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:55.910 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:55.910 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:55.910 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:55.911 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:55.911 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:55.911 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:55.911 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:55.911 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:55.911 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:55.912 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:55.912 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:55.912 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:55.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:56.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:56.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:56.015 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:56.016 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:56.016 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:56.016 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:56.016 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:56.016 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:56.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:43:56.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:56.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:56.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:56.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 3 2020-09-08T15:43:56.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 1 '!=' 1 2020-09-08T15:43:56.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:56.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:56.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:56.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:56.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:56.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:56.933 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:57.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=24462043 2020-09-08T15:43:57.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 24462043 '!=' null 2020-09-08T15:43:57.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:57.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:57.471 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:57.472 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:57.565 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:57.565 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:57.565 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:57.566 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:57.566 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:57.566 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:57.566 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:57.566 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:57.567 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:57.567 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:57.567 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:57.567 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:57.567 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:57.568 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:57.568 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:57.568 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:57.568 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:57.568 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:57.569 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:57.569 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:57.569 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:57.569 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:57.569 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:57.570 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:57.570 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:57.570 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:57.570 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:57.570 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:57.570 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:57.571 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:57.571 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:57.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:57.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:57.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:57.674 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:57.674 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:57.675 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:57.675 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:57.675 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:57.675 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:43:58.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:43:58.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:43:58.308 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:43:58.308 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:43:58.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 3 2020-09-08T15:43:58.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 1 '!=' 1 2020-09-08T15:43:58.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:43:58.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:43:58.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:43:58.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:43:58.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:43:58.841 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:43:58.841 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:43:59.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=15725582 2020-09-08T15:43:59.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 15725582 '!=' null 2020-09-08T15:43:59.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:43:59.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:59.433 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:43:59.433 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:43:59.525 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:43:59.526 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:43:59.526 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:59.526 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:59.526 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:43:59.527 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:59.527 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:43:59.527 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:43:59.527 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:59.527 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:43:59.528 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:43:59.528 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:59.528 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:59.528 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:59.528 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:59.529 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:43:59.529 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:43:59.529 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:43:59.529 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:43:59.529 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:43:59.529 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:43:59.530 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:59.530 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:43:59.530 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:43:59.530 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:43:59.530 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:43:59.531 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:43:59.531 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:43:59.531 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:43:59.531 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:43:59.531 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:43:59.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:43:59.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:43:59.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:43:59.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:43:59.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:43:59.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:43:59.636 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:43:59.636 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:43:59.636 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:00.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:44:00.031 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:00.032 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:00.032 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:00.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 3 2020-09-08T15:44:00.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 1 '!=' 1 2020-09-08T15:44:00.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:44:00.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:44:00.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:44:00.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:44:00.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:44:00.560 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:44:00.561 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:44:01.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=15725582 2020-09-08T15:44:01.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 15725582 '!=' null 2020-09-08T15:44:01.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:44:01.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:01.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:01.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:01.178 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:01.179 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:01.179 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:01.179 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:01.179 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [ 2020-09-08T15:44:01.179 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:01.180 INFO:tasks.workunit.client.0.smithi065.stdout: "priority": 110, 2020-09-08T15:44:01.180 INFO:tasks.workunit.client.0.smithi065.stdout: "items": [ 2020-09-08T15:44:01.180 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:01.180 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:44:01.180 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:44:01.180 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:44:01.181 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:01.181 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:01.181 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:01.198 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:44:01.198 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:44:01.198 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:01.199 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "3.0", 2020-09-08T15:44:01.199 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 151, 2020-09-08T15:44:01.199 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:44:01.199 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:01.199 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:01.200 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:01.200 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:01.200 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:01.200 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:01.200 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:01.201 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:01.201 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:01.201 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:01.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:01.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:01.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:01.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:01.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:01.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:01.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:01.291 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:01.292 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:01.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:44:01.678 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:01.678 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:01.678 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:02.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 3 2020-09-08T15:44:02.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 1 '!=' 1 2020-09-08T15:44:02.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:44:02.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:44:02.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:44:02.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:44:02.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:44:02.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:44:02.248 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:44:02.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=22714740 2020-09-08T15:44:02.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 22714740 '!=' null 2020-09-08T15:44:02.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:44:02.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:02.775 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:02.775 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:02.864 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:02.864 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:02.865 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:02.865 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:02.865 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:02.865 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:44:02.866 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:02.866 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:44:02.868 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:44:02.869 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:44:02.869 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:02.870 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:02.870 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:02.870 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:02.870 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:02.871 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:02.871 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:02.871 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:02.871 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:02.871 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:02.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:02.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:02.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:02.976 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:02.976 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:02.976 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:02.976 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:02.976 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:02.977 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:03.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:44:03.363 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:03.364 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:03.364 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:04.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 3 2020-09-08T15:44:04.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 1 '!=' 1 2020-09-08T15:44:04.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:44:04.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:44:04.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:44:04.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:44:04.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:44:04.032 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:44:04.032 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:44:04.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=22278401 2020-09-08T15:44:04.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 22278401 '!=' null 2020-09-08T15:44:04.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:44:04.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:04.560 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:04.560 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:04.657 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:04.658 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:04.658 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:04.658 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:04.658 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:04.658 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:44:04.659 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:04.659 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:44:04.659 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:44:04.659 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:44:04.659 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:04.660 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:04.660 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:04.660 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:04.660 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:04.660 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:04.661 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:04.661 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:04.661 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:04.661 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:04.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:04.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:04.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:04.763 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:04.764 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:04.764 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:04.764 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:04.764 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:04.764 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:05.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:44:05.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:05.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:05.157 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:05.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 3 2020-09-08T15:44:05.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 1 '!=' 1 2020-09-08T15:44:05.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:44:05.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:44:05.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:44:05.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:44:05.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:44:05.738 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:44:05.738 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:44:06.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=10483941 2020-09-08T15:44:06.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 10483941 '!=' null 2020-09-08T15:44:06.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:44:06.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:06.269 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:06.269 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:06.357 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:06.358 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:06.358 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:06.359 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:06.359 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:06.359 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:44:06.359 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:06.360 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:44:06.360 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:44:06.360 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:44:06.361 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:06.361 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:06.362 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:06.362 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:06.363 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:06.363 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:06.363 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:06.365 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:06.365 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:06.366 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:06.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:06.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:06.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:06.471 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:06.472 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:06.472 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:06.472 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:06.472 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:06.472 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:06.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:44:06.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:06.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:06.857 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:07.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 3 2020-09-08T15:44:07.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 1 '!=' 1 2020-09-08T15:44:07.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:44:07.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:44:07.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:44:07.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:44:07.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:44:07.385 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:44:07.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:44:07.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=22278293 2020-09-08T15:44:07.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 22278293 '!=' null 2020-09-08T15:44:07.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:44:07.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:07.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:07.912 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:08.002 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:08.002 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:08.002 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:08.003 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:08.003 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:08.003 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:44:08.003 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:08.003 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:44:08.004 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:44:08.004 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:44:08.004 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:08.004 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:08.004 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:08.005 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:08.005 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:08.005 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:08.005 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:08.005 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:08.006 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:08.006 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:08.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:08.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:08.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:08.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:08.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:08.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:08.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:08.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:08.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:08.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=2 2020-09-08T15:44:08.498 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:08.498 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:08.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:09.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 2 = 3 2020-09-08T15:44:09.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 2 '!=' 1 2020-09-08T15:44:09.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T15:44:09.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=2 2020-09-08T15:44:09.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:09.042 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:09.042 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:09.133 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:09.134 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:09.134 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:09.134 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:09.135 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:09.135 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:44:09.135 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:09.135 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:44:09.136 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:44:09.137 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:44:09.137 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:09.137 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:09.137 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:09.137 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:09.138 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:09.138 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:09.138 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:09.138 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:09.138 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:09.139 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:09.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:09.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:09.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:09.243 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:09.243 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:09.243 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:09.244 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:09.244 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:09.244 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:09.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=2 2020-09-08T15:44:09.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:09.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:09.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:10.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 2 = 3 2020-09-08T15:44:10.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 2 '!=' 2 2020-09-08T15:44:10.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:44:10.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:44:10.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:44:10.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:44:10.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:44:10.161 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:44:10.161 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:44:10.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=11794359 2020-09-08T15:44:10.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 11794359 '!=' null 2020-09-08T15:44:10.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:44:10.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:10.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:10.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:10.778 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:10.778 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:10.778 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:10.779 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:10.779 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:10.779 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:44:10.779 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:10.780 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:44:10.780 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:44:10.780 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:44:10.780 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:10.780 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:10.781 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:10.781 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:10.781 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:10.781 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:10.782 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:10.782 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:10.782 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:10.782 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:10.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:10.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:10.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:10.889 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:10.889 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:10.889 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:10.889 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:10.890 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:10.890 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:11.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=2 2020-09-08T15:44:11.280 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:11.280 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:11.280 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:11.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 2 = 3 2020-09-08T15:44:11.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 2 '!=' 2 2020-09-08T15:44:11.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:44:11.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:44:11.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:44:11.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:44:11.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:44:11.830 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:44:11.830 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:44:12.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=19995639 2020-09-08T15:44:12.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 19995639 '!=' null 2020-09-08T15:44:12.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:44:12.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:12.359 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:12.359 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:12.445 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:12.445 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:12.445 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:12.446 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:12.446 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:12.446 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:44:12.446 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:12.446 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:44:12.447 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:44:12.447 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:44:12.447 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:12.447 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:12.447 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:12.448 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:12.448 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:12.448 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:12.448 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:12.448 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:12.449 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:12.449 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:12.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:12.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:12.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:12.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:12.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:12.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:12.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:12.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:12.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:12.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=2 2020-09-08T15:44:12.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:12.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:12.941 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:13.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 2 = 3 2020-09-08T15:44:13.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 2 '!=' 2 2020-09-08T15:44:13.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:44:13.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:44:13.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:44:13.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:44:13.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:44:13.466 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:44:13.466 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:44:14.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=17163921 2020-09-08T15:44:14.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 17163921 '!=' null 2020-09-08T15:44:14.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:44:14.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:14.029 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:14.029 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:14.100 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:14.101 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:14.101 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:14.101 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:14.101 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:14.101 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:44:14.102 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:14.102 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:44:14.102 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:44:14.102 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:44:14.102 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:14.103 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:14.103 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:14.103 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:14.103 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:14.103 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:14.104 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:14.104 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:14.104 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:14.104 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:14.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:14.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:14.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:14.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:14.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:14.210 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:14.210 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:14.217 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:14.218 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:14.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=2 2020-09-08T15:44:14.597 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:14.597 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:14.597 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:15.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 2 = 3 2020-09-08T15:44:15.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 2 '!=' 2 2020-09-08T15:44:15.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:44:15.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:44:15.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:44:15.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:44:15.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:44:15.116 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:44:15.116 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:44:15.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=15725936 2020-09-08T15:44:15.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 15725936 '!=' null 2020-09-08T15:44:15.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:44:15.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:15.652 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:15.653 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:15.745 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:15.745 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:15.746 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:15.746 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:15.746 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:15.746 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:44:15.746 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:15.747 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:44:15.747 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:44:15.747 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:44:15.747 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:15.747 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:15.748 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:15.748 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:15.748 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:15.748 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:15.748 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:15.749 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:15.749 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:15.749 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:15.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:15.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:15.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:15.857 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:15.857 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:15.858 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:15.858 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:15.858 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:15.859 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:16.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=2 2020-09-08T15:44:16.239 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:16.239 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:16.239 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:16.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 2 = 3 2020-09-08T15:44:16.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 2 '!=' 2 2020-09-08T15:44:16.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:44:16.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:44:16.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:44:16.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:44:16.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:44:16.828 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:44:16.828 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:44:17.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=15725936 2020-09-08T15:44:17.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 15725936 '!=' null 2020-09-08T15:44:17.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:44:17.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:17.353 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:17.354 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:17.445 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:17.446 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:17.446 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:17.446 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:17.446 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:17.446 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:44:17.447 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:17.450 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:44:17.450 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:44:17.450 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:44:17.450 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:17.451 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:17.451 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:17.451 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:17.451 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:17.451 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:17.452 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:17.452 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:17.452 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:17.452 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:17.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:17.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:17.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:17.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:17.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:17.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:17.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:17.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:17.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:17.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=2 2020-09-08T15:44:17.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:17.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:17.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:18.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 2 = 3 2020-09-08T15:44:18.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 2 '!=' 2 2020-09-08T15:44:18.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:44:18.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:44:18.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:44:18.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:44:18.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:44:18.495 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:44:18.495 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:44:19.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=22714999 2020-09-08T15:44:19.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 22714999 '!=' null 2020-09-08T15:44:19.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:44:19.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:19.227 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:19.227 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:19.320 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:19.320 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:19.320 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:19.321 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:19.321 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:19.321 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:44:19.321 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:19.321 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:44:19.322 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:44:19.322 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:44:19.322 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:19.322 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:19.323 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:19.323 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:19.323 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:19.323 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:19.323 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:19.324 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:19.324 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:19.324 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:19.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:19.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:19.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:19.429 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:19.430 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:19.430 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:19.430 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:19.431 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:19.431 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:19.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=2 2020-09-08T15:44:19.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:19.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:19.823 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:20.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 2 = 3 2020-09-08T15:44:20.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 2 '!=' 2 2020-09-08T15:44:20.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:44:20.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:44:20.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:44:20.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:44:20.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:44:20.356 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:44:20.357 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:44:20.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=14852143 2020-09-08T15:44:20.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 14852143 '!=' null 2020-09-08T15:44:20.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:44:20.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:20.903 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:20.904 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:20.992 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:20.993 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:20.993 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:20.993 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:20.993 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:20.994 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:44:20.994 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:20.994 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:44:20.994 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:44:20.994 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:44:20.995 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:21.003 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:21.003 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:21.003 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:21.004 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:21.004 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:21.004 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:21.004 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:21.004 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:21.005 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:21.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:21.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:21.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:21.103 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:21.103 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:21.103 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:21.103 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:21.103 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:21.104 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:21.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=2 2020-09-08T15:44:21.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:21.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:21.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:22.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 2 = 3 2020-09-08T15:44:22.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 2 '!=' 2 2020-09-08T15:44:22.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:44:22.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:44:22.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:44:22.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:44:22.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:44:22.338 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:44:22.338 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:44:22.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=23588776 2020-09-08T15:44:22.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 23588776 '!=' null 2020-09-08T15:44:22.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:44:22.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:22.870 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:22.870 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:22.963 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:22.963 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:22.964 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:22.964 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:22.964 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:22.964 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:44:22.964 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:22.965 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:44:22.965 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:44:22.965 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:44:22.965 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:22.965 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:22.965 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:22.966 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:22.966 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:22.966 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:22.966 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:22.966 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:22.967 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:22.967 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:22.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:23.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:23.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:23.091 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:23.091 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:23.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:23.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:23.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:23.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:23.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=2 2020-09-08T15:44:23.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:23.465 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:23.465 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:24.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 2 = 3 2020-09-08T15:44:24.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 2 '!=' 2 2020-09-08T15:44:24.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:44:24.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:44:24.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:44:24.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:44:24.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:44:24.034 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:44:24.035 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:44:24.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=15725935 2020-09-08T15:44:24.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 15725935 '!=' null 2020-09-08T15:44:24.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:44:24.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:24.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:24.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:24.645 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:24.645 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:24.645 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:24.645 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:24.646 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:24.646 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:44:24.646 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:24.646 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:44:24.646 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:44:24.647 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:44:24.647 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:24.647 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:24.647 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:24.647 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:24.647 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:24.648 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:24.648 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:24.648 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:24.648 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:24.648 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:24.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:24.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:24.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:24.755 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:24.755 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:24.756 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:24.756 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:24.756 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:24.756 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:25.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=2 2020-09-08T15:44:25.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:25.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:25.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:25.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 2 = 3 2020-09-08T15:44:25.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 2 '!=' 2 2020-09-08T15:44:25.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:44:25.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:44:25.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:44:25.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:44:25.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:44:25.850 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:44:25.851 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:44:26.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=15725956 2020-09-08T15:44:26.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 15725956 '!=' null 2020-09-08T15:44:26.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:44:26.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:26.389 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:26.389 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:26.479 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:26.480 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:26.480 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:26.480 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:26.481 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:26.481 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:44:26.481 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:26.481 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:44:26.481 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:44:26.482 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:44:26.482 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:26.482 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:26.482 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:26.483 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:26.483 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:26.483 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:26.483 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:26.483 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:26.484 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:26.484 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:26.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:26.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:26.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:26.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:26.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:26.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:26.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:26.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:26.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:26.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=2 2020-09-08T15:44:26.982 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:26.982 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:26.983 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:27.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 2 = 3 2020-09-08T15:44:27.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 2 '!=' 2 2020-09-08T15:44:27.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:44:27.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:44:27.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:44:27.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:44:27.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:44:27.522 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:44:27.522 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:44:28.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=22715239 2020-09-08T15:44:28.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 22715239 '!=' null 2020-09-08T15:44:28.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:44:28.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:28.052 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:28.052 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:28.150 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:28.151 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:28.151 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:28.151 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:28.151 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:28.153 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:44:28.153 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:28.154 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:44:28.154 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:44:28.155 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:44:28.155 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:28.155 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:28.155 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:28.156 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:28.156 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:28.156 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:28.156 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:28.156 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:28.157 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:28.157 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:28.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:28.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:28.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:28.254 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:28.254 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:28.254 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:28.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:28.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:28.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:28.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=2 2020-09-08T15:44:28.943 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:28.943 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:28.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:29.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 2 = 3 2020-09-08T15:44:29.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 2 '!=' 2 2020-09-08T15:44:29.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:44:29.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:44:29.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:44:29.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:44:29.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:44:29.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:44:29.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:44:30.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=15726038 2020-09-08T15:44:30.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 15726038 '!=' null 2020-09-08T15:44:30.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:44:30.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:30.252 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:30.252 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:30.342 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:30.343 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:30.343 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:30.343 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:30.343 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:30.344 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [ 2020-09-08T15:44:30.344 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:30.344 INFO:tasks.workunit.client.0.smithi065.stdout: "item": "1.0", 2020-09-08T15:44:30.344 INFO:tasks.workunit.client.0.smithi065.stdout: "prio": 110, 2020-09-08T15:44:30.344 INFO:tasks.workunit.client.0.smithi065.stdout: "can_preempt": true 2020-09-08T15:44:30.345 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:30.345 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:30.345 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:30.345 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:30.345 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:30.346 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:30.346 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:30.346 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:30.346 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:30.346 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:30.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:30.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:30.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:30.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:30.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:30.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:30.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:30.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:30.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:30.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=2 2020-09-08T15:44:30.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:30.986 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:30.986 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:31.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 2 = 3 2020-09-08T15:44:31.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 2 '!=' 2 2020-09-08T15:44:31.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:44:31.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:44:31.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:44:31.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:44:31.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:44:31.513 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:44:31.513 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:44:32.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=20968115 2020-09-08T15:44:32.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 20968115 '!=' null 2020-09-08T15:44:32.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:44:32.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:32.108 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:32.108 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:32.195 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:32.195 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:32.196 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:32.196 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:32.196 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:32.196 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:32.197 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:32.197 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:32.197 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:32.197 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:32.198 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:32.198 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:32.198 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:32.198 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:32.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:32.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:32.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:32.305 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:32.305 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:32.306 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:32.306 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:32.306 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:32.306 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:32.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=2 2020-09-08T15:44:32.691 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:32.691 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:32.691 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:33.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 2 = 3 2020-09-08T15:44:33.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 2 '!=' 2 2020-09-08T15:44:33.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:44:33.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:44:33.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:44:33.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:44:33.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:44:33.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:44:33.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:44:33.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=18347040 2020-09-08T15:44:33.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 18347040 '!=' null 2020-09-08T15:44:33.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:44:33.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:33.756 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:33.756 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:33.854 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:33.855 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:33.855 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:33.855 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:33.855 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:33.856 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:33.856 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:33.856 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:33.856 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:33.856 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:33.857 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:33.857 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:33.857 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:33.857 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:33.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:33.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:33.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:33.965 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:33.965 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:33.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:33.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:33.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:33.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:34.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=2 2020-09-08T15:44:34.346 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:34.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:34.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:34.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 2 = 3 2020-09-08T15:44:34.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 2 '!=' 2 2020-09-08T15:44:34.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:44:34.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:44:34.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:44:34.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:44:34.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:44:34.872 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:44:34.872 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:44:35.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=7862999 2020-09-08T15:44:35.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 7862999 '!=' null 2020-09-08T15:44:35.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:44:35.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:35.409 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:35.410 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:35.492 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:35.494 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:35.495 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:35.495 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:35.495 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:35.495 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:35.495 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:35.496 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:35.496 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:35.496 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:35.496 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:35.496 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:35.497 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:35.497 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:35.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:35.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:35.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:35.603 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:35.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:35.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:35.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:35.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:35.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:35.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=2 2020-09-08T15:44:35.994 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:35.994 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:35.994 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:36.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 2 = 3 2020-09-08T15:44:36.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 2 '!=' 2 2020-09-08T15:44:36.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:44:36.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:44:36.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:44:36.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:44:36.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:44:36.545 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:44:36.545 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:44:37.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=7862999 2020-09-08T15:44:37.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 7862999 '!=' null 2020-09-08T15:44:37.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:44:37.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:37.047 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: CEPH_ARGS= 2020-09-08T15:44:37.047 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_recovery_reservations 2020-09-08T15:44:37.148 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:37.149 INFO:tasks.workunit.client.0.smithi065.stdout: "local_reservations": { 2020-09-08T15:44:37.149 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:37.149 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:37.149 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:37.150 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:37.150 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:37.150 INFO:tasks.workunit.client.0.smithi065.stdout: "remote_reservations": { 2020-09-08T15:44:37.150 INFO:tasks.workunit.client.0.smithi065.stdout: "max_allowed": 1, 2020-09-08T15:44:37.150 INFO:tasks.workunit.client.0.smithi065.stdout: "min_priority": 0, 2020-09-08T15:44:37.151 INFO:tasks.workunit.client.0.smithi065.stdout: "queues": [], 2020-09-08T15:44:37.151 INFO:tasks.workunit.client.0.smithi065.stdout: "in_progress": [] 2020-09-08T15:44:37.151 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:37.170 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:37.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:44:37.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:44:37.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:44:37.251 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:44:37.251 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:44:37.252 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:44:37.252 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:44:37.252 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:44:37.252 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:44:37.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=3 2020-09-08T15:44:37.643 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:44:37.643 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:44:37.643 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:44:38.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 3 = 3 2020-09-08T15:44:38.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:44:38.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:44:38.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:298: TEST_backfill_priority: ceph pg dump pgs 2020-09-08T15:44:38.539 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:44:38.540 INFO:tasks.workunit.client.0.smithi065.stdout:7.0 50 0 0 0 0 524288000 0 0 50 50 active+clean 2020-09-08T15:43:34.192190+0000 93'150 119:342 [1,4] 1 [1,4] 1 0'0 2020-09-08T15:40:12.298606+0000 0'0 2020-09-08T15:40:12.298606+0000 0 2020-09-08T15:44:38.540 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 50 0 0 0 0 524288000 0 0 50 50 active+clean 2020-09-08T15:44:32.733961+0000 93'150 120:349 [1,2] 1 [1,2] 1 0'0 2020-09-08T15:39:56.706146+0000 0'0 2020-09-08T15:39:56.706146+0000 0 2020-09-08T15:44:38.540 INFO:tasks.workunit.client.0.smithi065.stdout:3.0 50 0 0 0 0 524288000 0 0 50 50 active+clean 2020-09-08T15:44:02.722784+0000 93'150 119:352 [1,2] 1 [1,2] 1 0'0 2020-09-08T15:40:01.870430+0000 0'0 2020-09-08T15:40:01.870430+0000 0 2020-09-08T15:44:38.540 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:44:38.541 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:44:38.541 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:44:38.553 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:300: TEST_backfill_priority: get_asok_path osd.1 2020-09-08T15:44:38.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-09-08T15:44:38.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-09-08T15:44:38.554 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:44:38.555 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:44:38.555 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:44:38.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83246/ceph-osd.1.asok 2020-09-08T15:44:38.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:300: TEST_backfill_priority: CEPH_ARGS= 2020-09-08T15:44:38.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:300: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.83246/ceph-osd.1.asok dump_pgstate_history 2020-09-08T15:44:38.647 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:44:38.648 INFO:tasks.workunit.client.0.smithi065.stdout: "pgs": [ 2020-09-08T15:44:38.648 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.648 INFO:tasks.workunit.client.0.smithi065.stdout: "pg": "7.0", 2020-09-08T15:44:38.649 INFO:tasks.workunit.client.0.smithi065.stdout: "currently": "Started/Primary/Active/Clean", 2020-09-08T15:44:38.649 INFO:tasks.workunit.client.0.smithi065.stdout: "history": [ 2020-09-08T15:44:38.649 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.649 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "61", 2020-09-08T15:44:38.649 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.650 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.650 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Start", 2020-09-08T15:44:38.650 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:13.062956+0000", 2020-09-08T15:44:38.650 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:13.062965+0000" 2020-09-08T15:44:38.651 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.651 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.651 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetInfo", 2020-09-08T15:44:38.652 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:13.062971+0000", 2020-09-08T15:44:38.652 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:13.239026+0000" 2020-09-08T15:44:38.652 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.653 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.653 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetLog", 2020-09-08T15:44:38.653 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:13.239027+0000", 2020-09-08T15:44:38.653 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:13.239095+0000" 2020-09-08T15:44:38.653 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.654 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.654 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetMissing", 2020-09-08T15:44:38.654 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:13.239096+0000", 2020-09-08T15:44:38.654 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:13.239108+0000" 2020-09-08T15:44:38.654 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.655 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.655 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2020-09-08T15:44:38.655 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:13.239108+0000", 2020-09-08T15:44:38.655 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:13.540385+0000" 2020-09-08T15:44:38.655 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.656 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.656 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering", 2020-09-08T15:44:38.656 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:13.062968+0000", 2020-09-08T15:44:38.656 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:13.540394+0000" 2020-09-08T15:44:38.656 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.657 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.657 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Activating", 2020-09-08T15:44:38.657 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:13.540655+0000", 2020-09-08T15:44:38.657 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:13.937875+0000" 2020-09-08T15:44:38.657 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.658 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.658 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Recovered", 2020-09-08T15:44:38.659 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:13.937875+0000", 2020-09-08T15:44:38.659 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:13.937934+0000" 2020-09-08T15:44:38.659 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.659 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.659 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Clean", 2020-09-08T15:44:38.660 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:13.937935+0000", 2020-09-08T15:44:38.660 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:14.764244+0000" 2020-09-08T15:44:38.660 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.660 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.660 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active", 2020-09-08T15:44:38.661 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:13.540394+0000", 2020-09-08T15:44:38.661 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:14.764264+0000" 2020-09-08T15:44:38.661 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.661 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.661 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary", 2020-09-08T15:44:38.662 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:13.062965+0000", 2020-09-08T15:44:38.662 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:14.764279+0000" 2020-09-08T15:44:38.662 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.662 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.662 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started", 2020-09-08T15:44:38.663 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:13.062953+0000", 2020-09-08T15:44:38.663 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:14.764282+0000" 2020-09-08T15:44:38.663 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.663 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.663 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.664 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.664 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "63", 2020-09-08T15:44:38.664 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.664 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.664 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Reset", 2020-09-08T15:44:38.666 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:14.764282+0000", 2020-09-08T15:44:38.666 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:14.764540+0000" 2020-09-08T15:44:38.666 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.666 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.667 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.667 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.667 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "91", 2020-09-08T15:44:38.667 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.667 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.668 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Start", 2020-09-08T15:44:38.668 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:14.764544+0000", 2020-09-08T15:44:38.669 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:14.764555+0000" 2020-09-08T15:44:38.670 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.670 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.670 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetInfo", 2020-09-08T15:44:38.670 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:14.764563+0000", 2020-09-08T15:44:38.671 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:14.951184+0000" 2020-09-08T15:44:38.671 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.671 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.671 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetLog", 2020-09-08T15:44:38.672 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:14.951185+0000", 2020-09-08T15:44:38.672 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:14.951254+0000" 2020-09-08T15:44:38.672 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.672 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.672 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetMissing", 2020-09-08T15:44:38.673 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:14.951255+0000", 2020-09-08T15:44:38.673 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:14.951265+0000" 2020-09-08T15:44:38.673 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.673 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.675 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2020-09-08T15:44:38.675 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:14.951266+0000", 2020-09-08T15:44:38.675 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:15.241637+0000" 2020-09-08T15:44:38.675 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.676 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.676 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering", 2020-09-08T15:44:38.676 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:14.764559+0000", 2020-09-08T15:44:38.677 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:15.241656+0000" 2020-09-08T15:44:38.677 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.677 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.677 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Activating", 2020-09-08T15:44:38.678 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:15.241905+0000", 2020-09-08T15:44:38.678 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:15.568312+0000" 2020-09-08T15:44:38.678 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.679 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.679 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Recovered", 2020-09-08T15:44:38.679 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:15.568313+0000", 2020-09-08T15:44:38.679 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:15.568358+0000" 2020-09-08T15:44:38.679 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.680 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.680 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Clean", 2020-09-08T15:44:38.680 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:15.568358+0000", 2020-09-08T15:44:38.680 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:42.959111+0000" 2020-09-08T15:44:38.681 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.681 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.682 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active", 2020-09-08T15:44:38.682 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:15.241656+0000", 2020-09-08T15:44:38.682 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:42.959130+0000" 2020-09-08T15:44:38.682 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.683 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.683 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary", 2020-09-08T15:44:38.683 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:14.764556+0000", 2020-09-08T15:44:38.684 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:42.959147+0000" 2020-09-08T15:44:38.684 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.684 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.684 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started", 2020-09-08T15:44:38.685 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:14.764541+0000", 2020-09-08T15:44:38.685 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:42.959150+0000" 2020-09-08T15:44:38.685 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.686 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.686 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.686 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.686 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "92", 2020-09-08T15:44:38.686 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.687 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.687 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Reset", 2020-09-08T15:44:38.687 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:42.959150+0000", 2020-09-08T15:44:38.688 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:42.959363+0000" 2020-09-08T15:44:38.688 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.688 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.688 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.689 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.689 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "98", 2020-09-08T15:44:38.689 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.689 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.690 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Start", 2020-09-08T15:44:38.690 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:42.959366+0000", 2020-09-08T15:44:38.690 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:42.959376+0000" 2020-09-08T15:44:38.690 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.690 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.691 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetInfo", 2020-09-08T15:44:38.691 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:42.959382+0000", 2020-09-08T15:44:38.691 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:43.051831+0000" 2020-09-08T15:44:38.691 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.692 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.692 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetLog", 2020-09-08T15:44:38.692 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:43.051832+0000", 2020-09-08T15:44:38.692 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:43.051897+0000" 2020-09-08T15:44:38.693 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.693 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.693 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetMissing", 2020-09-08T15:44:38.693 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:43.051897+0000", 2020-09-08T15:44:38.694 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:43.051910+0000" 2020-09-08T15:44:38.694 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.694 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.694 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2020-09-08T15:44:38.695 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:43.051910+0000", 2020-09-08T15:44:38.695 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:43.369982+0000" 2020-09-08T15:44:38.695 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.695 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.696 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering", 2020-09-08T15:44:38.696 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:42.959379+0000", 2020-09-08T15:44:38.696 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:43.369989+0000" 2020-09-08T15:44:38.696 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.697 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.697 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Activating", 2020-09-08T15:44:38.697 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:43.370052+0000", 2020-09-08T15:44:38.697 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:43.498148+0000" 2020-09-08T15:44:38.698 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.698 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.698 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Recovered", 2020-09-08T15:44:38.699 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:43.498148+0000", 2020-09-08T15:44:38.699 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:43.498186+0000" 2020-09-08T15:44:38.699 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.700 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.700 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Clean", 2020-09-08T15:44:38.700 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:43.498186+0000", 2020-09-08T15:44:38.700 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:11.776577+0000" 2020-09-08T15:44:38.701 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.701 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.701 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active", 2020-09-08T15:44:38.701 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:43.369990+0000", 2020-09-08T15:44:38.702 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:11.776600+0000" 2020-09-08T15:44:38.702 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.702 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.702 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary", 2020-09-08T15:44:38.702 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:42.959376+0000", 2020-09-08T15:44:38.703 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:11.776657+0000" 2020-09-08T15:44:38.703 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.703 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.703 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started", 2020-09-08T15:44:38.704 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:42.959363+0000", 2020-09-08T15:44:38.704 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:11.776660+0000" 2020-09-08T15:44:38.704 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.705 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.705 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.705 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.705 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "98", 2020-09-08T15:44:38.706 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.706 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.706 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Reset", 2020-09-08T15:44:38.706 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:11.776661+0000", 2020-09-08T15:44:38.707 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:11.777002+0000" 2020-09-08T15:44:38.707 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.707 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.707 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.707 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.708 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "101", 2020-09-08T15:44:38.708 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.708 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.708 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Start", 2020-09-08T15:44:38.709 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:11.777008+0000", 2020-09-08T15:44:38.709 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:11.777022+0000" 2020-09-08T15:44:38.709 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.709 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.710 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetInfo", 2020-09-08T15:44:38.710 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:11.777031+0000", 2020-09-08T15:44:38.710 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:11.893779+0000" 2020-09-08T15:44:38.710 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.711 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.711 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetLog", 2020-09-08T15:44:38.711 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:11.893780+0000", 2020-09-08T15:44:38.711 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:11.893841+0000" 2020-09-08T15:44:38.712 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.712 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.713 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering", 2020-09-08T15:44:38.713 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:11.777026+0000", 2020-09-08T15:44:38.713 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:11.893849+0000" 2020-09-08T15:44:38.713 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.714 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.714 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/WaitActingChange", 2020-09-08T15:44:38.714 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:11.893849+0000", 2020-09-08T15:44:38.714 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:12.220312+0000" 2020-09-08T15:44:38.715 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.715 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.715 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary", 2020-09-08T15:44:38.715 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:11.777022+0000", 2020-09-08T15:44:38.716 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:12.220334+0000" 2020-09-08T15:44:38.716 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.716 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.716 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started", 2020-09-08T15:44:38.717 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:11.777003+0000", 2020-09-08T15:44:38.717 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:12.220338+0000" 2020-09-08T15:44:38.717 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.717 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.718 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.718 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.719 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "101", 2020-09-08T15:44:38.719 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.719 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.719 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Reset", 2020-09-08T15:44:38.720 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:12.220338+0000", 2020-09-08T15:44:38.720 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:12.220589+0000" 2020-09-08T15:44:38.720 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.720 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.721 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.730 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.731 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "115", 2020-09-08T15:44:38.731 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.731 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.731 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Start", 2020-09-08T15:44:38.732 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:12.220595+0000", 2020-09-08T15:44:38.732 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:12.220609+0000" 2020-09-08T15:44:38.732 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.732 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.733 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetInfo", 2020-09-08T15:44:38.733 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:12.220620+0000", 2020-09-08T15:44:38.733 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:12.346439+0000" 2020-09-08T15:44:38.733 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.736 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.737 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetLog", 2020-09-08T15:44:38.737 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:12.346439+0000", 2020-09-08T15:44:38.738 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:12.346527+0000" 2020-09-08T15:44:38.738 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.738 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.739 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetMissing", 2020-09-08T15:44:38.740 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:12.346527+0000", 2020-09-08T15:44:38.740 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:12.346546+0000" 2020-09-08T15:44:38.740 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.741 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.741 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2020-09-08T15:44:38.741 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:12.346546+0000", 2020-09-08T15:44:38.741 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:12.530926+0000" 2020-09-08T15:44:38.741 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.742 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.742 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering", 2020-09-08T15:44:38.742 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:12.220614+0000", 2020-09-08T15:44:38.742 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:12.530939+0000" 2020-09-08T15:44:38.742 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.742 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.743 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Activating", 2020-09-08T15:44:38.743 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:12.531216+0000", 2020-09-08T15:44:38.743 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:13.115643+0000" 2020-09-08T15:44:38.743 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.743 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.744 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/WaitLocalBackfillReserved", 2020-09-08T15:44:38.744 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:13.115644+0000", 2020-09-08T15:44:38.744 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:13.115790+0000" 2020-09-08T15:44:38.744 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.744 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.745 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/WaitRemoteBackfillReserved", 2020-09-08T15:44:38.745 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:13.115791+0000", 2020-09-08T15:44:38.745 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:13.116262+0000" 2020-09-08T15:44:38.745 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.745 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.746 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Backfilling", 2020-09-08T15:44:38.746 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:13.116263+0000", 2020-09-08T15:44:38.746 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:45.757770+0000" 2020-09-08T15:44:38.746 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.746 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.746 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/NotBackfilling", 2020-09-08T15:44:38.747 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:45.757771+0000", 2020-09-08T15:44:38.747 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:45.757927+0000" 2020-09-08T15:44:38.747 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.747 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.747 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/WaitLocalBackfillReserved", 2020-09-08T15:44:38.749 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:45.757927+0000", 2020-09-08T15:44:38.750 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:58.345076+0000" 2020-09-08T15:44:38.750 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.751 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.751 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/WaitRemoteBackfillReserved", 2020-09-08T15:44:38.751 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:58.345077+0000", 2020-09-08T15:44:38.751 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:58.345460+0000" 2020-09-08T15:44:38.751 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.752 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.752 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Backfilling", 2020-09-08T15:44:38.752 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:58.345461+0000", 2020-09-08T15:44:38.752 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:43:33.079155+0000" 2020-09-08T15:44:38.753 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.753 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.753 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Recovered", 2020-09-08T15:44:38.753 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:43:33.079156+0000", 2020-09-08T15:44:38.753 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:43:33.079318+0000" 2020-09-08T15:44:38.754 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.754 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.754 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Clean", 2020-09-08T15:44:38.754 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:43:33.079319+0000", 2020-09-08T15:44:38.754 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:43:33.486630+0000" 2020-09-08T15:44:38.755 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.755 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.755 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active", 2020-09-08T15:44:38.755 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:12.530940+0000", 2020-09-08T15:44:38.755 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:43:33.486674+0000" 2020-09-08T15:44:38.756 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.756 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.756 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary", 2020-09-08T15:44:38.756 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:12.220610+0000", 2020-09-08T15:44:38.756 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:43:33.486707+0000" 2020-09-08T15:44:38.757 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.757 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.757 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started", 2020-09-08T15:44:38.757 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:12.220589+0000", 2020-09-08T15:44:38.757 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:43:33.486726+0000" 2020-09-08T15:44:38.758 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.758 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.758 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.758 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.762 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "115", 2020-09-08T15:44:38.763 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.763 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.763 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Reset", 2020-09-08T15:44:38.763 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:43:33.486727+0000", 2020-09-08T15:44:38.763 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:43:33.487227+0000" 2020-09-08T15:44:38.764 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.764 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.764 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.764 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.764 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.765 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.765 INFO:tasks.workunit.client.0.smithi065.stdout: "pg": "3.0", 2020-09-08T15:44:38.765 INFO:tasks.workunit.client.0.smithi065.stdout: "currently": "Started/Primary/Active/Clean", 2020-09-08T15:44:38.765 INFO:tasks.workunit.client.0.smithi065.stdout: "history": [ 2020-09-08T15:44:38.765 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.767 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "41", 2020-09-08T15:44:38.768 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.768 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.768 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Start", 2020-09-08T15:44:38.768 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:02.290038+0000", 2020-09-08T15:44:38.768 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:02.290055+0000" 2020-09-08T15:44:38.769 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.769 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.769 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetInfo", 2020-09-08T15:44:38.769 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:02.290067+0000", 2020-09-08T15:44:38.769 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:02.465661+0000" 2020-09-08T15:44:38.770 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.770 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.770 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetLog", 2020-09-08T15:44:38.771 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:02.465661+0000", 2020-09-08T15:44:38.771 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:02.465738+0000" 2020-09-08T15:44:38.771 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.772 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.772 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetMissing", 2020-09-08T15:44:38.772 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:02.465738+0000", 2020-09-08T15:44:38.777 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:02.465758+0000" 2020-09-08T15:44:38.778 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.778 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.778 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2020-09-08T15:44:38.779 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:02.465759+0000", 2020-09-08T15:44:38.779 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:02.814066+0000" 2020-09-08T15:44:38.779 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.780 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.780 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering", 2020-09-08T15:44:38.781 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:02.290061+0000", 2020-09-08T15:44:38.781 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:02.814074+0000" 2020-09-08T15:44:38.781 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.782 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.788 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Activating", 2020-09-08T15:44:38.789 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:02.814248+0000", 2020-09-08T15:44:38.789 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:03.400486+0000" 2020-09-08T15:44:38.790 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.791 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.791 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Recovered", 2020-09-08T15:44:38.791 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:03.400487+0000", 2020-09-08T15:44:38.792 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:03.400573+0000" 2020-09-08T15:44:38.792 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.792 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.793 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Clean", 2020-09-08T15:44:38.793 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:03.400574+0000", 2020-09-08T15:44:38.793 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:04.181909+0000" 2020-09-08T15:44:38.794 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.794 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.794 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active", 2020-09-08T15:44:38.795 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:02.814075+0000", 2020-09-08T15:44:38.795 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:04.181927+0000" 2020-09-08T15:44:38.795 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.796 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.796 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary", 2020-09-08T15:44:38.796 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:02.290056+0000", 2020-09-08T15:44:38.797 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:04.181942+0000" 2020-09-08T15:44:38.797 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.797 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.798 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started", 2020-09-08T15:44:38.798 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:02.290026+0000", 2020-09-08T15:44:38.798 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:04.181945+0000" 2020-09-08T15:44:38.799 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.799 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.799 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.800 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.800 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "42", 2020-09-08T15:44:38.800 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.801 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.801 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Reset", 2020-09-08T15:44:38.802 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:04.181945+0000", 2020-09-08T15:44:38.802 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:04.182179+0000" 2020-09-08T15:44:38.802 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.802 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.803 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.803 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.803 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "89", 2020-09-08T15:44:38.804 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.805 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.805 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Start", 2020-09-08T15:44:38.805 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:04.182182+0000", 2020-09-08T15:44:38.805 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:04.182195+0000" 2020-09-08T15:44:38.806 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.806 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.806 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetInfo", 2020-09-08T15:44:38.806 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:04.182202+0000", 2020-09-08T15:44:38.807 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:04.366434+0000" 2020-09-08T15:44:38.807 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.808 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.808 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetLog", 2020-09-08T15:44:38.808 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:04.366435+0000", 2020-09-08T15:44:38.808 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:04.366493+0000" 2020-09-08T15:44:38.808 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.809 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.809 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetMissing", 2020-09-08T15:44:38.809 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:04.366493+0000", 2020-09-08T15:44:38.809 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:04.366505+0000" 2020-09-08T15:44:38.810 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.810 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.810 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2020-09-08T15:44:38.811 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:04.366506+0000", 2020-09-08T15:44:38.811 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:04.617269+0000" 2020-09-08T15:44:38.812 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.812 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.813 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering", 2020-09-08T15:44:38.813 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:04.182198+0000", 2020-09-08T15:44:38.813 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:04.617276+0000" 2020-09-08T15:44:38.814 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.814 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.815 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Activating", 2020-09-08T15:44:38.815 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:04.617406+0000", 2020-09-08T15:44:38.816 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:05.087114+0000" 2020-09-08T15:44:38.816 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.816 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.817 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Recovered", 2020-09-08T15:44:38.817 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:05.087114+0000", 2020-09-08T15:44:38.819 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:05.087162+0000" 2020-09-08T15:44:38.820 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.820 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.820 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Clean", 2020-09-08T15:44:38.821 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:05.087163+0000", 2020-09-08T15:44:38.821 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:42.960197+0000" 2020-09-08T15:44:38.821 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.822 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.822 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active", 2020-09-08T15:44:38.823 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:04.617277+0000", 2020-09-08T15:44:38.828 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:42.960215+0000" 2020-09-08T15:44:38.828 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.828 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.829 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary", 2020-09-08T15:44:38.829 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:04.182195+0000", 2020-09-08T15:44:38.829 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:42.960226+0000" 2020-09-08T15:44:38.830 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.830 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.830 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started", 2020-09-08T15:44:38.831 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:04.182179+0000", 2020-09-08T15:44:38.831 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:42.960229+0000" 2020-09-08T15:44:38.831 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.832 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.833 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.835 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.835 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "92", 2020-09-08T15:44:38.836 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.837 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.838 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Reset", 2020-09-08T15:44:38.839 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:42.960230+0000", 2020-09-08T15:44:38.839 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:42.960460+0000" 2020-09-08T15:44:38.840 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.840 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.840 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.841 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.841 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "107", 2020-09-08T15:44:38.842 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.842 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.843 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Start", 2020-09-08T15:44:38.843 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:42.960464+0000", 2020-09-08T15:44:38.843 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:42.960475+0000" 2020-09-08T15:44:38.844 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.844 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.844 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetInfo", 2020-09-08T15:44:38.845 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:42.960481+0000", 2020-09-08T15:44:38.845 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:43.077069+0000" 2020-09-08T15:44:38.845 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.846 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.846 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetLog", 2020-09-08T15:44:38.846 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:43.077070+0000", 2020-09-08T15:44:38.847 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:43.077180+0000" 2020-09-08T15:44:38.847 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.847 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.848 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetMissing", 2020-09-08T15:44:38.848 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:43.077180+0000", 2020-09-08T15:44:38.848 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:43.077205+0000" 2020-09-08T15:44:38.849 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.850 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.850 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2020-09-08T15:44:38.850 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:43.077205+0000", 2020-09-08T15:44:38.851 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:43.370175+0000" 2020-09-08T15:44:38.851 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.851 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.852 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering", 2020-09-08T15:44:38.853 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:42.960478+0000", 2020-09-08T15:44:38.853 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:43.370181+0000" 2020-09-08T15:44:38.853 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.854 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.854 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Activating", 2020-09-08T15:44:38.854 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:43.370235+0000", 2020-09-08T15:44:38.854 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:43.563069+0000" 2020-09-08T15:44:38.854 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.855 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.855 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Recovered", 2020-09-08T15:44:38.855 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:43.563069+0000", 2020-09-08T15:44:38.855 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:40:43.563161+0000" 2020-09-08T15:44:38.855 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.856 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.856 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Clean", 2020-09-08T15:44:38.856 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:43.563161+0000", 2020-09-08T15:44:38.856 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:32.461163+0000" 2020-09-08T15:44:38.856 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.857 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.857 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active", 2020-09-08T15:44:38.857 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:43.370181+0000", 2020-09-08T15:44:38.857 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:32.461195+0000" 2020-09-08T15:44:38.857 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.858 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.859 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary", 2020-09-08T15:44:38.859 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:42.960475+0000", 2020-09-08T15:44:38.859 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:32.461259+0000" 2020-09-08T15:44:38.859 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.859 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.860 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started", 2020-09-08T15:44:38.860 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:40:42.960460+0000", 2020-09-08T15:44:38.860 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:32.461263+0000" 2020-09-08T15:44:38.860 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.860 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.860 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.861 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.861 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "108", 2020-09-08T15:44:38.861 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.861 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.862 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Reset", 2020-09-08T15:44:38.862 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:32.461263+0000", 2020-09-08T15:44:38.863 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:32.461663+0000" 2020-09-08T15:44:38.864 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.864 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.864 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.864 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.865 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "109", 2020-09-08T15:44:38.865 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.865 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.865 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Start", 2020-09-08T15:44:38.865 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:32.461670+0000", 2020-09-08T15:44:38.866 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:32.461684+0000" 2020-09-08T15:44:38.866 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.866 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.866 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetInfo", 2020-09-08T15:44:38.866 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:32.461694+0000", 2020-09-08T15:44:38.866 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:32.462264+0000" 2020-09-08T15:44:38.867 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.867 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.867 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetLog", 2020-09-08T15:44:38.867 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:32.462265+0000", 2020-09-08T15:44:38.867 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:32.462331+0000" 2020-09-08T15:44:38.868 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.868 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.868 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering", 2020-09-08T15:44:38.868 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:32.461689+0000", 2020-09-08T15:44:38.868 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:32.462339+0000" 2020-09-08T15:44:38.869 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.869 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.869 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/WaitActingChange", 2020-09-08T15:44:38.869 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:32.462339+0000", 2020-09-08T15:44:38.869 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:32.725188+0000" 2020-09-08T15:44:38.869 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.870 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.870 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary", 2020-09-08T15:44:38.870 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:32.461685+0000", 2020-09-08T15:44:38.870 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:32.725208+0000" 2020-09-08T15:44:38.870 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.871 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.871 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started", 2020-09-08T15:44:38.871 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:32.461664+0000", 2020-09-08T15:44:38.871 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:32.725212+0000" 2020-09-08T15:44:38.871 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.872 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.872 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.872 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.872 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "109", 2020-09-08T15:44:38.872 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.872 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.873 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Reset", 2020-09-08T15:44:38.873 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:32.725212+0000", 2020-09-08T15:44:38.873 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:32.725418+0000" 2020-09-08T15:44:38.873 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.874 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.874 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.874 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.875 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "117", 2020-09-08T15:44:38.875 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.875 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.875 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Start", 2020-09-08T15:44:38.875 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:32.725423+0000", 2020-09-08T15:44:38.876 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:32.725435+0000" 2020-09-08T15:44:38.876 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.876 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.876 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetInfo", 2020-09-08T15:44:38.876 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:32.725444+0000", 2020-09-08T15:44:38.876 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:32.725973+0000" 2020-09-08T15:44:38.877 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.877 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.877 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetLog", 2020-09-08T15:44:38.877 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:32.725974+0000", 2020-09-08T15:44:38.878 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:32.726051+0000" 2020-09-08T15:44:38.878 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.878 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.878 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetMissing", 2020-09-08T15:44:38.878 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:32.726051+0000", 2020-09-08T15:44:38.878 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:32.726071+0000" 2020-09-08T15:44:38.879 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.879 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.879 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2020-09-08T15:44:38.879 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:32.726071+0000", 2020-09-08T15:44:38.879 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:32.984717+0000" 2020-09-08T15:44:38.880 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.880 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.880 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering", 2020-09-08T15:44:38.880 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:32.725440+0000", 2020-09-08T15:44:38.880 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:32.984729+0000" 2020-09-08T15:44:38.881 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.881 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.881 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Activating", 2020-09-08T15:44:38.881 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:32.985018+0000", 2020-09-08T15:44:38.881 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:33.745716+0000" 2020-09-08T15:44:38.882 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.882 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.882 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/WaitLocalBackfillReserved", 2020-09-08T15:44:38.882 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:33.745717+0000", 2020-09-08T15:44:38.883 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:45.757839+0000" 2020-09-08T15:44:38.883 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.883 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.883 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/WaitRemoteBackfillReserved", 2020-09-08T15:44:38.883 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:45.757839+0000", 2020-09-08T15:44:38.883 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:45.758204+0000" 2020-09-08T15:44:38.884 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.884 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.885 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Backfilling", 2020-09-08T15:44:38.885 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:45.758205+0000", 2020-09-08T15:44:38.885 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:58.344984+0000" 2020-09-08T15:44:38.885 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.885 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.886 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/NotBackfilling", 2020-09-08T15:44:38.886 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:58.344985+0000", 2020-09-08T15:44:38.886 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:58.345184+0000" 2020-09-08T15:44:38.886 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.886 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.887 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/WaitLocalBackfillReserved", 2020-09-08T15:44:38.887 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:58.345184+0000", 2020-09-08T15:44:38.887 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:43:33.079505+0000" 2020-09-08T15:44:38.887 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.887 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.888 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/WaitRemoteBackfillReserved", 2020-09-08T15:44:38.888 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:43:33.079506+0000", 2020-09-08T15:44:38.888 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:43:33.079910+0000" 2020-09-08T15:44:38.888 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.888 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.889 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Backfilling", 2020-09-08T15:44:38.889 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:43:33.079911+0000", 2020-09-08T15:44:38.889 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:44:01.584256+0000" 2020-09-08T15:44:38.889 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.890 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.890 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Recovered", 2020-09-08T15:44:38.890 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:44:01.584256+0000", 2020-09-08T15:44:38.891 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:44:01.584383+0000" 2020-09-08T15:44:38.891 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.891 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.891 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Clean", 2020-09-08T15:44:38.891 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:44:01.584383+0000", 2020-09-08T15:44:38.891 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:44:01.872231+0000" 2020-09-08T15:44:38.892 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.892 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.892 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active", 2020-09-08T15:44:38.892 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:32.984730+0000", 2020-09-08T15:44:38.892 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:44:01.872270+0000" 2020-09-08T15:44:38.893 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.893 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.893 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary", 2020-09-08T15:44:38.893 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:32.725435+0000", 2020-09-08T15:44:38.893 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:44:01.872304+0000" 2020-09-08T15:44:38.894 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.894 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.894 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started", 2020-09-08T15:44:38.895 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:32.725419+0000", 2020-09-08T15:44:38.895 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:44:01.872310+0000" 2020-09-08T15:44:38.895 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.896 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.896 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.896 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.896 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "117", 2020-09-08T15:44:38.896 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.897 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.897 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Reset", 2020-09-08T15:44:38.897 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:44:01.872311+0000", 2020-09-08T15:44:38.897 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:44:01.872582+0000" 2020-09-08T15:44:38.897 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.898 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.898 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.898 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.898 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.898 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.898 INFO:tasks.workunit.client.0.smithi065.stdout: "pg": "1.0", 2020-09-08T15:44:38.899 INFO:tasks.workunit.client.0.smithi065.stdout: "currently": "Started/Primary/Active/Clean", 2020-09-08T15:44:38.899 INFO:tasks.workunit.client.0.smithi065.stdout: "history": [ 2020-09-08T15:44:38.899 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.899 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "27", 2020-09-08T15:44:38.899 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.900 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.900 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Initial", 2020-09-08T15:44:38.900 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:57.074674+0000", 2020-09-08T15:44:38.900 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:57.074781+0000" 2020-09-08T15:44:38.901 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.901 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.901 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.901 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.902 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "27", 2020-09-08T15:44:38.902 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.902 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.902 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Reset", 2020-09-08T15:44:38.902 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:57.074781+0000", 2020-09-08T15:44:38.903 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:57.074813+0000" 2020-09-08T15:44:38.903 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.903 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.903 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.903 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.903 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "30", 2020-09-08T15:44:38.904 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.904 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.904 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Start", 2020-09-08T15:44:38.904 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:57.074816+0000", 2020-09-08T15:44:38.904 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:57.074826+0000" 2020-09-08T15:44:38.905 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.905 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.905 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetInfo", 2020-09-08T15:44:38.906 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:57.074834+0000", 2020-09-08T15:44:38.906 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:57.167363+0000" 2020-09-08T15:44:38.906 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.906 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.906 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetLog", 2020-09-08T15:44:38.907 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:57.167364+0000", 2020-09-08T15:44:38.907 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:57.167483+0000" 2020-09-08T15:44:38.907 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.907 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.907 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetMissing", 2020-09-08T15:44:38.908 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:57.167483+0000", 2020-09-08T15:44:38.908 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:57.167495+0000" 2020-09-08T15:44:38.908 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.908 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.908 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2020-09-08T15:44:38.909 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:57.167495+0000", 2020-09-08T15:44:38.909 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:57.403058+0000" 2020-09-08T15:44:38.909 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.909 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.909 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering", 2020-09-08T15:44:38.909 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:57.074831+0000", 2020-09-08T15:44:38.910 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:57.403066+0000" 2020-09-08T15:44:38.910 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.910 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.910 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Activating", 2020-09-08T15:44:38.910 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:57.403213+0000", 2020-09-08T15:44:38.911 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:57.912979+0000" 2020-09-08T15:44:38.911 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.911 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.911 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Recovered", 2020-09-08T15:44:38.911 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:57.912980+0000", 2020-09-08T15:44:38.912 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:57.913032+0000" 2020-09-08T15:44:38.912 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.912 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.912 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Clean", 2020-09-08T15:44:38.912 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:57.913032+0000", 2020-09-08T15:44:38.912 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:58.615528+0000" 2020-09-08T15:44:38.913 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.913 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.913 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active", 2020-09-08T15:44:38.913 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:57.403066+0000", 2020-09-08T15:44:38.913 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:58.615543+0000" 2020-09-08T15:44:38.914 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.914 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.914 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary", 2020-09-08T15:44:38.914 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:57.074826+0000", 2020-09-08T15:44:38.915 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:58.615555+0000" 2020-09-08T15:44:38.915 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.915 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.916 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started", 2020-09-08T15:44:38.917 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:57.074814+0000", 2020-09-08T15:44:38.917 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:58.615559+0000" 2020-09-08T15:44:38.917 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.918 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.918 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.918 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.919 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "30", 2020-09-08T15:44:38.919 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.919 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.920 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Reset", 2020-09-08T15:44:38.920 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:58.615560+0000", 2020-09-08T15:44:38.920 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:58.615740+0000" 2020-09-08T15:44:38.921 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.921 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.921 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.922 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.922 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "103", 2020-09-08T15:44:38.922 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.923 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.923 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Start", 2020-09-08T15:44:38.923 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:58.615743+0000", 2020-09-08T15:44:38.923 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:58.615753+0000" 2020-09-08T15:44:38.924 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.924 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.925 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetInfo", 2020-09-08T15:44:38.925 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:58.615760+0000", 2020-09-08T15:44:38.925 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:58.770856+0000" 2020-09-08T15:44:38.926 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.926 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.928 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetLog", 2020-09-08T15:44:38.928 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:58.770857+0000", 2020-09-08T15:44:38.928 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:58.770930+0000" 2020-09-08T15:44:38.929 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.929 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.929 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetMissing", 2020-09-08T15:44:38.930 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:58.770930+0000", 2020-09-08T15:44:38.930 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:58.770942+0000" 2020-09-08T15:44:38.930 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.931 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.931 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2020-09-08T15:44:38.931 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:58.770942+0000", 2020-09-08T15:44:38.932 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:59.235270+0000" 2020-09-08T15:44:38.932 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.932 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.933 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering", 2020-09-08T15:44:38.933 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:58.615757+0000", 2020-09-08T15:44:38.933 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:59.235277+0000" 2020-09-08T15:44:38.934 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.934 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.934 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Activating", 2020-09-08T15:44:38.934 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:59.235396+0000", 2020-09-08T15:44:38.935 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:59.732292+0000" 2020-09-08T15:44:38.935 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.935 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.936 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Recovered", 2020-09-08T15:44:38.936 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:59.732292+0000", 2020-09-08T15:44:38.936 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:39:59.732340+0000" 2020-09-08T15:44:38.937 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.938 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.938 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Clean", 2020-09-08T15:44:38.938 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:59.732340+0000", 2020-09-08T15:44:38.939 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:23.999908+0000" 2020-09-08T15:44:38.939 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.939 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.940 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active", 2020-09-08T15:44:38.940 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:59.235278+0000", 2020-09-08T15:44:38.940 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:23.999947+0000" 2020-09-08T15:44:38.941 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.941 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.941 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary", 2020-09-08T15:44:38.942 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:58.615754+0000", 2020-09-08T15:44:38.942 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:24.000006+0000" 2020-09-08T15:44:38.942 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.943 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.943 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started", 2020-09-08T15:44:38.943 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:39:58.615740+0000", 2020-09-08T15:44:38.944 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:24.000013+0000" 2020-09-08T15:44:38.944 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.944 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.945 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.945 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.945 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "103", 2020-09-08T15:44:38.946 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.946 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.946 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Reset", 2020-09-08T15:44:38.947 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:24.000013+0000", 2020-09-08T15:44:38.947 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:24.000465+0000" 2020-09-08T15:44:38.948 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.948 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.949 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.949 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.950 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "105", 2020-09-08T15:44:38.950 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.951 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.951 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Start", 2020-09-08T15:44:38.951 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:24.000472+0000", 2020-09-08T15:44:38.951 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:24.000500+0000" 2020-09-08T15:44:38.952 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.952 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.952 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetInfo", 2020-09-08T15:44:38.953 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:24.000517+0000", 2020-09-08T15:44:38.953 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:24.092545+0000" 2020-09-08T15:44:38.954 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.954 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.954 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetLog", 2020-09-08T15:44:38.955 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:24.092546+0000", 2020-09-08T15:44:38.955 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:24.092663+0000" 2020-09-08T15:44:38.955 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.956 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.956 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering", 2020-09-08T15:44:38.956 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:24.000509+0000", 2020-09-08T15:44:38.957 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:24.092680+0000" 2020-09-08T15:44:38.957 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.958 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.959 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/WaitActingChange", 2020-09-08T15:44:38.959 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:24.092680+0000", 2020-09-08T15:44:38.959 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:24.427624+0000" 2020-09-08T15:44:38.960 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.960 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.960 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary", 2020-09-08T15:44:38.960 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:24.000500+0000", 2020-09-08T15:44:38.960 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:24.427638+0000" 2020-09-08T15:44:38.961 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.961 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.961 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started", 2020-09-08T15:44:38.961 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:24.000465+0000", 2020-09-08T15:44:38.961 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:24.427642+0000" 2020-09-08T15:44:38.962 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.962 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.962 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.962 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.962 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "105", 2020-09-08T15:44:38.963 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.963 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.963 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Reset", 2020-09-08T15:44:38.963 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:24.427642+0000", 2020-09-08T15:44:38.963 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:24.427868+0000" 2020-09-08T15:44:38.964 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.964 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.964 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.964 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.964 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "119", 2020-09-08T15:44:38.964 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.965 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.965 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Start", 2020-09-08T15:44:38.965 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:24.427872+0000", 2020-09-08T15:44:38.965 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:24.427890+0000" 2020-09-08T15:44:38.966 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.966 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.966 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetInfo", 2020-09-08T15:44:38.966 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:24.427901+0000", 2020-09-08T15:44:38.966 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:24.603954+0000" 2020-09-08T15:44:38.967 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.967 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.967 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetLog", 2020-09-08T15:44:38.967 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:24.603954+0000", 2020-09-08T15:44:38.967 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:24.604055+0000" 2020-09-08T15:44:38.967 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.968 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.968 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/GetMissing", 2020-09-08T15:44:38.968 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:24.604056+0000", 2020-09-08T15:44:38.968 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:24.604081+0000" 2020-09-08T15:44:38.968 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.969 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.969 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2020-09-08T15:44:38.969 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:24.604082+0000", 2020-09-08T15:44:38.969 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:24.788723+0000" 2020-09-08T15:44:38.970 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.970 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.970 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Peering", 2020-09-08T15:44:38.970 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:24.427897+0000", 2020-09-08T15:44:38.970 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:24.788737+0000" 2020-09-08T15:44:38.971 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.971 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.971 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Activating", 2020-09-08T15:44:38.971 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:24.789110+0000", 2020-09-08T15:44:38.971 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:42:24.998958+0000" 2020-09-08T15:44:38.971 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.972 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.972 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/WaitLocalBackfillReserved", 2020-09-08T15:44:38.972 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:24.998958+0000", 2020-09-08T15:44:38.972 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:44:01.584541+0000" 2020-09-08T15:44:38.972 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.973 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.973 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/WaitRemoteBackfillReserved", 2020-09-08T15:44:38.973 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:44:01.584541+0000", 2020-09-08T15:44:38.973 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:44:01.584990+0000" 2020-09-08T15:44:38.973 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.974 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.974 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Backfilling", 2020-09-08T15:44:38.974 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:44:01.584992+0000", 2020-09-08T15:44:38.974 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:44:32.013609+0000" 2020-09-08T15:44:38.974 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.974 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.975 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Recovered", 2020-09-08T15:44:38.975 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:44:32.013610+0000", 2020-09-08T15:44:38.975 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:44:32.013881+0000" 2020-09-08T15:44:38.975 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.975 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.976 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active/Clean", 2020-09-08T15:44:38.976 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:44:32.013882+0000", 2020-09-08T15:44:38.976 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:44:32.334756+0000" 2020-09-08T15:44:38.976 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.976 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.976 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary/Active", 2020-09-08T15:44:38.977 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:24.788737+0000", 2020-09-08T15:44:38.977 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:44:32.334778+0000" 2020-09-08T15:44:38.977 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.977 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.977 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started/Primary", 2020-09-08T15:44:38.978 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:24.427891+0000", 2020-09-08T15:44:38.978 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:44:32.334797+0000" 2020-09-08T15:44:38.978 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.978 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.978 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Started", 2020-09-08T15:44:38.979 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:42:24.427868+0000", 2020-09-08T15:44:38.979 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:44:32.334802+0000" 2020-09-08T15:44:38.979 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.979 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.979 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:44:38.980 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.980 INFO:tasks.workunit.client.0.smithi065.stdout: "epoch": "119", 2020-09-08T15:44:38.980 INFO:tasks.workunit.client.0.smithi065.stdout: "states": [ 2020-09-08T15:44:38.981 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:44:38.981 INFO:tasks.workunit.client.0.smithi065.stdout: "state": "Reset", 2020-09-08T15:44:38.981 INFO:tasks.workunit.client.0.smithi065.stdout: "enter": "2020-09-08T15:44:32.334803+0000", 2020-09-08T15:44:38.981 INFO:tasks.workunit.client.0.smithi065.stdout: "exit": "2020-09-08T15:44:32.335106+0000" 2020-09-08T15:44:38.981 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.984 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.984 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.985 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.985 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:44:38.985 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:44:38.985 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:44:38.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:302: TEST_backfill_priority: '[' 0 '!=' 0 ']' 2020-09-08T15:44:38.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:306: TEST_backfill_priority: echo TEST PASSED 2020-09-08T15:44:38.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:309: TEST_backfill_priority: delete_pool test1 2020-09-08T15:44:38.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test1 2020-09-08T15:44:38.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2020-09-08T15:44:38.994 INFO:tasks.workunit.client.0.smithi065.stdout:TEST PASSED 2020-09-08T15:44:39.180 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test1' does not exist 2020-09-08T15:44:39.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:310: TEST_backfill_priority: delete_pool test3 2020-09-08T15:44:39.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test3 2020-09-08T15:44:39.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test3 test3 --yes-i-really-really-mean-it 2020-09-08T15:44:39.773 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test3' does not exist 2020-09-08T15:44:39.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:311: TEST_backfill_priority: delete_pool test7 2020-09-08T15:44:39.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test7 2020-09-08T15:44:39.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test7 test7 --yes-i-really-really-mean-it 2020-09-08T15:44:40.336 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test7' does not exist 2020-09-08T15:44:40.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:312: TEST_backfill_priority: kill_daemons td/osd-backfill-prio 2020-09-08T15:44:40.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:44:40.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:44:40.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:44:40.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:44:40.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:44:40.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:44:40.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:313: TEST_backfill_priority: return 0 2020-09-08T15:44:40.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-prio.sh:40: run: teardown td/osd-backfill-prio 2020-09-08T15:44:40.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-prio 2020-09-08T15:44:40.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:44:40.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-prio KILL 2020-09-08T15:44:40.466 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:44:40.466 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:44:40.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:44:40.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:44:40.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:44:40.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:44:40.467 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:44:40.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:44:40.467 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:44:40.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:44:40.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:44:40.468 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:44:40.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:44:40.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:44:40.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:44:40.470 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:44:40.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:44:40.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:44:40.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-prio 2020-09-08T15:44:40.497 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:44:40.497 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:44:40.498 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:44:40.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83246 2020-09-08T15:44:40.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:44:40.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:44:40.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2151: main: code=0 2020-09-08T15:44:40.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2155: main: teardown td/osd-backfill-prio 0 2020-09-08T15:44:40.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-prio 2020-09-08T15:44:40.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2020-09-08T15:44:40.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-prio KILL 2020-09-08T15:44:40.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:44:40.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:44:40.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:44:40.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:44:40.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:44:40.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:44:40.501 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:44:40.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:44:40.502 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:44:40.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:44:40.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:44:40.504 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:44:40.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:44:40.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:44:40.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:44:40.505 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:44:40.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:44:40.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2020-09-08T15:44:40.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-prio 2020-09-08T15:44:40.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:44:40.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:44:40.508 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83246 2020-09-08T15:44:40.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83246 2020-09-08T15:44:40.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:44:40.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:44:40.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2156: main: return 0 2020-09-08T15:44:40.512 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-09-08T15:44:40.512 INFO:teuthology.orchestra.run.smithi065:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-09-08T15:44:40.555 INFO:tasks.workunit:Running workunit osd/osd-backfill-recovery-log.sh... 2020-09-08T15:44:40.556 INFO:teuthology.orchestra.run.smithi065:workunit test osd/osd-backfill-recovery-log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dce4d291bd4243c9802c17d67b85a6da6bbc0f8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh 2020-09-08T15:44:40.634 INFO:tasks.workunit.client.0.smithi065.stderr:stty: 'standard input': Inappropriate ioctl for device 2020-09-08T15:44:40.643 INFO:tasks.workunit.client.0.smithi065.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2020-09-08T15:44:40.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T15:44:40.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T15:44:40.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: export PYTHONWARNINGS=ignore 2020-09-08T15:44:40.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: PYTHONWARNINGS=ignore 2020-09-08T15:44:40.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: export CEPH_CONF=/dev/null 2020-09-08T15:44:40.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: CEPH_CONF=/dev/null 2020-09-08T15:44:40.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2147: main: unset CEPH_ARGS 2020-09-08T15:44:40.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2149: main: local code 2020-09-08T15:44:40.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2150: main: run td/osd-backfill-recovery-log 2020-09-08T15:44:40.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:21: run: local dir=td/osd-backfill-recovery-log 2020-09-08T15:44:40.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:22: run: shift 2020-09-08T15:44:40.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:25: run: export CEPH_MON=127.0.0.1:7129 2020-09-08T15:44:40.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:25: run: CEPH_MON=127.0.0.1:7129 2020-09-08T15:44:40.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:26: run: export CEPH_ARGS 2020-09-08T15:44:40.646 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:27: run: uuidgen 2020-09-08T15:44:40.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:27: run: CEPH_ARGS+='--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none ' 2020-09-08T15:44:40.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:44:40.647 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:30: run: set 2020-09-08T15:44:40.647 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:30: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2020-09-08T15:44:40.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:30: run: local 'funcs=TEST_backfill_log_1 2020-09-08T15:44:40.648 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_backfill_log_2 2020-09-08T15:44:40.648 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_recovery_1 2020-09-08T15:44:40.648 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_recovery_2' 2020-09-08T15:44:40.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:31: run: for func in $funcs 2020-09-08T15:44:40.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:32: run: setup td/osd-backfill-recovery-log 2020-09-08T15:44:40.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-recovery-log 2020-09-08T15:44:40.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-recovery-log 2020-09-08T15:44:40.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-recovery-log 2020-09-08T15:44:40.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:44:40.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2020-09-08T15:44:40.650 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:44:40.650 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:44:40.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:44:40.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:44:40.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:44:40.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:44:40.651 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:44:40.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:44:40.651 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:44:40.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:44:40.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:44:40.652 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:44:40.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:44:40.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:44:40.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:44:40.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:44:40.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:44:40.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:44:40.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-recovery-log 2020-09-08T15:44:40.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:44:40.656 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:44:40.656 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:44:40.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.108735 2020-09-08T15:44:40.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:44:40.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:44:40.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-recovery-log 2020-09-08T15:44:40.657 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T15:44:40.657 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:44:40.657 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:44:40.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.108735 2020-09-08T15:44:40.657 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T15:44:40.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2020-09-08T15:44:40.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2020-09-08T15:44:40.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T15:44:40.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-recovery-log 1' TERM HUP INT 2020-09-08T15:44:40.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:33: run: TEST_backfill_log_1 td/osd-backfill-recovery-log 2020-09-08T15:44:40.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:105: TEST_backfill_log_1: local dir=td/osd-backfill-recovery-log 2020-09-08T15:44:40.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:107: TEST_backfill_log_1: _common_test td/osd-backfill-recovery-log '--osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2 8 150 2020-09-08T15:44:40.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:40: _common_test: local dir=td/osd-backfill-recovery-log 2020-09-08T15:44:40.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:41: _common_test: local 'extra_opts=--osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2020-09-08T15:44:40.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:42: _common_test: local loglen=2 2020-09-08T15:44:40.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:43: _common_test: local dupslen=8 2020-09-08T15:44:40.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:44: _common_test: local objects=150 2020-09-08T15:44:40.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:45: _common_test: local moreobjects=0 2020-09-08T15:44:40.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:47: _common_test: local OSDS=6 2020-09-08T15:44:40.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:49: _common_test: run_mon td/osd-backfill-recovery-log a 2020-09-08T15:44:40.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-recovery-log 2020-09-08T15:44:40.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T15:44:40.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T15:44:40.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T15:44:40.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-recovery-log/a 2020-09-08T15:44:40.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-recovery-log/a --run-dir=td/osd-backfill-recovery-log 2020-09-08T15:44:40.943 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T15:44:40.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:44:40.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:44:40.944 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:44:40.944 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:44:40.944 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:44:40.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:44:40.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-recovery-log/a '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-recovery-log/log --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T15:44:41.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T15:44:41.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T15:44:41.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:44:41.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:44:41.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T15:44:41.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T15:44:41.138 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:44:41.138 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:44:41.138 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:44:41.139 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:44:41.139 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:44:41.140 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:44:41.140 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.108735/ceph-mon.a.asok 2020-09-08T15:44:41.141 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:44:41.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.108735/ceph-mon.a.asok config get fsid 2020-09-08T15:44:41.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T15:44:41.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:44:41.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:44:41.216 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T15:44:41.216 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T15:44:41.216 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:44:41.216 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:44:41.216 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:44:41.217 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:44:41.217 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:44:41.217 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:44:41.217 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.108735/ceph-mon.a.asok 2020-09-08T15:44:41.217 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:44:41.218 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.108735/ceph-mon.a.asok config get mon_host 2020-09-08T15:44:41.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:50: _common_test: run_mgr td/osd-backfill-recovery-log x 2020-09-08T15:44:41.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-recovery-log 2020-09-08T15:44:41.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T15:44:41.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T15:44:41.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T15:44:41.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-recovery-log/x 2020-09-08T15:44:41.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T15:44:42.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T15:44:42.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:44:42.210 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:44:42.210 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:44:42.210 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:44:42.211 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:44:42.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:44:42.212 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:44:42.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-recovery-log/x '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:44:42.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:51: _common_test: export CEPH_ARGS 2020-09-08T15:44:42.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:52: _common_test: export 'EXTRA_OPTS= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2020-09-08T15:44:42.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:52: _common_test: EXTRA_OPTS=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2020-09-08T15:44:42.239 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: expr 6 - 1 2020-09-08T15:44:42.239 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: seq 0 5 2020-09-08T15:44:42.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:44:42.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 0 2020-09-08T15:44:42.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:44:42.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:44:42.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T15:44:42.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:44:42.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/0 2020-09-08T15:44:42.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:44:42.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:44:42.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:44:42.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:44:42.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/0' 2020-09-08T15:44:42.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/0/journal' 2020-09-08T15:44:42.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:44:42.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2020-09-08T15:44:42.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:44:42.244 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:44:42.244 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:44:42.245 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:44:42.245 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:44:42.245 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:44:42.246 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:44:42.246 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:44:42.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:44:42.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:44:42.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:44:42.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:44:42.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:44:42.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:44:42.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:44:42.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:44:42.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:44:42.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:44:42.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:44:42.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/0 2020-09-08T15:44:42.266 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:44:42.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=a98d686d-e57f-4a4b-8bdd-1597976f960d 2020-09-08T15:44:42.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 a98d686d-e57f-4a4b-8bdd-1597976f960d' 2020-09-08T15:44:42.266 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:44:42.267 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 a98d686d-e57f-4a4b-8bdd-1597976f960d 2020-09-08T15:44:42.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDqpldfU5NFDxAA/Jr3iSn5RBYj2Z0i3mRV5w== 2020-09-08T15:44:42.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDqpldfU5NFDxAA/Jr3iSn5RBYj2Z0i3mRV5w=="}' 2020-09-08T15:44:42.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new a98d686d-e57f-4a4b-8bdd-1597976f960d -i td/osd-backfill-recovery-log/0/new.json 2020-09-08T15:44:42.615 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:44:42.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/0/new.json 2020-09-08T15:44:42.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDqpldfU5NFDxAA/Jr3iSn5RBYj2Z0i3mRV5w== --osd-uuid a98d686d-e57f-4a4b-8bdd-1597976f960d 2020-09-08T15:44:42.651 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:42.654+0000 7fa99511aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:44:42.652 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:42.656+0000 7fa99511aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:44:42.653 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:42.657+0000 7fa99511aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:44:42.653 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:42.657+0000 7fa99511aec0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2020-09-08T15:44:42.653 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:42.657+0000 7fa99511aec0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2020-09-08T15:44:42.653 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:42.657+0000 7fa99511aec0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2020-09-08T15:44:42.694 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:42.698+0000 7fa99511aec0 -1 bluestore(td/osd-backfill-recovery-log/0) _read_fsid unparsable uuid 2020-09-08T15:44:46.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/0/keyring 2020-09-08T15:44:46.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:44:46.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T15:44:46.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:44:46.894 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T15:44:47.423 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T15:44:47.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T15:44:47.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:44:47.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:44:47.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:44:47.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:44:47.447 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:47.451+0000 7f58bf56dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:44:47.467 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:47.471+0000 7f58bf56dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:44:47.468 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:47.472+0000 7f58bf56dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:44:47.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T15:44:47.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:44:47.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:44:47.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:44:47.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:44:47.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:44:47.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:44:47.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:44:47.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:44:47.819 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:44:47.984 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:47.987+0000 7f58bf56dec0 -1 Falling back to public interface 2020-09-08T15:44:48.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:44:48.764 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:48.764+0000 7f58bf56dec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T15:44:49.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:44:49.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:44:49.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:44:49.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:44:49.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:44:49.267 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:44:49.667 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/109604,v1:127.0.0.1:6803/109604] [v2:127.0.0.1:6804/109604,v1:127.0.0.1:6805/109604] exists,up a98d686d-e57f-4a4b-8bdd-1597976f960d 2020-09-08T15:44:49.667 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 6d4ab518-c51d-46db-9093-98228fca2eb0 2020-09-08T15:44:49.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:44:49.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:44:49.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:44:49.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:44:49.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 1 2020-09-08T15:44:49.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:44:49.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:44:49.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T15:44:49.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:44:49.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/1 2020-09-08T15:44:49.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:44:49.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:44:49.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:44:49.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:44:49.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/1' 2020-09-08T15:44:49.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/1/journal' 2020-09-08T15:44:49.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:44:49.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2020-09-08T15:44:49.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:44:49.672 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:44:49.672 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:44:49.672 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:44:49.673 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:44:49.673 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:44:49.673 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:44:49.673 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:44:49.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:44:49.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:44:49.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:44:49.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:44:49.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:44:49.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:44:49.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:44:49.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:44:49.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:44:49.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:44:49.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:44:49.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/1 2020-09-08T15:44:49.676 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:44:49.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=6d4ab518-c51d-46db-9093-98228fca2eb0 2020-09-08T15:44:49.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 6d4ab518-c51d-46db-9093-98228fca2eb0' 2020-09-08T15:44:49.676 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:44:49.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDxpldfnADrKBAAeT8XIAyB4JtbPKNVS6oZ2g== 2020-09-08T15:44:49.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDxpldfnADrKBAAeT8XIAyB4JtbPKNVS6oZ2g=="}' 2020-09-08T15:44:49.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 6d4ab518-c51d-46db-9093-98228fca2eb0 -i td/osd-backfill-recovery-log/1/new.json 2020-09-08T15:44:50.231 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:44:50.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/1/new.json 2020-09-08T15:44:50.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDxpldfnADrKBAAeT8XIAyB4JtbPKNVS6oZ2g== --osd-uuid 6d4ab518-c51d-46db-9093-98228fca2eb0 2020-09-08T15:44:50.268 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:50.272+0000 7ff7a1604ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:44:50.269 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:50.274+0000 7ff7a1604ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:44:50.271 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:50.275+0000 7ff7a1604ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:44:50.271 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:50.276+0000 7ff7a1604ec0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2020-09-08T15:44:50.272 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:50.276+0000 7ff7a1604ec0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2020-09-08T15:44:50.272 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:50.276+0000 7ff7a1604ec0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2020-09-08T15:44:50.307 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:50.312+0000 7ff7a1604ec0 -1 bluestore(td/osd-backfill-recovery-log/1) _read_fsid unparsable uuid 2020-09-08T15:44:54.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/1/keyring 2020-09-08T15:44:54.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:44:54.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T15:44:54.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:44:54.246 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T15:44:54.772 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:44:54.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T15:44:54.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:44:54.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:44:54.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:44:54.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:44:54.797 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:54.801+0000 7f1d7e37cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:44:54.826 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:54.826+0000 7f1d7e37cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:44:54.827 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:54.828+0000 7f1d7e37cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:44:55.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T15:44:55.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:44:55.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:44:55.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:44:55.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:44:55.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:44:55.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:44:55.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:44:55.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:44:55.166 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:44:55.339 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:55.344+0000 7f1d7e37cec0 -1 Falling back to public interface 2020-09-08T15:44:55.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:44:56.238 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:56.243+0000 7f1d7e37cec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T15:44:56.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:44:56.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:44:56.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:44:56.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:44:56.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:44:56.594 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:44:57.087 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/110598,v1:127.0.0.1:6811/110598] [v2:127.0.0.1:6812/110598,v1:127.0.0.1:6813/110598] exists,up 6d4ab518-c51d-46db-9093-98228fca2eb0 2020-09-08T15:44:57.088 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 47ec3ce1-c8e1-4d69-8012-7da42e1cccac 2020-09-08T15:44:57.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:44:57.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:44:57.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:44:57.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:44:57.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 2 2020-09-08T15:44:57.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:44:57.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:44:57.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T15:44:57.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:44:57.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/2 2020-09-08T15:44:57.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:44:57.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:44:57.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:44:57.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:44:57.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/2' 2020-09-08T15:44:57.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/2/journal' 2020-09-08T15:44:57.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:44:57.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2020-09-08T15:44:57.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:44:57.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:44:57.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:44:57.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:44:57.100 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:44:57.100 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:44:57.100 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:44:57.100 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:44:57.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:44:57.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:44:57.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:44:57.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:44:57.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:44:57.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:44:57.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:44:57.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:44:57.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:44:57.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:44:57.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:44:57.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/2 2020-09-08T15:44:57.108 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:44:57.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=47ec3ce1-c8e1-4d69-8012-7da42e1cccac 2020-09-08T15:44:57.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 47ec3ce1-c8e1-4d69-8012-7da42e1cccac' 2020-09-08T15:44:57.109 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:44:57.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQD5pldfIF92BRAAshvl0raMR+dqokk6y+1xFg== 2020-09-08T15:44:57.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQD5pldfIF92BRAAshvl0raMR+dqokk6y+1xFg=="}' 2020-09-08T15:44:57.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 47ec3ce1-c8e1-4d69-8012-7da42e1cccac -i td/osd-backfill-recovery-log/2/new.json 2020-09-08T15:44:57.655 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T15:44:57.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/2/new.json 2020-09-08T15:44:57.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQD5pldfIF92BRAAshvl0raMR+dqokk6y+1xFg== --osd-uuid 47ec3ce1-c8e1-4d69-8012-7da42e1cccac 2020-09-08T15:44:57.692 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:57.696+0000 7fa5611ffec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:44:57.693 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:57.698+0000 7fa5611ffec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:44:57.695 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:57.699+0000 7fa5611ffec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:44:57.695 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:57.699+0000 7fa5611ffec0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2020-09-08T15:44:57.696 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:57.699+0000 7fa5611ffec0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2020-09-08T15:44:57.696 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:57.699+0000 7fa5611ffec0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2020-09-08T15:44:57.760 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:44:57.751+0000 7fa5611ffec0 -1 bluestore(td/osd-backfill-recovery-log/2) _read_fsid unparsable uuid 2020-09-08T15:45:01.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/2/keyring 2020-09-08T15:45:01.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:45:01.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T15:45:01.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:45:01.859 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T15:45:02.386 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T15:45:02.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T15:45:02.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:45:02.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:45:02.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:45:02.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:45:02.410 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:02.413+0000 7f0a27de7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:45:02.430 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:02.433+0000 7f0a27de7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:45:02.431 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:02.435+0000 7f0a27de7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:45:02.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T15:45:02.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:45:02.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:45:02.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:45:02.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:45:02.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:45:02.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:45:02.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:45:02.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:45:02.784 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:45:02.950 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:02.951+0000 7f0a27de7ec0 -1 Falling back to public interface 2020-09-08T15:45:03.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:45:03.738 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:03.733+0000 7f0a27de7ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T15:45:04.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:45:04.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:45:04.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:45:04.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:45:04.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:45:04.206 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:45:04.610 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/111592,v1:127.0.0.1:6819/111592] [v2:127.0.0.1:6820/111592,v1:127.0.0.1:6821/111592] exists,up 47ec3ce1-c8e1-4d69-8012-7da42e1cccac 2020-09-08T15:45:04.610 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 22b990a0-6b9d-4aed-a17c-81f1d9ba978a 2020-09-08T15:45:04.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:45:04.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:45:04.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:45:04.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:45:04.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 3 2020-09-08T15:45:04.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:45:04.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:45:04.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T15:45:04.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:45:04.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/3 2020-09-08T15:45:04.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:45:04.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:45:04.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:45:04.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:45:04.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/3' 2020-09-08T15:45:04.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/3/journal' 2020-09-08T15:45:04.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:45:04.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2020-09-08T15:45:04.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:45:04.619 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:45:04.619 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:45:04.620 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:45:04.620 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:45:04.620 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:45:04.620 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:45:04.620 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:45:04.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:45:04.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:45:04.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:45:04.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:45:04.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:45:04.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:45:04.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:45:04.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:45:04.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:45:04.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:45:04.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:45:04.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/3 2020-09-08T15:45:04.625 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:45:04.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=22b990a0-6b9d-4aed-a17c-81f1d9ba978a 2020-09-08T15:45:04.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 22b990a0-6b9d-4aed-a17c-81f1d9ba978a' 2020-09-08T15:45:04.626 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:45:04.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAAp1dfP3x4JRAAmGA2U6jGXIompxV2+z8MTw== 2020-09-08T15:45:04.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAAp1dfP3x4JRAAmGA2U6jGXIompxV2+z8MTw=="}' 2020-09-08T15:45:04.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 22b990a0-6b9d-4aed-a17c-81f1d9ba978a -i td/osd-backfill-recovery-log/3/new.json 2020-09-08T15:45:05.151 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T15:45:05.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/3/new.json 2020-09-08T15:45:05.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAAp1dfP3x4JRAAmGA2U6jGXIompxV2+z8MTw== --osd-uuid 22b990a0-6b9d-4aed-a17c-81f1d9ba978a 2020-09-08T15:45:05.188 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:05.191+0000 7fd188382ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:45:05.189 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:05.193+0000 7fd188382ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:45:05.190 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:05.194+0000 7fd188382ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:45:05.190 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:05.195+0000 7fd188382ec0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2020-09-08T15:45:05.191 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:05.195+0000 7fd188382ec0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2020-09-08T15:45:05.191 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:05.195+0000 7fd188382ec0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2020-09-08T15:45:05.244 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:05.249+0000 7fd188382ec0 -1 bluestore(td/osd-backfill-recovery-log/3) _read_fsid unparsable uuid 2020-09-08T15:45:09.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/3/keyring 2020-09-08T15:45:09.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:45:09.493 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T15:45:09.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T15:45:09.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:45:10.030 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T15:45:10.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T15:45:10.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:45:10.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:45:10.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:45:10.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:45:10.053 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:10.055+0000 7f4df1878ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:45:10.062 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:10.065+0000 7f4df1878ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:45:10.063 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:10.066+0000 7f4df1878ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:45:10.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T15:45:10.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:45:10.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T15:45:10.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:45:10.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:45:10.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:45:10.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:45:10.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:45:10.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T15:45:10.441 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:45:10.577 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:10.581+0000 7f4df1878ec0 -1 Falling back to public interface 2020-09-08T15:45:10.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:45:11.414 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:11.416+0000 7f4df1878ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T15:45:11.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:45:11.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:45:11.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:45:11.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:45:11.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T15:45:11.836 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:45:12.313 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/112586,v1:127.0.0.1:6827/112586] [v2:127.0.0.1:6828/112586,v1:127.0.0.1:6829/112586] exists,up 22b990a0-6b9d-4aed-a17c-81f1d9ba978a 2020-09-08T15:45:12.315 INFO:tasks.workunit.client.0.smithi065.stdout:add osd4 51b4b056-68f8-488c-91db-9bc10e9c5425 2020-09-08T15:45:12.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:45:12.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:45:12.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:45:12.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:45:12.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 4 2020-09-08T15:45:12.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:45:12.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:45:12.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=4 2020-09-08T15:45:12.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:45:12.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/4 2020-09-08T15:45:12.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:45:12.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:45:12.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:45:12.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:45:12.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/4' 2020-09-08T15:45:12.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/4/journal' 2020-09-08T15:45:12.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:45:12.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2020-09-08T15:45:12.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:45:12.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:45:12.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:45:12.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:45:12.320 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:45:12.320 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:45:12.320 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:45:12.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:45:12.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:45:12.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:45:12.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:45:12.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:45:12.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:45:12.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:45:12.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:45:12.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:45:12.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:45:12.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:45:12.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:45:12.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/4 2020-09-08T15:45:12.339 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:45:12.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=51b4b056-68f8-488c-91db-9bc10e9c5425 2020-09-08T15:45:12.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd4 51b4b056-68f8-488c-91db-9bc10e9c5425' 2020-09-08T15:45:12.339 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:45:12.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAIp1dfXX23ExAA8hNm+PNZ6YHnMUiTpBlqkg== 2020-09-08T15:45:12.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAIp1dfXX23ExAA8hNm+PNZ6YHnMUiTpBlqkg=="}' 2020-09-08T15:45:12.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 51b4b056-68f8-488c-91db-9bc10e9c5425 -i td/osd-backfill-recovery-log/4/new.json 2020-09-08T15:45:12.851 INFO:tasks.workunit.client.0.smithi065.stdout:4 2020-09-08T15:45:12.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/4/new.json 2020-09-08T15:45:12.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 4 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAIp1dfXX23ExAA8hNm+PNZ6YHnMUiTpBlqkg== --osd-uuid 51b4b056-68f8-488c-91db-9bc10e9c5425 2020-09-08T15:45:12.873 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:12.878+0000 7fd0481a5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:45:12.875 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:12.880+0000 7fd0481a5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:45:12.876 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:12.880+0000 7fd0481a5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:45:12.895 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:12.881+0000 7fd0481a5ec0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2020-09-08T15:45:12.895 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:12.881+0000 7fd0481a5ec0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2020-09-08T15:45:12.895 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:12.881+0000 7fd0481a5ec0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2020-09-08T15:45:12.911 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:12.916+0000 7fd0481a5ec0 -1 bluestore(td/osd-backfill-recovery-log/4) _read_fsid unparsable uuid 2020-09-08T15:45:17.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/4/keyring 2020-09-08T15:45:17.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:45:17.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd4 key to auth repository 2020-09-08T15:45:17.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:45:17.462 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd4 key to auth repository 2020-09-08T15:45:17.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.4 2020-09-08T15:45:17.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 4 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:45:17.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:45:17.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:45:17.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:45:17.999 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.4 2020-09-08T15:45:18.022 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:18.025+0000 7fd732525ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:45:18.038 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:18.039+0000 7fd732525ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:45:18.038 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:18.040+0000 7fd732525ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:45:18.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 4 2020-09-08T15:45:18.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:45:18.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=4 2020-09-08T15:45:18.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:45:18.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:45:18.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:45:18.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:45:18.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:45:18.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T15:45:18.392 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:45:18.551 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:18.555+0000 7fd732525ec0 -1 Falling back to public interface 2020-09-08T15:45:18.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:45:19.334 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:19.332+0000 7fd732525ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-09-08T15:45:19.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:45:19.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:45:19.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:45:19.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:45:19.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T15:45:19.778 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:45:20.194 INFO:tasks.workunit.client.0.smithi065.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/113580,v1:127.0.0.1:6835/113580] [v2:127.0.0.1:6836/113580,v1:127.0.0.1:6837/113580] exists,up 51b4b056-68f8-488c-91db-9bc10e9c5425 2020-09-08T15:45:20.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:45:20.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:45:20.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:45:20.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:45:20.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 5 2020-09-08T15:45:20.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:45:20.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:45:20.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=5 2020-09-08T15:45:20.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:45:20.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/5 2020-09-08T15:45:20.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:45:20.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:45:20.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:45:20.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:45:20.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/5' 2020-09-08T15:45:20.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/5/journal' 2020-09-08T15:45:20.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:45:20.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2020-09-08T15:45:20.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:45:20.199 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:45:20.199 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:45:20.199 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:45:20.199 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:45:20.199 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:45:20.200 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:45:20.200 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:45:20.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:45:20.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:45:20.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:45:20.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:45:20.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:45:20.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:45:20.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:45:20.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:45:20.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:45:20.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:45:20.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:45:20.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/5 2020-09-08T15:45:20.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:45:20.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=4bc284ef-5596-4b79-b3ce-158c0c362100 2020-09-08T15:45:20.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd5 4bc284ef-5596-4b79-b3ce-158c0c362100' 2020-09-08T15:45:20.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:45:20.204 INFO:tasks.workunit.client.0.smithi065.stdout:add osd5 4bc284ef-5596-4b79-b3ce-158c0c362100 2020-09-08T15:45:20.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAQp1dfcuTgDBAATjiWcAZqJDIgCkKzouXjUg== 2020-09-08T15:45:20.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAQp1dfcuTgDBAATjiWcAZqJDIgCkKzouXjUg=="}' 2020-09-08T15:45:20.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 4bc284ef-5596-4b79-b3ce-158c0c362100 -i td/osd-backfill-recovery-log/5/new.json 2020-09-08T15:45:20.811 INFO:tasks.workunit.client.0.smithi065.stdout:5 2020-09-08T15:45:20.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/5/new.json 2020-09-08T15:45:20.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 5 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAQp1dfcuTgDBAATjiWcAZqJDIgCkKzouXjUg== --osd-uuid 4bc284ef-5596-4b79-b3ce-158c0c362100 2020-09-08T15:45:20.847 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:20.851+0000 7fc8f09f1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:45:20.849 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:20.852+0000 7fc8f09f1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:45:20.851 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:20.854+0000 7fc8f09f1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:45:20.852 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:20.855+0000 7fc8f09f1ec0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2020-09-08T15:45:20.852 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:20.855+0000 7fc8f09f1ec0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2020-09-08T15:45:20.852 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:20.855+0000 7fc8f09f1ec0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2020-09-08T15:45:20.896 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:20.900+0000 7fc8f09f1ec0 -1 bluestore(td/osd-backfill-recovery-log/5) _read_fsid unparsable uuid 2020-09-08T15:45:25.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/5/keyring 2020-09-08T15:45:25.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:45:25.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd5 key to auth repository 2020-09-08T15:45:25.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:45:25.359 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd5 key to auth repository 2020-09-08T15:45:25.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.5 2020-09-08T15:45:25.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:45:25.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 5 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:45:25.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:45:25.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:45:25.895 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.5 2020-09-08T15:45:25.919 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:25.922+0000 7f649fc3aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:45:25.946 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:25.951+0000 7f649fc3aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:45:25.947 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:25.951+0000 7f649fc3aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:45:26.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 5 2020-09-08T15:45:26.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:45:26.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=5 2020-09-08T15:45:26.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:45:26.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:45:26.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:45:26.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:45:26.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:45:26.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T15:45:26.292 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:45:26.465 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:26.468+0000 7f649fc3aec0 -1 Falling back to public interface 2020-09-08T15:45:26.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:45:27.247 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:45:27.251+0000 7f649fc3aec0 -1 osd.5 0 log_to_monitors {default=true} 2020-09-08T15:45:27.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:45:27.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:45:27.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:45:27.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:45:27.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T15:45:27.701 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:45:28.127 INFO:tasks.workunit.client.0.smithi065.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/114574,v1:127.0.0.1:6843/114574] [v2:127.0.0.1:6844/114574,v1:127.0.0.1:6845/114574] exists,up 4bc284ef-5596-4b79-b3ce-158c0c362100 2020-09-08T15:45:28.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:45:28.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:45:28.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:45:28.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:59: _common_test: create_pool test 1 1 2020-09-08T15:45:28.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test 1 1 2020-09-08T15:45:28.726 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' already exists 2020-09-08T15:45:28.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:45:29.742 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: seq 1 150 2020-09-08T15:45:29.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:29.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-1 /etc/passwd 2020-09-08T15:45:29.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:29.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-2 /etc/passwd 2020-09-08T15:45:30.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:30.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-3 /etc/passwd 2020-09-08T15:45:30.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:30.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-4 /etc/passwd 2020-09-08T15:45:30.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:30.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-5 /etc/passwd 2020-09-08T15:45:30.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:30.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-6 /etc/passwd 2020-09-08T15:45:30.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:30.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-7 /etc/passwd 2020-09-08T15:45:30.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:30.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-8 /etc/passwd 2020-09-08T15:45:31.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:31.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-9 /etc/passwd 2020-09-08T15:45:31.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:31.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-10 /etc/passwd 2020-09-08T15:45:31.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:31.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-11 /etc/passwd 2020-09-08T15:45:31.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:31.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-12 /etc/passwd 2020-09-08T15:45:31.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:31.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-13 /etc/passwd 2020-09-08T15:45:31.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:31.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-14 /etc/passwd 2020-09-08T15:45:31.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:31.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-15 /etc/passwd 2020-09-08T15:45:32.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:32.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-16 /etc/passwd 2020-09-08T15:45:32.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:32.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-17 /etc/passwd 2020-09-08T15:45:32.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:32.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-18 /etc/passwd 2020-09-08T15:45:32.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:32.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-19 /etc/passwd 2020-09-08T15:45:32.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:32.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-20 /etc/passwd 2020-09-08T15:45:32.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:32.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-21 /etc/passwd 2020-09-08T15:45:32.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:32.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-22 /etc/passwd 2020-09-08T15:45:33.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:33.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-23 /etc/passwd 2020-09-08T15:45:33.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:33.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-24 /etc/passwd 2020-09-08T15:45:33.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:33.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-25 /etc/passwd 2020-09-08T15:45:33.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:33.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-26 /etc/passwd 2020-09-08T15:45:33.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:33.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-27 /etc/passwd 2020-09-08T15:45:33.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:33.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-28 /etc/passwd 2020-09-08T15:45:33.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:33.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-29 /etc/passwd 2020-09-08T15:45:34.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:34.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-30 /etc/passwd 2020-09-08T15:45:34.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:34.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-31 /etc/passwd 2020-09-08T15:45:34.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:34.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-32 /etc/passwd 2020-09-08T15:45:34.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:34.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-33 /etc/passwd 2020-09-08T15:45:34.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:34.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-34 /etc/passwd 2020-09-08T15:45:34.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:34.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-35 /etc/passwd 2020-09-08T15:45:34.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:34.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-36 /etc/passwd 2020-09-08T15:45:34.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:35.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-37 /etc/passwd 2020-09-08T15:45:35.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:35.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-38 /etc/passwd 2020-09-08T15:45:35.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:35.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-39 /etc/passwd 2020-09-08T15:45:35.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:35.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-40 /etc/passwd 2020-09-08T15:45:35.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:35.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-41 /etc/passwd 2020-09-08T15:45:35.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:35.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-42 /etc/passwd 2020-09-08T15:45:35.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:35.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-43 /etc/passwd 2020-09-08T15:45:35.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:35.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-44 /etc/passwd 2020-09-08T15:45:36.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:36.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-45 /etc/passwd 2020-09-08T15:45:36.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:36.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-46 /etc/passwd 2020-09-08T15:45:36.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:36.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-47 /etc/passwd 2020-09-08T15:45:36.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:36.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-48 /etc/passwd 2020-09-08T15:45:36.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:36.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-49 /etc/passwd 2020-09-08T15:45:36.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:36.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-50 /etc/passwd 2020-09-08T15:45:36.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:36.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-51 /etc/passwd 2020-09-08T15:45:37.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:37.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-52 /etc/passwd 2020-09-08T15:45:37.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:37.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-53 /etc/passwd 2020-09-08T15:45:37.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:37.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-54 /etc/passwd 2020-09-08T15:45:37.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:37.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-55 /etc/passwd 2020-09-08T15:45:37.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:37.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-56 /etc/passwd 2020-09-08T15:45:37.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:37.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-57 /etc/passwd 2020-09-08T15:45:37.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:37.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-58 /etc/passwd 2020-09-08T15:45:38.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:38.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-59 /etc/passwd 2020-09-08T15:45:38.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:38.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-60 /etc/passwd 2020-09-08T15:45:38.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:38.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-61 /etc/passwd 2020-09-08T15:45:38.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:38.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-62 /etc/passwd 2020-09-08T15:45:38.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:38.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-63 /etc/passwd 2020-09-08T15:45:38.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:38.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-64 /etc/passwd 2020-09-08T15:45:38.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:38.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-65 /etc/passwd 2020-09-08T15:45:39.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:39.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-66 /etc/passwd 2020-09-08T15:45:39.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:39.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-67 /etc/passwd 2020-09-08T15:45:39.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:39.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-68 /etc/passwd 2020-09-08T15:45:39.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:39.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-69 /etc/passwd 2020-09-08T15:45:39.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:39.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-70 /etc/passwd 2020-09-08T15:45:39.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:39.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-71 /etc/passwd 2020-09-08T15:45:39.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:39.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-72 /etc/passwd 2020-09-08T15:45:40.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:40.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-73 /etc/passwd 2020-09-08T15:45:40.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:40.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-74 /etc/passwd 2020-09-08T15:45:40.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:40.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-75 /etc/passwd 2020-09-08T15:45:40.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:40.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-76 /etc/passwd 2020-09-08T15:45:40.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:40.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-77 /etc/passwd 2020-09-08T15:45:40.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:40.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-78 /etc/passwd 2020-09-08T15:45:40.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:40.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-79 /etc/passwd 2020-09-08T15:45:41.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:41.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-80 /etc/passwd 2020-09-08T15:45:41.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:41.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-81 /etc/passwd 2020-09-08T15:45:41.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:41.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-82 /etc/passwd 2020-09-08T15:45:41.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:41.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-83 /etc/passwd 2020-09-08T15:45:41.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:41.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-84 /etc/passwd 2020-09-08T15:45:41.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:41.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-85 /etc/passwd 2020-09-08T15:45:41.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:41.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-86 /etc/passwd 2020-09-08T15:45:42.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:42.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-87 /etc/passwd 2020-09-08T15:45:42.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:42.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-88 /etc/passwd 2020-09-08T15:45:42.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:42.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-89 /etc/passwd 2020-09-08T15:45:42.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:42.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-90 /etc/passwd 2020-09-08T15:45:42.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:42.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-91 /etc/passwd 2020-09-08T15:45:42.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:42.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-92 /etc/passwd 2020-09-08T15:45:42.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:42.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-93 /etc/passwd 2020-09-08T15:45:43.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:43.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-94 /etc/passwd 2020-09-08T15:45:43.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:43.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-95 /etc/passwd 2020-09-08T15:45:43.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:43.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-96 /etc/passwd 2020-09-08T15:45:43.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:43.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-97 /etc/passwd 2020-09-08T15:45:43.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:43.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-98 /etc/passwd 2020-09-08T15:45:43.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:43.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-99 /etc/passwd 2020-09-08T15:45:43.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:43.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-100 /etc/passwd 2020-09-08T15:45:43.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:43.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-101 /etc/passwd 2020-09-08T15:45:44.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:44.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-102 /etc/passwd 2020-09-08T15:45:44.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:44.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-103 /etc/passwd 2020-09-08T15:45:44.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:44.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-104 /etc/passwd 2020-09-08T15:45:44.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:44.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-105 /etc/passwd 2020-09-08T15:45:44.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:44.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-106 /etc/passwd 2020-09-08T15:45:44.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:44.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-107 /etc/passwd 2020-09-08T15:45:45.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:45.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-108 /etc/passwd 2020-09-08T15:45:45.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:45.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-109 /etc/passwd 2020-09-08T15:45:45.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:45.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-110 /etc/passwd 2020-09-08T15:45:45.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:45.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-111 /etc/passwd 2020-09-08T15:45:45.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:45.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-112 /etc/passwd 2020-09-08T15:45:45.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:45.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-113 /etc/passwd 2020-09-08T15:45:45.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:45.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-114 /etc/passwd 2020-09-08T15:45:46.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:46.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-115 /etc/passwd 2020-09-08T15:45:46.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:46.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-116 /etc/passwd 2020-09-08T15:45:46.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:46.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-117 /etc/passwd 2020-09-08T15:45:46.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:46.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-118 /etc/passwd 2020-09-08T15:45:46.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:46.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-119 /etc/passwd 2020-09-08T15:45:46.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:46.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-120 /etc/passwd 2020-09-08T15:45:46.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:46.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-121 /etc/passwd 2020-09-08T15:45:47.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:47.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-122 /etc/passwd 2020-09-08T15:45:47.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:47.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-123 /etc/passwd 2020-09-08T15:45:47.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:47.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-124 /etc/passwd 2020-09-08T15:45:47.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:47.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-125 /etc/passwd 2020-09-08T15:45:47.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:47.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-126 /etc/passwd 2020-09-08T15:45:47.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:47.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-127 /etc/passwd 2020-09-08T15:45:47.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:47.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-128 /etc/passwd 2020-09-08T15:45:47.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:47.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-129 /etc/passwd 2020-09-08T15:45:48.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:48.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-130 /etc/passwd 2020-09-08T15:45:48.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:48.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-131 /etc/passwd 2020-09-08T15:45:48.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:48.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-132 /etc/passwd 2020-09-08T15:45:48.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:48.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-133 /etc/passwd 2020-09-08T15:45:48.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:48.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-134 /etc/passwd 2020-09-08T15:45:48.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:48.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-135 /etc/passwd 2020-09-08T15:45:48.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:48.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-136 /etc/passwd 2020-09-08T15:45:49.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:49.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-137 /etc/passwd 2020-09-08T15:45:49.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:49.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-138 /etc/passwd 2020-09-08T15:45:49.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:49.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-139 /etc/passwd 2020-09-08T15:45:49.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:49.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-140 /etc/passwd 2020-09-08T15:45:49.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:49.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-141 /etc/passwd 2020-09-08T15:45:49.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:49.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-142 /etc/passwd 2020-09-08T15:45:49.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:49.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-143 /etc/passwd 2020-09-08T15:45:50.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:50.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-144 /etc/passwd 2020-09-08T15:45:50.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:50.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-145 /etc/passwd 2020-09-08T15:45:50.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:50.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-146 /etc/passwd 2020-09-08T15:45:50.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:50.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-147 /etc/passwd 2020-09-08T15:45:50.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:50.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-148 /etc/passwd 2020-09-08T15:45:50.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:50.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-149 /etc/passwd 2020-09-08T15:45:50.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:45:50.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-150 /etc/passwd 2020-09-08T15:45:50.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:67: _common_test: ceph pg dump pgs --format=json 2020-09-08T15:45:50.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:67: _common_test: jq '.pg_stats[0].up[]' 2020-09-08T15:45:51.372 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:45:51.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:67: _common_test: ceph osd out 1 0 2 2020-09-08T15:45:51.944 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already out. osd.0 is already out. osd.2 is already out. 2020-09-08T15:45:51.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:68: _common_test: '[' 0 '!=' 0 ']' 2020-09-08T15:45:51.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:74: _common_test: sleep 1 2020-09-08T15:45:52.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:75: _common_test: wait_for_clean 2020-09-08T15:45:52.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:45:52.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:45:52.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:45:52.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:45:52.956 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T15:45:52.956 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:45:52.956 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:45:52.956 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:45:52.957 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:45:52.957 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:45:53.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:45:53.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:45:53.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:45:53.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:45:53.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:45:53.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:45:53.597 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:45:53.597 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T15:45:53.597 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T15:45:53.597 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T15:45:53.598 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T15:45:53.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:45:53.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:45:53.599 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:45:53.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836495 2020-09-08T15:45:53.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836495 2020-09-08T15:45:53.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495' 2020-09-08T15:45:53.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:45:53.728 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:45:53.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672974 2020-09-08T15:45:53.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672974 2020-09-08T15:45:53.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495 1-42949672974' 2020-09-08T15:45:53.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:45:53.858 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:45:53.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509452 2020-09-08T15:45:53.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509452 2020-09-08T15:45:53.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495 1-42949672974 2-64424509452' 2020-09-08T15:45:53.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:45:53.989 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T15:45:54.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345931 2020-09-08T15:45:54.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345931 2020-09-08T15:45:54.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495 1-42949672974 2-64424509452 3-85899345931' 2020-09-08T15:45:54.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:45:54.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T15:45:54.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182410 2020-09-08T15:45:54.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182410 2020-09-08T15:45:54.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495 1-42949672974 2-64424509452 3-85899345931 4-107374182410' 2020-09-08T15:45:54.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:45:54.295 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T15:45:54.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018888 2020-09-08T15:45:54.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018888 2020-09-08T15:45:54.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495 1-42949672974 2-64424509452 3-85899345931 4-107374182410 5-128849018888' 2020-09-08T15:45:54.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:45:54.425 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836495 2020-09-08T15:45:54.425 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:45:54.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:45:54.426 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836495 2020-09-08T15:45:54.426 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:45:54.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836495 2020-09-08T15:45:54.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836495' 2020-09-08T15:45:54.427 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836495 2020-09-08T15:45:54.428 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:45:54.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836495 -lt 21474836495 2020-09-08T15:45:54.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:45:54.825 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672974 2020-09-08T15:45:54.825 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:45:54.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:45:54.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672974 2020-09-08T15:45:54.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:45:54.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672974 2020-09-08T15:45:54.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672974' 2020-09-08T15:45:54.828 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672974 2020-09-08T15:45:54.829 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:45:55.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672974 -lt 42949672974 2020-09-08T15:45:55.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:45:55.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509452 2020-09-08T15:45:55.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:45:55.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:45:55.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509452 2020-09-08T15:45:55.225 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:45:55.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509452 2020-09-08T15:45:55.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509452' 2020-09-08T15:45:55.226 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:45:55.226 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509452 2020-09-08T15:45:55.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509451 -lt 64424509452 2020-09-08T15:45:55.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:45:56.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:45:56.615 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:45:57.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509453 -lt 64424509452 2020-09-08T15:45:57.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:45:57.017 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345931 2020-09-08T15:45:57.017 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:45:57.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T15:45:57.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345931 2020-09-08T15:45:57.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:45:57.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345931 2020-09-08T15:45:57.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345931' 2020-09-08T15:45:57.020 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345931 2020-09-08T15:45:57.021 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T15:45:57.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345931 -lt 85899345931 2020-09-08T15:45:57.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:45:57.415 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182410 2020-09-08T15:45:57.415 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:45:57.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T15:45:57.416 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182410 2020-09-08T15:45:57.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:45:57.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182410 2020-09-08T15:45:57.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182410' 2020-09-08T15:45:57.418 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182410 2020-09-08T15:45:57.418 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T15:45:57.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182411 -lt 107374182410 2020-09-08T15:45:57.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:45:57.823 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018888 2020-09-08T15:45:57.824 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:45:57.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T15:45:57.824 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018888 2020-09-08T15:45:57.824 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:45:57.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018888 2020-09-08T15:45:57.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018888' 2020-09-08T15:45:57.825 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T15:45:57.825 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018888 2020-09-08T15:45:58.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018888 -lt 128849018888 2020-09-08T15:45:58.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:45:58.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:45:58.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:45:58.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T15:45:58.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:45:58.776 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:45:58.776 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:45:58.776 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:45:58.776 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:45:58.777 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:45:58.777 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:45:59.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:45:59.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:45:59.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:45:59.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:45:59.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:45:59.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T15:45:59.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T15:45:59.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T15:45:59.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:45:59.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:45:59.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:45:59.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:45:59.775 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:45:59.776 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:45:59.776 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:45:59.776 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:45:59.776 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:45:59.777 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:00.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:00.166 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:00.166 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:00.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:00.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:00.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:00.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:00.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:00.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:00.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:00.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:00.676 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:00.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:01.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=1176 2020-09-08T15:46:01.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 1176 '!=' null 2020-09-08T15:46:01.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:01.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:01.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:01.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:01.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:01.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:01.291 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:01.292 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:01.292 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:01.294 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:01.294 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:01.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:01.674 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:01.674 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:01.674 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:02.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:02.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:02.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:02.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:02.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:02.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:02.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:02.200 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:02.201 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:02.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=18612 2020-09-08T15:46:02.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 18612 '!=' null 2020-09-08T15:46:02.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:02.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:02.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:02.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:02.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:02.830 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:02.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:02.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:02.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:02.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:02.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:03.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:03.233 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:03.233 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:03.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:03.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:03.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:03.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:03.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:03.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:03.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:03.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:03.777 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:03.778 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:04.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=15492 2020-09-08T15:46:04.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 15492 '!=' null 2020-09-08T15:46:04.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:04.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:04.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:04.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:04.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:04.399 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:04.400 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:04.400 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:04.400 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:04.400 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:04.400 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:04.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:04.785 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:04.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:04.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:05.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:05.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:05.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:05.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:05.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:05.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:05.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:05.309 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:05.309 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:05.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=15492 2020-09-08T15:46:05.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 15492 '!=' null 2020-09-08T15:46:05.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:05.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:05.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:05.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:05.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:05.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:05.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:05.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:05.941 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:05.941 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:05.941 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:06.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:06.340 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:06.340 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:06.340 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:06.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:06.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:06.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:06.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:06.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:06.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:06.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:06.865 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:06.866 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:07.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=26035 2020-09-08T15:46:07.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 26035 '!=' null 2020-09-08T15:46:07.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:07.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:07.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:07.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:07.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:07.501 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:07.501 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:07.501 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:07.502 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:07.502 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:07.502 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:07.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:07.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:07.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:07.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:08.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:08.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:08.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:08.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:08.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:08.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:08.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:08.430 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:08.430 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:08.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=25384 2020-09-08T15:46:08.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 25384 '!=' null 2020-09-08T15:46:08.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:08.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:08.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:09.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:09.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:09.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:09.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:09.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:09.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:09.056 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:09.056 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:09.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:09.443 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:09.443 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:09.444 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:09.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:09.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:09.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:09.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:09.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:09.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:09.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:09.963 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:09.963 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:10.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=25384 2020-09-08T15:46:10.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 25384 '!=' null 2020-09-08T15:46:10.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:10.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:10.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:10.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:10.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:10.587 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:10.587 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:10.587 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:10.587 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:10.587 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:10.588 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:10.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:10.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:10.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:10.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:11.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:11.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:11.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:11.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:11.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:11.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:11.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:11.512 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:11.512 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:12.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=25384 2020-09-08T15:46:12.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 25384 '!=' null 2020-09-08T15:46:12.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:12.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:12.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:12.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:12.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:12.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:12.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:12.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:12.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:12.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:12.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:12.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:12.517 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:12.517 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:12.517 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:13.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:13.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:13.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:13.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:13.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:13.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:13.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:13.037 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:13.037 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:13.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=37750 2020-09-08T15:46:13.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 37750 '!=' null 2020-09-08T15:46:13.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:13.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:13.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:13.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:13.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:13.654 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:13.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:13.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:13.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:13.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:13.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:14.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:14.051 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:14.051 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:14.051 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:14.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:14.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:14.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:14.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:14.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:14.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:14.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:14.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:14.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:15.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=25384 2020-09-08T15:46:15.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 25384 '!=' null 2020-09-08T15:46:15.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:15.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:15.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:15.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:15.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:15.191 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:15.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:15.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:15.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:15.193 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:15.193 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:15.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:15.573 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:15.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:15.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:16.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:16.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:16.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:16.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:16.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:16.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:16.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:16.116 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:16.117 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:16.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=38401 2020-09-08T15:46:16.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 38401 '!=' null 2020-09-08T15:46:16.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:16.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:16.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:16.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:16.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:16.965 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:16.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:16.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:16.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:16.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:16.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:17.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:17.345 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:17.345 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:17.346 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:17.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:17.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:17.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:17.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:17.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:17.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:17.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:17.865 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:17.866 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:18.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=25384 2020-09-08T15:46:18.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 25384 '!=' null 2020-09-08T15:46:18.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:18.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:18.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:18.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:18.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:18.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:18.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:18.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:18.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:18.494 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:18.494 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:18.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:18.873 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:18.874 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:18.874 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:19.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:19.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:19.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:19.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:19.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:19.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:19.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:19.396 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:19.396 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:19.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=25384 2020-09-08T15:46:19.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 25384 '!=' null 2020-09-08T15:46:19.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:19.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:19.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:20.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:20.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:20.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:20.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:20.159 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:20.159 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:20.159 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:20.160 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:20.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:20.438 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:20.438 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:20.438 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:20.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:20.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:20.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:20.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:20.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:20.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:20.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:20.965 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:20.965 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:21.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=25384 2020-09-08T15:46:21.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 25384 '!=' null 2020-09-08T15:46:21.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:21.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:21.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:21.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:21.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:21.585 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:21.585 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:21.585 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:21.585 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:21.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:21.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:21.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:21.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:21.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:21.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:22.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:22.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:22.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:22.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:22.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:22.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:22.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:22.545 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:22.546 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:23.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=38402 2020-09-08T15:46:23.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 38402 '!=' null 2020-09-08T15:46:23.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:23.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:23.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:23.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:23.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:23.169 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:23.169 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:23.169 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:23.169 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:23.170 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:23.170 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:23.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:23.548 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:23.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:23.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:24.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:24.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:24.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:24.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:24.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:24.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:24.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:24.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:24.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:24.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=26035 2020-09-08T15:46:24.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 26035 '!=' null 2020-09-08T15:46:24.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:24.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:24.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:24.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:24.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:24.707 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:24.707 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:24.707 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:24.708 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:24.708 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:24.708 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:25.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:25.089 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:25.089 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:25.089 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:25.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:25.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:25.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:25.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:25.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:25.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:25.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:25.608 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:25.608 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:26.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=26035 2020-09-08T15:46:26.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 26035 '!=' null 2020-09-08T15:46:26.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:26.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:26.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:26.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:26.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:26.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:26.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:26.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:26.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:26.273 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:26.273 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:26.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:26.654 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:26.654 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:26.654 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:27.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:27.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:27.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:27.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:27.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:27.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:27.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:27.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:27.176 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:27.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=38401 2020-09-08T15:46:27.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 38401 '!=' null 2020-09-08T15:46:27.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:27.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:27.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:27.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:27.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:27.806 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:27.806 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:27.806 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:27.807 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:27.807 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:27.807 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:28.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:28.199 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:28.200 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:28.200 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:28.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:28.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:28.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:28.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:28.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:28.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:28.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:28.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:28.728 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:29.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=25384 2020-09-08T15:46:29.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 25384 '!=' null 2020-09-08T15:46:29.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:29.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:29.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:29.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:29.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:29.358 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:29.358 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:29.358 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:29.359 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:29.359 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:29.359 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:29.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:29.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:29.742 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:29.742 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:30.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:30.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:30.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:30.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:30.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:30.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:30.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:30.273 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:30.273 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:30.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=25384 2020-09-08T15:46:30.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 25384 '!=' null 2020-09-08T15:46:30.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:30.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:30.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:30.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:30.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:30.917 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:30.917 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:30.918 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:30.918 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:30.921 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:30.921 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:31.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:31.297 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:31.297 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:31.297 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:31.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:31.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:31.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:31.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:31.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:31.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:31.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:31.863 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:31.863 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:32.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=37750 2020-09-08T15:46:32.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 37750 '!=' null 2020-09-08T15:46:32.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:32.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:32.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:32.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:32.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:32.506 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:32.506 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:32.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:32.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:32.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:32.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:32.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:32.887 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:32.887 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:32.887 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:33.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:33.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:33.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:33.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:33.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:33.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:33.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:33.415 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:33.415 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:33.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=37750 2020-09-08T15:46:33.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 37750 '!=' null 2020-09-08T15:46:33.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:33.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:33.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:34.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:34.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:34.037 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:34.037 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:34.038 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:34.038 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:34.038 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:34.038 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:34.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:34.427 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:34.428 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:34.431 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:34.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:34.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:34.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:34.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:34.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:34.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:34.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:34.942 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:34.942 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:35.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29679 2020-09-08T15:46:35.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29679 '!=' null 2020-09-08T15:46:35.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:35.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:35.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:35.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:35.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:35.562 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:35.562 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:35.562 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:35.563 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:35.563 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:35.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:35.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:46:35.938 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:35.938 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:35.939 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:36.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:46:36.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:46:36.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:46:36.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:46:36.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:46:36.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:46:36.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:46:36.458 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:46:36.458 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:46:36.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=31241 2020-09-08T15:46:36.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 31241 '!=' null 2020-09-08T15:46:36.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:46:36.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:46:36.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:46:37.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:46:37.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:46:37.091 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:46:37.091 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:46:37.091 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:46:37.091 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:46:37.091 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:46:37.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:46:37.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:46:37.462 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:46:37.463 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:46:37.463 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:46:37.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T15:46:37.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:46:37.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:46:37.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:77: _common_test: flush_pg_stats 2020-09-08T15:46:37.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:46:37.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:46:38.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:46:38.377 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:46:38.378 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T15:46:38.378 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T15:46:38.378 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T15:46:38.378 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T15:46:38.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:46:38.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:46:38.379 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:46:38.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836506 2020-09-08T15:46:38.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836506 2020-09-08T15:46:38.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836506' 2020-09-08T15:46:38.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:46:38.516 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:46:38.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672985 2020-09-08T15:46:38.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672985 2020-09-08T15:46:38.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836506 1-42949672985' 2020-09-08T15:46:38.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:46:38.645 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:46:38.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509463 2020-09-08T15:46:38.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509463 2020-09-08T15:46:38.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836506 1-42949672985 2-64424509463' 2020-09-08T15:46:38.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:46:38.775 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T15:46:38.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345942 2020-09-08T15:46:38.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345942 2020-09-08T15:46:38.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836506 1-42949672985 2-64424509463 3-85899345942' 2020-09-08T15:46:38.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:46:38.904 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T15:46:39.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182421 2020-09-08T15:46:39.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182421 2020-09-08T15:46:39.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836506 1-42949672985 2-64424509463 3-85899345942 4-107374182421' 2020-09-08T15:46:39.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:46:39.034 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T15:46:39.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018899 2020-09-08T15:46:39.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018899 2020-09-08T15:46:39.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836506 1-42949672985 2-64424509463 3-85899345942 4-107374182421 5-128849018899' 2020-09-08T15:46:39.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:46:39.164 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836506 2020-09-08T15:46:39.164 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:46:39.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:46:39.165 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836506 2020-09-08T15:46:39.165 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:46:39.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836506 2020-09-08T15:46:39.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836506' 2020-09-08T15:46:39.167 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836506 2020-09-08T15:46:39.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:46:39.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836504 -lt 21474836506 2020-09-08T15:46:39.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:46:40.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:46:40.560 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:46:40.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836506 -lt 21474836506 2020-09-08T15:46:40.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:46:40.959 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672985 2020-09-08T15:46:40.959 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:46:40.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:46:40.961 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672985 2020-09-08T15:46:40.961 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:46:40.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672985 2020-09-08T15:46:40.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672985' 2020-09-08T15:46:40.963 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:46:40.963 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672985 2020-09-08T15:46:41.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672985 -lt 42949672985 2020-09-08T15:46:41.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:46:41.379 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509463 2020-09-08T15:46:41.379 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:46:41.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:46:41.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509463 2020-09-08T15:46:41.382 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:46:41.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509463 2020-09-08T15:46:41.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509463' 2020-09-08T15:46:41.383 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:46:41.383 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509463 2020-09-08T15:46:41.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509463 -lt 64424509463 2020-09-08T15:46:41.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:46:41.774 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345942 2020-09-08T15:46:41.774 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:46:41.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T15:46:41.776 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345942 2020-09-08T15:46:41.776 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:46:41.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345942 2020-09-08T15:46:41.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345942' 2020-09-08T15:46:41.778 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345942 2020-09-08T15:46:41.778 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T15:46:42.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345942 -lt 85899345942 2020-09-08T15:46:42.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:46:42.201 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182421 2020-09-08T15:46:42.202 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:46:42.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T15:46:42.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182421 2020-09-08T15:46:42.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:46:42.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182421 2020-09-08T15:46:42.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182421' 2020-09-08T15:46:42.205 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182421 2020-09-08T15:46:42.205 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T15:46:42.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182422 -lt 107374182421 2020-09-08T15:46:42.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:46:42.605 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018899 2020-09-08T15:46:42.605 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:46:42.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T15:46:42.606 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018899 2020-09-08T15:46:42.607 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:46:42.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018899 2020-09-08T15:46:42.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018899' 2020-09-08T15:46:42.608 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018899 2020-09-08T15:46:42.608 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T15:46:43.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018899 -lt 128849018899 2020-09-08T15:46:43.008 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:79: _common_test: ceph pg dump pgs --format=json 2020-09-08T15:46:43.008 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:79: _common_test: jq '.pg_stats[0].up_primary' 2020-09-08T15:46:43.398 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:46:43.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:79: _common_test: newprimary=4 2020-09-08T15:46:43.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:80: _common_test: kill_daemons 2020-09-08T15:46:43.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:46:43.408 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:46:43.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:46:43.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:46:43.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:46:43.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:46:43.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:82: _common_test: ERRORS=0 2020-09-08T15:46:43.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:83: _common_test: _objectstore_tool_nodown td/osd-backfill-recovery-log 4 --no-mon-config --pgid 1.0 --op log 2020-09-08T15:46:43.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:83: _common_test: tee td/osd-backfill-recovery-log/result.log 2020-09-08T15:46:43.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local dir=td/osd-backfill-recovery-log 2020-09-08T15:46:43.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2020-09-08T15:46:43.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local id=4 2020-09-08T15:46:43.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1198: _objectstore_tool_nodown: shift 2020-09-08T15:46:43.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: _objectstore_tool_nodown: local osd_data=td/osd-backfill-recovery-log/4 2020-09-08T15:46:43.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1202: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-recovery-log/4 --no-mon-config --pgid 1.0 --op log 2020-09-08T15:46:44.849 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:46:44.850 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_log_t": { 2020-09-08T15:46:44.850 INFO:tasks.workunit.client.0.smithi065.stdout: "head": "34'150", 2020-09-08T15:46:44.850 INFO:tasks.workunit.client.0.smithi065.stdout: "tail": "34'148", 2020-09-08T15:46:44.850 INFO:tasks.workunit.client.0.smithi065.stdout: "log": [ 2020-09-08T15:46:44.851 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:46:44.851 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:46:44.851 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:e9c179f9:::obj-149:head", 2020-09-08T15:46:44.851 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'149", 2020-09-08T15:46:44.851 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:46:44.852 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4631.0:1", 2020-09-08T15:46:44.852 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:46:44.852 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:45:50.762673+0000", 2020-09-08T15:46:44.852 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:46:44.852 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:46:44.853 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:46:44.853 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:46:44.853 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:46:44.853 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:46:44.853 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:46:44.854 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:46:44.854 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:46:44.854 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:46:44.854 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:46:44.854 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:46:44.854 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:46:44.855 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:46:44.855 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:46:44.855 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:46:44.855 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:46:44.855 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:46:44.856 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:cb39fd60:::obj-150:head", 2020-09-08T15:46:44.856 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'150", 2020-09-08T15:46:44.856 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:46:44.856 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4634.0:1", 2020-09-08T15:46:44.856 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:46:44.857 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:45:50.896394+0000", 2020-09-08T15:46:44.857 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:46:44.857 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:46:44.857 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:46:44.857 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:46:44.858 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:46:44.859 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:46:44.859 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:46:44.859 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:46:44.859 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:46:44.859 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:46:44.860 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:46:44.860 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:46:44.860 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:46:44.860 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:46:44.861 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:46:44.861 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:46:44.861 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:46:44.861 INFO:tasks.workunit.client.0.smithi065.stdout: "dups": [ 2020-09-08T15:46:44.861 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:46:44.862 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4607.0:1", 2020-09-08T15:46:44.862 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'141", 2020-09-08T15:46:44.862 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "141", 2020-09-08T15:46:44.862 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:46:44.862 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:46:44.862 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:46:44.863 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4610.0:1", 2020-09-08T15:46:44.863 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'142", 2020-09-08T15:46:44.863 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "142", 2020-09-08T15:46:44.863 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:46:44.863 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:46:44.864 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:46:44.864 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4613.0:1", 2020-09-08T15:46:44.864 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'143", 2020-09-08T15:46:44.864 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "143", 2020-09-08T15:46:44.864 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:46:44.865 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:46:44.865 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:46:44.865 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4616.0:1", 2020-09-08T15:46:44.865 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'144", 2020-09-08T15:46:44.865 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "144", 2020-09-08T15:46:44.865 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:46:44.866 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:46:44.872 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:46:44.872 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4619.0:1", 2020-09-08T15:46:44.872 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'145", 2020-09-08T15:46:44.872 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "145", 2020-09-08T15:46:44.872 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:46:44.873 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:46:44.873 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:46:44.873 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4622.0:1", 2020-09-08T15:46:44.873 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'146", 2020-09-08T15:46:44.873 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "146", 2020-09-08T15:46:44.874 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:46:44.874 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:46:44.874 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:46:44.874 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4625.0:1", 2020-09-08T15:46:44.874 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'147", 2020-09-08T15:46:44.875 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "147", 2020-09-08T15:46:44.875 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:46:44.875 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:46:44.875 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:46:44.875 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4628.0:1", 2020-09-08T15:46:44.875 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'148", 2020-09-08T15:46:44.876 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "148", 2020-09-08T15:46:44.876 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:46:44.876 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:46:44.876 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:46:44.876 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:46:44.877 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_missing_t": { 2020-09-08T15:46:44.877 INFO:tasks.workunit.client.0.smithi065.stdout: "missing": [], 2020-09-08T15:46:44.877 INFO:tasks.workunit.client.0.smithi065.stdout: "may_include_deletes": true 2020-09-08T15:46:44.877 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:46:44.877 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:46:44.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:84: _common_test: jq '.pg_log_t.log | length' td/osd-backfill-recovery-log/result.log 2020-09-08T15:46:44.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:84: _common_test: LOGLEN=2 2020-09-08T15:46:44.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:85: _common_test: '[' 2 '!=' 2 ']' 2020-09-08T15:46:44.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:89: _common_test: jq '.pg_log_t.dups | length' td/osd-backfill-recovery-log/result.log 2020-09-08T15:46:44.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:89: _common_test: DUPSLEN=8 2020-09-08T15:46:44.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:90: _common_test: '[' 8 '!=' 8 ']' 2020-09-08T15:46:44.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:94: _common_test: grep 'copy_up_to\|copy_after' td/osd-backfill-recovery-log/osd.0.log td/osd-backfill-recovery-log/osd.1.log td/osd-backfill-recovery-log/osd.2.log td/osd-backfill-recovery-log/osd.3.log td/osd-backfill-recovery-log/osd.4.log td/osd-backfill-recovery-log/osd.5.log 2020-09-08T15:46:44.880 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to max 2 2020-09-08T15:46:44.881 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to copy log version 34'150 2020-09-08T15:46:44.881 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to copy log version 34'149 2020-09-08T15:46:44.881 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after earliest_dup_version 141 2020-09-08T15:46:44.881 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'141 2020-09-08T15:46:44.881 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'142 2020-09-08T15:46:44.882 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'143 2020-09-08T15:46:44.882 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'144 2020-09-08T15:46:44.882 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'145 2020-09-08T15:46:44.882 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'146 2020-09-08T15:46:44.882 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'147 2020-09-08T15:46:44.883 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'148 2020-09-08T15:46:44.883 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to max 2 2020-09-08T15:46:44.883 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to copy log version 34'150 2020-09-08T15:46:44.883 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to copy log version 34'149 2020-09-08T15:46:44.883 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after earliest_dup_version 141 2020-09-08T15:46:44.884 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'141 2020-09-08T15:46:44.884 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'142 2020-09-08T15:46:44.884 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'143 2020-09-08T15:46:44.884 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'144 2020-09-08T15:46:44.884 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'145 2020-09-08T15:46:44.885 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'146 2020-09-08T15:46:44.885 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'147 2020-09-08T15:46:44.885 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'148 2020-09-08T15:46:44.885 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to max 2 2020-09-08T15:46:44.885 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to copy log version 34'150 2020-09-08T15:46:44.886 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to copy log version 34'149 2020-09-08T15:46:44.886 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after earliest_dup_version 141 2020-09-08T15:46:44.886 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'141 2020-09-08T15:46:44.886 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'142 2020-09-08T15:46:44.886 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'143 2020-09-08T15:46:44.888 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'144 2020-09-08T15:46:44.888 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'145 2020-09-08T15:46:44.888 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'146 2020-09-08T15:46:44.888 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'147 2020-09-08T15:46:44.889 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:45:53.966+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'148 2020-09-08T15:46:44.889 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:46:34.076+0000 7f589cea8700 20 copy_after v 34'150 2020-09-08T15:46:44.889 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:46:34.076+0000 7f589cea8700 20 copy_up_to/copy_after earliest_dup_version 141 2020-09-08T15:46:44.889 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:46:34.076+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'141 2020-09-08T15:46:44.889 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:46:34.076+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'142 2020-09-08T15:46:44.890 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:46:34.076+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'143 2020-09-08T15:46:44.890 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:46:34.076+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'144 2020-09-08T15:46:44.890 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:46:34.076+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'145 2020-09-08T15:46:44.890 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:46:34.076+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'146 2020-09-08T15:46:44.890 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:46:34.076+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'147 2020-09-08T15:46:44.891 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:46:34.076+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'148 2020-09-08T15:46:44.891 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:46:34.076+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'149 2020-09-08T15:46:44.891 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:46:34.076+0000 7f589cea8700 20 copy_up_to/copy_after copy dup from log version 34'150 2020-09-08T15:46:44.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:95: _common_test: rm -f td/osd-backfill-recovery-log/result.log 2020-09-08T15:46:44.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:96: _common_test: '[' 0 '!=' 0 ']' 2020-09-08T15:46:44.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:34: run: teardown td/osd-backfill-recovery-log 2020-09-08T15:46:44.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-recovery-log 2020-09-08T15:46:44.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:46:44.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2020-09-08T15:46:44.893 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:46:44.893 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:46:44.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:46:44.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:46:44.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:46:44.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:46:44.895 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:46:44.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:46:44.895 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:46:44.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:46:44.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:46:44.896 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:46:44.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:46:44.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:46:44.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:46:44.897 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:46:44.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:46:44.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:46:44.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-recovery-log 2020-09-08T15:46:44.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:46:44.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:46:44.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:46:44.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.108735 2020-09-08T15:46:44.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:46:44.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:46:44.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:31: run: for func in $funcs 2020-09-08T15:46:44.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:32: run: setup td/osd-backfill-recovery-log 2020-09-08T15:46:44.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-recovery-log 2020-09-08T15:46:44.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-recovery-log 2020-09-08T15:46:44.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-recovery-log 2020-09-08T15:46:44.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:46:44.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2020-09-08T15:46:44.917 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:46:44.917 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:46:44.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:46:44.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:46:44.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:46:44.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:46:44.919 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:46:44.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:46:44.920 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:46:44.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:46:44.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:46:44.920 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:46:44.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:46:44.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:46:44.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:46:44.922 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:46:44.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:46:44.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:46:44.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-recovery-log 2020-09-08T15:46:44.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:46:44.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:46:44.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:46:44.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.108735 2020-09-08T15:46:44.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:46:44.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:46:44.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-recovery-log 2020-09-08T15:46:44.927 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T15:46:44.927 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:46:44.927 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:46:44.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.108735 2020-09-08T15:46:44.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T15:46:44.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T15:46:44.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T15:46:44.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-recovery-log 1' TERM HUP INT 2020-09-08T15:46:44.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:33: run: TEST_backfill_log_2 td/osd-backfill-recovery-log 2020-09-08T15:46:44.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:113: TEST_backfill_log_2: local dir=td/osd-backfill-recovery-log 2020-09-08T15:46:44.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:115: TEST_backfill_log_2: _common_test td/osd-backfill-recovery-log '--osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2 148 150 2020-09-08T15:46:44.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:40: _common_test: local dir=td/osd-backfill-recovery-log 2020-09-08T15:46:44.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:41: _common_test: local 'extra_opts=--osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2020-09-08T15:46:44.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:42: _common_test: local loglen=2 2020-09-08T15:46:44.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:43: _common_test: local dupslen=148 2020-09-08T15:46:44.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:44: _common_test: local objects=150 2020-09-08T15:46:44.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:45: _common_test: local moreobjects=0 2020-09-08T15:46:44.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:47: _common_test: local OSDS=6 2020-09-08T15:46:44.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:49: _common_test: run_mon td/osd-backfill-recovery-log a 2020-09-08T15:46:44.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-recovery-log 2020-09-08T15:46:44.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T15:46:44.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T15:46:44.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T15:46:44.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-recovery-log/a 2020-09-08T15:46:44.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-recovery-log/a --run-dir=td/osd-backfill-recovery-log 2020-09-08T15:46:45.220 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T15:46:45.220 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:46:45.221 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:46:45.221 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:46:45.222 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:46:45.222 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:46:45.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:46:45.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-recovery-log/a '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-recovery-log/log --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T15:46:45.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T15:46:45.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T15:46:45.405 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:46:45.405 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:46:45.405 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T15:46:45.405 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T15:46:45.406 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:46:45.406 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:46:45.406 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:46:45.407 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:46:45.407 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:46:45.407 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:46:45.408 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.108735/ceph-mon.a.asok 2020-09-08T15:46:45.408 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:46:45.408 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.108735/ceph-mon.a.asok config get fsid 2020-09-08T15:46:45.509 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T15:46:45.510 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:46:45.510 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:46:45.510 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T15:46:45.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T15:46:45.511 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:46:45.511 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:46:45.511 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:46:45.512 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:46:45.512 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:46:45.512 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:46:45.513 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.108735/ceph-mon.a.asok 2020-09-08T15:46:45.513 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:46:45.513 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.108735/ceph-mon.a.asok config get mon_host 2020-09-08T15:46:45.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:50: _common_test: run_mgr td/osd-backfill-recovery-log x 2020-09-08T15:46:45.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-recovery-log 2020-09-08T15:46:45.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T15:46:45.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T15:46:45.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T15:46:45.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-recovery-log/x 2020-09-08T15:46:45.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T15:46:46.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T15:46:46.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:46:46.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:46:46.129 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:46:46.129 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:46:46.130 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:46:46.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:46:46.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:46:46.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-recovery-log/x '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:46:46.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:51: _common_test: export CEPH_ARGS 2020-09-08T15:46:46.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:52: _common_test: export 'EXTRA_OPTS= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2020-09-08T15:46:46.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:52: _common_test: EXTRA_OPTS=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2020-09-08T15:46:46.155 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: expr 6 - 1 2020-09-08T15:46:46.155 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: seq 0 5 2020-09-08T15:46:46.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:46:46.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 0 2020-09-08T15:46:46.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:46:46.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:46:46.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T15:46:46.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:46:46.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/0 2020-09-08T15:46:46.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:46:46.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:46:46.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:46:46.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:46:46.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/0' 2020-09-08T15:46:46.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/0/journal' 2020-09-08T15:46:46.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:46:46.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2020-09-08T15:46:46.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:46:46.164 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:46:46.164 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:46:46.165 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:46:46.165 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:46:46.165 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:46:46.165 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:46:46.166 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:46:46.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:46:46.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:46:46.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:46:46.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:46:46.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:46:46.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:46:46.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:46:46.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:46:46.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:46:46.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:46:46.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:46:46.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/0 2020-09-08T15:46:46.172 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:46:46.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=1561aef8-23a1-4015-8515-20becbb1f344 2020-09-08T15:46:46.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 1561aef8-23a1-4015-8515-20becbb1f344' 2020-09-08T15:46:46.173 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:46:46.173 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 1561aef8-23a1-4015-8515-20becbb1f344 2020-09-08T15:46:46.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBmp1dfK7u0ChAAgA/S7JhsqUTjvRVrKaJ34Q== 2020-09-08T15:46:46.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBmp1dfK7u0ChAAgA/S7JhsqUTjvRVrKaJ34Q=="}' 2020-09-08T15:46:46.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 1561aef8-23a1-4015-8515-20becbb1f344 -i td/osd-backfill-recovery-log/0/new.json 2020-09-08T15:46:46.522 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:46:46.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/0/new.json 2020-09-08T15:46:46.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBmp1dfK7u0ChAAgA/S7JhsqUTjvRVrKaJ34Q== --osd-uuid 1561aef8-23a1-4015-8515-20becbb1f344 2020-09-08T15:46:46.558 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:46.563+0000 7f0d548d4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:46:46.560 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:46.565+0000 7f0d548d4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:46:46.561 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:46.566+0000 7f0d548d4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:46:46.562 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:46.566+0000 7f0d548d4ec0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2020-09-08T15:46:46.562 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:46.566+0000 7f0d548d4ec0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2020-09-08T15:46:46.562 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:46.566+0000 7f0d548d4ec0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2020-09-08T15:46:46.602 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:46.606+0000 7f0d548d4ec0 -1 bluestore(td/osd-backfill-recovery-log/0) _read_fsid unparsable uuid 2020-09-08T15:46:50.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/0/keyring 2020-09-08T15:46:50.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:46:50.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T15:46:50.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:46:50.813 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T15:46:51.341 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T15:46:51.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T15:46:51.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:46:51.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:46:51.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:46:51.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:46:51.364 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:51.368+0000 7f272bc63ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:46:51.386 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:51.388+0000 7f272bc63ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:46:51.387 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:51.389+0000 7f272bc63ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:46:51.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T15:46:51.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:46:51.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:46:51.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:46:51.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:46:51.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:46:51.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:46:51.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:46:51.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:46:51.735 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:46:51.901 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:51.905+0000 7f272bc63ec0 -1 Falling back to public interface 2020-09-08T15:46:52.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:46:52.667 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:52.671+0000 7f272bc63ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T15:46:53.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:46:53.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:46:53.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:46:53.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:46:53.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:46:53.165 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:46:53.585 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/122156,v1:127.0.0.1:6803/122156] [v2:127.0.0.1:6804/122156,v1:127.0.0.1:6805/122156] exists,up 1561aef8-23a1-4015-8515-20becbb1f344 2020-09-08T15:46:53.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:46:53.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:46:53.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:46:53.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:46:53.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 1 2020-09-08T15:46:53.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:46:53.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:46:53.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T15:46:53.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:46:53.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/1 2020-09-08T15:46:53.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:46:53.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:46:53.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:46:53.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:46:53.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/1' 2020-09-08T15:46:53.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/1/journal' 2020-09-08T15:46:53.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:46:53.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2020-09-08T15:46:53.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:46:53.590 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:46:53.590 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:46:53.590 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:46:53.590 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:46:53.590 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:46:53.591 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:46:53.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:46:53.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:46:53.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:46:53.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:46:53.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:46:53.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:46:53.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:46:53.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:46:53.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:46:53.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:46:53.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:46:53.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:46:53.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/1 2020-09-08T15:46:53.595 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:46:53.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=b4ee5f35-0d0a-4ff8-8d82-72fd88089b76 2020-09-08T15:46:53.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 b4ee5f35-0d0a-4ff8-8d82-72fd88089b76' 2020-09-08T15:46:53.595 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:46:53.596 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 b4ee5f35-0d0a-4ff8-8d82-72fd88089b76 2020-09-08T15:46:53.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBtp1df/ggiJBAAVqIkWHGV8lfRuWZgulg9Gg== 2020-09-08T15:46:53.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBtp1df/ggiJBAAVqIkWHGV8lfRuWZgulg9Gg=="}' 2020-09-08T15:46:53.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new b4ee5f35-0d0a-4ff8-8d82-72fd88089b76 -i td/osd-backfill-recovery-log/1/new.json 2020-09-08T15:46:54.089 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:46:54.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/1/new.json 2020-09-08T15:46:54.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBtp1df/ggiJBAAVqIkWHGV8lfRuWZgulg9Gg== --osd-uuid b4ee5f35-0d0a-4ff8-8d82-72fd88089b76 2020-09-08T15:46:54.125 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:54.130+0000 7f11bfb1cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:46:54.127 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:54.132+0000 7f11bfb1cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:46:54.128 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:54.133+0000 7f11bfb1cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:46:54.129 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:54.134+0000 7f11bfb1cec0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2020-09-08T15:46:54.130 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:54.134+0000 7f11bfb1cec0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2020-09-08T15:46:54.130 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:54.134+0000 7f11bfb1cec0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2020-09-08T15:46:54.173 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:54.179+0000 7f11bfb1cec0 -1 bluestore(td/osd-backfill-recovery-log/1) _read_fsid unparsable uuid 2020-09-08T15:46:58.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/1/keyring 2020-09-08T15:46:58.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:46:58.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T15:46:58.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:46:58.124 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T15:46:58.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T15:46:58.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:46:58.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:46:58.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:46:58.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:46:58.665 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:46:58.686 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:58.689+0000 7fcfb8069ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:46:58.713 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:58.716+0000 7fcfb8069ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:46:58.714 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:58.718+0000 7fcfb8069ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:46:59.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T15:46:59.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:46:59.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:46:59.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:46:59.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:46:59.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:46:59.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:46:59.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:46:59.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:46:59.058 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:46:59.232 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:46:59.233+0000 7fcfb8069ec0 -1 Falling back to public interface 2020-09-08T15:46:59.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:47:00.080 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:00.083+0000 7fcfb8069ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T15:47:00.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:47:00.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:47:00.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:47:00.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:47:00.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:47:00.469 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:47:00.897 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/123150,v1:127.0.0.1:6811/123150] [v2:127.0.0.1:6812/123150,v1:127.0.0.1:6813/123150] exists,up b4ee5f35-0d0a-4ff8-8d82-72fd88089b76 2020-09-08T15:47:00.902 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 13e546a1-41ef-424c-9932-c045f8dfa92a 2020-09-08T15:47:00.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:47:00.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:47:00.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:47:00.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:47:00.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 2 2020-09-08T15:47:00.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:47:00.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:47:00.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T15:47:00.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:47:00.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/2 2020-09-08T15:47:00.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:47:00.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:47:00.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:47:00.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:47:00.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/2' 2020-09-08T15:47:00.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/2/journal' 2020-09-08T15:47:00.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:47:00.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2020-09-08T15:47:00.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:47:00.909 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:47:00.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:47:00.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:47:00.911 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:47:00.912 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:47:00.912 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:47:00.912 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:47:00.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:47:00.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:47:00.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:47:00.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:47:00.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:47:00.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:47:00.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:47:00.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:47:00.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:47:00.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:47:00.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:47:00.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/2 2020-09-08T15:47:00.916 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:47:00.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=13e546a1-41ef-424c-9932-c045f8dfa92a 2020-09-08T15:47:00.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 13e546a1-41ef-424c-9932-c045f8dfa92a' 2020-09-08T15:47:00.917 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:47:00.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQB0p1df4yJ+NhAA0VvqC5Qc9SbTAOF3ei4lbw== 2020-09-08T15:47:00.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQB0p1df4yJ+NhAA0VvqC5Qc9SbTAOF3ei4lbw=="}' 2020-09-08T15:47:00.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 13e546a1-41ef-424c-9932-c045f8dfa92a -i td/osd-backfill-recovery-log/2/new.json 2020-09-08T15:47:01.504 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T15:47:01.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/2/new.json 2020-09-08T15:47:01.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQB0p1df4yJ+NhAA0VvqC5Qc9SbTAOF3ei4lbw== --osd-uuid 13e546a1-41ef-424c-9932-c045f8dfa92a 2020-09-08T15:47:01.541 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:01.545+0000 7fc72d6d3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:01.542 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:01.547+0000 7fc72d6d3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:01.544 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:01.549+0000 7fc72d6d3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:01.545 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:01.550+0000 7fc72d6d3ec0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2020-09-08T15:47:01.545 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:01.550+0000 7fc72d6d3ec0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2020-09-08T15:47:01.545 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:01.550+0000 7fc72d6d3ec0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2020-09-08T15:47:01.595 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:01.600+0000 7fc72d6d3ec0 -1 bluestore(td/osd-backfill-recovery-log/2) _read_fsid unparsable uuid 2020-09-08T15:47:05.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/2/keyring 2020-09-08T15:47:05.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:47:05.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T15:47:05.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:47:05.773 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T15:47:06.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T15:47:06.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:47:06.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:47:06.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:47:06.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:47:06.312 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T15:47:06.340 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:06.339+0000 7f5bd1e97ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:06.351 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:06.356+0000 7f5bd1e97ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:06.352 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:06.357+0000 7f5bd1e97ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:06.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T15:47:06.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:47:06.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:47:06.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:47:06.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:47:06.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:47:06.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:47:06.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:47:06.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:47:06.703 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:47:06.868 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:06.873+0000 7f5bd1e97ec0 -1 Falling back to public interface 2020-09-08T15:47:07.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:47:07.644 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:07.648+0000 7f5bd1e97ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T15:47:08.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:47:08.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:47:08.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:47:08.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:47:08.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:47:08.110 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:47:08.535 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/124144,v1:127.0.0.1:6819/124144] [v2:127.0.0.1:6820/124144,v1:127.0.0.1:6821/124144] exists,up 13e546a1-41ef-424c-9932-c045f8dfa92a 2020-09-08T15:47:08.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:47:08.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:47:08.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:47:08.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:47:08.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 3 2020-09-08T15:47:08.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:47:08.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:47:08.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T15:47:08.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:47:08.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/3 2020-09-08T15:47:08.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:47:08.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:47:08.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:47:08.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:47:08.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/3' 2020-09-08T15:47:08.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/3/journal' 2020-09-08T15:47:08.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:47:08.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2020-09-08T15:47:08.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:47:08.540 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:47:08.540 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:47:08.540 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:47:08.540 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:47:08.541 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:47:08.541 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:47:08.541 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:47:08.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:47:08.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:47:08.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:47:08.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:47:08.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:47:08.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:47:08.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:47:08.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:47:08.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:47:08.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:47:08.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:47:08.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/3 2020-09-08T15:47:08.544 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:47:08.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=ad880197-7864-4503-975b-d8d403c89e97 2020-09-08T15:47:08.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 ad880197-7864-4503-975b-d8d403c89e97' 2020-09-08T15:47:08.545 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:47:08.546 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 ad880197-7864-4503-975b-d8d403c89e97 2020-09-08T15:47:08.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQB8p1dfxbEVIRAAT326VANRWR+3DqFs09KwJQ== 2020-09-08T15:47:08.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQB8p1dfxbEVIRAAT326VANRWR+3DqFs09KwJQ=="}' 2020-09-08T15:47:08.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new ad880197-7864-4503-975b-d8d403c89e97 -i td/osd-backfill-recovery-log/3/new.json 2020-09-08T15:47:09.041 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T15:47:09.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/3/new.json 2020-09-08T15:47:09.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQB8p1dfxbEVIRAAT326VANRWR+3DqFs09KwJQ== --osd-uuid ad880197-7864-4503-975b-d8d403c89e97 2020-09-08T15:47:09.077 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:09.082+0000 7f5541cd1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:09.078 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:09.083+0000 7f5541cd1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:09.080 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:09.085+0000 7f5541cd1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:09.082 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:09.086+0000 7f5541cd1ec0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2020-09-08T15:47:09.082 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:09.086+0000 7f5541cd1ec0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2020-09-08T15:47:09.082 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:09.086+0000 7f5541cd1ec0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2020-09-08T15:47:09.134 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:09.138+0000 7f5541cd1ec0 -1 bluestore(td/osd-backfill-recovery-log/3) _read_fsid unparsable uuid 2020-09-08T15:47:13.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/3/keyring 2020-09-08T15:47:13.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:47:13.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T15:47:13.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:47:13.495 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T15:47:14.022 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T15:47:14.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T15:47:14.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:47:14.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:47:14.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:47:14.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:47:14.046 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:14.050+0000 7fa1f1e07ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:14.047 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:14.052+0000 7fa1f1e07ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:14.048 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:14.053+0000 7fa1f1e07ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:14.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T15:47:14.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:47:14.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T15:47:14.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:47:14.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:47:14.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:47:14.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:47:14.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:47:14.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T15:47:14.412 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:47:14.570 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:14.574+0000 7fa1f1e07ec0 -1 Falling back to public interface 2020-09-08T15:47:14.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:47:15.358 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:15.355+0000 7fa1f1e07ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T15:47:15.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:47:15.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:47:15.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:47:15.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:47:15.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T15:47:15.803 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:47:16.215 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/125138,v1:127.0.0.1:6827/125138] [v2:127.0.0.1:6828/125138,v1:127.0.0.1:6829/125138] exists,up ad880197-7864-4503-975b-d8d403c89e97 2020-09-08T15:47:16.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:47:16.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:47:16.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:47:16.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:47:16.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 4 2020-09-08T15:47:16.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:47:16.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:47:16.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=4 2020-09-08T15:47:16.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:47:16.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/4 2020-09-08T15:47:16.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:47:16.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:47:16.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:47:16.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:47:16.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/4' 2020-09-08T15:47:16.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/4/journal' 2020-09-08T15:47:16.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:47:16.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2020-09-08T15:47:16.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:47:16.220 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:47:16.220 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:47:16.220 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:47:16.220 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:47:16.220 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:47:16.220 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:47:16.221 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:47:16.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:47:16.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:47:16.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:47:16.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:47:16.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:47:16.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:47:16.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:47:16.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:47:16.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:47:16.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:47:16.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:47:16.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/4 2020-09-08T15:47:16.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:47:16.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=4f9565ad-c1c4-47e1-9c8c-f63b101e0d23 2020-09-08T15:47:16.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd4 4f9565ad-c1c4-47e1-9c8c-f63b101e0d23' 2020-09-08T15:47:16.225 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:47:16.225 INFO:tasks.workunit.client.0.smithi065.stdout:add osd4 4f9565ad-c1c4-47e1-9c8c-f63b101e0d23 2020-09-08T15:47:16.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCEp1dfMPcHDhAAMiCnxrPgT06BwdA2eMHw2Q== 2020-09-08T15:47:16.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCEp1dfMPcHDhAAMiCnxrPgT06BwdA2eMHw2Q=="}' 2020-09-08T15:47:16.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 4f9565ad-c1c4-47e1-9c8c-f63b101e0d23 -i td/osd-backfill-recovery-log/4/new.json 2020-09-08T15:47:16.731 INFO:tasks.workunit.client.0.smithi065.stdout:4 2020-09-08T15:47:16.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/4/new.json 2020-09-08T15:47:16.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 4 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCEp1dfMPcHDhAAMiCnxrPgT06BwdA2eMHw2Q== --osd-uuid 4f9565ad-c1c4-47e1-9c8c-f63b101e0d23 2020-09-08T15:47:16.768 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:16.772+0000 7feec3f53ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:16.769 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:16.774+0000 7feec3f53ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:16.778 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:16.775+0000 7feec3f53ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:16.779 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:16.776+0000 7feec3f53ec0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2020-09-08T15:47:16.779 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:16.776+0000 7feec3f53ec0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2020-09-08T15:47:16.779 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:16.776+0000 7feec3f53ec0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2020-09-08T15:47:16.822 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:16.827+0000 7feec3f53ec0 -1 bluestore(td/osd-backfill-recovery-log/4) _read_fsid unparsable uuid 2020-09-08T15:47:21.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/4/keyring 2020-09-08T15:47:21.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:47:21.176 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd4 key to auth repository 2020-09-08T15:47:21.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd4 key to auth repository 2020-09-08T15:47:21.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:47:21.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.4 2020-09-08T15:47:21.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:47:21.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:47:21.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:47:21.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 4 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:47:21.715 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.4 2020-09-08T15:47:21.736 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:21.741+0000 7f8594162ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:21.748 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:21.753+0000 7f8594162ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:21.750 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:21.755+0000 7f8594162ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:22.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 4 2020-09-08T15:47:22.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:47:22.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=4 2020-09-08T15:47:22.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:47:22.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:47:22.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:47:22.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:47:22.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:47:22.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T15:47:22.117 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:47:22.265 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:22.270+0000 7f8594162ec0 -1 Falling back to public interface 2020-09-08T15:47:22.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:47:23.092 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:23.095+0000 7f8594162ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-09-08T15:47:23.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:47:23.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:47:23.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:47:23.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:47:23.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T15:47:23.523 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:47:23.967 INFO:tasks.workunit.client.0.smithi065.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/126132,v1:127.0.0.1:6835/126132] [v2:127.0.0.1:6836/126132,v1:127.0.0.1:6837/126132] exists,up 4f9565ad-c1c4-47e1-9c8c-f63b101e0d23 2020-09-08T15:47:23.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:47:23.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:47:23.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:47:23.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:47:23.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 5 2020-09-08T15:47:23.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:47:23.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:47:23.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=5 2020-09-08T15:47:23.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:47:23.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/5 2020-09-08T15:47:23.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:47:23.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:47:23.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:47:23.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:47:23.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/5' 2020-09-08T15:47:23.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/5/journal' 2020-09-08T15:47:23.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:47:23.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2020-09-08T15:47:23.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:47:23.972 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:47:23.972 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:47:23.972 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:47:23.972 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:47:23.972 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:47:23.972 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:47:23.974 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:47:23.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:47:23.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:47:23.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:47:23.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:47:23.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:47:23.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:47:23.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:47:23.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:47:23.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:47:23.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:47:23.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:47:23.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/5 2020-09-08T15:47:23.977 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:47:23.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=9c0d0209-4f31-4588-8520-bec958d962c0 2020-09-08T15:47:23.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd5 9c0d0209-4f31-4588-8520-bec958d962c0' 2020-09-08T15:47:23.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:47:23.979 INFO:tasks.workunit.client.0.smithi065.stdout:add osd5 9c0d0209-4f31-4588-8520-bec958d962c0 2020-09-08T15:47:23.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCLp1dfXb/qOhAA+cUttODtRr7MzfC6rattrg== 2020-09-08T15:47:23.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCLp1dfXb/qOhAA+cUttODtRr7MzfC6rattrg=="}' 2020-09-08T15:47:23.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 9c0d0209-4f31-4588-8520-bec958d962c0 -i td/osd-backfill-recovery-log/5/new.json 2020-09-08T15:47:24.530 INFO:tasks.workunit.client.0.smithi065.stdout:5 2020-09-08T15:47:24.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/5/new.json 2020-09-08T15:47:24.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 5 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCLp1dfXb/qOhAA+cUttODtRr7MzfC6rattrg== --osd-uuid 9c0d0209-4f31-4588-8520-bec958d962c0 2020-09-08T15:47:24.566 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:24.570+0000 7f30e3edeec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:24.591 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:24.595+0000 7f30e3edeec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:24.592 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:24.597+0000 7f30e3edeec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:24.593 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:24.598+0000 7f30e3edeec0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2020-09-08T15:47:24.593 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:24.598+0000 7f30e3edeec0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2020-09-08T15:47:24.593 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:24.598+0000 7f30e3edeec0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2020-09-08T15:47:24.657 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:24.662+0000 7f30e3edeec0 -1 bluestore(td/osd-backfill-recovery-log/5) _read_fsid unparsable uuid 2020-09-08T15:47:28.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/5/keyring 2020-09-08T15:47:28.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:47:28.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd5 key to auth repository 2020-09-08T15:47:28.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:47:28.952 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd5 key to auth repository 2020-09-08T15:47:29.481 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.5 2020-09-08T15:47:29.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.5 2020-09-08T15:47:29.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 5 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:47:29.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:47:29.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:47:29.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:47:29.504 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:29.509+0000 7f0ee26ccec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:29.515 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:29.520+0000 7f0ee26ccec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:29.516 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:29.521+0000 7f0ee26ccec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:47:29.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 5 2020-09-08T15:47:29.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:47:29.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=5 2020-09-08T15:47:29.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:47:29.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:47:29.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:47:29.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:47:29.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:47:29.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T15:47:29.876 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:47:30.036 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:30.040+0000 7f0ee26ccec0 -1 Falling back to public interface 2020-09-08T15:47:30.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:47:30.884 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:47:30.888+0000 7f0ee26ccec0 -1 osd.5 0 log_to_monitors {default=true} 2020-09-08T15:47:31.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:47:31.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:47:31.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:47:31.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:47:31.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T15:47:31.283 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:47:31.687 INFO:tasks.workunit.client.0.smithi065.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/127126,v1:127.0.0.1:6843/127126] [v2:127.0.0.1:6844/127126,v1:127.0.0.1:6845/127126] exists,up 9c0d0209-4f31-4588-8520-bec958d962c0 2020-09-08T15:47:31.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:47:31.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:47:31.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:47:31.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:59: _common_test: create_pool test 1 1 2020-09-08T15:47:31.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test 1 1 2020-09-08T15:47:32.361 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' already exists 2020-09-08T15:47:32.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:47:33.371 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: seq 1 150 2020-09-08T15:47:33.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:33.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-1 /etc/passwd 2020-09-08T15:47:33.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:33.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-2 /etc/passwd 2020-09-08T15:47:33.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:33.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-3 /etc/passwd 2020-09-08T15:47:33.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:33.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-4 /etc/passwd 2020-09-08T15:47:34.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:34.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-5 /etc/passwd 2020-09-08T15:47:34.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:34.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-6 /etc/passwd 2020-09-08T15:47:34.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:34.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-7 /etc/passwd 2020-09-08T15:47:34.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:34.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-8 /etc/passwd 2020-09-08T15:47:34.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:34.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-9 /etc/passwd 2020-09-08T15:47:34.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:34.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-10 /etc/passwd 2020-09-08T15:47:34.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:34.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-11 /etc/passwd 2020-09-08T15:47:34.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:34.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-12 /etc/passwd 2020-09-08T15:47:35.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:35.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-13 /etc/passwd 2020-09-08T15:47:35.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:35.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-14 /etc/passwd 2020-09-08T15:47:35.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:35.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-15 /etc/passwd 2020-09-08T15:47:35.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:35.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-16 /etc/passwd 2020-09-08T15:47:35.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:35.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-17 /etc/passwd 2020-09-08T15:47:35.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:35.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-18 /etc/passwd 2020-09-08T15:47:35.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:35.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-19 /etc/passwd 2020-09-08T15:47:36.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:36.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-20 /etc/passwd 2020-09-08T15:47:36.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:36.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-21 /etc/passwd 2020-09-08T15:47:36.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:36.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-22 /etc/passwd 2020-09-08T15:47:36.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:36.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-23 /etc/passwd 2020-09-08T15:47:36.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:36.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-24 /etc/passwd 2020-09-08T15:47:36.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:36.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-25 /etc/passwd 2020-09-08T15:47:36.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:36.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-26 /etc/passwd 2020-09-08T15:47:37.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:37.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-27 /etc/passwd 2020-09-08T15:47:37.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:37.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-28 /etc/passwd 2020-09-08T15:47:37.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:37.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-29 /etc/passwd 2020-09-08T15:47:37.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:37.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-30 /etc/passwd 2020-09-08T15:47:37.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:37.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-31 /etc/passwd 2020-09-08T15:47:37.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:37.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-32 /etc/passwd 2020-09-08T15:47:37.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:37.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-33 /etc/passwd 2020-09-08T15:47:37.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:37.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-34 /etc/passwd 2020-09-08T15:47:38.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:38.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-35 /etc/passwd 2020-09-08T15:47:38.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:38.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-36 /etc/passwd 2020-09-08T15:47:38.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:38.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-37 /etc/passwd 2020-09-08T15:47:38.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:38.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-38 /etc/passwd 2020-09-08T15:47:38.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:38.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-39 /etc/passwd 2020-09-08T15:47:38.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:38.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-40 /etc/passwd 2020-09-08T15:47:38.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:38.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-41 /etc/passwd 2020-09-08T15:47:39.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:39.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-42 /etc/passwd 2020-09-08T15:47:39.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:39.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-43 /etc/passwd 2020-09-08T15:47:39.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:39.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-44 /etc/passwd 2020-09-08T15:47:39.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:39.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-45 /etc/passwd 2020-09-08T15:47:39.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:39.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-46 /etc/passwd 2020-09-08T15:47:39.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:39.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-47 /etc/passwd 2020-09-08T15:47:39.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:39.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-48 /etc/passwd 2020-09-08T15:47:40.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:40.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-49 /etc/passwd 2020-09-08T15:47:40.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:40.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-50 /etc/passwd 2020-09-08T15:47:40.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:40.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-51 /etc/passwd 2020-09-08T15:47:40.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:40.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-52 /etc/passwd 2020-09-08T15:47:40.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:40.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-53 /etc/passwd 2020-09-08T15:47:40.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:40.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-54 /etc/passwd 2020-09-08T15:47:40.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:40.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-55 /etc/passwd 2020-09-08T15:47:40.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:40.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-56 /etc/passwd 2020-09-08T15:47:41.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:41.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-57 /etc/passwd 2020-09-08T15:47:41.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:41.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-58 /etc/passwd 2020-09-08T15:47:41.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:41.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-59 /etc/passwd 2020-09-08T15:47:41.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:41.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-60 /etc/passwd 2020-09-08T15:47:41.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:41.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-61 /etc/passwd 2020-09-08T15:47:41.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:41.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-62 /etc/passwd 2020-09-08T15:47:41.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:41.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-63 /etc/passwd 2020-09-08T15:47:42.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:42.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-64 /etc/passwd 2020-09-08T15:47:42.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:42.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-65 /etc/passwd 2020-09-08T15:47:42.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:42.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-66 /etc/passwd 2020-09-08T15:47:42.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:42.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-67 /etc/passwd 2020-09-08T15:47:42.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:42.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-68 /etc/passwd 2020-09-08T15:47:42.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:42.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-69 /etc/passwd 2020-09-08T15:47:42.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:42.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-70 /etc/passwd 2020-09-08T15:47:43.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:43.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-71 /etc/passwd 2020-09-08T15:47:43.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:43.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-72 /etc/passwd 2020-09-08T15:47:43.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:43.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-73 /etc/passwd 2020-09-08T15:47:43.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:43.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-74 /etc/passwd 2020-09-08T15:47:43.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:43.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-75 /etc/passwd 2020-09-08T15:47:43.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:43.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-76 /etc/passwd 2020-09-08T15:47:43.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:43.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-77 /etc/passwd 2020-09-08T15:47:44.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:44.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-78 /etc/passwd 2020-09-08T15:47:44.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:44.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-79 /etc/passwd 2020-09-08T15:47:44.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:44.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-80 /etc/passwd 2020-09-08T15:47:44.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:44.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-81 /etc/passwd 2020-09-08T15:47:44.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:44.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-82 /etc/passwd 2020-09-08T15:47:44.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:44.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-83 /etc/passwd 2020-09-08T15:47:44.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:44.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-84 /etc/passwd 2020-09-08T15:47:45.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:45.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-85 /etc/passwd 2020-09-08T15:47:45.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:45.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-86 /etc/passwd 2020-09-08T15:47:45.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:45.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-87 /etc/passwd 2020-09-08T15:47:45.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:45.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-88 /etc/passwd 2020-09-08T15:47:45.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:45.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-89 /etc/passwd 2020-09-08T15:47:45.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:45.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-90 /etc/passwd 2020-09-08T15:47:45.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:45.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-91 /etc/passwd 2020-09-08T15:47:45.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:45.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-92 /etc/passwd 2020-09-08T15:47:46.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:46.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-93 /etc/passwd 2020-09-08T15:47:46.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:46.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-94 /etc/passwd 2020-09-08T15:47:46.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:46.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-95 /etc/passwd 2020-09-08T15:47:46.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:46.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-96 /etc/passwd 2020-09-08T15:47:46.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:46.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-97 /etc/passwd 2020-09-08T15:47:46.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:46.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-98 /etc/passwd 2020-09-08T15:47:46.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:46.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-99 /etc/passwd 2020-09-08T15:47:47.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:47.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-100 /etc/passwd 2020-09-08T15:47:47.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:47.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-101 /etc/passwd 2020-09-08T15:47:47.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:47.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-102 /etc/passwd 2020-09-08T15:47:47.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:47.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-103 /etc/passwd 2020-09-08T15:47:47.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:47.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-104 /etc/passwd 2020-09-08T15:47:47.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:47.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-105 /etc/passwd 2020-09-08T15:47:47.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:47.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-106 /etc/passwd 2020-09-08T15:47:47.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:47.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-107 /etc/passwd 2020-09-08T15:47:48.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:48.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-108 /etc/passwd 2020-09-08T15:47:48.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:48.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-109 /etc/passwd 2020-09-08T15:47:48.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:48.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-110 /etc/passwd 2020-09-08T15:47:48.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:48.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-111 /etc/passwd 2020-09-08T15:47:48.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:48.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-112 /etc/passwd 2020-09-08T15:47:49.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:49.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-113 /etc/passwd 2020-09-08T15:47:49.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:49.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-114 /etc/passwd 2020-09-08T15:47:49.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:49.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-115 /etc/passwd 2020-09-08T15:47:49.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:49.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-116 /etc/passwd 2020-09-08T15:47:49.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:49.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-117 /etc/passwd 2020-09-08T15:47:49.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:49.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-118 /etc/passwd 2020-09-08T15:47:49.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:49.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-119 /etc/passwd 2020-09-08T15:47:50.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:50.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-120 /etc/passwd 2020-09-08T15:47:50.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:50.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-121 /etc/passwd 2020-09-08T15:47:50.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:50.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-122 /etc/passwd 2020-09-08T15:47:50.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:50.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-123 /etc/passwd 2020-09-08T15:47:50.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:50.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-124 /etc/passwd 2020-09-08T15:47:50.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:50.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-125 /etc/passwd 2020-09-08T15:47:50.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:50.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-126 /etc/passwd 2020-09-08T15:47:51.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:51.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-127 /etc/passwd 2020-09-08T15:47:51.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:51.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-128 /etc/passwd 2020-09-08T15:47:51.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:51.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-129 /etc/passwd 2020-09-08T15:47:51.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:51.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-130 /etc/passwd 2020-09-08T15:47:51.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:51.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-131 /etc/passwd 2020-09-08T15:47:51.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:51.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-132 /etc/passwd 2020-09-08T15:47:51.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:51.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-133 /etc/passwd 2020-09-08T15:47:51.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:51.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-134 /etc/passwd 2020-09-08T15:47:52.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:52.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-135 /etc/passwd 2020-09-08T15:47:52.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:52.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-136 /etc/passwd 2020-09-08T15:47:52.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:52.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-137 /etc/passwd 2020-09-08T15:47:52.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:52.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-138 /etc/passwd 2020-09-08T15:47:52.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:52.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-139 /etc/passwd 2020-09-08T15:47:52.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:52.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-140 /etc/passwd 2020-09-08T15:47:52.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:52.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-141 /etc/passwd 2020-09-08T15:47:53.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:53.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-142 /etc/passwd 2020-09-08T15:47:53.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:53.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-143 /etc/passwd 2020-09-08T15:47:53.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:53.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-144 /etc/passwd 2020-09-08T15:47:53.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:53.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-145 /etc/passwd 2020-09-08T15:47:53.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:53.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-146 /etc/passwd 2020-09-08T15:47:53.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:53.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-147 /etc/passwd 2020-09-08T15:47:53.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:53.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-148 /etc/passwd 2020-09-08T15:47:54.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:54.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-149 /etc/passwd 2020-09-08T15:47:54.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:47:54.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-150 /etc/passwd 2020-09-08T15:47:54.400 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:67: _common_test: ceph pg dump pgs --format=json 2020-09-08T15:47:54.401 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:67: _common_test: jq '.pg_stats[0].up[]' 2020-09-08T15:47:54.778 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:47:54.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:67: _common_test: ceph osd out 1 0 2 2020-09-08T15:47:55.333 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already out. osd.0 is already out. osd.2 is already out. 2020-09-08T15:47:55.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:68: _common_test: '[' 0 '!=' 0 ']' 2020-09-08T15:47:55.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:74: _common_test: sleep 1 2020-09-08T15:47:56.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:75: _common_test: wait_for_clean 2020-09-08T15:47:56.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:47:56.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:47:56.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:47:56.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:47:56.344 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T15:47:56.345 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:47:56.345 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:47:56.345 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:47:56.345 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:47:56.346 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:47:56.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:47:56.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:47:56.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:47:56.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:47:56.458 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:47:56.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:47:56.849 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:47:56.849 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T15:47:56.849 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T15:47:56.850 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T15:47:56.850 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T15:47:56.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:47:56.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:47:56.850 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:47:56.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836495 2020-09-08T15:47:56.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836495 2020-09-08T15:47:56.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495' 2020-09-08T15:47:56.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:47:56.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:47:57.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672975 2020-09-08T15:47:57.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672975 2020-09-08T15:47:57.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495 1-42949672975' 2020-09-08T15:47:57.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:47:57.108 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:47:57.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509452 2020-09-08T15:47:57.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509452 2020-09-08T15:47:57.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495 1-42949672975 2-64424509452' 2020-09-08T15:47:57.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:47:57.238 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T15:47:57.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345931 2020-09-08T15:47:57.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345931 2020-09-08T15:47:57.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495 1-42949672975 2-64424509452 3-85899345931' 2020-09-08T15:47:57.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:47:57.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T15:47:57.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182410 2020-09-08T15:47:57.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182410 2020-09-08T15:47:57.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495 1-42949672975 2-64424509452 3-85899345931 4-107374182410' 2020-09-08T15:47:57.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:47:57.496 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T15:47:57.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018888 2020-09-08T15:47:57.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018888 2020-09-08T15:47:57.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495 1-42949672975 2-64424509452 3-85899345931 4-107374182410 5-128849018888' 2020-09-08T15:47:57.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:47:57.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836495 2020-09-08T15:47:57.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:47:57.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:47:57.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836495 2020-09-08T15:47:57.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:47:57.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836495 2020-09-08T15:47:57.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836495' 2020-09-08T15:47:57.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:47:57.631 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836495 2020-09-08T15:47:58.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 0 -lt 21474836495 2020-09-08T15:47:58.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:47:59.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:47:59.043 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:47:59.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836495 -lt 21474836495 2020-09-08T15:47:59.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:47:59.449 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672975 2020-09-08T15:47:59.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:47:59.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:47:59.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672975 2020-09-08T15:47:59.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:47:59.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672975 2020-09-08T15:47:59.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672975' 2020-09-08T15:47:59.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:47:59.452 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672975 2020-09-08T15:47:59.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672975 -lt 42949672975 2020-09-08T15:47:59.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:47:59.843 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509452 2020-09-08T15:47:59.843 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:47:59.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:47:59.844 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509452 2020-09-08T15:47:59.844 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:47:59.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509452 2020-09-08T15:47:59.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509452' 2020-09-08T15:47:59.845 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:47:59.845 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509452 2020-09-08T15:48:00.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509453 -lt 64424509452 2020-09-08T15:48:00.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:48:00.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345931 2020-09-08T15:48:00.241 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:48:00.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T15:48:00.241 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345931 2020-09-08T15:48:00.242 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:48:00.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345931 2020-09-08T15:48:00.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345931' 2020-09-08T15:48:00.243 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T15:48:00.243 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345931 2020-09-08T15:48:00.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345931 -lt 85899345931 2020-09-08T15:48:00.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:48:00.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182410 2020-09-08T15:48:00.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:48:00.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T15:48:00.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182410 2020-09-08T15:48:00.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:48:00.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182410 2020-09-08T15:48:00.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182410' 2020-09-08T15:48:00.637 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T15:48:00.637 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182410 2020-09-08T15:48:01.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182411 -lt 107374182410 2020-09-08T15:48:01.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:48:01.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018888 2020-09-08T15:48:01.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:48:01.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T15:48:01.056 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018888 2020-09-08T15:48:01.056 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:48:01.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018888 2020-09-08T15:48:01.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018888' 2020-09-08T15:48:01.057 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T15:48:01.057 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018888 2020-09-08T15:48:01.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018888 -lt 128849018888 2020-09-08T15:48:01.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:48:01.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:01.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:02.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T15:48:02.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:02.020 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:02.020 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:02.020 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:02.020 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:02.020 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:02.021 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:02.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:02.401 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:02.401 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:02.402 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:02.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:02.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T15:48:02.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T15:48:02.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T15:48:02.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:02.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:03.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:03.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:03.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:03.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:03.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:03.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:03.024 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:03.024 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:03.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:03.403 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:03.403 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:03.403 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:03.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:03.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:03.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:03.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:03.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:03.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:03.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:03.921 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:03.921 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:04.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4881 2020-09-08T15:48:04.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4881 '!=' null 2020-09-08T15:48:04.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:04.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:04.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:04.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:04.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:04.597 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:04.597 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:04.597 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:04.597 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:04.597 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:04.598 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:04.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:04.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:04.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:04.969 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:05.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:05.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:05.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:05.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:05.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:05.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:05.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:05.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:05.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:06.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4881 2020-09-08T15:48:06.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4881 '!=' null 2020-09-08T15:48:06.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:06.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:06.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:06.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:06.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:06.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:06.114 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:06.114 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:06.114 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:06.114 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:06.115 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:06.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:06.495 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:06.496 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:06.496 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:07.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:07.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:07.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:07.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:07.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:07.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:07.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:07.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:07.020 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:07.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=18129 2020-09-08T15:48:07.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 18129 '!=' null 2020-09-08T15:48:07.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:07.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:07.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:07.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:07.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:07.690 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:07.690 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:07.690 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:07.690 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:07.690 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:07.691 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:08.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:08.079 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:08.080 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:08.080 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:08.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:08.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:08.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:08.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:08.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:08.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:08.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:08.597 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:08.598 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:09.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=15622 2020-09-08T15:48:09.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 15622 '!=' null 2020-09-08T15:48:09.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:09.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:09.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:09.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:09.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:09.210 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:09.210 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:09.210 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:09.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:09.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:09.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:09.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:09.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:09.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:09.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:10.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:10.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:10.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:10.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:10.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:10.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:10.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:10.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:10.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:10.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=27337 2020-09-08T15:48:10.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 27337 '!=' null 2020-09-08T15:48:10.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:10.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:10.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:10.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:10.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:10.777 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:10.777 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:10.778 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:10.778 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:10.778 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:10.778 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:11.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:11.155 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:11.155 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:11.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:11.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:11.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:11.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:11.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:11.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:11.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:11.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:11.683 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:11.683 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:12.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=24083 2020-09-08T15:48:12.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 24083 '!=' null 2020-09-08T15:48:12.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:12.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:12.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:12.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:12.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:12.305 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:12.306 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:12.306 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:12.306 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:12.306 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:12.306 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:12.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:12.690 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:12.690 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:12.691 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:13.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:13.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:13.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:13.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:13.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:13.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:13.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:13.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:13.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:13.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=24083 2020-09-08T15:48:13.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 24083 '!=' null 2020-09-08T15:48:13.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:13.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:13.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:13.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:13.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:13.835 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:13.835 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:13.836 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:13.836 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:13.836 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:13.836 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:14.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:14.216 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:14.216 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:14.216 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:14.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:14.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:14.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:14.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:14.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:14.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:14.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:14.742 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:14.742 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:15.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=24083 2020-09-08T15:48:15.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 24083 '!=' null 2020-09-08T15:48:15.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:15.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:15.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:15.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:15.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:15.378 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:15.378 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:15.378 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:15.379 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:15.379 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:15.379 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:15.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:15.767 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:15.767 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:15.767 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:16.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:16.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:16.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:16.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:16.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:16.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:16.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:16.306 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:16.306 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:16.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=36449 2020-09-08T15:48:16.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 36449 '!=' null 2020-09-08T15:48:16.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:16.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:16.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:16.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:16.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:16.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:16.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:16.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:16.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:16.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:16.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:17.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:17.313 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:17.314 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:17.314 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:17.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:17.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:17.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:17.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:17.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:17.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:17.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:17.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:17.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:18.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=24733 2020-09-08T15:48:18.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 24733 '!=' null 2020-09-08T15:48:18.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:18.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:18.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:18.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:18.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:18.484 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:18.484 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:18.484 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:18.484 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:18.485 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:18.485 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:18.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:18.861 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:18.862 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:18.862 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:19.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:19.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:19.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:19.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:19.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:19.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:19.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:19.377 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:19.377 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:19.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=24733 2020-09-08T15:48:19.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 24733 '!=' null 2020-09-08T15:48:19.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:19.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:19.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:19.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:19.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:19.996 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:19.997 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:19.997 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:19.997 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:19.997 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:19.997 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:20.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:20.411 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:20.411 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:20.411 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:20.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:20.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:20.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:20.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:20.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:20.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:20.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:20.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:20.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:21.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=37751 2020-09-08T15:48:21.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 37751 '!=' null 2020-09-08T15:48:21.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:21.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:21.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:21.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:21.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:21.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:21.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:21.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:21.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:21.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:21.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:21.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:21.939 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:21.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:21.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:22.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:22.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:22.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:22.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:22.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:22.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:22.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:22.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:22.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:22.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=25384 2020-09-08T15:48:22.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 25384 '!=' null 2020-09-08T15:48:22.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:22.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:22.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:23.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:23.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:23.082 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:23.082 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:23.083 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:23.083 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:23.083 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:23.083 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:23.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:23.461 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:23.461 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:23.462 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:24.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:24.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:24.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:24.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:24.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:24.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:24.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:24.002 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:24.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:24.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=25384 2020-09-08T15:48:24.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 25384 '!=' null 2020-09-08T15:48:24.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:24.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:24.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:24.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:24.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:24.619 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:24.620 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:24.620 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:24.620 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:24.620 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:24.621 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:25.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:25.007 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:25.007 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:25.007 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:25.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:25.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:25.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:25.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:25.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:25.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:25.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:25.526 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:25.526 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:26.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=25384 2020-09-08T15:48:26.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 25384 '!=' null 2020-09-08T15:48:26.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:26.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:26.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:26.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:26.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:26.180 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:26.180 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:26.181 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:26.181 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:26.181 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:26.181 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:26.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:26.563 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:26.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:26.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:27.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:27.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:27.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:27.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:27.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:27.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:27.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:27.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:27.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:27.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=37751 2020-09-08T15:48:27.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 37751 '!=' null 2020-09-08T15:48:27.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:27.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:27.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:27.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:27.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:27.704 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:27.704 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:27.704 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:27.704 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:27.705 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:27.705 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:28.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:28.080 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:28.081 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:28.081 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:28.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:28.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:28.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:28.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:28.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:28.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:28.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:28.598 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:28.598 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:29.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=25384 2020-09-08T15:48:29.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 25384 '!=' null 2020-09-08T15:48:29.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:29.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:29.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:29.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:29.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:29.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:29.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:29.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:29.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:29.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:29.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:29.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:29.602 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:29.602 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:29.603 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:30.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:30.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:30.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:30.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:30.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:30.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:30.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:30.132 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:30.133 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:30.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=37751 2020-09-08T15:48:30.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 37751 '!=' null 2020-09-08T15:48:30.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:30.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:30.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:30.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:30.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:30.742 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:30.743 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:30.743 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:30.743 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:30.743 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:30.743 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:31.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:31.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:31.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:31.129 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:31.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:31.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:31.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:31.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:31.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:31.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:31.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:31.651 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:31.651 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:32.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=24734 2020-09-08T15:48:32.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 24734 '!=' null 2020-09-08T15:48:32.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:32.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:32.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:32.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:32.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:32.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:32.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:32.291 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:32.291 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:32.291 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:32.291 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:32.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:32.673 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:32.674 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:32.674 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:33.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:33.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:33.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:33.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:33.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:33.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:33.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:33.190 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:33.191 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:33.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=24734 2020-09-08T15:48:33.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 24734 '!=' null 2020-09-08T15:48:33.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:33.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:33.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:33.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:33.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:33.855 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:33.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:33.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:33.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:33.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:33.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:34.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:34.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:34.235 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:34.235 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:34.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:34.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:34.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:34.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:34.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:34.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:34.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:34.765 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:34.765 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:35.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=24734 2020-09-08T15:48:35.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 24734 '!=' null 2020-09-08T15:48:35.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:35.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:35.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:35.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:35.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:35.383 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:35.383 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:35.383 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:35.383 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:35.383 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:35.384 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:35.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:35.765 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:35.765 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:35.766 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:36.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:36.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:36.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:36.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:36.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:36.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:36.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:36.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:36.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:36.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=37100 2020-09-08T15:48:36.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 37100 '!=' null 2020-09-08T15:48:36.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:36.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:36.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:36.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:36.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:36.909 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:36.909 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:36.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:36.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:36.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:36.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:37.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:37.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:37.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:37.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:37.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:37.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:37.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:37.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:37.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:37.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:37.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:37.824 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:37.824 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:38.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=18550 2020-09-08T15:48:38.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 18550 '!=' null 2020-09-08T15:48:38.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:38.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:38.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:38.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:38.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:38.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:38.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:38.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:38.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:38.465 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:38.465 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:38.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:48:38.849 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:38.850 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:38.850 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:39.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:48:39.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:48:39.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:48:39.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:48:39.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:48:39.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:48:39.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:48:39.375 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:48:39.375 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:48:39.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=18550 2020-09-08T15:48:39.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 18550 '!=' null 2020-09-08T15:48:39.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:48:39.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:48:39.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:48:39.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:48:39.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:48:39.987 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:48:39.988 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:48:39.988 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:48:39.988 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:48:39.988 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:48:39.988 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:48:40.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:48:40.371 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:48:40.371 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:48:40.371 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:48:40.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T15:48:40.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:48:40.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:48:40.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:77: _common_test: flush_pg_stats 2020-09-08T15:48:40.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:48:40.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:48:41.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:48:41.274 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:48:41.274 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T15:48:41.274 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T15:48:41.274 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T15:48:41.274 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T15:48:41.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:48:41.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:48:41.275 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:48:41.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836506 2020-09-08T15:48:41.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836506 2020-09-08T15:48:41.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836506' 2020-09-08T15:48:41.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:48:41.425 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:48:41.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672986 2020-09-08T15:48:41.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672986 2020-09-08T15:48:41.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836506 1-42949672986' 2020-09-08T15:48:41.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:48:41.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:48:41.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509463 2020-09-08T15:48:41.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509463 2020-09-08T15:48:41.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836506 1-42949672986 2-64424509463' 2020-09-08T15:48:41.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:48:41.682 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T15:48:41.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345942 2020-09-08T15:48:41.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345942 2020-09-08T15:48:41.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836506 1-42949672986 2-64424509463 3-85899345942' 2020-09-08T15:48:41.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:48:41.811 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T15:48:41.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182421 2020-09-08T15:48:41.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182421 2020-09-08T15:48:41.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836506 1-42949672986 2-64424509463 3-85899345942 4-107374182421' 2020-09-08T15:48:41.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:48:41.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T15:48:42.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018898 2020-09-08T15:48:42.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018898 2020-09-08T15:48:42.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836506 1-42949672986 2-64424509463 3-85899345942 4-107374182421 5-128849018898' 2020-09-08T15:48:42.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:48:42.069 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836506 2020-09-08T15:48:42.069 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:48:42.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:48:42.070 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836506 2020-09-08T15:48:42.070 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:48:42.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836506 2020-09-08T15:48:42.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836506' 2020-09-08T15:48:42.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:48:42.072 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836506 2020-09-08T15:48:42.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836506 -lt 21474836506 2020-09-08T15:48:42.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:48:42.461 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672986 2020-09-08T15:48:42.461 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:48:42.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:48:42.462 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672986 2020-09-08T15:48:42.462 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:48:42.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672986 2020-09-08T15:48:42.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672986' 2020-09-08T15:48:42.463 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672986 2020-09-08T15:48:42.463 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:48:42.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672986 -lt 42949672986 2020-09-08T15:48:42.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:48:42.866 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509463 2020-09-08T15:48:42.866 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:48:42.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:48:42.867 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509463 2020-09-08T15:48:42.867 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:48:42.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509463 2020-09-08T15:48:42.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509463' 2020-09-08T15:48:42.868 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:48:42.868 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509463 2020-09-08T15:48:43.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509463 -lt 64424509463 2020-09-08T15:48:43.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:48:43.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345942 2020-09-08T15:48:43.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:48:43.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T15:48:43.274 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345942 2020-09-08T15:48:43.274 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:48:43.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345942 2020-09-08T15:48:43.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345942' 2020-09-08T15:48:43.276 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T15:48:43.276 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345942 2020-09-08T15:48:43.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345942 -lt 85899345942 2020-09-08T15:48:43.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:48:43.683 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182421 2020-09-08T15:48:43.683 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:48:43.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T15:48:43.684 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182421 2020-09-08T15:48:43.684 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:48:43.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182421 2020-09-08T15:48:43.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182421' 2020-09-08T15:48:43.685 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T15:48:43.685 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182421 2020-09-08T15:48:44.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182421 -lt 107374182421 2020-09-08T15:48:44.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:48:44.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018898 2020-09-08T15:48:44.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:48:44.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T15:48:44.087 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018898 2020-09-08T15:48:44.087 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:48:44.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018898 2020-09-08T15:48:44.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018898' 2020-09-08T15:48:44.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T15:48:44.089 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018898 2020-09-08T15:48:44.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018899 -lt 128849018898 2020-09-08T15:48:44.504 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:79: _common_test: ceph pg dump pgs --format=json 2020-09-08T15:48:44.504 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:79: _common_test: jq '.pg_stats[0].up_primary' 2020-09-08T15:48:44.884 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:48:44.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:79: _common_test: newprimary=4 2020-09-08T15:48:44.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:80: _common_test: kill_daemons 2020-09-08T15:48:44.893 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:48:44.893 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:48:44.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:48:44.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:48:44.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:48:45.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:48:45.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:82: _common_test: ERRORS=0 2020-09-08T15:48:45.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:83: _common_test: _objectstore_tool_nodown td/osd-backfill-recovery-log 4 --no-mon-config --pgid 1.0 --op log 2020-09-08T15:48:45.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:83: _common_test: tee td/osd-backfill-recovery-log/result.log 2020-09-08T15:48:45.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local dir=td/osd-backfill-recovery-log 2020-09-08T15:48:45.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2020-09-08T15:48:45.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local id=4 2020-09-08T15:48:45.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1198: _objectstore_tool_nodown: shift 2020-09-08T15:48:45.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: _objectstore_tool_nodown: local osd_data=td/osd-backfill-recovery-log/4 2020-09-08T15:48:45.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1202: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-recovery-log/4 --no-mon-config --pgid 1.0 --op log 2020-09-08T15:48:46.241 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:48:46.241 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_log_t": { 2020-09-08T15:48:46.241 INFO:tasks.workunit.client.0.smithi065.stdout: "head": "34'150", 2020-09-08T15:48:46.241 INFO:tasks.workunit.client.0.smithi065.stdout: "tail": "34'148", 2020-09-08T15:48:46.242 INFO:tasks.workunit.client.0.smithi065.stdout: "log": [ 2020-09-08T15:48:46.242 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.242 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:48:46.242 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:e9c179f9:::obj-149:head", 2020-09-08T15:48:46.243 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'149", 2020-09-08T15:48:46.243 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:48:46.243 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4631.0:1", 2020-09-08T15:48:46.243 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:48:46.243 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:47:54.130238+0000", 2020-09-08T15:48:46.244 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:48:46.244 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:48:46.244 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:48:46.244 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:48:46.244 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:48:46.246 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:48:46.246 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:48:46.246 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.247 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:48:46.247 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:48:46.247 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:48:46.247 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:48:46.247 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:48:46.248 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:48:46.248 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:48:46.249 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.249 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.249 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:48:46.249 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:cb39fd60:::obj-150:head", 2020-09-08T15:48:46.250 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'150", 2020-09-08T15:48:46.250 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:48:46.250 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4634.0:1", 2020-09-08T15:48:46.250 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:48:46.251 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:47:54.281416+0000", 2020-09-08T15:48:46.252 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:48:46.252 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:48:46.252 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:48:46.252 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:48:46.252 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:48:46.253 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:48:46.253 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:48:46.253 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.253 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:48:46.254 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:48:46.254 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:48:46.254 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:48:46.254 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:48:46.254 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:48:46.255 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:48:46.255 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:48:46.255 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:48:46.255 INFO:tasks.workunit.client.0.smithi065.stdout: "dups": [ 2020-09-08T15:48:46.255 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.255 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4187.0:1", 2020-09-08T15:48:46.256 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'1", 2020-09-08T15:48:46.257 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "1", 2020-09-08T15:48:46.257 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.258 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.258 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.258 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4190.0:1", 2020-09-08T15:48:46.259 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'2", 2020-09-08T15:48:46.260 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "2", 2020-09-08T15:48:46.260 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.260 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.261 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.261 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4193.0:1", 2020-09-08T15:48:46.261 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'3", 2020-09-08T15:48:46.261 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "3", 2020-09-08T15:48:46.261 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.262 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.262 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.262 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4196.0:1", 2020-09-08T15:48:46.262 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'4", 2020-09-08T15:48:46.262 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "4", 2020-09-08T15:48:46.263 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.263 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.264 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.264 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4199.0:1", 2020-09-08T15:48:46.264 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'5", 2020-09-08T15:48:46.264 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "5", 2020-09-08T15:48:46.264 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.265 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.265 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.265 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4202.0:1", 2020-09-08T15:48:46.265 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'6", 2020-09-08T15:48:46.265 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "6", 2020-09-08T15:48:46.266 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.266 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.266 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.266 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4205.0:1", 2020-09-08T15:48:46.266 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'7", 2020-09-08T15:48:46.267 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "7", 2020-09-08T15:48:46.267 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.267 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.267 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.267 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4208.0:1", 2020-09-08T15:48:46.268 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'8", 2020-09-08T15:48:46.268 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "8", 2020-09-08T15:48:46.268 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.268 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.268 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.270 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4211.0:1", 2020-09-08T15:48:46.270 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'9", 2020-09-08T15:48:46.271 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "9", 2020-09-08T15:48:46.272 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.272 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.272 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.272 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4214.0:1", 2020-09-08T15:48:46.272 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'10", 2020-09-08T15:48:46.273 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "10", 2020-09-08T15:48:46.273 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.273 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.273 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.273 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4217.0:1", 2020-09-08T15:48:46.274 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'11", 2020-09-08T15:48:46.274 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "11", 2020-09-08T15:48:46.274 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.274 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.276 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.276 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4220.0:1", 2020-09-08T15:48:46.276 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'12", 2020-09-08T15:48:46.276 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "12", 2020-09-08T15:48:46.277 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.277 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.277 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.277 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4223.0:1", 2020-09-08T15:48:46.277 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'13", 2020-09-08T15:48:46.278 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "13", 2020-09-08T15:48:46.278 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.278 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.278 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.278 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4226.0:1", 2020-09-08T15:48:46.279 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'14", 2020-09-08T15:48:46.279 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "14", 2020-09-08T15:48:46.279 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.280 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.280 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.280 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4229.0:1", 2020-09-08T15:48:46.280 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'15", 2020-09-08T15:48:46.280 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "15", 2020-09-08T15:48:46.280 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.281 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.281 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.281 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4232.0:1", 2020-09-08T15:48:46.281 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'16", 2020-09-08T15:48:46.281 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "16", 2020-09-08T15:48:46.282 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.282 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.283 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.283 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4235.0:1", 2020-09-08T15:48:46.283 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'17", 2020-09-08T15:48:46.283 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "17", 2020-09-08T15:48:46.283 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.284 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.284 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.284 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4238.0:1", 2020-09-08T15:48:46.284 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'18", 2020-09-08T15:48:46.284 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "18", 2020-09-08T15:48:46.285 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.285 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.285 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.285 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4241.0:1", 2020-09-08T15:48:46.285 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'19", 2020-09-08T15:48:46.286 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "19", 2020-09-08T15:48:46.286 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.286 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.286 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.286 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4244.0:1", 2020-09-08T15:48:46.287 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'20", 2020-09-08T15:48:46.287 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "20", 2020-09-08T15:48:46.287 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.287 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.288 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.288 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4247.0:1", 2020-09-08T15:48:46.288 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'21", 2020-09-08T15:48:46.289 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "21", 2020-09-08T15:48:46.289 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.289 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.289 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.290 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4250.0:1", 2020-09-08T15:48:46.290 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'22", 2020-09-08T15:48:46.290 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "22", 2020-09-08T15:48:46.290 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.290 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.291 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.291 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4253.0:1", 2020-09-08T15:48:46.291 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'23", 2020-09-08T15:48:46.291 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "23", 2020-09-08T15:48:46.291 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.292 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.292 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.292 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4256.0:1", 2020-09-08T15:48:46.293 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'24", 2020-09-08T15:48:46.293 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "24", 2020-09-08T15:48:46.293 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.294 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.294 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.294 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4259.0:1", 2020-09-08T15:48:46.294 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'25", 2020-09-08T15:48:46.294 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "25", 2020-09-08T15:48:46.295 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.295 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.295 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.295 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4262.0:1", 2020-09-08T15:48:46.296 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'26", 2020-09-08T15:48:46.296 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "26", 2020-09-08T15:48:46.296 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.296 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.296 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.297 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4265.0:1", 2020-09-08T15:48:46.297 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'27", 2020-09-08T15:48:46.297 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "27", 2020-09-08T15:48:46.297 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.297 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.298 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.298 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4268.0:1", 2020-09-08T15:48:46.298 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'28", 2020-09-08T15:48:46.298 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "28", 2020-09-08T15:48:46.298 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.299 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.300 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.300 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4271.0:1", 2020-09-08T15:48:46.300 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'29", 2020-09-08T15:48:46.301 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "29", 2020-09-08T15:48:46.301 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.301 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.301 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.301 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4274.0:1", 2020-09-08T15:48:46.302 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'30", 2020-09-08T15:48:46.302 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "30", 2020-09-08T15:48:46.302 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.302 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.302 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.303 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4277.0:1", 2020-09-08T15:48:46.303 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'31", 2020-09-08T15:48:46.303 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "31", 2020-09-08T15:48:46.303 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.303 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.304 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.304 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4280.0:1", 2020-09-08T15:48:46.304 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'32", 2020-09-08T15:48:46.304 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "32", 2020-09-08T15:48:46.304 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.304 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.305 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.305 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4283.0:1", 2020-09-08T15:48:46.305 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'33", 2020-09-08T15:48:46.305 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "33", 2020-09-08T15:48:46.305 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.306 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.306 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.307 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4286.0:1", 2020-09-08T15:48:46.307 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'34", 2020-09-08T15:48:46.307 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "34", 2020-09-08T15:48:46.307 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.307 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.307 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.308 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4289.0:1", 2020-09-08T15:48:46.308 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'35", 2020-09-08T15:48:46.308 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "35", 2020-09-08T15:48:46.308 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.308 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.309 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.309 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4292.0:1", 2020-09-08T15:48:46.309 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'36", 2020-09-08T15:48:46.309 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "36", 2020-09-08T15:48:46.309 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.310 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.310 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.311 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4295.0:1", 2020-09-08T15:48:46.311 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'37", 2020-09-08T15:48:46.311 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "37", 2020-09-08T15:48:46.311 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.311 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.312 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.312 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4298.0:1", 2020-09-08T15:48:46.312 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'38", 2020-09-08T15:48:46.312 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "38", 2020-09-08T15:48:46.312 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.312 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.313 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.313 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4301.0:1", 2020-09-08T15:48:46.313 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'39", 2020-09-08T15:48:46.313 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "39", 2020-09-08T15:48:46.313 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.314 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.314 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.314 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4304.0:1", 2020-09-08T15:48:46.314 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'40", 2020-09-08T15:48:46.314 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "40", 2020-09-08T15:48:46.315 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.315 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.315 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.315 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4307.0:1", 2020-09-08T15:48:46.315 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'41", 2020-09-08T15:48:46.315 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "41", 2020-09-08T15:48:46.316 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.316 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.316 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.317 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4310.0:1", 2020-09-08T15:48:46.317 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'42", 2020-09-08T15:48:46.317 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "42", 2020-09-08T15:48:46.317 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.317 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.318 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.318 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4313.0:1", 2020-09-08T15:48:46.318 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'43", 2020-09-08T15:48:46.318 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "43", 2020-09-08T15:48:46.318 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.319 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.319 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.319 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4316.0:1", 2020-09-08T15:48:46.319 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'44", 2020-09-08T15:48:46.319 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "44", 2020-09-08T15:48:46.320 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.320 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.320 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.320 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4319.0:1", 2020-09-08T15:48:46.321 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'45", 2020-09-08T15:48:46.321 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "45", 2020-09-08T15:48:46.321 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.321 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.322 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.322 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4322.0:1", 2020-09-08T15:48:46.322 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'46", 2020-09-08T15:48:46.322 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "46", 2020-09-08T15:48:46.322 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.323 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.323 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.323 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4325.0:1", 2020-09-08T15:48:46.323 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'47", 2020-09-08T15:48:46.323 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "47", 2020-09-08T15:48:46.323 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.324 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.324 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.324 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4328.0:1", 2020-09-08T15:48:46.324 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'48", 2020-09-08T15:48:46.324 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "48", 2020-09-08T15:48:46.325 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.325 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.325 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.325 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4331.0:1", 2020-09-08T15:48:46.325 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'49", 2020-09-08T15:48:46.326 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "49", 2020-09-08T15:48:46.326 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.326 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.326 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.326 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4334.0:1", 2020-09-08T15:48:46.327 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'50", 2020-09-08T15:48:46.327 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "50", 2020-09-08T15:48:46.327 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.328 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.328 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.328 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4337.0:1", 2020-09-08T15:48:46.328 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'51", 2020-09-08T15:48:46.328 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "51", 2020-09-08T15:48:46.328 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.329 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.329 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.329 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4340.0:1", 2020-09-08T15:48:46.329 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'52", 2020-09-08T15:48:46.329 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "52", 2020-09-08T15:48:46.330 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.330 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.330 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.330 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4343.0:1", 2020-09-08T15:48:46.330 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'53", 2020-09-08T15:48:46.331 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "53", 2020-09-08T15:48:46.331 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.331 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.332 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.332 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4346.0:1", 2020-09-08T15:48:46.332 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'54", 2020-09-08T15:48:46.332 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "54", 2020-09-08T15:48:46.332 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.333 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.333 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.333 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4349.0:1", 2020-09-08T15:48:46.333 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'55", 2020-09-08T15:48:46.333 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "55", 2020-09-08T15:48:46.334 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.334 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.334 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.334 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4352.0:1", 2020-09-08T15:48:46.334 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'56", 2020-09-08T15:48:46.334 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "56", 2020-09-08T15:48:46.335 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.335 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.335 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.335 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4355.0:1", 2020-09-08T15:48:46.335 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'57", 2020-09-08T15:48:46.336 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "57", 2020-09-08T15:48:46.336 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.336 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.336 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.336 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4358.0:1", 2020-09-08T15:48:46.337 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'58", 2020-09-08T15:48:46.337 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "58", 2020-09-08T15:48:46.337 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.338 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.338 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.338 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4361.0:1", 2020-09-08T15:48:46.338 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'59", 2020-09-08T15:48:46.338 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "59", 2020-09-08T15:48:46.338 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.339 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.339 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.339 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4364.0:1", 2020-09-08T15:48:46.339 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'60", 2020-09-08T15:48:46.339 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "60", 2020-09-08T15:48:46.340 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.340 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.340 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.340 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4367.0:1", 2020-09-08T15:48:46.340 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'61", 2020-09-08T15:48:46.341 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "61", 2020-09-08T15:48:46.341 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.341 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.341 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.342 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4370.0:1", 2020-09-08T15:48:46.342 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'62", 2020-09-08T15:48:46.342 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "62", 2020-09-08T15:48:46.342 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.342 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.343 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.343 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4373.0:1", 2020-09-08T15:48:46.343 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'63", 2020-09-08T15:48:46.343 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "63", 2020-09-08T15:48:46.343 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.344 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.344 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.344 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4376.0:1", 2020-09-08T15:48:46.344 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'64", 2020-09-08T15:48:46.344 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "64", 2020-09-08T15:48:46.345 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.345 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.345 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.345 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4379.0:1", 2020-09-08T15:48:46.345 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'65", 2020-09-08T15:48:46.345 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "65", 2020-09-08T15:48:46.346 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.346 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.346 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.346 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4382.0:1", 2020-09-08T15:48:46.346 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'66", 2020-09-08T15:48:46.347 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "66", 2020-09-08T15:48:46.347 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.347 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.347 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.348 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4385.0:1", 2020-09-08T15:48:46.348 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'67", 2020-09-08T15:48:46.348 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "67", 2020-09-08T15:48:46.348 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.348 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.349 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.349 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4388.0:1", 2020-09-08T15:48:46.349 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'68", 2020-09-08T15:48:46.349 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "68", 2020-09-08T15:48:46.349 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.350 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.350 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.350 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4391.0:1", 2020-09-08T15:48:46.350 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'69", 2020-09-08T15:48:46.350 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "69", 2020-09-08T15:48:46.351 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.351 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.351 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.351 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4394.0:1", 2020-09-08T15:48:46.351 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'70", 2020-09-08T15:48:46.351 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "70", 2020-09-08T15:48:46.352 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.352 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.353 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.353 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4397.0:1", 2020-09-08T15:48:46.353 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'71", 2020-09-08T15:48:46.353 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "71", 2020-09-08T15:48:46.353 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.354 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.354 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.354 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4400.0:1", 2020-09-08T15:48:46.354 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'72", 2020-09-08T15:48:46.354 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "72", 2020-09-08T15:48:46.354 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.355 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.355 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.355 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4403.0:1", 2020-09-08T15:48:46.355 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'73", 2020-09-08T15:48:46.355 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "73", 2020-09-08T15:48:46.356 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.356 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.356 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.356 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4406.0:1", 2020-09-08T15:48:46.356 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'74", 2020-09-08T15:48:46.357 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "74", 2020-09-08T15:48:46.357 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.357 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.357 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.357 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4409.0:1", 2020-09-08T15:48:46.358 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'75", 2020-09-08T15:48:46.358 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "75", 2020-09-08T15:48:46.358 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.359 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.359 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.359 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4412.0:1", 2020-09-08T15:48:46.359 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'76", 2020-09-08T15:48:46.359 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "76", 2020-09-08T15:48:46.359 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.360 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.360 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.360 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4415.0:1", 2020-09-08T15:48:46.360 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'77", 2020-09-08T15:48:46.360 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "77", 2020-09-08T15:48:46.361 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.361 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.361 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.361 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4418.0:1", 2020-09-08T15:48:46.362 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'78", 2020-09-08T15:48:46.362 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "78", 2020-09-08T15:48:46.362 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.363 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.363 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.363 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4421.0:1", 2020-09-08T15:48:46.363 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'79", 2020-09-08T15:48:46.363 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "79", 2020-09-08T15:48:46.364 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.364 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.364 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.364 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4424.0:1", 2020-09-08T15:48:46.364 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'80", 2020-09-08T15:48:46.365 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "80", 2020-09-08T15:48:46.365 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.365 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.365 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.365 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4427.0:1", 2020-09-08T15:48:46.365 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'81", 2020-09-08T15:48:46.366 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "81", 2020-09-08T15:48:46.366 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.366 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.366 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.366 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4430.0:1", 2020-09-08T15:48:46.367 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'82", 2020-09-08T15:48:46.367 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "82", 2020-09-08T15:48:46.367 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.367 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.367 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.368 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4433.0:1", 2020-09-08T15:48:46.368 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'83", 2020-09-08T15:48:46.368 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "83", 2020-09-08T15:48:46.368 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.369 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.369 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.369 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4436.0:1", 2020-09-08T15:48:46.369 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'84", 2020-09-08T15:48:46.369 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "84", 2020-09-08T15:48:46.370 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.370 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.370 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.370 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4439.0:1", 2020-09-08T15:48:46.370 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'85", 2020-09-08T15:48:46.371 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "85", 2020-09-08T15:48:46.371 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.371 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.371 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.371 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4442.0:1", 2020-09-08T15:48:46.371 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'86", 2020-09-08T15:48:46.372 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "86", 2020-09-08T15:48:46.372 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.372 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.372 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.373 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4445.0:1", 2020-09-08T15:48:46.373 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'87", 2020-09-08T15:48:46.373 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "87", 2020-09-08T15:48:46.373 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.374 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.374 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.374 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4448.0:1", 2020-09-08T15:48:46.374 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'88", 2020-09-08T15:48:46.374 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "88", 2020-09-08T15:48:46.375 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.375 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.375 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.375 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4451.0:1", 2020-09-08T15:48:46.375 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'89", 2020-09-08T15:48:46.376 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "89", 2020-09-08T15:48:46.376 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.376 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.376 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.376 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4454.0:1", 2020-09-08T15:48:46.376 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'90", 2020-09-08T15:48:46.377 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "90", 2020-09-08T15:48:46.377 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.377 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.377 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.377 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4457.0:1", 2020-09-08T15:48:46.378 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'91", 2020-09-08T15:48:46.378 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "91", 2020-09-08T15:48:46.378 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.378 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.379 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.379 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4460.0:1", 2020-09-08T15:48:46.379 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'92", 2020-09-08T15:48:46.379 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "92", 2020-09-08T15:48:46.380 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.380 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.380 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.380 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4463.0:1", 2020-09-08T15:48:46.381 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'93", 2020-09-08T15:48:46.381 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "93", 2020-09-08T15:48:46.381 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.381 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.382 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.382 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4466.0:1", 2020-09-08T15:48:46.382 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'94", 2020-09-08T15:48:46.382 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "94", 2020-09-08T15:48:46.382 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.383 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.383 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.383 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4469.0:1", 2020-09-08T15:48:46.384 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'95", 2020-09-08T15:48:46.384 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "95", 2020-09-08T15:48:46.384 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.384 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.384 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.385 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4472.0:1", 2020-09-08T15:48:46.385 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'96", 2020-09-08T15:48:46.385 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "96", 2020-09-08T15:48:46.385 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.385 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.386 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.386 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4475.0:1", 2020-09-08T15:48:46.386 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'97", 2020-09-08T15:48:46.386 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "97", 2020-09-08T15:48:46.386 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.386 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.387 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.387 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4478.0:1", 2020-09-08T15:48:46.387 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'98", 2020-09-08T15:48:46.387 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "98", 2020-09-08T15:48:46.387 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.388 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.388 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.388 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4481.0:1", 2020-09-08T15:48:46.388 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'99", 2020-09-08T15:48:46.388 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "99", 2020-09-08T15:48:46.389 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.389 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.389 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.390 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4484.0:1", 2020-09-08T15:48:46.390 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'100", 2020-09-08T15:48:46.390 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "100", 2020-09-08T15:48:46.390 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.390 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.390 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.391 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4487.0:1", 2020-09-08T15:48:46.391 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'101", 2020-09-08T15:48:46.391 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "101", 2020-09-08T15:48:46.391 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.391 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.392 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.392 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4490.0:1", 2020-09-08T15:48:46.392 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'102", 2020-09-08T15:48:46.392 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "102", 2020-09-08T15:48:46.392 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.393 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.393 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.393 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4493.0:1", 2020-09-08T15:48:46.393 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'103", 2020-09-08T15:48:46.394 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "103", 2020-09-08T15:48:46.394 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.394 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.394 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.395 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4496.0:1", 2020-09-08T15:48:46.395 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'104", 2020-09-08T15:48:46.395 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "104", 2020-09-08T15:48:46.395 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.395 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.396 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.396 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4499.0:1", 2020-09-08T15:48:46.396 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'105", 2020-09-08T15:48:46.396 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "105", 2020-09-08T15:48:46.397 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.397 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.397 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.397 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4502.0:1", 2020-09-08T15:48:46.397 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'106", 2020-09-08T15:48:46.397 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "106", 2020-09-08T15:48:46.398 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.398 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.398 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.398 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4505.0:1", 2020-09-08T15:48:46.398 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'107", 2020-09-08T15:48:46.399 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "107", 2020-09-08T15:48:46.399 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.399 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.400 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.400 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4508.0:1", 2020-09-08T15:48:46.401 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'108", 2020-09-08T15:48:46.401 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "108", 2020-09-08T15:48:46.401 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.401 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.401 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.402 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4511.0:1", 2020-09-08T15:48:46.402 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'109", 2020-09-08T15:48:46.402 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "109", 2020-09-08T15:48:46.402 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.402 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.403 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.403 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4514.0:1", 2020-09-08T15:48:46.403 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'110", 2020-09-08T15:48:46.403 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "110", 2020-09-08T15:48:46.403 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.403 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.404 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.404 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4517.0:1", 2020-09-08T15:48:46.404 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'111", 2020-09-08T15:48:46.404 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "111", 2020-09-08T15:48:46.404 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.405 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.405 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.405 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4520.0:1", 2020-09-08T15:48:46.405 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'112", 2020-09-08T15:48:46.405 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "112", 2020-09-08T15:48:46.406 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.406 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.406 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.406 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4523.0:1", 2020-09-08T15:48:46.406 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'113", 2020-09-08T15:48:46.408 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "113", 2020-09-08T15:48:46.408 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.408 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.408 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.408 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4526.0:1", 2020-09-08T15:48:46.409 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'114", 2020-09-08T15:48:46.409 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "114", 2020-09-08T15:48:46.409 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.409 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.410 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.410 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4529.0:1", 2020-09-08T15:48:46.410 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'115", 2020-09-08T15:48:46.410 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "115", 2020-09-08T15:48:46.411 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.411 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.411 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.411 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4532.0:1", 2020-09-08T15:48:46.411 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'116", 2020-09-08T15:48:46.411 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "116", 2020-09-08T15:48:46.412 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.412 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.412 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.412 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4535.0:1", 2020-09-08T15:48:46.412 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'117", 2020-09-08T15:48:46.413 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "117", 2020-09-08T15:48:46.413 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.413 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.413 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.413 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4538.0:1", 2020-09-08T15:48:46.414 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'118", 2020-09-08T15:48:46.414 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "118", 2020-09-08T15:48:46.414 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.414 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.414 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.415 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4541.0:1", 2020-09-08T15:48:46.415 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'119", 2020-09-08T15:48:46.415 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "119", 2020-09-08T15:48:46.415 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.416 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.416 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.416 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4544.0:1", 2020-09-08T15:48:46.416 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'120", 2020-09-08T15:48:46.416 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "120", 2020-09-08T15:48:46.417 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.422 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.422 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.422 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4547.0:1", 2020-09-08T15:48:46.422 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'121", 2020-09-08T15:48:46.423 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "121", 2020-09-08T15:48:46.423 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.423 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.423 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.423 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4550.0:1", 2020-09-08T15:48:46.424 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'122", 2020-09-08T15:48:46.424 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "122", 2020-09-08T15:48:46.424 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.424 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.424 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.425 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4553.0:1", 2020-09-08T15:48:46.425 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'123", 2020-09-08T15:48:46.425 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "123", 2020-09-08T15:48:46.425 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.425 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.426 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.426 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4556.0:1", 2020-09-08T15:48:46.426 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'124", 2020-09-08T15:48:46.426 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "124", 2020-09-08T15:48:46.426 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.427 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.427 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.427 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4559.0:1", 2020-09-08T15:48:46.427 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'125", 2020-09-08T15:48:46.427 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "125", 2020-09-08T15:48:46.428 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.428 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.428 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.428 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4562.0:1", 2020-09-08T15:48:46.428 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'126", 2020-09-08T15:48:46.428 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "126", 2020-09-08T15:48:46.429 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.429 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.429 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.430 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4565.0:1", 2020-09-08T15:48:46.430 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'127", 2020-09-08T15:48:46.430 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "127", 2020-09-08T15:48:46.430 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.430 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.430 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.431 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4568.0:1", 2020-09-08T15:48:46.431 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'128", 2020-09-08T15:48:46.431 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "128", 2020-09-08T15:48:46.431 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.431 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.432 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.432 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4571.0:1", 2020-09-08T15:48:46.432 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'129", 2020-09-08T15:48:46.432 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "129", 2020-09-08T15:48:46.432 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.432 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.433 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.433 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4574.0:1", 2020-09-08T15:48:46.433 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'130", 2020-09-08T15:48:46.433 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "130", 2020-09-08T15:48:46.433 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.434 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.434 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.434 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4577.0:1", 2020-09-08T15:48:46.435 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'131", 2020-09-08T15:48:46.435 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "131", 2020-09-08T15:48:46.435 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.435 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.435 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.435 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4580.0:1", 2020-09-08T15:48:46.436 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'132", 2020-09-08T15:48:46.436 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "132", 2020-09-08T15:48:46.436 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.436 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.436 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.437 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4583.0:1", 2020-09-08T15:48:46.437 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'133", 2020-09-08T15:48:46.437 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "133", 2020-09-08T15:48:46.437 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.437 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.438 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.438 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4586.0:1", 2020-09-08T15:48:46.438 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'134", 2020-09-08T15:48:46.438 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "134", 2020-09-08T15:48:46.438 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.438 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.439 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.439 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4589.0:1", 2020-09-08T15:48:46.439 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'135", 2020-09-08T15:48:46.439 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "135", 2020-09-08T15:48:46.439 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.440 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.440 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.440 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4592.0:1", 2020-09-08T15:48:46.440 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'136", 2020-09-08T15:48:46.440 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "136", 2020-09-08T15:48:46.440 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.441 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.441 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.441 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4595.0:1", 2020-09-08T15:48:46.441 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'137", 2020-09-08T15:48:46.441 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "137", 2020-09-08T15:48:46.442 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.442 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.442 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.442 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4598.0:1", 2020-09-08T15:48:46.442 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'138", 2020-09-08T15:48:46.443 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "138", 2020-09-08T15:48:46.443 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.443 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.443 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.443 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4601.0:1", 2020-09-08T15:48:46.443 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'139", 2020-09-08T15:48:46.444 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "139", 2020-09-08T15:48:46.444 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.444 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.444 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.444 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4604.0:1", 2020-09-08T15:48:46.445 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'140", 2020-09-08T15:48:46.445 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "140", 2020-09-08T15:48:46.445 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.445 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.445 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.446 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4607.0:1", 2020-09-08T15:48:46.446 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'141", 2020-09-08T15:48:46.446 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "141", 2020-09-08T15:48:46.446 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.446 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.446 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.447 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4610.0:1", 2020-09-08T15:48:46.447 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'142", 2020-09-08T15:48:46.447 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "142", 2020-09-08T15:48:46.447 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.447 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.448 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.448 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4613.0:1", 2020-09-08T15:48:46.448 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'143", 2020-09-08T15:48:46.448 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "143", 2020-09-08T15:48:46.448 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.448 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.449 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.449 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4616.0:1", 2020-09-08T15:48:46.449 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'144", 2020-09-08T15:48:46.449 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "144", 2020-09-08T15:48:46.449 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.450 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.450 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.450 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4619.0:1", 2020-09-08T15:48:46.450 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'145", 2020-09-08T15:48:46.450 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "145", 2020-09-08T15:48:46.450 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.451 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.451 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.451 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4622.0:1", 2020-09-08T15:48:46.451 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'146", 2020-09-08T15:48:46.451 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "146", 2020-09-08T15:48:46.452 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.452 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.452 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.452 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4625.0:1", 2020-09-08T15:48:46.452 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'147", 2020-09-08T15:48:46.503 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "147", 2020-09-08T15:48:46.503 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.504 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.504 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:48:46.504 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4628.0:1", 2020-09-08T15:48:46.504 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'148", 2020-09-08T15:48:46.504 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "148", 2020-09-08T15:48:46.505 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:48:46.505 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:48:46.505 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:48:46.505 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:48:46.505 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_missing_t": { 2020-09-08T15:48:46.506 INFO:tasks.workunit.client.0.smithi065.stdout: "missing": [], 2020-09-08T15:48:46.506 INFO:tasks.workunit.client.0.smithi065.stdout: "may_include_deletes": true 2020-09-08T15:48:46.506 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:48:46.506 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:48:46.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:84: _common_test: jq '.pg_log_t.log | length' td/osd-backfill-recovery-log/result.log 2020-09-08T15:48:46.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:84: _common_test: LOGLEN=2 2020-09-08T15:48:46.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:85: _common_test: '[' 2 '!=' 2 ']' 2020-09-08T15:48:46.508 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:89: _common_test: jq '.pg_log_t.dups | length' td/osd-backfill-recovery-log/result.log 2020-09-08T15:48:46.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:89: _common_test: DUPSLEN=148 2020-09-08T15:48:46.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:90: _common_test: '[' 148 '!=' 148 ']' 2020-09-08T15:48:46.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:94: _common_test: grep 'copy_up_to\|copy_after' td/osd-backfill-recovery-log/osd.0.log td/osd-backfill-recovery-log/osd.1.log td/osd-backfill-recovery-log/osd.2.log td/osd-backfill-recovery-log/osd.3.log td/osd-backfill-recovery-log/osd.4.log td/osd-backfill-recovery-log/osd.5.log 2020-09-08T15:48:46.515 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to max 2 2020-09-08T15:48:46.515 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to copy log version 34'150 2020-09-08T15:48:46.517 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to copy log version 34'149 2020-09-08T15:48:46.517 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after earliest_dup_version 0 2020-09-08T15:48:46.518 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'1 2020-09-08T15:48:46.518 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'2 2020-09-08T15:48:46.518 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'3 2020-09-08T15:48:46.518 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'4 2020-09-08T15:48:46.519 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'5 2020-09-08T15:48:46.519 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'6 2020-09-08T15:48:46.519 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'7 2020-09-08T15:48:46.519 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'8 2020-09-08T15:48:46.520 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'9 2020-09-08T15:48:46.520 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'10 2020-09-08T15:48:46.520 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'11 2020-09-08T15:48:46.521 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'12 2020-09-08T15:48:46.521 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'13 2020-09-08T15:48:46.521 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'14 2020-09-08T15:48:46.521 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'15 2020-09-08T15:48:46.523 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'16 2020-09-08T15:48:46.523 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'17 2020-09-08T15:48:46.523 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'18 2020-09-08T15:48:46.524 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'19 2020-09-08T15:48:46.524 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'20 2020-09-08T15:48:46.524 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'21 2020-09-08T15:48:46.524 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'22 2020-09-08T15:48:46.524 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'23 2020-09-08T15:48:46.525 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'24 2020-09-08T15:48:46.525 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'25 2020-09-08T15:48:46.525 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'26 2020-09-08T15:48:46.530 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'27 2020-09-08T15:48:46.530 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'28 2020-09-08T15:48:46.530 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'29 2020-09-08T15:48:46.531 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'30 2020-09-08T15:48:46.531 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'31 2020-09-08T15:48:46.531 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'32 2020-09-08T15:48:46.531 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'33 2020-09-08T15:48:46.531 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'34 2020-09-08T15:48:46.532 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'35 2020-09-08T15:48:46.532 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'36 2020-09-08T15:48:46.532 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'37 2020-09-08T15:48:46.532 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'38 2020-09-08T15:48:46.532 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'39 2020-09-08T15:48:46.533 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'40 2020-09-08T15:48:46.533 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'41 2020-09-08T15:48:46.533 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'42 2020-09-08T15:48:46.533 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'43 2020-09-08T15:48:46.533 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'44 2020-09-08T15:48:46.534 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'45 2020-09-08T15:48:46.539 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'46 2020-09-08T15:48:46.539 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'47 2020-09-08T15:48:46.540 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'48 2020-09-08T15:48:46.540 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'49 2020-09-08T15:48:46.540 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'50 2020-09-08T15:48:46.540 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'51 2020-09-08T15:48:46.540 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'52 2020-09-08T15:48:46.541 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'53 2020-09-08T15:48:46.541 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'54 2020-09-08T15:48:46.541 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'55 2020-09-08T15:48:46.541 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'56 2020-09-08T15:48:46.541 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'57 2020-09-08T15:48:46.541 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'58 2020-09-08T15:48:46.542 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'59 2020-09-08T15:48:46.542 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'60 2020-09-08T15:48:46.542 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'61 2020-09-08T15:48:46.542 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'62 2020-09-08T15:48:46.542 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'63 2020-09-08T15:48:46.543 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'64 2020-09-08T15:48:46.543 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'65 2020-09-08T15:48:46.543 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'66 2020-09-08T15:48:46.543 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'67 2020-09-08T15:48:46.543 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'68 2020-09-08T15:48:46.544 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'69 2020-09-08T15:48:46.544 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'70 2020-09-08T15:48:46.544 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'71 2020-09-08T15:48:46.544 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'72 2020-09-08T15:48:46.544 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'73 2020-09-08T15:48:46.545 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'74 2020-09-08T15:48:46.545 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'75 2020-09-08T15:48:46.545 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'76 2020-09-08T15:48:46.545 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'77 2020-09-08T15:48:46.545 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'78 2020-09-08T15:48:46.546 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'79 2020-09-08T15:48:46.546 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'80 2020-09-08T15:48:46.546 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'81 2020-09-08T15:48:46.546 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'82 2020-09-08T15:48:46.546 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'83 2020-09-08T15:48:46.546 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'84 2020-09-08T15:48:46.547 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'85 2020-09-08T15:48:46.547 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'86 2020-09-08T15:48:46.547 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'87 2020-09-08T15:48:46.547 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'88 2020-09-08T15:48:46.547 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'89 2020-09-08T15:48:46.548 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'90 2020-09-08T15:48:46.548 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'91 2020-09-08T15:48:46.548 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'92 2020-09-08T15:48:46.548 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'93 2020-09-08T15:48:46.548 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'94 2020-09-08T15:48:46.549 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'95 2020-09-08T15:48:46.549 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'96 2020-09-08T15:48:46.549 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'97 2020-09-08T15:48:46.549 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'98 2020-09-08T15:48:46.549 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'99 2020-09-08T15:48:46.550 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'100 2020-09-08T15:48:46.550 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'101 2020-09-08T15:48:46.550 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'102 2020-09-08T15:48:46.550 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'103 2020-09-08T15:48:46.550 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'104 2020-09-08T15:48:46.550 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'105 2020-09-08T15:48:46.551 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'106 2020-09-08T15:48:46.551 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'107 2020-09-08T15:48:46.551 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'108 2020-09-08T15:48:46.551 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'109 2020-09-08T15:48:46.551 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'110 2020-09-08T15:48:46.552 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'111 2020-09-08T15:48:46.552 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'112 2020-09-08T15:48:46.552 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'113 2020-09-08T15:48:46.552 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'114 2020-09-08T15:48:46.552 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'115 2020-09-08T15:48:46.553 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'116 2020-09-08T15:48:46.553 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'117 2020-09-08T15:48:46.553 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'118 2020-09-08T15:48:46.553 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'119 2020-09-08T15:48:46.553 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'120 2020-09-08T15:48:46.554 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'121 2020-09-08T15:48:46.554 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'122 2020-09-08T15:48:46.554 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'123 2020-09-08T15:48:46.554 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'124 2020-09-08T15:48:46.554 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'125 2020-09-08T15:48:46.555 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'126 2020-09-08T15:48:46.555 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'127 2020-09-08T15:48:46.555 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'128 2020-09-08T15:48:46.555 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'129 2020-09-08T15:48:46.555 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'130 2020-09-08T15:48:46.555 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'131 2020-09-08T15:48:46.556 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'132 2020-09-08T15:48:46.556 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'133 2020-09-08T15:48:46.556 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'134 2020-09-08T15:48:46.556 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'135 2020-09-08T15:48:46.556 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'136 2020-09-08T15:48:46.557 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'137 2020-09-08T15:48:46.557 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'138 2020-09-08T15:48:46.557 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'139 2020-09-08T15:48:46.557 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'140 2020-09-08T15:48:46.557 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'141 2020-09-08T15:48:46.558 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'142 2020-09-08T15:48:46.558 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'143 2020-09-08T15:48:46.558 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'144 2020-09-08T15:48:46.558 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'145 2020-09-08T15:48:46.558 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'146 2020-09-08T15:48:46.559 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'147 2020-09-08T15:48:46.559 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'148 2020-09-08T15:48:46.559 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to max 2 2020-09-08T15:48:46.559 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to copy log version 34'150 2020-09-08T15:48:46.559 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to copy log version 34'149 2020-09-08T15:48:46.559 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after earliest_dup_version 0 2020-09-08T15:48:46.560 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'1 2020-09-08T15:48:46.560 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'2 2020-09-08T15:48:46.560 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'3 2020-09-08T15:48:46.560 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'4 2020-09-08T15:48:46.560 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'5 2020-09-08T15:48:46.561 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'6 2020-09-08T15:48:46.561 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'7 2020-09-08T15:48:46.561 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'8 2020-09-08T15:48:46.561 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'9 2020-09-08T15:48:46.561 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'10 2020-09-08T15:48:46.562 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'11 2020-09-08T15:48:46.562 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'12 2020-09-08T15:48:46.562 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'13 2020-09-08T15:48:46.562 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'14 2020-09-08T15:48:46.562 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'15 2020-09-08T15:48:46.563 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'16 2020-09-08T15:48:46.563 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'17 2020-09-08T15:48:46.563 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'18 2020-09-08T15:48:46.563 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'19 2020-09-08T15:48:46.563 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'20 2020-09-08T15:48:46.563 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'21 2020-09-08T15:48:46.564 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'22 2020-09-08T15:48:46.564 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'23 2020-09-08T15:48:46.564 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'24 2020-09-08T15:48:46.564 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'25 2020-09-08T15:48:46.564 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'26 2020-09-08T15:48:46.565 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'27 2020-09-08T15:48:46.565 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'28 2020-09-08T15:48:46.565 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'29 2020-09-08T15:48:46.565 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'30 2020-09-08T15:48:46.565 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'31 2020-09-08T15:48:46.566 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'32 2020-09-08T15:48:46.566 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'33 2020-09-08T15:48:46.566 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'34 2020-09-08T15:48:46.566 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'35 2020-09-08T15:48:46.566 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'36 2020-09-08T15:48:46.567 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'37 2020-09-08T15:48:46.567 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'38 2020-09-08T15:48:46.567 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'39 2020-09-08T15:48:46.567 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'40 2020-09-08T15:48:46.567 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'41 2020-09-08T15:48:46.567 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'42 2020-09-08T15:48:46.568 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'43 2020-09-08T15:48:46.568 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'44 2020-09-08T15:48:46.568 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'45 2020-09-08T15:48:46.568 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'46 2020-09-08T15:48:46.568 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'47 2020-09-08T15:48:46.569 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'48 2020-09-08T15:48:46.569 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'49 2020-09-08T15:48:46.569 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'50 2020-09-08T15:48:46.569 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'51 2020-09-08T15:48:46.569 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'52 2020-09-08T15:48:46.570 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'53 2020-09-08T15:48:46.571 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'54 2020-09-08T15:48:46.571 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'55 2020-09-08T15:48:46.571 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'56 2020-09-08T15:48:46.571 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'57 2020-09-08T15:48:46.571 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'58 2020-09-08T15:48:46.572 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'59 2020-09-08T15:48:46.572 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'60 2020-09-08T15:48:46.572 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'61 2020-09-08T15:48:46.572 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'62 2020-09-08T15:48:46.572 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'63 2020-09-08T15:48:46.573 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'64 2020-09-08T15:48:46.573 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'65 2020-09-08T15:48:46.573 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'66 2020-09-08T15:48:46.573 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'67 2020-09-08T15:48:46.573 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'68 2020-09-08T15:48:46.574 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'69 2020-09-08T15:48:46.574 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'70 2020-09-08T15:48:46.574 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'71 2020-09-08T15:48:46.574 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'72 2020-09-08T15:48:46.574 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'73 2020-09-08T15:48:46.575 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'74 2020-09-08T15:48:46.575 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'75 2020-09-08T15:48:46.575 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'76 2020-09-08T15:48:46.575 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'77 2020-09-08T15:48:46.575 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'78 2020-09-08T15:48:46.575 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'79 2020-09-08T15:48:46.576 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'80 2020-09-08T15:48:46.576 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'81 2020-09-08T15:48:46.576 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'82 2020-09-08T15:48:46.576 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'83 2020-09-08T15:48:46.576 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'84 2020-09-08T15:48:46.577 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'85 2020-09-08T15:48:46.577 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'86 2020-09-08T15:48:46.577 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'87 2020-09-08T15:48:46.577 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'88 2020-09-08T15:48:46.577 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'89 2020-09-08T15:48:46.578 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'90 2020-09-08T15:48:46.578 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'91 2020-09-08T15:48:46.578 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'92 2020-09-08T15:48:46.578 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'93 2020-09-08T15:48:46.578 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'94 2020-09-08T15:48:46.579 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'95 2020-09-08T15:48:46.579 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'96 2020-09-08T15:48:46.579 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'97 2020-09-08T15:48:46.579 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'98 2020-09-08T15:48:46.579 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'99 2020-09-08T15:48:46.580 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'100 2020-09-08T15:48:46.580 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'101 2020-09-08T15:48:46.580 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'102 2020-09-08T15:48:46.580 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'103 2020-09-08T15:48:46.580 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'104 2020-09-08T15:48:46.580 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'105 2020-09-08T15:48:46.581 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'106 2020-09-08T15:48:46.581 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'107 2020-09-08T15:48:46.581 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'108 2020-09-08T15:48:46.581 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'109 2020-09-08T15:48:46.581 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'110 2020-09-08T15:48:46.582 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'111 2020-09-08T15:48:46.582 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'112 2020-09-08T15:48:46.582 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'113 2020-09-08T15:48:46.582 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'114 2020-09-08T15:48:46.582 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'115 2020-09-08T15:48:46.583 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'116 2020-09-08T15:48:46.583 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'117 2020-09-08T15:48:46.583 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'118 2020-09-08T15:48:46.583 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'119 2020-09-08T15:48:46.583 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'120 2020-09-08T15:48:46.584 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'121 2020-09-08T15:48:46.584 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'122 2020-09-08T15:48:46.584 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'123 2020-09-08T15:48:46.584 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'124 2020-09-08T15:48:46.584 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'125 2020-09-08T15:48:46.584 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'126 2020-09-08T15:48:46.585 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'127 2020-09-08T15:48:46.585 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'128 2020-09-08T15:48:46.585 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'129 2020-09-08T15:48:46.585 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'130 2020-09-08T15:48:46.585 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'131 2020-09-08T15:48:46.586 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'132 2020-09-08T15:48:46.586 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'133 2020-09-08T15:48:46.586 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'134 2020-09-08T15:48:46.586 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'135 2020-09-08T15:48:46.586 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'136 2020-09-08T15:48:46.587 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'137 2020-09-08T15:48:46.587 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'138 2020-09-08T15:48:46.587 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'139 2020-09-08T15:48:46.587 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'140 2020-09-08T15:48:46.587 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'141 2020-09-08T15:48:46.588 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'142 2020-09-08T15:48:46.588 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'143 2020-09-08T15:48:46.588 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'144 2020-09-08T15:48:46.588 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'145 2020-09-08T15:48:46.588 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'146 2020-09-08T15:48:46.588 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'147 2020-09-08T15:48:46.589 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'148 2020-09-08T15:48:46.589 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to max 2 2020-09-08T15:48:46.589 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to copy log version 34'150 2020-09-08T15:48:46.589 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to copy log version 34'149 2020-09-08T15:48:46.589 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after earliest_dup_version 0 2020-09-08T15:48:46.590 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'1 2020-09-08T15:48:46.590 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'2 2020-09-08T15:48:46.590 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'3 2020-09-08T15:48:46.590 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'4 2020-09-08T15:48:46.590 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'5 2020-09-08T15:48:46.591 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'6 2020-09-08T15:48:46.591 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'7 2020-09-08T15:48:46.591 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'8 2020-09-08T15:48:46.591 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'9 2020-09-08T15:48:46.591 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'10 2020-09-08T15:48:46.592 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'11 2020-09-08T15:48:46.592 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'12 2020-09-08T15:48:46.592 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'13 2020-09-08T15:48:46.592 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'14 2020-09-08T15:48:46.592 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'15 2020-09-08T15:48:46.592 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'16 2020-09-08T15:48:46.593 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'17 2020-09-08T15:48:46.593 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'18 2020-09-08T15:48:46.593 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'19 2020-09-08T15:48:46.593 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'20 2020-09-08T15:48:46.593 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'21 2020-09-08T15:48:46.594 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'22 2020-09-08T15:48:46.594 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'23 2020-09-08T15:48:46.594 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'24 2020-09-08T15:48:46.594 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'25 2020-09-08T15:48:46.594 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'26 2020-09-08T15:48:46.595 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'27 2020-09-08T15:48:46.595 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'28 2020-09-08T15:48:46.595 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'29 2020-09-08T15:48:46.595 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'30 2020-09-08T15:48:46.595 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'31 2020-09-08T15:48:46.595 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'32 2020-09-08T15:48:46.596 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'33 2020-09-08T15:48:46.596 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'34 2020-09-08T15:48:46.596 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'35 2020-09-08T15:48:46.596 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'36 2020-09-08T15:48:46.596 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'37 2020-09-08T15:48:46.597 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'38 2020-09-08T15:48:46.597 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'39 2020-09-08T15:48:46.597 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'40 2020-09-08T15:48:46.597 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'41 2020-09-08T15:48:46.597 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'42 2020-09-08T15:48:46.598 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'43 2020-09-08T15:48:46.598 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'44 2020-09-08T15:48:46.598 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'45 2020-09-08T15:48:46.598 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'46 2020-09-08T15:48:46.598 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'47 2020-09-08T15:48:46.599 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'48 2020-09-08T15:48:46.599 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'49 2020-09-08T15:48:46.599 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'50 2020-09-08T15:48:46.599 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'51 2020-09-08T15:48:46.599 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'52 2020-09-08T15:48:46.599 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'53 2020-09-08T15:48:46.600 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'54 2020-09-08T15:48:46.600 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'55 2020-09-08T15:48:46.600 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'56 2020-09-08T15:48:46.600 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'57 2020-09-08T15:48:46.600 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'58 2020-09-08T15:48:46.601 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'59 2020-09-08T15:48:46.601 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'60 2020-09-08T15:48:46.601 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'61 2020-09-08T15:48:46.601 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'62 2020-09-08T15:48:46.601 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'63 2020-09-08T15:48:46.602 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'64 2020-09-08T15:48:46.602 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'65 2020-09-08T15:48:46.602 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'66 2020-09-08T15:48:46.602 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'67 2020-09-08T15:48:46.602 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'68 2020-09-08T15:48:46.602 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'69 2020-09-08T15:48:46.603 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'70 2020-09-08T15:48:46.603 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'71 2020-09-08T15:48:46.603 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'72 2020-09-08T15:48:46.603 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'73 2020-09-08T15:48:46.603 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'74 2020-09-08T15:48:46.604 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'75 2020-09-08T15:48:46.604 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'76 2020-09-08T15:48:46.604 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'77 2020-09-08T15:48:46.604 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'78 2020-09-08T15:48:46.604 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'79 2020-09-08T15:48:46.605 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'80 2020-09-08T15:48:46.605 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'81 2020-09-08T15:48:46.605 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'82 2020-09-08T15:48:46.605 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'83 2020-09-08T15:48:46.605 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'84 2020-09-08T15:48:46.606 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'85 2020-09-08T15:48:46.606 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'86 2020-09-08T15:48:46.606 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'87 2020-09-08T15:48:46.606 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'88 2020-09-08T15:48:46.606 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'89 2020-09-08T15:48:46.606 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'90 2020-09-08T15:48:46.607 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'91 2020-09-08T15:48:46.607 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'92 2020-09-08T15:48:46.607 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'93 2020-09-08T15:48:46.607 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'94 2020-09-08T15:48:46.607 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'95 2020-09-08T15:48:46.608 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'96 2020-09-08T15:48:46.608 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'97 2020-09-08T15:48:46.608 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'98 2020-09-08T15:48:46.608 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'99 2020-09-08T15:48:46.608 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'100 2020-09-08T15:48:46.609 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'101 2020-09-08T15:48:46.609 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'102 2020-09-08T15:48:46.609 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'103 2020-09-08T15:48:46.609 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'104 2020-09-08T15:48:46.609 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'105 2020-09-08T15:48:46.610 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'106 2020-09-08T15:48:46.610 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'107 2020-09-08T15:48:46.610 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'108 2020-09-08T15:48:46.610 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'109 2020-09-08T15:48:46.610 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'110 2020-09-08T15:48:46.611 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'111 2020-09-08T15:48:46.611 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'112 2020-09-08T15:48:46.611 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'113 2020-09-08T15:48:46.611 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'114 2020-09-08T15:48:46.611 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'115 2020-09-08T15:48:46.612 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'116 2020-09-08T15:48:46.612 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'117 2020-09-08T15:48:46.612 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'118 2020-09-08T15:48:46.612 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'119 2020-09-08T15:48:46.612 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'120 2020-09-08T15:48:46.613 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'121 2020-09-08T15:48:46.613 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'122 2020-09-08T15:48:46.613 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'123 2020-09-08T15:48:46.613 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'124 2020-09-08T15:48:46.613 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'125 2020-09-08T15:48:46.614 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'126 2020-09-08T15:48:46.614 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'127 2020-09-08T15:48:46.614 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'128 2020-09-08T15:48:46.622 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'129 2020-09-08T15:48:46.622 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'130 2020-09-08T15:48:46.622 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'131 2020-09-08T15:48:46.623 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'132 2020-09-08T15:48:46.623 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'133 2020-09-08T15:48:46.623 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'134 2020-09-08T15:48:46.623 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'135 2020-09-08T15:48:46.623 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'136 2020-09-08T15:48:46.624 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'137 2020-09-08T15:48:46.624 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'138 2020-09-08T15:48:46.624 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'139 2020-09-08T15:48:46.624 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'140 2020-09-08T15:48:46.624 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'141 2020-09-08T15:48:46.625 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'142 2020-09-08T15:48:46.625 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'143 2020-09-08T15:48:46.625 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'144 2020-09-08T15:48:46.625 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'145 2020-09-08T15:48:46.625 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'146 2020-09-08T15:48:46.625 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'147 2020-09-08T15:48:46.626 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:47:56.484+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'148 2020-09-08T15:48:46.626 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_after v 34'150 2020-09-08T15:48:46.626 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after earliest_dup_version 0 2020-09-08T15:48:46.626 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'1 2020-09-08T15:48:46.626 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'2 2020-09-08T15:48:46.627 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'3 2020-09-08T15:48:46.627 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'4 2020-09-08T15:48:46.627 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'5 2020-09-08T15:48:46.627 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'6 2020-09-08T15:48:46.627 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'7 2020-09-08T15:48:46.628 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'8 2020-09-08T15:48:46.628 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'9 2020-09-08T15:48:46.628 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'10 2020-09-08T15:48:46.628 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'11 2020-09-08T15:48:46.628 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'12 2020-09-08T15:48:46.629 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'13 2020-09-08T15:48:46.629 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'14 2020-09-08T15:48:46.629 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'15 2020-09-08T15:48:46.629 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'16 2020-09-08T15:48:46.629 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'17 2020-09-08T15:48:46.630 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'18 2020-09-08T15:48:46.630 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'19 2020-09-08T15:48:46.630 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'20 2020-09-08T15:48:46.630 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'21 2020-09-08T15:48:46.630 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'22 2020-09-08T15:48:46.631 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'23 2020-09-08T15:48:46.631 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'24 2020-09-08T15:48:46.631 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'25 2020-09-08T15:48:46.631 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'26 2020-09-08T15:48:46.631 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'27 2020-09-08T15:48:46.632 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'28 2020-09-08T15:48:46.632 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'29 2020-09-08T15:48:46.632 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'30 2020-09-08T15:48:46.632 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'31 2020-09-08T15:48:46.632 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'32 2020-09-08T15:48:46.633 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'33 2020-09-08T15:48:46.633 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'34 2020-09-08T15:48:46.633 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'35 2020-09-08T15:48:46.633 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'36 2020-09-08T15:48:46.633 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'37 2020-09-08T15:48:46.634 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'38 2020-09-08T15:48:46.634 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'39 2020-09-08T15:48:46.634 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'40 2020-09-08T15:48:46.634 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'41 2020-09-08T15:48:46.634 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'42 2020-09-08T15:48:46.635 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'43 2020-09-08T15:48:46.635 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'44 2020-09-08T15:48:46.635 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'45 2020-09-08T15:48:46.635 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'46 2020-09-08T15:48:46.635 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'47 2020-09-08T15:48:46.635 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'48 2020-09-08T15:48:46.636 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'49 2020-09-08T15:48:46.636 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'50 2020-09-08T15:48:46.636 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'51 2020-09-08T15:48:46.636 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'52 2020-09-08T15:48:46.636 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'53 2020-09-08T15:48:46.637 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'54 2020-09-08T15:48:46.637 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'55 2020-09-08T15:48:46.637 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'56 2020-09-08T15:48:46.637 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'57 2020-09-08T15:48:46.637 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'58 2020-09-08T15:48:46.638 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'59 2020-09-08T15:48:46.638 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'60 2020-09-08T15:48:46.638 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'61 2020-09-08T15:48:46.638 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'62 2020-09-08T15:48:46.638 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'63 2020-09-08T15:48:46.639 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'64 2020-09-08T15:48:46.639 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'65 2020-09-08T15:48:46.639 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'66 2020-09-08T15:48:46.639 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'67 2020-09-08T15:48:46.639 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'68 2020-09-08T15:48:46.639 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'69 2020-09-08T15:48:46.640 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'70 2020-09-08T15:48:46.640 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'71 2020-09-08T15:48:46.640 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'72 2020-09-08T15:48:46.640 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'73 2020-09-08T15:48:46.640 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'74 2020-09-08T15:48:46.641 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'75 2020-09-08T15:48:46.641 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'76 2020-09-08T15:48:46.641 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'77 2020-09-08T15:48:46.641 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'78 2020-09-08T15:48:46.641 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'79 2020-09-08T15:48:46.642 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'80 2020-09-08T15:48:46.642 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'81 2020-09-08T15:48:46.642 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'82 2020-09-08T15:48:46.642 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'83 2020-09-08T15:48:46.642 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'84 2020-09-08T15:48:46.642 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'85 2020-09-08T15:48:46.643 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'86 2020-09-08T15:48:46.643 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'87 2020-09-08T15:48:46.643 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'88 2020-09-08T15:48:46.643 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'89 2020-09-08T15:48:46.643 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'90 2020-09-08T15:48:46.644 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'91 2020-09-08T15:48:46.644 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'92 2020-09-08T15:48:46.644 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'93 2020-09-08T15:48:46.644 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'94 2020-09-08T15:48:46.644 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'95 2020-09-08T15:48:46.645 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'96 2020-09-08T15:48:46.645 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'97 2020-09-08T15:48:46.645 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'98 2020-09-08T15:48:46.645 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'99 2020-09-08T15:48:46.645 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup version 34'100 2020-09-08T15:48:46.645 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'101 2020-09-08T15:48:46.646 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'102 2020-09-08T15:48:46.646 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'103 2020-09-08T15:48:46.646 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'104 2020-09-08T15:48:46.646 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'105 2020-09-08T15:48:46.646 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'106 2020-09-08T15:48:46.647 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'107 2020-09-08T15:48:46.647 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'108 2020-09-08T15:48:46.647 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'109 2020-09-08T15:48:46.647 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'110 2020-09-08T15:48:46.647 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'111 2020-09-08T15:48:46.648 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'112 2020-09-08T15:48:46.648 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'113 2020-09-08T15:48:46.648 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'114 2020-09-08T15:48:46.648 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'115 2020-09-08T15:48:46.648 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'116 2020-09-08T15:48:46.649 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'117 2020-09-08T15:48:46.649 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'118 2020-09-08T15:48:46.649 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'119 2020-09-08T15:48:46.649 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'120 2020-09-08T15:48:46.649 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'121 2020-09-08T15:48:46.650 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'122 2020-09-08T15:48:46.650 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'123 2020-09-08T15:48:46.650 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'124 2020-09-08T15:48:46.650 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'125 2020-09-08T15:48:46.650 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'126 2020-09-08T15:48:46.650 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'127 2020-09-08T15:48:46.651 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'128 2020-09-08T15:48:46.651 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'129 2020-09-08T15:48:46.651 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'130 2020-09-08T15:48:46.651 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'131 2020-09-08T15:48:46.651 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'132 2020-09-08T15:48:46.652 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'133 2020-09-08T15:48:46.652 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'134 2020-09-08T15:48:46.652 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'135 2020-09-08T15:48:46.652 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'136 2020-09-08T15:48:46.652 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'137 2020-09-08T15:48:46.653 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'138 2020-09-08T15:48:46.653 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'139 2020-09-08T15:48:46.653 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'140 2020-09-08T15:48:46.653 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'141 2020-09-08T15:48:46.653 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'142 2020-09-08T15:48:46.654 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'143 2020-09-08T15:48:46.654 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'144 2020-09-08T15:48:46.654 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'145 2020-09-08T15:48:46.654 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'146 2020-09-08T15:48:46.654 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'147 2020-09-08T15:48:46.655 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'148 2020-09-08T15:48:46.655 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'149 2020-09-08T15:48:46.655 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:48:37.587+0000 7f270959e700 20 copy_up_to/copy_after copy dup from log version 34'150 2020-09-08T15:48:46.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:95: _common_test: rm -f td/osd-backfill-recovery-log/result.log 2020-09-08T15:48:46.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:96: _common_test: '[' 0 '!=' 0 ']' 2020-09-08T15:48:46.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:34: run: teardown td/osd-backfill-recovery-log 2020-09-08T15:48:46.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-recovery-log 2020-09-08T15:48:46.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:48:46.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2020-09-08T15:48:46.656 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:48:46.657 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:48:46.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:48:46.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:48:46.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:48:46.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:48:46.658 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:48:46.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:48:46.658 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:48:46.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:48:46.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:48:46.659 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:48:46.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:48:46.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:48:46.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:48:46.659 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:48:46.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:48:46.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:48:46.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-recovery-log 2020-09-08T15:48:46.660 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:48:46.660 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:48:46.661 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:48:46.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.108735 2020-09-08T15:48:46.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:48:46.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:48:46.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:31: run: for func in $funcs 2020-09-08T15:48:46.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:32: run: setup td/osd-backfill-recovery-log 2020-09-08T15:48:46.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-recovery-log 2020-09-08T15:48:46.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-recovery-log 2020-09-08T15:48:46.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-recovery-log 2020-09-08T15:48:46.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:48:46.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2020-09-08T15:48:46.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:48:46.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:48:46.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:48:46.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:48:46.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:48:46.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:48:46.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:48:46.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:48:46.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:48:46.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:48:46.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:48:46.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:48:46.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:48:46.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:48:46.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:48:46.666 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:48:46.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:48:46.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:48:46.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-recovery-log 2020-09-08T15:48:46.666 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:48:46.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:48:46.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:48:46.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.108735 2020-09-08T15:48:46.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:48:46.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:48:46.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-recovery-log 2020-09-08T15:48:46.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T15:48:46.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:48:46.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:48:46.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.108735 2020-09-08T15:48:46.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T15:48:46.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T15:48:46.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T15:48:46.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-recovery-log 1' TERM HUP INT 2020-09-08T15:48:46.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:33: run: TEST_recovery_1 td/osd-backfill-recovery-log 2020-09-08T15:48:46.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:121: TEST_recovery_1: local dir=td/osd-backfill-recovery-log 2020-09-08T15:48:46.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:123: TEST_recovery_1: _common_test td/osd-backfill-recovery-log '--osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 40 0 40 2020-09-08T15:48:46.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:40: _common_test: local dir=td/osd-backfill-recovery-log 2020-09-08T15:48:46.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:41: _common_test: local 'extra_opts=--osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2020-09-08T15:48:46.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:42: _common_test: local loglen=40 2020-09-08T15:48:46.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:43: _common_test: local dupslen=0 2020-09-08T15:48:46.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:44: _common_test: local objects=40 2020-09-08T15:48:46.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:45: _common_test: local moreobjects=0 2020-09-08T15:48:46.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:47: _common_test: local OSDS=6 2020-09-08T15:48:46.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:49: _common_test: run_mon td/osd-backfill-recovery-log a 2020-09-08T15:48:46.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-recovery-log 2020-09-08T15:48:46.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T15:48:46.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T15:48:46.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T15:48:46.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-recovery-log/a 2020-09-08T15:48:46.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-recovery-log/a --run-dir=td/osd-backfill-recovery-log 2020-09-08T15:48:46.878 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T15:48:46.878 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:48:46.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:48:46.879 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:48:46.879 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:48:46.879 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:48:46.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:48:46.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-recovery-log/a '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-recovery-log/log --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T15:48:47.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T15:48:47.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T15:48:47.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:48:47.064 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:48:47.064 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T15:48:47.064 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T15:48:47.064 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:48:47.064 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:48:47.065 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:48:47.065 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:48:47.066 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:48:47.066 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:48:47.066 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.108735/ceph-mon.a.asok 2020-09-08T15:48:47.066 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:48:47.067 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.108735/ceph-mon.a.asok config get fsid 2020-09-08T15:48:47.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T15:48:47.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:48:47.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:48:47.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T15:48:47.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T15:48:47.168 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:48:47.168 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:48:47.168 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:48:47.169 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:48:47.169 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:48:47.169 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:48:47.169 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.108735/ceph-mon.a.asok 2020-09-08T15:48:47.169 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:48:47.170 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.108735/ceph-mon.a.asok config get mon_host 2020-09-08T15:48:47.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:50: _common_test: run_mgr td/osd-backfill-recovery-log x 2020-09-08T15:48:47.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-recovery-log 2020-09-08T15:48:47.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T15:48:47.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T15:48:47.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T15:48:47.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-recovery-log/x 2020-09-08T15:48:47.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T15:48:48.159 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T15:48:48.159 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:48:48.160 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:48:48.160 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:48:48.160 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:48:48.160 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:48:48.161 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:48:48.161 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:48:48.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-recovery-log/x '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:48:48.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:51: _common_test: export CEPH_ARGS 2020-09-08T15:48:48.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:52: _common_test: export 'EXTRA_OPTS= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2020-09-08T15:48:48.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:52: _common_test: EXTRA_OPTS=' --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2020-09-08T15:48:48.184 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: expr 6 - 1 2020-09-08T15:48:48.190 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: seq 0 5 2020-09-08T15:48:48.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:48:48.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 0 2020-09-08T15:48:48.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:48:48.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:48:48.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T15:48:48.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:48:48.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/0 2020-09-08T15:48:48.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:48:48.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:48:48.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:48:48.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:48:48.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/0' 2020-09-08T15:48:48.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/0/journal' 2020-09-08T15:48:48.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:48:48.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2020-09-08T15:48:48.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:48:48.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:48:48.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:48:48.205 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:48:48.205 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:48:48.205 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:48:48.205 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:48:48.205 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:48:48.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:48:48.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:48:48.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:48:48.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:48:48.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:48:48.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:48:48.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:48:48.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:48:48.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:48:48.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:48:48.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:48:48.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/0 2020-09-08T15:48:48.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:48:48.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=26e6b506-49de-4ea8-b919-65bbb098676d 2020-09-08T15:48:48.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 26e6b506-49de-4ea8-b919-65bbb098676d' 2020-09-08T15:48:48.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:48:48.209 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 26e6b506-49de-4ea8-b919-65bbb098676d 2020-09-08T15:48:48.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDgp1dfUCBnDBAAcUoJRehsaoXfr+3ju2us3Q== 2020-09-08T15:48:48.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDgp1dfUCBnDBAAcUoJRehsaoXfr+3ju2us3Q=="}' 2020-09-08T15:48:48.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 26e6b506-49de-4ea8-b919-65bbb098676d -i td/osd-backfill-recovery-log/0/new.json 2020-09-08T15:48:48.558 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:48:48.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/0/new.json 2020-09-08T15:48:48.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDgp1dfUCBnDBAAcUoJRehsaoXfr+3ju2us3Q== --osd-uuid 26e6b506-49de-4ea8-b919-65bbb098676d 2020-09-08T15:48:48.595 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:48:48.599+0000 7fcee6f52ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:48:48.596 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:48:48.601+0000 7fcee6f52ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:48:48.598 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:48:48.603+0000 7fcee6f52ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:48:48.599 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:48:48.604+0000 7fcee6f52ec0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2020-09-08T15:48:48.599 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:48:48.604+0000 7fcee6f52ec0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2020-09-08T15:48:48.600 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:48:48.604+0000 7fcee6f52ec0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2020-09-08T15:48:48.636 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:48:48.641+0000 7fcee6f52ec0 -1 bluestore(td/osd-backfill-recovery-log/0) _read_fsid unparsable uuid 2020-09-08T15:48:52.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/0/keyring 2020-09-08T15:48:52.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:48:52.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T15:48:52.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:48:52.851 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T15:48:53.380 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T15:48:53.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T15:48:53.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:48:53.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:48:53.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:48:53.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:48:53.404 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:48:53.409+0000 7f700be38ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:48:53.416 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:48:53.421+0000 7f700be38ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:48:53.418 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:48:53.422+0000 7f700be38ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:48:53.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T15:48:53.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:48:53.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:48:53.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:48:53.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:48:53.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:48:53.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:48:53.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:48:53.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:48:53.769 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:48:53.934 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:48:53.939+0000 7f700be38ec0 -1 Falling back to public interface 2020-09-08T15:48:54.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:48:54.700 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:48:54.704+0000 7f700be38ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T15:48:55.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:48:55.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:48:55.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:48:55.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:48:55.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:48:55.207 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:48:55.616 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/134684,v1:127.0.0.1:6803/134684] [v2:127.0.0.1:6804/134684,v1:127.0.0.1:6805/134684] exists,up 26e6b506-49de-4ea8-b919-65bbb098676d 2020-09-08T15:48:55.616 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 8f6f2d51-67fd-4bf0-a04f-42c3a76e6e9f 2020-09-08T15:48:55.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:48:55.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:48:55.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:48:55.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:48:55.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 1 2020-09-08T15:48:55.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:48:55.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:48:55.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T15:48:55.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:48:55.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/1 2020-09-08T15:48:55.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:48:55.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:48:55.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:48:55.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:48:55.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/1' 2020-09-08T15:48:55.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/1/journal' 2020-09-08T15:48:55.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:48:55.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2020-09-08T15:48:55.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:48:55.621 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:48:55.621 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:48:55.621 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:48:55.621 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:48:55.621 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:48:55.622 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:48:55.622 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:48:55.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:48:55.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:48:55.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:48:55.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:48:55.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:48:55.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:48:55.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:48:55.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:48:55.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:48:55.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:48:55.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:48:55.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/1 2020-09-08T15:48:55.625 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:48:55.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=8f6f2d51-67fd-4bf0-a04f-42c3a76e6e9f 2020-09-08T15:48:55.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 8f6f2d51-67fd-4bf0-a04f-42c3a76e6e9f' 2020-09-08T15:48:55.626 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:48:55.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDnp1dft8HiJRAA16KfDVAScQwOVZtdV8UdKg== 2020-09-08T15:48:55.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDnp1dft8HiJRAA16KfDVAScQwOVZtdV8UdKg=="}' 2020-09-08T15:48:55.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 8f6f2d51-67fd-4bf0-a04f-42c3a76e6e9f -i td/osd-backfill-recovery-log/1/new.json 2020-09-08T15:48:56.149 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:48:56.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/1/new.json 2020-09-08T15:48:56.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDnp1dft8HiJRAA16KfDVAScQwOVZtdV8UdKg== --osd-uuid 8f6f2d51-67fd-4bf0-a04f-42c3a76e6e9f 2020-09-08T15:48:56.187 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:48:56.191+0000 7f8d5076eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:48:56.188 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:48:56.193+0000 7f8d5076eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:48:56.190 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:48:56.194+0000 7f8d5076eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:48:56.190 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:48:56.195+0000 7f8d5076eec0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2020-09-08T15:48:56.191 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:48:56.195+0000 7f8d5076eec0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2020-09-08T15:48:56.191 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:48:56.195+0000 7f8d5076eec0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2020-09-08T15:48:56.231 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:48:56.236+0000 7f8d5076eec0 -1 bluestore(td/osd-backfill-recovery-log/1) _read_fsid unparsable uuid 2020-09-08T15:49:00.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/1/keyring 2020-09-08T15:49:00.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:49:00.473 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T15:49:00.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T15:49:00.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:49:01.007 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:49:01.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T15:49:01.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:49:01.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:49:01.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:49:01.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:49:01.032 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:01.037+0000 7f088e808ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:01.045 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:01.049+0000 7f088e808ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:01.046 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:01.051+0000 7f088e808ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:01.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T15:49:01.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:49:01.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:49:01.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:49:01.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:49:01.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:49:01.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:49:01.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:49:01.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:49:01.400 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:49:01.562 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:01.566+0000 7f088e808ec0 -1 Falling back to public interface 2020-09-08T15:49:01.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:49:02.420 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:02.425+0000 7f088e808ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T15:49:02.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:49:02.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:49:02.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:49:02.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:49:02.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:49:02.807 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:49:03.255 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/135678,v1:127.0.0.1:6811/135678] [v2:127.0.0.1:6812/135678,v1:127.0.0.1:6813/135678] exists,up 8f6f2d51-67fd-4bf0-a04f-42c3a76e6e9f 2020-09-08T15:49:03.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:49:03.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:49:03.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:49:03.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:49:03.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 2 2020-09-08T15:49:03.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:49:03.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:49:03.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T15:49:03.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:49:03.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/2 2020-09-08T15:49:03.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:49:03.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:49:03.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:49:03.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:49:03.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/2' 2020-09-08T15:49:03.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/2/journal' 2020-09-08T15:49:03.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:49:03.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2020-09-08T15:49:03.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:49:03.260 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:49:03.260 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:49:03.260 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:49:03.260 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:49:03.260 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:49:03.260 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:49:03.261 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:49:03.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:49:03.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:49:03.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:49:03.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:49:03.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:49:03.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:49:03.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:49:03.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:49:03.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:49:03.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:49:03.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:49:03.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/2 2020-09-08T15:49:03.264 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:49:03.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=0feeff18-5a83-429b-ba6e-fc08bc4709d4 2020-09-08T15:49:03.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 0feeff18-5a83-429b-ba6e-fc08bc4709d4' 2020-09-08T15:49:03.266 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:49:03.266 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 0feeff18-5a83-429b-ba6e-fc08bc4709d4 2020-09-08T15:49:03.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDvp1dfu3V5EBAA3UY1sOjSGgYhN4C5Ut/vfQ== 2020-09-08T15:49:03.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDvp1dfu3V5EBAA3UY1sOjSGgYhN4C5Ut/vfQ=="}' 2020-09-08T15:49:03.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 0feeff18-5a83-429b-ba6e-fc08bc4709d4 -i td/osd-backfill-recovery-log/2/new.json 2020-09-08T15:49:03.819 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T15:49:03.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/2/new.json 2020-09-08T15:49:03.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDvp1dfu3V5EBAA3UY1sOjSGgYhN4C5Ut/vfQ== --osd-uuid 0feeff18-5a83-429b-ba6e-fc08bc4709d4 2020-09-08T15:49:03.856 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:03.861+0000 7fe11d61eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:03.858 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:03.863+0000 7fe11d61eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:03.860 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:03.865+0000 7fe11d61eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:03.861 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:03.865+0000 7fe11d61eec0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2020-09-08T15:49:03.861 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:03.865+0000 7fe11d61eec0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2020-09-08T15:49:03.861 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:03.865+0000 7fe11d61eec0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2020-09-08T15:49:03.902 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:03.907+0000 7fe11d61eec0 -1 bluestore(td/osd-backfill-recovery-log/2) _read_fsid unparsable uuid 2020-09-08T15:49:08.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/2/keyring 2020-09-08T15:49:08.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:49:08.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T15:49:08.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:49:08.144 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T15:49:08.694 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T15:49:08.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T15:49:08.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:49:08.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:49:08.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:49:08.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:49:08.718 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:08.723+0000 7f9a3e718ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:08.734 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:08.738+0000 7f9a3e718ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:08.734 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:08.739+0000 7f9a3e718ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:09.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T15:49:09.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:49:09.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:49:09.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:49:09.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:49:09.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:49:09.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:49:09.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:49:09.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:49:09.088 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:49:09.251 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:09.255+0000 7f9a3e718ec0 -1 Falling back to public interface 2020-09-08T15:49:09.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:49:10.076 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:10.080+0000 7f9a3e718ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T15:49:10.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:49:10.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:49:10.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:49:10.500 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:49:10.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:49:10.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:49:10.911 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/136672,v1:127.0.0.1:6819/136672] [v2:127.0.0.1:6820/136672,v1:127.0.0.1:6821/136672] exists,up 0feeff18-5a83-429b-ba6e-fc08bc4709d4 2020-09-08T15:49:10.911 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 2828732c-1862-498d-a0a1-064f124aa1ad 2020-09-08T15:49:10.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:49:10.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:49:10.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:49:10.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:49:10.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 3 2020-09-08T15:49:10.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:49:10.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:49:10.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T15:49:10.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:49:10.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/3 2020-09-08T15:49:10.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:49:10.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:49:10.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:49:10.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:49:10.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/3' 2020-09-08T15:49:10.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/3/journal' 2020-09-08T15:49:10.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:49:10.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2020-09-08T15:49:10.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:49:10.916 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:49:10.916 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:49:10.916 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:49:10.916 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:49:10.916 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:49:10.917 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:49:10.917 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:49:10.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:49:10.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:49:10.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:49:10.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:49:10.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:49:10.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:49:10.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:49:10.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:49:10.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:49:10.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:49:10.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:49:10.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/3 2020-09-08T15:49:10.920 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:49:10.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=2828732c-1862-498d-a0a1-064f124aa1ad 2020-09-08T15:49:10.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 2828732c-1862-498d-a0a1-064f124aa1ad' 2020-09-08T15:49:10.921 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:49:10.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQD2p1dfonBxNxAAVbcN1VBNy6OKlc49nVQWAw== 2020-09-08T15:49:10.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQD2p1dfonBxNxAAVbcN1VBNy6OKlc49nVQWAw=="}' 2020-09-08T15:49:10.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 2828732c-1862-498d-a0a1-064f124aa1ad -i td/osd-backfill-recovery-log/3/new.json 2020-09-08T15:49:11.515 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T15:49:11.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/3/new.json 2020-09-08T15:49:11.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQD2p1dfonBxNxAAVbcN1VBNy6OKlc49nVQWAw== --osd-uuid 2828732c-1862-498d-a0a1-064f124aa1ad 2020-09-08T15:49:11.553 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:11.557+0000 7fed98a33ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:11.554 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:11.559+0000 7fed98a33ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:11.556 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:11.561+0000 7fed98a33ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:11.557 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:11.561+0000 7fed98a33ec0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2020-09-08T15:49:11.557 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:11.561+0000 7fed98a33ec0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2020-09-08T15:49:11.557 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:11.561+0000 7fed98a33ec0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2020-09-08T15:49:11.638 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:11.643+0000 7fed98a33ec0 -1 bluestore(td/osd-backfill-recovery-log/3) _read_fsid unparsable uuid 2020-09-08T15:49:15.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/3/keyring 2020-09-08T15:49:15.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:49:15.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T15:49:15.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:49:15.835 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T15:49:16.367 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T15:49:16.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T15:49:16.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:49:16.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:49:16.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:49:16.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:49:16.391 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:16.396+0000 7fe8c2776ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:16.486 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:16.490+0000 7fe8c2776ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:16.487 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:16.491+0000 7fe8c2776ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:16.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T15:49:16.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:49:16.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T15:49:16.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:49:16.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:49:16.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:49:16.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:49:16.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:49:16.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T15:49:16.793 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:49:17.003 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:17.008+0000 7fe8c2776ec0 -1 Falling back to public interface 2020-09-08T15:49:17.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:49:17.815 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:17.820+0000 7fe8c2776ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T15:49:18.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:49:18.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:49:18.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:49:18.194 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:49:18.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:49:18.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T15:49:18.604 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/137683,v1:127.0.0.1:6827/137683] [v2:127.0.0.1:6828/137683,v1:127.0.0.1:6829/137683] exists,up 2828732c-1862-498d-a0a1-064f124aa1ad 2020-09-08T15:49:18.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:49:18.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:49:18.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:49:18.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:49:18.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 4 2020-09-08T15:49:18.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:49:18.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:49:18.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=4 2020-09-08T15:49:18.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:49:18.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/4 2020-09-08T15:49:18.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:49:18.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:49:18.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:49:18.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:49:18.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/4' 2020-09-08T15:49:18.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/4/journal' 2020-09-08T15:49:18.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:49:18.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2020-09-08T15:49:18.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:49:18.609 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:49:18.609 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:49:18.609 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:49:18.610 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:49:18.610 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:49:18.611 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:49:18.611 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:49:18.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:49:18.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:49:18.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:49:18.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:49:18.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:49:18.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:49:18.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:49:18.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:49:18.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:49:18.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:49:18.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:49:18.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/4 2020-09-08T15:49:18.615 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:49:18.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=a9b69c3b-af31-4dd0-bf7f-5af401123ccf 2020-09-08T15:49:18.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd4 a9b69c3b-af31-4dd0-bf7f-5af401123ccf' 2020-09-08T15:49:18.616 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:49:18.616 INFO:tasks.workunit.client.0.smithi065.stdout:add osd4 a9b69c3b-af31-4dd0-bf7f-5af401123ccf 2020-09-08T15:49:18.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQD+p1dfOwtQJRAAWgHxjQQC2ahyKLJSiu+wZA== 2020-09-08T15:49:18.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQD+p1dfOwtQJRAAWgHxjQQC2ahyKLJSiu+wZA=="}' 2020-09-08T15:49:18.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new a9b69c3b-af31-4dd0-bf7f-5af401123ccf -i td/osd-backfill-recovery-log/4/new.json 2020-09-08T15:49:19.171 INFO:tasks.workunit.client.0.smithi065.stdout:4 2020-09-08T15:49:19.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/4/new.json 2020-09-08T15:49:19.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 4 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQD+p1dfOwtQJRAAWgHxjQQC2ahyKLJSiu+wZA== --osd-uuid a9b69c3b-af31-4dd0-bf7f-5af401123ccf 2020-09-08T15:49:19.212 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:19.214+0000 7f5e0d91eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:19.213 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:19.216+0000 7f5e0d91eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:19.213 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:19.216+0000 7f5e0d91eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:19.213 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:19.217+0000 7f5e0d91eec0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2020-09-08T15:49:19.213 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:19.217+0000 7f5e0d91eec0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2020-09-08T15:49:19.214 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:19.217+0000 7f5e0d91eec0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2020-09-08T15:49:19.256 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:19.262+0000 7f5e0d91eec0 -1 bluestore(td/osd-backfill-recovery-log/4) _read_fsid unparsable uuid 2020-09-08T15:49:23.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/4/keyring 2020-09-08T15:49:23.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:49:23.440 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd4 key to auth repository 2020-09-08T15:49:23.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd4 key to auth repository 2020-09-08T15:49:23.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:49:23.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.4 2020-09-08T15:49:23.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 4 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:49:23.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:49:23.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:49:23.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:49:23.971 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.4 2020-09-08T15:49:23.994 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:23.998+0000 7f45c1a7eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:24.013 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:24.017+0000 7f45c1a7eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:24.014 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:24.017+0000 7f45c1a7eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:24.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 4 2020-09-08T15:49:24.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:49:24.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=4 2020-09-08T15:49:24.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:49:24.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:49:24.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:49:24.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:49:24.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:49:24.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T15:49:24.411 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:49:24.528 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:24.532+0000 7f45c1a7eec0 -1 Falling back to public interface 2020-09-08T15:49:24.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:49:25.349 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:25.351+0000 7f45c1a7eec0 -1 osd.4 0 log_to_monitors {default=true} 2020-09-08T15:49:25.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:49:25.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:49:25.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:49:25.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T15:49:25.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:49:25.799 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:49:26.212 INFO:tasks.workunit.client.0.smithi065.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/138660,v1:127.0.0.1:6835/138660] [v2:127.0.0.1:6836/138660,v1:127.0.0.1:6837/138660] exists,up a9b69c3b-af31-4dd0-bf7f-5af401123ccf 2020-09-08T15:49:26.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:49:26.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:49:26.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:49:26.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:49:26.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 5 2020-09-08T15:49:26.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:49:26.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:49:26.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=5 2020-09-08T15:49:26.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:49:26.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/5 2020-09-08T15:49:26.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:49:26.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:49:26.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:49:26.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:49:26.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/5' 2020-09-08T15:49:26.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/5/journal' 2020-09-08T15:49:26.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:49:26.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2020-09-08T15:49:26.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:49:26.217 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:49:26.217 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:49:26.217 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:49:26.217 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:49:26.217 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:49:26.218 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:49:26.218 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:49:26.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:49:26.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:49:26.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:49:26.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:49:26.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:49:26.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:49:26.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:49:26.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:49:26.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:49:26.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:49:26.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:49:26.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/5 2020-09-08T15:49:26.220 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:49:26.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=b4736c39-0a8f-42c2-af1d-d7b3f4b80265 2020-09-08T15:49:26.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd5 b4736c39-0a8f-42c2-af1d-d7b3f4b80265' 2020-09-08T15:49:26.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:49:26.222 INFO:tasks.workunit.client.0.smithi065.stdout:add osd5 b4736c39-0a8f-42c2-af1d-d7b3f4b80265 2020-09-08T15:49:26.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAGqFdfM9zXDRAAzXqbDrOcIe0Ld89CjGcGTA== 2020-09-08T15:49:26.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAGqFdfM9zXDRAAzXqbDrOcIe0Ld89CjGcGTA=="}' 2020-09-08T15:49:26.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new b4736c39-0a8f-42c2-af1d-d7b3f4b80265 -i td/osd-backfill-recovery-log/5/new.json 2020-09-08T15:49:26.813 INFO:tasks.workunit.client.0.smithi065.stdout:5 2020-09-08T15:49:26.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/5/new.json 2020-09-08T15:49:26.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 5 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAGqFdfM9zXDRAAzXqbDrOcIe0Ld89CjGcGTA== --osd-uuid b4736c39-0a8f-42c2-af1d-d7b3f4b80265 2020-09-08T15:49:26.852 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:26.854+0000 7faa48083ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:26.852 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:26.856+0000 7faa48083ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:26.863 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:26.857+0000 7faa48083ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:26.864 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:26.857+0000 7faa48083ec0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2020-09-08T15:49:26.864 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:26.857+0000 7faa48083ec0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2020-09-08T15:49:26.864 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:26.857+0000 7faa48083ec0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2020-09-08T15:49:26.909 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:26.913+0000 7faa48083ec0 -1 bluestore(td/osd-backfill-recovery-log/5) _read_fsid unparsable uuid 2020-09-08T15:49:31.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/5/keyring 2020-09-08T15:49:31.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:49:31.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd5 key to auth repository 2020-09-08T15:49:31.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:49:31.142 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd5 key to auth repository 2020-09-08T15:49:31.678 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.5 2020-09-08T15:49:31.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.5 2020-09-08T15:49:31.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:49:31.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 5 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:49:31.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:49:31.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:49:31.702 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:31.706+0000 7f545957aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:31.714 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:31.718+0000 7f545957aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:31.715 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:31.720+0000 7f545957aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:49:32.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 5 2020-09-08T15:49:32.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:49:32.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=5 2020-09-08T15:49:32.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:49:32.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:49:32.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:49:32.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:49:32.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:49:32.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T15:49:32.074 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:49:32.231 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:32.236+0000 7f545957aec0 -1 Falling back to public interface 2020-09-08T15:49:32.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:49:33.007 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:49:33.011+0000 7f545957aec0 -1 osd.5 0 log_to_monitors {default=true} 2020-09-08T15:49:33.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:49:33.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:49:33.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:49:33.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T15:49:33.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:49:33.480 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:49:33.898 INFO:tasks.workunit.client.0.smithi065.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/139654,v1:127.0.0.1:6843/139654] [v2:127.0.0.1:6844/139654,v1:127.0.0.1:6845/139654] exists,up b4736c39-0a8f-42c2-af1d-d7b3f4b80265 2020-09-08T15:49:33.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:49:33.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:49:33.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:49:33.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:59: _common_test: create_pool test 1 1 2020-09-08T15:49:33.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test 1 1 2020-09-08T15:49:34.686 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' already exists 2020-09-08T15:49:34.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:49:35.696 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: seq 1 40 2020-09-08T15:49:35.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:35.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-1 /etc/passwd 2020-09-08T15:49:35.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:35.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-2 /etc/passwd 2020-09-08T15:49:36.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:36.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-3 /etc/passwd 2020-09-08T15:49:36.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:36.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-4 /etc/passwd 2020-09-08T15:49:36.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:36.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-5 /etc/passwd 2020-09-08T15:49:36.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:36.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-6 /etc/passwd 2020-09-08T15:49:36.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:36.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-7 /etc/passwd 2020-09-08T15:49:36.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:36.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-8 /etc/passwd 2020-09-08T15:49:36.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:36.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-9 /etc/passwd 2020-09-08T15:49:37.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:37.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-10 /etc/passwd 2020-09-08T15:49:37.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:37.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-11 /etc/passwd 2020-09-08T15:49:37.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:37.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-12 /etc/passwd 2020-09-08T15:49:37.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:37.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-13 /etc/passwd 2020-09-08T15:49:37.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:37.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-14 /etc/passwd 2020-09-08T15:49:37.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:37.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-15 /etc/passwd 2020-09-08T15:49:37.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:37.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-16 /etc/passwd 2020-09-08T15:49:38.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:38.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-17 /etc/passwd 2020-09-08T15:49:38.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:38.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-18 /etc/passwd 2020-09-08T15:49:38.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:38.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-19 /etc/passwd 2020-09-08T15:49:38.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:38.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-20 /etc/passwd 2020-09-08T15:49:38.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:38.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-21 /etc/passwd 2020-09-08T15:49:38.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:38.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-22 /etc/passwd 2020-09-08T15:49:38.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:38.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-23 /etc/passwd 2020-09-08T15:49:39.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:39.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-24 /etc/passwd 2020-09-08T15:49:39.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:39.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-25 /etc/passwd 2020-09-08T15:49:39.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:39.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-26 /etc/passwd 2020-09-08T15:49:39.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:39.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-27 /etc/passwd 2020-09-08T15:49:39.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:39.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-28 /etc/passwd 2020-09-08T15:49:39.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:39.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-29 /etc/passwd 2020-09-08T15:49:39.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:39.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-30 /etc/passwd 2020-09-08T15:49:39.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:39.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-31 /etc/passwd 2020-09-08T15:49:40.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:40.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-32 /etc/passwd 2020-09-08T15:49:40.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:40.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-33 /etc/passwd 2020-09-08T15:49:40.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:40.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-34 /etc/passwd 2020-09-08T15:49:40.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:40.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-35 /etc/passwd 2020-09-08T15:49:40.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:40.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-36 /etc/passwd 2020-09-08T15:49:40.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:40.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-37 /etc/passwd 2020-09-08T15:49:40.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:40.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-38 /etc/passwd 2020-09-08T15:49:41.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:41.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-39 /etc/passwd 2020-09-08T15:49:41.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:49:41.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-40 /etc/passwd 2020-09-08T15:49:41.363 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:67: _common_test: ceph pg dump pgs --format=json 2020-09-08T15:49:41.364 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:67: _common_test: jq '.pg_stats[0].up[]' 2020-09-08T15:49:41.747 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:49:41.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:67: _common_test: ceph osd out 1 0 2 2020-09-08T15:49:42.295 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already out. osd.0 is already out. osd.2 is already out. 2020-09-08T15:49:42.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:68: _common_test: '[' 0 '!=' 0 ']' 2020-09-08T15:49:42.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:74: _common_test: sleep 1 2020-09-08T15:49:43.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:75: _common_test: wait_for_clean 2020-09-08T15:49:43.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:49:43.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:49:43.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:49:43.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:49:43.306 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T15:49:43.307 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:49:43.307 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:49:43.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:49:43.308 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:49:43.308 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:49:43.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:49:43.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:49:43.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:49:43.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:49:43.415 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:49:43.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:49:43.802 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:49:43.802 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T15:49:43.802 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T15:49:43.803 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T15:49:43.803 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T15:49:43.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:49:43.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:49:43.803 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:49:43.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836493 2020-09-08T15:49:43.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836493 2020-09-08T15:49:43.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836493' 2020-09-08T15:49:43.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:49:43.957 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:49:44.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672972 2020-09-08T15:49:44.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672972 2020-09-08T15:49:44.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836493 1-42949672972' 2020-09-08T15:49:44.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:49:44.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:49:44.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509449 2020-09-08T15:49:44.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509449 2020-09-08T15:49:44.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836493 1-42949672972 2-64424509449' 2020-09-08T15:49:44.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:49:44.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T15:49:44.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345928 2020-09-08T15:49:44.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345928 2020-09-08T15:49:44.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836493 1-42949672972 2-64424509449 3-85899345928' 2020-09-08T15:49:44.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:49:44.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T15:49:44.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182406 2020-09-08T15:49:44.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182406 2020-09-08T15:49:44.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836493 1-42949672972 2-64424509449 3-85899345928 4-107374182406' 2020-09-08T15:49:44.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:49:44.581 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T15:49:44.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018886 2020-09-08T15:49:44.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018886 2020-09-08T15:49:44.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836493 1-42949672972 2-64424509449 3-85899345928 4-107374182406 5-128849018886' 2020-09-08T15:49:44.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:49:44.711 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836493 2020-09-08T15:49:44.712 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:49:44.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:49:44.726 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836493 2020-09-08T15:49:44.726 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:49:44.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836493 2020-09-08T15:49:44.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836493' 2020-09-08T15:49:44.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:49:44.728 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836493 2020-09-08T15:49:45.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 0 -lt 21474836493 2020-09-08T15:49:45.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:49:46.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:49:46.115 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:49:46.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836493 -lt 21474836493 2020-09-08T15:49:46.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:49:46.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672972 2020-09-08T15:49:46.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:49:46.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:49:46.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672972 2020-09-08T15:49:46.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:49:46.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672972 2020-09-08T15:49:46.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672972' 2020-09-08T15:49:46.516 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:49:46.517 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672972 2020-09-08T15:49:46.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672972 -lt 42949672972 2020-09-08T15:49:46.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:49:46.955 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509449 2020-09-08T15:49:46.955 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:49:46.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:49:46.956 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509449 2020-09-08T15:49:46.956 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:49:46.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509449 2020-09-08T15:49:46.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509449' 2020-09-08T15:49:46.957 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:49:46.958 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509449 2020-09-08T15:49:47.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509449 -lt 64424509449 2020-09-08T15:49:47.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:49:47.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345928 2020-09-08T15:49:47.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:49:47.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T15:49:47.348 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345928 2020-09-08T15:49:47.348 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:49:47.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345928 2020-09-08T15:49:47.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345928' 2020-09-08T15:49:47.350 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T15:49:47.350 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345928 2020-09-08T15:49:47.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345928 -lt 85899345928 2020-09-08T15:49:47.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:49:47.745 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182406 2020-09-08T15:49:47.745 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:49:47.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T15:49:47.746 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182406 2020-09-08T15:49:47.746 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:49:47.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182406 2020-09-08T15:49:47.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182406' 2020-09-08T15:49:47.747 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T15:49:47.748 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182406 2020-09-08T15:49:48.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182407 -lt 107374182406 2020-09-08T15:49:48.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:49:48.161 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018886 2020-09-08T15:49:48.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:49:48.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T15:49:48.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018886 2020-09-08T15:49:48.163 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:49:48.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018886 2020-09-08T15:49:48.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018886' 2020-09-08T15:49:48.164 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T15:49:48.164 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018886 2020-09-08T15:49:48.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018886 -lt 128849018886 2020-09-08T15:49:48.563 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:49:48.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:49:48.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:49:49.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T15:49:49.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:49:49.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:49:49.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:49:49.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:49:49.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:49:49.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:49:49.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:49:49.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:49:49.475 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:49:49.475 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:49:49.475 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:49:49.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:49:49.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T15:49:49.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T15:49:49.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T15:49:49.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:49:49.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:49:50.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:49:50.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:49:50.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:49:50.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:49:50.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:49:50.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:49:50.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:49:50.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:49:50.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:49:50.480 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:49:50.481 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:49:50.481 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:49:50.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:49:51.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:49:51.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:49:51.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:49:51.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:49:51.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:49:51.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:49:51.001 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:49:51.001 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:49:51.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4881 2020-09-08T15:49:51.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4881 '!=' null 2020-09-08T15:49:51.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:49:51.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:49:51.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:49:51.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:49:51.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:49:51.618 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:49:51.618 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:49:51.618 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:49:51.618 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:49:51.618 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:49:51.619 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:49:51.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:49:51.998 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:49:51.998 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:49:51.998 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:49:52.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:49:52.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:49:52.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:49:52.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:49:52.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:49:52.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:49:52.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:49:52.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:49:52.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:49:53.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=19203 2020-09-08T15:49:53.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 19203 '!=' null 2020-09-08T15:49:53.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:49:53.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:49:53.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:49:53.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:49:53.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:49:53.235 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:49:53.235 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:49:53.235 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:49:53.235 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:49:53.235 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:49:53.236 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:49:53.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:49:53.618 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:49:53.618 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:49:53.619 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:49:54.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:49:54.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:49:54.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:49:54.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:49:54.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:49:54.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:49:54.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:49:54.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:49:54.149 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:49:54.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=18745 2020-09-08T15:49:54.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 18745 '!=' null 2020-09-08T15:49:54.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:49:54.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:49:54.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:49:54.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:49:54.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:49:54.768 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:49:54.768 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:49:54.768 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:49:54.769 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:49:54.769 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:49:54.769 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:49:55.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:49:55.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:49:55.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:49:55.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:49:55.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:49:55.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:49:55.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:49:55.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:49:55.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:49:55.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:49:55.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:49:55.672 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:49:55.673 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:49:56.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=16195 2020-09-08T15:49:56.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 16195 '!=' null 2020-09-08T15:49:56.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:49:56.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:49:56.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:49:56.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:49:56.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:49:56.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:49:56.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:49:56.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:49:56.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:49:56.300 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:49:56.300 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:49:56.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:49:56.685 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:49:56.686 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:49:56.686 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:49:57.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:49:57.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:49:57.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:49:57.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:49:57.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:49:57.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:49:57.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:49:57.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:49:57.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:49:57.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=16195 2020-09-08T15:49:57.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 16195 '!=' null 2020-09-08T15:49:57.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:49:57.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:49:57.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:49:57.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:49:57.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:49:57.821 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:49:57.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:49:57.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:49:57.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:49:57.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:49:57.823 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:49:58.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:49:58.205 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:49:58.206 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:49:58.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:49:58.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T15:49:58.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:49:58.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:49:58.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:77: _common_test: flush_pg_stats 2020-09-08T15:49:58.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:49:58.725 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:49:59.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:49:59.114 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:49:59.114 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T15:49:59.115 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T15:49:59.115 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T15:49:59.115 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T15:49:59.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:49:59.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:49:59.116 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:49:59.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836498 2020-09-08T15:49:59.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836498 2020-09-08T15:49:59.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498' 2020-09-08T15:49:59.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:49:59.258 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:49:59.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672977 2020-09-08T15:49:59.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672977 2020-09-08T15:49:59.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498 1-42949672977' 2020-09-08T15:49:59.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:49:59.410 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:49:59.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509454 2020-09-08T15:49:59.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509454 2020-09-08T15:49:59.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498 1-42949672977 2-64424509454' 2020-09-08T15:49:59.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:49:59.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T15:49:59.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345933 2020-09-08T15:49:59.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345933 2020-09-08T15:49:59.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498 1-42949672977 2-64424509454 3-85899345933' 2020-09-08T15:49:59.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:49:59.666 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T15:49:59.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182411 2020-09-08T15:49:59.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182411 2020-09-08T15:49:59.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498 1-42949672977 2-64424509454 3-85899345933 4-107374182411' 2020-09-08T15:49:59.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:49:59.795 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T15:49:59.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018891 2020-09-08T15:49:59.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018891 2020-09-08T15:49:59.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498 1-42949672977 2-64424509454 3-85899345933 4-107374182411 5-128849018891' 2020-09-08T15:49:59.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:49:59.924 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836498 2020-09-08T15:49:59.924 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:49:59.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:49:59.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836498 2020-09-08T15:49:59.926 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:49:59.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836498 2020-09-08T15:49:59.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836498' 2020-09-08T15:49:59.926 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836498 2020-09-08T15:49:59.927 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:50:00.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836498 -lt 21474836498 2020-09-08T15:50:00.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:50:00.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672977 2020-09-08T15:50:00.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:50:00.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:50:00.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672977 2020-09-08T15:50:00.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:50:00.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672977 2020-09-08T15:50:00.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672977' 2020-09-08T15:50:00.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:50:00.321 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672977 2020-09-08T15:50:00.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672977 -lt 42949672977 2020-09-08T15:50:00.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:50:00.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509454 2020-09-08T15:50:00.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:50:00.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:50:00.725 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509454 2020-09-08T15:50:00.725 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:50:00.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509454 2020-09-08T15:50:00.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509454' 2020-09-08T15:50:00.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:50:00.727 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509454 2020-09-08T15:50:01.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509454 -lt 64424509454 2020-09-08T15:50:01.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:50:01.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345933 2020-09-08T15:50:01.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:50:01.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T15:50:01.144 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345933 2020-09-08T15:50:01.144 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:50:01.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345933 2020-09-08T15:50:01.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345933' 2020-09-08T15:50:01.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T15:50:01.146 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345933 2020-09-08T15:50:01.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345933 -lt 85899345933 2020-09-08T15:50:01.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:50:01.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182411 2020-09-08T15:50:01.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:50:01.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T15:50:01.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182411 2020-09-08T15:50:01.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:50:01.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182411 2020-09-08T15:50:01.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182411' 2020-09-08T15:50:01.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T15:50:01.556 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182411 2020-09-08T15:50:01.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182411 -lt 107374182411 2020-09-08T15:50:01.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:50:01.969 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018891 2020-09-08T15:50:01.970 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:50:01.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T15:50:01.970 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018891 2020-09-08T15:50:01.971 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:50:01.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018891 2020-09-08T15:50:01.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018891' 2020-09-08T15:50:01.972 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T15:50:01.972 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018891 2020-09-08T15:50:02.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018891 -lt 128849018891 2020-09-08T15:50:02.400 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:79: _common_test: ceph pg dump pgs --format=json 2020-09-08T15:50:02.400 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:79: _common_test: jq '.pg_stats[0].up_primary' 2020-09-08T15:50:02.773 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:50:02.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:79: _common_test: newprimary=4 2020-09-08T15:50:02.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:80: _common_test: kill_daemons 2020-09-08T15:50:02.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:50:02.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:50:02.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:50:02.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:50:02.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:50:02.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:50:02.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:82: _common_test: ERRORS=0 2020-09-08T15:50:02.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:83: _common_test: _objectstore_tool_nodown td/osd-backfill-recovery-log 4 --no-mon-config --pgid 1.0 --op log 2020-09-08T15:50:02.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:83: _common_test: tee td/osd-backfill-recovery-log/result.log 2020-09-08T15:50:02.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local dir=td/osd-backfill-recovery-log 2020-09-08T15:50:02.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2020-09-08T15:50:02.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local id=4 2020-09-08T15:50:02.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1198: _objectstore_tool_nodown: shift 2020-09-08T15:50:02.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: _objectstore_tool_nodown: local osd_data=td/osd-backfill-recovery-log/4 2020-09-08T15:50:02.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1202: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-recovery-log/4 --no-mon-config --pgid 1.0 --op log 2020-09-08T15:50:03.782 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:50:03.782 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_log_t": { 2020-09-08T15:50:03.782 INFO:tasks.workunit.client.0.smithi065.stdout: "head": "34'40", 2020-09-08T15:50:03.783 INFO:tasks.workunit.client.0.smithi065.stdout: "tail": "0'0", 2020-09-08T15:50:03.783 INFO:tasks.workunit.client.0.smithi065.stdout: "log": [ 2020-09-08T15:50:03.783 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.783 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.784 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:c00128d9:::obj-1:head", 2020-09-08T15:50:03.784 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'1", 2020-09-08T15:50:03.784 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.784 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4187.0:1", 2020-09-08T15:50:03.784 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.785 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:35.763713+0000", 2020-09-08T15:50:03.785 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.785 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.785 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.785 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.786 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.786 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.786 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.786 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.786 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.787 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.787 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.787 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.787 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.787 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.788 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.788 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.788 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.788 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.788 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:d7942fc0:::obj-2:head", 2020-09-08T15:50:03.788 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'2", 2020-09-08T15:50:03.789 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.789 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4190.0:1", 2020-09-08T15:50:03.789 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.789 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:35.931017+0000", 2020-09-08T15:50:03.790 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.790 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.790 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.791 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.791 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.791 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.791 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.791 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.792 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.792 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.792 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.792 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.792 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.793 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.793 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.793 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.793 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.793 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.793 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:1dda57ab:::obj-3:head", 2020-09-08T15:50:03.794 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'3", 2020-09-08T15:50:03.794 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.794 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4193.0:1", 2020-09-08T15:50:03.794 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.794 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:36.116579+0000", 2020-09-08T15:50:03.795 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.795 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.795 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.795 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.795 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.796 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.796 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.796 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.796 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.796 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.797 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.797 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.797 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.797 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.797 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.800 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.800 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.800 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.801 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:ba1802d0:::obj-4:head", 2020-09-08T15:50:03.802 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'4", 2020-09-08T15:50:03.802 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.802 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4196.0:1", 2020-09-08T15:50:03.802 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.802 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:36.258226+0000", 2020-09-08T15:50:03.803 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.803 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.803 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.803 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.803 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.804 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.804 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.804 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.804 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.804 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.805 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.805 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.805 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.805 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.805 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.806 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.806 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.806 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.806 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:d5d4a582:::obj-5:head", 2020-09-08T15:50:03.807 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'5", 2020-09-08T15:50:03.807 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.807 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4199.0:1", 2020-09-08T15:50:03.807 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.807 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:36.382912+0000", 2020-09-08T15:50:03.808 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.808 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.808 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.808 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.808 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.809 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.809 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.809 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.809 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.809 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.810 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.810 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.810 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.810 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.811 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.811 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.811 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.811 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.812 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:25cac09a:::obj-6:head", 2020-09-08T15:50:03.813 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'6", 2020-09-08T15:50:03.813 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.814 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4202.0:1", 2020-09-08T15:50:03.814 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.815 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:36.508004+0000", 2020-09-08T15:50:03.815 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.815 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.815 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.816 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.816 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.816 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.817 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.817 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.817 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.817 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.821 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.821 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.821 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.821 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.822 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.822 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.822 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.822 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.822 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:b11b7838:::obj-7:head", 2020-09-08T15:50:03.823 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'7", 2020-09-08T15:50:03.823 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.824 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4205.0:1", 2020-09-08T15:50:03.824 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.824 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:36.633640+0000", 2020-09-08T15:50:03.824 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.824 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.825 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.825 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.825 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.825 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.825 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.826 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.826 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.826 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.826 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.826 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.827 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.827 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.827 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.827 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.827 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.828 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.828 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:a0f702de:::obj-8:head", 2020-09-08T15:50:03.828 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'8", 2020-09-08T15:50:03.828 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.828 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4208.0:1", 2020-09-08T15:50:03.828 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.829 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:36.760120+0000", 2020-09-08T15:50:03.829 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.829 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.829 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.829 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.830 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.830 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.830 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.830 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.830 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.831 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.831 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.831 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.831 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.831 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.831 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.832 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.832 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.832 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.832 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:1e5c3677:::obj-9:head", 2020-09-08T15:50:03.832 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'9", 2020-09-08T15:50:03.833 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.833 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4211.0:1", 2020-09-08T15:50:03.833 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.833 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:36.928713+0000", 2020-09-08T15:50:03.833 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.834 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.835 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.835 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.835 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.835 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.836 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.836 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.836 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.836 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.836 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.837 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.837 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.837 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.837 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.837 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.838 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.839 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.839 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:86dc045c:::obj-10:head", 2020-09-08T15:50:03.839 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'10", 2020-09-08T15:50:03.839 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.840 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4214.0:1", 2020-09-08T15:50:03.840 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.840 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:37.079851+0000", 2020-09-08T15:50:03.840 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.841 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.841 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.841 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.841 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.841 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.842 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.842 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.842 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.842 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.843 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.843 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.843 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.843 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.843 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.844 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.844 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.844 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.844 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:1e6eca61:::obj-11:head", 2020-09-08T15:50:03.844 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'11", 2020-09-08T15:50:03.844 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.845 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4217.0:1", 2020-09-08T15:50:03.845 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.845 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:37.222075+0000", 2020-09-08T15:50:03.845 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.845 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.846 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.846 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.846 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.846 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.846 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.847 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.847 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.847 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.847 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.848 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.848 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.848 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.848 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.848 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.849 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.850 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.850 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:18dee445:::obj-12:head", 2020-09-08T15:50:03.850 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'12", 2020-09-08T15:50:03.850 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.850 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4220.0:1", 2020-09-08T15:50:03.851 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.851 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:37.381731+0000", 2020-09-08T15:50:03.851 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.851 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.851 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.852 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.852 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.852 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.852 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.852 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.852 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.853 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.853 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.853 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.853 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.853 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.854 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.854 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.854 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.854 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.854 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:283c5c90:::obj-13:head", 2020-09-08T15:50:03.855 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'13", 2020-09-08T15:50:03.855 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.855 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4223.0:1", 2020-09-08T15:50:03.855 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.855 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:37.540529+0000", 2020-09-08T15:50:03.856 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.856 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.857 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.858 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.858 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.858 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.858 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.858 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.859 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.859 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.859 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.859 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.859 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.860 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.860 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.860 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.860 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.860 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.861 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:cc896bf0:::obj-14:head", 2020-09-08T15:50:03.861 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'14", 2020-09-08T15:50:03.861 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.861 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4226.0:1", 2020-09-08T15:50:03.861 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.862 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:37.674291+0000", 2020-09-08T15:50:03.862 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.862 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.862 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.862 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.863 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.863 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.863 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.863 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.863 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.864 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.864 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.864 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.864 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.864 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.864 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.865 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.865 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.865 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.865 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:a581f807:::obj-15:head", 2020-09-08T15:50:03.865 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'15", 2020-09-08T15:50:03.866 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.866 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4229.0:1", 2020-09-08T15:50:03.866 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.866 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:37.808300+0000", 2020-09-08T15:50:03.866 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.867 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.867 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.867 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.867 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.867 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.868 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.868 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.868 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.868 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.868 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.868 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.869 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.869 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.869 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.869 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.869 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.870 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.870 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:c902ca7c:::obj-16:head", 2020-09-08T15:50:03.871 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'16", 2020-09-08T15:50:03.871 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.871 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4232.0:1", 2020-09-08T15:50:03.871 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.871 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:37.933717+0000", 2020-09-08T15:50:03.872 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.872 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.872 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.872 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.872 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.873 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.873 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.873 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.873 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.873 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.874 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.875 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.875 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.875 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.875 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.875 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.876 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.876 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.876 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:655283c8:::obj-17:head", 2020-09-08T15:50:03.877 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'17", 2020-09-08T15:50:03.877 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.877 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4235.0:1", 2020-09-08T15:50:03.878 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.878 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:38.076660+0000", 2020-09-08T15:50:03.878 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.878 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.878 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.879 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.879 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.879 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.879 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.879 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.879 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.880 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.880 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.880 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.880 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.880 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.881 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.881 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.881 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.881 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.881 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:d759d762:::obj-18:head", 2020-09-08T15:50:03.881 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'18", 2020-09-08T15:50:03.882 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.882 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4238.0:1", 2020-09-08T15:50:03.882 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.882 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:38.219074+0000", 2020-09-08T15:50:03.882 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.883 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.883 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.883 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.883 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.883 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.884 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.884 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.884 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.884 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.884 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.884 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.885 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.885 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.885 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.885 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.885 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.886 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.886 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:1b934a2d:::obj-19:head", 2020-09-08T15:50:03.886 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'19", 2020-09-08T15:50:03.886 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.886 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4241.0:1", 2020-09-08T15:50:03.887 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.887 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:38.353335+0000", 2020-09-08T15:50:03.887 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.887 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.887 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.887 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.888 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.888 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.888 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.888 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.888 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.889 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.889 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.889 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.889 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.889 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.889 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.890 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.890 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.890 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.890 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:1d0ea2ca:::obj-20:head", 2020-09-08T15:50:03.890 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'20", 2020-09-08T15:50:03.891 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.891 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4244.0:1", 2020-09-08T15:50:03.891 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.891 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:38.487771+0000", 2020-09-08T15:50:03.891 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.892 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.892 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.892 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.892 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.892 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.892 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.893 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.893 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.893 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.894 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.894 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.894 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.894 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.894 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.895 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.895 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.895 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.895 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:ab396690:::obj-21:head", 2020-09-08T15:50:03.895 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'21", 2020-09-08T15:50:03.896 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.896 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4247.0:1", 2020-09-08T15:50:03.896 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.896 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:38.630176+0000", 2020-09-08T15:50:03.896 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.897 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.897 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.897 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.897 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.897 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.897 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.898 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.898 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.898 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.898 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.898 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.899 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.899 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.899 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.899 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.899 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.899 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.900 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:254983db:::obj-22:head", 2020-09-08T15:50:03.900 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'22", 2020-09-08T15:50:03.900 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.900 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4250.0:1", 2020-09-08T15:50:03.900 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.901 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:38.764480+0000", 2020-09-08T15:50:03.901 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.901 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.901 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.901 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.902 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.902 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.902 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.902 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.902 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.902 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.903 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.903 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.903 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.903 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.903 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.904 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.904 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.904 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.904 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:e656299f:::obj-23:head", 2020-09-08T15:50:03.904 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'23", 2020-09-08T15:50:03.904 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.905 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4253.0:1", 2020-09-08T15:50:03.905 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.905 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:38.898251+0000", 2020-09-08T15:50:03.905 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.905 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.906 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.906 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.906 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.906 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.906 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.907 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.907 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.907 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.907 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.907 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.907 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.908 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.908 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.908 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.908 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.909 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.909 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:5cdf412b:::obj-24:head", 2020-09-08T15:50:03.909 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'24", 2020-09-08T15:50:03.909 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.910 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4256.0:1", 2020-09-08T15:50:03.910 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.910 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:39.040746+0000", 2020-09-08T15:50:03.910 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.910 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.911 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.911 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.911 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.911 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.911 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.911 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.912 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.912 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.912 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.912 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.912 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.913 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.913 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.913 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.913 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.913 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.914 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:cacae143:::obj-25:head", 2020-09-08T15:50:03.914 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'25", 2020-09-08T15:50:03.914 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.914 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4259.0:1", 2020-09-08T15:50:03.914 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.914 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:39.183075+0000", 2020-09-08T15:50:03.915 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.915 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.915 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.915 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.915 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.916 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.916 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.916 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.916 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.916 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.916 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.917 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.917 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.917 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.917 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.917 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.918 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.918 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.918 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:34b5bff6:::obj-26:head", 2020-09-08T15:50:03.918 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'26", 2020-09-08T15:50:03.918 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.919 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4262.0:1", 2020-09-08T15:50:03.919 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.919 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:39.325735+0000", 2020-09-08T15:50:03.919 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.919 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.919 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.920 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.920 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.920 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.920 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.920 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.921 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.921 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.921 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.921 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.921 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.921 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.922 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.922 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.922 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.922 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.922 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:a354f8f6:::obj-27:head", 2020-09-08T15:50:03.923 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'27", 2020-09-08T15:50:03.923 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.923 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4265.0:1", 2020-09-08T15:50:03.924 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.924 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:39.467743+0000", 2020-09-08T15:50:03.924 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.924 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.924 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.925 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.925 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.925 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.925 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.925 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.925 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.926 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.926 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.926 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.926 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.926 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.927 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.927 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.927 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.927 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.927 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:7421db49:::obj-28:head", 2020-09-08T15:50:03.928 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'28", 2020-09-08T15:50:03.928 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.928 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4268.0:1", 2020-09-08T15:50:03.928 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.928 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:39.593500+0000", 2020-09-08T15:50:03.928 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.929 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.929 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.929 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.929 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.929 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.930 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.930 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.930 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.930 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.930 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.931 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.931 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.931 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.931 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.931 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.931 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.932 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.932 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:54bc79ba:::obj-29:head", 2020-09-08T15:50:03.932 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'29", 2020-09-08T15:50:03.932 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.932 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4271.0:1", 2020-09-08T15:50:03.933 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.933 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:39.728055+0000", 2020-09-08T15:50:03.933 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.933 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.933 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.934 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.934 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.934 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.934 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.934 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.934 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.935 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.935 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.935 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.935 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.935 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.936 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.936 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.936 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.936 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.936 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:01b15595:::obj-30:head", 2020-09-08T15:50:03.936 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'30", 2020-09-08T15:50:03.937 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.937 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4274.0:1", 2020-09-08T15:50:03.937 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.937 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:39.870606+0000", 2020-09-08T15:50:03.937 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.938 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.938 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.938 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.938 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.938 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.939 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.939 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.939 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.939 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.939 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.939 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.940 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.940 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.940 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.940 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.940 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.941 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.941 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:f9a0a8a2:::obj-31:head", 2020-09-08T15:50:03.941 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'31", 2020-09-08T15:50:03.941 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.941 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4277.0:1", 2020-09-08T15:50:03.941 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.942 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:40.013354+0000", 2020-09-08T15:50:03.942 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.942 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.942 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.942 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.943 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.943 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.943 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.943 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.943 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.943 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.944 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.944 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.944 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.944 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.944 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.945 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.945 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.945 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.945 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:1bf2562f:::obj-32:head", 2020-09-08T15:50:03.945 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'32", 2020-09-08T15:50:03.945 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.946 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4280.0:1", 2020-09-08T15:50:03.946 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.946 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:40.154660+0000", 2020-09-08T15:50:03.946 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.946 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.947 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.947 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.947 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.947 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.947 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.947 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.948 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.948 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.948 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.948 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.948 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.949 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.949 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.949 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.949 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.949 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.950 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:b982ae22:::obj-33:head", 2020-09-08T15:50:03.950 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'33", 2020-09-08T15:50:03.950 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.950 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4283.0:1", 2020-09-08T15:50:03.950 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.950 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:40.307601+0000", 2020-09-08T15:50:03.951 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.951 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.951 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.951 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.951 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.952 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.952 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.952 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.952 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.952 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.952 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.953 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.953 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.953 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.953 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.953 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.954 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.954 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.954 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:1ad9f98e:::obj-34:head", 2020-09-08T15:50:03.954 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'34", 2020-09-08T15:50:03.954 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.954 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4286.0:1", 2020-09-08T15:50:03.955 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.955 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:40.440399+0000", 2020-09-08T15:50:03.955 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.955 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.955 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.956 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.956 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.956 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.956 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.956 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.956 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.957 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.957 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.957 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.957 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.957 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.958 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.958 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.958 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.958 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.958 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:941f43ff:::obj-35:head", 2020-09-08T15:50:03.959 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'35", 2020-09-08T15:50:03.959 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.959 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4289.0:1", 2020-09-08T15:50:03.959 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.959 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:40.583086+0000", 2020-09-08T15:50:03.959 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.960 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.960 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.960 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.960 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.960 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.961 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.961 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.961 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.961 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.961 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.961 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.962 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.962 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.962 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.962 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.962 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.963 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.963 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:24ebabe9:::obj-36:head", 2020-09-08T15:50:03.963 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'36", 2020-09-08T15:50:03.963 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:03.963 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4292.0:1", 2020-09-08T15:50:03.963 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:03.964 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:40.724969+0000", 2020-09-08T15:50:03.964 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:03.964 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:03.964 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:03.964 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:03.965 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:03.965 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:03.965 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.965 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.965 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:03.965 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:03.966 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:03.966 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:03.966 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:03.966 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.966 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:03.967 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:03.967 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:03.967 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:03.967 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:5f3a5398:::obj-37:head", 2020-09-08T15:50:03.967 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'37", 2020-09-08T15:50:03.967 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:04.044 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4295.0:1", 2020-09-08T15:50:04.044 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:04.045 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:40.858904+0000", 2020-09-08T15:50:04.045 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:04.045 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:04.045 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:04.045 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:04.046 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:04.046 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:04.046 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:04.046 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:04.046 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:04.047 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:04.047 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:04.047 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:04.047 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:04.047 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:04.048 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:04.048 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:04.048 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:04.048 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:04.048 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:c96cb37e:::obj-38:head", 2020-09-08T15:50:04.048 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'38", 2020-09-08T15:50:04.049 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:04.049 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4298.0:1", 2020-09-08T15:50:04.049 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:04.049 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:40.984084+0000", 2020-09-08T15:50:04.049 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:04.050 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:04.050 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:04.050 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:04.050 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:04.050 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:04.051 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:04.051 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:04.051 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:04.051 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:04.051 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:04.052 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:04.052 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:04.052 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:04.052 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:04.052 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:04.052 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:04.053 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:04.053 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:69e36996:::obj-39:head", 2020-09-08T15:50:04.053 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'39", 2020-09-08T15:50:04.053 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:04.053 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4301.0:1", 2020-09-08T15:50:04.054 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:04.054 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:41.110685+0000", 2020-09-08T15:50:04.054 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:04.054 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:04.054 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:04.054 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:04.055 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:04.055 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:04.055 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:04.055 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:04.055 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:04.056 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:04.056 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:04.056 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:04.056 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:04.056 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:04.057 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:04.057 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:04.057 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:50:04.057 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:50:04.057 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:9f75773e:::obj-40:head", 2020-09-08T15:50:04.057 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'40", 2020-09-08T15:50:04.058 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:50:04.058 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4304.0:1", 2020-09-08T15:50:04.058 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:50:04.058 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:49:41.254520+0000", 2020-09-08T15:50:04.058 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:50:04.059 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:50:04.059 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:50:04.059 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:50:04.059 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:50:04.059 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:50:04.059 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:04.060 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:04.060 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:50:04.060 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:50:04.060 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:50:04.060 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:50:04.061 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:50:04.061 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:04.061 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:04.061 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:04.061 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:50:04.061 INFO:tasks.workunit.client.0.smithi065.stdout: "dups": [] 2020-09-08T15:50:04.062 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:50:04.062 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_missing_t": { 2020-09-08T15:50:04.062 INFO:tasks.workunit.client.0.smithi065.stdout: "missing": [], 2020-09-08T15:50:04.062 INFO:tasks.workunit.client.0.smithi065.stdout: "may_include_deletes": true 2020-09-08T15:50:04.062 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:50:04.063 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:50:04.065 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:84: _common_test: jq '.pg_log_t.log | length' td/osd-backfill-recovery-log/result.log 2020-09-08T15:50:04.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:84: _common_test: LOGLEN=40 2020-09-08T15:50:04.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:85: _common_test: '[' 40 '!=' 40 ']' 2020-09-08T15:50:04.065 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:89: _common_test: jq '.pg_log_t.dups | length' td/osd-backfill-recovery-log/result.log 2020-09-08T15:50:04.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:89: _common_test: DUPSLEN=0 2020-09-08T15:50:04.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:90: _common_test: '[' 0 '!=' 0 ']' 2020-09-08T15:50:04.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:94: _common_test: grep 'copy_up_to\|copy_after' td/osd-backfill-recovery-log/osd.0.log td/osd-backfill-recovery-log/osd.1.log td/osd-backfill-recovery-log/osd.2.log td/osd-backfill-recovery-log/osd.3.log td/osd-backfill-recovery-log/osd.4.log td/osd-backfill-recovery-log/osd.5.log 2020-09-08T15:50:04.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:95: _common_test: rm -f td/osd-backfill-recovery-log/result.log 2020-09-08T15:50:04.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:96: _common_test: '[' 0 '!=' 0 ']' 2020-09-08T15:50:04.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:34: run: teardown td/osd-backfill-recovery-log 2020-09-08T15:50:04.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-recovery-log 2020-09-08T15:50:04.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:50:04.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2020-09-08T15:50:04.067 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:50:04.068 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:50:04.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:50:04.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:50:04.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:50:04.068 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after v 0'0 2020-09-08T15:50:04.069 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'40 2020-09-08T15:50:04.069 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'39 2020-09-08T15:50:04.069 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'38 2020-09-08T15:50:04.069 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'37 2020-09-08T15:50:04.069 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'36 2020-09-08T15:50:04.070 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'35 2020-09-08T15:50:04.070 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'34 2020-09-08T15:50:04.070 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'33 2020-09-08T15:50:04.070 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'32 2020-09-08T15:50:04.070 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'31 2020-09-08T15:50:04.071 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'30 2020-09-08T15:50:04.071 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'29 2020-09-08T15:50:04.071 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'28 2020-09-08T15:50:04.071 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'27 2020-09-08T15:50:04.071 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'26 2020-09-08T15:50:04.072 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'25 2020-09-08T15:50:04.072 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'24 2020-09-08T15:50:04.072 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'23 2020-09-08T15:50:04.072 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'22 2020-09-08T15:50:04.072 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'21 2020-09-08T15:50:04.072 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'20 2020-09-08T15:50:04.073 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'19 2020-09-08T15:50:04.073 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'18 2020-09-08T15:50:04.073 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'17 2020-09-08T15:50:04.073 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'16 2020-09-08T15:50:04.073 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'15 2020-09-08T15:50:04.074 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'14 2020-09-08T15:50:04.074 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'13 2020-09-08T15:50:04.074 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'12 2020-09-08T15:50:04.074 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'11 2020-09-08T15:50:04.074 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'10 2020-09-08T15:50:04.075 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'9 2020-09-08T15:50:04.075 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'8 2020-09-08T15:50:04.075 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'7 2020-09-08T15:50:04.075 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'6 2020-09-08T15:50:04.075 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'5 2020-09-08T15:50:04.076 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'4 2020-09-08T15:50:04.076 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'3 2020-09-08T15:50:04.076 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'2 2020-09-08T15:50:04.076 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_after copy log version 34'1 2020-09-08T15:50:04.076 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:49:44.295+0000 7f6fe9773700 20 copy_up_to/copy_after earliest_dup_version 0 2020-09-08T15:50:04.077 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after v 0'0 2020-09-08T15:50:04.077 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'40 2020-09-08T15:50:04.077 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'39 2020-09-08T15:50:04.077 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'38 2020-09-08T15:50:04.077 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'37 2020-09-08T15:50:04.078 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'36 2020-09-08T15:50:04.078 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'35 2020-09-08T15:50:04.078 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'34 2020-09-08T15:50:04.078 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'33 2020-09-08T15:50:04.079 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'32 2020-09-08T15:50:04.079 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'31 2020-09-08T15:50:04.079 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'30 2020-09-08T15:50:04.079 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'29 2020-09-08T15:50:04.079 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'28 2020-09-08T15:50:04.079 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'27 2020-09-08T15:50:04.080 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'26 2020-09-08T15:50:04.080 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'25 2020-09-08T15:50:04.080 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'24 2020-09-08T15:50:04.080 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'23 2020-09-08T15:50:04.080 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'22 2020-09-08T15:50:04.081 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'21 2020-09-08T15:50:04.081 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'20 2020-09-08T15:50:04.081 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'19 2020-09-08T15:50:04.081 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'18 2020-09-08T15:50:04.081 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'17 2020-09-08T15:50:04.082 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'16 2020-09-08T15:50:04.082 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'15 2020-09-08T15:50:04.082 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'14 2020-09-08T15:50:04.082 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'13 2020-09-08T15:50:04.082 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'12 2020-09-08T15:50:04.083 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'11 2020-09-08T15:50:04.083 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'10 2020-09-08T15:50:04.083 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'9 2020-09-08T15:50:04.083 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'8 2020-09-08T15:50:04.083 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'7 2020-09-08T15:50:04.083 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'6 2020-09-08T15:50:04.084 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'5 2020-09-08T15:50:04.084 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'4 2020-09-08T15:50:04.084 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'3 2020-09-08T15:50:04.084 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'2 2020-09-08T15:50:04.084 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'1 2020-09-08T15:50:04.085 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_up_to/copy_after earliest_dup_version 0 2020-09-08T15:50:04.085 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after v 0'0 2020-09-08T15:50:04.085 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'40 2020-09-08T15:50:04.085 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'39 2020-09-08T15:50:04.085 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'38 2020-09-08T15:50:04.086 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'37 2020-09-08T15:50:04.086 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'36 2020-09-08T15:50:04.086 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'35 2020-09-08T15:50:04.086 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'34 2020-09-08T15:50:04.086 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'33 2020-09-08T15:50:04.086 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'32 2020-09-08T15:50:04.087 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'31 2020-09-08T15:50:04.087 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'30 2020-09-08T15:50:04.087 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'29 2020-09-08T15:50:04.087 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'28 2020-09-08T15:50:04.087 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'27 2020-09-08T15:50:04.088 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'26 2020-09-08T15:50:04.088 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'25 2020-09-08T15:50:04.088 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'24 2020-09-08T15:50:04.088 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'23 2020-09-08T15:50:04.088 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'22 2020-09-08T15:50:04.089 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'21 2020-09-08T15:50:04.089 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'20 2020-09-08T15:50:04.089 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'19 2020-09-08T15:50:04.089 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'18 2020-09-08T15:50:04.089 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'17 2020-09-08T15:50:04.089 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'16 2020-09-08T15:50:04.090 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'15 2020-09-08T15:50:04.090 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'14 2020-09-08T15:50:04.090 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'13 2020-09-08T15:50:04.090 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'12 2020-09-08T15:50:04.090 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'11 2020-09-08T15:50:04.091 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'10 2020-09-08T15:50:04.091 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'9 2020-09-08T15:50:04.091 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'8 2020-09-08T15:50:04.091 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'7 2020-09-08T15:50:04.091 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'6 2020-09-08T15:50:04.092 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'5 2020-09-08T15:50:04.092 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'4 2020-09-08T15:50:04.092 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'3 2020-09-08T15:50:04.092 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'2 2020-09-08T15:50:04.092 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_after copy log version 34'1 2020-09-08T15:50:04.092 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.4.log:2020-09-08T15:49:44.562+0000 7f459f3b9700 20 copy_up_to/copy_after earliest_dup_version 0 2020-09-08T15:50:04.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:50:04.096 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:50:04.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:50:04.096 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:50:04.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:50:04.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:50:04.097 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:50:04.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:50:04.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:50:04.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:50:04.098 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:50:04.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:50:04.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:50:04.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-recovery-log 2020-09-08T15:50:04.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:50:04.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:50:04.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:50:04.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.108735 2020-09-08T15:50:04.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:50:04.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:50:04.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:31: run: for func in $funcs 2020-09-08T15:50:04.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:32: run: setup td/osd-backfill-recovery-log 2020-09-08T15:50:04.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-recovery-log 2020-09-08T15:50:04.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-recovery-log 2020-09-08T15:50:04.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-recovery-log 2020-09-08T15:50:04.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:50:04.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2020-09-08T15:50:04.101 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:50:04.101 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:50:04.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:50:04.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:50:04.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:50:04.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:50:04.102 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:50:04.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:50:04.103 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:50:04.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:50:04.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:50:04.103 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:50:04.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:50:04.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:50:04.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:50:04.107 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:50:04.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:50:04.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:50:04.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-recovery-log 2020-09-08T15:50:04.108 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:50:04.108 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:50:04.108 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:50:04.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.108735 2020-09-08T15:50:04.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:50:04.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:50:04.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-recovery-log 2020-09-08T15:50:04.109 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T15:50:04.109 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:50:04.109 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:50:04.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.108735 2020-09-08T15:50:04.110 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T15:50:04.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T15:50:04.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T15:50:04.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-recovery-log 1' TERM HUP INT 2020-09-08T15:50:04.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:33: run: TEST_recovery_2 td/osd-backfill-recovery-log 2020-09-08T15:50:04.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:129: TEST_recovery_2: local dir=td/osd-backfill-recovery-log 2020-09-08T15:50:04.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:131: TEST_recovery_2: _common_test td/osd-backfill-recovery-log '--osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 151 10 141 20 2020-09-08T15:50:04.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:40: _common_test: local dir=td/osd-backfill-recovery-log 2020-09-08T15:50:04.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:41: _common_test: local 'extra_opts=--osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2020-09-08T15:50:04.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:42: _common_test: local loglen=151 2020-09-08T15:50:04.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:43: _common_test: local dupslen=10 2020-09-08T15:50:04.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:44: _common_test: local objects=141 2020-09-08T15:50:04.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:45: _common_test: local moreobjects=20 2020-09-08T15:50:04.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:47: _common_test: local OSDS=6 2020-09-08T15:50:04.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:49: _common_test: run_mon td/osd-backfill-recovery-log a 2020-09-08T15:50:04.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-recovery-log 2020-09-08T15:50:04.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T15:50:04.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T15:50:04.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T15:50:04.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-recovery-log/a 2020-09-08T15:50:04.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-recovery-log/a --run-dir=td/osd-backfill-recovery-log 2020-09-08T15:50:04.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T15:50:04.387 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:50:04.387 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:50:04.387 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:50:04.387 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:50:04.388 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:50:04.388 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:50:04.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-recovery-log/a '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-recovery-log/log --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T15:50:04.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T15:50:04.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T15:50:04.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:50:04.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:50:04.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T15:50:04.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T15:50:04.566 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:50:04.566 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:50:04.566 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:50:04.567 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:50:04.567 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:50:04.567 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:50:04.567 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.108735/ceph-mon.a.asok 2020-09-08T15:50:04.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:50:04.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.108735/ceph-mon.a.asok config get fsid 2020-09-08T15:50:04.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T15:50:04.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:50:04.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:50:04.666 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T15:50:04.666 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T15:50:04.666 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:50:04.666 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:50:04.666 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:50:04.667 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:50:04.668 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:50:04.668 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:50:04.668 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.108735/ceph-mon.a.asok 2020-09-08T15:50:04.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:50:04.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.108735/ceph-mon.a.asok config get mon_host 2020-09-08T15:50:04.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:50: _common_test: run_mgr td/osd-backfill-recovery-log x 2020-09-08T15:50:04.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-recovery-log 2020-09-08T15:50:04.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T15:50:04.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T15:50:04.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T15:50:04.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-recovery-log/x 2020-09-08T15:50:04.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T15:50:05.279 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T15:50:05.279 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:50:05.280 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:50:05.280 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:50:05.280 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:50:05.280 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:50:05.280 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:50:05.281 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:50:05.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-recovery-log/x '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:50:05.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:51: _common_test: export CEPH_ARGS 2020-09-08T15:50:05.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:52: _common_test: export 'EXTRA_OPTS= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2020-09-08T15:50:05.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:52: _common_test: EXTRA_OPTS=' --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2020-09-08T15:50:05.306 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: expr 6 - 1 2020-09-08T15:50:05.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: seq 0 5 2020-09-08T15:50:05.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:50:05.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 0 2020-09-08T15:50:05.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:50:05.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:50:05.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T15:50:05.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:50:05.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/0 2020-09-08T15:50:05.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:50:05.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:50:05.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:50:05.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:50:05.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/0' 2020-09-08T15:50:05.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/0/journal' 2020-09-08T15:50:05.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:50:05.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2020-09-08T15:50:05.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:50:05.313 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:50:05.313 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:50:05.313 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:50:05.314 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:50:05.314 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:50:05.314 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:50:05.314 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:50:05.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:50:05.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:50:05.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:50:05.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:50:05.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:50:05.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:50:05.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:50:05.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:50:05.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:50:05.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:50:05.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:50:05.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/0 2020-09-08T15:50:05.317 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:50:05.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=055e874e-9f1f-46d7-a7fa-d29502bdcfb2 2020-09-08T15:50:05.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 055e874e-9f1f-46d7-a7fa-d29502bdcfb2' 2020-09-08T15:50:05.318 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:50:05.318 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 055e874e-9f1f-46d7-a7fa-d29502bdcfb2 2020-09-08T15:50:05.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAtqFdfCsu0ExAAeo9HCkdB6IAA64YP+4tYPg== 2020-09-08T15:50:05.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAtqFdfCsu0ExAAeo9HCkdB6IAA64YP+4tYPg=="}' 2020-09-08T15:50:05.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 055e874e-9f1f-46d7-a7fa-d29502bdcfb2 -i td/osd-backfill-recovery-log/0/new.json 2020-09-08T15:50:05.666 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:50:05.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/0/new.json 2020-09-08T15:50:05.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAtqFdfCsu0ExAAeo9HCkdB6IAA64YP+4tYPg== --osd-uuid 055e874e-9f1f-46d7-a7fa-d29502bdcfb2 2020-09-08T15:50:05.704 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:05.708+0000 7f2e7173bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:05.705 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:05.710+0000 7f2e7173bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:05.706 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:05.711+0000 7f2e7173bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:05.707 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:05.712+0000 7f2e7173bec0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2020-09-08T15:50:05.707 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:05.712+0000 7f2e7173bec0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2020-09-08T15:50:05.707 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:05.712+0000 7f2e7173bec0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2020-09-08T15:50:05.745 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:05.750+0000 7f2e7173bec0 -1 bluestore(td/osd-backfill-recovery-log/0) _read_fsid unparsable uuid 2020-09-08T15:50:09.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/0/keyring 2020-09-08T15:50:09.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:50:09.954 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T15:50:09.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T15:50:09.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:50:10.490 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T15:50:10.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T15:50:10.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:50:10.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:50:10.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:50:10.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:50:10.514 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:10.519+0000 7f81b1535ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:10.516 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:10.521+0000 7f81b1535ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:10.518 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:10.523+0000 7f81b1535ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:10.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T15:50:10.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:50:10.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:50:10.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:50:10.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:50:10.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:50:10.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:50:10.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:50:10.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:50:10.886 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:50:11.038 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:11.043+0000 7f81b1535ec0 -1 Falling back to public interface 2020-09-08T15:50:11.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:50:11.852 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:11.856+0000 7f81b1535ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T15:50:12.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:50:12.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:50:12.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:50:12.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:50:12.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:50:12.300 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:50:12.720 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/143506,v1:127.0.0.1:6803/143506] [v2:127.0.0.1:6804/143506,v1:127.0.0.1:6805/143506] exists,up 055e874e-9f1f-46d7-a7fa-d29502bdcfb2 2020-09-08T15:50:12.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:50:12.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:50:12.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:50:12.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:50:12.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 1 2020-09-08T15:50:12.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:50:12.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:50:12.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T15:50:12.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:50:12.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/1 2020-09-08T15:50:12.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:50:12.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:50:12.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:50:12.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:50:12.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/1' 2020-09-08T15:50:12.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/1/journal' 2020-09-08T15:50:12.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:50:12.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2020-09-08T15:50:12.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:50:12.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:50:12.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:50:12.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:50:12.725 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:50:12.725 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:50:12.725 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:50:12.725 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:50:12.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:50:12.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:50:12.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:50:12.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:50:12.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:50:12.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:50:12.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:50:12.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:50:12.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:50:12.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:50:12.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:50:12.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/1 2020-09-08T15:50:12.728 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:50:12.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=99328161-806e-4e65-8bff-09f7c2a8b639 2020-09-08T15:50:12.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 99328161-806e-4e65-8bff-09f7c2a8b639' 2020-09-08T15:50:12.730 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:50:12.730 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 99328161-806e-4e65-8bff-09f7c2a8b639 2020-09-08T15:50:12.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQA0qFdfYtUbLBAAJPG1vgxQ8BWxS9NyOilJcA== 2020-09-08T15:50:12.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQA0qFdfYtUbLBAAJPG1vgxQ8BWxS9NyOilJcA=="}' 2020-09-08T15:50:12.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 99328161-806e-4e65-8bff-09f7c2a8b639 -i td/osd-backfill-recovery-log/1/new.json 2020-09-08T15:50:13.233 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:50:13.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/1/new.json 2020-09-08T15:50:13.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQA0qFdfYtUbLBAAJPG1vgxQ8BWxS9NyOilJcA== --osd-uuid 99328161-806e-4e65-8bff-09f7c2a8b639 2020-09-08T15:50:13.271 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:13.274+0000 7f2a16093ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:13.272 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:13.276+0000 7f2a16093ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:13.274 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:13.278+0000 7f2a16093ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:13.275 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:13.278+0000 7f2a16093ec0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2020-09-08T15:50:13.275 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:13.278+0000 7f2a16093ec0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2020-09-08T15:50:13.275 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:13.278+0000 7f2a16093ec0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2020-09-08T15:50:13.325 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:13.330+0000 7f2a16093ec0 -1 bluestore(td/osd-backfill-recovery-log/1) _read_fsid unparsable uuid 2020-09-08T15:50:17.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/1/keyring 2020-09-08T15:50:17.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:50:17.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T15:50:17.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:50:17.268 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T15:50:17.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T15:50:17.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:50:17.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:50:17.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:50:17.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:50:17.821 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:50:17.844 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:17.848+0000 7feed262eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:17.948 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:17.953+0000 7feed262eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:17.950 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:17.955+0000 7feed262eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:18.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T15:50:18.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:50:18.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:50:18.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:50:18.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:50:18.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:50:18.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:50:18.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:50:18.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:50:18.255 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:50:18.475 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:18.474+0000 7feed262eec0 -1 Falling back to public interface 2020-09-08T15:50:18.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:50:19.308 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:19.313+0000 7feed262eec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T15:50:19.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:50:19.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:50:19.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:50:19.669 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:50:19.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:50:19.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:50:20.114 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/144518,v1:127.0.0.1:6811/144518] [v2:127.0.0.1:6812/144518,v1:127.0.0.1:6813/144518] exists,up 99328161-806e-4e65-8bff-09f7c2a8b639 2020-09-08T15:50:20.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:50:20.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:50:20.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:50:20.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:50:20.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 2 2020-09-08T15:50:20.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:50:20.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:50:20.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T15:50:20.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:50:20.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/2 2020-09-08T15:50:20.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:50:20.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:50:20.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:50:20.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:50:20.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/2' 2020-09-08T15:50:20.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/2/journal' 2020-09-08T15:50:20.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:50:20.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2020-09-08T15:50:20.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:50:20.118 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:50:20.119 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:50:20.119 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:50:20.119 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:50:20.119 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:50:20.119 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:50:20.119 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:50:20.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:50:20.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:50:20.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:50:20.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:50:20.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:50:20.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:50:20.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:50:20.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:50:20.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:50:20.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:50:20.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:50:20.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/2 2020-09-08T15:50:20.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:50:20.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=468ad8f5-034c-4a2c-8205-a1c5c0e6d58b 2020-09-08T15:50:20.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 468ad8f5-034c-4a2c-8205-a1c5c0e6d58b' 2020-09-08T15:50:20.123 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:50:20.123 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 468ad8f5-034c-4a2c-8205-a1c5c0e6d58b 2020-09-08T15:50:20.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQA8qFdfQqgDCBAAAcO4UnmpmhA80iKF4gfjqw== 2020-09-08T15:50:20.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQA8qFdfQqgDCBAAAcO4UnmpmhA80iKF4gfjqw=="}' 2020-09-08T15:50:20.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 468ad8f5-034c-4a2c-8205-a1c5c0e6d58b -i td/osd-backfill-recovery-log/2/new.json 2020-09-08T15:50:20.671 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T15:50:20.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/2/new.json 2020-09-08T15:50:20.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQA8qFdfQqgDCBAAAcO4UnmpmhA80iKF4gfjqw== --osd-uuid 468ad8f5-034c-4a2c-8205-a1c5c0e6d58b 2020-09-08T15:50:20.710 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:20.714+0000 7f0d0cfffec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:20.711 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:20.716+0000 7f0d0cfffec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:20.712 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:20.717+0000 7f0d0cfffec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:20.713 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:20.718+0000 7f0d0cfffec0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2020-09-08T15:50:20.713 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:20.718+0000 7f0d0cfffec0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2020-09-08T15:50:20.713 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:20.718+0000 7f0d0cfffec0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2020-09-08T15:50:20.756 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:20.760+0000 7f0d0cfffec0 -1 bluestore(td/osd-backfill-recovery-log/2) _read_fsid unparsable uuid 2020-09-08T15:50:24.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/2/keyring 2020-09-08T15:50:24.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:50:24.947 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T15:50:24.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T15:50:24.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:50:25.483 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T15:50:25.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T15:50:25.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:50:25.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:50:25.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:50:25.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:50:25.507 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:25.512+0000 7fe488b28ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:25.530 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:25.534+0000 7fe488b28ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:25.531 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:25.535+0000 7fe488b28ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:25.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T15:50:25.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:50:25.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:50:25.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:50:25.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:50:25.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:50:25.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:50:25.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:50:25.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:50:25.880 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:50:26.046 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:26.051+0000 7fe488b28ec0 -1 Falling back to public interface 2020-09-08T15:50:26.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:50:26.829 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:26.834+0000 7fe488b28ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T15:50:27.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:50:27.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:50:27.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:50:27.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:50:27.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:50:27.286 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:50:27.730 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/145494,v1:127.0.0.1:6819/145494] [v2:127.0.0.1:6820/145494,v1:127.0.0.1:6821/145494] exists,up 468ad8f5-034c-4a2c-8205-a1c5c0e6d58b 2020-09-08T15:50:27.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:50:27.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:50:27.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:50:27.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:50:27.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 3 2020-09-08T15:50:27.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:50:27.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:50:27.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T15:50:27.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:50:27.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/3 2020-09-08T15:50:27.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:50:27.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:50:27.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:50:27.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:50:27.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/3' 2020-09-08T15:50:27.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/3/journal' 2020-09-08T15:50:27.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:50:27.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2020-09-08T15:50:27.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:50:27.736 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:50:27.736 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:50:27.737 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:50:27.737 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:50:27.737 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:50:27.737 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:50:27.737 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:50:27.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:50:27.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:50:27.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:50:27.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:50:27.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:50:27.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:50:27.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:50:27.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:50:27.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:50:27.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:50:27.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:50:27.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/3 2020-09-08T15:50:27.742 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:50:27.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=cff393b0-8080-4db1-8d80-a0db4da494d4 2020-09-08T15:50:27.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 cff393b0-8080-4db1-8d80-a0db4da494d4' 2020-09-08T15:50:27.743 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:50:27.744 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 cff393b0-8080-4db1-8d80-a0db4da494d4 2020-09-08T15:50:27.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBDqFdfhRC2LBAACUk0SkV1XrqE5z7yw8jylA== 2020-09-08T15:50:27.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBDqFdfhRC2LBAACUk0SkV1XrqE5z7yw8jylA=="}' 2020-09-08T15:50:27.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new cff393b0-8080-4db1-8d80-a0db4da494d4 -i td/osd-backfill-recovery-log/3/new.json 2020-09-08T15:50:28.254 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T15:50:28.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/3/new.json 2020-09-08T15:50:28.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBDqFdfhRC2LBAACUk0SkV1XrqE5z7yw8jylA== --osd-uuid cff393b0-8080-4db1-8d80-a0db4da494d4 2020-09-08T15:50:28.291 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:28.296+0000 7f78ef709ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:28.293 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:28.297+0000 7f78ef709ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:28.293 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:28.298+0000 7f78ef709ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:28.294 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:28.299+0000 7f78ef709ec0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2020-09-08T15:50:28.294 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:28.299+0000 7f78ef709ec0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2020-09-08T15:50:28.295 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:28.299+0000 7f78ef709ec0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2020-09-08T15:50:28.345 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:28.350+0000 7f78ef709ec0 -1 bluestore(td/osd-backfill-recovery-log/3) _read_fsid unparsable uuid 2020-09-08T15:50:32.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/3/keyring 2020-09-08T15:50:32.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:50:32.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T15:50:32.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:50:32.572 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T15:50:33.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T15:50:33.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:50:33.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:50:33.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:50:33.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:50:33.096 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T15:50:33.119 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:33.124+0000 7f8c74297ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:33.136 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:33.141+0000 7f8c74297ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:33.138 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:33.142+0000 7f8c74297ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:33.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T15:50:33.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:50:33.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T15:50:33.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:50:33.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:50:33.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:50:33.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:50:33.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:50:33.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T15:50:33.494 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:50:33.658 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:33.662+0000 7f8c74297ec0 -1 Falling back to public interface 2020-09-08T15:50:33.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:50:34.479 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:34.483+0000 7f8c74297ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T15:50:34.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:50:34.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:50:34.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:50:34.884 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:50:34.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:50:34.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T15:50:35.320 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/146488,v1:127.0.0.1:6827/146488] [v2:127.0.0.1:6828/146488,v1:127.0.0.1:6829/146488] exists,up cff393b0-8080-4db1-8d80-a0db4da494d4 2020-09-08T15:50:35.321 INFO:tasks.workunit.client.0.smithi065.stdout:add osd4 618ca5f8-aa3c-4f68-adbd-b564c00eefd2 2020-09-08T15:50:35.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:50:35.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:50:35.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:50:35.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:50:35.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 4 2020-09-08T15:50:35.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:50:35.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:50:35.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=4 2020-09-08T15:50:35.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:50:35.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/4 2020-09-08T15:50:35.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:50:35.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:50:35.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:50:35.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:50:35.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/4' 2020-09-08T15:50:35.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/4/journal' 2020-09-08T15:50:35.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:50:35.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2020-09-08T15:50:35.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:50:35.327 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:50:35.327 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:50:35.327 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:50:35.327 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:50:35.327 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:50:35.328 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:50:35.328 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:50:35.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:50:35.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:50:35.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:50:35.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:50:35.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:50:35.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:50:35.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:50:35.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:50:35.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:50:35.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:50:35.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:50:35.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/4 2020-09-08T15:50:35.331 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:50:35.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=618ca5f8-aa3c-4f68-adbd-b564c00eefd2 2020-09-08T15:50:35.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd4 618ca5f8-aa3c-4f68-adbd-b564c00eefd2' 2020-09-08T15:50:35.332 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:50:35.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBLqFdfO8X9ExAAANbUdt+xvB6lpVD3yrNR0A== 2020-09-08T15:50:35.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBLqFdfO8X9ExAAANbUdt+xvB6lpVD3yrNR0A=="}' 2020-09-08T15:50:35.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 618ca5f8-aa3c-4f68-adbd-b564c00eefd2 -i td/osd-backfill-recovery-log/4/new.json 2020-09-08T15:50:35.885 INFO:tasks.workunit.client.0.smithi065.stdout:4 2020-09-08T15:50:35.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/4/new.json 2020-09-08T15:50:35.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 4 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBLqFdfO8X9ExAAANbUdt+xvB6lpVD3yrNR0A== --osd-uuid 618ca5f8-aa3c-4f68-adbd-b564c00eefd2 2020-09-08T15:50:35.923 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:35.927+0000 7ff1bfdd7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:35.924 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:35.929+0000 7ff1bfdd7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:35.926 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:35.931+0000 7ff1bfdd7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:35.927 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:35.931+0000 7ff1bfdd7ec0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2020-09-08T15:50:35.927 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:35.931+0000 7ff1bfdd7ec0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2020-09-08T15:50:35.927 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:35.931+0000 7ff1bfdd7ec0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2020-09-08T15:50:35.995 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:35.999+0000 7ff1bfdd7ec0 -1 bluestore(td/osd-backfill-recovery-log/4) _read_fsid unparsable uuid 2020-09-08T15:50:40.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/4/keyring 2020-09-08T15:50:40.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:50:40.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd4 key to auth repository 2020-09-08T15:50:40.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:50:40.299 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd4 key to auth repository 2020-09-08T15:50:40.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.4 2020-09-08T15:50:40.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 4 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:50:40.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:50:40.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:50:40.828 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.4 2020-09-08T15:50:40.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:50:40.852 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:40.856+0000 7f0e7cbc0ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:40.860 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:40.865+0000 7f0e7cbc0ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:40.862 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:40.867+0000 7f0e7cbc0ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:41.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 4 2020-09-08T15:50:41.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:50:41.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=4 2020-09-08T15:50:41.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:50:41.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:50:41.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:50:41.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:50:41.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:50:41.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T15:50:41.223 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:50:41.381 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:41.386+0000 7f0e7cbc0ec0 -1 Falling back to public interface 2020-09-08T15:50:41.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:50:42.179 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:42.183+0000 7f0e7cbc0ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-09-08T15:50:42.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:50:42.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:50:42.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:50:42.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:50:42.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T15:50:42.612 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:50:43.031 INFO:tasks.workunit.client.0.smithi065.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/147482,v1:127.0.0.1:6835/147482] [v2:127.0.0.1:6836/147482,v1:127.0.0.1:6837/147482] exists,up 618ca5f8-aa3c-4f68-adbd-b564c00eefd2 2020-09-08T15:50:43.032 INFO:tasks.workunit.client.0.smithi065.stdout:add osd5 6b981ba1-f299-488e-ad7c-df2f3f2a72a8 2020-09-08T15:50:43.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:50:43.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:50:43.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:50:43.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:54: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:50:43.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:56: _common_test: run_osd td/osd-backfill-recovery-log 5 2020-09-08T15:50:43.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-recovery-log 2020-09-08T15:50:43.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:50:43.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=5 2020-09-08T15:50:43.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:50:43.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-recovery-log/5 2020-09-08T15:50:43.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2020-09-08T15:50:43.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:50:43.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:50:43.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:50:43.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/5' 2020-09-08T15:50:43.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/5/journal' 2020-09-08T15:50:43.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:50:43.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2020-09-08T15:50:43.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2020-09-08T15:50:43.039 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:50:43.039 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:50:43.039 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:50:43.039 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:50:43.039 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:50:43.040 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:50:43.040 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:50:43.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' 2020-09-08T15:50:43.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:50:43.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:50:43.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:50:43.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2020-09-08T15:50:43.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2020-09-08T15:50:43.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:50:43.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:50:43.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:50:43.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:50:43.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:50:43.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-recovery-log/5 2020-09-08T15:50:43.044 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:50:43.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=6b981ba1-f299-488e-ad7c-df2f3f2a72a8 2020-09-08T15:50:43.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd5 6b981ba1-f299-488e-ad7c-df2f3f2a72a8' 2020-09-08T15:50:43.045 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:50:43.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBTqFdfBF0JAxAAfEDQ/XMEq07UUlWn1bJx0w== 2020-09-08T15:50:43.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBTqFdfBF0JAxAAfEDQ/XMEq07UUlWn1bJx0w=="}' 2020-09-08T15:50:43.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 6b981ba1-f299-488e-ad7c-df2f3f2a72a8 -i td/osd-backfill-recovery-log/5/new.json 2020-09-08T15:50:43.603 INFO:tasks.workunit.client.0.smithi065.stdout:5 2020-09-08T15:50:43.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-recovery-log/5/new.json 2020-09-08T15:50:43.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 5 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBTqFdfBF0JAxAAfEDQ/XMEq07UUlWn1bJx0w== --osd-uuid 6b981ba1-f299-488e-ad7c-df2f3f2a72a8 2020-09-08T15:50:43.642 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:43.646+0000 7fa9f5cc1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:43.644 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:43.648+0000 7fa9f5cc1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:43.644 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:43.649+0000 7fa9f5cc1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:43.645 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:43.649+0000 7fa9f5cc1ec0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2020-09-08T15:50:43.646 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:43.649+0000 7fa9f5cc1ec0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2020-09-08T15:50:43.646 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:43.649+0000 7fa9f5cc1ec0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2020-09-08T15:50:43.729 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:43.734+0000 7fa9f5cc1ec0 -1 bluestore(td/osd-backfill-recovery-log/5) _read_fsid unparsable uuid 2020-09-08T15:50:48.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-recovery-log/5/keyring 2020-09-08T15:50:48.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:50:48.299 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd5 key to auth repository 2020-09-08T15:50:48.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd5 key to auth repository 2020-09-08T15:50:48.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-recovery-log/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:50:48.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.5 2020-09-08T15:50:48.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 5 --fsid=a9ff3909-c42f-4c3b-a4c1-4e819ac82cc9 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.108735/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:50:48.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:50:48.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:50:48.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:50:48.848 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.5 2020-09-08T15:50:48.862 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:48.864+0000 7fe966136ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:48.872 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:48.876+0000 7fe966136ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:48.873 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:48.878+0000 7fe966136ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:50:49.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 5 2020-09-08T15:50:49.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:50:49.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=5 2020-09-08T15:50:49.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:50:49.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:50:49.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:50:49.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:50:49.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:50:49.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T15:50:49.229 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:50:49.391 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:49.395+0000 7fe966136ec0 -1 Falling back to public interface 2020-09-08T15:50:49.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:50:50.173 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:50:50.177+0000 7fe966136ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-09-08T15:50:50.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:50:50.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:50:50.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:50:50.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:50:50.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T15:50:50.622 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:50:51.049 INFO:tasks.workunit.client.0.smithi065.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/148484,v1:127.0.0.1:6843/148484] [v2:127.0.0.1:6844/148484,v1:127.0.0.1:6845/148484] exists,up 6b981ba1-f299-488e-ad7c-df2f3f2a72a8 2020-09-08T15:50:51.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:50:51.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:50:51.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:50:51.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:59: _common_test: create_pool test 1 1 2020-09-08T15:50:51.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test 1 1 2020-09-08T15:50:51.762 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' already exists 2020-09-08T15:50:51.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:50:52.774 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: seq 1 141 2020-09-08T15:50:52.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:52.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-1 /etc/passwd 2020-09-08T15:50:52.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:52.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-2 /etc/passwd 2020-09-08T15:50:53.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:53.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-3 /etc/passwd 2020-09-08T15:50:53.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:53.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-4 /etc/passwd 2020-09-08T15:50:53.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:53.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-5 /etc/passwd 2020-09-08T15:50:53.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:53.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-6 /etc/passwd 2020-09-08T15:50:53.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:53.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-7 /etc/passwd 2020-09-08T15:50:53.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:53.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-8 /etc/passwd 2020-09-08T15:50:53.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:53.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-9 /etc/passwd 2020-09-08T15:50:54.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:54.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-10 /etc/passwd 2020-09-08T15:50:54.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:54.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-11 /etc/passwd 2020-09-08T15:50:54.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:54.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-12 /etc/passwd 2020-09-08T15:50:54.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:54.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-13 /etc/passwd 2020-09-08T15:50:54.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:54.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-14 /etc/passwd 2020-09-08T15:50:54.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:54.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-15 /etc/passwd 2020-09-08T15:50:54.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:54.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-16 /etc/passwd 2020-09-08T15:50:55.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:55.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-17 /etc/passwd 2020-09-08T15:50:55.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:55.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-18 /etc/passwd 2020-09-08T15:50:55.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:55.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-19 /etc/passwd 2020-09-08T15:50:55.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:55.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-20 /etc/passwd 2020-09-08T15:50:55.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:55.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-21 /etc/passwd 2020-09-08T15:50:55.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:55.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-22 /etc/passwd 2020-09-08T15:50:55.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:55.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-23 /etc/passwd 2020-09-08T15:50:56.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:56.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-24 /etc/passwd 2020-09-08T15:50:56.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:56.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-25 /etc/passwd 2020-09-08T15:50:56.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:56.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-26 /etc/passwd 2020-09-08T15:50:56.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:56.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-27 /etc/passwd 2020-09-08T15:50:56.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:56.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-28 /etc/passwd 2020-09-08T15:50:56.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:56.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-29 /etc/passwd 2020-09-08T15:50:56.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:56.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-30 /etc/passwd 2020-09-08T15:50:57.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:57.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-31 /etc/passwd 2020-09-08T15:50:57.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:57.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-32 /etc/passwd 2020-09-08T15:50:57.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:57.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-33 /etc/passwd 2020-09-08T15:50:57.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:57.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-34 /etc/passwd 2020-09-08T15:50:57.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:57.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-35 /etc/passwd 2020-09-08T15:50:57.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:57.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-36 /etc/passwd 2020-09-08T15:50:57.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:57.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-37 /etc/passwd 2020-09-08T15:50:57.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:57.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-38 /etc/passwd 2020-09-08T15:50:58.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:58.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-39 /etc/passwd 2020-09-08T15:50:58.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:58.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-40 /etc/passwd 2020-09-08T15:50:58.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:58.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-41 /etc/passwd 2020-09-08T15:50:58.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:58.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-42 /etc/passwd 2020-09-08T15:50:58.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:58.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-43 /etc/passwd 2020-09-08T15:50:58.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:58.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-44 /etc/passwd 2020-09-08T15:50:58.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:58.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-45 /etc/passwd 2020-09-08T15:50:59.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:59.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-46 /etc/passwd 2020-09-08T15:50:59.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:59.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-47 /etc/passwd 2020-09-08T15:50:59.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:59.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-48 /etc/passwd 2020-09-08T15:50:59.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:59.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-49 /etc/passwd 2020-09-08T15:50:59.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:59.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-50 /etc/passwd 2020-09-08T15:50:59.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:59.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-51 /etc/passwd 2020-09-08T15:50:59.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:50:59.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-52 /etc/passwd 2020-09-08T15:51:00.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:00.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-53 /etc/passwd 2020-09-08T15:51:00.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:00.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-54 /etc/passwd 2020-09-08T15:51:00.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:00.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-55 /etc/passwd 2020-09-08T15:51:00.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:00.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-56 /etc/passwd 2020-09-08T15:51:00.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:00.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-57 /etc/passwd 2020-09-08T15:51:00.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:00.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-58 /etc/passwd 2020-09-08T15:51:00.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:00.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-59 /etc/passwd 2020-09-08T15:51:01.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:01.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-60 /etc/passwd 2020-09-08T15:51:01.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:01.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-61 /etc/passwd 2020-09-08T15:51:01.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:01.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-62 /etc/passwd 2020-09-08T15:51:01.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:01.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-63 /etc/passwd 2020-09-08T15:51:01.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:01.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-64 /etc/passwd 2020-09-08T15:51:01.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:01.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-65 /etc/passwd 2020-09-08T15:51:01.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:01.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-66 /etc/passwd 2020-09-08T15:51:01.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:01.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-67 /etc/passwd 2020-09-08T15:51:02.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:02.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-68 /etc/passwd 2020-09-08T15:51:02.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:02.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-69 /etc/passwd 2020-09-08T15:51:02.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:02.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-70 /etc/passwd 2020-09-08T15:51:02.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:02.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-71 /etc/passwd 2020-09-08T15:51:02.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:02.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-72 /etc/passwd 2020-09-08T15:51:02.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:02.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-73 /etc/passwd 2020-09-08T15:51:02.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:02.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-74 /etc/passwd 2020-09-08T15:51:03.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:03.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-75 /etc/passwd 2020-09-08T15:51:03.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:03.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-76 /etc/passwd 2020-09-08T15:51:03.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:03.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-77 /etc/passwd 2020-09-08T15:51:03.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:03.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-78 /etc/passwd 2020-09-08T15:51:03.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:03.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-79 /etc/passwd 2020-09-08T15:51:03.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:03.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-80 /etc/passwd 2020-09-08T15:51:03.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:03.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-81 /etc/passwd 2020-09-08T15:51:04.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:04.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-82 /etc/passwd 2020-09-08T15:51:04.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:04.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-83 /etc/passwd 2020-09-08T15:51:04.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:04.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-84 /etc/passwd 2020-09-08T15:51:04.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:04.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-85 /etc/passwd 2020-09-08T15:51:04.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:04.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-86 /etc/passwd 2020-09-08T15:51:04.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:04.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-87 /etc/passwd 2020-09-08T15:51:04.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:04.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-88 /etc/passwd 2020-09-08T15:51:05.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:05.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-89 /etc/passwd 2020-09-08T15:51:05.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:05.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-90 /etc/passwd 2020-09-08T15:51:05.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:05.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-91 /etc/passwd 2020-09-08T15:51:05.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:05.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-92 /etc/passwd 2020-09-08T15:51:05.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:05.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-93 /etc/passwd 2020-09-08T15:51:05.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:05.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-94 /etc/passwd 2020-09-08T15:51:05.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:05.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-95 /etc/passwd 2020-09-08T15:51:06.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:06.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-96 /etc/passwd 2020-09-08T15:51:06.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:06.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-97 /etc/passwd 2020-09-08T15:51:06.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:06.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-98 /etc/passwd 2020-09-08T15:51:06.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:06.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-99 /etc/passwd 2020-09-08T15:51:06.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:06.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-100 /etc/passwd 2020-09-08T15:51:06.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:06.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-101 /etc/passwd 2020-09-08T15:51:06.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:06.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-102 /etc/passwd 2020-09-08T15:51:07.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:07.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-103 /etc/passwd 2020-09-08T15:51:07.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:07.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-104 /etc/passwd 2020-09-08T15:51:07.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:07.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-105 /etc/passwd 2020-09-08T15:51:07.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:07.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-106 /etc/passwd 2020-09-08T15:51:07.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:07.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-107 /etc/passwd 2020-09-08T15:51:07.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:07.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-108 /etc/passwd 2020-09-08T15:51:07.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:07.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-109 /etc/passwd 2020-09-08T15:51:07.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:07.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-110 /etc/passwd 2020-09-08T15:51:08.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:08.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-111 /etc/passwd 2020-09-08T15:51:08.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:08.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-112 /etc/passwd 2020-09-08T15:51:08.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:08.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-113 /etc/passwd 2020-09-08T15:51:08.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:08.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-114 /etc/passwd 2020-09-08T15:51:08.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:08.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-115 /etc/passwd 2020-09-08T15:51:08.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:08.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-116 /etc/passwd 2020-09-08T15:51:08.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:08.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-117 /etc/passwd 2020-09-08T15:51:09.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:09.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-118 /etc/passwd 2020-09-08T15:51:09.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:09.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-119 /etc/passwd 2020-09-08T15:51:09.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:09.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-120 /etc/passwd 2020-09-08T15:51:09.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:09.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-121 /etc/passwd 2020-09-08T15:51:09.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:09.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-122 /etc/passwd 2020-09-08T15:51:09.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:09.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-123 /etc/passwd 2020-09-08T15:51:10.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:10.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-124 /etc/passwd 2020-09-08T15:51:10.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:10.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-125 /etc/passwd 2020-09-08T15:51:10.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:10.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-126 /etc/passwd 2020-09-08T15:51:10.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:10.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-127 /etc/passwd 2020-09-08T15:51:10.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:10.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-128 /etc/passwd 2020-09-08T15:51:10.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:10.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-129 /etc/passwd 2020-09-08T15:51:10.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:10.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-130 /etc/passwd 2020-09-08T15:51:10.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:10.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-131 /etc/passwd 2020-09-08T15:51:11.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:11.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-132 /etc/passwd 2020-09-08T15:51:11.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:11.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-133 /etc/passwd 2020-09-08T15:51:11.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:11.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-134 /etc/passwd 2020-09-08T15:51:11.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:11.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-135 /etc/passwd 2020-09-08T15:51:11.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:11.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-136 /etc/passwd 2020-09-08T15:51:11.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:11.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-137 /etc/passwd 2020-09-08T15:51:11.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:11.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-138 /etc/passwd 2020-09-08T15:51:12.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:12.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-139 /etc/passwd 2020-09-08T15:51:12.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:12.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-140 /etc/passwd 2020-09-08T15:51:12.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:61: _common_test: for j in $(seq 1 $objects) 2020-09-08T15:51:12.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:63: _common_test: rados -p test put obj-141 /etc/passwd 2020-09-08T15:51:12.409 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:67: _common_test: ceph pg dump pgs --format=json 2020-09-08T15:51:12.409 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:67: _common_test: jq '.pg_stats[0].up[]' 2020-09-08T15:51:12.781 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:51:12.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:67: _common_test: ceph osd out 1 0 2 2020-09-08T15:51:13.330 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already out. osd.0 is already out. osd.2 is already out. 2020-09-08T15:51:13.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:68: _common_test: '[' 20 '!=' 0 ']' 2020-09-08T15:51:13.339 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:69: _common_test: seq 1 20 2020-09-08T15:51:13.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:69: _common_test: for j in $(seq 1 $moreobjects) 2020-09-08T15:51:13.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:71: _common_test: rados -p test put obj-more-1 /etc/passwd 2020-09-08T15:51:15.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:69: _common_test: for j in $(seq 1 $moreobjects) 2020-09-08T15:51:15.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:71: _common_test: rados -p test put obj-more-2 /etc/passwd 2020-09-08T15:51:15.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:69: _common_test: for j in $(seq 1 $moreobjects) 2020-09-08T15:51:15.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:71: _common_test: rados -p test put obj-more-3 /etc/passwd 2020-09-08T15:51:16.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:69: _common_test: for j in $(seq 1 $moreobjects) 2020-09-08T15:51:16.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:71: _common_test: rados -p test put obj-more-4 /etc/passwd 2020-09-08T15:51:16.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:69: _common_test: for j in $(seq 1 $moreobjects) 2020-09-08T15:51:16.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:71: _common_test: rados -p test put obj-more-5 /etc/passwd 2020-09-08T15:51:16.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:69: _common_test: for j in $(seq 1 $moreobjects) 2020-09-08T15:51:16.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:71: _common_test: rados -p test put obj-more-6 /etc/passwd 2020-09-08T15:51:16.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:69: _common_test: for j in $(seq 1 $moreobjects) 2020-09-08T15:51:16.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:71: _common_test: rados -p test put obj-more-7 /etc/passwd 2020-09-08T15:51:17.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:69: _common_test: for j in $(seq 1 $moreobjects) 2020-09-08T15:51:17.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:71: _common_test: rados -p test put obj-more-8 /etc/passwd 2020-09-08T15:51:17.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:69: _common_test: for j in $(seq 1 $moreobjects) 2020-09-08T15:51:17.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:71: _common_test: rados -p test put obj-more-9 /etc/passwd 2020-09-08T15:51:17.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:69: _common_test: for j in $(seq 1 $moreobjects) 2020-09-08T15:51:17.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:71: _common_test: rados -p test put obj-more-10 /etc/passwd 2020-09-08T15:51:17.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:69: _common_test: for j in $(seq 1 $moreobjects) 2020-09-08T15:51:17.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:71: _common_test: rados -p test put obj-more-11 /etc/passwd 2020-09-08T15:51:17.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:69: _common_test: for j in $(seq 1 $moreobjects) 2020-09-08T15:51:17.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:71: _common_test: rados -p test put obj-more-12 /etc/passwd 2020-09-08T15:51:18.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:69: _common_test: for j in $(seq 1 $moreobjects) 2020-09-08T15:51:18.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:71: _common_test: rados -p test put obj-more-13 /etc/passwd 2020-09-08T15:51:18.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:69: _common_test: for j in $(seq 1 $moreobjects) 2020-09-08T15:51:18.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:71: _common_test: rados -p test put obj-more-14 /etc/passwd 2020-09-08T15:51:18.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:69: _common_test: for j in $(seq 1 $moreobjects) 2020-09-08T15:51:18.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:71: _common_test: rados -p test put obj-more-15 /etc/passwd 2020-09-08T15:51:18.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:69: _common_test: for j in $(seq 1 $moreobjects) 2020-09-08T15:51:18.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:71: _common_test: rados -p test put obj-more-16 /etc/passwd 2020-09-08T15:51:19.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:69: _common_test: for j in $(seq 1 $moreobjects) 2020-09-08T15:51:19.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:71: _common_test: rados -p test put obj-more-17 /etc/passwd 2020-09-08T15:51:19.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:69: _common_test: for j in $(seq 1 $moreobjects) 2020-09-08T15:51:19.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:71: _common_test: rados -p test put obj-more-18 /etc/passwd 2020-09-08T15:51:19.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:69: _common_test: for j in $(seq 1 $moreobjects) 2020-09-08T15:51:19.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:71: _common_test: rados -p test put obj-more-19 /etc/passwd 2020-09-08T15:51:19.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:69: _common_test: for j in $(seq 1 $moreobjects) 2020-09-08T15:51:19.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:71: _common_test: rados -p test put obj-more-20 /etc/passwd 2020-09-08T15:51:20.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:74: _common_test: sleep 1 2020-09-08T15:51:21.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:75: _common_test: wait_for_clean 2020-09-08T15:51:21.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:51:21.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:51:21.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:51:21.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:51:21.169 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T15:51:21.171 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:51:21.171 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:51:21.171 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:51:21.172 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:51:21.172 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:51:21.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:51:21.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:51:21.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:51:21.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:51:21.277 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:51:21.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:51:21.700 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:51:21.701 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T15:51:21.701 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T15:51:21.701 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T15:51:21.701 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T15:51:21.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:51:21.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:51:21.702 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:51:21.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836496 2020-09-08T15:51:21.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836496 2020-09-08T15:51:21.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836496' 2020-09-08T15:51:21.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:51:21.863 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:51:21.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672976 2020-09-08T15:51:21.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672976 2020-09-08T15:51:21.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836496 1-42949672976' 2020-09-08T15:51:21.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:51:21.993 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:51:22.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509453 2020-09-08T15:51:22.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509453 2020-09-08T15:51:22.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836496 1-42949672976 2-64424509453' 2020-09-08T15:51:22.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:51:22.123 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T15:51:22.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345932 2020-09-08T15:51:22.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345932 2020-09-08T15:51:22.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836496 1-42949672976 2-64424509453 3-85899345932' 2020-09-08T15:51:22.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:51:22.252 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T15:51:22.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182410 2020-09-08T15:51:22.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182410 2020-09-08T15:51:22.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836496 1-42949672976 2-64424509453 3-85899345932 4-107374182410' 2020-09-08T15:51:22.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:51:22.383 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T15:51:22.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018889 2020-09-08T15:51:22.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018889 2020-09-08T15:51:22.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836496 1-42949672976 2-64424509453 3-85899345932 4-107374182410 5-128849018889' 2020-09-08T15:51:22.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:51:22.512 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836496 2020-09-08T15:51:22.512 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:51:22.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:51:22.513 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836496 2020-09-08T15:51:22.513 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:51:22.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836496 2020-09-08T15:51:22.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836496' 2020-09-08T15:51:22.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:51:22.515 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836496 2020-09-08T15:51:22.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836494 -lt 21474836496 2020-09-08T15:51:22.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:51:23.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:51:23.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:51:24.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836496 -lt 21474836496 2020-09-08T15:51:24.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:51:24.309 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672976 2020-09-08T15:51:24.309 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:51:24.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:51:24.310 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672976 2020-09-08T15:51:24.310 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:51:24.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672976 2020-09-08T15:51:24.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672976' 2020-09-08T15:51:24.312 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:51:24.312 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672976 2020-09-08T15:51:24.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672976 -lt 42949672976 2020-09-08T15:51:24.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:51:24.731 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509453 2020-09-08T15:51:24.732 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:51:24.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:51:24.732 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509453 2020-09-08T15:51:24.733 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:51:24.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509453 2020-09-08T15:51:24.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509453' 2020-09-08T15:51:24.734 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:51:24.734 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509453 2020-09-08T15:51:25.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509453 -lt 64424509453 2020-09-08T15:51:25.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:51:25.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345932 2020-09-08T15:51:25.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:51:25.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T15:51:25.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345932 2020-09-08T15:51:25.159 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:51:25.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345932 2020-09-08T15:51:25.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345932' 2020-09-08T15:51:25.159 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T15:51:25.160 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345932 2020-09-08T15:51:25.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345932 -lt 85899345932 2020-09-08T15:51:25.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:51:25.552 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182410 2020-09-08T15:51:25.552 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:51:25.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T15:51:25.553 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182410 2020-09-08T15:51:25.553 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:51:25.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182410 2020-09-08T15:51:25.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182410' 2020-09-08T15:51:25.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T15:51:25.554 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182410 2020-09-08T15:51:25.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182411 -lt 107374182410 2020-09-08T15:51:25.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:51:25.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018889 2020-09-08T15:51:25.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:51:25.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T15:51:25.955 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018889 2020-09-08T15:51:25.955 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:51:25.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018889 2020-09-08T15:51:25.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018889' 2020-09-08T15:51:25.956 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T15:51:25.956 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018889 2020-09-08T15:51:26.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018889 -lt 128849018889 2020-09-08T15:51:26.344 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:51:26.345 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:51:26.345 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:51:26.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T15:51:26.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:51:26.895 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:51:26.896 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:51:26.896 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:51:26.896 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:51:26.896 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:51:26.896 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:51:27.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:51:27.281 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:51:27.281 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:51:27.281 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:51:27.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:51:27.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T15:51:27.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T15:51:27.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T15:51:27.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:51:27.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:51:27.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:51:27.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:51:27.919 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:51:27.920 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:51:27.920 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:51:27.920 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:51:27.920 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:51:27.920 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:51:28.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:51:28.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:51:28.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:51:28.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:51:28.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:51:28.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:51:28.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:51:28.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:51:28.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:51:28.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:51:28.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:51:28.849 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:51:28.849 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:51:29.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=35796 2020-09-08T15:51:29.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 35796 '!=' null 2020-09-08T15:51:29.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:51:29.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:51:29.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:51:29.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:51:29.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:51:29.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:51:29.465 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:51:29.465 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:51:29.465 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:51:29.466 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:51:29.467 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:51:29.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:51:29.843 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:51:29.843 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:51:29.843 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:51:30.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:51:30.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:51:30.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:51:30.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:51:30.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:51:30.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:51:30.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:51:30.366 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:51:30.366 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:51:30.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=35796 2020-09-08T15:51:30.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 35796 '!=' null 2020-09-08T15:51:30.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:51:30.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:51:30.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:51:31.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:51:31.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:51:31.014 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:51:31.014 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:51:31.014 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:51:31.014 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:51:31.015 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:51:31.015 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:51:31.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:51:31.421 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:51:31.421 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:51:31.422 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:51:31.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:51:31.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:51:31.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:51:31.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:51:31.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:51:31.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:51:31.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:51:31.946 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:51:31.946 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:51:32.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=28637 2020-09-08T15:51:32.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 28637 '!=' null 2020-09-08T15:51:32.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:51:32.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:51:32.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:51:32.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:51:32.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:51:32.562 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:51:32.562 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:51:32.562 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:51:32.562 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:51:32.562 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:51:32.563 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:51:32.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:51:32.946 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:51:32.946 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:51:32.947 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:51:33.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:51:33.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:51:33.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:51:33.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:51:33.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:51:33.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:51:33.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:51:33.470 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:51:33.470 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:51:33.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=28637 2020-09-08T15:51:33.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 28637 '!=' null 2020-09-08T15:51:33.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:51:33.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:51:33.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:51:34.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:51:34.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:51:34.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:51:34.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:51:34.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:51:34.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:51:34.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:51:34.089 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:51:34.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:51:34.477 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:51:34.477 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:51:34.478 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:51:34.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:51:34.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:51:34.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:51:34.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:51:34.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:51:34.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:51:34.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:51:34.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:51:34.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:51:35.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=33194 2020-09-08T15:51:35.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 33194 '!=' null 2020-09-08T15:51:35.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:51:35.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:51:35.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:51:35.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:51:35.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:51:35.612 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:51:35.613 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:51:35.613 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:51:35.613 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:51:35.613 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:51:35.613 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:51:35.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:51:35.995 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:51:35.995 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:51:35.995 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:51:36.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:51:36.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:51:36.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:51:36.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:51:36.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:51:36.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:51:36.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:51:36.522 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:51:36.522 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:51:37.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=33194 2020-09-08T15:51:37.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 33194 '!=' null 2020-09-08T15:51:37.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:51:37.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:51:37.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:51:37.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:51:37.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:51:37.141 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:51:37.141 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:51:37.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:51:37.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:51:37.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:51:37.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:51:37.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:51:37.520 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:51:37.520 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:51:37.520 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:51:38.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:51:38.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:51:38.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:51:38.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:51:38.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:51:38.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:51:38.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:51:38.040 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:51:38.040 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:51:38.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29289 2020-09-08T15:51:38.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29289 '!=' null 2020-09-08T15:51:38.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:51:38.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:51:38.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:51:38.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:51:38.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:51:38.695 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:51:38.695 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:51:38.695 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:51:38.696 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:51:38.696 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:51:38.697 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:51:39.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:51:39.076 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:51:39.076 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:51:39.076 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:51:39.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:51:39.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:51:39.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:51:39.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:51:39.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:51:39.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:51:39.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:51:39.618 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:51:39.618 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:51:40.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=44259 2020-09-08T15:51:40.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 44259 '!=' null 2020-09-08T15:51:40.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:51:40.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:51:40.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:51:40.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:51:40.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:51:40.237 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:51:40.237 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:51:40.238 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:51:40.238 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:51:40.238 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:51:40.238 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:51:40.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:51:40.618 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:51:40.619 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:51:40.619 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:51:41.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:51:41.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:51:41.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:51:41.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:51:41.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:51:41.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:51:41.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:51:41.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:51:41.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:51:41.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29940 2020-09-08T15:51:41.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29940 '!=' null 2020-09-08T15:51:41.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:51:41.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:51:41.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:51:41.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:51:41.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:51:41.782 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:51:41.782 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:51:41.782 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:51:41.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:51:41.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:51:41.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:51:42.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:51:42.174 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:51:42.174 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:51:42.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:51:42.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:51:42.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:51:42.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:51:42.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:51:42.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:51:42.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:51:42.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:51:42.694 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:51:42.695 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:51:43.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29940 2020-09-08T15:51:43.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29940 '!=' null 2020-09-08T15:51:43.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:51:43.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:51:43.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:51:43.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:51:43.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:51:43.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:51:43.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:51:43.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:51:43.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:51:43.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:51:43.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:51:43.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:51:43.707 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:51:43.708 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:51:43.708 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:51:44.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:51:44.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:51:44.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:51:44.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:51:44.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:51:44.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:51:44.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:51:44.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:51:44.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:51:44.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29940 2020-09-08T15:51:44.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29940 '!=' null 2020-09-08T15:51:44.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:51:44.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:51:44.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:51:44.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:51:44.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:51:44.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:51:44.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:51:44.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:51:44.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:51:44.848 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:51:44.848 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:51:45.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:51:45.226 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:51:45.226 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:51:45.226 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:51:45.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:51:45.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:51:45.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:51:45.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:51:45.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:51:45.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:51:45.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:51:45.748 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:51:45.748 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:51:46.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=43609 2020-09-08T15:51:46.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 43609 '!=' null 2020-09-08T15:51:46.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:51:46.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:51:46.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:51:46.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:51:46.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:51:46.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:51:46.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:51:46.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:51:46.382 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:51:46.382 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:51:46.382 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:51:46.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:51:46.765 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:51:46.766 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:51:46.766 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:51:47.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:51:47.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:51:47.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:51:47.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:51:47.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:51:47.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:51:47.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:51:47.279 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:51:47.279 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:51:47.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=28638 2020-09-08T15:51:47.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 28638 '!=' null 2020-09-08T15:51:47.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:51:47.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:51:47.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:51:47.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:51:47.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:51:47.902 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:51:47.902 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:51:47.902 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:51:47.903 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:51:47.903 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:51:47.903 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:51:48.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:51:48.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:51:48.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:51:48.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:51:48.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:51:48.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:51:48.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:51:48.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:51:48.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:51:48.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:51:48.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:51:48.845 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:51:48.845 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:51:49.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=39052 2020-09-08T15:51:49.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 39052 '!=' null 2020-09-08T15:51:49.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:51:49.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:51:49.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:51:49.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:51:49.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:51:49.467 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:51:49.467 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:51:49.468 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:51:49.468 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:51:49.468 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:51:49.468 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:51:49.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:51:49.845 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:51:49.845 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:51:49.845 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:51:50.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T15:51:50.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:51:50.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:51:50.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:77: _common_test: flush_pg_stats 2020-09-08T15:51:50.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:51:50.377 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:51:50.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:51:50.767 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:51:50.767 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T15:51:50.767 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T15:51:50.767 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T15:51:50.768 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T15:51:50.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:51:50.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:51:50.768 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:51:50.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836504 2020-09-08T15:51:50.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836504 2020-09-08T15:51:50.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836504' 2020-09-08T15:51:50.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:51:50.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:51:51.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672984 2020-09-08T15:51:51.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672984 2020-09-08T15:51:51.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836504 1-42949672984' 2020-09-08T15:51:51.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:51:51.042 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:51:51.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509461 2020-09-08T15:51:51.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509461 2020-09-08T15:51:51.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836504 1-42949672984 2-64424509461' 2020-09-08T15:51:51.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:51:51.196 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T15:51:51.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345940 2020-09-08T15:51:51.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345940 2020-09-08T15:51:51.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836504 1-42949672984 2-64424509461 3-85899345940' 2020-09-08T15:51:51.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:51:51.325 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T15:51:51.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182418 2020-09-08T15:51:51.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182418 2020-09-08T15:51:51.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836504 1-42949672984 2-64424509461 3-85899345940 4-107374182418' 2020-09-08T15:51:51.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:51:51.454 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T15:51:51.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018897 2020-09-08T15:51:51.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018897 2020-09-08T15:51:51.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836504 1-42949672984 2-64424509461 3-85899345940 4-107374182418 5-128849018897' 2020-09-08T15:51:51.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:51:51.583 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836504 2020-09-08T15:51:51.583 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:51:51.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:51:51.584 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836504 2020-09-08T15:51:51.584 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:51:51.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836504 2020-09-08T15:51:51.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836504' 2020-09-08T15:51:51.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:51:51.586 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836504 2020-09-08T15:51:51.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836504 -lt 21474836504 2020-09-08T15:51:51.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:51:51.979 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672984 2020-09-08T15:51:51.979 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:51:51.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:51:51.980 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672984 2020-09-08T15:51:51.980 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:51:51.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672984 2020-09-08T15:51:51.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672984' 2020-09-08T15:51:51.982 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:51:51.982 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672984 2020-09-08T15:51:52.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672984 -lt 42949672984 2020-09-08T15:51:52.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:51:52.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509461 2020-09-08T15:51:52.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:51:52.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:51:52.382 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509461 2020-09-08T15:51:52.382 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:51:52.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509461 2020-09-08T15:51:52.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509461' 2020-09-08T15:51:52.384 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:51:52.384 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509461 2020-09-08T15:51:52.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509459 -lt 64424509461 2020-09-08T15:51:52.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:51:53.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:51:53.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:51:54.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509461 -lt 64424509461 2020-09-08T15:51:54.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:51:54.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345940 2020-09-08T15:51:54.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:51:54.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T15:51:54.205 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345940 2020-09-08T15:51:54.205 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:51:54.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345940 2020-09-08T15:51:54.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345940' 2020-09-08T15:51:54.206 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345940 2020-09-08T15:51:54.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T15:51:54.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345940 -lt 85899345940 2020-09-08T15:51:54.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:51:54.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182418 2020-09-08T15:51:54.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:51:54.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T15:51:54.603 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182418 2020-09-08T15:51:54.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:51:54.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182418 2020-09-08T15:51:54.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182418' 2020-09-08T15:51:54.605 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T15:51:54.605 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182418 2020-09-08T15:51:55.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182418 -lt 107374182418 2020-09-08T15:51:55.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:51:55.002 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018897 2020-09-08T15:51:55.002 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:51:55.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T15:51:55.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018897 2020-09-08T15:51:55.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:51:55.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018897 2020-09-08T15:51:55.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018897' 2020-09-08T15:51:55.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T15:51:55.004 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018897 2020-09-08T15:51:55.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018897 -lt 128849018897 2020-09-08T15:51:55.424 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:79: _common_test: ceph pg dump pgs --format=json 2020-09-08T15:51:55.424 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:79: _common_test: jq '.pg_stats[0].up_primary' 2020-09-08T15:51:55.807 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:51:55.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:79: _common_test: newprimary=4 2020-09-08T15:51:55.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:80: _common_test: kill_daemons 2020-09-08T15:51:55.818 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:51:55.818 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:51:55.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:51:55.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:51:55.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:51:56.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:51:56.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:82: _common_test: ERRORS=0 2020-09-08T15:51:56.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:83: _common_test: _objectstore_tool_nodown td/osd-backfill-recovery-log 4 --no-mon-config --pgid 1.0 --op log 2020-09-08T15:51:56.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local dir=td/osd-backfill-recovery-log 2020-09-08T15:51:56.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:83: _common_test: tee td/osd-backfill-recovery-log/result.log 2020-09-08T15:51:56.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2020-09-08T15:51:56.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local id=4 2020-09-08T15:51:56.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1198: _objectstore_tool_nodown: shift 2020-09-08T15:51:56.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: _objectstore_tool_nodown: local osd_data=td/osd-backfill-recovery-log/4 2020-09-08T15:51:56.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1202: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-recovery-log/4 --no-mon-config --pgid 1.0 --op log 2020-09-08T15:51:56.935 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T15:51:56.936 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_log_t": { 2020-09-08T15:51:56.936 INFO:tasks.workunit.client.0.smithi065.stdout: "head": "38'161", 2020-09-08T15:51:56.936 INFO:tasks.workunit.client.0.smithi065.stdout: "tail": "34'10", 2020-09-08T15:51:56.936 INFO:tasks.workunit.client.0.smithi065.stdout: "log": [ 2020-09-08T15:51:56.936 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:56.937 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:56.937 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:1e6eca61:::obj-11:head", 2020-09-08T15:51:56.937 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'11", 2020-09-08T15:51:56.937 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:56.938 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4217.0:1", 2020-09-08T15:51:56.938 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:56.938 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:54.288649+0000", 2020-09-08T15:51:56.938 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:56.938 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:56.938 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:56.939 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:56.939 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:56.939 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:56.939 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.939 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:56.940 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:56.940 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:56.940 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:56.940 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:56.940 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:56.941 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.941 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.941 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:56.941 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:56.941 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:56.942 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:18dee445:::obj-12:head", 2020-09-08T15:51:56.943 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'12", 2020-09-08T15:51:56.943 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:56.943 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4220.0:1", 2020-09-08T15:51:56.943 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:56.944 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:54.414375+0000", 2020-09-08T15:51:56.944 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:56.944 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:56.944 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:56.944 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:56.944 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:56.945 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:56.945 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.945 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:56.945 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:56.946 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:56.946 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:56.946 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:56.946 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:56.946 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.947 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.947 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:56.947 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:56.947 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:56.947 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:283c5c90:::obj-13:head", 2020-09-08T15:51:56.947 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'13", 2020-09-08T15:51:56.948 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:56.948 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4223.0:1", 2020-09-08T15:51:56.948 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:56.948 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:54.540713+0000", 2020-09-08T15:51:56.948 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:56.949 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:56.949 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:56.949 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:56.949 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:56.949 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:56.950 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.950 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:56.950 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:56.950 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:56.950 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:56.951 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:56.951 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:56.951 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.951 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.951 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:56.951 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:56.952 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:56.952 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:cc896bf0:::obj-14:head", 2020-09-08T15:51:56.952 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'14", 2020-09-08T15:51:56.954 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:56.955 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4226.0:1", 2020-09-08T15:51:56.955 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:56.955 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:54.675040+0000", 2020-09-08T15:51:56.955 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:56.956 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:56.956 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:56.956 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:56.956 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:56.956 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:56.957 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.957 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:56.957 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:56.957 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:56.957 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:56.958 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:56.958 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:56.958 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.958 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.958 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:56.959 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:56.959 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:56.959 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:a581f807:::obj-15:head", 2020-09-08T15:51:56.959 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'15", 2020-09-08T15:51:56.959 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:56.959 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4229.0:1", 2020-09-08T15:51:56.960 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:56.960 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:54.826823+0000", 2020-09-08T15:51:56.960 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:56.960 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:56.960 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:56.961 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:56.961 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:56.961 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:56.961 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.961 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:56.962 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:56.962 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:56.962 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:56.962 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:56.962 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:56.963 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.963 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.963 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:56.964 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:56.964 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:56.965 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:c902ca7c:::obj-16:head", 2020-09-08T15:51:56.966 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'16", 2020-09-08T15:51:56.966 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:56.966 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4232.0:1", 2020-09-08T15:51:56.967 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:56.967 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:54.961155+0000", 2020-09-08T15:51:56.967 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:56.967 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:56.968 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:56.968 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:56.968 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:56.968 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:56.968 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.969 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:56.969 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:56.969 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:56.969 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:56.969 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:56.970 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:56.970 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.970 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.970 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:56.971 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:56.971 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:56.971 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:655283c8:::obj-17:head", 2020-09-08T15:51:56.971 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'17", 2020-09-08T15:51:56.972 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:56.972 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4235.0:1", 2020-09-08T15:51:56.972 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:56.972 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:55.102394+0000", 2020-09-08T15:51:56.973 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:56.973 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:56.973 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:56.977 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:56.977 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:56.977 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:56.978 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.978 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:56.978 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:56.978 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:56.979 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:56.979 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:56.979 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:56.979 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.979 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.980 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:56.980 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:56.980 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:56.980 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:d759d762:::obj-18:head", 2020-09-08T15:51:56.980 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'18", 2020-09-08T15:51:56.980 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:56.981 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4238.0:1", 2020-09-08T15:51:56.981 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:56.981 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:55.245226+0000", 2020-09-08T15:51:56.981 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:56.981 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:56.982 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:56.982 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:56.982 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:56.982 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:56.983 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.983 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:56.983 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:56.983 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:56.983 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:56.984 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:56.984 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:56.984 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.984 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.984 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:56.984 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:56.985 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:56.985 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:1b934a2d:::obj-19:head", 2020-09-08T15:51:56.985 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'19", 2020-09-08T15:51:56.985 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:56.985 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4241.0:1", 2020-09-08T15:51:56.986 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:56.986 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:55.393329+0000", 2020-09-08T15:51:56.986 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:56.986 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:56.986 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:56.987 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:56.987 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:56.987 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:56.988 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.988 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:56.988 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:56.988 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:56.988 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:56.989 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:56.989 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:56.990 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.990 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.991 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:56.991 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:56.992 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:56.992 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:1d0ea2ca:::obj-20:head", 2020-09-08T15:51:56.992 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'20", 2020-09-08T15:51:56.993 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:56.993 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4244.0:1", 2020-09-08T15:51:56.993 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:56.993 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:55.538343+0000", 2020-09-08T15:51:56.994 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:56.994 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:56.994 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:56.994 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:56.994 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:56.995 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:56.995 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.995 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:56.995 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:56.996 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:56.996 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:56.996 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:56.996 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:56.996 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.997 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:56.997 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:56.998 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:56.998 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:56.998 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:ab396690:::obj-21:head", 2020-09-08T15:51:56.998 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'21", 2020-09-08T15:51:56.998 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:56.999 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4247.0:1", 2020-09-08T15:51:56.999 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:56.999 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:55.681314+0000", 2020-09-08T15:51:56.999 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:56.999 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:56.999 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.000 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.000 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.000 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.000 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.000 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.001 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.001 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.001 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.001 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.001 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.002 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.002 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.002 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.002 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.002 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.002 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:254983db:::obj-22:head", 2020-09-08T15:51:57.003 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'22", 2020-09-08T15:51:57.003 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.003 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4250.0:1", 2020-09-08T15:51:57.003 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.003 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:55.823084+0000", 2020-09-08T15:51:57.004 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.004 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.004 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.004 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.004 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.005 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.005 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.005 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.005 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.005 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.006 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.006 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.006 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.006 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.006 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.006 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.007 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.007 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.008 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:e656299f:::obj-23:head", 2020-09-08T15:51:57.008 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'23", 2020-09-08T15:51:57.008 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.008 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4253.0:1", 2020-09-08T15:51:57.009 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.009 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:55.958086+0000", 2020-09-08T15:51:57.009 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.009 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.010 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.010 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.010 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.010 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.011 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.011 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.011 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.011 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.011 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.012 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.012 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.012 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.012 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.012 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.013 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.013 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.013 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:5cdf412b:::obj-24:head", 2020-09-08T15:51:57.013 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'24", 2020-09-08T15:51:57.013 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.014 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4256.0:1", 2020-09-08T15:51:57.014 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.014 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:56.091660+0000", 2020-09-08T15:51:57.014 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.014 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.014 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.015 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.015 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.015 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.015 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.015 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.016 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.016 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.016 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.016 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.016 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.016 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.017 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.017 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.017 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.017 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.018 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:cacae143:::obj-25:head", 2020-09-08T15:51:57.018 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'25", 2020-09-08T15:51:57.018 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.018 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4259.0:1", 2020-09-08T15:51:57.018 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.019 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:56.266277+0000", 2020-09-08T15:51:57.019 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.019 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.019 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.019 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.020 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.020 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.020 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.020 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.020 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.021 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.021 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.021 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.021 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.021 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.021 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.022 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.022 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.022 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.022 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:34b5bff6:::obj-26:head", 2020-09-08T15:51:57.022 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'26", 2020-09-08T15:51:57.023 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.023 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4262.0:1", 2020-09-08T15:51:57.023 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.023 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:56.401454+0000", 2020-09-08T15:51:57.023 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.023 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.024 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.024 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.024 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.024 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.024 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.025 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.025 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.025 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.025 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.025 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.026 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.026 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.026 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.026 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.026 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.026 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.027 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:a354f8f6:::obj-27:head", 2020-09-08T15:51:57.027 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'27", 2020-09-08T15:51:57.027 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.027 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4265.0:1", 2020-09-08T15:51:57.028 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.028 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:56.543957+0000", 2020-09-08T15:51:57.028 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.028 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.029 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.029 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.029 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.029 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.029 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.030 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.030 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.030 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.030 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.030 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.030 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.031 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.031 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.031 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.031 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.031 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.032 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:7421db49:::obj-28:head", 2020-09-08T15:51:57.032 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'28", 2020-09-08T15:51:57.032 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.032 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4268.0:1", 2020-09-08T15:51:57.032 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.032 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:56.660852+0000", 2020-09-08T15:51:57.033 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.033 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.033 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.033 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.033 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.034 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.034 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.034 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.034 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.034 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.035 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.035 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.035 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.035 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.035 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.035 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.036 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.036 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.036 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:54bc79ba:::obj-29:head", 2020-09-08T15:51:57.036 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'29", 2020-09-08T15:51:57.036 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.037 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4271.0:1", 2020-09-08T15:51:57.037 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.037 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:56.795452+0000", 2020-09-08T15:51:57.037 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.037 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.038 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.038 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.038 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.038 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.039 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.039 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.039 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.039 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.039 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.039 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.040 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.040 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.040 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.040 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.040 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.041 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.041 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:01b15595:::obj-30:head", 2020-09-08T15:51:57.041 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'30", 2020-09-08T15:51:57.041 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.041 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4274.0:1", 2020-09-08T15:51:57.042 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.042 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:56.929565+0000", 2020-09-08T15:51:57.043 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.043 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.043 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.043 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.043 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.044 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.044 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.044 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.044 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.045 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.045 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.045 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.045 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.045 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.046 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.046 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.046 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.046 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.046 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:f9a0a8a2:::obj-31:head", 2020-09-08T15:51:57.046 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'31", 2020-09-08T15:51:57.047 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.047 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4277.0:1", 2020-09-08T15:51:57.047 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.047 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:57.063411+0000", 2020-09-08T15:51:57.047 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.048 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.048 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.048 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.048 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.049 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.049 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.049 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.049 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.049 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.050 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.050 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.050 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.050 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.050 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.051 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.051 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.051 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.051 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:1bf2562f:::obj-32:head", 2020-09-08T15:51:57.051 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'32", 2020-09-08T15:51:57.051 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.052 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4280.0:1", 2020-09-08T15:51:57.052 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.052 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:57.189717+0000", 2020-09-08T15:51:57.052 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.052 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.053 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.053 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.053 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.053 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.053 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.054 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.054 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.054 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.054 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.054 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.055 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.055 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.055 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.055 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.055 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.055 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.056 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:b982ae22:::obj-33:head", 2020-09-08T15:51:57.056 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'33", 2020-09-08T15:51:57.056 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.056 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4283.0:1", 2020-09-08T15:51:57.056 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.057 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:57.332741+0000", 2020-09-08T15:51:57.057 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.057 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.057 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.057 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.058 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.058 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.058 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.059 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.059 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.059 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.059 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.059 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.060 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.060 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.060 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.060 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.060 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.060 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.061 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:1ad9f98e:::obj-34:head", 2020-09-08T15:51:57.061 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'34", 2020-09-08T15:51:57.061 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.061 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4286.0:1", 2020-09-08T15:51:57.061 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.062 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:57.476086+0000", 2020-09-08T15:51:57.062 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.062 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.062 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.062 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.063 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.063 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.063 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.063 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.063 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.063 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.064 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.064 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.064 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.064 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.064 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.065 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.065 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.065 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.065 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:941f43ff:::obj-35:head", 2020-09-08T15:51:57.065 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'35", 2020-09-08T15:51:57.066 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.066 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4289.0:1", 2020-09-08T15:51:57.066 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.067 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:57.599917+0000", 2020-09-08T15:51:57.067 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.067 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.067 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.067 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.068 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.068 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.068 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.068 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.068 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.069 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.069 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.069 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.069 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.070 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.070 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.070 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.070 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.070 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.070 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:24ebabe9:::obj-36:head", 2020-09-08T15:51:57.071 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'36", 2020-09-08T15:51:57.071 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.071 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4292.0:1", 2020-09-08T15:51:57.072 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.072 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:57.725467+0000", 2020-09-08T15:51:57.072 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.072 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.072 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.073 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.073 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.073 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.073 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.073 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.073 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.074 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.074 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.074 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.074 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.074 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.075 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.075 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.075 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.075 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.075 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:5f3a5398:::obj-37:head", 2020-09-08T15:51:57.076 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'37", 2020-09-08T15:51:57.076 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.076 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4295.0:1", 2020-09-08T15:51:57.076 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.076 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:57.860532+0000", 2020-09-08T15:51:57.076 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.077 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.077 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.077 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.077 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.077 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.078 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.078 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.078 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.078 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.079 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.079 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.079 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.079 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.080 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.080 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.080 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.080 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.080 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:c96cb37e:::obj-38:head", 2020-09-08T15:51:57.081 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'38", 2020-09-08T15:51:57.081 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.081 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4298.0:1", 2020-09-08T15:51:57.081 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.081 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:57.994411+0000", 2020-09-08T15:51:57.082 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.082 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.082 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.082 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.082 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.083 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.083 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.083 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.083 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.084 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.084 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.084 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.084 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.084 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.085 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.085 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.085 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.085 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.085 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:69e36996:::obj-39:head", 2020-09-08T15:51:57.086 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'39", 2020-09-08T15:51:57.086 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.086 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4301.0:1", 2020-09-08T15:51:57.086 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.086 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:58.136905+0000", 2020-09-08T15:51:57.087 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.087 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.087 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.087 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.087 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.087 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.088 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.088 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.088 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.088 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.088 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.089 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.089 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.089 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.089 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.090 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.090 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.090 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.090 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:9f75773e:::obj-40:head", 2020-09-08T15:51:57.090 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'40", 2020-09-08T15:51:57.091 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.091 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4304.0:1", 2020-09-08T15:51:57.091 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.091 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:58.270256+0000", 2020-09-08T15:51:57.091 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.092 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.092 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.092 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.092 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.092 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.092 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.093 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.093 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.093 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.093 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.094 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.094 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.094 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.094 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.094 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.095 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.095 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.095 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:2c01cd48:::obj-41:head", 2020-09-08T15:51:57.095 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'41", 2020-09-08T15:51:57.096 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.096 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4307.0:1", 2020-09-08T15:51:57.096 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.096 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:58.395450+0000", 2020-09-08T15:51:57.096 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.097 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.097 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.097 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.097 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.097 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.097 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.098 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.098 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.098 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.098 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.098 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.099 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.099 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.099 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.099 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.100 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.100 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.100 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:5e676e3d:::obj-42:head", 2020-09-08T15:51:57.100 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'42", 2020-09-08T15:51:57.100 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.101 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4310.0:1", 2020-09-08T15:51:57.101 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.101 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:58.538274+0000", 2020-09-08T15:51:57.101 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.101 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.102 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.102 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.102 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.102 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.102 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.102 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.103 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.103 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.103 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.103 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.103 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.104 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.104 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.104 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.104 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.104 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.105 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:1215f697:::obj-43:head", 2020-09-08T15:51:57.105 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'43", 2020-09-08T15:51:57.105 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.105 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4313.0:1", 2020-09-08T15:51:57.105 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.106 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:58.663880+0000", 2020-09-08T15:51:57.106 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.106 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.106 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.106 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.106 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.107 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.107 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.107 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.107 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.107 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.108 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.108 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.108 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.108 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.108 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.109 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.109 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.109 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.109 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:3a0aa357:::obj-44:head", 2020-09-08T15:51:57.109 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'44", 2020-09-08T15:51:57.110 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.110 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4316.0:1", 2020-09-08T15:51:57.110 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.110 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:58.790036+0000", 2020-09-08T15:51:57.111 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.111 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.111 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.111 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.112 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.112 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.112 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.112 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.112 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.113 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.113 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.113 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.113 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.113 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.114 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.114 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.114 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.114 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.114 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:6366950a:::obj-45:head", 2020-09-08T15:51:57.114 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'45", 2020-09-08T15:51:57.115 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.115 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4319.0:1", 2020-09-08T15:51:57.115 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.115 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:58.949892+0000", 2020-09-08T15:51:57.115 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.116 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.116 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.116 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.116 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.116 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.117 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.117 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.117 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.117 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.117 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.117 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.118 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.118 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.118 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.118 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.118 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.119 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.119 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:621cb2b3:::obj-46:head", 2020-09-08T15:51:57.119 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'46", 2020-09-08T15:51:57.119 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.119 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4322.0:1", 2020-09-08T15:51:57.120 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.120 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:59.091168+0000", 2020-09-08T15:51:57.120 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.120 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.121 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.121 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.121 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.121 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.121 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.122 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.122 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.122 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.122 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.122 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.123 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.123 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.123 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.123 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.123 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.124 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.124 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:d83ab3cd:::obj-47:head", 2020-09-08T15:51:57.124 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'47", 2020-09-08T15:51:57.125 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.125 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4325.0:1", 2020-09-08T15:51:57.125 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.125 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:59.243087+0000", 2020-09-08T15:51:57.126 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.126 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.126 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.126 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.127 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.127 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.127 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.127 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.127 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.128 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.128 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.128 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.128 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.128 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.129 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.129 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.129 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.129 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.129 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:3d8e6d4a:::obj-48:head", 2020-09-08T15:51:57.130 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'48", 2020-09-08T15:51:57.130 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.130 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4328.0:1", 2020-09-08T15:51:57.131 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.131 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:59.385419+0000", 2020-09-08T15:51:57.131 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.131 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.131 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.132 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.132 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.132 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.132 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.132 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.132 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.133 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.133 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.133 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.133 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.133 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.134 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.134 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.134 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.134 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.134 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:50b1e2f2:::obj-49:head", 2020-09-08T15:51:57.135 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'49", 2020-09-08T15:51:57.135 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.135 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4331.0:1", 2020-09-08T15:51:57.135 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.135 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:59.528362+0000", 2020-09-08T15:51:57.136 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.136 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.136 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.136 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.136 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.136 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.137 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.137 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.137 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.137 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.137 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.138 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.138 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.138 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.138 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.138 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.139 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.139 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.139 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:c75430e6:::obj-50:head", 2020-09-08T15:51:57.139 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'50", 2020-09-08T15:51:57.139 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.140 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4334.0:1", 2020-09-08T15:51:57.140 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.140 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:59.653970+0000", 2020-09-08T15:51:57.140 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.140 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.141 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.141 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.141 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.142 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.142 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.142 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.142 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.142 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.142 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.143 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.143 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.143 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.143 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.143 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.144 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.144 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.144 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:eaf3ca0a:::obj-51:head", 2020-09-08T15:51:57.144 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'51", 2020-09-08T15:51:57.144 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.144 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4337.0:1", 2020-09-08T15:51:57.145 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.145 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:59.787608+0000", 2020-09-08T15:51:57.145 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.145 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.145 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.146 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.146 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.146 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.146 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.146 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.147 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.147 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.147 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.147 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.147 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.147 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.148 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.148 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.148 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.148 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.148 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:86a15bea:::obj-52:head", 2020-09-08T15:51:57.149 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'52", 2020-09-08T15:51:57.149 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.149 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4340.0:1", 2020-09-08T15:51:57.149 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.149 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:50:59.939797+0000", 2020-09-08T15:51:57.150 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.150 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.150 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.150 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.150 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.150 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.151 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.151 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.151 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.152 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.152 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.152 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.152 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.152 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.153 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.153 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.153 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.153 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.153 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:1df15dae:::obj-53:head", 2020-09-08T15:51:57.154 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'53", 2020-09-08T15:51:57.154 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.154 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4343.0:1", 2020-09-08T15:51:57.154 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.154 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:00.080952+0000", 2020-09-08T15:51:57.155 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.155 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.155 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.155 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.155 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.155 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.156 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.156 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.156 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.156 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.156 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.157 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.157 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.157 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.157 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.157 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.158 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.158 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.158 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:29304dc8:::obj-54:head", 2020-09-08T15:51:57.158 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'54", 2020-09-08T15:51:57.158 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.159 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4346.0:1", 2020-09-08T15:51:57.159 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.159 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:00.215707+0000", 2020-09-08T15:51:57.159 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.159 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.159 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.160 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.160 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.160 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.160 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.160 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.161 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.161 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.161 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.161 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.162 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.162 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.162 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.162 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.163 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.163 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.163 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:de02c26d:::obj-55:head", 2020-09-08T15:51:57.163 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'55", 2020-09-08T15:51:57.163 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.163 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4349.0:1", 2020-09-08T15:51:57.164 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.164 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:00.349433+0000", 2020-09-08T15:51:57.164 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.164 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.164 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.165 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.165 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.165 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.165 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.165 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.165 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.166 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.166 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.166 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.166 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.166 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.167 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.167 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.167 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.167 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.167 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:0d36fc08:::obj-56:head", 2020-09-08T15:51:57.168 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'56", 2020-09-08T15:51:57.168 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.168 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4352.0:1", 2020-09-08T15:51:57.168 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.168 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:00.483541+0000", 2020-09-08T15:51:57.168 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.169 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.169 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.169 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.169 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.169 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.170 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.170 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.170 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.170 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.170 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.171 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.171 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.171 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.171 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.171 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.171 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.172 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.172 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:2b2cbcba:::obj-57:head", 2020-09-08T15:51:57.172 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'57", 2020-09-08T15:51:57.173 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.173 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4355.0:1", 2020-09-08T15:51:57.173 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.173 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:00.609009+0000", 2020-09-08T15:51:57.173 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.174 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.174 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.174 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.174 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.174 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.174 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.175 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.175 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.175 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.175 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.175 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.176 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.176 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.176 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.176 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.176 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.177 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.177 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:838be76e:::obj-58:head", 2020-09-08T15:51:57.177 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'58", 2020-09-08T15:51:57.177 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.177 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4358.0:1", 2020-09-08T15:51:57.178 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.178 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:00.751213+0000", 2020-09-08T15:51:57.178 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.178 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.178 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.179 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.179 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.179 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.179 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.180 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.180 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.180 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.180 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.180 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.181 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.181 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.181 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.181 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.181 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.181 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.182 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:2c66fd6f:::obj-59:head", 2020-09-08T15:51:57.182 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'59", 2020-09-08T15:51:57.182 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.183 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4361.0:1", 2020-09-08T15:51:57.183 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.183 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:00.893729+0000", 2020-09-08T15:51:57.183 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.183 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.184 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.184 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.184 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.184 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.185 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.185 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.185 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.185 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.185 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.185 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.186 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.186 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.186 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.186 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.186 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.187 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.187 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:2b18273b:::obj-60:head", 2020-09-08T15:51:57.187 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'60", 2020-09-08T15:51:57.187 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.187 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4364.0:1", 2020-09-08T15:51:57.188 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.188 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:01.035952+0000", 2020-09-08T15:51:57.188 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.188 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.188 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.188 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.189 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.189 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.189 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.189 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.189 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.190 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.190 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.190 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.190 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.190 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.190 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.191 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.191 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.191 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.191 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:fcfa3cd1:::obj-61:head", 2020-09-08T15:51:57.191 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'61", 2020-09-08T15:51:57.192 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.192 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4367.0:1", 2020-09-08T15:51:57.192 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.192 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:01.178537+0000", 2020-09-08T15:51:57.192 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.193 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.193 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.193 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.193 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.194 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.194 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.194 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.194 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.195 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.195 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.195 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.195 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.195 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.196 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.196 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.196 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.196 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.196 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:16e51a68:::obj-62:head", 2020-09-08T15:51:57.196 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'62", 2020-09-08T15:51:57.197 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.197 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4370.0:1", 2020-09-08T15:51:57.197 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.197 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:01.303659+0000", 2020-09-08T15:51:57.197 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.198 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.198 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.198 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.198 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.198 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.199 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.199 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.199 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.199 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.199 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.199 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.200 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.200 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.200 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.200 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.200 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.201 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.201 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:c15678fc:::obj-63:head", 2020-09-08T15:51:57.201 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'63", 2020-09-08T15:51:57.201 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.201 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4373.0:1", 2020-09-08T15:51:57.201 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.202 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:01.445487+0000", 2020-09-08T15:51:57.202 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.202 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.202 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.202 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.203 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.203 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.203 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.204 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.204 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.204 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.204 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.204 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.204 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.205 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.205 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.205 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.205 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.205 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.206 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:e066252d:::obj-64:head", 2020-09-08T15:51:57.206 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'64", 2020-09-08T15:51:57.206 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.206 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4376.0:1", 2020-09-08T15:51:57.206 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.207 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:01.572990+0000", 2020-09-08T15:51:57.207 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.207 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.207 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.207 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.208 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.208 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.208 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.208 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.208 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.208 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.209 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.209 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.209 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.209 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.209 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.210 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.210 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.210 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.210 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:95a4ceaf:::obj-65:head", 2020-09-08T15:51:57.210 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'65", 2020-09-08T15:51:57.211 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.211 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4379.0:1", 2020-09-08T15:51:57.211 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.211 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:01.715316+0000", 2020-09-08T15:51:57.212 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.212 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.212 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.212 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.212 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.212 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.213 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.213 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.213 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.214 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.214 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.214 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.214 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.219 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.220 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.220 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.220 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.220 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.221 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:6e97b31a:::obj-66:head", 2020-09-08T15:51:57.221 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'66", 2020-09-08T15:51:57.221 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.221 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4382.0:1", 2020-09-08T15:51:57.221 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.221 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:01.857579+0000", 2020-09-08T15:51:57.222 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.222 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.222 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.222 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.222 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.223 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.223 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.223 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.223 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.224 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.224 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.224 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.224 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.224 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.225 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.225 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.225 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.225 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.225 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:ceed8b4e:::obj-67:head", 2020-09-08T15:51:57.226 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'67", 2020-09-08T15:51:57.226 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.226 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4385.0:1", 2020-09-08T15:51:57.226 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.226 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:01.991652+0000", 2020-09-08T15:51:57.227 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.227 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.227 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.227 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.227 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.227 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.228 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.228 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.228 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.228 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.228 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.229 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.229 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.229 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.229 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.229 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.230 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.230 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.230 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:05e2e722:::obj-68:head", 2020-09-08T15:51:57.230 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'68", 2020-09-08T15:51:57.230 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.230 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4388.0:1", 2020-09-08T15:51:57.231 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.231 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:02.109021+0000", 2020-09-08T15:51:57.231 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.231 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.231 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.232 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.232 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.232 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.232 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.232 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.232 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.233 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.233 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.233 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.233 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.233 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.234 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.234 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.234 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.234 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.235 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:c40f7de9:::obj-69:head", 2020-09-08T15:51:57.235 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'69", 2020-09-08T15:51:57.235 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.235 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4391.0:1", 2020-09-08T15:51:57.235 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.236 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:02.243182+0000", 2020-09-08T15:51:57.236 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.236 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.236 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.236 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.237 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.237 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.237 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.237 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.237 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.237 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.238 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.238 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.238 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.238 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.238 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.239 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.239 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.239 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.239 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:7bab3581:::obj-70:head", 2020-09-08T15:51:57.239 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'70", 2020-09-08T15:51:57.239 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.240 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4394.0:1", 2020-09-08T15:51:57.240 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.240 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:02.402513+0000", 2020-09-08T15:51:57.240 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.240 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.241 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.241 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.241 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.241 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.241 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.242 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.242 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.242 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.242 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.242 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.242 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.243 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.243 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.243 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.243 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.243 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.244 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:cb9edc4f:::obj-71:head", 2020-09-08T15:51:57.244 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'71", 2020-09-08T15:51:57.244 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.244 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4397.0:1", 2020-09-08T15:51:57.245 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.245 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:02.536768+0000", 2020-09-08T15:51:57.245 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.245 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.245 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.246 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.246 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.246 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.246 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.246 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.247 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.247 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.247 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.247 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.247 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.247 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.248 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.248 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.248 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.248 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.248 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:88ae729f:::obj-72:head", 2020-09-08T15:51:57.249 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'72", 2020-09-08T15:51:57.249 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.249 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4400.0:1", 2020-09-08T15:51:57.249 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.249 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:02.679010+0000", 2020-09-08T15:51:57.249 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.250 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.250 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.250 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.250 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.250 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.251 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.251 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.251 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.251 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.251 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.251 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.252 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.252 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.252 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.252 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.252 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.253 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.253 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:887b5de4:::obj-73:head", 2020-09-08T15:51:57.253 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'73", 2020-09-08T15:51:57.253 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.253 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4403.0:1", 2020-09-08T15:51:57.254 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.254 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:02.821342+0000", 2020-09-08T15:51:57.254 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.254 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.254 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.255 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.255 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.256 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.256 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.256 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.256 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.256 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.256 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.257 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.257 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.257 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.257 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.257 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.258 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.258 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.258 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:996efeaa:::obj-74:head", 2020-09-08T15:51:57.258 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'74", 2020-09-08T15:51:57.258 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.259 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4406.0:1", 2020-09-08T15:51:57.259 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.259 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:02.971866+0000", 2020-09-08T15:51:57.259 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.259 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.260 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.260 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.260 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.260 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.260 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.261 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.261 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.261 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.261 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.261 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.262 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.262 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.262 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.262 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.262 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.263 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.263 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:942222a0:::obj-75:head", 2020-09-08T15:51:57.263 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'75", 2020-09-08T15:51:57.263 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.263 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4409.0:1", 2020-09-08T15:51:57.263 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.264 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:03.113804+0000", 2020-09-08T15:51:57.264 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.264 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.264 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.264 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.265 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.265 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.265 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.265 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.265 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.266 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.266 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.266 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.266 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.266 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.266 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.267 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.267 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.267 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.267 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:35f0499f:::obj-76:head", 2020-09-08T15:51:57.267 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'76", 2020-09-08T15:51:57.268 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.268 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4412.0:1", 2020-09-08T15:51:57.268 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.268 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:03.249017+0000", 2020-09-08T15:51:57.268 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.269 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.269 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.269 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.269 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.269 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.269 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.270 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.270 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.270 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.270 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.270 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.271 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.271 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.271 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.271 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.271 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.272 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.272 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:15cd38e3:::obj-77:head", 2020-09-08T15:51:57.272 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'77", 2020-09-08T15:51:57.272 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.272 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4415.0:1", 2020-09-08T15:51:57.272 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.273 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:03.399633+0000", 2020-09-08T15:51:57.273 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.273 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.273 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.273 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.274 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.274 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.274 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.274 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.274 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.275 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.275 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.275 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.275 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.275 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.275 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.276 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.276 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.276 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.276 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:7adeb77b:::obj-78:head", 2020-09-08T15:51:57.276 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'78", 2020-09-08T15:51:57.277 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.277 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4418.0:1", 2020-09-08T15:51:57.277 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.277 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:03.534161+0000", 2020-09-08T15:51:57.277 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.278 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.278 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.278 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.278 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.278 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.278 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.279 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.279 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.279 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.279 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.279 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.280 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.280 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.280 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.280 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.280 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.280 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.281 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:c92176ea:::obj-79:head", 2020-09-08T15:51:57.281 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'79", 2020-09-08T15:51:57.281 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.281 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4421.0:1", 2020-09-08T15:51:57.281 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.282 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:03.667665+0000", 2020-09-08T15:51:57.282 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.282 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.282 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.282 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.283 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.283 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.283 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.283 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.283 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.283 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.284 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.284 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.284 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.284 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.284 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.285 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.285 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.285 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.285 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:14abac33:::obj-80:head", 2020-09-08T15:51:57.285 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'80", 2020-09-08T15:51:57.286 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.286 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4424.0:1", 2020-09-08T15:51:57.286 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.286 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:03.801534+0000", 2020-09-08T15:51:57.286 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.286 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.287 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.287 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.287 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.287 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.287 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.288 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.288 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.288 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.288 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.288 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.288 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.289 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.289 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.289 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.289 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.289 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.290 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:ea1005df:::obj-81:head", 2020-09-08T15:51:57.290 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'81", 2020-09-08T15:51:57.290 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.290 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4427.0:1", 2020-09-08T15:51:57.290 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.290 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:03.944365+0000", 2020-09-08T15:51:57.291 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.291 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.291 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.291 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.291 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.292 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.292 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.292 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.292 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.292 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.293 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.293 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.293 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.293 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.293 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.293 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.294 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.294 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.294 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:df18954d:::obj-82:head", 2020-09-08T15:51:57.294 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'82", 2020-09-08T15:51:57.294 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.295 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4430.0:1", 2020-09-08T15:51:57.295 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.295 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:04.078449+0000", 2020-09-08T15:51:57.295 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.295 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.295 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.296 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.296 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.296 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.296 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.296 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.297 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.297 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.297 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.297 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.297 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.298 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.298 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.298 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.298 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.298 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.298 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:cdd3834b:::obj-83:head", 2020-09-08T15:51:57.299 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'83", 2020-09-08T15:51:57.299 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.299 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4433.0:1", 2020-09-08T15:51:57.299 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.299 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:04.204616+0000", 2020-09-08T15:51:57.300 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.300 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.300 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.300 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.300 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.300 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.301 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.301 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.301 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.301 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.301 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.302 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.302 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.302 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.302 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.302 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.303 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.303 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.303 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:dfbf520a:::obj-84:head", 2020-09-08T15:51:57.303 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'84", 2020-09-08T15:51:57.303 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.303 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4436.0:1", 2020-09-08T15:51:57.304 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.304 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:04.338585+0000", 2020-09-08T15:51:57.304 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.304 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.304 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.305 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.305 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.305 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.305 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.305 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.306 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.306 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.306 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.306 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.306 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.306 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.307 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.307 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.307 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.307 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.307 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:1dd3df2f:::obj-85:head", 2020-09-08T15:51:57.308 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'85", 2020-09-08T15:51:57.308 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.308 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4439.0:1", 2020-09-08T15:51:57.308 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.308 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:04.481047+0000", 2020-09-08T15:51:57.308 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.309 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.309 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.309 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.309 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.309 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.310 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.310 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.310 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.310 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.310 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.311 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.311 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.311 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.311 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.311 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.311 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.312 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.312 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:54554b77:::obj-86:head", 2020-09-08T15:51:57.312 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'86", 2020-09-08T15:51:57.312 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.312 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4442.0:1", 2020-09-08T15:51:57.313 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.313 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:04.623480+0000", 2020-09-08T15:51:57.313 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.313 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.313 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.313 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.314 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.314 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.314 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.314 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.314 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.315 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.315 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.315 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.315 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.315 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.316 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.316 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.316 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.316 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.316 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:43a48f98:::obj-87:head", 2020-09-08T15:51:57.316 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'87", 2020-09-08T15:51:57.317 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.317 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4445.0:1", 2020-09-08T15:51:57.317 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.317 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:04.757025+0000", 2020-09-08T15:51:57.317 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.318 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.318 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.318 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.318 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.318 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.318 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.319 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.319 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.319 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.319 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.319 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.320 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.320 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.320 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.320 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.320 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.320 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.321 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:3f7b3ecc:::obj-88:head", 2020-09-08T15:51:57.321 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'88", 2020-09-08T15:51:57.321 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.321 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4448.0:1", 2020-09-08T15:51:57.321 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.322 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:04.917012+0000", 2020-09-08T15:51:57.322 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.322 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.322 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.322 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.323 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.323 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.323 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.323 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.323 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.323 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.324 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.324 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.324 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.324 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.324 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.325 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.325 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.325 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.325 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:d25ef7d2:::obj-89:head", 2020-09-08T15:51:57.325 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'89", 2020-09-08T15:51:57.325 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.326 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4451.0:1", 2020-09-08T15:51:57.326 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.326 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:05.042053+0000", 2020-09-08T15:51:57.326 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.326 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.327 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.327 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.327 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.327 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.327 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.327 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.328 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.328 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.328 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.328 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.328 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.329 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.329 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.329 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.329 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.329 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.329 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:ea27d688:::obj-90:head", 2020-09-08T15:51:57.330 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'90", 2020-09-08T15:51:57.330 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.330 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4454.0:1", 2020-09-08T15:51:57.330 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.330 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:05.192737+0000", 2020-09-08T15:51:57.331 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.331 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.331 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.331 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.331 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.331 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.332 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.332 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.332 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.332 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.332 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.333 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.333 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.333 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.333 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.333 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.334 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.334 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.334 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:088f9d12:::obj-91:head", 2020-09-08T15:51:57.334 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'91", 2020-09-08T15:51:57.334 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.334 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4457.0:1", 2020-09-08T15:51:57.335 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.335 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:05.318506+0000", 2020-09-08T15:51:57.335 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.335 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.335 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.336 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.336 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.336 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.336 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.336 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.336 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.337 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.337 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.337 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.337 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.337 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.338 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.338 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.338 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.338 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.338 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:206f25a5:::obj-92:head", 2020-09-08T15:51:57.338 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'92", 2020-09-08T15:51:57.339 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.339 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4460.0:1", 2020-09-08T15:51:57.339 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.339 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:05.477948+0000", 2020-09-08T15:51:57.339 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.340 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.340 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.340 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.340 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.340 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.341 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.341 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.341 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.341 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.341 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.341 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.342 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.342 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.342 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.342 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.342 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.343 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.343 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:501cca61:::obj-93:head", 2020-09-08T15:51:57.343 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'93", 2020-09-08T15:51:57.343 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.343 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4463.0:1", 2020-09-08T15:51:57.343 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.344 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:05.628746+0000", 2020-09-08T15:51:57.344 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.344 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.344 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.344 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.345 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.345 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.345 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.345 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.345 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.346 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.346 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.346 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.346 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.346 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.346 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.347 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.347 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.347 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.347 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:1ed468c0:::obj-94:head", 2020-09-08T15:51:57.347 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'94", 2020-09-08T15:51:57.348 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.348 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4466.0:1", 2020-09-08T15:51:57.348 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.348 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:05.771087+0000", 2020-09-08T15:51:57.348 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.348 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.349 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.349 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.349 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.349 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.349 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.350 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.350 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.350 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.350 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.350 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.350 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.351 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.351 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.351 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.351 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.351 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.352 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:e8cba918:::obj-95:head", 2020-09-08T15:51:57.352 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'95", 2020-09-08T15:51:57.352 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.352 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4469.0:1", 2020-09-08T15:51:57.352 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.353 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:05.905114+0000", 2020-09-08T15:51:57.353 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.353 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.353 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.353 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.353 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.354 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.354 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.354 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.354 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.354 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.355 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.355 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.355 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.355 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.355 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.356 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.356 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.356 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.356 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:403c3dfc:::obj-96:head", 2020-09-08T15:51:57.356 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'96", 2020-09-08T15:51:57.356 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.357 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4472.0:1", 2020-09-08T15:51:57.357 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.357 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:06.064208+0000", 2020-09-08T15:51:57.357 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.357 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.358 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.358 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.358 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.358 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.358 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.358 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.359 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.359 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.359 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.359 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.359 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.360 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.360 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.360 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.360 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.360 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.360 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:7c2d0cb1:::obj-97:head", 2020-09-08T15:51:57.361 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'97", 2020-09-08T15:51:57.361 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.361 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4475.0:1", 2020-09-08T15:51:57.361 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.361 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:06.214975+0000", 2020-09-08T15:51:57.362 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.362 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.362 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.362 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.362 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.363 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.363 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.363 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.363 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.363 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.363 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.364 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.364 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.364 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.364 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.364 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.365 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.365 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.365 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:6f3e26a7:::obj-98:head", 2020-09-08T15:51:57.365 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'98", 2020-09-08T15:51:57.365 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.365 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4478.0:1", 2020-09-08T15:51:57.366 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.366 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:06.365791+0000", 2020-09-08T15:51:57.366 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.366 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.366 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.367 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.367 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.367 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.367 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.367 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.367 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.368 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.368 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.368 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.368 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.368 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.369 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.369 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.369 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.369 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.369 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:a4b22c6a:::obj-99:head", 2020-09-08T15:51:57.369 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'99", 2020-09-08T15:51:57.370 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.370 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4481.0:1", 2020-09-08T15:51:57.370 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.370 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:06.499020+0000", 2020-09-08T15:51:57.370 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.371 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.371 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.371 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.371 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.371 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.371 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.372 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.372 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.372 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.372 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.372 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.373 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.373 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.373 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.373 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.373 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.374 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.374 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:25c09ea8:::obj-100:head", 2020-09-08T15:51:57.374 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'100", 2020-09-08T15:51:57.374 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.374 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4484.0:1", 2020-09-08T15:51:57.374 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.375 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:06.624948+0000", 2020-09-08T15:51:57.375 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.375 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.375 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.375 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.376 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.376 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.376 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.376 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.376 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.376 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.377 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.377 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.377 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.377 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.377 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.378 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.378 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.378 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.378 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:be8b0193:::obj-101:head", 2020-09-08T15:51:57.378 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'101", 2020-09-08T15:51:57.378 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.379 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4487.0:1", 2020-09-08T15:51:57.379 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.379 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:06.759720+0000", 2020-09-08T15:51:57.379 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.379 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.380 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.380 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.380 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.380 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.380 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.380 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.381 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.381 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.381 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.381 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.381 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.382 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.382 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.382 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.382 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.382 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.383 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:6aa5e219:::obj-102:head", 2020-09-08T15:51:57.383 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'102", 2020-09-08T15:51:57.383 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.383 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4490.0:1", 2020-09-08T15:51:57.383 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.383 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:06.902023+0000", 2020-09-08T15:51:57.384 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.384 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.384 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.384 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.384 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.385 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.385 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.385 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.385 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.385 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.385 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.386 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.386 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.386 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.386 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.386 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.387 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.387 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.387 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:ff8cd32f:::obj-103:head", 2020-09-08T15:51:57.387 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'103", 2020-09-08T15:51:57.387 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.387 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4493.0:1", 2020-09-08T15:51:57.388 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.388 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:07.044619+0000", 2020-09-08T15:51:57.388 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.388 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.388 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.389 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.389 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.389 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.389 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.389 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.390 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.390 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.390 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.390 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.390 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.390 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.391 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.391 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.391 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.391 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.391 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:fcaf5c1c:::obj-104:head", 2020-09-08T15:51:57.392 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'104", 2020-09-08T15:51:57.392 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.392 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4496.0:1", 2020-09-08T15:51:57.392 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.392 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:07.180041+0000", 2020-09-08T15:51:57.392 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.393 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.393 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.393 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.393 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.393 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.394 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.394 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.394 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.394 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.394 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.395 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.395 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.395 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.395 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.395 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.395 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.396 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.396 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:2111aa60:::obj-105:head", 2020-09-08T15:51:57.396 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'105", 2020-09-08T15:51:57.396 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.396 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4499.0:1", 2020-09-08T15:51:57.397 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.397 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:07.312182+0000", 2020-09-08T15:51:57.397 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.397 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.397 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.397 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.398 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.398 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.398 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.398 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.398 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.399 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.399 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.399 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.399 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.399 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.399 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.400 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.400 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.400 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.400 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:9fed4eb7:::obj-106:head", 2020-09-08T15:51:57.400 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'106", 2020-09-08T15:51:57.401 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.401 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4502.0:1", 2020-09-08T15:51:57.401 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.401 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:07.463368+0000", 2020-09-08T15:51:57.401 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.402 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.402 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.402 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.402 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.402 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.402 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.403 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.403 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.403 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.403 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.403 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.404 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.404 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.404 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.404 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.404 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.405 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.405 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:0b0c0bce:::obj-107:head", 2020-09-08T15:51:57.405 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'107", 2020-09-08T15:51:57.405 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.405 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4505.0:1", 2020-09-08T15:51:57.406 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.406 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:07.604641+0000", 2020-09-08T15:51:57.406 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.406 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.406 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.407 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.407 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.407 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.407 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.407 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.407 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.408 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.408 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.408 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.408 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.408 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.409 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.409 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.409 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.409 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.409 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:b7ce613a:::obj-108:head", 2020-09-08T15:51:57.409 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'108", 2020-09-08T15:51:57.410 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.410 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4508.0:1", 2020-09-08T15:51:57.410 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.410 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:07.739162+0000", 2020-09-08T15:51:57.410 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.411 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.411 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.411 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.411 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.411 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.411 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.412 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.412 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.412 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.412 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.412 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.413 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.413 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.413 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.413 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.413 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.413 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.414 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:4f32cd61:::obj-109:head", 2020-09-08T15:51:57.414 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'109", 2020-09-08T15:51:57.414 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.414 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4511.0:1", 2020-09-08T15:51:57.414 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.415 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:07.874016+0000", 2020-09-08T15:51:57.415 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.415 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.415 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.415 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.416 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.416 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.416 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.416 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.416 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.416 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.417 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.417 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.417 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.417 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.417 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.418 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.418 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.423 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.424 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:40f97f88:::obj-110:head", 2020-09-08T15:51:57.424 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'110", 2020-09-08T15:51:57.424 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.424 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4514.0:1", 2020-09-08T15:51:57.424 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.425 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:08.016548+0000", 2020-09-08T15:51:57.425 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.425 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.425 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.425 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.426 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.426 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.426 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.426 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.426 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.427 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.427 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.427 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.427 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.427 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.428 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.428 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.428 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.428 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.428 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:1d8e7a62:::obj-111:head", 2020-09-08T15:51:57.428 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'111", 2020-09-08T15:51:57.429 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.429 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4517.0:1", 2020-09-08T15:51:57.429 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.429 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:08.142586+0000", 2020-09-08T15:51:57.429 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.430 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.430 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.430 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.430 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.430 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.431 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.431 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.431 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.431 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.431 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.431 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.432 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.432 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.432 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.432 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.432 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.433 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.433 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:3a283967:::obj-112:head", 2020-09-08T15:51:57.433 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'112", 2020-09-08T15:51:57.433 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.433 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4520.0:1", 2020-09-08T15:51:57.434 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.434 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:08.284629+0000", 2020-09-08T15:51:57.434 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.434 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.434 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.434 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.435 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.435 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.435 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.435 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.435 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.436 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.436 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.436 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.436 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.436 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.436 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.437 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.437 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.437 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.437 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:2acdc9e7:::obj-113:head", 2020-09-08T15:51:57.437 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'113", 2020-09-08T15:51:57.438 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.438 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4523.0:1", 2020-09-08T15:51:57.438 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.438 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:08.410169+0000", 2020-09-08T15:51:57.438 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.439 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.439 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.439 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.439 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.439 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.439 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.440 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.440 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.440 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.440 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.440 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.441 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.441 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.441 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.441 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.441 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.442 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.442 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:7f18a9ad:::obj-114:head", 2020-09-08T15:51:57.442 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'114", 2020-09-08T15:51:57.442 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.442 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4526.0:1", 2020-09-08T15:51:57.442 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.443 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:08.544795+0000", 2020-09-08T15:51:57.443 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.443 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.443 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.443 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.444 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.444 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.444 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.444 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.444 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.445 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.445 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.445 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.445 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.445 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.445 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.446 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.446 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.446 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.446 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:852b8a34:::obj-115:head", 2020-09-08T15:51:57.446 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'115", 2020-09-08T15:51:57.447 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.447 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4529.0:1", 2020-09-08T15:51:57.447 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.447 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:08.670444+0000", 2020-09-08T15:51:57.447 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.447 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.448 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.448 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.448 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.448 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.448 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.449 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.449 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.449 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.449 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.449 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.449 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.450 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.450 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.450 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.450 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.450 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.451 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:589de4f7:::obj-116:head", 2020-09-08T15:51:57.451 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'116", 2020-09-08T15:51:57.451 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.451 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4532.0:1", 2020-09-08T15:51:57.451 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.452 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:08.803230+0000", 2020-09-08T15:51:57.452 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.452 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.452 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.452 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.452 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.453 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.453 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.453 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.453 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.453 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.454 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.454 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.454 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.454 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.454 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.454 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.455 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.455 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.455 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:14f2571c:::obj-117:head", 2020-09-08T15:51:57.455 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'117", 2020-09-08T15:51:57.455 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.456 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4535.0:1", 2020-09-08T15:51:57.456 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.456 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:08.929061+0000", 2020-09-08T15:51:57.456 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.456 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.457 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.457 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.457 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.457 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.457 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.458 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.458 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.458 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.458 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.458 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.458 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.459 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.459 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.459 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.459 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.459 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.460 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:dd36f0e5:::obj-118:head", 2020-09-08T15:51:57.460 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'118", 2020-09-08T15:51:57.460 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.460 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4538.0:1", 2020-09-08T15:51:57.460 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.460 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:09.256481+0000", 2020-09-08T15:51:57.461 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.461 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.461 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.461 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.461 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.462 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.462 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.462 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.462 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.462 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.462 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.463 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.463 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.463 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.463 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.463 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.464 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.464 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.464 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:0d7fa432:::obj-119:head", 2020-09-08T15:51:57.464 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'119", 2020-09-08T15:51:57.464 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.465 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4541.0:1", 2020-09-08T15:51:57.465 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.465 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:09.390691+0000", 2020-09-08T15:51:57.465 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.465 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.465 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.466 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.466 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.466 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.466 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.466 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.467 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.467 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.467 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.467 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.467 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.468 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.468 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.468 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.468 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.468 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.468 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:295ec31a:::obj-120:head", 2020-09-08T15:51:57.469 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'120", 2020-09-08T15:51:57.469 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.469 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4544.0:1", 2020-09-08T15:51:57.469 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.469 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:09.534391+0000", 2020-09-08T15:51:57.470 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.470 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.470 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.470 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.470 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.471 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.471 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.471 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.471 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.471 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.471 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.472 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.472 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.472 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.472 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.472 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.473 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.473 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.473 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:c2863561:::obj-121:head", 2020-09-08T15:51:57.473 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'121", 2020-09-08T15:51:57.473 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.473 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4547.0:1", 2020-09-08T15:51:57.474 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.474 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:09.666546+0000", 2020-09-08T15:51:57.474 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.474 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.474 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.475 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.475 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.475 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.475 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.475 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.475 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.476 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.476 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.476 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.476 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.476 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.477 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.477 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.477 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.477 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.477 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:0b943493:::obj-122:head", 2020-09-08T15:51:57.478 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'122", 2020-09-08T15:51:57.478 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.478 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4550.0:1", 2020-09-08T15:51:57.478 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.478 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:09.792420+0000", 2020-09-08T15:51:57.478 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.479 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.479 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.479 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.479 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.479 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.480 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.480 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.480 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.480 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.480 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.480 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.481 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.481 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.481 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.481 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.481 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.482 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.482 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:4cfecbf8:::obj-123:head", 2020-09-08T15:51:57.482 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'123", 2020-09-08T15:51:57.482 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.482 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4553.0:1", 2020-09-08T15:51:57.483 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.483 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:09.943619+0000", 2020-09-08T15:51:57.483 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.483 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.483 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.483 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.484 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.484 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.484 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.484 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.484 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.485 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.485 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.485 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.485 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.485 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.486 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.486 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.486 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.486 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.486 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:fd18e511:::obj-124:head", 2020-09-08T15:51:57.486 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'124", 2020-09-08T15:51:57.487 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.487 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4556.0:1", 2020-09-08T15:51:57.487 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.487 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:10.068027+0000", 2020-09-08T15:51:57.487 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.488 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.488 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.488 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.488 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.488 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.488 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.489 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.489 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.489 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.489 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.489 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.490 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.490 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.490 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.490 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.490 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.491 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.491 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:4f299322:::obj-125:head", 2020-09-08T15:51:57.491 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'125", 2020-09-08T15:51:57.491 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.491 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4559.0:1", 2020-09-08T15:51:57.491 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.492 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:10.210585+0000", 2020-09-08T15:51:57.492 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.492 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.492 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.492 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.493 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.493 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.493 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.493 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.493 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.494 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.494 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.494 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.494 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.494 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.494 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.495 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.495 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.495 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.495 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:302ecc7e:::obj-126:head", 2020-09-08T15:51:57.495 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'126", 2020-09-08T15:51:57.496 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.496 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4562.0:1", 2020-09-08T15:51:57.496 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.496 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:10.335611+0000", 2020-09-08T15:51:57.496 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.496 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.497 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.497 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.497 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.497 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.497 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.498 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.498 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.498 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.498 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.498 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.499 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.499 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.499 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.499 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.499 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.499 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.500 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:42feb657:::obj-127:head", 2020-09-08T15:51:57.500 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'127", 2020-09-08T15:51:57.500 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.500 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4565.0:1", 2020-09-08T15:51:57.500 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.501 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:10.472313+0000", 2020-09-08T15:51:57.501 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.501 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.501 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.501 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.501 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.502 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.502 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.502 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.502 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.502 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.503 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.503 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.503 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.503 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.503 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.503 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.504 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.504 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.504 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:5e6b9a81:::obj-128:head", 2020-09-08T15:51:57.504 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'128", 2020-09-08T15:51:57.504 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.505 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4568.0:1", 2020-09-08T15:51:57.505 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.505 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:10.602942+0000", 2020-09-08T15:51:57.505 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.505 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.506 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.506 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.506 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.506 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.506 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.507 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.507 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.507 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.507 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.507 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.507 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.508 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.508 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.508 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.508 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.508 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.509 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:0d242242:::obj-129:head", 2020-09-08T15:51:57.509 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'129", 2020-09-08T15:51:57.509 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.509 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4571.0:1", 2020-09-08T15:51:57.509 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.510 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:10.728308+0000", 2020-09-08T15:51:57.510 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.510 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.510 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.510 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.510 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.511 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.511 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.511 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.511 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.511 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.512 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.512 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.512 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.512 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.512 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.513 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.513 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.513 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.513 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:ed409294:::obj-130:head", 2020-09-08T15:51:57.513 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'130", 2020-09-08T15:51:57.513 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.514 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4574.0:1", 2020-09-08T15:51:57.514 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.514 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:10.862345+0000", 2020-09-08T15:51:57.514 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.514 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.515 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.515 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.515 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.515 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.515 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.515 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.516 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.516 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.516 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.516 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.516 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.517 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.517 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.517 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.517 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.517 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.518 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:720761ff:::obj-131:head", 2020-09-08T15:51:57.518 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'131", 2020-09-08T15:51:57.518 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.518 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4577.0:1", 2020-09-08T15:51:57.518 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.518 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:10.996344+0000", 2020-09-08T15:51:57.519 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.519 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.519 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.519 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.519 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.520 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.520 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.520 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.520 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.520 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.521 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.521 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.521 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.521 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.521 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.521 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.522 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.522 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.522 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:7715ee72:::obj-132:head", 2020-09-08T15:51:57.522 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'132", 2020-09-08T15:51:57.522 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.523 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4580.0:1", 2020-09-08T15:51:57.523 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.523 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:11.122517+0000", 2020-09-08T15:51:57.523 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.523 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.524 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.524 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.524 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.524 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.524 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.524 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.525 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.525 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.525 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.525 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.525 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.526 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.526 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.526 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.526 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.526 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.526 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:580938e3:::obj-133:head", 2020-09-08T15:51:57.527 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'133", 2020-09-08T15:51:57.527 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.527 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4583.0:1", 2020-09-08T15:51:57.527 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.527 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:11.248253+0000", 2020-09-08T15:51:57.528 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.528 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.528 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.528 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.528 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.529 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.529 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.529 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.529 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.529 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.529 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.530 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.530 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.530 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.530 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.530 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.531 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.531 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.531 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:05dc98b5:::obj-134:head", 2020-09-08T15:51:57.531 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'134", 2020-09-08T15:51:57.531 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.531 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4586.0:1", 2020-09-08T15:51:57.532 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.532 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:11.391479+0000", 2020-09-08T15:51:57.532 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.532 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.532 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.533 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.533 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.533 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.533 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.533 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.534 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.534 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.534 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.534 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.534 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.534 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.535 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.535 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.535 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.535 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.535 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:73221e51:::obj-135:head", 2020-09-08T15:51:57.536 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'135", 2020-09-08T15:51:57.536 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.536 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4589.0:1", 2020-09-08T15:51:57.536 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.536 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:11.516648+0000", 2020-09-08T15:51:57.537 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.537 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.537 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.537 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.537 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.537 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.538 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.538 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.538 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.538 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.538 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.539 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.539 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.539 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.539 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.539 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.539 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.540 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.540 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:3a97ede2:::obj-136:head", 2020-09-08T15:51:57.540 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'136", 2020-09-08T15:51:57.540 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.540 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4592.0:1", 2020-09-08T15:51:57.541 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.541 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:11.650472+0000", 2020-09-08T15:51:57.541 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.541 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.541 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.542 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.542 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.542 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.542 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.542 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.542 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.543 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.543 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.543 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.543 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.543 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.544 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.544 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.544 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.544 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.544 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:9e95a205:::obj-137:head", 2020-09-08T15:51:57.544 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'137", 2020-09-08T15:51:57.545 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.545 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4595.0:1", 2020-09-08T15:51:57.545 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.545 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:11.776162+0000", 2020-09-08T15:51:57.545 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.546 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.546 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.546 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.546 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.546 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.546 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.547 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.547 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.547 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.547 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.547 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.548 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.548 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.548 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.548 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.548 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.549 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.549 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:27f846bd:::obj-138:head", 2020-09-08T15:51:57.549 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'138", 2020-09-08T15:51:57.549 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.549 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4598.0:1", 2020-09-08T15:51:57.550 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.550 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:11.909911+0000", 2020-09-08T15:51:57.550 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.550 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.550 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.550 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.551 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.551 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.551 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.551 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.551 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.552 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.552 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.552 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.552 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.552 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.553 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.553 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.553 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.553 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.553 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:bb2f7605:::obj-139:head", 2020-09-08T15:51:57.553 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'139", 2020-09-08T15:51:57.554 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.554 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4601.0:1", 2020-09-08T15:51:57.554 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.554 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:12.052544+0000", 2020-09-08T15:51:57.554 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.555 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.555 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.555 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.555 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.555 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.556 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.556 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.556 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.556 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.556 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.556 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.557 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.557 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.557 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.557 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.557 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.558 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.558 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:27668d5f:::obj-140:head", 2020-09-08T15:51:57.558 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'140", 2020-09-08T15:51:57.558 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.558 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4604.0:1", 2020-09-08T15:51:57.559 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.559 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:12.178806+0000", 2020-09-08T15:51:57.559 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.559 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.559 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.559 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.560 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.560 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.560 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.560 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.560 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.561 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.561 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.561 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.561 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.561 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.562 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.562 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.562 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.562 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.562 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:0d70cb86:::obj-141:head", 2020-09-08T15:51:57.562 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'141", 2020-09-08T15:51:57.563 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.563 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4607.0:1", 2020-09-08T15:51:57.563 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.563 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:12.304142+0000", 2020-09-08T15:51:57.563 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.564 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.564 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.564 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.564 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.564 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.564 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.565 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.565 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.565 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.565 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.565 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.566 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.566 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.566 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.566 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.566 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.567 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.567 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:347b39b5:::obj-more-1:head", 2020-09-08T15:51:57.567 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "38'142", 2020-09-08T15:51:57.567 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.567 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4614.0:1", 2020-09-08T15:51:57.568 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.568 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:13.368323+0000", 2020-09-08T15:51:57.568 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.568 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.568 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.568 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.569 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.569 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.569 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.569 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.569 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.570 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.570 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.570 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.570 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.570 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.571 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.571 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.571 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.571 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.571 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:0c63cc63:::obj-more-2:head", 2020-09-08T15:51:57.571 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "38'143", 2020-09-08T15:51:57.572 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.572 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4617.0:1", 2020-09-08T15:51:57.572 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.572 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:15.672173+0000", 2020-09-08T15:51:57.572 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.573 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.573 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.573 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.573 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.573 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.574 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.574 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.574 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.574 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.574 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.574 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.575 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.575 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.575 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.575 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.575 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.576 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.576 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:3ce69b57:::obj-more-3:head", 2020-09-08T15:51:57.576 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "38'144", 2020-09-08T15:51:57.576 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.576 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4620.0:1", 2020-09-08T15:51:57.576 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.577 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:15.857268+0000", 2020-09-08T15:51:57.577 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.577 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.577 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.577 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.578 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.578 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.578 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.578 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.578 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.578 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.579 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.579 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.579 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.579 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.579 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.580 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.580 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.580 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.580 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:50476200:::obj-more-4:head", 2020-09-08T15:51:57.580 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "38'145", 2020-09-08T15:51:57.581 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.581 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4623.0:1", 2020-09-08T15:51:57.581 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.581 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:16.084193+0000", 2020-09-08T15:51:57.581 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.581 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.582 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.582 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.582 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.582 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.582 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.583 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.583 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.583 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.583 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.583 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.584 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.584 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.584 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.584 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.584 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.584 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.585 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:7a39cfd8:::obj-more-5:head", 2020-09-08T15:51:57.585 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "38'146", 2020-09-08T15:51:57.585 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.585 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4626.0:1", 2020-09-08T15:51:57.585 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.586 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:16.302447+0000", 2020-09-08T15:51:57.586 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.586 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.586 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.586 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.586 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.587 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.587 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.587 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.587 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.587 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.588 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.588 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.588 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.588 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.588 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.589 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.589 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.589 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.589 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:a7159f95:::obj-more-6:head", 2020-09-08T15:51:57.589 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "38'147", 2020-09-08T15:51:57.590 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.590 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4629.0:1", 2020-09-08T15:51:57.590 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.590 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:16.550704+0000", 2020-09-08T15:51:57.590 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.590 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.591 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.591 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.591 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.591 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.591 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.592 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.592 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.592 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.592 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.592 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.592 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.593 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.593 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.593 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.593 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.593 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.594 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:37f29f5f:::obj-more-7:head", 2020-09-08T15:51:57.594 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "38'148", 2020-09-08T15:51:57.594 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.594 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4632.0:1", 2020-09-08T15:51:57.594 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.594 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:16.806041+0000", 2020-09-08T15:51:57.595 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.595 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.595 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.595 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.595 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.596 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.596 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.596 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.596 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.596 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.597 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.597 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.597 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.597 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.597 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.598 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.598 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.598 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.598 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:4e4836c1:::obj-more-8:head", 2020-09-08T15:51:57.598 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "38'149", 2020-09-08T15:51:57.598 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.599 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4635.0:1", 2020-09-08T15:51:57.599 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.599 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:17.040976+0000", 2020-09-08T15:51:57.599 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.599 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.600 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.600 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.600 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.600 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.600 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.600 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.601 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.601 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.601 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.601 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.601 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.602 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.602 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.602 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.602 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.602 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.603 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:d56cad57:::obj-more-9:head", 2020-09-08T15:51:57.603 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "38'150", 2020-09-08T15:51:57.603 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.603 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4638.0:1", 2020-09-08T15:51:57.603 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.603 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:17.309285+0000", 2020-09-08T15:51:57.604 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.604 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.604 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.604 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.604 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.605 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.605 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.605 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.605 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.605 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.606 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.606 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.606 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.606 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.606 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.607 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.607 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.607 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.607 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:96ff4b77:::obj-more-10:head", 2020-09-08T15:51:57.607 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "38'151", 2020-09-08T15:51:57.607 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.608 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4641.0:1", 2020-09-08T15:51:57.608 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.608 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:17.553695+0000", 2020-09-08T15:51:57.608 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.608 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.609 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.609 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.609 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.609 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.609 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.610 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.610 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.610 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.610 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.610 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.610 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.611 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.611 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.611 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.611 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.611 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.612 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:b8937ca5:::obj-more-11:head", 2020-09-08T15:51:57.612 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "38'152", 2020-09-08T15:51:57.612 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.612 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4644.0:1", 2020-09-08T15:51:57.612 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.612 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:17.780232+0000", 2020-09-08T15:51:57.613 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.613 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.613 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.613 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.613 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.614 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.614 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.614 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.614 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.614 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.615 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.615 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.615 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.615 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.615 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.616 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.616 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.616 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.616 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:c949902e:::obj-more-12:head", 2020-09-08T15:51:57.616 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "38'153", 2020-09-08T15:51:57.616 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.617 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4647.0:1", 2020-09-08T15:51:57.617 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.617 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:18.007961+0000", 2020-09-08T15:51:57.617 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.617 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.618 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.618 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.618 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.618 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.618 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.619 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.619 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.619 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.619 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.619 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.619 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.620 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.620 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.620 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.620 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.620 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.621 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:4909985f:::obj-more-13:head", 2020-09-08T15:51:57.621 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "38'154", 2020-09-08T15:51:57.621 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.621 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4650.0:1", 2020-09-08T15:51:57.621 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.621 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:18.235625+0000", 2020-09-08T15:51:57.622 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.622 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.622 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.627 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.628 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.628 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.628 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.628 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.628 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.629 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.629 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.629 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.629 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.629 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.630 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.630 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.630 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.630 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.630 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:acf906ce:::obj-more-14:head", 2020-09-08T15:51:57.630 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "38'155", 2020-09-08T15:51:57.631 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.631 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4653.0:1", 2020-09-08T15:51:57.631 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.631 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:18.453796+0000", 2020-09-08T15:51:57.631 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.632 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.632 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.632 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.632 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.632 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.632 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.633 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.633 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.633 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.633 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.633 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.634 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.634 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.634 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.634 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.634 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.635 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.635 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:44d31ae5:::obj-more-15:head", 2020-09-08T15:51:57.635 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "38'156", 2020-09-08T15:51:57.635 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.635 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4656.0:1", 2020-09-08T15:51:57.635 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.636 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:18.680832+0000", 2020-09-08T15:51:57.636 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.636 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.636 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.636 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.637 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.637 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.637 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.637 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.637 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.638 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.638 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.638 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.638 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.638 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.638 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.639 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.639 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.639 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.639 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:54dfd3e0:::obj-more-16:head", 2020-09-08T15:51:57.639 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "38'157", 2020-09-08T15:51:57.640 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.640 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4659.0:1", 2020-09-08T15:51:57.640 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.640 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:18.899127+0000", 2020-09-08T15:51:57.640 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.640 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.641 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.641 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.641 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.641 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.641 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.642 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.642 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.642 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.642 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.642 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.642 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.643 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.643 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.643 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.643 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.643 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.644 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:6a7dcd50:::obj-more-17:head", 2020-09-08T15:51:57.644 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "38'158", 2020-09-08T15:51:57.644 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.644 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4662.0:1", 2020-09-08T15:51:57.644 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.644 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:19.183026+0000", 2020-09-08T15:51:57.645 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.645 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.645 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.645 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.645 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.646 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.646 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.646 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.646 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.646 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.647 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.647 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.647 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.647 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.647 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.647 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.648 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.648 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.648 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:fb20876f:::obj-more-18:head", 2020-09-08T15:51:57.648 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "38'159", 2020-09-08T15:51:57.648 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.649 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4665.0:1", 2020-09-08T15:51:57.649 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.649 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:19.412935+0000", 2020-09-08T15:51:57.649 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.649 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.649 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.650 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.650 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.650 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.650 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.650 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.651 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.651 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.651 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.651 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.651 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.651 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.652 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.652 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.652 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.652 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.652 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:ed63ae36:::obj-more-19:head", 2020-09-08T15:51:57.653 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "38'160", 2020-09-08T15:51:57.653 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.653 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4668.0:1", 2020-09-08T15:51:57.653 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.653 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:19.644743+0000", 2020-09-08T15:51:57.660 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.661 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.661 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.661 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.661 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.662 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.662 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.662 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.662 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.662 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.663 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.663 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.663 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.663 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.663 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.663 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.664 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.664 INFO:tasks.workunit.client.0.smithi065.stdout: "op": "modify", 2020-09-08T15:51:57.664 INFO:tasks.workunit.client.0.smithi065.stdout: "object": "1:6a8a392a:::obj-more-20:head", 2020-09-08T15:51:57.664 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "38'161", 2020-09-08T15:51:57.664 INFO:tasks.workunit.client.0.smithi065.stdout: "prior_version": "0'0", 2020-09-08T15:51:57.665 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4671.0:1", 2020-09-08T15:51:57.665 INFO:tasks.workunit.client.0.smithi065.stdout: "extra_reqids": [], 2020-09-08T15:51:57.665 INFO:tasks.workunit.client.0.smithi065.stdout: "mtime": "2020-09-08T15:51:19.955261+0000", 2020-09-08T15:51:57.665 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": 0, 2020-09-08T15:51:57.665 INFO:tasks.workunit.client.0.smithi065.stdout: "mod_desc": { 2020-09-08T15:51:57.666 INFO:tasks.workunit.client.0.smithi065.stdout: "object_mod_desc": { 2020-09-08T15:51:57.666 INFO:tasks.workunit.client.0.smithi065.stdout: "can_local_rollback": false, 2020-09-08T15:51:57.666 INFO:tasks.workunit.client.0.smithi065.stdout: "rollback_info_completed": false, 2020-09-08T15:51:57.666 INFO:tasks.workunit.client.0.smithi065.stdout: "ops": [] 2020-09-08T15:51:57.666 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.666 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.667 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_regions": { 2020-09-08T15:51:57.667 INFO:tasks.workunit.client.0.smithi065.stdout: "object_clean_regions": { 2020-09-08T15:51:57.667 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_offsets": "[7811~18446744073709543804]", 2020-09-08T15:51:57.667 INFO:tasks.workunit.client.0.smithi065.stdout: "clean_omap": true, 2020-09-08T15:51:57.667 INFO:tasks.workunit.client.0.smithi065.stdout: "new_object": false 2020-09-08T15:51:57.668 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.668 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.668 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.668 INFO:tasks.workunit.client.0.smithi065.stdout: ], 2020-09-08T15:51:57.668 INFO:tasks.workunit.client.0.smithi065.stdout: "dups": [ 2020-09-08T15:51:57.669 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.669 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4187.0:1", 2020-09-08T15:51:57.669 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'1", 2020-09-08T15:51:57.669 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "1", 2020-09-08T15:51:57.669 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:51:57.669 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.670 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.670 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4190.0:1", 2020-09-08T15:51:57.670 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'2", 2020-09-08T15:51:57.670 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "2", 2020-09-08T15:51:57.670 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:51:57.671 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.671 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.671 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4193.0:1", 2020-09-08T15:51:57.671 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'3", 2020-09-08T15:51:57.671 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "3", 2020-09-08T15:51:57.671 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:51:57.672 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.672 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.672 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4196.0:1", 2020-09-08T15:51:57.672 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'4", 2020-09-08T15:51:57.672 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "4", 2020-09-08T15:51:57.673 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:51:57.673 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.673 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.673 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4199.0:1", 2020-09-08T15:51:57.673 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'5", 2020-09-08T15:51:57.673 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "5", 2020-09-08T15:51:57.674 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:51:57.674 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.674 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.674 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4202.0:1", 2020-09-08T15:51:57.674 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'6", 2020-09-08T15:51:57.675 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "6", 2020-09-08T15:51:57.675 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:51:57.675 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.675 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.675 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4205.0:1", 2020-09-08T15:51:57.676 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'7", 2020-09-08T15:51:57.676 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "7", 2020-09-08T15:51:57.676 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:51:57.676 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.676 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.676 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4208.0:1", 2020-09-08T15:51:57.677 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'8", 2020-09-08T15:51:57.677 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "8", 2020-09-08T15:51:57.677 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:51:57.677 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.677 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.678 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4211.0:1", 2020-09-08T15:51:57.678 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'9", 2020-09-08T15:51:57.678 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "9", 2020-09-08T15:51:57.678 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:51:57.678 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.678 INFO:tasks.workunit.client.0.smithi065.stdout: { 2020-09-08T15:51:57.679 INFO:tasks.workunit.client.0.smithi065.stdout: "reqid": "client.4214.0:1", 2020-09-08T15:51:57.679 INFO:tasks.workunit.client.0.smithi065.stdout: "version": "34'10", 2020-09-08T15:51:57.679 INFO:tasks.workunit.client.0.smithi065.stdout: "user_version": "10", 2020-09-08T15:51:57.679 INFO:tasks.workunit.client.0.smithi065.stdout: "return_code": "0" 2020-09-08T15:51:57.679 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.680 INFO:tasks.workunit.client.0.smithi065.stdout: ] 2020-09-08T15:51:57.680 INFO:tasks.workunit.client.0.smithi065.stdout: }, 2020-09-08T15:51:57.680 INFO:tasks.workunit.client.0.smithi065.stdout: "pg_missing_t": { 2020-09-08T15:51:57.680 INFO:tasks.workunit.client.0.smithi065.stdout: "missing": [], 2020-09-08T15:51:57.680 INFO:tasks.workunit.client.0.smithi065.stdout: "may_include_deletes": true 2020-09-08T15:51:57.680 INFO:tasks.workunit.client.0.smithi065.stdout: } 2020-09-08T15:51:57.681 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T15:51:57.681 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after v 0'0 2020-09-08T15:51:57.681 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'141 2020-09-08T15:51:57.681 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'140 2020-09-08T15:51:57.681 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'139 2020-09-08T15:51:57.682 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'138 2020-09-08T15:51:57.682 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'137 2020-09-08T15:51:57.682 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'136 2020-09-08T15:51:57.682 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'135 2020-09-08T15:51:57.682 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'134 2020-09-08T15:51:57.683 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'133 2020-09-08T15:51:57.683 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'132 2020-09-08T15:51:57.683 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'131 2020-09-08T15:51:57.683 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'130 2020-09-08T15:51:57.683 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'129 2020-09-08T15:51:57.683 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'128 2020-09-08T15:51:57.684 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'127 2020-09-08T15:51:57.684 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'126 2020-09-08T15:51:57.684 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'125 2020-09-08T15:51:57.684 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'124 2020-09-08T15:51:57.684 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'123 2020-09-08T15:51:57.685 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'122 2020-09-08T15:51:57.685 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'121 2020-09-08T15:51:57.685 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'120 2020-09-08T15:51:57.685 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'119 2020-09-08T15:51:57.685 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'118 2020-09-08T15:51:57.686 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'117 2020-09-08T15:51:57.686 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'116 2020-09-08T15:51:57.686 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'115 2020-09-08T15:51:57.686 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'114 2020-09-08T15:51:57.686 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'113 2020-09-08T15:51:57.687 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'112 2020-09-08T15:51:57.687 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'111 2020-09-08T15:51:57.687 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'110 2020-09-08T15:51:57.687 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'109 2020-09-08T15:51:57.687 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'108 2020-09-08T15:51:57.687 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'107 2020-09-08T15:51:57.688 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'106 2020-09-08T15:51:57.688 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'105 2020-09-08T15:51:57.688 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'104 2020-09-08T15:51:57.688 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'103 2020-09-08T15:51:57.688 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'102 2020-09-08T15:51:57.689 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'101 2020-09-08T15:51:57.689 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'100 2020-09-08T15:51:57.689 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'99 2020-09-08T15:51:57.689 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'98 2020-09-08T15:51:57.689 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'97 2020-09-08T15:51:57.690 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'96 2020-09-08T15:51:57.690 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'95 2020-09-08T15:51:57.690 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'94 2020-09-08T15:51:57.690 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'93 2020-09-08T15:51:57.690 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'92 2020-09-08T15:51:57.691 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'91 2020-09-08T15:51:57.691 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'90 2020-09-08T15:51:57.691 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'89 2020-09-08T15:51:57.691 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'88 2020-09-08T15:51:57.691 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'87 2020-09-08T15:51:57.691 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'86 2020-09-08T15:51:57.692 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'85 2020-09-08T15:51:57.692 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'84 2020-09-08T15:51:57.692 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'83 2020-09-08T15:51:57.692 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'82 2020-09-08T15:51:57.692 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'81 2020-09-08T15:51:57.693 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'80 2020-09-08T15:51:57.693 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'79 2020-09-08T15:51:57.693 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'78 2020-09-08T15:51:57.693 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'77 2020-09-08T15:51:57.693 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'76 2020-09-08T15:51:57.694 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'75 2020-09-08T15:51:57.694 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'74 2020-09-08T15:51:57.694 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'73 2020-09-08T15:51:57.694 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'72 2020-09-08T15:51:57.694 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'71 2020-09-08T15:51:57.694 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'70 2020-09-08T15:51:57.695 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'69 2020-09-08T15:51:57.695 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'68 2020-09-08T15:51:57.695 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'67 2020-09-08T15:51:57.695 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'66 2020-09-08T15:51:57.695 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'65 2020-09-08T15:51:57.696 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'64 2020-09-08T15:51:57.696 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'63 2020-09-08T15:51:57.696 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'62 2020-09-08T15:51:57.696 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'61 2020-09-08T15:51:57.696 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'60 2020-09-08T15:51:57.697 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'59 2020-09-08T15:51:57.697 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'58 2020-09-08T15:51:57.697 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'57 2020-09-08T15:51:57.697 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'56 2020-09-08T15:51:57.697 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'55 2020-09-08T15:51:57.697 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'54 2020-09-08T15:51:57.698 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'53 2020-09-08T15:51:57.698 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'52 2020-09-08T15:51:57.698 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'51 2020-09-08T15:51:57.698 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'50 2020-09-08T15:51:57.698 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'49 2020-09-08T15:51:57.699 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'48 2020-09-08T15:51:57.699 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'47 2020-09-08T15:51:57.699 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'46 2020-09-08T15:51:57.699 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'45 2020-09-08T15:51:57.699 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'44 2020-09-08T15:51:57.700 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'43 2020-09-08T15:51:57.700 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'42 2020-09-08T15:51:57.700 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'41 2020-09-08T15:51:57.700 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'40 2020-09-08T15:51:57.700 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'39 2020-09-08T15:51:57.700 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'38 2020-09-08T15:51:57.701 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'37 2020-09-08T15:51:57.701 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'36 2020-09-08T15:51:57.701 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'35 2020-09-08T15:51:57.701 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'34 2020-09-08T15:51:57.701 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'33 2020-09-08T15:51:57.702 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'32 2020-09-08T15:51:57.702 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'31 2020-09-08T15:51:57.702 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'30 2020-09-08T15:51:57.702 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'29 2020-09-08T15:51:57.702 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'28 2020-09-08T15:51:57.703 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'27 2020-09-08T15:51:57.703 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'26 2020-09-08T15:51:57.703 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'25 2020-09-08T15:51:57.703 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'24 2020-09-08T15:51:57.703 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'23 2020-09-08T15:51:57.704 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'22 2020-09-08T15:51:57.704 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'21 2020-09-08T15:51:57.704 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'20 2020-09-08T15:51:57.704 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'19 2020-09-08T15:51:57.704 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'18 2020-09-08T15:51:57.704 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'17 2020-09-08T15:51:57.705 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'16 2020-09-08T15:51:57.705 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'15 2020-09-08T15:51:57.705 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'14 2020-09-08T15:51:57.705 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'13 2020-09-08T15:51:57.705 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'12 2020-09-08T15:51:57.706 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'11 2020-09-08T15:51:57.706 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'10 2020-09-08T15:51:57.706 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'9 2020-09-08T15:51:57.706 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'8 2020-09-08T15:51:57.706 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'7 2020-09-08T15:51:57.707 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'6 2020-09-08T15:51:57.707 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'5 2020-09-08T15:51:57.707 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'4 2020-09-08T15:51:57.707 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'3 2020-09-08T15:51:57.707 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'2 2020-09-08T15:51:57.708 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_after copy log version 34'1 2020-09-08T15:51:57.708 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.343+0000 7f818ee70700 20 copy_up_to/copy_after earliest_dup_version 0 2020-09-08T15:51:57.708 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after v 0'0 2020-09-08T15:51:57.708 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'141 2020-09-08T15:51:57.708 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'140 2020-09-08T15:51:57.708 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'139 2020-09-08T15:51:57.709 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'138 2020-09-08T15:51:57.709 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'137 2020-09-08T15:51:57.709 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'136 2020-09-08T15:51:57.709 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'135 2020-09-08T15:51:57.709 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'134 2020-09-08T15:51:57.710 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'133 2020-09-08T15:51:57.710 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'132 2020-09-08T15:51:57.710 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'131 2020-09-08T15:51:57.710 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'130 2020-09-08T15:51:57.710 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'129 2020-09-08T15:51:57.711 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'128 2020-09-08T15:51:57.711 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'127 2020-09-08T15:51:57.711 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'126 2020-09-08T15:51:57.711 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'125 2020-09-08T15:51:57.711 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'124 2020-09-08T15:51:57.712 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'123 2020-09-08T15:51:57.712 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'122 2020-09-08T15:51:57.712 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'121 2020-09-08T15:51:57.712 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'120 2020-09-08T15:51:57.712 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'119 2020-09-08T15:51:57.712 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'118 2020-09-08T15:51:57.713 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'117 2020-09-08T15:51:57.713 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'116 2020-09-08T15:51:57.713 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'115 2020-09-08T15:51:57.713 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'114 2020-09-08T15:51:57.713 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'113 2020-09-08T15:51:57.714 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'112 2020-09-08T15:51:57.714 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'111 2020-09-08T15:51:57.714 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'110 2020-09-08T15:51:57.714 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'109 2020-09-08T15:51:57.714 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'108 2020-09-08T15:51:57.715 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'107 2020-09-08T15:51:57.715 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'106 2020-09-08T15:51:57.715 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'105 2020-09-08T15:51:57.715 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'104 2020-09-08T15:51:57.715 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'103 2020-09-08T15:51:57.716 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'102 2020-09-08T15:51:57.716 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'101 2020-09-08T15:51:57.716 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'100 2020-09-08T15:51:57.716 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'99 2020-09-08T15:51:57.716 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'98 2020-09-08T15:51:57.716 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'97 2020-09-08T15:51:57.717 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'96 2020-09-08T15:51:57.717 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'95 2020-09-08T15:51:57.717 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'94 2020-09-08T15:51:57.717 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'93 2020-09-08T15:51:57.717 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'92 2020-09-08T15:51:57.718 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'91 2020-09-08T15:51:57.718 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'90 2020-09-08T15:51:57.718 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'89 2020-09-08T15:51:57.718 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'88 2020-09-08T15:51:57.718 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'87 2020-09-08T15:51:57.719 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'86 2020-09-08T15:51:57.719 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'85 2020-09-08T15:51:57.719 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'84 2020-09-08T15:51:57.719 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'83 2020-09-08T15:51:57.719 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'82 2020-09-08T15:51:57.719 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'81 2020-09-08T15:51:57.720 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'80 2020-09-08T15:51:57.720 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'79 2020-09-08T15:51:57.720 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'78 2020-09-08T15:51:57.720 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'77 2020-09-08T15:51:57.720 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'76 2020-09-08T15:51:57.721 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'75 2020-09-08T15:51:57.721 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'74 2020-09-08T15:51:57.721 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'73 2020-09-08T15:51:57.721 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'72 2020-09-08T15:51:57.721 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'71 2020-09-08T15:51:57.722 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'70 2020-09-08T15:51:57.722 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'69 2020-09-08T15:51:57.722 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'68 2020-09-08T15:51:57.722 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'67 2020-09-08T15:51:57.722 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'66 2020-09-08T15:51:57.722 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'65 2020-09-08T15:51:57.723 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'64 2020-09-08T15:51:57.723 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'63 2020-09-08T15:51:57.723 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'62 2020-09-08T15:51:57.723 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'61 2020-09-08T15:51:57.723 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'60 2020-09-08T15:51:57.724 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'59 2020-09-08T15:51:57.724 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'58 2020-09-08T15:51:57.724 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'57 2020-09-08T15:51:57.724 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'56 2020-09-08T15:51:57.724 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'55 2020-09-08T15:51:57.725 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'54 2020-09-08T15:51:57.725 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'53 2020-09-08T15:51:57.725 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'52 2020-09-08T15:51:57.725 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'51 2020-09-08T15:51:57.725 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'50 2020-09-08T15:51:57.725 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'49 2020-09-08T15:51:57.726 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'48 2020-09-08T15:51:57.726 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'47 2020-09-08T15:51:57.726 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'46 2020-09-08T15:51:57.726 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'45 2020-09-08T15:51:57.726 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'44 2020-09-08T15:51:57.727 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'43 2020-09-08T15:51:57.727 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'42 2020-09-08T15:51:57.727 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'41 2020-09-08T15:51:57.727 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'40 2020-09-08T15:51:57.727 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'39 2020-09-08T15:51:57.728 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'38 2020-09-08T15:51:57.728 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'37 2020-09-08T15:51:57.728 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'36 2020-09-08T15:51:57.728 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'35 2020-09-08T15:51:57.728 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'34 2020-09-08T15:51:57.728 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'33 2020-09-08T15:51:57.729 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'32 2020-09-08T15:51:57.729 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'31 2020-09-08T15:51:57.729 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'30 2020-09-08T15:51:57.729 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'29 2020-09-08T15:51:57.729 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'28 2020-09-08T15:51:57.730 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'27 2020-09-08T15:51:57.730 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'26 2020-09-08T15:51:57.730 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'25 2020-09-08T15:51:57.730 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'24 2020-09-08T15:51:57.730 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'23 2020-09-08T15:51:57.731 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'22 2020-09-08T15:51:57.731 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'21 2020-09-08T15:51:57.731 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'20 2020-09-08T15:51:57.731 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'19 2020-09-08T15:51:57.731 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'18 2020-09-08T15:51:57.731 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'17 2020-09-08T15:51:57.732 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'16 2020-09-08T15:51:57.732 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'15 2020-09-08T15:51:57.732 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'14 2020-09-08T15:51:57.732 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'13 2020-09-08T15:51:57.732 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'12 2020-09-08T15:51:57.733 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'11 2020-09-08T15:51:57.733 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'10 2020-09-08T15:51:57.733 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'9 2020-09-08T15:51:57.733 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'8 2020-09-08T15:51:57.733 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'7 2020-09-08T15:51:57.734 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'6 2020-09-08T15:51:57.734 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'5 2020-09-08T15:51:57.734 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'4 2020-09-08T15:51:57.734 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'3 2020-09-08T15:51:57.734 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'2 2020-09-08T15:51:57.735 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'1 2020-09-08T15:51:57.735 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_up_to/copy_after earliest_dup_version 0 2020-09-08T15:51:57.735 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after v 0'0 2020-09-08T15:51:57.735 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'141 2020-09-08T15:51:57.735 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'140 2020-09-08T15:51:57.736 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'139 2020-09-08T15:51:57.736 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'138 2020-09-08T15:51:57.736 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'137 2020-09-08T15:51:57.736 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'136 2020-09-08T15:51:57.736 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'135 2020-09-08T15:51:57.737 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'134 2020-09-08T15:51:57.737 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'133 2020-09-08T15:51:57.737 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'132 2020-09-08T15:51:57.737 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'131 2020-09-08T15:51:57.737 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'130 2020-09-08T15:51:57.737 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'129 2020-09-08T15:51:57.738 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'128 2020-09-08T15:51:57.738 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'127 2020-09-08T15:51:57.738 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'126 2020-09-08T15:51:57.738 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'125 2020-09-08T15:51:57.738 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'124 2020-09-08T15:51:57.739 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'123 2020-09-08T15:51:57.739 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'122 2020-09-08T15:51:57.739 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'121 2020-09-08T15:51:57.739 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'120 2020-09-08T15:51:57.739 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'119 2020-09-08T15:51:57.740 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'118 2020-09-08T15:51:57.740 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'117 2020-09-08T15:51:57.740 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'116 2020-09-08T15:51:57.740 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'115 2020-09-08T15:51:57.740 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'114 2020-09-08T15:51:57.740 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'113 2020-09-08T15:51:57.741 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'112 2020-09-08T15:51:57.741 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'111 2020-09-08T15:51:57.741 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'110 2020-09-08T15:51:57.741 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'109 2020-09-08T15:51:57.741 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'108 2020-09-08T15:51:57.742 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'107 2020-09-08T15:51:57.742 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'106 2020-09-08T15:51:57.742 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'105 2020-09-08T15:51:57.742 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'104 2020-09-08T15:51:57.742 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'103 2020-09-08T15:51:57.743 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'102 2020-09-08T15:51:57.743 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'101 2020-09-08T15:51:57.743 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'100 2020-09-08T15:51:57.743 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'99 2020-09-08T15:51:57.743 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'98 2020-09-08T15:51:57.744 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'97 2020-09-08T15:51:57.744 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'96 2020-09-08T15:51:57.744 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'95 2020-09-08T15:51:57.744 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'94 2020-09-08T15:51:57.744 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'93 2020-09-08T15:51:57.744 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'92 2020-09-08T15:51:57.745 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'91 2020-09-08T15:51:57.745 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'90 2020-09-08T15:51:57.745 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'89 2020-09-08T15:51:57.745 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'88 2020-09-08T15:51:57.745 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'87 2020-09-08T15:51:57.746 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'86 2020-09-08T15:51:57.746 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'85 2020-09-08T15:51:57.746 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'84 2020-09-08T15:51:57.746 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'83 2020-09-08T15:51:57.746 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'82 2020-09-08T15:51:57.747 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'81 2020-09-08T15:51:57.747 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'80 2020-09-08T15:51:57.747 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'79 2020-09-08T15:51:57.747 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'78 2020-09-08T15:51:57.747 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'77 2020-09-08T15:51:57.747 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'76 2020-09-08T15:51:57.748 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'75 2020-09-08T15:51:57.748 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'74 2020-09-08T15:51:57.748 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'73 2020-09-08T15:51:57.748 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'72 2020-09-08T15:51:57.748 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'71 2020-09-08T15:51:57.749 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'70 2020-09-08T15:51:57.749 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'69 2020-09-08T15:51:57.749 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'68 2020-09-08T15:51:57.749 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'67 2020-09-08T15:51:57.749 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'66 2020-09-08T15:51:57.750 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'65 2020-09-08T15:51:57.750 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'64 2020-09-08T15:51:57.750 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'63 2020-09-08T15:51:57.750 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'62 2020-09-08T15:51:57.750 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'61 2020-09-08T15:51:57.750 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'60 2020-09-08T15:51:57.751 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'59 2020-09-08T15:51:57.751 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'58 2020-09-08T15:51:57.751 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'57 2020-09-08T15:51:57.751 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'56 2020-09-08T15:51:57.751 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'55 2020-09-08T15:51:57.752 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'54 2020-09-08T15:51:57.752 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'53 2020-09-08T15:51:57.752 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'52 2020-09-08T15:51:57.752 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'51 2020-09-08T15:51:57.752 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'50 2020-09-08T15:51:57.753 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'49 2020-09-08T15:51:57.753 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'48 2020-09-08T15:51:57.753 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'47 2020-09-08T15:51:57.753 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'46 2020-09-08T15:51:57.753 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'45 2020-09-08T15:51:57.753 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'44 2020-09-08T15:51:57.754 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'43 2020-09-08T15:51:57.754 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'42 2020-09-08T15:51:57.754 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'41 2020-09-08T15:51:57.754 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'40 2020-09-08T15:51:57.754 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'39 2020-09-08T15:51:57.755 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'38 2020-09-08T15:51:57.755 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'37 2020-09-08T15:51:57.755 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'36 2020-09-08T15:51:57.755 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'35 2020-09-08T15:51:57.755 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'34 2020-09-08T15:51:57.756 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'33 2020-09-08T15:51:57.756 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'32 2020-09-08T15:51:57.756 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'31 2020-09-08T15:51:57.756 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'30 2020-09-08T15:51:57.756 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'29 2020-09-08T15:51:57.757 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'28 2020-09-08T15:51:57.757 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'27 2020-09-08T15:51:57.757 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'26 2020-09-08T15:51:57.757 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'25 2020-09-08T15:51:57.757 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'24 2020-09-08T15:51:57.758 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'23 2020-09-08T15:51:57.758 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'22 2020-09-08T15:51:57.758 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'21 2020-09-08T15:51:57.758 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'20 2020-09-08T15:51:57.758 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'19 2020-09-08T15:51:57.758 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'18 2020-09-08T15:51:57.759 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'17 2020-09-08T15:51:57.759 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'16 2020-09-08T15:51:57.759 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'15 2020-09-08T15:51:57.759 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'14 2020-09-08T15:51:57.759 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'13 2020-09-08T15:51:57.760 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'12 2020-09-08T15:51:57.760 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'11 2020-09-08T15:51:57.760 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'10 2020-09-08T15:51:57.760 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'9 2020-09-08T15:51:57.760 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'8 2020-09-08T15:51:57.760 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'7 2020-09-08T15:51:57.761 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'6 2020-09-08T15:51:57.761 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'5 2020-09-08T15:51:57.761 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'4 2020-09-08T15:51:57.761 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'3 2020-09-08T15:51:57.761 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'2 2020-09-08T15:51:57.762 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_after copy log version 34'1 2020-09-08T15:51:57.762 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:14.344+0000 7f818ee70700 20 copy_up_to/copy_after earliest_dup_version 0 2020-09-08T15:51:57.762 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_after v 38'161 2020-09-08T15:51:57.762 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after earliest_dup_version 0 2020-09-08T15:51:57.762 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup version 34'1 2020-09-08T15:51:57.763 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup version 34'2 2020-09-08T15:51:57.763 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup version 34'3 2020-09-08T15:51:57.763 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup version 34'4 2020-09-08T15:51:57.763 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup version 34'5 2020-09-08T15:51:57.763 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup version 34'6 2020-09-08T15:51:57.764 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup version 34'7 2020-09-08T15:51:57.764 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup version 34'8 2020-09-08T15:51:57.764 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup version 34'9 2020-09-08T15:51:57.764 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup version 34'10 2020-09-08T15:51:57.764 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'11 2020-09-08T15:51:57.764 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'12 2020-09-08T15:51:57.765 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'13 2020-09-08T15:51:57.765 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'14 2020-09-08T15:51:57.765 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'15 2020-09-08T15:51:57.765 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'16 2020-09-08T15:51:57.765 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'17 2020-09-08T15:51:57.766 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'18 2020-09-08T15:51:57.766 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'19 2020-09-08T15:51:57.766 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'20 2020-09-08T15:51:57.766 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'21 2020-09-08T15:51:57.766 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'22 2020-09-08T15:51:57.767 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'23 2020-09-08T15:51:57.767 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'24 2020-09-08T15:51:57.767 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'25 2020-09-08T15:51:57.767 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'26 2020-09-08T15:51:57.767 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'27 2020-09-08T15:51:57.768 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'28 2020-09-08T15:51:57.768 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'29 2020-09-08T15:51:57.768 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'30 2020-09-08T15:51:57.768 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'31 2020-09-08T15:51:57.768 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'32 2020-09-08T15:51:57.768 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'33 2020-09-08T15:51:57.769 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'34 2020-09-08T15:51:57.769 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'35 2020-09-08T15:51:57.769 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'36 2020-09-08T15:51:57.769 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'37 2020-09-08T15:51:57.769 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'38 2020-09-08T15:51:57.770 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'39 2020-09-08T15:51:57.770 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'40 2020-09-08T15:51:57.770 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'41 2020-09-08T15:51:57.770 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'42 2020-09-08T15:51:57.770 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'43 2020-09-08T15:51:57.771 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'44 2020-09-08T15:51:57.771 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'45 2020-09-08T15:51:57.771 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'46 2020-09-08T15:51:57.771 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'47 2020-09-08T15:51:57.771 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'48 2020-09-08T15:51:57.772 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'49 2020-09-08T15:51:57.772 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'50 2020-09-08T15:51:57.772 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'51 2020-09-08T15:51:57.772 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'52 2020-09-08T15:51:57.772 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'53 2020-09-08T15:51:57.773 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'54 2020-09-08T15:51:57.773 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'55 2020-09-08T15:51:57.773 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'56 2020-09-08T15:51:57.773 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'57 2020-09-08T15:51:57.773 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'58 2020-09-08T15:51:57.773 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'59 2020-09-08T15:51:57.774 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'60 2020-09-08T15:51:57.774 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'61 2020-09-08T15:51:57.774 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'62 2020-09-08T15:51:57.774 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'63 2020-09-08T15:51:57.774 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'64 2020-09-08T15:51:57.775 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'65 2020-09-08T15:51:57.775 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'66 2020-09-08T15:51:57.775 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'67 2020-09-08T15:51:57.775 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'68 2020-09-08T15:51:57.775 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'69 2020-09-08T15:51:57.776 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'70 2020-09-08T15:51:57.776 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'71 2020-09-08T15:51:57.776 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'72 2020-09-08T15:51:57.776 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'73 2020-09-08T15:51:57.776 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'74 2020-09-08T15:51:57.777 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'75 2020-09-08T15:51:57.777 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'76 2020-09-08T15:51:57.777 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'77 2020-09-08T15:51:57.777 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'78 2020-09-08T15:51:57.777 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'79 2020-09-08T15:51:57.777 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'80 2020-09-08T15:51:57.778 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'81 2020-09-08T15:51:57.778 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'82 2020-09-08T15:51:57.778 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'83 2020-09-08T15:51:57.778 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'84 2020-09-08T15:51:57.778 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'85 2020-09-08T15:51:57.779 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'86 2020-09-08T15:51:57.779 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'87 2020-09-08T15:51:57.779 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'88 2020-09-08T15:51:57.779 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'89 2020-09-08T15:51:57.779 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'90 2020-09-08T15:51:57.780 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'91 2020-09-08T15:51:57.780 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'92 2020-09-08T15:51:57.780 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'93 2020-09-08T15:51:57.780 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'94 2020-09-08T15:51:57.780 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'95 2020-09-08T15:51:57.781 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'96 2020-09-08T15:51:57.781 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'97 2020-09-08T15:51:57.781 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'98 2020-09-08T15:51:57.781 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'99 2020-09-08T15:51:57.781 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'100 2020-09-08T15:51:57.782 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'101 2020-09-08T15:51:57.782 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'102 2020-09-08T15:51:57.782 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'103 2020-09-08T15:51:57.782 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'104 2020-09-08T15:51:57.782 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'105 2020-09-08T15:51:57.782 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'106 2020-09-08T15:51:57.783 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'107 2020-09-08T15:51:57.783 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'108 2020-09-08T15:51:57.783 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'109 2020-09-08T15:51:57.783 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'110 2020-09-08T15:51:57.783 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'111 2020-09-08T15:51:57.784 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'112 2020-09-08T15:51:57.784 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'113 2020-09-08T15:51:57.784 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'114 2020-09-08T15:51:57.784 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'115 2020-09-08T15:51:57.784 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'116 2020-09-08T15:51:57.785 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'117 2020-09-08T15:51:57.785 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'118 2020-09-08T15:51:57.785 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'119 2020-09-08T15:51:57.785 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'120 2020-09-08T15:51:57.785 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'121 2020-09-08T15:51:57.786 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'122 2020-09-08T15:51:57.786 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'123 2020-09-08T15:51:57.786 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'124 2020-09-08T15:51:57.786 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'125 2020-09-08T15:51:57.786 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'126 2020-09-08T15:51:57.787 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'127 2020-09-08T15:51:57.787 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'128 2020-09-08T15:51:57.787 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'129 2020-09-08T15:51:57.787 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'130 2020-09-08T15:51:57.787 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'131 2020-09-08T15:51:57.787 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'132 2020-09-08T15:51:57.788 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'133 2020-09-08T15:51:57.788 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'134 2020-09-08T15:51:57.788 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'135 2020-09-08T15:51:57.788 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'136 2020-09-08T15:51:57.788 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'137 2020-09-08T15:51:57.789 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'138 2020-09-08T15:51:57.789 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'139 2020-09-08T15:51:57.789 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'140 2020-09-08T15:51:57.789 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 34'141 2020-09-08T15:51:57.789 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 38'142 2020-09-08T15:51:57.790 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 38'143 2020-09-08T15:51:57.790 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 38'144 2020-09-08T15:51:57.790 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 38'145 2020-09-08T15:51:57.790 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 38'146 2020-09-08T15:51:57.790 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 38'147 2020-09-08T15:51:57.791 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 38'148 2020-09-08T15:51:57.791 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 38'149 2020-09-08T15:51:57.791 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 38'150 2020-09-08T15:51:57.791 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 38'151 2020-09-08T15:51:57.791 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 38'152 2020-09-08T15:51:57.792 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 38'153 2020-09-08T15:51:57.792 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 38'154 2020-09-08T15:51:57.792 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 38'155 2020-09-08T15:51:57.792 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 38'156 2020-09-08T15:51:57.792 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 38'157 2020-09-08T15:51:57.792 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 38'158 2020-09-08T15:51:57.793 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 38'159 2020-09-08T15:51:57.793 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 38'160 2020-09-08T15:51:57.793 INFO:tasks.workunit.client.0.smithi065.stdout:td/osd-backfill-recovery-log/osd.0.log:2020-09-08T15:51:47.933+0000 7f818ee70700 20 copy_up_to/copy_after copy dup from log version 38'161 2020-09-08T15:51:57.793 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:84: _common_test: jq '.pg_log_t.log | length' td/osd-backfill-recovery-log/result.log 2020-09-08T15:51:57.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:84: _common_test: LOGLEN=151 2020-09-08T15:51:57.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:85: _common_test: '[' 151 '!=' 151 ']' 2020-09-08T15:51:57.794 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:89: _common_test: jq '.pg_log_t.dups | length' td/osd-backfill-recovery-log/result.log 2020-09-08T15:51:57.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:89: _common_test: DUPSLEN=10 2020-09-08T15:51:57.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:90: _common_test: '[' 10 '!=' 10 ']' 2020-09-08T15:51:57.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:94: _common_test: grep 'copy_up_to\|copy_after' td/osd-backfill-recovery-log/osd.0.log td/osd-backfill-recovery-log/osd.1.log td/osd-backfill-recovery-log/osd.2.log td/osd-backfill-recovery-log/osd.3.log td/osd-backfill-recovery-log/osd.4.log td/osd-backfill-recovery-log/osd.5.log 2020-09-08T15:51:57.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:95: _common_test: rm -f td/osd-backfill-recovery-log/result.log 2020-09-08T15:51:57.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:96: _common_test: '[' 0 '!=' 0 ']' 2020-09-08T15:51:57.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh:34: run: teardown td/osd-backfill-recovery-log 2020-09-08T15:51:57.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-recovery-log 2020-09-08T15:51:57.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:51:57.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2020-09-08T15:51:57.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:51:57.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:51:57.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:51:57.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:51:57.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:51:57.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:51:57.797 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:51:57.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:51:57.797 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:51:57.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:51:57.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:51:57.798 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:51:57.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:51:57.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:51:57.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:51:57.799 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:51:57.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:51:57.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:51:57.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-recovery-log 2020-09-08T15:51:57.800 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:51:57.800 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:51:57.800 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:51:57.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.108735 2020-09-08T15:51:57.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:51:57.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:51:57.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2151: main: code=0 2020-09-08T15:51:57.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2155: main: teardown td/osd-backfill-recovery-log 0 2020-09-08T15:51:57.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-recovery-log 2020-09-08T15:51:57.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2020-09-08T15:51:57.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2020-09-08T15:51:57.802 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:51:57.802 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:51:57.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:51:57.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:51:57.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:51:57.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:51:57.803 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:51:57.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:51:57.803 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:51:57.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:51:57.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:51:57.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:51:57.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:51:57.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:51:57.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:51:57.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:51:57.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:51:57.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2020-09-08T15:51:57.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-recovery-log 2020-09-08T15:51:57.805 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:51:57.805 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:51:57.806 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.108735 2020-09-08T15:51:57.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.108735 2020-09-08T15:51:57.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:51:57.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:51:57.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2156: main: return 0 2020-09-08T15:51:57.807 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-09-08T15:51:57.808 INFO:teuthology.orchestra.run.smithi065:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-09-08T15:51:57.852 INFO:tasks.workunit:Running workunit osd/osd-backfill-space.sh... 2020-09-08T15:51:57.853 INFO:teuthology.orchestra.run.smithi065:workunit test osd/osd-backfill-space.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dce4d291bd4243c9802c17d67b85a6da6bbc0f8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh 2020-09-08T15:51:57.914 INFO:tasks.workunit.client.0.smithi065.stderr:stty: 'standard input': Inappropriate ioctl for device 2020-09-08T15:51:57.925 INFO:tasks.workunit.client.0.smithi065.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2020-09-08T15:51:57.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T15:51:57.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T15:51:57.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: export PYTHONWARNINGS=ignore 2020-09-08T15:51:57.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: PYTHONWARNINGS=ignore 2020-09-08T15:51:57.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: export CEPH_CONF=/dev/null 2020-09-08T15:51:57.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: CEPH_CONF=/dev/null 2020-09-08T15:51:57.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2147: main: unset CEPH_ARGS 2020-09-08T15:51:57.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2149: main: local code 2020-09-08T15:51:57.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2150: main: run td/osd-backfill-space 2020-09-08T15:51:57.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:21: run: local dir=td/osd-backfill-space 2020-09-08T15:51:57.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:22: run: shift 2020-09-08T15:51:57.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:24: run: export CEPH_MON=127.0.0.1:7180 2020-09-08T15:51:57.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:24: run: CEPH_MON=127.0.0.1:7180 2020-09-08T15:51:57.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:25: run: export CEPH_ARGS 2020-09-08T15:51:57.928 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:26: run: uuidgen 2020-09-08T15:51:57.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:26: run: CEPH_ARGS+='--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none ' 2020-09-08T15:51:57.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:27: run: CEPH_ARGS+='--mon-host=127.0.0.1:7180 ' 2020-09-08T15:51:57.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:28: run: CEPH_ARGS+='--osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T15:51:57.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:29: run: CEPH_ARGS+='--fake_statfs_for_testing=3686400 ' 2020-09-08T15:51:57.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:30: run: CEPH_ARGS+='--osd_max_backfills=10 ' 2020-09-08T15:51:57.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:31: run: export objects=600 2020-09-08T15:51:57.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:31: run: objects=600 2020-09-08T15:51:57.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:32: run: export poolprefix=test 2020-09-08T15:51:57.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:32: run: poolprefix=test 2020-09-08T15:51:57.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:34: run: set 2020-09-08T15:51:57.933 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:34: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2020-09-08T15:51:57.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:34: run: local 'funcs=TEST_backfill_grow 2020-09-08T15:51:57.933 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_backfill_multi_partial 2020-09-08T15:51:57.933 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_backfill_test_multi 2020-09-08T15:51:57.934 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_backfill_test_sametarget 2020-09-08T15:51:57.934 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_backfill_test_simple 2020-09-08T15:51:57.934 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_ec_backfill_grow 2020-09-08T15:51:57.934 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_ec_backfill_multi 2020-09-08T15:51:57.934 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_ec_backfill_simple' 2020-09-08T15:51:57.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:35: run: for func in $funcs 2020-09-08T15:51:57.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:36: run: setup td/osd-backfill-space 2020-09-08T15:51:57.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-space 2020-09-08T15:51:57.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-space 2020-09-08T15:51:57.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2020-09-08T15:51:57.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:51:57.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2020-09-08T15:51:57.936 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:51:57.936 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:51:57.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:51:57.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:51:57.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:51:57.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:51:57.937 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:51:57.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:51:57.938 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:51:57.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:51:57.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:51:57.938 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:51:57.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:51:57.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:51:57.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:51:57.942 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:51:57.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:51:57.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:51:57.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2020-09-08T15:51:57.943 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:51:57.943 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:51:57.943 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:51:57.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.154687 2020-09-08T15:51:57.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:51:57.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:51:57.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-space 2020-09-08T15:51:57.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T15:51:57.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:51:57.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:51:57.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.154687 2020-09-08T15:51:57.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T15:51:57.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2020-09-08T15:51:57.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2020-09-08T15:51:57.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T15:51:57.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2020-09-08T15:51:57.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:37: run: TEST_backfill_grow td/osd-backfill-space 2020-09-08T15:51:57.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:557: TEST_backfill_grow: local dir=td/osd-backfill-space 2020-09-08T15:51:57.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:558: TEST_backfill_grow: local poolname=test 2020-09-08T15:51:57.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:559: TEST_backfill_grow: local OSDS=3 2020-09-08T15:51:57.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:561: TEST_backfill_grow: run_mon td/osd-backfill-space a 2020-09-08T15:51:57.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-space 2020-09-08T15:51:57.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T15:51:57.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T15:51:57.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T15:51:57.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-space/a 2020-09-08T15:51:57.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2020-09-08T15:51:58.217 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T15:51:58.217 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:51:58.218 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:51:58.218 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:51:58.218 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:51:58.218 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:51:58.218 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:51:58.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T15:51:58.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T15:51:58.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T15:51:58.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:51:58.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:51:58.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T15:51:58.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T15:51:58.405 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:51:58.405 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:51:58.405 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:51:58.405 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:51:58.405 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:51:58.406 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:51:58.406 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.154687/ceph-mon.a.asok 2020-09-08T15:51:58.406 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:51:58.406 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.154687/ceph-mon.a.asok config get fsid 2020-09-08T15:51:58.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T15:51:58.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:51:58.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:51:58.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T15:51:58.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T15:51:58.500 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:51:58.500 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:51:58.500 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:51:58.501 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:51:58.501 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:51:58.501 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:51:58.501 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.154687/ceph-mon.a.asok 2020-09-08T15:51:58.501 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:51:58.502 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.154687/ceph-mon.a.asok config get mon_host 2020-09-08T15:51:58.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:562: TEST_backfill_grow: run_mgr td/osd-backfill-space x 2020-09-08T15:51:58.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-space 2020-09-08T15:51:58.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T15:51:58.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T15:51:58.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T15:51:58.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-space/x 2020-09-08T15:51:58.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T15:51:59.489 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T15:51:59.489 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:51:59.489 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:51:59.490 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:51:59.490 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:51:59.490 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:51:59.490 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:51:59.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:51:59.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:51:59.515 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:564: TEST_backfill_grow: expr 3 - 1 2020-09-08T15:51:59.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:564: TEST_backfill_grow: seq 0 2 2020-09-08T15:51:59.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:564: TEST_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:51:59.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:566: TEST_backfill_grow: run_osd td/osd-backfill-space 0 2020-09-08T15:51:59.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T15:51:59.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:51:59.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T15:51:59.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:51:59.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/0 2020-09-08T15:51:59.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T15:51:59.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:51:59.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:51:59.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:51:59.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2020-09-08T15:51:59.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2020-09-08T15:51:59.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:51:59.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:51:59.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T15:51:59.522 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:51:59.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:51:59.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:51:59.523 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:51:59.523 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:51:59.523 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:51:59.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:51:59.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:51:59.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:51:59.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:51:59.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:51:59.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T15:51:59.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T15:51:59.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:51:59.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:51:59.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:51:59.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:51:59.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:51:59.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/0 2020-09-08T15:51:59.527 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:51:59.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=aea888d2-59e2-4900-9f13-406739c06961 2020-09-08T15:51:59.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 aea888d2-59e2-4900-9f13-406739c06961' 2020-09-08T15:51:59.530 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:51:59.530 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 aea888d2-59e2-4900-9f13-406739c06961 2020-09-08T15:51:59.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCfqFdfvi8FIRAAjC7XXCJ5/2EJax2ncck+yA== 2020-09-08T15:51:59.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCfqFdfvi8FIRAAjC7XXCJ5/2EJax2ncck+yA=="}' 2020-09-08T15:51:59.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new aea888d2-59e2-4900-9f13-406739c06961 -i td/osd-backfill-space/0/new.json 2020-09-08T15:51:59.886 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:51:59.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/0/new.json 2020-09-08T15:51:59.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCfqFdfvi8FIRAAjC7XXCJ5/2EJax2ncck+yA== --osd-uuid aea888d2-59e2-4900-9f13-406739c06961 2020-09-08T15:51:59.930 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:51:59.929+0000 7f8d3a0d4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:51:59.931 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:51:59.931+0000 7f8d3a0d4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:51:59.931 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:51:59.932+0000 7f8d3a0d4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:51:59.931 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:51:59.933+0000 7f8d3a0d4ec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T15:51:59.931 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:51:59.933+0000 7f8d3a0d4ec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T15:51:59.932 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:51:59.933+0000 7f8d3a0d4ec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T15:51:59.968 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:51:59.971+0000 7f8d3a0d4ec0 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2020-09-08T15:52:04.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2020-09-08T15:52:04.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:52:04.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T15:52:04.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:52:04.126 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T15:52:04.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T15:52:04.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:52:04.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:52:04.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:52:04.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:52:04.658 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T15:52:04.694 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:04.686+0000 7fdd03fa7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:52:04.695 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:04.693+0000 7fdd03fa7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:52:04.695 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:04.695+0000 7fdd03fa7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:52:05.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T15:52:05.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:52:05.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:52:05.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:52:05.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:52:05.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:52:05.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:52:05.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:52:05.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:52:05.055 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:52:05.212 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:05.217+0000 7fdd03fa7ec0 -1 Falling back to public interface 2020-09-08T15:52:05.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:52:06.006 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:06.010+0000 7fdd03fa7ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T15:52:06.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:52:06.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:52:06.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:52:06.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:52:06.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:52:06.473 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:52:06.883 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/155548,v1:127.0.0.1:6803/155548] [v2:127.0.0.1:6804/155548,v1:127.0.0.1:6805/155548] exists,up aea888d2-59e2-4900-9f13-406739c06961 2020-09-08T15:52:06.883 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 f19ab2d4-cfa8-41d8-86f1-2051bca0d16f 2020-09-08T15:52:06.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:52:06.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:52:06.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:52:06.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:564: TEST_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:52:06.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:566: TEST_backfill_grow: run_osd td/osd-backfill-space 1 2020-09-08T15:52:06.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T15:52:06.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:52:06.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T15:52:06.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:52:06.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/1 2020-09-08T15:52:06.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T15:52:06.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:52:06.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:52:06.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:52:06.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2020-09-08T15:52:06.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2020-09-08T15:52:06.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:52:06.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:52:06.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T15:52:06.905 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:52:06.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:52:06.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:52:06.908 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:52:06.908 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:52:06.908 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:52:06.909 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:52:06.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:52:06.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:52:06.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:52:06.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:52:06.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T15:52:06.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T15:52:06.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:52:06.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:52:06.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:52:06.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:52:06.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:52:06.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/1 2020-09-08T15:52:06.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:52:06.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=f19ab2d4-cfa8-41d8-86f1-2051bca0d16f 2020-09-08T15:52:06.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 f19ab2d4-cfa8-41d8-86f1-2051bca0d16f' 2020-09-08T15:52:06.915 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:52:06.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCmqFdfnTdrNRAAf4JmuyZLtn0Tz5mmzOm9tQ== 2020-09-08T15:52:06.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCmqFdfnTdrNRAAf4JmuyZLtn0Tz5mmzOm9tQ=="}' 2020-09-08T15:52:06.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new f19ab2d4-cfa8-41d8-86f1-2051bca0d16f -i td/osd-backfill-space/1/new.json 2020-09-08T15:52:07.386 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:52:07.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/1/new.json 2020-09-08T15:52:07.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCmqFdfnTdrNRAAf4JmuyZLtn0Tz5mmzOm9tQ== --osd-uuid f19ab2d4-cfa8-41d8-86f1-2051bca0d16f 2020-09-08T15:52:07.425 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:07.430+0000 7f0617d57ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:52:07.428 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:07.432+0000 7f0617d57ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:52:07.428 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:07.433+0000 7f0617d57ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:52:07.429 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:07.434+0000 7f0617d57ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T15:52:07.429 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:07.434+0000 7f0617d57ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T15:52:07.429 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:07.434+0000 7f0617d57ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T15:52:07.505 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:07.509+0000 7f0617d57ec0 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2020-09-08T15:52:11.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2020-09-08T15:52:11.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:52:11.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T15:52:11.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:52:11.420 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T15:52:11.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T15:52:11.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:52:11.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:52:11.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:52:11.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:52:11.969 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:52:11.994 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:11.995+0000 7f07b3c1aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:52:12.003 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:12.005+0000 7f07b3c1aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:52:12.003 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:12.006+0000 7f07b3c1aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:52:12.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T15:52:12.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:52:12.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:52:12.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:52:12.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:52:12.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:52:12.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:52:12.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:52:12.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:52:12.372 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:52:12.517 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:12.522+0000 7f07b3c1aec0 -1 Falling back to public interface 2020-09-08T15:52:12.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:52:13.301 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:13.306+0000 7f07b3c1aec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T15:52:13.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:52:13.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:52:13.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:52:13.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:52:13.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:52:13.773 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:52:14.178 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/156542,v1:127.0.0.1:6811/156542] [v2:127.0.0.1:6812/156542,v1:127.0.0.1:6813/156542] exists,up f19ab2d4-cfa8-41d8-86f1-2051bca0d16f 2020-09-08T15:52:14.178 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 4ef9702e-41e4-4551-b44c-79befbbe6dd6 2020-09-08T15:52:14.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:52:14.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:52:14.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:52:14.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:564: TEST_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:52:14.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:566: TEST_backfill_grow: run_osd td/osd-backfill-space 2 2020-09-08T15:52:14.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T15:52:14.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:52:14.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T15:52:14.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:52:14.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/2 2020-09-08T15:52:14.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T15:52:14.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:52:14.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:52:14.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:52:14.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2020-09-08T15:52:14.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2020-09-08T15:52:14.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:52:14.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:52:14.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T15:52:14.182 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:52:14.183 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:52:14.183 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:52:14.183 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:52:14.183 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:52:14.183 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:52:14.184 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:52:14.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:52:14.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:52:14.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:52:14.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:52:14.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T15:52:14.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T15:52:14.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:52:14.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:52:14.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:52:14.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:52:14.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:52:14.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/2 2020-09-08T15:52:14.186 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:52:14.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=4ef9702e-41e4-4551-b44c-79befbbe6dd6 2020-09-08T15:52:14.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 4ef9702e-41e4-4551-b44c-79befbbe6dd6' 2020-09-08T15:52:14.187 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:52:14.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCuqFdfScrwCxAAfseFXlxQ0sQYMRuGsRmLNQ== 2020-09-08T15:52:14.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCuqFdfScrwCxAAfseFXlxQ0sQYMRuGsRmLNQ=="}' 2020-09-08T15:52:14.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 4ef9702e-41e4-4551-b44c-79befbbe6dd6 -i td/osd-backfill-space/2/new.json 2020-09-08T15:52:14.688 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T15:52:14.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/2/new.json 2020-09-08T15:52:14.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCuqFdfScrwCxAAfseFXlxQ0sQYMRuGsRmLNQ== --osd-uuid 4ef9702e-41e4-4551-b44c-79befbbe6dd6 2020-09-08T15:52:14.727 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:14.731+0000 7fb5aa273ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:52:14.728 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:14.733+0000 7fb5aa273ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:52:14.729 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:14.734+0000 7fb5aa273ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:52:14.730 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:14.734+0000 7fb5aa273ec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T15:52:14.730 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:14.734+0000 7fb5aa273ec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T15:52:14.730 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:14.734+0000 7fb5aa273ec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T15:52:14.775 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:14.779+0000 7fb5aa273ec0 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2020-09-08T15:52:19.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2020-09-08T15:52:19.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:52:19.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T15:52:19.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:52:19.155 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T15:52:19.691 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T15:52:19.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T15:52:19.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:52:19.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:52:19.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:52:19.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:52:19.715 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:19.720+0000 7fe877221ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:52:19.732 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:19.735+0000 7fe877221ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:52:19.733 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:19.737+0000 7fe877221ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:52:20.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T15:52:20.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:52:20.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:52:20.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:52:20.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:52:20.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:52:20.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:52:20.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:52:20.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:52:20.093 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:52:20.268 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:20.273+0000 7fe877221ec0 -1 Falling back to public interface 2020-09-08T15:52:20.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:52:21.072 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:52:21.077+0000 7fe877221ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T15:52:21.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:52:21.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:52:21.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:52:21.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:52:21.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:52:21.504 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:52:21.924 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/157536,v1:127.0.0.1:6819/157536] [v2:127.0.0.1:6820/157536,v1:127.0.0.1:6821/157536] exists,up 4ef9702e-41e4-4551-b44c-79befbbe6dd6 2020-09-08T15:52:21.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:52:21.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:52:21.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:52:21.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:569: TEST_backfill_grow: ceph osd set-backfillfull-ratio .85 2020-09-08T15:52:22.775 INFO:tasks.workunit.client.0.smithi065.stderr:osd set-backfillfull-ratio 0.85 2020-09-08T15:52:22.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:571: TEST_backfill_grow: create_pool test 1 1 2020-09-08T15:52:22.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test 1 1 2020-09-08T15:52:23.325 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' already exists 2020-09-08T15:52:23.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:52:24.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:572: TEST_backfill_grow: ceph osd pool set test size 3 2020-09-08T15:52:25.077 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 3 2020-09-08T15:52:25.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:573: TEST_backfill_grow: sleep 5 2020-09-08T15:52:30.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:575: TEST_backfill_grow: wait_for_clean 2020-09-08T15:52:30.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:52:30.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:52:30.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:52:30.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:52:30.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T15:52:30.088 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:52:30.088 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:52:30.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:52:30.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:52:30.089 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:52:30.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:52:30.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:52:30.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:52:30.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:52:30.194 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:52:30.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:52:30.594 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:52:30.594 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:52:30.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:52:30.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:52:30.595 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:52:30.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836487 2020-09-08T15:52:30.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836487 2020-09-08T15:52:30.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836487' 2020-09-08T15:52:30.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:52:30.744 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:52:30.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672967 2020-09-08T15:52:30.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672967 2020-09-08T15:52:30.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836487 1-42949672967' 2020-09-08T15:52:30.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:52:30.867 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:52:31.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509444 2020-09-08T15:52:31.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509444 2020-09-08T15:52:31.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836487 1-42949672967 2-64424509444' 2020-09-08T15:52:31.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:52:31.001 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836487 2020-09-08T15:52:31.001 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:52:31.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:52:31.002 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836487 2020-09-08T15:52:31.002 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:52:31.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836487 2020-09-08T15:52:31.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2020-09-08T15:52:31.004 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836487 2020-09-08T15:52:31.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:52:31.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836487 -lt 21474836487 2020-09-08T15:52:31.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:52:31.398 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672967 2020-09-08T15:52:31.398 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:52:31.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:52:31.399 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672967 2020-09-08T15:52:31.399 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:52:31.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672967 2020-09-08T15:52:31.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672967' 2020-09-08T15:52:31.401 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:52:31.401 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672967 2020-09-08T15:52:31.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672967 -lt 42949672967 2020-09-08T15:52:31.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:52:31.821 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509444 2020-09-08T15:52:31.821 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:52:31.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:52:31.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509444 2020-09-08T15:52:31.823 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:52:31.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509444 2020-09-08T15:52:31.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509444' 2020-09-08T15:52:31.824 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509444 2020-09-08T15:52:31.824 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:52:32.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509444 -lt 64424509444 2020-09-08T15:52:32.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:52:32.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:52:32.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:52:32.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T15:52:32.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:52:32.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:52:32.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:52:32.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:52:32.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:52:32.762 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:52:32.762 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:52:33.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:52:33.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:52:33.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:52:33.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:52:33.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T15:52:33.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:52:33.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:52:33.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:577: TEST_backfill_grow: dd if=/dev/urandom of=td/osd-backfill-space/4kdata bs=1k count=4 2020-09-08T15:52:33.665 INFO:tasks.workunit.client.0.smithi065.stderr:4+0 records in 2020-09-08T15:52:33.665 INFO:tasks.workunit.client.0.smithi065.stderr:4+0 records out 2020-09-08T15:52:33.665 INFO:tasks.workunit.client.0.smithi065.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 7.0287e-05 s, 58.3 MB/s 2020-09-08T15:52:33.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: seq 1 600 2020-09-08T15:52:33.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:33.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj1 td/osd-backfill-space/4kdata 2020-09-08T15:52:33.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:33.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj2 td/osd-backfill-space/4kdata 2020-09-08T15:52:33.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:33.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj3 td/osd-backfill-space/4kdata 2020-09-08T15:52:34.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:34.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj4 td/osd-backfill-space/4kdata 2020-09-08T15:52:34.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:34.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj5 td/osd-backfill-space/4kdata 2020-09-08T15:52:34.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:34.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj6 td/osd-backfill-space/4kdata 2020-09-08T15:52:34.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:34.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj7 td/osd-backfill-space/4kdata 2020-09-08T15:52:34.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:34.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj8 td/osd-backfill-space/4kdata 2020-09-08T15:52:34.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:34.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj9 td/osd-backfill-space/4kdata 2020-09-08T15:52:34.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:34.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj10 td/osd-backfill-space/4kdata 2020-09-08T15:52:35.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:35.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj11 td/osd-backfill-space/4kdata 2020-09-08T15:52:35.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:35.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj12 td/osd-backfill-space/4kdata 2020-09-08T15:52:35.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:35.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj13 td/osd-backfill-space/4kdata 2020-09-08T15:52:35.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:35.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj14 td/osd-backfill-space/4kdata 2020-09-08T15:52:35.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:35.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj15 td/osd-backfill-space/4kdata 2020-09-08T15:52:35.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:35.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj16 td/osd-backfill-space/4kdata 2020-09-08T15:52:35.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:35.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj17 td/osd-backfill-space/4kdata 2020-09-08T15:52:35.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:35.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj18 td/osd-backfill-space/4kdata 2020-09-08T15:52:36.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:36.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj19 td/osd-backfill-space/4kdata 2020-09-08T15:52:36.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:36.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj20 td/osd-backfill-space/4kdata 2020-09-08T15:52:36.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:36.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj21 td/osd-backfill-space/4kdata 2020-09-08T15:52:36.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:36.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj22 td/osd-backfill-space/4kdata 2020-09-08T15:52:36.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:36.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj23 td/osd-backfill-space/4kdata 2020-09-08T15:52:36.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:36.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj24 td/osd-backfill-space/4kdata 2020-09-08T15:52:36.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:36.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj25 td/osd-backfill-space/4kdata 2020-09-08T15:52:37.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:37.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj26 td/osd-backfill-space/4kdata 2020-09-08T15:52:37.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:37.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj27 td/osd-backfill-space/4kdata 2020-09-08T15:52:37.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:37.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj28 td/osd-backfill-space/4kdata 2020-09-08T15:52:37.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:37.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj29 td/osd-backfill-space/4kdata 2020-09-08T15:52:37.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:37.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj30 td/osd-backfill-space/4kdata 2020-09-08T15:52:37.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:37.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj31 td/osd-backfill-space/4kdata 2020-09-08T15:52:37.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:37.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj32 td/osd-backfill-space/4kdata 2020-09-08T15:52:37.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:37.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj33 td/osd-backfill-space/4kdata 2020-09-08T15:52:38.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:38.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj34 td/osd-backfill-space/4kdata 2020-09-08T15:52:38.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:38.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj35 td/osd-backfill-space/4kdata 2020-09-08T15:52:38.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:38.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj36 td/osd-backfill-space/4kdata 2020-09-08T15:52:38.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:38.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj37 td/osd-backfill-space/4kdata 2020-09-08T15:52:38.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:38.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj38 td/osd-backfill-space/4kdata 2020-09-08T15:52:38.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:38.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj39 td/osd-backfill-space/4kdata 2020-09-08T15:52:38.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:38.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj40 td/osd-backfill-space/4kdata 2020-09-08T15:52:39.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:39.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj41 td/osd-backfill-space/4kdata 2020-09-08T15:52:39.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:39.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj42 td/osd-backfill-space/4kdata 2020-09-08T15:52:39.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:39.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj43 td/osd-backfill-space/4kdata 2020-09-08T15:52:39.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:39.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj44 td/osd-backfill-space/4kdata 2020-09-08T15:52:39.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:39.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj45 td/osd-backfill-space/4kdata 2020-09-08T15:52:39.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:39.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj46 td/osd-backfill-space/4kdata 2020-09-08T15:52:39.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:39.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj47 td/osd-backfill-space/4kdata 2020-09-08T15:52:40.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:40.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj48 td/osd-backfill-space/4kdata 2020-09-08T15:52:40.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:40.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj49 td/osd-backfill-space/4kdata 2020-09-08T15:52:40.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:40.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj50 td/osd-backfill-space/4kdata 2020-09-08T15:52:40.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:40.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj51 td/osd-backfill-space/4kdata 2020-09-08T15:52:40.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:40.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj52 td/osd-backfill-space/4kdata 2020-09-08T15:52:40.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:40.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj53 td/osd-backfill-space/4kdata 2020-09-08T15:52:40.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:40.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj54 td/osd-backfill-space/4kdata 2020-09-08T15:52:41.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:41.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj55 td/osd-backfill-space/4kdata 2020-09-08T15:52:41.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:41.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj56 td/osd-backfill-space/4kdata 2020-09-08T15:52:41.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:41.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj57 td/osd-backfill-space/4kdata 2020-09-08T15:52:41.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:41.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj58 td/osd-backfill-space/4kdata 2020-09-08T15:52:41.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:41.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj59 td/osd-backfill-space/4kdata 2020-09-08T15:52:41.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:41.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj60 td/osd-backfill-space/4kdata 2020-09-08T15:52:41.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:41.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj61 td/osd-backfill-space/4kdata 2020-09-08T15:52:42.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:42.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj62 td/osd-backfill-space/4kdata 2020-09-08T15:52:42.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:42.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj63 td/osd-backfill-space/4kdata 2020-09-08T15:52:42.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:42.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj64 td/osd-backfill-space/4kdata 2020-09-08T15:52:42.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:42.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj65 td/osd-backfill-space/4kdata 2020-09-08T15:52:42.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:42.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj66 td/osd-backfill-space/4kdata 2020-09-08T15:52:42.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:42.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj67 td/osd-backfill-space/4kdata 2020-09-08T15:52:42.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:42.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj68 td/osd-backfill-space/4kdata 2020-09-08T15:52:43.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:43.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj69 td/osd-backfill-space/4kdata 2020-09-08T15:52:43.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:43.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj70 td/osd-backfill-space/4kdata 2020-09-08T15:52:43.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:43.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj71 td/osd-backfill-space/4kdata 2020-09-08T15:52:43.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:43.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj72 td/osd-backfill-space/4kdata 2020-09-08T15:52:43.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:43.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj73 td/osd-backfill-space/4kdata 2020-09-08T15:52:43.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:43.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj74 td/osd-backfill-space/4kdata 2020-09-08T15:52:43.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:43.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj75 td/osd-backfill-space/4kdata 2020-09-08T15:52:44.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:44.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj76 td/osd-backfill-space/4kdata 2020-09-08T15:52:44.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:44.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj77 td/osd-backfill-space/4kdata 2020-09-08T15:52:44.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:44.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj78 td/osd-backfill-space/4kdata 2020-09-08T15:52:44.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:44.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj79 td/osd-backfill-space/4kdata 2020-09-08T15:52:44.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:44.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj80 td/osd-backfill-space/4kdata 2020-09-08T15:52:44.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:44.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj81 td/osd-backfill-space/4kdata 2020-09-08T15:52:44.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:44.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj82 td/osd-backfill-space/4kdata 2020-09-08T15:52:45.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:45.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj83 td/osd-backfill-space/4kdata 2020-09-08T15:52:45.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:45.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj84 td/osd-backfill-space/4kdata 2020-09-08T15:52:45.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:45.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj85 td/osd-backfill-space/4kdata 2020-09-08T15:52:45.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:45.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj86 td/osd-backfill-space/4kdata 2020-09-08T15:52:45.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:45.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj87 td/osd-backfill-space/4kdata 2020-09-08T15:52:45.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:45.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj88 td/osd-backfill-space/4kdata 2020-09-08T15:52:45.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:45.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj89 td/osd-backfill-space/4kdata 2020-09-08T15:52:46.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:46.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj90 td/osd-backfill-space/4kdata 2020-09-08T15:52:46.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:46.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj91 td/osd-backfill-space/4kdata 2020-09-08T15:52:46.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:46.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj92 td/osd-backfill-space/4kdata 2020-09-08T15:52:46.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:46.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj93 td/osd-backfill-space/4kdata 2020-09-08T15:52:46.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:46.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj94 td/osd-backfill-space/4kdata 2020-09-08T15:52:46.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:46.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj95 td/osd-backfill-space/4kdata 2020-09-08T15:52:46.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:46.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj96 td/osd-backfill-space/4kdata 2020-09-08T15:52:47.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:47.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj97 td/osd-backfill-space/4kdata 2020-09-08T15:52:47.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:47.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj98 td/osd-backfill-space/4kdata 2020-09-08T15:52:47.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:47.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj99 td/osd-backfill-space/4kdata 2020-09-08T15:52:47.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:47.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj100 td/osd-backfill-space/4kdata 2020-09-08T15:52:47.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:47.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj101 td/osd-backfill-space/4kdata 2020-09-08T15:52:47.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:47.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj102 td/osd-backfill-space/4kdata 2020-09-08T15:52:47.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:47.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj103 td/osd-backfill-space/4kdata 2020-09-08T15:52:48.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:48.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj104 td/osd-backfill-space/4kdata 2020-09-08T15:52:48.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:48.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj105 td/osd-backfill-space/4kdata 2020-09-08T15:52:48.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:48.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj106 td/osd-backfill-space/4kdata 2020-09-08T15:52:48.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:48.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj107 td/osd-backfill-space/4kdata 2020-09-08T15:52:48.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:48.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj108 td/osd-backfill-space/4kdata 2020-09-08T15:52:48.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:48.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj109 td/osd-backfill-space/4kdata 2020-09-08T15:52:48.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:48.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj110 td/osd-backfill-space/4kdata 2020-09-08T15:52:49.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:49.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj111 td/osd-backfill-space/4kdata 2020-09-08T15:52:49.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:49.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj112 td/osd-backfill-space/4kdata 2020-09-08T15:52:49.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:49.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj113 td/osd-backfill-space/4kdata 2020-09-08T15:52:49.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:49.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj114 td/osd-backfill-space/4kdata 2020-09-08T15:52:49.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:49.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj115 td/osd-backfill-space/4kdata 2020-09-08T15:52:49.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:49.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj116 td/osd-backfill-space/4kdata 2020-09-08T15:52:49.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:49.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj117 td/osd-backfill-space/4kdata 2020-09-08T15:52:50.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:50.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj118 td/osd-backfill-space/4kdata 2020-09-08T15:52:50.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:50.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj119 td/osd-backfill-space/4kdata 2020-09-08T15:52:50.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:50.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj120 td/osd-backfill-space/4kdata 2020-09-08T15:52:50.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:50.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj121 td/osd-backfill-space/4kdata 2020-09-08T15:52:50.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:50.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj122 td/osd-backfill-space/4kdata 2020-09-08T15:52:50.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:50.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj123 td/osd-backfill-space/4kdata 2020-09-08T15:52:50.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:50.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj124 td/osd-backfill-space/4kdata 2020-09-08T15:52:51.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:51.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj125 td/osd-backfill-space/4kdata 2020-09-08T15:52:51.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:51.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj126 td/osd-backfill-space/4kdata 2020-09-08T15:52:51.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:51.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj127 td/osd-backfill-space/4kdata 2020-09-08T15:52:51.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:51.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj128 td/osd-backfill-space/4kdata 2020-09-08T15:52:51.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:51.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj129 td/osd-backfill-space/4kdata 2020-09-08T15:52:51.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:51.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj130 td/osd-backfill-space/4kdata 2020-09-08T15:52:51.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:51.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj131 td/osd-backfill-space/4kdata 2020-09-08T15:52:51.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:52.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj132 td/osd-backfill-space/4kdata 2020-09-08T15:52:52.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:52.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj133 td/osd-backfill-space/4kdata 2020-09-08T15:52:52.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:52.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj134 td/osd-backfill-space/4kdata 2020-09-08T15:52:52.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:52.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj135 td/osd-backfill-space/4kdata 2020-09-08T15:52:52.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:52.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj136 td/osd-backfill-space/4kdata 2020-09-08T15:52:52.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:52.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj137 td/osd-backfill-space/4kdata 2020-09-08T15:52:52.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:52.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj138 td/osd-backfill-space/4kdata 2020-09-08T15:52:52.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:52.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj139 td/osd-backfill-space/4kdata 2020-09-08T15:52:53.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:53.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj140 td/osd-backfill-space/4kdata 2020-09-08T15:52:53.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:53.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj141 td/osd-backfill-space/4kdata 2020-09-08T15:52:53.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:53.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj142 td/osd-backfill-space/4kdata 2020-09-08T15:52:53.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:53.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj143 td/osd-backfill-space/4kdata 2020-09-08T15:52:53.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:53.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj144 td/osd-backfill-space/4kdata 2020-09-08T15:52:53.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:53.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj145 td/osd-backfill-space/4kdata 2020-09-08T15:52:53.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:53.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj146 td/osd-backfill-space/4kdata 2020-09-08T15:52:54.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:54.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj147 td/osd-backfill-space/4kdata 2020-09-08T15:52:54.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:54.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj148 td/osd-backfill-space/4kdata 2020-09-08T15:52:54.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:54.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj149 td/osd-backfill-space/4kdata 2020-09-08T15:52:54.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:54.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj150 td/osd-backfill-space/4kdata 2020-09-08T15:52:54.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:54.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj151 td/osd-backfill-space/4kdata 2020-09-08T15:52:54.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:54.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj152 td/osd-backfill-space/4kdata 2020-09-08T15:52:54.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:54.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj153 td/osd-backfill-space/4kdata 2020-09-08T15:52:55.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:55.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj154 td/osd-backfill-space/4kdata 2020-09-08T15:52:55.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:55.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj155 td/osd-backfill-space/4kdata 2020-09-08T15:52:55.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:55.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj156 td/osd-backfill-space/4kdata 2020-09-08T15:52:55.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:55.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj157 td/osd-backfill-space/4kdata 2020-09-08T15:52:55.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:55.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj158 td/osd-backfill-space/4kdata 2020-09-08T15:52:55.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:55.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj159 td/osd-backfill-space/4kdata 2020-09-08T15:52:55.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:55.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj160 td/osd-backfill-space/4kdata 2020-09-08T15:52:55.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:55.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj161 td/osd-backfill-space/4kdata 2020-09-08T15:52:56.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:56.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj162 td/osd-backfill-space/4kdata 2020-09-08T15:52:56.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:56.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj163 td/osd-backfill-space/4kdata 2020-09-08T15:52:56.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:56.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj164 td/osd-backfill-space/4kdata 2020-09-08T15:52:56.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:56.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj165 td/osd-backfill-space/4kdata 2020-09-08T15:52:56.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:56.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj166 td/osd-backfill-space/4kdata 2020-09-08T15:52:56.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:56.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj167 td/osd-backfill-space/4kdata 2020-09-08T15:52:56.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:56.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj168 td/osd-backfill-space/4kdata 2020-09-08T15:52:57.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:57.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj169 td/osd-backfill-space/4kdata 2020-09-08T15:52:57.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:57.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj170 td/osd-backfill-space/4kdata 2020-09-08T15:52:57.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:57.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj171 td/osd-backfill-space/4kdata 2020-09-08T15:52:57.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:57.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj172 td/osd-backfill-space/4kdata 2020-09-08T15:52:57.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:57.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj173 td/osd-backfill-space/4kdata 2020-09-08T15:52:57.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:57.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj174 td/osd-backfill-space/4kdata 2020-09-08T15:52:57.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:57.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj175 td/osd-backfill-space/4kdata 2020-09-08T15:52:57.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:57.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj176 td/osd-backfill-space/4kdata 2020-09-08T15:52:58.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:58.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj177 td/osd-backfill-space/4kdata 2020-09-08T15:52:58.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:58.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj178 td/osd-backfill-space/4kdata 2020-09-08T15:52:58.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:58.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj179 td/osd-backfill-space/4kdata 2020-09-08T15:52:58.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:58.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj180 td/osd-backfill-space/4kdata 2020-09-08T15:52:58.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:58.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj181 td/osd-backfill-space/4kdata 2020-09-08T15:52:58.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:58.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj182 td/osd-backfill-space/4kdata 2020-09-08T15:52:58.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:58.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj183 td/osd-backfill-space/4kdata 2020-09-08T15:52:59.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:59.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj184 td/osd-backfill-space/4kdata 2020-09-08T15:52:59.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:59.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj185 td/osd-backfill-space/4kdata 2020-09-08T15:52:59.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:59.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj186 td/osd-backfill-space/4kdata 2020-09-08T15:52:59.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:59.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj187 td/osd-backfill-space/4kdata 2020-09-08T15:52:59.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:59.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj188 td/osd-backfill-space/4kdata 2020-09-08T15:52:59.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:59.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj189 td/osd-backfill-space/4kdata 2020-09-08T15:52:59.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:59.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj190 td/osd-backfill-space/4kdata 2020-09-08T15:52:59.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:52:59.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj191 td/osd-backfill-space/4kdata 2020-09-08T15:53:00.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:00.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj192 td/osd-backfill-space/4kdata 2020-09-08T15:53:00.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:00.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj193 td/osd-backfill-space/4kdata 2020-09-08T15:53:00.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:00.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj194 td/osd-backfill-space/4kdata 2020-09-08T15:53:00.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:00.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj195 td/osd-backfill-space/4kdata 2020-09-08T15:53:00.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:00.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj196 td/osd-backfill-space/4kdata 2020-09-08T15:53:00.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:00.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj197 td/osd-backfill-space/4kdata 2020-09-08T15:53:00.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:00.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj198 td/osd-backfill-space/4kdata 2020-09-08T15:53:01.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:01.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj199 td/osd-backfill-space/4kdata 2020-09-08T15:53:01.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:01.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj200 td/osd-backfill-space/4kdata 2020-09-08T15:53:01.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:01.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj201 td/osd-backfill-space/4kdata 2020-09-08T15:53:01.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:01.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj202 td/osd-backfill-space/4kdata 2020-09-08T15:53:01.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:01.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj203 td/osd-backfill-space/4kdata 2020-09-08T15:53:01.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:01.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj204 td/osd-backfill-space/4kdata 2020-09-08T15:53:01.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:01.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj205 td/osd-backfill-space/4kdata 2020-09-08T15:53:02.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:02.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj206 td/osd-backfill-space/4kdata 2020-09-08T15:53:02.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:02.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj207 td/osd-backfill-space/4kdata 2020-09-08T15:53:02.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:02.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj208 td/osd-backfill-space/4kdata 2020-09-08T15:53:02.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:02.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj209 td/osd-backfill-space/4kdata 2020-09-08T15:53:02.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:02.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj210 td/osd-backfill-space/4kdata 2020-09-08T15:53:02.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:02.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj211 td/osd-backfill-space/4kdata 2020-09-08T15:53:03.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:03.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj212 td/osd-backfill-space/4kdata 2020-09-08T15:53:03.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:03.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj213 td/osd-backfill-space/4kdata 2020-09-08T15:53:03.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:03.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj214 td/osd-backfill-space/4kdata 2020-09-08T15:53:03.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:03.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj215 td/osd-backfill-space/4kdata 2020-09-08T15:53:03.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:03.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj216 td/osd-backfill-space/4kdata 2020-09-08T15:53:03.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:03.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj217 td/osd-backfill-space/4kdata 2020-09-08T15:53:03.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:03.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj218 td/osd-backfill-space/4kdata 2020-09-08T15:53:04.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:04.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj219 td/osd-backfill-space/4kdata 2020-09-08T15:53:04.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:04.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj220 td/osd-backfill-space/4kdata 2020-09-08T15:53:04.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:04.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj221 td/osd-backfill-space/4kdata 2020-09-08T15:53:04.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:04.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj222 td/osd-backfill-space/4kdata 2020-09-08T15:53:04.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:04.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj223 td/osd-backfill-space/4kdata 2020-09-08T15:53:04.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:04.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj224 td/osd-backfill-space/4kdata 2020-09-08T15:53:04.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:04.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj225 td/osd-backfill-space/4kdata 2020-09-08T15:53:05.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:05.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj226 td/osd-backfill-space/4kdata 2020-09-08T15:53:05.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:05.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj227 td/osd-backfill-space/4kdata 2020-09-08T15:53:05.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:05.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj228 td/osd-backfill-space/4kdata 2020-09-08T15:53:05.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:05.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj229 td/osd-backfill-space/4kdata 2020-09-08T15:53:05.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:05.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj230 td/osd-backfill-space/4kdata 2020-09-08T15:53:05.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:05.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj231 td/osd-backfill-space/4kdata 2020-09-08T15:53:05.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:05.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj232 td/osd-backfill-space/4kdata 2020-09-08T15:53:05.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:05.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj233 td/osd-backfill-space/4kdata 2020-09-08T15:53:06.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:06.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj234 td/osd-backfill-space/4kdata 2020-09-08T15:53:06.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:06.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj235 td/osd-backfill-space/4kdata 2020-09-08T15:53:06.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:06.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj236 td/osd-backfill-space/4kdata 2020-09-08T15:53:06.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:06.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj237 td/osd-backfill-space/4kdata 2020-09-08T15:53:06.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:06.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj238 td/osd-backfill-space/4kdata 2020-09-08T15:53:06.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:06.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj239 td/osd-backfill-space/4kdata 2020-09-08T15:53:06.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:06.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj240 td/osd-backfill-space/4kdata 2020-09-08T15:53:07.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:07.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj241 td/osd-backfill-space/4kdata 2020-09-08T15:53:07.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:07.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj242 td/osd-backfill-space/4kdata 2020-09-08T15:53:07.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:07.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj243 td/osd-backfill-space/4kdata 2020-09-08T15:53:07.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:07.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj244 td/osd-backfill-space/4kdata 2020-09-08T15:53:07.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:07.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj245 td/osd-backfill-space/4kdata 2020-09-08T15:53:07.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:07.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj246 td/osd-backfill-space/4kdata 2020-09-08T15:53:07.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:07.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj247 td/osd-backfill-space/4kdata 2020-09-08T15:53:08.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:08.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj248 td/osd-backfill-space/4kdata 2020-09-08T15:53:08.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:08.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj249 td/osd-backfill-space/4kdata 2020-09-08T15:53:08.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:08.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj250 td/osd-backfill-space/4kdata 2020-09-08T15:53:08.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:08.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj251 td/osd-backfill-space/4kdata 2020-09-08T15:53:08.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:08.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj252 td/osd-backfill-space/4kdata 2020-09-08T15:53:08.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:08.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj253 td/osd-backfill-space/4kdata 2020-09-08T15:53:08.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:08.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj254 td/osd-backfill-space/4kdata 2020-09-08T15:53:09.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:09.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj255 td/osd-backfill-space/4kdata 2020-09-08T15:53:09.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:09.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj256 td/osd-backfill-space/4kdata 2020-09-08T15:53:09.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:09.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj257 td/osd-backfill-space/4kdata 2020-09-08T15:53:09.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:09.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj258 td/osd-backfill-space/4kdata 2020-09-08T15:53:09.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:09.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj259 td/osd-backfill-space/4kdata 2020-09-08T15:53:09.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:09.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj260 td/osd-backfill-space/4kdata 2020-09-08T15:53:09.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:09.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj261 td/osd-backfill-space/4kdata 2020-09-08T15:53:10.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:10.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj262 td/osd-backfill-space/4kdata 2020-09-08T15:53:10.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:10.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj263 td/osd-backfill-space/4kdata 2020-09-08T15:53:10.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:10.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj264 td/osd-backfill-space/4kdata 2020-09-08T15:53:10.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:10.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj265 td/osd-backfill-space/4kdata 2020-09-08T15:53:10.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:10.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj266 td/osd-backfill-space/4kdata 2020-09-08T15:53:10.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:10.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj267 td/osd-backfill-space/4kdata 2020-09-08T15:53:10.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:10.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj268 td/osd-backfill-space/4kdata 2020-09-08T15:53:10.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:10.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj269 td/osd-backfill-space/4kdata 2020-09-08T15:53:11.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:11.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj270 td/osd-backfill-space/4kdata 2020-09-08T15:53:11.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:11.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj271 td/osd-backfill-space/4kdata 2020-09-08T15:53:11.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:11.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj272 td/osd-backfill-space/4kdata 2020-09-08T15:53:11.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:11.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj273 td/osd-backfill-space/4kdata 2020-09-08T15:53:11.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:11.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj274 td/osd-backfill-space/4kdata 2020-09-08T15:53:11.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:11.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj275 td/osd-backfill-space/4kdata 2020-09-08T15:53:11.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:11.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj276 td/osd-backfill-space/4kdata 2020-09-08T15:53:12.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:12.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj277 td/osd-backfill-space/4kdata 2020-09-08T15:53:12.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:12.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj278 td/osd-backfill-space/4kdata 2020-09-08T15:53:12.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:12.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj279 td/osd-backfill-space/4kdata 2020-09-08T15:53:12.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:12.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj280 td/osd-backfill-space/4kdata 2020-09-08T15:53:12.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:12.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj281 td/osd-backfill-space/4kdata 2020-09-08T15:53:12.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:12.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj282 td/osd-backfill-space/4kdata 2020-09-08T15:53:12.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:12.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj283 td/osd-backfill-space/4kdata 2020-09-08T15:53:12.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:12.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj284 td/osd-backfill-space/4kdata 2020-09-08T15:53:13.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:13.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj285 td/osd-backfill-space/4kdata 2020-09-08T15:53:13.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:13.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj286 td/osd-backfill-space/4kdata 2020-09-08T15:53:13.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:13.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj287 td/osd-backfill-space/4kdata 2020-09-08T15:53:13.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:13.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj288 td/osd-backfill-space/4kdata 2020-09-08T15:53:13.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:13.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj289 td/osd-backfill-space/4kdata 2020-09-08T15:53:13.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:13.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj290 td/osd-backfill-space/4kdata 2020-09-08T15:53:13.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:13.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj291 td/osd-backfill-space/4kdata 2020-09-08T15:53:14.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:14.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj292 td/osd-backfill-space/4kdata 2020-09-08T15:53:14.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:14.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj293 td/osd-backfill-space/4kdata 2020-09-08T15:53:14.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:14.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj294 td/osd-backfill-space/4kdata 2020-09-08T15:53:14.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:14.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj295 td/osd-backfill-space/4kdata 2020-09-08T15:53:14.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:14.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj296 td/osd-backfill-space/4kdata 2020-09-08T15:53:14.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:14.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj297 td/osd-backfill-space/4kdata 2020-09-08T15:53:14.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:14.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj298 td/osd-backfill-space/4kdata 2020-09-08T15:53:14.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:14.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj299 td/osd-backfill-space/4kdata 2020-09-08T15:53:15.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:15.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj300 td/osd-backfill-space/4kdata 2020-09-08T15:53:15.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:15.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj301 td/osd-backfill-space/4kdata 2020-09-08T15:53:15.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:15.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj302 td/osd-backfill-space/4kdata 2020-09-08T15:53:15.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:15.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj303 td/osd-backfill-space/4kdata 2020-09-08T15:53:15.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:15.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj304 td/osd-backfill-space/4kdata 2020-09-08T15:53:15.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:15.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj305 td/osd-backfill-space/4kdata 2020-09-08T15:53:15.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:15.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj306 td/osd-backfill-space/4kdata 2020-09-08T15:53:16.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:16.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj307 td/osd-backfill-space/4kdata 2020-09-08T15:53:16.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:16.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj308 td/osd-backfill-space/4kdata 2020-09-08T15:53:16.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:16.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj309 td/osd-backfill-space/4kdata 2020-09-08T15:53:16.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:16.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj310 td/osd-backfill-space/4kdata 2020-09-08T15:53:16.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:16.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj311 td/osd-backfill-space/4kdata 2020-09-08T15:53:16.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:16.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj312 td/osd-backfill-space/4kdata 2020-09-08T15:53:16.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:16.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj313 td/osd-backfill-space/4kdata 2020-09-08T15:53:16.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:16.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj314 td/osd-backfill-space/4kdata 2020-09-08T15:53:17.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:17.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj315 td/osd-backfill-space/4kdata 2020-09-08T15:53:17.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:17.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj316 td/osd-backfill-space/4kdata 2020-09-08T15:53:17.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:17.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj317 td/osd-backfill-space/4kdata 2020-09-08T15:53:17.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:17.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj318 td/osd-backfill-space/4kdata 2020-09-08T15:53:17.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:17.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj319 td/osd-backfill-space/4kdata 2020-09-08T15:53:17.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:17.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj320 td/osd-backfill-space/4kdata 2020-09-08T15:53:17.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:17.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj321 td/osd-backfill-space/4kdata 2020-09-08T15:53:18.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:18.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj322 td/osd-backfill-space/4kdata 2020-09-08T15:53:18.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:18.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj323 td/osd-backfill-space/4kdata 2020-09-08T15:53:18.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:18.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj324 td/osd-backfill-space/4kdata 2020-09-08T15:53:18.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:18.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj325 td/osd-backfill-space/4kdata 2020-09-08T15:53:18.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:18.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj326 td/osd-backfill-space/4kdata 2020-09-08T15:53:18.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:18.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj327 td/osd-backfill-space/4kdata 2020-09-08T15:53:18.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:18.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj328 td/osd-backfill-space/4kdata 2020-09-08T15:53:19.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:19.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj329 td/osd-backfill-space/4kdata 2020-09-08T15:53:19.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:19.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj330 td/osd-backfill-space/4kdata 2020-09-08T15:53:19.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:19.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj331 td/osd-backfill-space/4kdata 2020-09-08T15:53:19.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:19.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj332 td/osd-backfill-space/4kdata 2020-09-08T15:53:19.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:19.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj333 td/osd-backfill-space/4kdata 2020-09-08T15:53:19.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:19.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj334 td/osd-backfill-space/4kdata 2020-09-08T15:53:19.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:19.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj335 td/osd-backfill-space/4kdata 2020-09-08T15:53:20.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:20.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj336 td/osd-backfill-space/4kdata 2020-09-08T15:53:20.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:20.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj337 td/osd-backfill-space/4kdata 2020-09-08T15:53:20.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:20.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj338 td/osd-backfill-space/4kdata 2020-09-08T15:53:20.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:20.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj339 td/osd-backfill-space/4kdata 2020-09-08T15:53:20.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:20.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj340 td/osd-backfill-space/4kdata 2020-09-08T15:53:20.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:20.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj341 td/osd-backfill-space/4kdata 2020-09-08T15:53:20.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:20.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj342 td/osd-backfill-space/4kdata 2020-09-08T15:53:20.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:20.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj343 td/osd-backfill-space/4kdata 2020-09-08T15:53:21.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:21.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj344 td/osd-backfill-space/4kdata 2020-09-08T15:53:21.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:21.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj345 td/osd-backfill-space/4kdata 2020-09-08T15:53:21.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:21.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj346 td/osd-backfill-space/4kdata 2020-09-08T15:53:21.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:21.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj347 td/osd-backfill-space/4kdata 2020-09-08T15:53:21.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:21.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj348 td/osd-backfill-space/4kdata 2020-09-08T15:53:21.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:21.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj349 td/osd-backfill-space/4kdata 2020-09-08T15:53:21.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:21.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj350 td/osd-backfill-space/4kdata 2020-09-08T15:53:22.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:22.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj351 td/osd-backfill-space/4kdata 2020-09-08T15:53:22.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:22.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj352 td/osd-backfill-space/4kdata 2020-09-08T15:53:22.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:22.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj353 td/osd-backfill-space/4kdata 2020-09-08T15:53:22.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:22.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj354 td/osd-backfill-space/4kdata 2020-09-08T15:53:22.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:22.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj355 td/osd-backfill-space/4kdata 2020-09-08T15:53:22.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:22.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj356 td/osd-backfill-space/4kdata 2020-09-08T15:53:22.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:22.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj357 td/osd-backfill-space/4kdata 2020-09-08T15:53:22.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:22.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj358 td/osd-backfill-space/4kdata 2020-09-08T15:53:23.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:23.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj359 td/osd-backfill-space/4kdata 2020-09-08T15:53:23.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:23.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj360 td/osd-backfill-space/4kdata 2020-09-08T15:53:23.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:23.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj361 td/osd-backfill-space/4kdata 2020-09-08T15:53:23.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:23.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj362 td/osd-backfill-space/4kdata 2020-09-08T15:53:23.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:23.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj363 td/osd-backfill-space/4kdata 2020-09-08T15:53:23.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:23.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj364 td/osd-backfill-space/4kdata 2020-09-08T15:53:23.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:23.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj365 td/osd-backfill-space/4kdata 2020-09-08T15:53:24.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:24.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj366 td/osd-backfill-space/4kdata 2020-09-08T15:53:24.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:24.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj367 td/osd-backfill-space/4kdata 2020-09-08T15:53:24.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:24.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj368 td/osd-backfill-space/4kdata 2020-09-08T15:53:24.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:24.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj369 td/osd-backfill-space/4kdata 2020-09-08T15:53:24.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:24.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj370 td/osd-backfill-space/4kdata 2020-09-08T15:53:24.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:24.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj371 td/osd-backfill-space/4kdata 2020-09-08T15:53:24.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:24.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj372 td/osd-backfill-space/4kdata 2020-09-08T15:53:24.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:24.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj373 td/osd-backfill-space/4kdata 2020-09-08T15:53:25.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:25.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj374 td/osd-backfill-space/4kdata 2020-09-08T15:53:25.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:25.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj375 td/osd-backfill-space/4kdata 2020-09-08T15:53:25.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:25.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj376 td/osd-backfill-space/4kdata 2020-09-08T15:53:25.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:25.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj377 td/osd-backfill-space/4kdata 2020-09-08T15:53:25.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:25.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj378 td/osd-backfill-space/4kdata 2020-09-08T15:53:25.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:25.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj379 td/osd-backfill-space/4kdata 2020-09-08T15:53:25.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:25.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj380 td/osd-backfill-space/4kdata 2020-09-08T15:53:26.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:26.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj381 td/osd-backfill-space/4kdata 2020-09-08T15:53:26.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:26.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj382 td/osd-backfill-space/4kdata 2020-09-08T15:53:26.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:26.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj383 td/osd-backfill-space/4kdata 2020-09-08T15:53:26.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:26.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj384 td/osd-backfill-space/4kdata 2020-09-08T15:53:26.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:26.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj385 td/osd-backfill-space/4kdata 2020-09-08T15:53:26.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:26.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj386 td/osd-backfill-space/4kdata 2020-09-08T15:53:26.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:26.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj387 td/osd-backfill-space/4kdata 2020-09-08T15:53:26.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:26.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj388 td/osd-backfill-space/4kdata 2020-09-08T15:53:27.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:27.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj389 td/osd-backfill-space/4kdata 2020-09-08T15:53:27.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:27.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj390 td/osd-backfill-space/4kdata 2020-09-08T15:53:27.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:27.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj391 td/osd-backfill-space/4kdata 2020-09-08T15:53:27.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:27.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj392 td/osd-backfill-space/4kdata 2020-09-08T15:53:27.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:27.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj393 td/osd-backfill-space/4kdata 2020-09-08T15:53:27.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:27.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj394 td/osd-backfill-space/4kdata 2020-09-08T15:53:27.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:27.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj395 td/osd-backfill-space/4kdata 2020-09-08T15:53:27.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:27.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj396 td/osd-backfill-space/4kdata 2020-09-08T15:53:28.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:28.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj397 td/osd-backfill-space/4kdata 2020-09-08T15:53:28.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:28.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj398 td/osd-backfill-space/4kdata 2020-09-08T15:53:28.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:28.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj399 td/osd-backfill-space/4kdata 2020-09-08T15:53:28.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:28.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj400 td/osd-backfill-space/4kdata 2020-09-08T15:53:28.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:28.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj401 td/osd-backfill-space/4kdata 2020-09-08T15:53:28.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:28.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj402 td/osd-backfill-space/4kdata 2020-09-08T15:53:28.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:28.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj403 td/osd-backfill-space/4kdata 2020-09-08T15:53:28.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:28.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj404 td/osd-backfill-space/4kdata 2020-09-08T15:53:29.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:29.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj405 td/osd-backfill-space/4kdata 2020-09-08T15:53:29.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:29.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj406 td/osd-backfill-space/4kdata 2020-09-08T15:53:29.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:29.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj407 td/osd-backfill-space/4kdata 2020-09-08T15:53:29.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:29.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj408 td/osd-backfill-space/4kdata 2020-09-08T15:53:29.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:29.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj409 td/osd-backfill-space/4kdata 2020-09-08T15:53:29.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:29.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj410 td/osd-backfill-space/4kdata 2020-09-08T15:53:29.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:29.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj411 td/osd-backfill-space/4kdata 2020-09-08T15:53:30.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:30.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj412 td/osd-backfill-space/4kdata 2020-09-08T15:53:30.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:30.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj413 td/osd-backfill-space/4kdata 2020-09-08T15:53:30.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:30.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj414 td/osd-backfill-space/4kdata 2020-09-08T15:53:30.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:30.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj415 td/osd-backfill-space/4kdata 2020-09-08T15:53:30.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:30.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj416 td/osd-backfill-space/4kdata 2020-09-08T15:53:30.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:30.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj417 td/osd-backfill-space/4kdata 2020-09-08T15:53:30.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:30.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj418 td/osd-backfill-space/4kdata 2020-09-08T15:53:30.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:30.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj419 td/osd-backfill-space/4kdata 2020-09-08T15:53:31.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:31.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj420 td/osd-backfill-space/4kdata 2020-09-08T15:53:31.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:31.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj421 td/osd-backfill-space/4kdata 2020-09-08T15:53:31.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:31.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj422 td/osd-backfill-space/4kdata 2020-09-08T15:53:31.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:31.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj423 td/osd-backfill-space/4kdata 2020-09-08T15:53:31.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:31.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj424 td/osd-backfill-space/4kdata 2020-09-08T15:53:31.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:31.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj425 td/osd-backfill-space/4kdata 2020-09-08T15:53:31.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:31.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj426 td/osd-backfill-space/4kdata 2020-09-08T15:53:32.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:32.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj427 td/osd-backfill-space/4kdata 2020-09-08T15:53:32.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:32.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj428 td/osd-backfill-space/4kdata 2020-09-08T15:53:32.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:32.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj429 td/osd-backfill-space/4kdata 2020-09-08T15:53:32.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:32.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj430 td/osd-backfill-space/4kdata 2020-09-08T15:53:32.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:32.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj431 td/osd-backfill-space/4kdata 2020-09-08T15:53:32.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:32.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj432 td/osd-backfill-space/4kdata 2020-09-08T15:53:32.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:32.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj433 td/osd-backfill-space/4kdata 2020-09-08T15:53:32.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:32.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj434 td/osd-backfill-space/4kdata 2020-09-08T15:53:33.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:33.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj435 td/osd-backfill-space/4kdata 2020-09-08T15:53:33.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:33.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj436 td/osd-backfill-space/4kdata 2020-09-08T15:53:33.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:33.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj437 td/osd-backfill-space/4kdata 2020-09-08T15:53:33.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:33.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj438 td/osd-backfill-space/4kdata 2020-09-08T15:53:33.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:33.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj439 td/osd-backfill-space/4kdata 2020-09-08T15:53:33.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:33.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj440 td/osd-backfill-space/4kdata 2020-09-08T15:53:33.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:33.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj441 td/osd-backfill-space/4kdata 2020-09-08T15:53:34.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:34.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj442 td/osd-backfill-space/4kdata 2020-09-08T15:53:34.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:34.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj443 td/osd-backfill-space/4kdata 2020-09-08T15:53:34.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:34.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj444 td/osd-backfill-space/4kdata 2020-09-08T15:53:34.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:34.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj445 td/osd-backfill-space/4kdata 2020-09-08T15:53:34.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:34.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj446 td/osd-backfill-space/4kdata 2020-09-08T15:53:34.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:34.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj447 td/osd-backfill-space/4kdata 2020-09-08T15:53:34.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:34.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj448 td/osd-backfill-space/4kdata 2020-09-08T15:53:35.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:35.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj449 td/osd-backfill-space/4kdata 2020-09-08T15:53:35.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:35.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj450 td/osd-backfill-space/4kdata 2020-09-08T15:53:35.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:35.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj451 td/osd-backfill-space/4kdata 2020-09-08T15:53:35.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:35.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj452 td/osd-backfill-space/4kdata 2020-09-08T15:53:35.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:35.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj453 td/osd-backfill-space/4kdata 2020-09-08T15:53:35.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:35.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj454 td/osd-backfill-space/4kdata 2020-09-08T15:53:35.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:35.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj455 td/osd-backfill-space/4kdata 2020-09-08T15:53:35.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:35.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj456 td/osd-backfill-space/4kdata 2020-09-08T15:53:36.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:36.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj457 td/osd-backfill-space/4kdata 2020-09-08T15:53:36.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:36.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj458 td/osd-backfill-space/4kdata 2020-09-08T15:53:36.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:36.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj459 td/osd-backfill-space/4kdata 2020-09-08T15:53:36.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:36.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj460 td/osd-backfill-space/4kdata 2020-09-08T15:53:36.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:36.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj461 td/osd-backfill-space/4kdata 2020-09-08T15:53:36.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:36.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj462 td/osd-backfill-space/4kdata 2020-09-08T15:53:36.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:36.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj463 td/osd-backfill-space/4kdata 2020-09-08T15:53:36.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:36.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj464 td/osd-backfill-space/4kdata 2020-09-08T15:53:37.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:37.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj465 td/osd-backfill-space/4kdata 2020-09-08T15:53:37.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:37.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj466 td/osd-backfill-space/4kdata 2020-09-08T15:53:37.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:37.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj467 td/osd-backfill-space/4kdata 2020-09-08T15:53:37.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:37.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj468 td/osd-backfill-space/4kdata 2020-09-08T15:53:37.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:37.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj469 td/osd-backfill-space/4kdata 2020-09-08T15:53:37.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:37.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj470 td/osd-backfill-space/4kdata 2020-09-08T15:53:37.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:37.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj471 td/osd-backfill-space/4kdata 2020-09-08T15:53:38.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:38.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj472 td/osd-backfill-space/4kdata 2020-09-08T15:53:38.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:38.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj473 td/osd-backfill-space/4kdata 2020-09-08T15:53:38.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:38.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj474 td/osd-backfill-space/4kdata 2020-09-08T15:53:38.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:38.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj475 td/osd-backfill-space/4kdata 2020-09-08T15:53:38.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:38.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj476 td/osd-backfill-space/4kdata 2020-09-08T15:53:38.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:38.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj477 td/osd-backfill-space/4kdata 2020-09-08T15:53:38.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:38.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj478 td/osd-backfill-space/4kdata 2020-09-08T15:53:38.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:38.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj479 td/osd-backfill-space/4kdata 2020-09-08T15:53:39.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:39.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj480 td/osd-backfill-space/4kdata 2020-09-08T15:53:39.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:39.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj481 td/osd-backfill-space/4kdata 2020-09-08T15:53:39.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:39.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj482 td/osd-backfill-space/4kdata 2020-09-08T15:53:39.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:39.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj483 td/osd-backfill-space/4kdata 2020-09-08T15:53:39.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:39.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj484 td/osd-backfill-space/4kdata 2020-09-08T15:53:39.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:39.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj485 td/osd-backfill-space/4kdata 2020-09-08T15:53:39.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:39.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj486 td/osd-backfill-space/4kdata 2020-09-08T15:53:40.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:40.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj487 td/osd-backfill-space/4kdata 2020-09-08T15:53:40.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:40.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj488 td/osd-backfill-space/4kdata 2020-09-08T15:53:40.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:40.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj489 td/osd-backfill-space/4kdata 2020-09-08T15:53:40.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:40.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj490 td/osd-backfill-space/4kdata 2020-09-08T15:53:40.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:40.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj491 td/osd-backfill-space/4kdata 2020-09-08T15:53:40.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:40.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj492 td/osd-backfill-space/4kdata 2020-09-08T15:53:40.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:40.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj493 td/osd-backfill-space/4kdata 2020-09-08T15:53:40.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:40.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj494 td/osd-backfill-space/4kdata 2020-09-08T15:53:41.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:41.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj495 td/osd-backfill-space/4kdata 2020-09-08T15:53:41.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:41.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj496 td/osd-backfill-space/4kdata 2020-09-08T15:53:41.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:41.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj497 td/osd-backfill-space/4kdata 2020-09-08T15:53:41.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:41.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj498 td/osd-backfill-space/4kdata 2020-09-08T15:53:41.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:41.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj499 td/osd-backfill-space/4kdata 2020-09-08T15:53:41.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:41.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj500 td/osd-backfill-space/4kdata 2020-09-08T15:53:41.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:41.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj501 td/osd-backfill-space/4kdata 2020-09-08T15:53:41.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:41.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj502 td/osd-backfill-space/4kdata 2020-09-08T15:53:42.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:42.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj503 td/osd-backfill-space/4kdata 2020-09-08T15:53:42.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:42.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj504 td/osd-backfill-space/4kdata 2020-09-08T15:53:42.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:42.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj505 td/osd-backfill-space/4kdata 2020-09-08T15:53:42.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:42.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj506 td/osd-backfill-space/4kdata 2020-09-08T15:53:42.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:42.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj507 td/osd-backfill-space/4kdata 2020-09-08T15:53:42.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:42.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj508 td/osd-backfill-space/4kdata 2020-09-08T15:53:42.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:42.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj509 td/osd-backfill-space/4kdata 2020-09-08T15:53:42.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:42.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj510 td/osd-backfill-space/4kdata 2020-09-08T15:53:43.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:43.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj511 td/osd-backfill-space/4kdata 2020-09-08T15:53:43.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:43.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj512 td/osd-backfill-space/4kdata 2020-09-08T15:53:43.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:43.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj513 td/osd-backfill-space/4kdata 2020-09-08T15:53:43.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:43.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj514 td/osd-backfill-space/4kdata 2020-09-08T15:53:43.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:43.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj515 td/osd-backfill-space/4kdata 2020-09-08T15:53:43.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:43.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj516 td/osd-backfill-space/4kdata 2020-09-08T15:53:43.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:43.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj517 td/osd-backfill-space/4kdata 2020-09-08T15:53:44.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:44.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj518 td/osd-backfill-space/4kdata 2020-09-08T15:53:44.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:44.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj519 td/osd-backfill-space/4kdata 2020-09-08T15:53:44.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:44.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj520 td/osd-backfill-space/4kdata 2020-09-08T15:53:44.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:44.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj521 td/osd-backfill-space/4kdata 2020-09-08T15:53:44.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:44.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj522 td/osd-backfill-space/4kdata 2020-09-08T15:53:44.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:44.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj523 td/osd-backfill-space/4kdata 2020-09-08T15:53:44.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:44.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj524 td/osd-backfill-space/4kdata 2020-09-08T15:53:44.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:44.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj525 td/osd-backfill-space/4kdata 2020-09-08T15:53:45.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:45.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj526 td/osd-backfill-space/4kdata 2020-09-08T15:53:45.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:45.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj527 td/osd-backfill-space/4kdata 2020-09-08T15:53:45.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:45.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj528 td/osd-backfill-space/4kdata 2020-09-08T15:53:45.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:45.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj529 td/osd-backfill-space/4kdata 2020-09-08T15:53:45.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:45.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj530 td/osd-backfill-space/4kdata 2020-09-08T15:53:45.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:45.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj531 td/osd-backfill-space/4kdata 2020-09-08T15:53:45.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:45.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj532 td/osd-backfill-space/4kdata 2020-09-08T15:53:46.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:46.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj533 td/osd-backfill-space/4kdata 2020-09-08T15:53:46.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:46.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj534 td/osd-backfill-space/4kdata 2020-09-08T15:53:46.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:46.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj535 td/osd-backfill-space/4kdata 2020-09-08T15:53:46.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:46.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj536 td/osd-backfill-space/4kdata 2020-09-08T15:53:46.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:46.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj537 td/osd-backfill-space/4kdata 2020-09-08T15:53:46.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:46.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj538 td/osd-backfill-space/4kdata 2020-09-08T15:53:46.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:46.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj539 td/osd-backfill-space/4kdata 2020-09-08T15:53:46.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:46.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj540 td/osd-backfill-space/4kdata 2020-09-08T15:53:47.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:47.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj541 td/osd-backfill-space/4kdata 2020-09-08T15:53:47.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:47.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj542 td/osd-backfill-space/4kdata 2020-09-08T15:53:47.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:47.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj543 td/osd-backfill-space/4kdata 2020-09-08T15:53:47.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:47.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj544 td/osd-backfill-space/4kdata 2020-09-08T15:53:47.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:47.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj545 td/osd-backfill-space/4kdata 2020-09-08T15:53:47.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:47.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj546 td/osd-backfill-space/4kdata 2020-09-08T15:53:47.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:47.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj547 td/osd-backfill-space/4kdata 2020-09-08T15:53:47.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:47.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj548 td/osd-backfill-space/4kdata 2020-09-08T15:53:48.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:48.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj549 td/osd-backfill-space/4kdata 2020-09-08T15:53:48.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:48.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj550 td/osd-backfill-space/4kdata 2020-09-08T15:53:48.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:48.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj551 td/osd-backfill-space/4kdata 2020-09-08T15:53:48.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:48.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj552 td/osd-backfill-space/4kdata 2020-09-08T15:53:48.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:48.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj553 td/osd-backfill-space/4kdata 2020-09-08T15:53:48.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:48.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj554 td/osd-backfill-space/4kdata 2020-09-08T15:53:48.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:48.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj555 td/osd-backfill-space/4kdata 2020-09-08T15:53:49.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:49.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj556 td/osd-backfill-space/4kdata 2020-09-08T15:53:49.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:49.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj557 td/osd-backfill-space/4kdata 2020-09-08T15:53:49.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:49.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj558 td/osd-backfill-space/4kdata 2020-09-08T15:53:49.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:49.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj559 td/osd-backfill-space/4kdata 2020-09-08T15:53:49.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:49.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj560 td/osd-backfill-space/4kdata 2020-09-08T15:53:49.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:49.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj561 td/osd-backfill-space/4kdata 2020-09-08T15:53:49.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:49.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj562 td/osd-backfill-space/4kdata 2020-09-08T15:53:49.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:49.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj563 td/osd-backfill-space/4kdata 2020-09-08T15:53:50.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:50.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj564 td/osd-backfill-space/4kdata 2020-09-08T15:53:50.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:50.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj565 td/osd-backfill-space/4kdata 2020-09-08T15:53:50.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:50.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj566 td/osd-backfill-space/4kdata 2020-09-08T15:53:50.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:50.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj567 td/osd-backfill-space/4kdata 2020-09-08T15:53:50.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:50.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj568 td/osd-backfill-space/4kdata 2020-09-08T15:53:50.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:50.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj569 td/osd-backfill-space/4kdata 2020-09-08T15:53:50.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:50.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj570 td/osd-backfill-space/4kdata 2020-09-08T15:53:50.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:50.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj571 td/osd-backfill-space/4kdata 2020-09-08T15:53:51.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:51.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj572 td/osd-backfill-space/4kdata 2020-09-08T15:53:51.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:51.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj573 td/osd-backfill-space/4kdata 2020-09-08T15:53:51.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:51.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj574 td/osd-backfill-space/4kdata 2020-09-08T15:53:51.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:51.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj575 td/osd-backfill-space/4kdata 2020-09-08T15:53:51.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:51.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj576 td/osd-backfill-space/4kdata 2020-09-08T15:53:51.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:51.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj577 td/osd-backfill-space/4kdata 2020-09-08T15:53:51.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:51.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj578 td/osd-backfill-space/4kdata 2020-09-08T15:53:52.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:52.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj579 td/osd-backfill-space/4kdata 2020-09-08T15:53:52.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:52.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj580 td/osd-backfill-space/4kdata 2020-09-08T15:53:52.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:52.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj581 td/osd-backfill-space/4kdata 2020-09-08T15:53:52.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:52.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj582 td/osd-backfill-space/4kdata 2020-09-08T15:53:52.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:52.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj583 td/osd-backfill-space/4kdata 2020-09-08T15:53:52.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:52.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj584 td/osd-backfill-space/4kdata 2020-09-08T15:53:52.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:52.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj585 td/osd-backfill-space/4kdata 2020-09-08T15:53:52.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:52.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj586 td/osd-backfill-space/4kdata 2020-09-08T15:53:53.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:53.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj587 td/osd-backfill-space/4kdata 2020-09-08T15:53:53.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:53.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj588 td/osd-backfill-space/4kdata 2020-09-08T15:53:53.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:53.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj589 td/osd-backfill-space/4kdata 2020-09-08T15:53:53.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:53.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj590 td/osd-backfill-space/4kdata 2020-09-08T15:53:53.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:53.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj591 td/osd-backfill-space/4kdata 2020-09-08T15:53:53.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:53.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj592 td/osd-backfill-space/4kdata 2020-09-08T15:53:53.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:53.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj593 td/osd-backfill-space/4kdata 2020-09-08T15:53:53.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:53.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj594 td/osd-backfill-space/4kdata 2020-09-08T15:53:54.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:54.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj595 td/osd-backfill-space/4kdata 2020-09-08T15:53:54.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:54.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj596 td/osd-backfill-space/4kdata 2020-09-08T15:53:54.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:54.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj597 td/osd-backfill-space/4kdata 2020-09-08T15:53:54.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:54.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj598 td/osd-backfill-space/4kdata 2020-09-08T15:53:54.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:54.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj599 td/osd-backfill-space/4kdata 2020-09-08T15:53:54.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:578: TEST_backfill_grow: for i in $(seq 1 $objects) 2020-09-08T15:53:54.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:580: TEST_backfill_grow: rados -p test put obj600 td/osd-backfill-space/4kdata 2020-09-08T15:53:54.902 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:583: TEST_backfill_grow: get_pg test obj1 2020-09-08T15:53:54.902 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1031: get_pg: local poolname=test 2020-09-08T15:53:54.903 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: local objectname=obj1 2020-09-08T15:53:54.903 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: ceph --format json osd map test obj1 2020-09-08T15:53:54.903 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: jq -r .pgid 2020-09-08T15:53:55.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:583: TEST_backfill_grow: local PG=1.0 2020-09-08T15:53:55.302 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:585: TEST_backfill_grow: get_primary test obj1 2020-09-08T15:53:55.302 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T15:53:55.303 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T15:53:55.303 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T15:53:55.303 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T15:53:55.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:585: TEST_backfill_grow: local primary=1 2020-09-08T15:53:55.729 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:586: TEST_backfill_grow: get_not_primary test obj1 2020-09-08T15:53:55.729 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1167: get_not_primary: local poolname=test 2020-09-08T15:53:55.729 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: get_not_primary: local objectname=obj1 2020-09-08T15:53:55.729 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: get_primary test obj1 2020-09-08T15:53:55.730 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T15:53:55.730 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T15:53:55.730 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T15:53:55.730 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T15:53:56.125 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: local primary=1 2020-09-08T15:53:56.126 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1172: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2020-09-08T15:53:56.126 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1171: get_not_primary: ceph --format json osd map test obj1 2020-09-08T15:53:56.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:586: TEST_backfill_grow: local otherosd=0 2020-09-08T15:53:56.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:588: TEST_backfill_grow: ceph osd set noout 2020-09-08T15:53:57.239 INFO:tasks.workunit.client.0.smithi065.stderr:noout is set 2020-09-08T15:53:57.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:589: TEST_backfill_grow: kill_daemons td/osd-backfill-space TERM 0 2020-09-08T15:53:57.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:53:57.248 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:53:57.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:53:57.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:53:57.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:53:57.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:53:57.354 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:591: TEST_backfill_grow: expr 600 / 4 2020-09-08T15:53:57.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:591: TEST_backfill_grow: rmobjects=150 2020-09-08T15:53:57.355 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: seq 1 150 2020-09-08T15:53:57.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:53:57.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj1 2020-09-08T15:53:58.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:53:58.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj2 2020-09-08T15:53:58.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:53:58.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj3 2020-09-08T15:53:58.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:53:58.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj4 2020-09-08T15:53:58.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:53:58.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj5 2020-09-08T15:53:58.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:53:58.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj6 2020-09-08T15:53:58.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:53:58.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj7 2020-09-08T15:53:58.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:53:58.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj8 2020-09-08T15:53:58.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:53:58.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj9 2020-09-08T15:53:58.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:53:58.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj10 2020-09-08T15:53:58.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:53:58.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj11 2020-09-08T15:53:59.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:53:59.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj12 2020-09-08T15:53:59.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:53:59.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj13 2020-09-08T15:53:59.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:53:59.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj14 2020-09-08T15:53:59.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:53:59.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj15 2020-09-08T15:53:59.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:53:59.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj16 2020-09-08T15:53:59.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:53:59.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj17 2020-09-08T15:53:59.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:53:59.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj18 2020-09-08T15:53:59.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:53:59.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj19 2020-09-08T15:53:59.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:53:59.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj20 2020-09-08T15:54:00.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:00.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj21 2020-09-08T15:54:00.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:00.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj22 2020-09-08T15:54:00.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:00.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj23 2020-09-08T15:54:00.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:00.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj24 2020-09-08T15:54:00.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:00.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj25 2020-09-08T15:54:00.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:00.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj26 2020-09-08T15:54:00.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:00.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj27 2020-09-08T15:54:00.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:00.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj28 2020-09-08T15:54:00.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:00.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj29 2020-09-08T15:54:00.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:00.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj30 2020-09-08T15:54:01.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:01.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj31 2020-09-08T15:54:01.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:01.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj32 2020-09-08T15:54:01.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:01.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj33 2020-09-08T15:54:01.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:01.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj34 2020-09-08T15:54:01.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:01.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj35 2020-09-08T15:54:01.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:01.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj36 2020-09-08T15:54:01.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:01.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj37 2020-09-08T15:54:01.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:01.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj38 2020-09-08T15:54:01.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:01.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj39 2020-09-08T15:54:01.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:01.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj40 2020-09-08T15:54:02.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:02.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj41 2020-09-08T15:54:02.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:02.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj42 2020-09-08T15:54:02.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:02.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj43 2020-09-08T15:54:02.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:02.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj44 2020-09-08T15:54:02.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:02.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj45 2020-09-08T15:54:02.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:02.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj46 2020-09-08T15:54:02.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:02.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj47 2020-09-08T15:54:02.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:02.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj48 2020-09-08T15:54:02.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:02.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj49 2020-09-08T15:54:02.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:02.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj50 2020-09-08T15:54:03.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:03.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj51 2020-09-08T15:54:03.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:03.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj52 2020-09-08T15:54:03.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:03.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj53 2020-09-08T15:54:03.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:03.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj54 2020-09-08T15:54:03.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:03.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj55 2020-09-08T15:54:03.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:03.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj56 2020-09-08T15:54:03.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:03.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj57 2020-09-08T15:54:03.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:03.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj58 2020-09-08T15:54:03.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:03.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj59 2020-09-08T15:54:03.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:03.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj60 2020-09-08T15:54:03.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:03.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj61 2020-09-08T15:54:04.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:04.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj62 2020-09-08T15:54:04.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:04.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj63 2020-09-08T15:54:04.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:04.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj64 2020-09-08T15:54:04.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:04.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj65 2020-09-08T15:54:04.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:04.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj66 2020-09-08T15:54:04.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:04.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj67 2020-09-08T15:54:04.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:04.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj68 2020-09-08T15:54:04.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:04.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj69 2020-09-08T15:54:04.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:04.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj70 2020-09-08T15:54:04.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:04.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj71 2020-09-08T15:54:05.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:05.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj72 2020-09-08T15:54:05.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:05.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj73 2020-09-08T15:54:05.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:05.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj74 2020-09-08T15:54:05.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:05.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj75 2020-09-08T15:54:05.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:05.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj76 2020-09-08T15:54:05.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:05.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj77 2020-09-08T15:54:05.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:05.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj78 2020-09-08T15:54:06.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:06.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj79 2020-09-08T15:54:06.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:06.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj80 2020-09-08T15:54:06.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:06.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj81 2020-09-08T15:54:06.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:06.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj82 2020-09-08T15:54:06.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:06.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj83 2020-09-08T15:54:06.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:06.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj84 2020-09-08T15:54:06.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:06.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj85 2020-09-08T15:54:06.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:06.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj86 2020-09-08T15:54:06.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:06.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj87 2020-09-08T15:54:06.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:06.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj88 2020-09-08T15:54:07.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:07.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj89 2020-09-08T15:54:07.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:07.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj90 2020-09-08T15:54:07.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:07.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj91 2020-09-08T15:54:07.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:07.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj92 2020-09-08T15:54:07.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:07.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj93 2020-09-08T15:54:07.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:07.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj94 2020-09-08T15:54:07.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:07.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj95 2020-09-08T15:54:07.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:07.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj96 2020-09-08T15:54:07.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:07.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj97 2020-09-08T15:54:07.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:07.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj98 2020-09-08T15:54:07.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:07.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj99 2020-09-08T15:54:08.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:08.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj100 2020-09-08T15:54:08.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:08.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj101 2020-09-08T15:54:08.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:08.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj102 2020-09-08T15:54:08.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:08.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj103 2020-09-08T15:54:08.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:08.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj104 2020-09-08T15:54:08.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:08.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj105 2020-09-08T15:54:08.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:08.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj106 2020-09-08T15:54:08.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:08.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj107 2020-09-08T15:54:08.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:08.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj108 2020-09-08T15:54:08.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:08.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj109 2020-09-08T15:54:09.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:09.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj110 2020-09-08T15:54:09.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:09.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj111 2020-09-08T15:54:09.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:09.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj112 2020-09-08T15:54:09.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:09.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj113 2020-09-08T15:54:09.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:09.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj114 2020-09-08T15:54:09.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:09.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj115 2020-09-08T15:54:09.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:09.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj116 2020-09-08T15:54:09.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:09.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj117 2020-09-08T15:54:09.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:09.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj118 2020-09-08T15:54:10.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:10.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj119 2020-09-08T15:54:10.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:10.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj120 2020-09-08T15:54:10.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:10.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj121 2020-09-08T15:54:10.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:10.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj122 2020-09-08T15:54:10.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:10.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj123 2020-09-08T15:54:10.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:10.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj124 2020-09-08T15:54:10.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:10.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj125 2020-09-08T15:54:10.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:10.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj126 2020-09-08T15:54:10.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:10.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj127 2020-09-08T15:54:10.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:10.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj128 2020-09-08T15:54:11.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:11.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj129 2020-09-08T15:54:11.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:11.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj130 2020-09-08T15:54:11.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:11.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj131 2020-09-08T15:54:11.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:11.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj132 2020-09-08T15:54:11.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:11.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj133 2020-09-08T15:54:11.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:11.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj134 2020-09-08T15:54:11.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:11.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj135 2020-09-08T15:54:11.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:11.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj136 2020-09-08T15:54:11.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:11.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj137 2020-09-08T15:54:11.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:11.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj138 2020-09-08T15:54:12.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:12.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj139 2020-09-08T15:54:12.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:12.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj140 2020-09-08T15:54:12.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:12.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj141 2020-09-08T15:54:12.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:12.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj142 2020-09-08T15:54:12.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:12.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj143 2020-09-08T15:54:12.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:12.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj144 2020-09-08T15:54:12.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:12.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj145 2020-09-08T15:54:12.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:12.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj146 2020-09-08T15:54:12.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:12.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj147 2020-09-08T15:54:12.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:12.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj148 2020-09-08T15:54:13.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:13.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj149 2020-09-08T15:54:13.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:592: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T15:54:13.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:594: TEST_backfill_grow: rados -p test rm obj150 2020-09-08T15:54:13.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:597: TEST_backfill_grow: dd if=/dev/urandom of=td/osd-backfill-space/6kdata bs=6k count=1 2020-09-08T15:54:13.289 INFO:tasks.workunit.client.0.smithi065.stderr:1+0 records in 2020-09-08T15:54:13.289 INFO:tasks.workunit.client.0.smithi065.stderr:1+0 records out 2020-09-08T15:54:13.290 INFO:tasks.workunit.client.0.smithi065.stderr:6144 bytes (6.1 kB, 6.0 KiB) copied, 7.3828e-05 s, 83.2 MB/s 2020-09-08T15:54:13.290 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: expr 150 + 1 2020-09-08T15:54:13.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: seq 151 600 2020-09-08T15:54:13.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:13.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj151 td/osd-backfill-space/6kdata 2020-09-08T15:54:13.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:13.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj152 td/osd-backfill-space/6kdata 2020-09-08T15:54:13.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:13.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj153 td/osd-backfill-space/6kdata 2020-09-08T15:54:13.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:13.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj154 td/osd-backfill-space/6kdata 2020-09-08T15:54:13.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:13.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj155 td/osd-backfill-space/6kdata 2020-09-08T15:54:13.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:13.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj156 td/osd-backfill-space/6kdata 2020-09-08T15:54:14.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:14.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj157 td/osd-backfill-space/6kdata 2020-09-08T15:54:14.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:14.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj158 td/osd-backfill-space/6kdata 2020-09-08T15:54:14.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:14.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj159 td/osd-backfill-space/6kdata 2020-09-08T15:54:14.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:14.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj160 td/osd-backfill-space/6kdata 2020-09-08T15:54:14.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:14.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj161 td/osd-backfill-space/6kdata 2020-09-08T15:54:14.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:14.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj162 td/osd-backfill-space/6kdata 2020-09-08T15:54:14.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:14.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj163 td/osd-backfill-space/6kdata 2020-09-08T15:54:14.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:14.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj164 td/osd-backfill-space/6kdata 2020-09-08T15:54:15.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:15.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj165 td/osd-backfill-space/6kdata 2020-09-08T15:54:15.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:15.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj166 td/osd-backfill-space/6kdata 2020-09-08T15:54:15.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:15.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj167 td/osd-backfill-space/6kdata 2020-09-08T15:54:15.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:15.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj168 td/osd-backfill-space/6kdata 2020-09-08T15:54:15.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:15.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj169 td/osd-backfill-space/6kdata 2020-09-08T15:54:15.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:15.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj170 td/osd-backfill-space/6kdata 2020-09-08T15:54:15.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:15.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj171 td/osd-backfill-space/6kdata 2020-09-08T15:54:16.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:16.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj172 td/osd-backfill-space/6kdata 2020-09-08T15:54:16.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:16.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj173 td/osd-backfill-space/6kdata 2020-09-08T15:54:16.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:16.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj174 td/osd-backfill-space/6kdata 2020-09-08T15:54:16.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:16.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj175 td/osd-backfill-space/6kdata 2020-09-08T15:54:16.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:16.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj176 td/osd-backfill-space/6kdata 2020-09-08T15:54:16.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:16.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj177 td/osd-backfill-space/6kdata 2020-09-08T15:54:16.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:16.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj178 td/osd-backfill-space/6kdata 2020-09-08T15:54:16.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:16.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj179 td/osd-backfill-space/6kdata 2020-09-08T15:54:17.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:17.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj180 td/osd-backfill-space/6kdata 2020-09-08T15:54:17.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:17.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj181 td/osd-backfill-space/6kdata 2020-09-08T15:54:17.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:17.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj182 td/osd-backfill-space/6kdata 2020-09-08T15:54:17.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:17.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj183 td/osd-backfill-space/6kdata 2020-09-08T15:54:17.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:17.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj184 td/osd-backfill-space/6kdata 2020-09-08T15:54:17.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:17.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj185 td/osd-backfill-space/6kdata 2020-09-08T15:54:17.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:17.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj186 td/osd-backfill-space/6kdata 2020-09-08T15:54:17.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:17.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj187 td/osd-backfill-space/6kdata 2020-09-08T15:54:18.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:18.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj188 td/osd-backfill-space/6kdata 2020-09-08T15:54:18.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:18.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj189 td/osd-backfill-space/6kdata 2020-09-08T15:54:18.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:18.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj190 td/osd-backfill-space/6kdata 2020-09-08T15:54:18.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:18.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj191 td/osd-backfill-space/6kdata 2020-09-08T15:54:18.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:18.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj192 td/osd-backfill-space/6kdata 2020-09-08T15:54:18.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:18.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj193 td/osd-backfill-space/6kdata 2020-09-08T15:54:18.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:18.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj194 td/osd-backfill-space/6kdata 2020-09-08T15:54:18.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:18.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj195 td/osd-backfill-space/6kdata 2020-09-08T15:54:19.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:19.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj196 td/osd-backfill-space/6kdata 2020-09-08T15:54:19.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:19.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj197 td/osd-backfill-space/6kdata 2020-09-08T15:54:19.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:19.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj198 td/osd-backfill-space/6kdata 2020-09-08T15:54:19.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:19.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj199 td/osd-backfill-space/6kdata 2020-09-08T15:54:19.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:19.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj200 td/osd-backfill-space/6kdata 2020-09-08T15:54:19.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:19.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj201 td/osd-backfill-space/6kdata 2020-09-08T15:54:19.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:19.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj202 td/osd-backfill-space/6kdata 2020-09-08T15:54:19.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:19.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj203 td/osd-backfill-space/6kdata 2020-09-08T15:54:20.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:20.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj204 td/osd-backfill-space/6kdata 2020-09-08T15:54:20.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:20.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj205 td/osd-backfill-space/6kdata 2020-09-08T15:54:20.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:20.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj206 td/osd-backfill-space/6kdata 2020-09-08T15:54:20.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:20.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj207 td/osd-backfill-space/6kdata 2020-09-08T15:54:20.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:20.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj208 td/osd-backfill-space/6kdata 2020-09-08T15:54:20.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:20.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj209 td/osd-backfill-space/6kdata 2020-09-08T15:54:20.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:20.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj210 td/osd-backfill-space/6kdata 2020-09-08T15:54:20.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:20.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj211 td/osd-backfill-space/6kdata 2020-09-08T15:54:21.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:21.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj212 td/osd-backfill-space/6kdata 2020-09-08T15:54:21.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:21.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj213 td/osd-backfill-space/6kdata 2020-09-08T15:54:21.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:21.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj214 td/osd-backfill-space/6kdata 2020-09-08T15:54:21.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:21.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj215 td/osd-backfill-space/6kdata 2020-09-08T15:54:21.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:21.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj216 td/osd-backfill-space/6kdata 2020-09-08T15:54:21.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:21.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj217 td/osd-backfill-space/6kdata 2020-09-08T15:54:21.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:21.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj218 td/osd-backfill-space/6kdata 2020-09-08T15:54:21.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:21.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj219 td/osd-backfill-space/6kdata 2020-09-08T15:54:22.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:22.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj220 td/osd-backfill-space/6kdata 2020-09-08T15:54:22.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:22.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj221 td/osd-backfill-space/6kdata 2020-09-08T15:54:22.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:22.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj222 td/osd-backfill-space/6kdata 2020-09-08T15:54:22.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:22.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj223 td/osd-backfill-space/6kdata 2020-09-08T15:54:22.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:22.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj224 td/osd-backfill-space/6kdata 2020-09-08T15:54:22.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:22.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj225 td/osd-backfill-space/6kdata 2020-09-08T15:54:22.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:22.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj226 td/osd-backfill-space/6kdata 2020-09-08T15:54:22.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:22.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj227 td/osd-backfill-space/6kdata 2020-09-08T15:54:23.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:23.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj228 td/osd-backfill-space/6kdata 2020-09-08T15:54:23.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:23.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj229 td/osd-backfill-space/6kdata 2020-09-08T15:54:23.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:23.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj230 td/osd-backfill-space/6kdata 2020-09-08T15:54:23.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:23.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj231 td/osd-backfill-space/6kdata 2020-09-08T15:54:23.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:23.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj232 td/osd-backfill-space/6kdata 2020-09-08T15:54:23.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:23.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj233 td/osd-backfill-space/6kdata 2020-09-08T15:54:23.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:23.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj234 td/osd-backfill-space/6kdata 2020-09-08T15:54:23.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:23.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj235 td/osd-backfill-space/6kdata 2020-09-08T15:54:24.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:24.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj236 td/osd-backfill-space/6kdata 2020-09-08T15:54:24.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:24.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj237 td/osd-backfill-space/6kdata 2020-09-08T15:54:24.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:24.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj238 td/osd-backfill-space/6kdata 2020-09-08T15:54:24.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:24.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj239 td/osd-backfill-space/6kdata 2020-09-08T15:54:24.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:24.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj240 td/osd-backfill-space/6kdata 2020-09-08T15:54:24.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:24.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj241 td/osd-backfill-space/6kdata 2020-09-08T15:54:24.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:24.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj242 td/osd-backfill-space/6kdata 2020-09-08T15:54:24.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:24.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj243 td/osd-backfill-space/6kdata 2020-09-08T15:54:25.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:25.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj244 td/osd-backfill-space/6kdata 2020-09-08T15:54:25.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:25.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj245 td/osd-backfill-space/6kdata 2020-09-08T15:54:25.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:25.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj246 td/osd-backfill-space/6kdata 2020-09-08T15:54:25.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:25.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj247 td/osd-backfill-space/6kdata 2020-09-08T15:54:25.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:25.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj248 td/osd-backfill-space/6kdata 2020-09-08T15:54:25.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:25.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj249 td/osd-backfill-space/6kdata 2020-09-08T15:54:25.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:25.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj250 td/osd-backfill-space/6kdata 2020-09-08T15:54:25.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:25.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj251 td/osd-backfill-space/6kdata 2020-09-08T15:54:26.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:26.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj252 td/osd-backfill-space/6kdata 2020-09-08T15:54:26.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:26.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj253 td/osd-backfill-space/6kdata 2020-09-08T15:54:26.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:26.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj254 td/osd-backfill-space/6kdata 2020-09-08T15:54:26.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:26.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj255 td/osd-backfill-space/6kdata 2020-09-08T15:54:26.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:26.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj256 td/osd-backfill-space/6kdata 2020-09-08T15:54:26.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:26.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj257 td/osd-backfill-space/6kdata 2020-09-08T15:54:26.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:26.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj258 td/osd-backfill-space/6kdata 2020-09-08T15:54:26.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:26.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj259 td/osd-backfill-space/6kdata 2020-09-08T15:54:27.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:27.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj260 td/osd-backfill-space/6kdata 2020-09-08T15:54:27.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:27.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj261 td/osd-backfill-space/6kdata 2020-09-08T15:54:27.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:27.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj262 td/osd-backfill-space/6kdata 2020-09-08T15:54:27.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:27.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj263 td/osd-backfill-space/6kdata 2020-09-08T15:54:27.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:27.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj264 td/osd-backfill-space/6kdata 2020-09-08T15:54:27.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:27.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj265 td/osd-backfill-space/6kdata 2020-09-08T15:54:27.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:27.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj266 td/osd-backfill-space/6kdata 2020-09-08T15:54:27.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:27.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj267 td/osd-backfill-space/6kdata 2020-09-08T15:54:28.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:28.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj268 td/osd-backfill-space/6kdata 2020-09-08T15:54:28.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:28.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj269 td/osd-backfill-space/6kdata 2020-09-08T15:54:28.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:28.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj270 td/osd-backfill-space/6kdata 2020-09-08T15:54:28.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:28.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj271 td/osd-backfill-space/6kdata 2020-09-08T15:54:28.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:28.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj272 td/osd-backfill-space/6kdata 2020-09-08T15:54:28.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:28.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj273 td/osd-backfill-space/6kdata 2020-09-08T15:54:28.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:28.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj274 td/osd-backfill-space/6kdata 2020-09-08T15:54:28.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:28.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj275 td/osd-backfill-space/6kdata 2020-09-08T15:54:29.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:29.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj276 td/osd-backfill-space/6kdata 2020-09-08T15:54:29.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:29.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj277 td/osd-backfill-space/6kdata 2020-09-08T15:54:29.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:29.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj278 td/osd-backfill-space/6kdata 2020-09-08T15:54:29.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:29.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj279 td/osd-backfill-space/6kdata 2020-09-08T15:54:29.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:29.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj280 td/osd-backfill-space/6kdata 2020-09-08T15:54:29.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:29.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj281 td/osd-backfill-space/6kdata 2020-09-08T15:54:29.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:29.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj282 td/osd-backfill-space/6kdata 2020-09-08T15:54:29.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:29.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj283 td/osd-backfill-space/6kdata 2020-09-08T15:54:30.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:30.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj284 td/osd-backfill-space/6kdata 2020-09-08T15:54:30.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:30.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj285 td/osd-backfill-space/6kdata 2020-09-08T15:54:30.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:30.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj286 td/osd-backfill-space/6kdata 2020-09-08T15:54:30.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:30.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj287 td/osd-backfill-space/6kdata 2020-09-08T15:54:30.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:30.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj288 td/osd-backfill-space/6kdata 2020-09-08T15:54:30.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:30.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj289 td/osd-backfill-space/6kdata 2020-09-08T15:54:30.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:30.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj290 td/osd-backfill-space/6kdata 2020-09-08T15:54:30.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:30.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj291 td/osd-backfill-space/6kdata 2020-09-08T15:54:31.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:31.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj292 td/osd-backfill-space/6kdata 2020-09-08T15:54:31.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:31.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj293 td/osd-backfill-space/6kdata 2020-09-08T15:54:31.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:31.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj294 td/osd-backfill-space/6kdata 2020-09-08T15:54:31.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:31.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj295 td/osd-backfill-space/6kdata 2020-09-08T15:54:31.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:31.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj296 td/osd-backfill-space/6kdata 2020-09-08T15:54:31.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:31.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj297 td/osd-backfill-space/6kdata 2020-09-08T15:54:31.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:31.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj298 td/osd-backfill-space/6kdata 2020-09-08T15:54:31.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:31.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj299 td/osd-backfill-space/6kdata 2020-09-08T15:54:32.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:32.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj300 td/osd-backfill-space/6kdata 2020-09-08T15:54:32.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:32.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj301 td/osd-backfill-space/6kdata 2020-09-08T15:54:32.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:32.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj302 td/osd-backfill-space/6kdata 2020-09-08T15:54:32.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:32.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj303 td/osd-backfill-space/6kdata 2020-09-08T15:54:32.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:32.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj304 td/osd-backfill-space/6kdata 2020-09-08T15:54:32.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:32.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj305 td/osd-backfill-space/6kdata 2020-09-08T15:54:32.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:32.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj306 td/osd-backfill-space/6kdata 2020-09-08T15:54:32.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:32.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj307 td/osd-backfill-space/6kdata 2020-09-08T15:54:33.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:33.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj308 td/osd-backfill-space/6kdata 2020-09-08T15:54:33.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:33.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj309 td/osd-backfill-space/6kdata 2020-09-08T15:54:33.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:33.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj310 td/osd-backfill-space/6kdata 2020-09-08T15:54:33.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:33.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj311 td/osd-backfill-space/6kdata 2020-09-08T15:54:33.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:33.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj312 td/osd-backfill-space/6kdata 2020-09-08T15:54:33.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:33.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj313 td/osd-backfill-space/6kdata 2020-09-08T15:54:33.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:33.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj314 td/osd-backfill-space/6kdata 2020-09-08T15:54:33.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:33.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj315 td/osd-backfill-space/6kdata 2020-09-08T15:54:34.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:34.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj316 td/osd-backfill-space/6kdata 2020-09-08T15:54:34.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:34.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj317 td/osd-backfill-space/6kdata 2020-09-08T15:54:34.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:34.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj318 td/osd-backfill-space/6kdata 2020-09-08T15:54:34.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:34.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj319 td/osd-backfill-space/6kdata 2020-09-08T15:54:34.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:34.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj320 td/osd-backfill-space/6kdata 2020-09-08T15:54:34.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:34.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj321 td/osd-backfill-space/6kdata 2020-09-08T15:54:34.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:34.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj322 td/osd-backfill-space/6kdata 2020-09-08T15:54:34.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:34.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj323 td/osd-backfill-space/6kdata 2020-09-08T15:54:35.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:35.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj324 td/osd-backfill-space/6kdata 2020-09-08T15:54:35.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:35.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj325 td/osd-backfill-space/6kdata 2020-09-08T15:54:35.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:35.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj326 td/osd-backfill-space/6kdata 2020-09-08T15:54:35.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:35.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj327 td/osd-backfill-space/6kdata 2020-09-08T15:54:35.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:35.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj328 td/osd-backfill-space/6kdata 2020-09-08T15:54:35.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:35.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj329 td/osd-backfill-space/6kdata 2020-09-08T15:54:35.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:35.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj330 td/osd-backfill-space/6kdata 2020-09-08T15:54:35.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:35.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj331 td/osd-backfill-space/6kdata 2020-09-08T15:54:36.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:36.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj332 td/osd-backfill-space/6kdata 2020-09-08T15:54:36.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:36.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj333 td/osd-backfill-space/6kdata 2020-09-08T15:54:36.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:36.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj334 td/osd-backfill-space/6kdata 2020-09-08T15:54:36.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:36.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj335 td/osd-backfill-space/6kdata 2020-09-08T15:54:36.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:36.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj336 td/osd-backfill-space/6kdata 2020-09-08T15:54:37.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:37.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj337 td/osd-backfill-space/6kdata 2020-09-08T15:54:37.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:37.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj338 td/osd-backfill-space/6kdata 2020-09-08T15:54:37.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:37.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj339 td/osd-backfill-space/6kdata 2020-09-08T15:54:37.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:37.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj340 td/osd-backfill-space/6kdata 2020-09-08T15:54:37.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:37.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj341 td/osd-backfill-space/6kdata 2020-09-08T15:54:37.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:37.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj342 td/osd-backfill-space/6kdata 2020-09-08T15:54:37.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:37.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj343 td/osd-backfill-space/6kdata 2020-09-08T15:54:37.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:37.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj344 td/osd-backfill-space/6kdata 2020-09-08T15:54:38.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:38.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj345 td/osd-backfill-space/6kdata 2020-09-08T15:54:38.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:38.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj346 td/osd-backfill-space/6kdata 2020-09-08T15:54:38.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:38.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj347 td/osd-backfill-space/6kdata 2020-09-08T15:54:38.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:38.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj348 td/osd-backfill-space/6kdata 2020-09-08T15:54:38.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:38.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj349 td/osd-backfill-space/6kdata 2020-09-08T15:54:38.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:38.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj350 td/osd-backfill-space/6kdata 2020-09-08T15:54:38.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:38.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj351 td/osd-backfill-space/6kdata 2020-09-08T15:54:38.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:38.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj352 td/osd-backfill-space/6kdata 2020-09-08T15:54:39.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:39.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj353 td/osd-backfill-space/6kdata 2020-09-08T15:54:39.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:39.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj354 td/osd-backfill-space/6kdata 2020-09-08T15:54:39.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:39.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj355 td/osd-backfill-space/6kdata 2020-09-08T15:54:39.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:39.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj356 td/osd-backfill-space/6kdata 2020-09-08T15:54:39.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:39.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj357 td/osd-backfill-space/6kdata 2020-09-08T15:54:39.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:39.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj358 td/osd-backfill-space/6kdata 2020-09-08T15:54:39.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:39.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj359 td/osd-backfill-space/6kdata 2020-09-08T15:54:39.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:39.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj360 td/osd-backfill-space/6kdata 2020-09-08T15:54:40.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:40.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj361 td/osd-backfill-space/6kdata 2020-09-08T15:54:40.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:40.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj362 td/osd-backfill-space/6kdata 2020-09-08T15:54:40.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:40.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj363 td/osd-backfill-space/6kdata 2020-09-08T15:54:40.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:40.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj364 td/osd-backfill-space/6kdata 2020-09-08T15:54:40.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:40.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj365 td/osd-backfill-space/6kdata 2020-09-08T15:54:40.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:40.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj366 td/osd-backfill-space/6kdata 2020-09-08T15:54:40.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:40.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj367 td/osd-backfill-space/6kdata 2020-09-08T15:54:40.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:40.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj368 td/osd-backfill-space/6kdata 2020-09-08T15:54:41.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:41.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj369 td/osd-backfill-space/6kdata 2020-09-08T15:54:41.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:41.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj370 td/osd-backfill-space/6kdata 2020-09-08T15:54:41.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:41.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj371 td/osd-backfill-space/6kdata 2020-09-08T15:54:41.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:41.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj372 td/osd-backfill-space/6kdata 2020-09-08T15:54:41.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:41.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj373 td/osd-backfill-space/6kdata 2020-09-08T15:54:41.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:41.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj374 td/osd-backfill-space/6kdata 2020-09-08T15:54:41.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:41.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj375 td/osd-backfill-space/6kdata 2020-09-08T15:54:41.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:41.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj376 td/osd-backfill-space/6kdata 2020-09-08T15:54:42.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:42.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj377 td/osd-backfill-space/6kdata 2020-09-08T15:54:42.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:42.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj378 td/osd-backfill-space/6kdata 2020-09-08T15:54:42.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:42.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj379 td/osd-backfill-space/6kdata 2020-09-08T15:54:42.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:42.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj380 td/osd-backfill-space/6kdata 2020-09-08T15:54:42.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:42.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj381 td/osd-backfill-space/6kdata 2020-09-08T15:54:42.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:42.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj382 td/osd-backfill-space/6kdata 2020-09-08T15:54:42.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:42.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj383 td/osd-backfill-space/6kdata 2020-09-08T15:54:42.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:42.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj384 td/osd-backfill-space/6kdata 2020-09-08T15:54:43.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:43.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj385 td/osd-backfill-space/6kdata 2020-09-08T15:54:43.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:43.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj386 td/osd-backfill-space/6kdata 2020-09-08T15:54:43.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:43.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj387 td/osd-backfill-space/6kdata 2020-09-08T15:54:43.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:43.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj388 td/osd-backfill-space/6kdata 2020-09-08T15:54:43.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:43.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj389 td/osd-backfill-space/6kdata 2020-09-08T15:54:43.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:43.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj390 td/osd-backfill-space/6kdata 2020-09-08T15:54:43.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:43.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj391 td/osd-backfill-space/6kdata 2020-09-08T15:54:43.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:43.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj392 td/osd-backfill-space/6kdata 2020-09-08T15:54:44.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:44.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj393 td/osd-backfill-space/6kdata 2020-09-08T15:54:44.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:44.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj394 td/osd-backfill-space/6kdata 2020-09-08T15:54:44.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:44.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj395 td/osd-backfill-space/6kdata 2020-09-08T15:54:44.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:44.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj396 td/osd-backfill-space/6kdata 2020-09-08T15:54:44.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:44.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj397 td/osd-backfill-space/6kdata 2020-09-08T15:54:44.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:44.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj398 td/osd-backfill-space/6kdata 2020-09-08T15:54:44.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:44.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj399 td/osd-backfill-space/6kdata 2020-09-08T15:54:44.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:44.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj400 td/osd-backfill-space/6kdata 2020-09-08T15:54:45.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:45.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj401 td/osd-backfill-space/6kdata 2020-09-08T15:54:45.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:45.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj402 td/osd-backfill-space/6kdata 2020-09-08T15:54:45.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:45.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj403 td/osd-backfill-space/6kdata 2020-09-08T15:54:45.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:45.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj404 td/osd-backfill-space/6kdata 2020-09-08T15:54:45.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:45.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj405 td/osd-backfill-space/6kdata 2020-09-08T15:54:45.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:45.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj406 td/osd-backfill-space/6kdata 2020-09-08T15:54:45.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:45.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj407 td/osd-backfill-space/6kdata 2020-09-08T15:54:45.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:45.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj408 td/osd-backfill-space/6kdata 2020-09-08T15:54:46.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:46.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj409 td/osd-backfill-space/6kdata 2020-09-08T15:54:46.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:46.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj410 td/osd-backfill-space/6kdata 2020-09-08T15:54:46.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:46.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj411 td/osd-backfill-space/6kdata 2020-09-08T15:54:46.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:46.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj412 td/osd-backfill-space/6kdata 2020-09-08T15:54:46.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:46.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj413 td/osd-backfill-space/6kdata 2020-09-08T15:54:46.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:46.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj414 td/osd-backfill-space/6kdata 2020-09-08T15:54:46.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:46.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj415 td/osd-backfill-space/6kdata 2020-09-08T15:54:46.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:46.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj416 td/osd-backfill-space/6kdata 2020-09-08T15:54:47.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:47.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj417 td/osd-backfill-space/6kdata 2020-09-08T15:54:47.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:47.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj418 td/osd-backfill-space/6kdata 2020-09-08T15:54:47.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:47.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj419 td/osd-backfill-space/6kdata 2020-09-08T15:54:47.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:47.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj420 td/osd-backfill-space/6kdata 2020-09-08T15:54:47.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:47.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj421 td/osd-backfill-space/6kdata 2020-09-08T15:54:47.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:47.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj422 td/osd-backfill-space/6kdata 2020-09-08T15:54:47.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:47.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj423 td/osd-backfill-space/6kdata 2020-09-08T15:54:48.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:48.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj424 td/osd-backfill-space/6kdata 2020-09-08T15:54:48.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:48.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj425 td/osd-backfill-space/6kdata 2020-09-08T15:54:48.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:48.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj426 td/osd-backfill-space/6kdata 2020-09-08T15:54:48.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:48.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj427 td/osd-backfill-space/6kdata 2020-09-08T15:54:48.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:48.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj428 td/osd-backfill-space/6kdata 2020-09-08T15:54:48.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:48.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj429 td/osd-backfill-space/6kdata 2020-09-08T15:54:48.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:48.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj430 td/osd-backfill-space/6kdata 2020-09-08T15:54:48.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:48.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj431 td/osd-backfill-space/6kdata 2020-09-08T15:54:49.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:49.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj432 td/osd-backfill-space/6kdata 2020-09-08T15:54:49.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:49.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj433 td/osd-backfill-space/6kdata 2020-09-08T15:54:49.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:49.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj434 td/osd-backfill-space/6kdata 2020-09-08T15:54:49.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:49.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj435 td/osd-backfill-space/6kdata 2020-09-08T15:54:49.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:49.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj436 td/osd-backfill-space/6kdata 2020-09-08T15:54:49.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:49.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj437 td/osd-backfill-space/6kdata 2020-09-08T15:54:49.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:49.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj438 td/osd-backfill-space/6kdata 2020-09-08T15:54:49.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:49.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj439 td/osd-backfill-space/6kdata 2020-09-08T15:54:50.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:50.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj440 td/osd-backfill-space/6kdata 2020-09-08T15:54:50.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:50.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj441 td/osd-backfill-space/6kdata 2020-09-08T15:54:50.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:50.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj442 td/osd-backfill-space/6kdata 2020-09-08T15:54:50.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:50.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj443 td/osd-backfill-space/6kdata 2020-09-08T15:54:50.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:50.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj444 td/osd-backfill-space/6kdata 2020-09-08T15:54:50.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:50.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj445 td/osd-backfill-space/6kdata 2020-09-08T15:54:50.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:50.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj446 td/osd-backfill-space/6kdata 2020-09-08T15:54:50.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:50.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj447 td/osd-backfill-space/6kdata 2020-09-08T15:54:51.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:51.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj448 td/osd-backfill-space/6kdata 2020-09-08T15:54:51.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:51.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj449 td/osd-backfill-space/6kdata 2020-09-08T15:54:51.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:51.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj450 td/osd-backfill-space/6kdata 2020-09-08T15:54:51.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:51.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj451 td/osd-backfill-space/6kdata 2020-09-08T15:54:51.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:51.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj452 td/osd-backfill-space/6kdata 2020-09-08T15:54:51.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:51.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj453 td/osd-backfill-space/6kdata 2020-09-08T15:54:51.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:51.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj454 td/osd-backfill-space/6kdata 2020-09-08T15:54:51.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:51.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj455 td/osd-backfill-space/6kdata 2020-09-08T15:54:52.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:52.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj456 td/osd-backfill-space/6kdata 2020-09-08T15:54:52.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:52.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj457 td/osd-backfill-space/6kdata 2020-09-08T15:54:52.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:52.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj458 td/osd-backfill-space/6kdata 2020-09-08T15:54:52.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:52.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj459 td/osd-backfill-space/6kdata 2020-09-08T15:54:52.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:52.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj460 td/osd-backfill-space/6kdata 2020-09-08T15:54:52.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:52.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj461 td/osd-backfill-space/6kdata 2020-09-08T15:54:52.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:52.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj462 td/osd-backfill-space/6kdata 2020-09-08T15:54:52.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:52.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj463 td/osd-backfill-space/6kdata 2020-09-08T15:54:53.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:53.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj464 td/osd-backfill-space/6kdata 2020-09-08T15:54:53.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:53.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj465 td/osd-backfill-space/6kdata 2020-09-08T15:54:53.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:53.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj466 td/osd-backfill-space/6kdata 2020-09-08T15:54:53.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:53.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj467 td/osd-backfill-space/6kdata 2020-09-08T15:54:53.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:53.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj468 td/osd-backfill-space/6kdata 2020-09-08T15:54:53.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:53.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj469 td/osd-backfill-space/6kdata 2020-09-08T15:54:53.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:53.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj470 td/osd-backfill-space/6kdata 2020-09-08T15:54:53.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:53.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj471 td/osd-backfill-space/6kdata 2020-09-08T15:54:54.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:54.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj472 td/osd-backfill-space/6kdata 2020-09-08T15:54:54.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:54.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj473 td/osd-backfill-space/6kdata 2020-09-08T15:54:54.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:54.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj474 td/osd-backfill-space/6kdata 2020-09-08T15:54:54.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:54.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj475 td/osd-backfill-space/6kdata 2020-09-08T15:54:54.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:54.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj476 td/osd-backfill-space/6kdata 2020-09-08T15:54:54.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:54.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj477 td/osd-backfill-space/6kdata 2020-09-08T15:54:54.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:54.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj478 td/osd-backfill-space/6kdata 2020-09-08T15:54:54.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:54.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj479 td/osd-backfill-space/6kdata 2020-09-08T15:54:55.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:55.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj480 td/osd-backfill-space/6kdata 2020-09-08T15:54:55.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:55.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj481 td/osd-backfill-space/6kdata 2020-09-08T15:54:55.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:55.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj482 td/osd-backfill-space/6kdata 2020-09-08T15:54:55.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:55.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj483 td/osd-backfill-space/6kdata 2020-09-08T15:54:55.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:55.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj484 td/osd-backfill-space/6kdata 2020-09-08T15:54:55.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:55.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj485 td/osd-backfill-space/6kdata 2020-09-08T15:54:55.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:55.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj486 td/osd-backfill-space/6kdata 2020-09-08T15:54:55.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:55.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj487 td/osd-backfill-space/6kdata 2020-09-08T15:54:56.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:56.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj488 td/osd-backfill-space/6kdata 2020-09-08T15:54:56.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:56.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj489 td/osd-backfill-space/6kdata 2020-09-08T15:54:56.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:56.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj490 td/osd-backfill-space/6kdata 2020-09-08T15:54:56.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:56.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj491 td/osd-backfill-space/6kdata 2020-09-08T15:54:56.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:56.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj492 td/osd-backfill-space/6kdata 2020-09-08T15:54:56.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:56.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj493 td/osd-backfill-space/6kdata 2020-09-08T15:54:56.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:56.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj494 td/osd-backfill-space/6kdata 2020-09-08T15:54:56.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:56.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj495 td/osd-backfill-space/6kdata 2020-09-08T15:54:57.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:57.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj496 td/osd-backfill-space/6kdata 2020-09-08T15:54:57.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:57.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj497 td/osd-backfill-space/6kdata 2020-09-08T15:54:57.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:57.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj498 td/osd-backfill-space/6kdata 2020-09-08T15:54:57.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:57.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj499 td/osd-backfill-space/6kdata 2020-09-08T15:54:57.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:57.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj500 td/osd-backfill-space/6kdata 2020-09-08T15:54:57.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:57.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj501 td/osd-backfill-space/6kdata 2020-09-08T15:54:57.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:57.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj502 td/osd-backfill-space/6kdata 2020-09-08T15:54:58.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:58.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj503 td/osd-backfill-space/6kdata 2020-09-08T15:54:58.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:58.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj504 td/osd-backfill-space/6kdata 2020-09-08T15:54:58.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:58.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj505 td/osd-backfill-space/6kdata 2020-09-08T15:54:58.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:58.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj506 td/osd-backfill-space/6kdata 2020-09-08T15:54:58.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:58.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj507 td/osd-backfill-space/6kdata 2020-09-08T15:54:58.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:58.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj508 td/osd-backfill-space/6kdata 2020-09-08T15:54:58.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:58.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj509 td/osd-backfill-space/6kdata 2020-09-08T15:54:58.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:58.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj510 td/osd-backfill-space/6kdata 2020-09-08T15:54:58.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:58.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj511 td/osd-backfill-space/6kdata 2020-09-08T15:54:59.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:59.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj512 td/osd-backfill-space/6kdata 2020-09-08T15:54:59.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:59.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj513 td/osd-backfill-space/6kdata 2020-09-08T15:54:59.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:59.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj514 td/osd-backfill-space/6kdata 2020-09-08T15:54:59.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:59.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj515 td/osd-backfill-space/6kdata 2020-09-08T15:54:59.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:59.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj516 td/osd-backfill-space/6kdata 2020-09-08T15:54:59.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:59.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj517 td/osd-backfill-space/6kdata 2020-09-08T15:54:59.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:54:59.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj518 td/osd-backfill-space/6kdata 2020-09-08T15:55:00.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:00.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj519 td/osd-backfill-space/6kdata 2020-09-08T15:55:00.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:00.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj520 td/osd-backfill-space/6kdata 2020-09-08T15:55:00.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:00.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj521 td/osd-backfill-space/6kdata 2020-09-08T15:55:00.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:00.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj522 td/osd-backfill-space/6kdata 2020-09-08T15:55:00.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:00.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj523 td/osd-backfill-space/6kdata 2020-09-08T15:55:00.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:00.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj524 td/osd-backfill-space/6kdata 2020-09-08T15:55:00.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:00.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj525 td/osd-backfill-space/6kdata 2020-09-08T15:55:00.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:00.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj526 td/osd-backfill-space/6kdata 2020-09-08T15:55:00.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:00.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj527 td/osd-backfill-space/6kdata 2020-09-08T15:55:01.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:01.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj528 td/osd-backfill-space/6kdata 2020-09-08T15:55:01.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:01.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj529 td/osd-backfill-space/6kdata 2020-09-08T15:55:01.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:01.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj530 td/osd-backfill-space/6kdata 2020-09-08T15:55:01.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:01.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj531 td/osd-backfill-space/6kdata 2020-09-08T15:55:01.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:01.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj532 td/osd-backfill-space/6kdata 2020-09-08T15:55:01.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:01.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj533 td/osd-backfill-space/6kdata 2020-09-08T15:55:01.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:01.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj534 td/osd-backfill-space/6kdata 2020-09-08T15:55:01.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:01.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj535 td/osd-backfill-space/6kdata 2020-09-08T15:55:02.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:02.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj536 td/osd-backfill-space/6kdata 2020-09-08T15:55:02.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:02.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj537 td/osd-backfill-space/6kdata 2020-09-08T15:55:02.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:02.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj538 td/osd-backfill-space/6kdata 2020-09-08T15:55:02.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:02.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj539 td/osd-backfill-space/6kdata 2020-09-08T15:55:02.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:02.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj540 td/osd-backfill-space/6kdata 2020-09-08T15:55:02.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:02.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj541 td/osd-backfill-space/6kdata 2020-09-08T15:55:02.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:02.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj542 td/osd-backfill-space/6kdata 2020-09-08T15:55:02.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:02.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj543 td/osd-backfill-space/6kdata 2020-09-08T15:55:03.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:03.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj544 td/osd-backfill-space/6kdata 2020-09-08T15:55:03.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:03.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj545 td/osd-backfill-space/6kdata 2020-09-08T15:55:03.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:03.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj546 td/osd-backfill-space/6kdata 2020-09-08T15:55:03.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:03.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj547 td/osd-backfill-space/6kdata 2020-09-08T15:55:03.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:03.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj548 td/osd-backfill-space/6kdata 2020-09-08T15:55:03.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:03.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj549 td/osd-backfill-space/6kdata 2020-09-08T15:55:03.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:03.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj550 td/osd-backfill-space/6kdata 2020-09-08T15:55:03.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:03.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj551 td/osd-backfill-space/6kdata 2020-09-08T15:55:04.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:04.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj552 td/osd-backfill-space/6kdata 2020-09-08T15:55:04.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:04.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj553 td/osd-backfill-space/6kdata 2020-09-08T15:55:04.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:04.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj554 td/osd-backfill-space/6kdata 2020-09-08T15:55:04.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:04.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj555 td/osd-backfill-space/6kdata 2020-09-08T15:55:04.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:04.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj556 td/osd-backfill-space/6kdata 2020-09-08T15:55:04.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:04.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj557 td/osd-backfill-space/6kdata 2020-09-08T15:55:04.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:04.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj558 td/osd-backfill-space/6kdata 2020-09-08T15:55:04.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:04.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj559 td/osd-backfill-space/6kdata 2020-09-08T15:55:05.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:05.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj560 td/osd-backfill-space/6kdata 2020-09-08T15:55:05.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:05.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj561 td/osd-backfill-space/6kdata 2020-09-08T15:55:05.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:05.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj562 td/osd-backfill-space/6kdata 2020-09-08T15:55:05.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:05.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj563 td/osd-backfill-space/6kdata 2020-09-08T15:55:05.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:05.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj564 td/osd-backfill-space/6kdata 2020-09-08T15:55:05.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:05.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj565 td/osd-backfill-space/6kdata 2020-09-08T15:55:05.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:05.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj566 td/osd-backfill-space/6kdata 2020-09-08T15:55:05.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:05.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj567 td/osd-backfill-space/6kdata 2020-09-08T15:55:05.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:05.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj568 td/osd-backfill-space/6kdata 2020-09-08T15:55:06.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:06.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj569 td/osd-backfill-space/6kdata 2020-09-08T15:55:06.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:06.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj570 td/osd-backfill-space/6kdata 2020-09-08T15:55:06.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:06.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj571 td/osd-backfill-space/6kdata 2020-09-08T15:55:06.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:06.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj572 td/osd-backfill-space/6kdata 2020-09-08T15:55:06.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:06.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj573 td/osd-backfill-space/6kdata 2020-09-08T15:55:06.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:06.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj574 td/osd-backfill-space/6kdata 2020-09-08T15:55:06.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:06.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj575 td/osd-backfill-space/6kdata 2020-09-08T15:55:06.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:06.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj576 td/osd-backfill-space/6kdata 2020-09-08T15:55:07.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:07.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj577 td/osd-backfill-space/6kdata 2020-09-08T15:55:07.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:07.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj578 td/osd-backfill-space/6kdata 2020-09-08T15:55:07.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:07.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj579 td/osd-backfill-space/6kdata 2020-09-08T15:55:07.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:07.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj580 td/osd-backfill-space/6kdata 2020-09-08T15:55:07.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:07.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj581 td/osd-backfill-space/6kdata 2020-09-08T15:55:07.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:07.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj582 td/osd-backfill-space/6kdata 2020-09-08T15:55:08.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:08.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj583 td/osd-backfill-space/6kdata 2020-09-08T15:55:08.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:08.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj584 td/osd-backfill-space/6kdata 2020-09-08T15:55:08.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:08.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj585 td/osd-backfill-space/6kdata 2020-09-08T15:55:08.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:08.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj586 td/osd-backfill-space/6kdata 2020-09-08T15:55:08.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:08.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj587 td/osd-backfill-space/6kdata 2020-09-08T15:55:08.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:08.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj588 td/osd-backfill-space/6kdata 2020-09-08T15:55:08.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:08.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj589 td/osd-backfill-space/6kdata 2020-09-08T15:55:09.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:09.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj590 td/osd-backfill-space/6kdata 2020-09-08T15:55:09.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:09.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj591 td/osd-backfill-space/6kdata 2020-09-08T15:55:09.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:09.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj592 td/osd-backfill-space/6kdata 2020-09-08T15:55:09.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:09.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj593 td/osd-backfill-space/6kdata 2020-09-08T15:55:09.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:09.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj594 td/osd-backfill-space/6kdata 2020-09-08T15:55:09.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:09.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj595 td/osd-backfill-space/6kdata 2020-09-08T15:55:09.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:09.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj596 td/osd-backfill-space/6kdata 2020-09-08T15:55:09.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:09.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj597 td/osd-backfill-space/6kdata 2020-09-08T15:55:10.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:10.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj598 td/osd-backfill-space/6kdata 2020-09-08T15:55:10.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:10.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj599 td/osd-backfill-space/6kdata 2020-09-08T15:55:10.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:598: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2020-09-08T15:55:10.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:600: TEST_backfill_grow: rados -p test put obj600 td/osd-backfill-space/6kdata 2020-09-08T15:55:10.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:603: TEST_backfill_grow: activate_osd td/osd-backfill-space 0 2020-09-08T15:55:10.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/osd-backfill-space 2020-09-08T15:55:10.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:55:10.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=0 2020-09-08T15:55:10.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:55:10.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/osd-backfill-space/0 2020-09-08T15:55:10.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T15:55:10.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:55:10.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:55:10.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:55:10.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2020-09-08T15:55:10.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2020-09-08T15:55:10.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:55:10.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:55:10.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T15:55:10.447 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:55:10.447 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:55:10.448 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:55:10.448 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:55:10.448 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:55:10.448 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:55:10.448 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:55:10.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:55:10.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:55:10.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T15:55:10.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T15:55:10.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:55:10.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:55:10.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:55:10.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:55:10.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:55:10.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/osd-backfill-space/0 2020-09-08T15:55:10.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.0 2020-09-08T15:55:10.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 0 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:55:10.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/osd-backfill-space/0/whoami 2020-09-08T15:55:10.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 0 = 0 ']' 2020-09-08T15:55:10.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:55:10.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:55:10.452 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T15:55:10.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:55:10.469 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:55:10.473+0000 7ff3f4ad6ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:55:10.471 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:55:10.475+0000 7ff3f4ad6ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:55:10.473 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:55:10.477+0000 7ff3f4ad6ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:55:10.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 0 2020-09-08T15:55:10.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:55:10.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:55:10.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:55:10.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:55:10.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:55:10.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:55:10.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:55:10.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:55:10.935 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:55:10.990 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:55:10.995+0000 7ff3f4ad6ec0 -1 Falling back to public interface 2020-09-08T15:55:11.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:55:12.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:55:12.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:55:12.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:55:12.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:55:12.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:55:12.327 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:55:12.423 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:55:12.428+0000 7ff3f4ad6ec0 -1 osd.0 23 log_to_monitors {default=true} 2020-09-08T15:55:12.734 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 28 up_thru 0 down_at 26 last_clean_interval [5,23) [v2:127.0.0.1:6802/182549,v1:127.0.0.1:6803/182549] [v2:127.0.0.1:6804/182549,v1:127.0.0.1:6805/182549] exists,up aea888d2-59e2-4900-9f13-406739c06961 2020-09-08T15:55:12.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:55:12.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:55:12.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:55:12.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:605: TEST_backfill_grow: ceph tell osd.1 debug kick_recovery_wq 0 2020-09-08T15:55:12.875 INFO:tasks.workunit.client.0.smithi065.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2020-09-08T15:55:12.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:607: TEST_backfill_grow: sleep 2 2020-09-08T15:55:14.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:609: TEST_backfill_grow: wait_for_clean 2020-09-08T15:55:14.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:55:14.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:55:14.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:55:14.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:55:14.886 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T15:55:14.887 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:55:14.887 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:55:14.887 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:55:14.887 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:55:14.888 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:55:14.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:55:14.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:55:14.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:55:14.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:55:14.993 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:55:15.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:55:15.389 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:55:15.389 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:55:15.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:55:15.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:55:15.389 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:55:15.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=120259084291 2020-09-08T15:55:15.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 120259084291 2020-09-08T15:55:15.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-120259084291' 2020-09-08T15:55:15.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:55:15.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:55:15.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949673002 2020-09-08T15:55:15.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949673002 2020-09-08T15:55:15.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-120259084291 1-42949673002' 2020-09-08T15:55:15.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:55:15.661 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:55:15.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509479 2020-09-08T15:55:15.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509479 2020-09-08T15:55:15.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-120259084291 1-42949673002 2-64424509479' 2020-09-08T15:55:15.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:55:15.792 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-120259084291 2020-09-08T15:55:15.792 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:55:15.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:55:15.793 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-120259084291 2020-09-08T15:55:15.793 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:55:15.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=120259084291 2020-09-08T15:55:15.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 120259084291' 2020-09-08T15:55:15.795 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:55:15.795 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 120259084291 2020-09-08T15:55:16.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 1 -lt 120259084291 2020-09-08T15:55:16.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:55:17.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:55:17.188 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:55:17.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 120259084291 -lt 120259084291 2020-09-08T15:55:17.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:55:17.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949673002 2020-09-08T15:55:17.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:55:17.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:55:17.605 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949673002 2020-09-08T15:55:17.605 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:55:17.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949673002 2020-09-08T15:55:17.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949673002' 2020-09-08T15:55:17.606 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:55:17.606 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949673002 2020-09-08T15:55:18.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949673002 -lt 42949673002 2020-09-08T15:55:18.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:55:18.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509479 2020-09-08T15:55:18.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:55:18.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:55:18.006 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509479 2020-09-08T15:55:18.006 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:55:18.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509479 2020-09-08T15:55:18.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509479' 2020-09-08T15:55:18.007 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:55:18.008 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509479 2020-09-08T15:55:18.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509479 -lt 64424509479 2020-09-08T15:55:18.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:55:18.405 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:18.405 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:18.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T15:55:18.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:18.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:18.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:18.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:18.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:18.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:18.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:19.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:19.318 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:19.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:19.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:19.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:19.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T15:55:19.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T15:55:19.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T15:55:19.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:19.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:19.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:19.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:19.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:19.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:19.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:19.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:19.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:19.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:20.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:20.325 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:20.326 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:20.326 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:20.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:20.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:20.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:20.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:20.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:20.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:20.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:20.854 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:20.854 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:21.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5119 2020-09-08T15:55:21.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5119 '!=' null 2020-09-08T15:55:21.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:21.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:21.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:21.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:21.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:21.477 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:21.477 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:21.477 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:21.478 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:21.478 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:21.478 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:21.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:21.860 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:21.860 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:21.861 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:22.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:22.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:22.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:22.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:22.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:22.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:22.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:22.392 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:22.392 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:22.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=21879 2020-09-08T15:55:22.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 21879 '!=' null 2020-09-08T15:55:22.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:22.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:22.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:23.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:23.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:23.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:23.028 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:23.028 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:23.028 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:23.028 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:23.028 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:23.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:23.416 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:23.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:23.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:23.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:23.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:23.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:23.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:23.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:23.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:23.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:23.947 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:23.948 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:24.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=17851 2020-09-08T15:55:24.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 17851 '!=' null 2020-09-08T15:55:24.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:24.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:24.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:24.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:24.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:24.583 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:24.583 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:24.583 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:24.584 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:24.585 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:24.585 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:24.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:24.970 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:24.971 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:24.971 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:25.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:25.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:25.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:25.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:25.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:25.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:25.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:25.498 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:25.498 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:26.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29856 2020-09-08T15:55:26.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29856 '!=' null 2020-09-08T15:55:26.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:26.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:26.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:26.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:26.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:26.114 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:26.114 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:26.114 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:26.115 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:26.115 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:26.115 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:26.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:26.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:26.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:26.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:27.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:27.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:27.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:27.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:27.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:27.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:27.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:27.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:27.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:27.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=28159 2020-09-08T15:55:27.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 28159 '!=' null 2020-09-08T15:55:27.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:27.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:27.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:27.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:27.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:27.659 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:27.659 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:27.659 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:27.660 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:27.660 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:27.660 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:28.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:28.048 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:28.048 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:28.049 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:28.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:28.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:28.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:28.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:28.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:28.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:28.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:28.579 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:28.580 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:29.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=28159 2020-09-08T15:55:29.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 28159 '!=' null 2020-09-08T15:55:29.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:29.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:29.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:29.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:29.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:29.239 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:29.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:29.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:29.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:29.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:29.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:29.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:29.659 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:29.660 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:29.660 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:30.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:30.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:30.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:30.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:30.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:30.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:30.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:30.191 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:30.191 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:30.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=25599 2020-09-08T15:55:30.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 25599 '!=' null 2020-09-08T15:55:30.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:30.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:30.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:30.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:30.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:30.821 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:30.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:30.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:30.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:30.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:30.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:31.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:31.199 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:31.200 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:31.200 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:31.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:31.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:31.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:31.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:31.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:31.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:31.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:31.729 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:31.729 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:32.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=39423 2020-09-08T15:55:32.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 39423 '!=' null 2020-09-08T15:55:32.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:32.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:32.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:32.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:32.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:32.354 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:32.354 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:32.354 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:32.354 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:32.355 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:32.355 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:32.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:32.734 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:32.734 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:32.735 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:33.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:33.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:33.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:33.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:33.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:33.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:33.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:33.257 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:33.258 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:33.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=27647 2020-09-08T15:55:33.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 27647 '!=' null 2020-09-08T15:55:33.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:33.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:33.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:33.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:33.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:33.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:33.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:33.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:33.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:33.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:33.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:34.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:34.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:34.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:34.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:34.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:34.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:34.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:34.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:34.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:34.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:34.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:34.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:34.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:35.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=27647 2020-09-08T15:55:35.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 27647 '!=' null 2020-09-08T15:55:35.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:35.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:35.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:35.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:35.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:35.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:35.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:35.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:35.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:35.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:35.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:35.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:35.878 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:35.878 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:35.878 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:36.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:36.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:36.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:36.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:36.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:36.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:36.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:36.401 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:36.402 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:36.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=43006 2020-09-08T15:55:36.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 43006 '!=' null 2020-09-08T15:55:36.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:36.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:36.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:37.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:37.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:37.029 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:37.029 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:37.029 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:37.029 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:37.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:37.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:37.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:37.411 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:37.412 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:37.412 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:37.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:37.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:37.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:37.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:37.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:37.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:37.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:37.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:37.941 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:38.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29183 2020-09-08T15:55:38.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29183 '!=' null 2020-09-08T15:55:38.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:38.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:38.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:38.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:38.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:38.559 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:38.559 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:38.559 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:38.560 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:38.560 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:38.560 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:38.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:38.949 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:38.949 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:38.949 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:39.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:39.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:39.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:39.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:39.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:39.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:39.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:39.478 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:39.478 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:40.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29183 2020-09-08T15:55:40.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29183 '!=' null 2020-09-08T15:55:40.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:40.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:40.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:40.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:40.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:40.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:40.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:40.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:40.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:40.131 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:40.131 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:40.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:40.517 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:40.518 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:40.518 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:41.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:41.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:41.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:41.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:41.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:41.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:41.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:41.081 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:41.081 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:41.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=43007 2020-09-08T15:55:41.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 43007 '!=' null 2020-09-08T15:55:41.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:41.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:41.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:41.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:41.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:41.698 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:41.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:41.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:41.700 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:41.700 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:41.700 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:42.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:42.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:42.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:42.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:42.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:42.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:42.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:42.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:42.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:42.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:42.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:42.610 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:42.611 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:43.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=43007 2020-09-08T15:55:43.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 43007 '!=' null 2020-09-08T15:55:43.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:43.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:43.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:43.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:43.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:43.239 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:43.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:43.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:43.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:43.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:43.241 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:43.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:43.625 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:43.625 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:43.626 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:44.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:44.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:44.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:44.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:44.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:44.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:44.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:44.159 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:44.160 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:44.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29183 2020-09-08T15:55:44.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29183 '!=' null 2020-09-08T15:55:44.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:44.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:44.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:44.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:44.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:44.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:44.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:44.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:44.787 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:44.787 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:44.787 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:45.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:45.178 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:45.178 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:45.178 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:45.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:45.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:45.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:45.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:45.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:45.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:45.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:45.708 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:45.709 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:46.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=44544 2020-09-08T15:55:46.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 44544 '!=' null 2020-09-08T15:55:46.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:46.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:46.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:46.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:46.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:46.340 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:46.341 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:46.341 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:46.341 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:46.342 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:46.342 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:46.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:46.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:46.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:46.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:47.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:47.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:47.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:47.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:47.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:47.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:47.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:47.253 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:47.253 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:47.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29183 2020-09-08T15:55:47.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29183 '!=' null 2020-09-08T15:55:47.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:47.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:47.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:47.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:47.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:47.894 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:47.894 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:47.894 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:47.894 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:47.894 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:47.895 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:48.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:48.280 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:48.281 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:48.281 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:48.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:48.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:48.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:48.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:48.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:48.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:48.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:48.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:48.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:49.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29183 2020-09-08T15:55:49.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29183 '!=' null 2020-09-08T15:55:49.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:49.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:49.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:49.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:49.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:49.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:49.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:49.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:49.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:49.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:49.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:49.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:49.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:49.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:49.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:50.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:50.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:50.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:50.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:50.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:50.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:50.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:50.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:50.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:50.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29183 2020-09-08T15:55:50.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29183 '!=' null 2020-09-08T15:55:50.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:50.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:50.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:50.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:50.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:50.994 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:50.994 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:50.994 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:50.994 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:50.995 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:50.995 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:51.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:51.377 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:51.378 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:51.378 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:51.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:51.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:51.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:51.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:51.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:51.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:51.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:51.902 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:51.903 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:52.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=43519 2020-09-08T15:55:52.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 43519 '!=' null 2020-09-08T15:55:52.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:52.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:52.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:52.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:52.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:52.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:52.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:52.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:52.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:52.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:52.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:52.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:52.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:52.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:52.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:53.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:53.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:53.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:53.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:53.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:53.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:53.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:53.436 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:53.437 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:53.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29694 2020-09-08T15:55:53.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29694 '!=' null 2020-09-08T15:55:53.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:53.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:53.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:54.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:54.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:54.076 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:54.076 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:54.077 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:54.077 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:54.078 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:54.079 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:54.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:54.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:54.460 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:54.460 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:54.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:54.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:54.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:54.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:54.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:54.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:54.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:54.987 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:54.987 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:55.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=44031 2020-09-08T15:55:55.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 44031 '!=' null 2020-09-08T15:55:55.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:55.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:55.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:55.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:55.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:55.617 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:55.617 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:55.617 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:55.617 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:55.617 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:55.618 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:56.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:56.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:56.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:56.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:56.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:56.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:56.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:56.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:56.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:56.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:56.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:56.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:56.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:57.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=44031 2020-09-08T15:55:57.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 44031 '!=' null 2020-09-08T15:55:57.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:57.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:57.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:57.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:57.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:57.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:57.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:57.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:57.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:57.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:57.154 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:57.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:57.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:57.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:57.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:58.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:58.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:58.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:58.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:58.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:58.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:58.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:58.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:58.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:55:58.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=28671 2020-09-08T15:55:58.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 28671 '!=' null 2020-09-08T15:55:58.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:55:58.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:55:58.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:55:58.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:55:58.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:55:58.681 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:55:58.682 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:55:58.682 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:55:58.682 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:55:58.682 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:55:58.682 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:55:59.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:55:59.067 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:55:59.067 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:55:59.068 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:55:59.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:55:59.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:55:59.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:55:59.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:55:59.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:55:59.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:55:59.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:55:59.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:55:59.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:00.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=28671 2020-09-08T15:56:00.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 28671 '!=' null 2020-09-08T15:56:00.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:00.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:00.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:00.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:00.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:00.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:00.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:00.256 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:00.256 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:00.256 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:00.256 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:00.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:00.640 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:00.640 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:00.641 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:01.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:01.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:01.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:01.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:01.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:01.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:01.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:01.173 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:01.173 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:01.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=43519 2020-09-08T15:56:01.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 43519 '!=' null 2020-09-08T15:56:01.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:01.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:01.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:01.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:01.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:01.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:01.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:01.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:01.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:01.823 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:01.823 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:02.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:02.206 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:02.206 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:02.206 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:02.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:02.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:02.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:02.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:02.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:02.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:02.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:02.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:02.728 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:03.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=43519 2020-09-08T15:56:03.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 43519 '!=' null 2020-09-08T15:56:03.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:03.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:03.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:03.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:03.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:03.356 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:03.356 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:03.356 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:03.357 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:03.357 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:03.357 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:03.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:03.740 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:03.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:03.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:04.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:04.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:04.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:04.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:04.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:04.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:04.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:04.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:04.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:04.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29183 2020-09-08T15:56:04.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29183 '!=' null 2020-09-08T15:56:04.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:04.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:04.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:04.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:04.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:04.922 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:04.922 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:04.922 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:04.923 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:04.923 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:04.923 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:05.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:05.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:05.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:05.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:05.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:05.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:05.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:05.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:05.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:05.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:05.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:05.845 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:05.845 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:06.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=44031 2020-09-08T15:56:06.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 44031 '!=' null 2020-09-08T15:56:06.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:06.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:06.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:06.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:06.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:06.463 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:06.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:06.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:06.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:06.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:06.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:06.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:06.845 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:06.845 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:06.846 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:07.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:07.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:07.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:07.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:07.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:07.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:07.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:07.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:07.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:07.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29694 2020-09-08T15:56:07.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29694 '!=' null 2020-09-08T15:56:07.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:07.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:07.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:07.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:07.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:07.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:07.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:07.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:07.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:07.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:07.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:08.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:08.374 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:08.374 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:08.375 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:08.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:08.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:08.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:08.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:08.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:08.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:08.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:08.906 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:08.906 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:09.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29694 2020-09-08T15:56:09.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29694 '!=' null 2020-09-08T15:56:09.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:09.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:09.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:09.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:09.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:09.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:09.525 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:09.525 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:09.525 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:09.525 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:09.526 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:09.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:09.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:09.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:09.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:10.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:10.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:10.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:10.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:10.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:10.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:10.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:10.434 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:10.434 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:10.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29694 2020-09-08T15:56:10.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29694 '!=' null 2020-09-08T15:56:10.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:10.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:10.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:11.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:11.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:11.057 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:11.057 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:11.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:11.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:11.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:11.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:11.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:11.441 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:11.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:11.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:11.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:11.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:11.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:11.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:11.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:11.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:11.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:11.969 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:11.969 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:12.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=44031 2020-09-08T15:56:12.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 44031 '!=' null 2020-09-08T15:56:12.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:12.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:12.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:12.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:12.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:12.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:12.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:12.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:12.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:12.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:12.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:12.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:12.975 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:12.975 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:12.975 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:13.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:13.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:13.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:13.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:13.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:13.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:13.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:13.495 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:13.496 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:14.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29182 2020-09-08T15:56:14.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29182 '!=' null 2020-09-08T15:56:14.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:14.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:14.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:14.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:14.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:14.121 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:14.121 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:14.121 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:14.121 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:14.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:14.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:14.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:14.504 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:14.505 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:14.505 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:15.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:15.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:15.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:15.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:15.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:15.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:15.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:15.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:15.028 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:15.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=44031 2020-09-08T15:56:15.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 44031 '!=' null 2020-09-08T15:56:15.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:15.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:15.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:15.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:15.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:15.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:15.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:15.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:15.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:15.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:15.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:16.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:16.049 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:16.050 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:16.050 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:16.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:16.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:16.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:16.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:16.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:16.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:16.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:16.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:16.569 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:17.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=44031 2020-09-08T15:56:17.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 44031 '!=' null 2020-09-08T15:56:17.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:17.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:17.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:17.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:17.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:17.194 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:17.194 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:17.194 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:17.194 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:17.195 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:17.195 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:17.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:17.578 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:17.579 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:17.579 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:18.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:18.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:18.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:18.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:18.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:18.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:18.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:18.104 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:18.104 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:18.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29183 2020-09-08T15:56:18.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29183 '!=' null 2020-09-08T15:56:18.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:18.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:18.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:18.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:18.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:18.726 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:18.726 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:18.726 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:18.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:18.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:18.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:19.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:19.111 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:19.111 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:19.111 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:19.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:19.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:19.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:19.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:19.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:19.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:19.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:19.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:19.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:20.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29183 2020-09-08T15:56:20.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29183 '!=' null 2020-09-08T15:56:20.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:20.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:20.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:20.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:20.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:20.257 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:20.257 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:20.257 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:20.258 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:20.258 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:20.258 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:20.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:20.659 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:20.659 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:20.659 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:21.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:21.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:21.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:21.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:21.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:21.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:21.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:21.183 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:21.183 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:21.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=44031 2020-09-08T15:56:21.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 44031 '!=' null 2020-09-08T15:56:21.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:21.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:21.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:21.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:21.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:21.807 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:21.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:21.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:21.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:21.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:21.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:22.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:22.189 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:22.190 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:22.190 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:22.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:22.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:22.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:22.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:22.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:22.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:22.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:22.718 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:22.718 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:23.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=44031 2020-09-08T15:56:23.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 44031 '!=' null 2020-09-08T15:56:23.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:23.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:23.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:23.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:23.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:23.338 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:23.338 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:23.338 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:23.339 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:23.339 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:23.339 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:23.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:23.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:23.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:23.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:24.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:24.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:24.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:24.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:24.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:24.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:24.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:24.249 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:24.249 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:24.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29695 2020-09-08T15:56:24.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29695 '!=' null 2020-09-08T15:56:24.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:24.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:24.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:24.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:24.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:24.872 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:24.872 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:24.872 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:24.872 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:24.873 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:24.873 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:25.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:25.259 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:25.260 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:25.261 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:25.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:25.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:25.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:25.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:25.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:25.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:25.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:25.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:25.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:26.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=44543 2020-09-08T15:56:26.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 44543 '!=' null 2020-09-08T15:56:26.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:26.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:26.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:26.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:26.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:26.449 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:26.449 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:26.449 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:26.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:26.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:26.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:26.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:26.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:26.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:26.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:27.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:27.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:27.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:27.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:27.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:27.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:27.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:27.364 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:27.364 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:27.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29695 2020-09-08T15:56:27.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29695 '!=' null 2020-09-08T15:56:27.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:27.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:27.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:27.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:27.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:27.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:27.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:27.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:27.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:27.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:27.993 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:28.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:28.377 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:28.377 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:28.377 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:28.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:28.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:28.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:28.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:28.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:28.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:28.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:28.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:28.901 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:29.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29695 2020-09-08T15:56:29.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29695 '!=' null 2020-09-08T15:56:29.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:29.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:29.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:29.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:29.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:29.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:29.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:29.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:29.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:29.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:29.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:29.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:29.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:29.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:29.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:30.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:30.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:30.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:30.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:30.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:30.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:30.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:30.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:30.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:31.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29695 2020-09-08T15:56:31.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29695 '!=' null 2020-09-08T15:56:31.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:31.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:31.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:31.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:31.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:31.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:31.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:31.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:31.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:31.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:31.114 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:31.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:31.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:31.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:31.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:32.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:32.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:32.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:32.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:32.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:32.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:32.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:32.017 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:32.017 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:32.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=44543 2020-09-08T15:56:32.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 44543 '!=' null 2020-09-08T15:56:32.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:32.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:32.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:32.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:32.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:32.658 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:32.658 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:32.658 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:32.659 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:32.659 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:32.659 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:33.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:33.041 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:33.042 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:33.042 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:33.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:33.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:33.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:33.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:33.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:33.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:33.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:33.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:33.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:34.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=29695 2020-09-08T15:56:34.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 29695 '!=' null 2020-09-08T15:56:34.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:34.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:34.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:34.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:34.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:34.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:34.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:34.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:34.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:34.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:34.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:34.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T15:56:34.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:34.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:34.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:35.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T15:56:35.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T15:56:35.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T15:56:35.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T15:56:35.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T15:56:35.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T15:56:35.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T15:56:35.218 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T15:56:35.219 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T15:56:35.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=39935 2020-09-08T15:56:35.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 39935 '!=' null 2020-09-08T15:56:35.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T15:56:35.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T15:56:35.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T15:56:35.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T15:56:35.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:56:35.858 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:56:35.859 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:56:35.859 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:56:35.859 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:56:35.859 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:56:35.859 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:56:36.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T15:56:36.245 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:56:36.245 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:56:36.245 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:56:36.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T15:56:36.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:56:36.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:56:36.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:611: TEST_backfill_grow: delete_pool test 2020-09-08T15:56:36.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test 2020-09-08T15:56:36.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2020-09-08T15:56:37.292 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' does not exist 2020-09-08T15:56:37.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:612: TEST_backfill_grow: kill_daemons td/osd-backfill-space 2020-09-08T15:56:37.301 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:56:37.301 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:56:37.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:56:37.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:56:37.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:56:37.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:56:37.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:613: TEST_backfill_grow: grep -q 'num_bytes mismatch' td/osd-backfill-space/osd.0.log td/osd-backfill-space/osd.1.log td/osd-backfill-space/osd.2.log 2020-09-08T15:56:37.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:38: run: teardown td/osd-backfill-space 2020-09-08T15:56:37.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2020-09-08T15:56:37.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:56:37.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2020-09-08T15:56:37.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:56:37.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:56:37.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:56:37.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:56:37.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:56:37.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:56:37.446 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:56:37.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:56:37.447 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:56:37.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:56:37.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:56:37.448 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:56:37.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:56:37.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:56:37.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:56:37.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:56:37.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:56:37.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:56:37.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2020-09-08T15:56:37.488 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:56:37.489 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:56:37.489 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:56:37.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.154687 2020-09-08T15:56:37.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:56:37.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:56:37.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:35: run: for func in $funcs 2020-09-08T15:56:37.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:36: run: setup td/osd-backfill-space 2020-09-08T15:56:37.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-space 2020-09-08T15:56:37.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-space 2020-09-08T15:56:37.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2020-09-08T15:56:37.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T15:56:37.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2020-09-08T15:56:37.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:56:37.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:56:37.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:56:37.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:56:37.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:56:37.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:56:37.496 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T15:56:37.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T15:56:37.497 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T15:56:37.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T15:56:37.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T15:56:37.497 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T15:56:37.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:56:37.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T15:56:37.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T15:56:37.498 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T15:56:37.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T15:56:37.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T15:56:37.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2020-09-08T15:56:37.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T15:56:37.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:56:37.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:56:37.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.154687 2020-09-08T15:56:37.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T15:56:37.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T15:56:37.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-space 2020-09-08T15:56:37.502 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T15:56:37.502 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:56:37.503 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:56:37.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.154687 2020-09-08T15:56:37.504 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T15:56:37.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T15:56:37.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T15:56:37.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2020-09-08T15:56:37.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:37: run: TEST_backfill_multi_partial td/osd-backfill-space 2020-09-08T15:56:37.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:429: TEST_backfill_multi_partial: local dir=td/osd-backfill-space 2020-09-08T15:56:37.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:430: TEST_backfill_multi_partial: local EC= 2020-09-08T15:56:37.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:431: TEST_backfill_multi_partial: local pools=2 2020-09-08T15:56:37.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:432: TEST_backfill_multi_partial: local OSDS=3 2020-09-08T15:56:37.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:434: TEST_backfill_multi_partial: run_mon td/osd-backfill-space a 2020-09-08T15:56:37.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-space 2020-09-08T15:56:37.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T15:56:37.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T15:56:37.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T15:56:37.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-space/a 2020-09-08T15:56:37.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2020-09-08T15:56:37.807 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T15:56:37.810 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:56:37.810 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:56:37.810 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:56:37.810 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:56:37.811 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:56:37.811 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:56:37.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T15:56:37.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T15:56:37.997 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T15:56:37.998 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:56:37.998 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:56:37.998 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T15:56:37.999 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T15:56:37.999 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:56:37.999 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:56:38.000 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:56:38.000 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:56:38.001 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:56:38.002 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:56:38.002 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.154687/ceph-mon.a.asok 2020-09-08T15:56:38.002 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:56:38.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.154687/ceph-mon.a.asok config get fsid 2020-09-08T15:56:38.087 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T15:56:38.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T15:56:38.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T15:56:38.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T15:56:38.089 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T15:56:38.089 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T15:56:38.089 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T15:56:38.089 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T15:56:38.090 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T15:56:38.091 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:56:38.092 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:56:38.092 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.154687/ceph-mon.a.asok 2020-09-08T15:56:38.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T15:56:38.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.154687/ceph-mon.a.asok config get mon_host 2020-09-08T15:56:38.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:435: TEST_backfill_multi_partial: run_mgr td/osd-backfill-space x 2020-09-08T15:56:38.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-space 2020-09-08T15:56:38.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T15:56:38.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T15:56:38.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T15:56:38.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-space/x 2020-09-08T15:56:38.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T15:56:39.072 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T15:56:39.072 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:56:39.072 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:56:39.074 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:56:39.074 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:56:39.074 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:56:39.074 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:56:39.076 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:56:39.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T15:56:39.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:436: TEST_backfill_multi_partial: export CEPH_ARGS 2020-09-08T15:56:39.100 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:438: TEST_backfill_multi_partial: expr 3 - 1 2020-09-08T15:56:39.100 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:438: TEST_backfill_multi_partial: seq 0 2 2020-09-08T15:56:39.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:438: TEST_backfill_multi_partial: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:56:39.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:440: TEST_backfill_multi_partial: run_osd td/osd-backfill-space 0 2020-09-08T15:56:39.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T15:56:39.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:56:39.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T15:56:39.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:56:39.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/0 2020-09-08T15:56:39.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T15:56:39.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:56:39.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:56:39.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:56:39.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2020-09-08T15:56:39.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2020-09-08T15:56:39.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:56:39.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:56:39.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T15:56:39.107 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:56:39.109 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:56:39.109 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:56:39.110 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:56:39.110 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:56:39.110 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:56:39.110 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:56:39.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:56:39.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:56:39.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:56:39.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:56:39.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T15:56:39.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T15:56:39.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:56:39.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:56:39.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:56:39.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:56:39.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:56:39.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/0 2020-09-08T15:56:39.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:56:39.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=1b8f0836-768b-489e-b91b-8b5dcc34478a 2020-09-08T15:56:39.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 1b8f0836-768b-489e-b91b-8b5dcc34478a' 2020-09-08T15:56:39.114 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:56:39.114 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 1b8f0836-768b-489e-b91b-8b5dcc34478a 2020-09-08T15:56:39.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQC3qVdfxFyKBxAAfooCV7POKzYpYf3SfifQIw== 2020-09-08T15:56:39.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQC3qVdfxFyKBxAAfooCV7POKzYpYf3SfifQIw=="}' 2020-09-08T15:56:39.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 1b8f0836-768b-489e-b91b-8b5dcc34478a -i td/osd-backfill-space/0/new.json 2020-09-08T15:56:39.462 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:56:39.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/0/new.json 2020-09-08T15:56:39.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQC3qVdfxFyKBxAAfooCV7POKzYpYf3SfifQIw== --osd-uuid 1b8f0836-768b-489e-b91b-8b5dcc34478a 2020-09-08T15:56:39.500 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:39.505+0000 7fa078c95ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:56:39.502 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:39.507+0000 7fa078c95ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:56:39.503 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:39.508+0000 7fa078c95ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:56:39.504 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:39.509+0000 7fa078c95ec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T15:56:39.505 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:39.509+0000 7fa078c95ec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T15:56:39.505 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:39.509+0000 7fa078c95ec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T15:56:39.562 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:39.567+0000 7fa078c95ec0 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2020-09-08T15:56:43.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2020-09-08T15:56:43.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:56:43.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T15:56:43.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:56:43.799 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T15:56:44.331 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T15:56:44.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T15:56:44.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:56:44.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:56:44.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:56:44.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:56:44.357 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:44.360+0000 7f3910ecdec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:56:44.371 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:44.375+0000 7f3910ecdec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:56:44.373 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:44.377+0000 7f3910ecdec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:56:44.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T15:56:44.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:56:44.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T15:56:44.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:56:44.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:56:44.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:56:44.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:56:44.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:56:44.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:56:44.730 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:56:44.894 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:44.897+0000 7f3910ecdec0 -1 Falling back to public interface 2020-09-08T15:56:45.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:56:45.680 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:45.684+0000 7f3910ecdec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T15:56:46.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:56:46.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:56:46.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:56:46.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:56:46.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T15:56:46.170 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:56:46.598 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/188215,v1:127.0.0.1:6803/188215] [v2:127.0.0.1:6804/188215,v1:127.0.0.1:6805/188215] exists,up 1b8f0836-768b-489e-b91b-8b5dcc34478a 2020-09-08T15:56:46.598 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 7a372dc9-d171-46e1-bc31-12a3e2311ac0 2020-09-08T15:56:46.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:56:46.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:56:46.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:56:46.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:438: TEST_backfill_multi_partial: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:56:46.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:440: TEST_backfill_multi_partial: run_osd td/osd-backfill-space 1 2020-09-08T15:56:46.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T15:56:46.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:56:46.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T15:56:46.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:56:46.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/1 2020-09-08T15:56:46.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T15:56:46.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:56:46.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:56:46.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:56:46.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2020-09-08T15:56:46.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2020-09-08T15:56:46.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:56:46.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:56:46.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T15:56:46.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:56:46.605 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:56:46.605 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:56:46.605 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:56:46.605 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:56:46.606 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:56:46.606 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:56:46.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:56:46.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:56:46.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:56:46.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:56:46.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T15:56:46.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T15:56:46.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:56:46.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:56:46.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:56:46.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:56:46.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:56:46.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/1 2020-09-08T15:56:46.609 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:56:46.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=7a372dc9-d171-46e1-bc31-12a3e2311ac0 2020-09-08T15:56:46.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 7a372dc9-d171-46e1-bc31-12a3e2311ac0' 2020-09-08T15:56:46.610 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:56:46.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQC+qVdf/V34JBAAmfqwMNPs3hgVZoENjNAdcw== 2020-09-08T15:56:46.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQC+qVdf/V34JBAAmfqwMNPs3hgVZoENjNAdcw=="}' 2020-09-08T15:56:46.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 7a372dc9-d171-46e1-bc31-12a3e2311ac0 -i td/osd-backfill-space/1/new.json 2020-09-08T15:56:47.108 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:56:47.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/1/new.json 2020-09-08T15:56:47.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQC+qVdf/V34JBAAmfqwMNPs3hgVZoENjNAdcw== --osd-uuid 7a372dc9-d171-46e1-bc31-12a3e2311ac0 2020-09-08T15:56:47.146 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:47.150+0000 7f7f8b803ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:56:47.153 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:47.152+0000 7f7f8b803ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:56:47.153 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:47.153+0000 7f7f8b803ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:56:47.153 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:47.154+0000 7f7f8b803ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T15:56:47.155 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:47.154+0000 7f7f8b803ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T15:56:47.155 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:47.154+0000 7f7f8b803ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T15:56:47.199 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:47.204+0000 7f7f8b803ec0 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2020-09-08T15:56:51.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2020-09-08T15:56:51.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:56:51.125 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T15:56:51.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T15:56:51.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:56:51.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T15:56:51.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:56:51.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:56:51.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:56:51.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:56:51.659 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:56:51.682 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:51.687+0000 7ffb611c8ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:56:51.756 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:51.761+0000 7ffb611c8ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:56:51.758 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:51.763+0000 7ffb611c8ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:56:52.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T15:56:52.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:56:52.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:56:52.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:56:52.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:56:52.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:56:52.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:56:52.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:56:52.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:56:52.064 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:56:52.274 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:52.278+0000 7ffb611c8ec0 -1 Falling back to public interface 2020-09-08T15:56:52.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:56:53.157 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:53.161+0000 7ffb611c8ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T15:56:53.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:56:53.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:56:53.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:56:53.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:56:53.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:56:53.474 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:56:53.889 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/189235,v1:127.0.0.1:6811/189235] [v2:127.0.0.1:6812/189235,v1:127.0.0.1:6813/189235] exists,up 7a372dc9-d171-46e1-bc31-12a3e2311ac0 2020-09-08T15:56:53.890 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 e23572dd-8b8f-4ce8-8315-ba2876ddb8af 2020-09-08T15:56:53.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:56:53.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:56:53.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:56:53.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:438: TEST_backfill_multi_partial: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T15:56:53.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:440: TEST_backfill_multi_partial: run_osd td/osd-backfill-space 2 2020-09-08T15:56:53.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T15:56:53.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T15:56:53.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T15:56:53.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T15:56:53.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/2 2020-09-08T15:56:53.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T15:56:53.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:56:53.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:56:53.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:56:53.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2020-09-08T15:56:53.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2020-09-08T15:56:53.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T15:56:53.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T15:56:53.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T15:56:53.903 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T15:56:53.904 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:56:53.904 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:56:53.904 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:56:53.904 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:56:53.904 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:56:53.905 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:56:53.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:56:53.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:56:53.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T15:56:53.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T15:56:53.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T15:56:53.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T15:56:53.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:56:53.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:56:53.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:56:53.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T15:56:53.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T15:56:53.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/2 2020-09-08T15:56:53.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T15:56:53.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=e23572dd-8b8f-4ce8-8315-ba2876ddb8af 2020-09-08T15:56:53.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 e23572dd-8b8f-4ce8-8315-ba2876ddb8af' 2020-09-08T15:56:53.919 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T15:56:53.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDFqVdfR/5XNhAANlHt9DbJTnpVHLeKnciWKw== 2020-09-08T15:56:53.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDFqVdfR/5XNhAANlHt9DbJTnpVHLeKnciWKw=="}' 2020-09-08T15:56:53.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new e23572dd-8b8f-4ce8-8315-ba2876ddb8af -i td/osd-backfill-space/2/new.json 2020-09-08T15:56:54.437 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T15:56:54.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/2/new.json 2020-09-08T15:56:54.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDFqVdfR/5XNhAANlHt9DbJTnpVHLeKnciWKw== --osd-uuid e23572dd-8b8f-4ce8-8315-ba2876ddb8af 2020-09-08T15:56:54.477 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:54.482+0000 7ff6c1bb3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:56:54.479 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:54.484+0000 7ff6c1bb3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:56:54.480 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:54.485+0000 7ff6c1bb3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:56:54.481 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:54.486+0000 7ff6c1bb3ec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T15:56:54.481 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:54.486+0000 7ff6c1bb3ec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T15:56:54.481 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:54.486+0000 7ff6c1bb3ec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T15:56:54.563 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:54.568+0000 7ff6c1bb3ec0 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2020-09-08T15:56:59.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2020-09-08T15:56:59.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T15:56:59.075 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T15:56:59.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T15:56:59.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T15:56:59.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T15:56:59.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:56:59.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T15:56:59.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T15:56:59.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T15:56:59.621 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T15:56:59.645 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:59.650+0000 7fe84e449ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:56:59.657 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:59.657+0000 7fe84e449ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:56:59.658 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:56:59.659+0000 7fe84e449ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:57:00.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T15:57:00.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:57:00.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:57:00.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:57:00.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:57:00.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:57:00.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:57:00.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:57:00.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:57:00.019 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:57:00.171 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:57:00.176+0000 7fe84e449ec0 -1 Falling back to public interface 2020-09-08T15:57:00.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:57:01.089 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:57:01.093+0000 7fe84e449ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T15:57:01.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:57:01.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:57:01.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:57:01.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:57:01.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:57:01.416 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:57:01.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:57:02.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:57:02.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:57:02.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T15:57:02.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:57:02.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:57:02.846 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T15:57:03.254 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/190211,v1:127.0.0.1:6819/190211] [v2:127.0.0.1:6820/190211,v1:127.0.0.1:6821/190211] exists,up e23572dd-8b8f-4ce8-8315-ba2876ddb8af 2020-09-08T15:57:03.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:57:03.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:57:03.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:57:03.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:443: TEST_backfill_multi_partial: ceph osd set-backfillfull-ratio .85 2020-09-08T15:57:03.957 INFO:tasks.workunit.client.0.smithi065.stderr:osd set-backfillfull-ratio 0.85 2020-09-08T15:57:03.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:445: TEST_backfill_multi_partial: ceph osd set-require-min-compat-client luminous 2020-09-08T15:57:04.810 INFO:tasks.workunit.client.0.smithi065.stderr:set require_min_compat_client to luminous 2020-09-08T15:57:04.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:446: TEST_backfill_multi_partial: create_pool fillpool 1 1 2020-09-08T15:57:04.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create fillpool 1 1 2020-09-08T15:57:05.361 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'fillpool' already exists 2020-09-08T15:57:05.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:57:06.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:447: TEST_backfill_multi_partial: ceph osd pool set fillpool size 1 --yes-i-really-mean-it 2020-09-08T15:57:07.429 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 1 2020-09-08T15:57:07.438 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:448: TEST_backfill_multi_partial: seq 1 2 2020-09-08T15:57:07.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:448: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T15:57:07.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:450: TEST_backfill_multi_partial: create_pool test1 1 1 2020-09-08T15:57:07.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test1 1 1 2020-09-08T15:57:07.988 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test1' already exists 2020-09-08T15:57:07.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:57:08.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:451: TEST_backfill_multi_partial: ceph osd pool set test1 size 2 2020-09-08T15:57:10.105 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 2 size to 2 2020-09-08T15:57:10.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:448: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T15:57:10.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:450: TEST_backfill_multi_partial: create_pool test2 1 1 2020-09-08T15:57:10.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test2 1 1 2020-09-08T15:57:10.714 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test2' already exists 2020-09-08T15:57:10.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T15:57:11.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:451: TEST_backfill_multi_partial: ceph osd pool set test2 size 2 2020-09-08T15:57:12.771 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 3 size to 2 2020-09-08T15:57:12.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:454: TEST_backfill_multi_partial: wait_for_clean 2020-09-08T15:57:12.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T15:57:12.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T15:57:12.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T15:57:12.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T15:57:12.782 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T15:57:12.783 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T15:57:12.783 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T15:57:12.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T15:57:12.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T15:57:12.784 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T15:57:12.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T15:57:12.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T15:57:12.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T15:57:12.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T15:57:12.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T15:57:13.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T15:57:13.278 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:57:13.278 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T15:57:13.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T15:57:13.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:57:13.278 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T15:57:13.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836488 2020-09-08T15:57:13.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836488 2020-09-08T15:57:13.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836488' 2020-09-08T15:57:13.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:57:13.419 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T15:57:13.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672966 2020-09-08T15:57:13.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672966 2020-09-08T15:57:13.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836488 1-42949672966' 2020-09-08T15:57:13.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T15:57:13.545 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T15:57:13.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=60129542150 2020-09-08T15:57:13.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 60129542150 2020-09-08T15:57:13.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836488 1-42949672966 2-60129542150' 2020-09-08T15:57:13.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:57:13.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836488 2020-09-08T15:57:13.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:57:13.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T15:57:13.678 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836488 2020-09-08T15:57:13.678 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:57:13.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836488 2020-09-08T15:57:13.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2020-09-08T15:57:13.680 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:57:13.680 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836488 2020-09-08T15:57:14.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836486 -lt 21474836488 2020-09-08T15:57:14.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T15:57:15.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T15:57:15.077 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T15:57:15.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836488 -lt 21474836488 2020-09-08T15:57:15.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:57:15.487 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672966 2020-09-08T15:57:15.487 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:57:15.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T15:57:15.488 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672966 2020-09-08T15:57:15.488 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:57:15.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672966 2020-09-08T15:57:15.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672966' 2020-09-08T15:57:15.489 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T15:57:15.489 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672966 2020-09-08T15:57:15.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672967 -lt 42949672966 2020-09-08T15:57:15.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T15:57:15.899 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-60129542150 2020-09-08T15:57:15.899 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T15:57:15.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T15:57:15.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-60129542150 2020-09-08T15:57:15.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T15:57:15.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=60129542150 2020-09-08T15:57:15.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2020-09-08T15:57:15.902 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T15:57:15.902 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 60129542150 2020-09-08T15:57:16.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 60129542150 -lt 60129542150 2020-09-08T15:57:16.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T15:57:16.312 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:57:16.312 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:57:16.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 3 == 0 2020-09-08T15:57:16.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T15:57:16.841 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T15:57:16.841 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T15:57:16.842 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T15:57:16.842 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T15:57:16.842 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T15:57:16.842 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T15:57:17.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=3 2020-09-08T15:57:17.231 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T15:57:17.231 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T15:57:17.231 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T15:57:17.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 3 = 3 2020-09-08T15:57:17.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T15:57:17.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T15:57:17.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:461: TEST_backfill_multi_partial: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=2611 count=1 2020-09-08T15:57:17.750 INFO:tasks.workunit.client.0.smithi065.stderr:1+0 records in 2020-09-08T15:57:17.750 INFO:tasks.workunit.client.0.smithi065.stderr:1+0 records out 2020-09-08T15:57:17.750 INFO:tasks.workunit.client.0.smithi065.stderr:2611 bytes (2.6 kB, 2.5 KiB) copied, 6.0112e-05 s, 43.4 MB/s 2020-09-08T15:57:17.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: seq 1 600 2020-09-08T15:57:17.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:17.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-1 td/osd-backfill-space/datafile 2020-09-08T15:57:17.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:17.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-2 td/osd-backfill-space/datafile 2020-09-08T15:57:17.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:17.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-3 td/osd-backfill-space/datafile 2020-09-08T15:57:18.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:18.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-4 td/osd-backfill-space/datafile 2020-09-08T15:57:18.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:18.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-5 td/osd-backfill-space/datafile 2020-09-08T15:57:18.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:18.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-6 td/osd-backfill-space/datafile 2020-09-08T15:57:18.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:18.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-7 td/osd-backfill-space/datafile 2020-09-08T15:57:18.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:18.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-8 td/osd-backfill-space/datafile 2020-09-08T15:57:18.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:18.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-9 td/osd-backfill-space/datafile 2020-09-08T15:57:18.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:18.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-10 td/osd-backfill-space/datafile 2020-09-08T15:57:18.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:18.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-11 td/osd-backfill-space/datafile 2020-09-08T15:57:18.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:18.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-12 td/osd-backfill-space/datafile 2020-09-08T15:57:18.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:18.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-13 td/osd-backfill-space/datafile 2020-09-08T15:57:18.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:18.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-14 td/osd-backfill-space/datafile 2020-09-08T15:57:18.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:18.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-15 td/osd-backfill-space/datafile 2020-09-08T15:57:19.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:19.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-16 td/osd-backfill-space/datafile 2020-09-08T15:57:19.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:19.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-17 td/osd-backfill-space/datafile 2020-09-08T15:57:19.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:19.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-18 td/osd-backfill-space/datafile 2020-09-08T15:57:19.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:19.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-19 td/osd-backfill-space/datafile 2020-09-08T15:57:19.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:19.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-20 td/osd-backfill-space/datafile 2020-09-08T15:57:19.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:19.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-21 td/osd-backfill-space/datafile 2020-09-08T15:57:19.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:19.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-22 td/osd-backfill-space/datafile 2020-09-08T15:57:19.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:19.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-23 td/osd-backfill-space/datafile 2020-09-08T15:57:19.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:19.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-24 td/osd-backfill-space/datafile 2020-09-08T15:57:19.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:19.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-25 td/osd-backfill-space/datafile 2020-09-08T15:57:19.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:19.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-26 td/osd-backfill-space/datafile 2020-09-08T15:57:19.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:19.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-27 td/osd-backfill-space/datafile 2020-09-08T15:57:19.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:19.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-28 td/osd-backfill-space/datafile 2020-09-08T15:57:20.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:20.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-29 td/osd-backfill-space/datafile 2020-09-08T15:57:20.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:20.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-30 td/osd-backfill-space/datafile 2020-09-08T15:57:20.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:20.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-31 td/osd-backfill-space/datafile 2020-09-08T15:57:20.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:20.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-32 td/osd-backfill-space/datafile 2020-09-08T15:57:20.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:20.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-33 td/osd-backfill-space/datafile 2020-09-08T15:57:20.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:20.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-34 td/osd-backfill-space/datafile 2020-09-08T15:57:20.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:20.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-35 td/osd-backfill-space/datafile 2020-09-08T15:57:20.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:20.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-36 td/osd-backfill-space/datafile 2020-09-08T15:57:20.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:20.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-37 td/osd-backfill-space/datafile 2020-09-08T15:57:20.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:20.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-38 td/osd-backfill-space/datafile 2020-09-08T15:57:20.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:20.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-39 td/osd-backfill-space/datafile 2020-09-08T15:57:20.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:20.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-40 td/osd-backfill-space/datafile 2020-09-08T15:57:21.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:21.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-41 td/osd-backfill-space/datafile 2020-09-08T15:57:21.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:21.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-42 td/osd-backfill-space/datafile 2020-09-08T15:57:21.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:21.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-43 td/osd-backfill-space/datafile 2020-09-08T15:57:21.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:21.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-44 td/osd-backfill-space/datafile 2020-09-08T15:57:21.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:21.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-45 td/osd-backfill-space/datafile 2020-09-08T15:57:21.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:21.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-46 td/osd-backfill-space/datafile 2020-09-08T15:57:21.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:21.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-47 td/osd-backfill-space/datafile 2020-09-08T15:57:21.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:21.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-48 td/osd-backfill-space/datafile 2020-09-08T15:57:21.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:21.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-49 td/osd-backfill-space/datafile 2020-09-08T15:57:21.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:21.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-50 td/osd-backfill-space/datafile 2020-09-08T15:57:21.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:21.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-51 td/osd-backfill-space/datafile 2020-09-08T15:57:22.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:22.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-52 td/osd-backfill-space/datafile 2020-09-08T15:57:22.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:22.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-53 td/osd-backfill-space/datafile 2020-09-08T15:57:22.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:22.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-54 td/osd-backfill-space/datafile 2020-09-08T15:57:22.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:22.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-55 td/osd-backfill-space/datafile 2020-09-08T15:57:22.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:22.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-56 td/osd-backfill-space/datafile 2020-09-08T15:57:22.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:22.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-57 td/osd-backfill-space/datafile 2020-09-08T15:57:22.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:22.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-58 td/osd-backfill-space/datafile 2020-09-08T15:57:22.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:22.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-59 td/osd-backfill-space/datafile 2020-09-08T15:57:22.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:22.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-60 td/osd-backfill-space/datafile 2020-09-08T15:57:22.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:22.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-61 td/osd-backfill-space/datafile 2020-09-08T15:57:22.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:22.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-62 td/osd-backfill-space/datafile 2020-09-08T15:57:22.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:22.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-63 td/osd-backfill-space/datafile 2020-09-08T15:57:23.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:23.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-64 td/osd-backfill-space/datafile 2020-09-08T15:57:23.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:23.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-65 td/osd-backfill-space/datafile 2020-09-08T15:57:23.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:23.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-66 td/osd-backfill-space/datafile 2020-09-08T15:57:23.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:23.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-67 td/osd-backfill-space/datafile 2020-09-08T15:57:23.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:23.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-68 td/osd-backfill-space/datafile 2020-09-08T15:57:23.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:23.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-69 td/osd-backfill-space/datafile 2020-09-08T15:57:23.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:23.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-70 td/osd-backfill-space/datafile 2020-09-08T15:57:23.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:23.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-71 td/osd-backfill-space/datafile 2020-09-08T15:57:23.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:23.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-72 td/osd-backfill-space/datafile 2020-09-08T15:57:23.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:23.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-73 td/osd-backfill-space/datafile 2020-09-08T15:57:23.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:23.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-74 td/osd-backfill-space/datafile 2020-09-08T15:57:23.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:23.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-75 td/osd-backfill-space/datafile 2020-09-08T15:57:23.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:23.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-76 td/osd-backfill-space/datafile 2020-09-08T15:57:24.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:24.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-77 td/osd-backfill-space/datafile 2020-09-08T15:57:24.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:24.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-78 td/osd-backfill-space/datafile 2020-09-08T15:57:24.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:24.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-79 td/osd-backfill-space/datafile 2020-09-08T15:57:24.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:24.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-80 td/osd-backfill-space/datafile 2020-09-08T15:57:24.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:24.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-81 td/osd-backfill-space/datafile 2020-09-08T15:57:24.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:24.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-82 td/osd-backfill-space/datafile 2020-09-08T15:57:24.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:24.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-83 td/osd-backfill-space/datafile 2020-09-08T15:57:24.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:24.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-84 td/osd-backfill-space/datafile 2020-09-08T15:57:24.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:24.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-85 td/osd-backfill-space/datafile 2020-09-08T15:57:24.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:24.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-86 td/osd-backfill-space/datafile 2020-09-08T15:57:24.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:24.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-87 td/osd-backfill-space/datafile 2020-09-08T15:57:24.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:24.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-88 td/osd-backfill-space/datafile 2020-09-08T15:57:25.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:25.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-89 td/osd-backfill-space/datafile 2020-09-08T15:57:25.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:25.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-90 td/osd-backfill-space/datafile 2020-09-08T15:57:25.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:25.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-91 td/osd-backfill-space/datafile 2020-09-08T15:57:25.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:25.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-92 td/osd-backfill-space/datafile 2020-09-08T15:57:25.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:25.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-93 td/osd-backfill-space/datafile 2020-09-08T15:57:25.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:25.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-94 td/osd-backfill-space/datafile 2020-09-08T15:57:25.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:25.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-95 td/osd-backfill-space/datafile 2020-09-08T15:57:25.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:25.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-96 td/osd-backfill-space/datafile 2020-09-08T15:57:25.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:25.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-97 td/osd-backfill-space/datafile 2020-09-08T15:57:25.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:25.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-98 td/osd-backfill-space/datafile 2020-09-08T15:57:25.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:25.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-99 td/osd-backfill-space/datafile 2020-09-08T15:57:25.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:25.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-100 td/osd-backfill-space/datafile 2020-09-08T15:57:25.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:25.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-101 td/osd-backfill-space/datafile 2020-09-08T15:57:26.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:26.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-102 td/osd-backfill-space/datafile 2020-09-08T15:57:26.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:26.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-103 td/osd-backfill-space/datafile 2020-09-08T15:57:26.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:26.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-104 td/osd-backfill-space/datafile 2020-09-08T15:57:26.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:26.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-105 td/osd-backfill-space/datafile 2020-09-08T15:57:26.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:26.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-106 td/osd-backfill-space/datafile 2020-09-08T15:57:26.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:26.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-107 td/osd-backfill-space/datafile 2020-09-08T15:57:26.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:26.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-108 td/osd-backfill-space/datafile 2020-09-08T15:57:26.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:26.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-109 td/osd-backfill-space/datafile 2020-09-08T15:57:26.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:26.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-110 td/osd-backfill-space/datafile 2020-09-08T15:57:26.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:26.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-111 td/osd-backfill-space/datafile 2020-09-08T15:57:26.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:26.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-112 td/osd-backfill-space/datafile 2020-09-08T15:57:26.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:26.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-113 td/osd-backfill-space/datafile 2020-09-08T15:57:26.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:26.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-114 td/osd-backfill-space/datafile 2020-09-08T15:57:27.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:27.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-115 td/osd-backfill-space/datafile 2020-09-08T15:57:27.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:27.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-116 td/osd-backfill-space/datafile 2020-09-08T15:57:27.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:27.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-117 td/osd-backfill-space/datafile 2020-09-08T15:57:27.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:27.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-118 td/osd-backfill-space/datafile 2020-09-08T15:57:27.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:27.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-119 td/osd-backfill-space/datafile 2020-09-08T15:57:27.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:27.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-120 td/osd-backfill-space/datafile 2020-09-08T15:57:27.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:27.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-121 td/osd-backfill-space/datafile 2020-09-08T15:57:27.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:27.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-122 td/osd-backfill-space/datafile 2020-09-08T15:57:27.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:27.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-123 td/osd-backfill-space/datafile 2020-09-08T15:57:27.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:27.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-124 td/osd-backfill-space/datafile 2020-09-08T15:57:27.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:27.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-125 td/osd-backfill-space/datafile 2020-09-08T15:57:27.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:27.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-126 td/osd-backfill-space/datafile 2020-09-08T15:57:28.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:28.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-127 td/osd-backfill-space/datafile 2020-09-08T15:57:28.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:28.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-128 td/osd-backfill-space/datafile 2020-09-08T15:57:28.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:28.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-129 td/osd-backfill-space/datafile 2020-09-08T15:57:28.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:28.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-130 td/osd-backfill-space/datafile 2020-09-08T15:57:28.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:28.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-131 td/osd-backfill-space/datafile 2020-09-08T15:57:28.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:28.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-132 td/osd-backfill-space/datafile 2020-09-08T15:57:28.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:28.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-133 td/osd-backfill-space/datafile 2020-09-08T15:57:28.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:28.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-134 td/osd-backfill-space/datafile 2020-09-08T15:57:28.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:28.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-135 td/osd-backfill-space/datafile 2020-09-08T15:57:28.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:28.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-136 td/osd-backfill-space/datafile 2020-09-08T15:57:28.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:28.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-137 td/osd-backfill-space/datafile 2020-09-08T15:57:28.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:28.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-138 td/osd-backfill-space/datafile 2020-09-08T15:57:29.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:29.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-139 td/osd-backfill-space/datafile 2020-09-08T15:57:29.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:29.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-140 td/osd-backfill-space/datafile 2020-09-08T15:57:29.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:29.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-141 td/osd-backfill-space/datafile 2020-09-08T15:57:29.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:29.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-142 td/osd-backfill-space/datafile 2020-09-08T15:57:29.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:29.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-143 td/osd-backfill-space/datafile 2020-09-08T15:57:29.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:29.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-144 td/osd-backfill-space/datafile 2020-09-08T15:57:29.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:29.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-145 td/osd-backfill-space/datafile 2020-09-08T15:57:29.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:29.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-146 td/osd-backfill-space/datafile 2020-09-08T15:57:29.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:29.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-147 td/osd-backfill-space/datafile 2020-09-08T15:57:29.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:29.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-148 td/osd-backfill-space/datafile 2020-09-08T15:57:29.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:29.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-149 td/osd-backfill-space/datafile 2020-09-08T15:57:29.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:29.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-150 td/osd-backfill-space/datafile 2020-09-08T15:57:29.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:29.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-151 td/osd-backfill-space/datafile 2020-09-08T15:57:30.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:30.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-152 td/osd-backfill-space/datafile 2020-09-08T15:57:30.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:30.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-153 td/osd-backfill-space/datafile 2020-09-08T15:57:30.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:30.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-154 td/osd-backfill-space/datafile 2020-09-08T15:57:30.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:30.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-155 td/osd-backfill-space/datafile 2020-09-08T15:57:30.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:30.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-156 td/osd-backfill-space/datafile 2020-09-08T15:57:30.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:30.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-157 td/osd-backfill-space/datafile 2020-09-08T15:57:30.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:30.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-158 td/osd-backfill-space/datafile 2020-09-08T15:57:30.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:30.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-159 td/osd-backfill-space/datafile 2020-09-08T15:57:30.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:30.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-160 td/osd-backfill-space/datafile 2020-09-08T15:57:30.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:30.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-161 td/osd-backfill-space/datafile 2020-09-08T15:57:30.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:30.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-162 td/osd-backfill-space/datafile 2020-09-08T15:57:30.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:30.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-163 td/osd-backfill-space/datafile 2020-09-08T15:57:31.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:31.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-164 td/osd-backfill-space/datafile 2020-09-08T15:57:31.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:31.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-165 td/osd-backfill-space/datafile 2020-09-08T15:57:31.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:31.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-166 td/osd-backfill-space/datafile 2020-09-08T15:57:31.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:31.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-167 td/osd-backfill-space/datafile 2020-09-08T15:57:31.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:31.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-168 td/osd-backfill-space/datafile 2020-09-08T15:57:31.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:31.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-169 td/osd-backfill-space/datafile 2020-09-08T15:57:31.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:31.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-170 td/osd-backfill-space/datafile 2020-09-08T15:57:31.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:31.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-171 td/osd-backfill-space/datafile 2020-09-08T15:57:31.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:31.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-172 td/osd-backfill-space/datafile 2020-09-08T15:57:31.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:31.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-173 td/osd-backfill-space/datafile 2020-09-08T15:57:31.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:31.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-174 td/osd-backfill-space/datafile 2020-09-08T15:57:31.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:31.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-175 td/osd-backfill-space/datafile 2020-09-08T15:57:32.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:32.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-176 td/osd-backfill-space/datafile 2020-09-08T15:57:32.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:32.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-177 td/osd-backfill-space/datafile 2020-09-08T15:57:32.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:32.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-178 td/osd-backfill-space/datafile 2020-09-08T15:57:32.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:32.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-179 td/osd-backfill-space/datafile 2020-09-08T15:57:32.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:32.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-180 td/osd-backfill-space/datafile 2020-09-08T15:57:32.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:32.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-181 td/osd-backfill-space/datafile 2020-09-08T15:57:32.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:32.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-182 td/osd-backfill-space/datafile 2020-09-08T15:57:32.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:32.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-183 td/osd-backfill-space/datafile 2020-09-08T15:57:32.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:32.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-184 td/osd-backfill-space/datafile 2020-09-08T15:57:32.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:32.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-185 td/osd-backfill-space/datafile 2020-09-08T15:57:32.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:32.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-186 td/osd-backfill-space/datafile 2020-09-08T15:57:32.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:32.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-187 td/osd-backfill-space/datafile 2020-09-08T15:57:33.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:33.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-188 td/osd-backfill-space/datafile 2020-09-08T15:57:33.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:33.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-189 td/osd-backfill-space/datafile 2020-09-08T15:57:33.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:33.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-190 td/osd-backfill-space/datafile 2020-09-08T15:57:33.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:33.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-191 td/osd-backfill-space/datafile 2020-09-08T15:57:33.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:33.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-192 td/osd-backfill-space/datafile 2020-09-08T15:57:33.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:33.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-193 td/osd-backfill-space/datafile 2020-09-08T15:57:33.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:33.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-194 td/osd-backfill-space/datafile 2020-09-08T15:57:33.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:33.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-195 td/osd-backfill-space/datafile 2020-09-08T15:57:33.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:33.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-196 td/osd-backfill-space/datafile 2020-09-08T15:57:33.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:33.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-197 td/osd-backfill-space/datafile 2020-09-08T15:57:33.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:33.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-198 td/osd-backfill-space/datafile 2020-09-08T15:57:33.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:33.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-199 td/osd-backfill-space/datafile 2020-09-08T15:57:34.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:34.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-200 td/osd-backfill-space/datafile 2020-09-08T15:57:34.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:34.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-201 td/osd-backfill-space/datafile 2020-09-08T15:57:34.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:34.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-202 td/osd-backfill-space/datafile 2020-09-08T15:57:34.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:34.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-203 td/osd-backfill-space/datafile 2020-09-08T15:57:34.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:34.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-204 td/osd-backfill-space/datafile 2020-09-08T15:57:34.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:34.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-205 td/osd-backfill-space/datafile 2020-09-08T15:57:34.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:34.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-206 td/osd-backfill-space/datafile 2020-09-08T15:57:34.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:34.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-207 td/osd-backfill-space/datafile 2020-09-08T15:57:34.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:34.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-208 td/osd-backfill-space/datafile 2020-09-08T15:57:34.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:34.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-209 td/osd-backfill-space/datafile 2020-09-08T15:57:34.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:34.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-210 td/osd-backfill-space/datafile 2020-09-08T15:57:34.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:34.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-211 td/osd-backfill-space/datafile 2020-09-08T15:57:34.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:34.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-212 td/osd-backfill-space/datafile 2020-09-08T15:57:35.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:35.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-213 td/osd-backfill-space/datafile 2020-09-08T15:57:35.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:35.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-214 td/osd-backfill-space/datafile 2020-09-08T15:57:35.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:35.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-215 td/osd-backfill-space/datafile 2020-09-08T15:57:35.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:35.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-216 td/osd-backfill-space/datafile 2020-09-08T15:57:35.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:35.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-217 td/osd-backfill-space/datafile 2020-09-08T15:57:35.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:35.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-218 td/osd-backfill-space/datafile 2020-09-08T15:57:35.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:35.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-219 td/osd-backfill-space/datafile 2020-09-08T15:57:35.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:35.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-220 td/osd-backfill-space/datafile 2020-09-08T15:57:35.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:35.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-221 td/osd-backfill-space/datafile 2020-09-08T15:57:35.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:35.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-222 td/osd-backfill-space/datafile 2020-09-08T15:57:35.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:35.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-223 td/osd-backfill-space/datafile 2020-09-08T15:57:35.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:35.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-224 td/osd-backfill-space/datafile 2020-09-08T15:57:36.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:36.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-225 td/osd-backfill-space/datafile 2020-09-08T15:57:36.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:36.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-226 td/osd-backfill-space/datafile 2020-09-08T15:57:36.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:36.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-227 td/osd-backfill-space/datafile 2020-09-08T15:57:36.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:36.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-228 td/osd-backfill-space/datafile 2020-09-08T15:57:36.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:36.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-229 td/osd-backfill-space/datafile 2020-09-08T15:57:36.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:36.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-230 td/osd-backfill-space/datafile 2020-09-08T15:57:36.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:36.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-231 td/osd-backfill-space/datafile 2020-09-08T15:57:36.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:36.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-232 td/osd-backfill-space/datafile 2020-09-08T15:57:36.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:36.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-233 td/osd-backfill-space/datafile 2020-09-08T15:57:36.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:36.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-234 td/osd-backfill-space/datafile 2020-09-08T15:57:36.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:36.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-235 td/osd-backfill-space/datafile 2020-09-08T15:57:36.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:36.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-236 td/osd-backfill-space/datafile 2020-09-08T15:57:37.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:37.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-237 td/osd-backfill-space/datafile 2020-09-08T15:57:37.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:37.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-238 td/osd-backfill-space/datafile 2020-09-08T15:57:37.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:37.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-239 td/osd-backfill-space/datafile 2020-09-08T15:57:37.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:37.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-240 td/osd-backfill-space/datafile 2020-09-08T15:57:37.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:37.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-241 td/osd-backfill-space/datafile 2020-09-08T15:57:37.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:37.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-242 td/osd-backfill-space/datafile 2020-09-08T15:57:37.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:37.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-243 td/osd-backfill-space/datafile 2020-09-08T15:57:37.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:37.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-244 td/osd-backfill-space/datafile 2020-09-08T15:57:37.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:37.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-245 td/osd-backfill-space/datafile 2020-09-08T15:57:37.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:37.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-246 td/osd-backfill-space/datafile 2020-09-08T15:57:37.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:37.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-247 td/osd-backfill-space/datafile 2020-09-08T15:57:37.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:37.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-248 td/osd-backfill-space/datafile 2020-09-08T15:57:38.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:38.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-249 td/osd-backfill-space/datafile 2020-09-08T15:57:38.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:38.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-250 td/osd-backfill-space/datafile 2020-09-08T15:57:38.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:38.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-251 td/osd-backfill-space/datafile 2020-09-08T15:57:38.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:38.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-252 td/osd-backfill-space/datafile 2020-09-08T15:57:38.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:38.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-253 td/osd-backfill-space/datafile 2020-09-08T15:57:38.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:38.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-254 td/osd-backfill-space/datafile 2020-09-08T15:57:38.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:38.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-255 td/osd-backfill-space/datafile 2020-09-08T15:57:38.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:38.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-256 td/osd-backfill-space/datafile 2020-09-08T15:57:38.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:38.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-257 td/osd-backfill-space/datafile 2020-09-08T15:57:38.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:38.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-258 td/osd-backfill-space/datafile 2020-09-08T15:57:38.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:38.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-259 td/osd-backfill-space/datafile 2020-09-08T15:57:38.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:38.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-260 td/osd-backfill-space/datafile 2020-09-08T15:57:39.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:39.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-261 td/osd-backfill-space/datafile 2020-09-08T15:57:39.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:39.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-262 td/osd-backfill-space/datafile 2020-09-08T15:57:39.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:39.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-263 td/osd-backfill-space/datafile 2020-09-08T15:57:39.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:39.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-264 td/osd-backfill-space/datafile 2020-09-08T15:57:39.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:39.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-265 td/osd-backfill-space/datafile 2020-09-08T15:57:39.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:39.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-266 td/osd-backfill-space/datafile 2020-09-08T15:57:39.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:39.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-267 td/osd-backfill-space/datafile 2020-09-08T15:57:39.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:39.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-268 td/osd-backfill-space/datafile 2020-09-08T15:57:39.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:39.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-269 td/osd-backfill-space/datafile 2020-09-08T15:57:39.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:39.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-270 td/osd-backfill-space/datafile 2020-09-08T15:57:39.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:39.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-271 td/osd-backfill-space/datafile 2020-09-08T15:57:39.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:39.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-272 td/osd-backfill-space/datafile 2020-09-08T15:57:39.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:39.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-273 td/osd-backfill-space/datafile 2020-09-08T15:57:40.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:40.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-274 td/osd-backfill-space/datafile 2020-09-08T15:57:40.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:40.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-275 td/osd-backfill-space/datafile 2020-09-08T15:57:40.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:40.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-276 td/osd-backfill-space/datafile 2020-09-08T15:57:40.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:40.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-277 td/osd-backfill-space/datafile 2020-09-08T15:57:40.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:40.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-278 td/osd-backfill-space/datafile 2020-09-08T15:57:40.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:40.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-279 td/osd-backfill-space/datafile 2020-09-08T15:57:40.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:40.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-280 td/osd-backfill-space/datafile 2020-09-08T15:57:40.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:40.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-281 td/osd-backfill-space/datafile 2020-09-08T15:57:40.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:40.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-282 td/osd-backfill-space/datafile 2020-09-08T15:57:40.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:40.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-283 td/osd-backfill-space/datafile 2020-09-08T15:57:40.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:40.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-284 td/osd-backfill-space/datafile 2020-09-08T15:57:40.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:40.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-285 td/osd-backfill-space/datafile 2020-09-08T15:57:41.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:41.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-286 td/osd-backfill-space/datafile 2020-09-08T15:57:41.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:41.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-287 td/osd-backfill-space/datafile 2020-09-08T15:57:41.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:41.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-288 td/osd-backfill-space/datafile 2020-09-08T15:57:41.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:41.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-289 td/osd-backfill-space/datafile 2020-09-08T15:57:41.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:41.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-290 td/osd-backfill-space/datafile 2020-09-08T15:57:41.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:41.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-291 td/osd-backfill-space/datafile 2020-09-08T15:57:41.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:41.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-292 td/osd-backfill-space/datafile 2020-09-08T15:57:41.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:41.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-293 td/osd-backfill-space/datafile 2020-09-08T15:57:41.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:41.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-294 td/osd-backfill-space/datafile 2020-09-08T15:57:41.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:41.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-295 td/osd-backfill-space/datafile 2020-09-08T15:57:42.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:42.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-296 td/osd-backfill-space/datafile 2020-09-08T15:57:42.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:42.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-297 td/osd-backfill-space/datafile 2020-09-08T15:57:42.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:42.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-298 td/osd-backfill-space/datafile 2020-09-08T15:57:42.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:42.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-299 td/osd-backfill-space/datafile 2020-09-08T15:57:42.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:42.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-300 td/osd-backfill-space/datafile 2020-09-08T15:57:42.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:42.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-301 td/osd-backfill-space/datafile 2020-09-08T15:57:42.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:42.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-302 td/osd-backfill-space/datafile 2020-09-08T15:57:42.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:42.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-303 td/osd-backfill-space/datafile 2020-09-08T15:57:42.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:42.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-304 td/osd-backfill-space/datafile 2020-09-08T15:57:42.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:42.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-305 td/osd-backfill-space/datafile 2020-09-08T15:57:42.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:42.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-306 td/osd-backfill-space/datafile 2020-09-08T15:57:43.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:43.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-307 td/osd-backfill-space/datafile 2020-09-08T15:57:43.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:43.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-308 td/osd-backfill-space/datafile 2020-09-08T15:57:43.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:43.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-309 td/osd-backfill-space/datafile 2020-09-08T15:57:43.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:43.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-310 td/osd-backfill-space/datafile 2020-09-08T15:57:43.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:43.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-311 td/osd-backfill-space/datafile 2020-09-08T15:57:43.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:43.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-312 td/osd-backfill-space/datafile 2020-09-08T15:57:43.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:43.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-313 td/osd-backfill-space/datafile 2020-09-08T15:57:43.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:43.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-314 td/osd-backfill-space/datafile 2020-09-08T15:57:43.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:43.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-315 td/osd-backfill-space/datafile 2020-09-08T15:57:43.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:43.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-316 td/osd-backfill-space/datafile 2020-09-08T15:57:43.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:43.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-317 td/osd-backfill-space/datafile 2020-09-08T15:57:43.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:43.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-318 td/osd-backfill-space/datafile 2020-09-08T15:57:43.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:43.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-319 td/osd-backfill-space/datafile 2020-09-08T15:57:44.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:44.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-320 td/osd-backfill-space/datafile 2020-09-08T15:57:44.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:44.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-321 td/osd-backfill-space/datafile 2020-09-08T15:57:44.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:44.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-322 td/osd-backfill-space/datafile 2020-09-08T15:57:44.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:44.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-323 td/osd-backfill-space/datafile 2020-09-08T15:57:44.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:44.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-324 td/osd-backfill-space/datafile 2020-09-08T15:57:44.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:44.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-325 td/osd-backfill-space/datafile 2020-09-08T15:57:44.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:44.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-326 td/osd-backfill-space/datafile 2020-09-08T15:57:44.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:44.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-327 td/osd-backfill-space/datafile 2020-09-08T15:57:44.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:44.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-328 td/osd-backfill-space/datafile 2020-09-08T15:57:44.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:44.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-329 td/osd-backfill-space/datafile 2020-09-08T15:57:44.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:44.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-330 td/osd-backfill-space/datafile 2020-09-08T15:57:44.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:44.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-331 td/osd-backfill-space/datafile 2020-09-08T15:57:45.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:45.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-332 td/osd-backfill-space/datafile 2020-09-08T15:57:45.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:45.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-333 td/osd-backfill-space/datafile 2020-09-08T15:57:45.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:45.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-334 td/osd-backfill-space/datafile 2020-09-08T15:57:45.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:45.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-335 td/osd-backfill-space/datafile 2020-09-08T15:57:45.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:45.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-336 td/osd-backfill-space/datafile 2020-09-08T15:57:45.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:45.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-337 td/osd-backfill-space/datafile 2020-09-08T15:57:45.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:45.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-338 td/osd-backfill-space/datafile 2020-09-08T15:57:45.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:45.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-339 td/osd-backfill-space/datafile 2020-09-08T15:57:45.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:45.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-340 td/osd-backfill-space/datafile 2020-09-08T15:57:45.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:45.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-341 td/osd-backfill-space/datafile 2020-09-08T15:57:45.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:45.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-342 td/osd-backfill-space/datafile 2020-09-08T15:57:45.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:45.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-343 td/osd-backfill-space/datafile 2020-09-08T15:57:46.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:46.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-344 td/osd-backfill-space/datafile 2020-09-08T15:57:46.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:46.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-345 td/osd-backfill-space/datafile 2020-09-08T15:57:46.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:46.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-346 td/osd-backfill-space/datafile 2020-09-08T15:57:46.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:46.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-347 td/osd-backfill-space/datafile 2020-09-08T15:57:46.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:46.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-348 td/osd-backfill-space/datafile 2020-09-08T15:57:46.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:46.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-349 td/osd-backfill-space/datafile 2020-09-08T15:57:46.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:46.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-350 td/osd-backfill-space/datafile 2020-09-08T15:57:46.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:46.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-351 td/osd-backfill-space/datafile 2020-09-08T15:57:46.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:46.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-352 td/osd-backfill-space/datafile 2020-09-08T15:57:46.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:46.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-353 td/osd-backfill-space/datafile 2020-09-08T15:57:46.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:46.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-354 td/osd-backfill-space/datafile 2020-09-08T15:57:46.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:46.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-355 td/osd-backfill-space/datafile 2020-09-08T15:57:46.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:46.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-356 td/osd-backfill-space/datafile 2020-09-08T15:57:47.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:47.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-357 td/osd-backfill-space/datafile 2020-09-08T15:57:47.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:47.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-358 td/osd-backfill-space/datafile 2020-09-08T15:57:47.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:47.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-359 td/osd-backfill-space/datafile 2020-09-08T15:57:47.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:47.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-360 td/osd-backfill-space/datafile 2020-09-08T15:57:47.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:47.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-361 td/osd-backfill-space/datafile 2020-09-08T15:57:47.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:47.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-362 td/osd-backfill-space/datafile 2020-09-08T15:57:47.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:47.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-363 td/osd-backfill-space/datafile 2020-09-08T15:57:47.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:47.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-364 td/osd-backfill-space/datafile 2020-09-08T15:57:47.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:47.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-365 td/osd-backfill-space/datafile 2020-09-08T15:57:47.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:47.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-366 td/osd-backfill-space/datafile 2020-09-08T15:57:47.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:47.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-367 td/osd-backfill-space/datafile 2020-09-08T15:57:47.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:47.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-368 td/osd-backfill-space/datafile 2020-09-08T15:57:48.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:48.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-369 td/osd-backfill-space/datafile 2020-09-08T15:57:48.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:48.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-370 td/osd-backfill-space/datafile 2020-09-08T15:57:48.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:48.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-371 td/osd-backfill-space/datafile 2020-09-08T15:57:48.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:48.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-372 td/osd-backfill-space/datafile 2020-09-08T15:57:48.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:48.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-373 td/osd-backfill-space/datafile 2020-09-08T15:57:48.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:48.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-374 td/osd-backfill-space/datafile 2020-09-08T15:57:48.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:48.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-375 td/osd-backfill-space/datafile 2020-09-08T15:57:48.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:48.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-376 td/osd-backfill-space/datafile 2020-09-08T15:57:48.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:48.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-377 td/osd-backfill-space/datafile 2020-09-08T15:57:48.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:48.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-378 td/osd-backfill-space/datafile 2020-09-08T15:57:48.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:48.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-379 td/osd-backfill-space/datafile 2020-09-08T15:57:48.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:48.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-380 td/osd-backfill-space/datafile 2020-09-08T15:57:49.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:49.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-381 td/osd-backfill-space/datafile 2020-09-08T15:57:49.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:49.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-382 td/osd-backfill-space/datafile 2020-09-08T15:57:49.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:49.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-383 td/osd-backfill-space/datafile 2020-09-08T15:57:49.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:49.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-384 td/osd-backfill-space/datafile 2020-09-08T15:57:49.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:49.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-385 td/osd-backfill-space/datafile 2020-09-08T15:57:49.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:49.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-386 td/osd-backfill-space/datafile 2020-09-08T15:57:49.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:49.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-387 td/osd-backfill-space/datafile 2020-09-08T15:57:49.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:49.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-388 td/osd-backfill-space/datafile 2020-09-08T15:57:49.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:49.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-389 td/osd-backfill-space/datafile 2020-09-08T15:57:49.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:49.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-390 td/osd-backfill-space/datafile 2020-09-08T15:57:49.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:49.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-391 td/osd-backfill-space/datafile 2020-09-08T15:57:49.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:49.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-392 td/osd-backfill-space/datafile 2020-09-08T15:57:49.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:49.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-393 td/osd-backfill-space/datafile 2020-09-08T15:57:50.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:50.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-394 td/osd-backfill-space/datafile 2020-09-08T15:57:50.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:50.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-395 td/osd-backfill-space/datafile 2020-09-08T15:57:50.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:50.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-396 td/osd-backfill-space/datafile 2020-09-08T15:57:50.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:50.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-397 td/osd-backfill-space/datafile 2020-09-08T15:57:50.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:50.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-398 td/osd-backfill-space/datafile 2020-09-08T15:57:50.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:50.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-399 td/osd-backfill-space/datafile 2020-09-08T15:57:50.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:50.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-400 td/osd-backfill-space/datafile 2020-09-08T15:57:50.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:50.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-401 td/osd-backfill-space/datafile 2020-09-08T15:57:50.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:50.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-402 td/osd-backfill-space/datafile 2020-09-08T15:57:50.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:50.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-403 td/osd-backfill-space/datafile 2020-09-08T15:57:50.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:50.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-404 td/osd-backfill-space/datafile 2020-09-08T15:57:50.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:50.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-405 td/osd-backfill-space/datafile 2020-09-08T15:57:50.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:50.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-406 td/osd-backfill-space/datafile 2020-09-08T15:57:51.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:51.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-407 td/osd-backfill-space/datafile 2020-09-08T15:57:51.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:51.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-408 td/osd-backfill-space/datafile 2020-09-08T15:57:51.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:51.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-409 td/osd-backfill-space/datafile 2020-09-08T15:57:51.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:51.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-410 td/osd-backfill-space/datafile 2020-09-08T15:57:51.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:51.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-411 td/osd-backfill-space/datafile 2020-09-08T15:57:51.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:51.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-412 td/osd-backfill-space/datafile 2020-09-08T15:57:51.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:51.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-413 td/osd-backfill-space/datafile 2020-09-08T15:57:51.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:51.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-414 td/osd-backfill-space/datafile 2020-09-08T15:57:51.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:51.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-415 td/osd-backfill-space/datafile 2020-09-08T15:57:51.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:51.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-416 td/osd-backfill-space/datafile 2020-09-08T15:57:51.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:51.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-417 td/osd-backfill-space/datafile 2020-09-08T15:57:51.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:51.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-418 td/osd-backfill-space/datafile 2020-09-08T15:57:52.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:52.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-419 td/osd-backfill-space/datafile 2020-09-08T15:57:52.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:52.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-420 td/osd-backfill-space/datafile 2020-09-08T15:57:52.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:52.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-421 td/osd-backfill-space/datafile 2020-09-08T15:57:52.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:52.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-422 td/osd-backfill-space/datafile 2020-09-08T15:57:52.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:52.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-423 td/osd-backfill-space/datafile 2020-09-08T15:57:52.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:52.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-424 td/osd-backfill-space/datafile 2020-09-08T15:57:52.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:52.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-425 td/osd-backfill-space/datafile 2020-09-08T15:57:52.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:52.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-426 td/osd-backfill-space/datafile 2020-09-08T15:57:52.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:52.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-427 td/osd-backfill-space/datafile 2020-09-08T15:57:52.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:52.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-428 td/osd-backfill-space/datafile 2020-09-08T15:57:52.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:52.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-429 td/osd-backfill-space/datafile 2020-09-08T15:57:52.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:52.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-430 td/osd-backfill-space/datafile 2020-09-08T15:57:53.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:53.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-431 td/osd-backfill-space/datafile 2020-09-08T15:57:53.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:53.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-432 td/osd-backfill-space/datafile 2020-09-08T15:57:53.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:53.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-433 td/osd-backfill-space/datafile 2020-09-08T15:57:53.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:53.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-434 td/osd-backfill-space/datafile 2020-09-08T15:57:53.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:53.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-435 td/osd-backfill-space/datafile 2020-09-08T15:57:53.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:53.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-436 td/osd-backfill-space/datafile 2020-09-08T15:57:53.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:53.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-437 td/osd-backfill-space/datafile 2020-09-08T15:57:53.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:53.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-438 td/osd-backfill-space/datafile 2020-09-08T15:57:53.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:53.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-439 td/osd-backfill-space/datafile 2020-09-08T15:57:53.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:53.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-440 td/osd-backfill-space/datafile 2020-09-08T15:57:53.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:53.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-441 td/osd-backfill-space/datafile 2020-09-08T15:57:53.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:53.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-442 td/osd-backfill-space/datafile 2020-09-08T15:57:53.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:53.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-443 td/osd-backfill-space/datafile 2020-09-08T15:57:54.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:54.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-444 td/osd-backfill-space/datafile 2020-09-08T15:57:54.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:54.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-445 td/osd-backfill-space/datafile 2020-09-08T15:57:54.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:54.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-446 td/osd-backfill-space/datafile 2020-09-08T15:57:54.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:54.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-447 td/osd-backfill-space/datafile 2020-09-08T15:57:54.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:54.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-448 td/osd-backfill-space/datafile 2020-09-08T15:57:54.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:54.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-449 td/osd-backfill-space/datafile 2020-09-08T15:57:54.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:54.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-450 td/osd-backfill-space/datafile 2020-09-08T15:57:54.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:54.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-451 td/osd-backfill-space/datafile 2020-09-08T15:57:54.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:54.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-452 td/osd-backfill-space/datafile 2020-09-08T15:57:54.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:54.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-453 td/osd-backfill-space/datafile 2020-09-08T15:57:54.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:54.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-454 td/osd-backfill-space/datafile 2020-09-08T15:57:54.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:54.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-455 td/osd-backfill-space/datafile 2020-09-08T15:57:55.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:55.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-456 td/osd-backfill-space/datafile 2020-09-08T15:57:55.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:55.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-457 td/osd-backfill-space/datafile 2020-09-08T15:57:55.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:55.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-458 td/osd-backfill-space/datafile 2020-09-08T15:57:55.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:55.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-459 td/osd-backfill-space/datafile 2020-09-08T15:57:55.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:55.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-460 td/osd-backfill-space/datafile 2020-09-08T15:57:55.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:55.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-461 td/osd-backfill-space/datafile 2020-09-08T15:57:55.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:55.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-462 td/osd-backfill-space/datafile 2020-09-08T15:57:55.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:55.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-463 td/osd-backfill-space/datafile 2020-09-08T15:57:55.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:55.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-464 td/osd-backfill-space/datafile 2020-09-08T15:57:55.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:55.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-465 td/osd-backfill-space/datafile 2020-09-08T15:57:55.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:55.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-466 td/osd-backfill-space/datafile 2020-09-08T15:57:55.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:55.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-467 td/osd-backfill-space/datafile 2020-09-08T15:57:55.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:55.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-468 td/osd-backfill-space/datafile 2020-09-08T15:57:56.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:56.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-469 td/osd-backfill-space/datafile 2020-09-08T15:57:56.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:56.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-470 td/osd-backfill-space/datafile 2020-09-08T15:57:56.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:56.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-471 td/osd-backfill-space/datafile 2020-09-08T15:57:56.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:56.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-472 td/osd-backfill-space/datafile 2020-09-08T15:57:56.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:56.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-473 td/osd-backfill-space/datafile 2020-09-08T15:57:56.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:56.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-474 td/osd-backfill-space/datafile 2020-09-08T15:57:56.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:56.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-475 td/osd-backfill-space/datafile 2020-09-08T15:57:56.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:56.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-476 td/osd-backfill-space/datafile 2020-09-08T15:57:56.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:56.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-477 td/osd-backfill-space/datafile 2020-09-08T15:57:56.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:56.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-478 td/osd-backfill-space/datafile 2020-09-08T15:57:56.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:56.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-479 td/osd-backfill-space/datafile 2020-09-08T15:57:56.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:56.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-480 td/osd-backfill-space/datafile 2020-09-08T15:57:56.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:56.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-481 td/osd-backfill-space/datafile 2020-09-08T15:57:57.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:57.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-482 td/osd-backfill-space/datafile 2020-09-08T15:57:57.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:57.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-483 td/osd-backfill-space/datafile 2020-09-08T15:57:57.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:57.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-484 td/osd-backfill-space/datafile 2020-09-08T15:57:57.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:57.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-485 td/osd-backfill-space/datafile 2020-09-08T15:57:57.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:57.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-486 td/osd-backfill-space/datafile 2020-09-08T15:57:57.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:57.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-487 td/osd-backfill-space/datafile 2020-09-08T15:57:57.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:57.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-488 td/osd-backfill-space/datafile 2020-09-08T15:57:57.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:57.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-489 td/osd-backfill-space/datafile 2020-09-08T15:57:57.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:57.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-490 td/osd-backfill-space/datafile 2020-09-08T15:57:57.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:57.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-491 td/osd-backfill-space/datafile 2020-09-08T15:57:57.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:57.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-492 td/osd-backfill-space/datafile 2020-09-08T15:57:57.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:57.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-493 td/osd-backfill-space/datafile 2020-09-08T15:57:58.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:58.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-494 td/osd-backfill-space/datafile 2020-09-08T15:57:58.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:58.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-495 td/osd-backfill-space/datafile 2020-09-08T15:57:58.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:58.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-496 td/osd-backfill-space/datafile 2020-09-08T15:57:58.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:58.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-497 td/osd-backfill-space/datafile 2020-09-08T15:57:58.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:58.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-498 td/osd-backfill-space/datafile 2020-09-08T15:57:58.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:58.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-499 td/osd-backfill-space/datafile 2020-09-08T15:57:58.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:58.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-500 td/osd-backfill-space/datafile 2020-09-08T15:57:58.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:58.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-501 td/osd-backfill-space/datafile 2020-09-08T15:57:58.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:58.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-502 td/osd-backfill-space/datafile 2020-09-08T15:57:58.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:58.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-503 td/osd-backfill-space/datafile 2020-09-08T15:57:58.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:58.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-504 td/osd-backfill-space/datafile 2020-09-08T15:57:58.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:58.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-505 td/osd-backfill-space/datafile 2020-09-08T15:57:59.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:59.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-506 td/osd-backfill-space/datafile 2020-09-08T15:57:59.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:59.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-507 td/osd-backfill-space/datafile 2020-09-08T15:57:59.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:59.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-508 td/osd-backfill-space/datafile 2020-09-08T15:57:59.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:59.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-509 td/osd-backfill-space/datafile 2020-09-08T15:57:59.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:59.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-510 td/osd-backfill-space/datafile 2020-09-08T15:57:59.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:59.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-511 td/osd-backfill-space/datafile 2020-09-08T15:57:59.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:59.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-512 td/osd-backfill-space/datafile 2020-09-08T15:57:59.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:59.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-513 td/osd-backfill-space/datafile 2020-09-08T15:57:59.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:59.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-514 td/osd-backfill-space/datafile 2020-09-08T15:57:59.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:59.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-515 td/osd-backfill-space/datafile 2020-09-08T15:57:59.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:59.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-516 td/osd-backfill-space/datafile 2020-09-08T15:57:59.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:59.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-517 td/osd-backfill-space/datafile 2020-09-08T15:57:59.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:57:59.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-518 td/osd-backfill-space/datafile 2020-09-08T15:58:00.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:00.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-519 td/osd-backfill-space/datafile 2020-09-08T15:58:00.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:00.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-520 td/osd-backfill-space/datafile 2020-09-08T15:58:00.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:00.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-521 td/osd-backfill-space/datafile 2020-09-08T15:58:00.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:00.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-522 td/osd-backfill-space/datafile 2020-09-08T15:58:00.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:00.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-523 td/osd-backfill-space/datafile 2020-09-08T15:58:00.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:00.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-524 td/osd-backfill-space/datafile 2020-09-08T15:58:00.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:00.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-525 td/osd-backfill-space/datafile 2020-09-08T15:58:00.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:00.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-526 td/osd-backfill-space/datafile 2020-09-08T15:58:00.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:00.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-527 td/osd-backfill-space/datafile 2020-09-08T15:58:00.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:00.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-528 td/osd-backfill-space/datafile 2020-09-08T15:58:00.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:00.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-529 td/osd-backfill-space/datafile 2020-09-08T15:58:00.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:00.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-530 td/osd-backfill-space/datafile 2020-09-08T15:58:01.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:01.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-531 td/osd-backfill-space/datafile 2020-09-08T15:58:01.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:01.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-532 td/osd-backfill-space/datafile 2020-09-08T15:58:01.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:01.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-533 td/osd-backfill-space/datafile 2020-09-08T15:58:01.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:01.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-534 td/osd-backfill-space/datafile 2020-09-08T15:58:01.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:01.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-535 td/osd-backfill-space/datafile 2020-09-08T15:58:01.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:01.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-536 td/osd-backfill-space/datafile 2020-09-08T15:58:01.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:01.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-537 td/osd-backfill-space/datafile 2020-09-08T15:58:01.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:01.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-538 td/osd-backfill-space/datafile 2020-09-08T15:58:01.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:01.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-539 td/osd-backfill-space/datafile 2020-09-08T15:58:01.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:01.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-540 td/osd-backfill-space/datafile 2020-09-08T15:58:01.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:01.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-541 td/osd-backfill-space/datafile 2020-09-08T15:58:01.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:01.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-542 td/osd-backfill-space/datafile 2020-09-08T15:58:01.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:01.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-543 td/osd-backfill-space/datafile 2020-09-08T15:58:02.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:02.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-544 td/osd-backfill-space/datafile 2020-09-08T15:58:02.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:02.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-545 td/osd-backfill-space/datafile 2020-09-08T15:58:02.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:02.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-546 td/osd-backfill-space/datafile 2020-09-08T15:58:02.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:02.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-547 td/osd-backfill-space/datafile 2020-09-08T15:58:02.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:02.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-548 td/osd-backfill-space/datafile 2020-09-08T15:58:02.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:02.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-549 td/osd-backfill-space/datafile 2020-09-08T15:58:02.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:02.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-550 td/osd-backfill-space/datafile 2020-09-08T15:58:02.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:02.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-551 td/osd-backfill-space/datafile 2020-09-08T15:58:02.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:02.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-552 td/osd-backfill-space/datafile 2020-09-08T15:58:02.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:02.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-553 td/osd-backfill-space/datafile 2020-09-08T15:58:02.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:02.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-554 td/osd-backfill-space/datafile 2020-09-08T15:58:02.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:02.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-555 td/osd-backfill-space/datafile 2020-09-08T15:58:03.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:03.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-556 td/osd-backfill-space/datafile 2020-09-08T15:58:03.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:03.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-557 td/osd-backfill-space/datafile 2020-09-08T15:58:03.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:03.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-558 td/osd-backfill-space/datafile 2020-09-08T15:58:03.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:03.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-559 td/osd-backfill-space/datafile 2020-09-08T15:58:03.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:03.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-560 td/osd-backfill-space/datafile 2020-09-08T15:58:03.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:03.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-561 td/osd-backfill-space/datafile 2020-09-08T15:58:03.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:03.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-562 td/osd-backfill-space/datafile 2020-09-08T15:58:03.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:03.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-563 td/osd-backfill-space/datafile 2020-09-08T15:58:03.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:03.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-564 td/osd-backfill-space/datafile 2020-09-08T15:58:03.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:03.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-565 td/osd-backfill-space/datafile 2020-09-08T15:58:03.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:03.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-566 td/osd-backfill-space/datafile 2020-09-08T15:58:03.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:03.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-567 td/osd-backfill-space/datafile 2020-09-08T15:58:03.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:03.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-568 td/osd-backfill-space/datafile 2020-09-08T15:58:04.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:04.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-569 td/osd-backfill-space/datafile 2020-09-08T15:58:04.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:04.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-570 td/osd-backfill-space/datafile 2020-09-08T15:58:04.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:04.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-571 td/osd-backfill-space/datafile 2020-09-08T15:58:04.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:04.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-572 td/osd-backfill-space/datafile 2020-09-08T15:58:04.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:04.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-573 td/osd-backfill-space/datafile 2020-09-08T15:58:04.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:04.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-574 td/osd-backfill-space/datafile 2020-09-08T15:58:04.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:04.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-575 td/osd-backfill-space/datafile 2020-09-08T15:58:04.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:04.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-576 td/osd-backfill-space/datafile 2020-09-08T15:58:04.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:04.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-577 td/osd-backfill-space/datafile 2020-09-08T15:58:04.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:04.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-578 td/osd-backfill-space/datafile 2020-09-08T15:58:04.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:04.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-579 td/osd-backfill-space/datafile 2020-09-08T15:58:04.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:04.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-580 td/osd-backfill-space/datafile 2020-09-08T15:58:05.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:05.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-581 td/osd-backfill-space/datafile 2020-09-08T15:58:05.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:05.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-582 td/osd-backfill-space/datafile 2020-09-08T15:58:05.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:05.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-583 td/osd-backfill-space/datafile 2020-09-08T15:58:05.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:05.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-584 td/osd-backfill-space/datafile 2020-09-08T15:58:05.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:05.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-585 td/osd-backfill-space/datafile 2020-09-08T15:58:05.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:05.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-586 td/osd-backfill-space/datafile 2020-09-08T15:58:05.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:05.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-587 td/osd-backfill-space/datafile 2020-09-08T15:58:05.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:05.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-588 td/osd-backfill-space/datafile 2020-09-08T15:58:05.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:05.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-589 td/osd-backfill-space/datafile 2020-09-08T15:58:05.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:05.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-590 td/osd-backfill-space/datafile 2020-09-08T15:58:05.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:05.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-591 td/osd-backfill-space/datafile 2020-09-08T15:58:05.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:05.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-592 td/osd-backfill-space/datafile 2020-09-08T15:58:06.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:06.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-593 td/osd-backfill-space/datafile 2020-09-08T15:58:06.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:06.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-594 td/osd-backfill-space/datafile 2020-09-08T15:58:06.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:06.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-595 td/osd-backfill-space/datafile 2020-09-08T15:58:06.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:06.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-596 td/osd-backfill-space/datafile 2020-09-08T15:58:06.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:06.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-597 td/osd-backfill-space/datafile 2020-09-08T15:58:06.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:06.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-598 td/osd-backfill-space/datafile 2020-09-08T15:58:06.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:06.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-599 td/osd-backfill-space/datafile 2020-09-08T15:58:06.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:462: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:06.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:464: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-600 td/osd-backfill-space/datafile 2020-09-08T15:58:06.633 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:467: TEST_backfill_multi_partial: get_primary fillpool obj-fill-1 2020-09-08T15:58:06.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=fillpool 2020-09-08T15:58:06.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj-fill-1 2020-09-08T15:58:06.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map fillpool obj-fill-1 2020-09-08T15:58:06.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T15:58:07.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:467: TEST_backfill_multi_partial: local fillosd=1 2020-09-08T15:58:07.029 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:468: TEST_backfill_multi_partial: expr 1 + 1 2020-09-08T15:58:07.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:468: TEST_backfill_multi_partial: osd=2 2020-09-08T15:58:07.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:469: TEST_backfill_multi_partial: '[' 2 = 3 ']' 2020-09-08T15:58:07.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:473: TEST_backfill_multi_partial: kill_daemon td/osd-backfill-space/osd.1.pid TERM 2020-09-08T15:58:07.031 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: cat td/osd-backfill-space/osd.1.pid 2020-09-08T15:58:07.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: local pid=189235 2020-09-08T15:58:07.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: local send_signal=TERM 2020-09-08T15:58:07.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2020-09-08T15:58:07.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:258: kill_daemon: local exit_code=1 2020-09-08T15:58:07.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2020-09-08T15:58:07.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 189235 2020-09-08T15:58:07.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2020-09-08T15:58:07.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2020-09-08T15:58:07.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.1 2020-09-08T15:58:07.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2020-09-08T15:58:07.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 189235 2020-09-08T15:58:07.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:265: kill_daemon: exit_code=0 2020-09-08T15:58:07.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:266: kill_daemon: break 2020-09-08T15:58:07.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:271: kill_daemon: return 0 2020-09-08T15:58:07.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:474: TEST_backfill_multi_partial: ceph osd out osd.1 2020-09-08T15:58:07.894 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already out. 2020-09-08T15:58:07.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:476: TEST_backfill_multi_partial: _objectstore_tool_nodown td/osd-backfill-space 1 --op export-remove --pgid 1.0 --file td/osd-backfill-space/fillexport.out 2020-09-08T15:58:07.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local dir=td/osd-backfill-space 2020-09-08T15:58:07.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2020-09-08T15:58:07.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local id=1 2020-09-08T15:58:07.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1198: _objectstore_tool_nodown: shift 2020-09-08T15:58:07.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: _objectstore_tool_nodown: local osd_data=td/osd-backfill-space/1 2020-09-08T15:58:07.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1202: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-space/1 --op export-remove --pgid 1.0 --file td/osd-backfill-space/fillexport.out 2020-09-08T15:58:09.443 INFO:tasks.workunit.client.0.smithi065.stderr:Exporting 1.0 info 1.0( v 36'600 (36'500,36'600] local-lis/les=23/24 n=600 ec=20/20 lis/c=23/23 les/c/f=24/24/0 sis=23) 2020-09-08T15:58:09.449 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:0002d87b:::obj-fill-318:head# 2020-09-08T15:58:09.456 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:00676868:::obj-fill-583:head# 2020-09-08T15:58:09.462 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:00f4514e:::obj-fill-547:head# 2020-09-08T15:58:09.467 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:01596a3c:::obj-fill-533:head# 2020-09-08T15:58:09.468 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:0285e89c:::obj-fill-190:head# 2020-09-08T15:58:09.468 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:02bd591e:::obj-fill-463:head# 2020-09-08T15:58:09.469 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:02c01ffe:::obj-fill-28:head# 2020-09-08T15:58:09.470 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:03ada31e:::obj-fill-285:head# 2020-09-08T15:58:09.478 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:03b07c3f:::obj-fill-568:head# 2020-09-08T15:58:09.478 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:03b85770:::obj-fill-573:head# 2020-09-08T15:58:09.479 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:03dcbe89:::obj-fill-375:head# 2020-09-08T15:58:09.479 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:04231826:::obj-fill-594:head# 2020-09-08T15:58:09.480 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:04d48684:::obj-fill-421:head# 2020-09-08T15:58:09.481 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:05385fcc:::obj-fill-299:head# 2020-09-08T15:58:09.481 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:05785d38:::obj-fill-159:head# 2020-09-08T15:58:09.486 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:057ec231:::obj-fill-138:head# 2020-09-08T15:58:09.486 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:06058b5e:::obj-fill-569:head# 2020-09-08T15:58:09.487 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:06d2a3d9:::obj-fill-284:head# 2020-09-08T15:58:09.487 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:07597b63:::obj-fill-459:head# 2020-09-08T15:58:09.488 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:075f4069:::obj-fill-550:head# 2020-09-08T15:58:09.488 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:08234052:::obj-fill-17:head# 2020-09-08T15:58:09.498 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:091ce2ec:::obj-fill-472:head# 2020-09-08T15:58:09.499 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:095fd509:::obj-fill-210:head# 2020-09-08T15:58:09.499 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:0a52a594:::obj-fill-116:head# 2020-09-08T15:58:09.500 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:0a63716b:::obj-fill-225:head# 2020-09-08T15:58:09.500 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:0b0fa6fb:::obj-fill-541:head# 2020-09-08T15:58:09.513 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:0b673f72:::obj-fill-232:head# 2020-09-08T15:58:09.518 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:0bbcd1b2:::obj-fill-582:head# 2020-09-08T15:58:09.518 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:0caf8ce3:::obj-fill-214:head# 2020-09-08T15:58:09.518 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:0d94b9fb:::obj-fill-415:head# 2020-09-08T15:58:09.518 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:0de4e6f7:::obj-fill-94:head# 2020-09-08T15:58:09.519 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:0ef75768:::obj-fill-489:head# 2020-09-08T15:58:09.519 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:0f67284f:::obj-fill-213:head# 2020-09-08T15:58:09.521 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:0f823df2:::obj-fill-234:head# 2020-09-08T15:58:09.521 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:1005c08d:::obj-fill-490:head# 2020-09-08T15:58:09.524 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:1039525f:::obj-fill-369:head# 2020-09-08T15:58:09.524 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:105fb36c:::obj-fill-226:head# 2020-09-08T15:58:09.525 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:111abdeb:::obj-fill-554:head# 2020-09-08T15:58:09.525 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:11392f3d:::obj-fill-453:head# 2020-09-08T15:58:09.525 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:1169976c:::obj-fill-417:head# 2020-09-08T15:58:09.525 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:11840a2a:::obj-fill-477:head# 2020-09-08T15:58:09.525 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:11a4832e:::obj-fill-279:head# 2020-09-08T15:58:09.526 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:11a4d2f6:::obj-fill-256:head# 2020-09-08T15:58:09.526 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:12d52a31:::obj-fill-22:head# 2020-09-08T15:58:09.526 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:133c45db:::obj-fill-257:head# 2020-09-08T15:58:09.526 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:13563256:::obj-fill-150:head# 2020-09-08T15:58:09.527 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:13c09e00:::obj-fill-71:head# 2020-09-08T15:58:09.527 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:13e9fbed:::obj-fill-242:head# 2020-09-08T15:58:09.527 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:13fae6c2:::obj-fill-163:head# 2020-09-08T15:58:09.527 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:145025e0:::obj-fill-543:head# 2020-09-08T15:58:09.529 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:14517c84:::obj-fill-13:head# 2020-09-08T15:58:09.534 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:14802e9c:::obj-fill-127:head# 2020-09-08T15:58:09.534 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:150f1c96:::obj-fill-62:head# 2020-09-08T15:58:09.540 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:155e90a2:::obj-fill-537:head# 2020-09-08T15:58:09.540 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:1632c776:::obj-fill-262:head# 2020-09-08T15:58:09.542 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:163bde28:::obj-fill-523:head# 2020-09-08T15:58:09.542 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:169c4ad0:::obj-fill-85:head# 2020-09-08T15:58:09.542 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:16c4da1d:::obj-fill-436:head# 2020-09-08T15:58:09.543 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:17b28c32:::obj-fill-345:head# 2020-09-08T15:58:09.543 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:17b34255:::obj-fill-577:head# 2020-09-08T15:58:09.544 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:17d2541f:::obj-fill-426:head# 2020-09-08T15:58:09.545 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:17ea19f2:::obj-fill-542:head# 2020-09-08T15:58:09.546 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:189155ea:::obj-fill-496:head# 2020-09-08T15:58:09.546 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:191a6d81:::obj-fill-548:head# 2020-09-08T15:58:09.546 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:1a964993:::obj-fill-576:head# 2020-09-08T15:58:09.546 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:1aa623dc:::obj-fill-356:head# 2020-09-08T15:58:09.546 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:1abe5c38:::obj-fill-561:head# 2020-09-08T15:58:09.547 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:1bddc06b:::obj-fill-7:head# 2020-09-08T15:58:09.548 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:1be86b71:::obj-fill-295:head# 2020-09-08T15:58:09.548 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:1c499bca:::obj-fill-240:head# 2020-09-08T15:58:09.549 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:1c545e27:::obj-fill-509:head# 2020-09-08T15:58:09.550 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:1c63c8f4:::obj-fill-4:head# 2020-09-08T15:58:09.550 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:1d5a8f59:::obj-fill-377:head# 2020-09-08T15:58:09.551 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:1d85b5df:::obj-fill-201:head# 2020-09-08T15:58:09.551 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:1d9a0d5b:::obj-fill-581:head# 2020-09-08T15:58:09.552 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:1dcf5667:::obj-fill-488:head# 2020-09-08T15:58:09.552 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:1fa3090d:::obj-fill-458:head# 2020-09-08T15:58:09.552 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:1fe937f6:::obj-fill-337:head# 2020-09-08T15:58:09.562 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:1ff54542:::obj-fill-349:head# 2020-09-08T15:58:09.562 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:20d9e0ca:::obj-fill-367:head# 2020-09-08T15:58:09.562 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:21b8e3bb:::obj-fill-538:head# 2020-09-08T15:58:09.563 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:227183d4:::obj-fill-235:head# 2020-09-08T15:58:09.563 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:229e5e5d:::obj-fill-522:head# 2020-09-08T15:58:09.563 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:234f8861:::obj-fill-476:head# 2020-09-08T15:58:09.563 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:23ac2c9d:::obj-fill-471:head# 2020-09-08T15:58:09.563 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:25db1742:::obj-fill-200:head# 2020-09-08T15:58:09.564 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:264f8545:::obj-fill-230:head# 2020-09-08T15:58:09.564 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:267ba97f:::obj-fill-493:head# 2020-09-08T15:58:09.564 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:26b067e8:::obj-fill-208:head# 2020-09-08T15:58:09.564 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:26f521cb:::obj-fill-300:head# 2020-09-08T15:58:09.564 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:27e70a11:::obj-fill-368:head# 2020-09-08T15:58:09.564 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:29357d4a:::obj-fill-456:head# 2020-09-08T15:58:09.565 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:29f2567e:::obj-fill-414:head# 2020-09-08T15:58:09.565 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2a10cbb6:::obj-fill-228:head# 2020-09-08T15:58:09.565 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2a1519a6:::obj-fill-148:head# 2020-09-08T15:58:09.565 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2a686ca6:::obj-fill-411:head# 2020-09-08T15:58:09.565 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2ab3f384:::obj-fill-77:head# 2020-09-08T15:58:09.567 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2ae6a1d0:::obj-fill-187:head# 2020-09-08T15:58:09.568 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2b890959:::obj-fill-222:head# 2020-09-08T15:58:09.568 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2bcc26c4:::obj-fill-114:head# 2020-09-08T15:58:09.569 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2bd3a3a2:::obj-fill-281:head# 2020-09-08T15:58:09.569 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2c1a21d7:::obj-fill-505:head# 2020-09-08T15:58:09.569 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2c255347:::obj-fill-95:head# 2020-09-08T15:58:09.570 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2c2a3f62:::obj-fill-131:head# 2020-09-08T15:58:09.570 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2c7d92ce:::obj-fill-442:head# 2020-09-08T15:58:09.570 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2d1ad117:::obj-fill-443:head# 2020-09-08T15:58:09.571 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2d57b2f7:::obj-fill-192:head# 2020-09-08T15:58:09.571 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2d7b53ea:::obj-fill-79:head# 2020-09-08T15:58:09.572 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2db25266:::obj-fill-121:head# 2020-09-08T15:58:09.572 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2e27853e:::obj-fill-473:head# 2020-09-08T15:58:09.572 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2f12cb21:::obj-fill-386:head# 2020-09-08T15:58:09.573 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2f957332:::obj-fill-422:head# 2020-09-08T15:58:09.574 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:2feae493:::obj-fill-301:head# 2020-09-08T15:58:09.574 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:302c95d2:::obj-fill-110:head# 2020-09-08T15:58:09.575 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:302d6b76:::obj-fill-374:head# 2020-09-08T15:58:09.575 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:30581f34:::obj-fill-313:head# 2020-09-08T15:58:09.576 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:307e86ac:::obj-fill-381:head# 2020-09-08T15:58:09.577 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:30ab77bf:::obj-fill-275:head# 2020-09-08T15:58:09.577 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:31127e6d:::obj-fill-250:head# 2020-09-08T15:58:09.578 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:32c93500:::obj-fill-155:head# 2020-09-08T15:58:09.578 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:339880b7:::obj-fill-227:head# 2020-09-08T15:58:09.578 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:34069e1e:::obj-fill-292:head# 2020-09-08T15:58:09.578 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:346dff31:::obj-fill-157:head# 2020-09-08T15:58:09.579 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:34ade0f1:::obj-fill-575:head# 2020-09-08T15:58:09.579 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:34bbae43:::obj-fill-90:head# 2020-09-08T15:58:09.580 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:34e97cf8:::obj-fill-334:head# 2020-09-08T15:58:09.581 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:35d7ccc2:::obj-fill-510:head# 2020-09-08T15:58:09.581 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:35f519b6:::obj-fill-513:head# 2020-09-08T15:58:09.581 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:364727e8:::obj-fill-130:head# 2020-09-08T15:58:09.581 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:364c0361:::obj-fill-586:head# 2020-09-08T15:58:09.582 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:368e7baf:::obj-fill-546:head# 2020-09-08T15:58:09.582 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:36ffb224:::obj-fill-82:head# 2020-09-08T15:58:09.582 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:371cb800:::obj-fill-330:head# 2020-09-08T15:58:09.583 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:37d5378d:::obj-fill-175:head# 2020-09-08T15:58:09.583 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:385593f3:::obj-fill-325:head# 2020-09-08T15:58:09.583 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:388d5073:::obj-fill-317:head# 2020-09-08T15:58:09.584 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:394af079:::obj-fill-59:head# 2020-09-08T15:58:09.584 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:3a41ad37:::obj-fill-409:head# 2020-09-08T15:58:09.586 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:3b3c63d2:::obj-fill-136:head# 2020-09-08T15:58:09.587 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:3bb50131:::obj-fill-512:head# 2020-09-08T15:58:09.587 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:3bb52bb5:::obj-fill-188:head# 2020-09-08T15:58:09.587 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:3c0683d1:::obj-fill-372:head# 2020-09-08T15:58:09.588 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:3c67d3f4:::obj-fill-249:head# 2020-09-08T15:58:09.588 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:3c6a4a4c:::obj-fill-495:head# 2020-09-08T15:58:09.588 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:3c7fc8c9:::obj-fill-324:head# 2020-09-08T15:58:09.589 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:3d940c50:::obj-fill-591:head# 2020-09-08T15:58:09.589 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:3ed5508e:::obj-fill-558:head# 2020-09-08T15:58:09.593 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:3f598316:::obj-fill-389:head# 2020-09-08T15:58:09.594 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:401cd0ce:::obj-fill-251:head# 2020-09-08T15:58:09.594 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:40fae006:::obj-fill-14:head# 2020-09-08T15:58:09.595 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:4120b10f:::obj-fill-165:head# 2020-09-08T15:58:09.595 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:41b382c2:::obj-fill-289:head# 2020-09-08T15:58:09.595 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:4277cdea:::obj-fill-319:head# 2020-09-08T15:58:09.596 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:42978c3c:::obj-fill-174:head# 2020-09-08T15:58:09.596 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:42b08dc2:::obj-fill-553:head# 2020-09-08T15:58:09.597 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:42ec4bf6:::obj-fill-209:head# 2020-09-08T15:58:09.597 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:430c129d:::obj-fill-448:head# 2020-09-08T15:58:09.598 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:4335d553:::obj-fill-600:head# 2020-09-08T15:58:09.598 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:44804f62:::obj-fill-532:head# 2020-09-08T15:58:09.598 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:44954d54:::obj-fill-2:head# 2020-09-08T15:58:09.599 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:4502f904:::obj-fill-429:head# 2020-09-08T15:58:09.600 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:4568ddcb:::obj-fill-382:head# 2020-09-08T15:58:09.600 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:45939974:::obj-fill-563:head# 2020-09-08T15:58:09.601 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:462a5bbd:::obj-fill-567:head# 2020-09-08T15:58:09.601 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:47773ae4:::obj-fill-307:head# 2020-09-08T15:58:09.602 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:4802b263:::obj-fill-387:head# 2020-09-08T15:58:09.602 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:483d938e:::obj-fill-128:head# 2020-09-08T15:58:09.603 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:48a7ad29:::obj-fill-147:head# 2020-09-08T15:58:09.604 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:493b61ce:::obj-fill-454:head# 2020-09-08T15:58:09.604 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:4afb70fe:::obj-fill-186:head# 2020-09-08T15:58:09.604 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:4bff08e3:::obj-fill-352:head# 2020-09-08T15:58:09.605 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:4c01eabe:::obj-fill-370:head# 2020-09-08T15:58:09.605 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:4c131560:::obj-fill-6:head# 2020-09-08T15:58:09.605 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:4c4c5e14:::obj-fill-350:head# 2020-09-08T15:58:09.606 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:4c80dc2c:::obj-fill-357:head# 2020-09-08T15:58:09.606 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:4c9dee9b:::obj-fill-540:head# 2020-09-08T15:58:09.607 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:4ce40c18:::obj-fill-280:head# 2020-09-08T15:58:09.607 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:4d854fc3:::obj-fill-585:head# 2020-09-08T15:58:09.608 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:4f615b53:::obj-fill-101:head# 2020-09-08T15:58:09.608 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5042b30f:::obj-fill-84:head# 2020-09-08T15:58:09.609 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:507dc08b:::obj-fill-336:head# 2020-09-08T15:58:09.609 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:512fcf5a:::obj-fill-169:head# 2020-09-08T15:58:09.610 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:51a0c8f8:::obj-fill-578:head# 2020-09-08T15:58:09.610 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:51fd05a2:::obj-fill-425:head# 2020-09-08T15:58:09.611 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:52400ebc:::obj-fill-81:head# 2020-09-08T15:58:09.611 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5288d40c:::obj-fill-16:head# 2020-09-08T15:58:09.612 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5295b0ee:::obj-fill-224:head# 2020-09-08T15:58:09.612 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:531e4c60:::obj-fill-103:head# 2020-09-08T15:58:09.613 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:54259f28:::obj-fill-584:head# 2020-09-08T15:58:09.613 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:542d619c:::obj-fill-528:head# 2020-09-08T15:58:09.614 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5503ca3e:::obj-fill-494:head# 2020-09-08T15:58:09.614 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5555c48b:::obj-fill-403:head# 2020-09-08T15:58:09.615 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:558d1ec7:::obj-fill-447:head# 2020-09-08T15:58:09.620 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:55aa2233:::obj-fill-21:head# 2020-09-08T15:58:09.621 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:55aaf8c4:::obj-fill-29:head# 2020-09-08T15:58:09.621 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:55e246e1:::obj-fill-65:head# 2020-09-08T15:58:09.622 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:563b14a8:::obj-fill-120:head# 2020-09-08T15:58:09.622 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:56e1df25:::obj-fill-305:head# 2020-09-08T15:58:09.623 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5702979c:::obj-fill-73:head# 2020-09-08T15:58:09.623 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:570722ba:::obj-fill-219:head# 2020-09-08T15:58:09.624 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:57f7a09b:::obj-fill-571:head# 2020-09-08T15:58:09.624 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:585309ba:::obj-fill-144:head# 2020-09-08T15:58:09.625 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:585c7c9c:::obj-fill-437:head# 2020-09-08T15:58:09.627 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:587c63db:::obj-fill-182:head# 2020-09-08T15:58:09.628 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:58f34d6b:::obj-fill-598:head# 2020-09-08T15:58:09.628 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:58f40088:::obj-fill-298:head# 2020-09-08T15:58:09.629 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:591e150c:::obj-fill-32:head# 2020-09-08T15:58:09.629 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:59971ddb:::obj-fill-559:head# 2020-09-08T15:58:09.630 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5adafca4:::obj-fill-56:head# 2020-09-08T15:58:09.630 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5b32b04f:::obj-fill-484:head# 2020-09-08T15:58:09.631 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5bdaeb16:::obj-fill-99:head# 2020-09-08T15:58:09.631 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5c1d6f4b:::obj-fill-133:head# 2020-09-08T15:58:09.632 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5c92b8f1:::obj-fill-255:head# 2020-09-08T15:58:09.632 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5ca4850f:::obj-fill-238:head# 2020-09-08T15:58:09.632 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5d928a5b:::obj-fill-395:head# 2020-09-08T15:58:09.633 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5dd49320:::obj-fill-423:head# 2020-09-08T15:58:09.633 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5e7bc368:::obj-fill-506:head# 2020-09-08T15:58:09.633 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5ebd5ee3:::obj-fill-322:head# 2020-09-08T15:58:09.634 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5edeedf1:::obj-fill-557:head# 2020-09-08T15:58:09.634 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:5facf8e2:::obj-fill-15:head# 2020-09-08T15:58:09.635 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:603a2c76:::obj-fill-439:head# 2020-09-08T15:58:09.635 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:60b30714:::obj-fill-53:head# 2020-09-08T15:58:09.635 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:612b4a8a:::obj-fill-412:head# 2020-09-08T15:58:09.636 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:61a111b6:::obj-fill-87:head# 2020-09-08T15:58:09.636 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:63a0e8a2:::obj-fill-266:head# 2020-09-08T15:58:09.637 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:63aa4d60:::obj-fill-68:head# 2020-09-08T15:58:09.637 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:63ac5b95:::obj-fill-405:head# 2020-09-08T15:58:09.637 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:6415a9e3:::obj-fill-400:head# 2020-09-08T15:58:09.638 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:64ba03ae:::obj-fill-20:head# 2020-09-08T15:58:09.638 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:6512f015:::obj-fill-597:head# 2020-09-08T15:58:09.638 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:65433104:::obj-fill-504:head# 2020-09-08T15:58:09.639 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:65950c58:::obj-fill-86:head# 2020-09-08T15:58:09.639 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:65b6b2d7:::obj-fill-39:head# 2020-09-08T15:58:09.640 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:661c8afd:::obj-fill-267:head# 2020-09-08T15:58:09.640 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:66f87c94:::obj-fill-229:head# 2020-09-08T15:58:09.640 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:67292cef:::obj-fill-93:head# 2020-09-08T15:58:09.641 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:67f0e12c:::obj-fill-363:head# 2020-09-08T15:58:09.641 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:696eb83b:::obj-fill-185:head# 2020-09-08T15:58:09.641 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:6b33981c:::obj-fill-259:head# 2020-09-08T15:58:09.642 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:6b5a527c:::obj-fill-485:head# 2020-09-08T15:58:09.642 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:6b6f1852:::obj-fill-390:head# 2020-09-08T15:58:09.642 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:6ba5c5f8:::obj-fill-304:head# 2020-09-08T15:58:09.643 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:6bce929d:::obj-fill-518:head# 2020-09-08T15:58:09.643 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:6c8ffc04:::obj-fill-61:head# 2020-09-08T15:58:09.644 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:6ca7e551:::obj-fill-40:head# 2020-09-08T15:58:09.644 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:6caff2cd:::obj-fill-332:head# 2020-09-08T15:58:09.645 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:6ce4adc7:::obj-fill-574:head# 2020-09-08T15:58:09.645 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:6d09d770:::obj-fill-74:head# 2020-09-08T15:58:09.645 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:6e039822:::obj-fill-278:head# 2020-09-08T15:58:09.646 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:6f2cd109:::obj-fill-297:head# 2020-09-08T15:58:09.646 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:6f3754c4:::obj-fill-88:head# 2020-09-08T15:58:09.646 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:6f86cfd2:::obj-fill-511:head# 2020-09-08T15:58:09.647 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:6fe3f3f7:::obj-fill-193:head# 2020-09-08T15:58:09.648 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7002c57d:::obj-fill-50:head# 2020-09-08T15:58:09.648 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7030b2a3:::obj-fill-217:head# 2020-09-08T15:58:09.648 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:70665087:::obj-fill-51:head# 2020-09-08T15:58:09.648 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:70a0f5e0:::obj-fill-11:head# 2020-09-08T15:58:09.649 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:71f4643d:::obj-fill-236:head# 2020-09-08T15:58:09.649 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:722fbd0f:::obj-fill-302:head# 2020-09-08T15:58:09.650 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:72584da9:::obj-fill-445:head# 2020-09-08T15:58:09.650 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:72d91d24:::obj-fill-218:head# 2020-09-08T15:58:09.651 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:72f7268b:::obj-fill-106:head# 2020-09-08T15:58:09.651 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:74077abf:::obj-fill-435:head# 2020-09-08T15:58:09.652 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:740ca050:::obj-fill-112:head# 2020-09-08T15:58:09.652 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7435e881:::obj-fill-78:head# 2020-09-08T15:58:09.652 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:74ba0bb7:::obj-fill-478:head# 2020-09-08T15:58:09.652 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:74d82091:::obj-fill-96:head# 2020-09-08T15:58:09.653 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7515f56c:::obj-fill-483:head# 2020-09-08T15:58:09.654 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7550d6fe:::obj-fill-286:head# 2020-09-08T15:58:09.659 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:75807edc:::obj-fill-223:head# 2020-09-08T15:58:09.660 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:762ba324:::obj-fill-172:head# 2020-09-08T15:58:09.660 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:76369bda:::obj-fill-570:head# 2020-09-08T15:58:09.660 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7667a5b0:::obj-fill-196:head# 2020-09-08T15:58:09.660 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:77736c0c:::obj-fill-566:head# 2020-09-08T15:58:09.664 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:77fb47a4:::obj-fill-314:head# 2020-09-08T15:58:09.664 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:785ad894:::obj-fill-80:head# 2020-09-08T15:58:09.664 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:785e3d14:::obj-fill-530:head# 2020-09-08T15:58:09.664 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:788efef4:::obj-fill-595:head# 2020-09-08T15:58:09.665 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:789ec5ab:::obj-fill-44:head# 2020-09-08T15:58:09.665 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:798a3fa8:::obj-fill-517:head# 2020-09-08T15:58:09.665 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:79a105ef:::obj-fill-315:head# 2020-09-08T15:58:09.665 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:79d02f04:::obj-fill-243:head# 2020-09-08T15:58:09.665 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7a00dfcb:::obj-fill-402:head# 2020-09-08T15:58:09.666 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7b982684:::obj-fill-168:head# 2020-09-08T15:58:09.666 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7bb36851:::obj-fill-440:head# 2020-09-08T15:58:09.666 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7bb49d8c:::obj-fill-55:head# 2020-09-08T15:58:09.666 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7c77b783:::obj-fill-580:head# 2020-09-08T15:58:09.666 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7c89d75b:::obj-fill-555:head# 2020-09-08T15:58:09.666 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7d12fb67:::obj-fill-399:head# 2020-09-08T15:58:09.667 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7d139961:::obj-fill-92:head# 2020-09-08T15:58:09.667 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7d39ffd0:::obj-fill-135:head# 2020-09-08T15:58:09.667 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7e534cc4:::obj-fill-282:head# 2020-09-08T15:58:09.667 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7e7a08e0:::obj-fill-108:head# 2020-09-08T15:58:09.667 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7e8e2b67:::obj-fill-244:head# 2020-09-08T15:58:09.668 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7eea215e:::obj-fill-139:head# 2020-09-08T15:58:09.668 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7efa3c6e:::obj-fill-408:head# 2020-09-08T15:58:09.668 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7f03a24b:::obj-fill-45:head# 2020-09-08T15:58:09.668 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7f6a2e2b:::obj-fill-427:head# 2020-09-08T15:58:09.668 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7fb0abd6:::obj-fill-479:head# 2020-09-08T15:58:09.669 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:7fb77de1:::obj-fill-167:head# 2020-09-08T15:58:09.669 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:80012a03:::obj-fill-105:head# 2020-09-08T15:58:09.670 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:80075ae5:::obj-fill-376:head# 2020-09-08T15:58:09.670 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8089baa5:::obj-fill-97:head# 2020-09-08T15:58:09.670 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:80d0b4c5:::obj-fill-123:head# 2020-09-08T15:58:09.671 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:810f319f:::obj-fill-552:head# 2020-09-08T15:58:09.671 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:81427ef2:::obj-fill-474:head# 2020-09-08T15:58:09.672 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:818d780c:::obj-fill-33:head# 2020-09-08T15:58:09.672 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:819f31b9:::obj-fill-366:head# 2020-09-08T15:58:09.672 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8205549d:::obj-fill-125:head# 2020-09-08T15:58:09.673 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:821f56e5:::obj-fill-339:head# 2020-09-08T15:58:09.673 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:822807c6:::obj-fill-69:head# 2020-09-08T15:58:09.674 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:822fcf61:::obj-fill-560:head# 2020-09-08T15:58:09.674 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:82ad696b:::obj-fill-149:head# 2020-09-08T15:58:09.675 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:835cc771:::obj-fill-446:head# 2020-09-08T15:58:09.675 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8386bee1:::obj-fill-137:head# 2020-09-08T15:58:09.676 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:83c1303a:::obj-fill-311:head# 2020-09-08T15:58:09.676 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:83cf1c2a:::obj-fill-360:head# 2020-09-08T15:58:09.677 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:83d70321:::obj-fill-351:head# 2020-09-08T15:58:09.677 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:83ef162d:::obj-fill-331:head# 2020-09-08T15:58:09.678 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:840f8f20:::obj-fill-398:head# 2020-09-08T15:58:09.679 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:84d2e456:::obj-fill-207:head# 2020-09-08T15:58:09.679 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:856697ff:::obj-fill-333:head# 2020-09-08T15:58:09.679 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:858be937:::obj-fill-418:head# 2020-09-08T15:58:09.680 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:85a0b302:::obj-fill-438:head# 2020-09-08T15:58:09.680 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:85fa942e:::obj-fill-272:head# 2020-09-08T15:58:09.681 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:863eb6f8:::obj-fill-320:head# 2020-09-08T15:58:09.681 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:868d4588:::obj-fill-19:head# 2020-09-08T15:58:09.682 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8759d023:::obj-fill-466:head# 2020-09-08T15:58:09.682 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:88072111:::obj-fill-312:head# 2020-09-08T15:58:09.682 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:886edcef:::obj-fill-380:head# 2020-09-08T15:58:09.683 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:88ce753e:::obj-fill-43:head# 2020-09-08T15:58:09.684 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:890e1d83:::obj-fill-590:head# 2020-09-08T15:58:09.684 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:891566a3:::obj-fill-341:head# 2020-09-08T15:58:09.684 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:891ca235:::obj-fill-177:head# 2020-09-08T15:58:09.685 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:897fa9d0:::obj-fill-283:head# 2020-09-08T15:58:09.685 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:89cd304b:::obj-fill-592:head# 2020-09-08T15:58:09.686 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:89d04c4a:::obj-fill-388:head# 2020-09-08T15:58:09.686 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:89db45d9:::obj-fill-247:head# 2020-09-08T15:58:09.686 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8ad879c5:::obj-fill-492:head# 2020-09-08T15:58:09.687 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8af4b5de:::obj-fill-37:head# 2020-09-08T15:58:09.687 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8b132e86:::obj-fill-35:head# 2020-09-08T15:58:09.688 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8b80a60a:::obj-fill-100:head# 2020-09-08T15:58:09.688 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8bb64fa6:::obj-fill-599:head# 2020-09-08T15:58:09.688 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8bed03f5:::obj-fill-5:head# 2020-09-08T15:58:09.689 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8c60e135:::obj-fill-470:head# 2020-09-08T15:58:09.689 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8c774623:::obj-fill-38:head# 2020-09-08T15:58:09.690 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8cc528ae:::obj-fill-519:head# 2020-09-08T15:58:09.691 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8cf73826:::obj-fill-460:head# 2020-09-08T15:58:09.692 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8d3564b3:::obj-fill-452:head# 2020-09-08T15:58:09.693 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8dfe1ca2:::obj-fill-469:head# 2020-09-08T15:58:09.694 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8e527672:::obj-fill-246:head# 2020-09-08T15:58:09.694 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8e96103f:::obj-fill-444:head# 2020-09-08T15:58:09.694 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8ed6417f:::obj-fill-146:head# 2020-09-08T15:58:09.695 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8eda2ffc:::obj-fill-539:head# 2020-09-08T15:58:09.695 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8f08dd48:::obj-fill-26:head# 2020-09-08T15:58:09.696 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8f111b25:::obj-fill-18:head# 2020-09-08T15:58:09.697 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:8fde63f8:::obj-fill-338:head# 2020-09-08T15:58:09.697 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:9030746d:::obj-fill-468:head# 2020-09-08T15:58:09.698 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:9115d8a1:::obj-fill-260:head# 2020-09-08T15:58:09.699 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:91649909:::obj-fill-140:head# 2020-09-08T15:58:09.699 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:91c1081d:::obj-fill-404:head# 2020-09-08T15:58:09.700 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:91f42503:::obj-fill-216:head# 2020-09-08T15:58:09.701 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:927b34a0:::obj-fill-63:head# 2020-09-08T15:58:09.701 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:92a00a91:::obj-fill-467:head# 2020-09-08T15:58:09.701 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:930a7268:::obj-fill-450:head# 2020-09-08T15:58:09.702 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:93c3d0bf:::obj-fill-118:head# 2020-09-08T15:58:09.702 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:93ca7c9e:::obj-fill-132:head# 2020-09-08T15:58:09.703 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:942435d5:::obj-fill-378:head# 2020-09-08T15:58:09.704 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:9445f8c5:::obj-fill-245:head# 2020-09-08T15:58:09.704 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:9457c8d9:::obj-fill-535:head# 2020-09-08T15:58:09.704 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:950dc56e:::obj-fill-348:head# 2020-09-08T15:58:09.705 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:9559ee1d:::obj-fill-545:head# 2020-09-08T15:58:09.706 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:957c5cc4:::obj-fill-212:head# 2020-09-08T15:58:09.707 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:95bdac02:::obj-fill-588:head# 2020-09-08T15:58:09.707 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:95f202af:::obj-fill-126:head# 2020-09-08T15:58:09.708 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:96789003:::obj-fill-83:head# 2020-09-08T15:58:09.708 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:96d494a8:::obj-fill-316:head# 2020-09-08T15:58:09.709 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:97adb85b:::obj-fill-233:head# 2020-09-08T15:58:09.710 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:980d998c:::obj-fill-197:head# 2020-09-08T15:58:09.710 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:98235c44:::obj-fill-396:head# 2020-09-08T15:58:09.711 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:987d3b87:::obj-fill-327:head# 2020-09-08T15:58:09.711 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:990a5e24:::obj-fill-515:head# 2020-09-08T15:58:09.711 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:995fec05:::obj-fill-191:head# 2020-09-08T15:58:09.712 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:9a769b75:::obj-fill-587:head# 2020-09-08T15:58:09.712 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:9b141990:::obj-fill-394:head# 2020-09-08T15:58:09.713 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:9bb108fb:::obj-fill-579:head# 2020-09-08T15:58:09.713 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:9ce19d92:::obj-fill-361:head# 2020-09-08T15:58:09.714 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:9d8c3f95:::obj-fill-572:head# 2020-09-08T15:58:09.714 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:9e283e00:::obj-fill-254:head# 2020-09-08T15:58:09.715 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:9e3a1a61:::obj-fill-58:head# 2020-09-08T15:58:09.715 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:9e8f6029:::obj-fill-41:head# 2020-09-08T15:58:09.716 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:9ef117aa:::obj-fill-520:head# 2020-09-08T15:58:09.716 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:9f3bdfc2:::obj-fill-184:head# 2020-09-08T15:58:09.717 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:9fd89320:::obj-fill-364:head# 2020-09-08T15:58:09.717 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:9feb7062:::obj-fill-419:head# 2020-09-08T15:58:09.718 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a07504c4:::obj-fill-516:head# 2020-09-08T15:58:09.718 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a1897e34:::obj-fill-153:head# 2020-09-08T15:58:09.719 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a19a9d76:::obj-fill-30:head# 2020-09-08T15:58:09.720 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a1a49c98:::obj-fill-98:head# 2020-09-08T15:58:09.720 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a1ea911a:::obj-fill-36:head# 2020-09-08T15:58:09.721 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a24bad98:::obj-fill-335:head# 2020-09-08T15:58:09.721 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a263b16f:::obj-fill-326:head# 2020-09-08T15:58:09.722 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a27d661e:::obj-fill-152:head# 2020-09-08T15:58:09.722 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a282a129:::obj-fill-451:head# 2020-09-08T15:58:09.723 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a28f05ba:::obj-fill-241:head# 2020-09-08T15:58:09.724 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a2cdc5cc:::obj-fill-180:head# 2020-09-08T15:58:09.724 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a30777ea:::obj-fill-486:head# 2020-09-08T15:58:09.724 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a3a65661:::obj-fill-151:head# 2020-09-08T15:58:09.725 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a3cb2967:::obj-fill-195:head# 2020-09-08T15:58:09.725 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a3ffc098:::obj-fill-293:head# 2020-09-08T15:58:09.726 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a4a31ccc:::obj-fill-413:head# 2020-09-08T15:58:09.726 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a51c3677:::obj-fill-384:head# 2020-09-08T15:58:09.727 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a5e941a7:::obj-fill-141:head# 2020-09-08T15:58:09.727 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a6cdd8b2:::obj-fill-342:head# 2020-09-08T15:58:09.728 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a6e20b86:::obj-fill-593:head# 2020-09-08T15:58:09.728 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a7a9ccf9:::obj-fill-129:head# 2020-09-08T15:58:09.729 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a7b702d3:::obj-fill-49:head# 2020-09-08T15:58:09.729 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a8daf8bd:::obj-fill-391:head# 2020-09-08T15:58:09.730 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:a99c3cef:::obj-fill-171:head# 2020-09-08T15:58:09.730 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:aabb5718:::obj-fill-521:head# 2020-09-08T15:58:09.731 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ab0cb851:::obj-fill-183:head# 2020-09-08T15:58:09.732 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ab7a05e4:::obj-fill-203:head# 2020-09-08T15:58:09.732 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ab7dda83:::obj-fill-113:head# 2020-09-08T15:58:09.732 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:abb3502c:::obj-fill-461:head# 2020-09-08T15:58:09.733 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ac1c41be:::obj-fill-162:head# 2020-09-08T15:58:09.734 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ac2114ba:::obj-fill-239:head# 2020-09-08T15:58:09.734 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ad355fca:::obj-fill-271:head# 2020-09-08T15:58:09.734 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ad4634a0:::obj-fill-487:head# 2020-09-08T15:58:09.735 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:add2bb13:::obj-fill-31:head# 2020-09-08T15:58:09.735 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:aeb6258d:::obj-fill-124:head# 2020-09-08T15:58:09.736 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:af17f7d7:::obj-fill-464:head# 2020-09-08T15:58:09.737 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:af1e1cf0:::obj-fill-237:head# 2020-09-08T15:58:09.738 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:afc439ce:::obj-fill-248:head# 2020-09-08T15:58:09.738 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:afceab4d:::obj-fill-527:head# 2020-09-08T15:58:09.738 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b03af40c:::obj-fill-143:head# 2020-09-08T15:58:09.739 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b04cf0db:::obj-fill-507:head# 2020-09-08T15:58:09.739 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b07896f0:::obj-fill-269:head# 2020-09-08T15:58:09.740 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b0b954d5:::obj-fill-524:head# 2020-09-08T15:58:09.740 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b1cbfcb7:::obj-fill-134:head# 2020-09-08T15:58:09.741 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b2978fd3:::obj-fill-27:head# 2020-09-08T15:58:09.741 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b394798f:::obj-fill-156:head# 2020-09-08T15:58:09.742 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b3c6f36d:::obj-fill-401:head# 2020-09-08T15:58:09.742 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b3f8e5ac:::obj-fill-290:head# 2020-09-08T15:58:09.743 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b41ed5f8:::obj-fill-76:head# 2020-09-08T15:58:09.744 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b4878e76:::obj-fill-253:head# 2020-09-08T15:58:09.744 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b4e19741:::obj-fill-503:head# 2020-09-08T15:58:09.745 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b53a3690:::obj-fill-264:head# 2020-09-08T15:58:09.745 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b545ab4f:::obj-fill-24:head# 2020-09-08T15:58:09.745 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b55af5e6:::obj-fill-491:head# 2020-09-08T15:58:09.746 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b57edf82:::obj-fill-526:head# 2020-09-08T15:58:09.747 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b589d2be:::obj-fill-323:head# 2020-09-08T15:58:09.747 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b6207f32:::obj-fill-344:head# 2020-09-08T15:58:09.747 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b757ee2e:::obj-fill-433:head# 2020-09-08T15:58:09.748 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b75cc479:::obj-fill-34:head# 2020-09-08T15:58:09.748 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b7b03117:::obj-fill-42:head# 2020-09-08T15:58:09.749 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b7e6205d:::obj-fill-501:head# 2020-09-08T15:58:09.749 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b8d18b7a:::obj-fill-353:head# 2020-09-08T15:58:09.750 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b9189c29:::obj-fill-328:head# 2020-09-08T15:58:09.750 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b98e07aa:::obj-fill-54:head# 2020-09-08T15:58:09.750 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:b9cd1e9a:::obj-fill-371:head# 2020-09-08T15:58:09.751 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:bc3322bb:::obj-fill-340:head# 2020-09-08T15:58:09.752 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:bcf43161:::obj-fill-294:head# 2020-09-08T15:58:09.752 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:bd07fc4f:::obj-fill-549:head# 2020-09-08T15:58:09.753 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:bdf48e47:::obj-fill-430:head# 2020-09-08T15:58:09.753 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:be01c111:::obj-fill-1:head# 2020-09-08T15:58:09.754 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:be3a4bc7:::obj-fill-102:head# 2020-09-08T15:58:09.754 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:be8e1fcd:::obj-fill-321:head# 2020-09-08T15:58:09.755 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:bf5fcbac:::obj-fill-287:head# 2020-09-08T15:58:09.755 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:bf806d14:::obj-fill-115:head# 2020-09-08T15:58:09.756 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:bfb28823:::obj-fill-72:head# 2020-09-08T15:58:09.756 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:bfef805e:::obj-fill-119:head# 2020-09-08T15:58:09.757 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c02f8e10:::obj-fill-497:head# 2020-09-08T15:58:09.757 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c050cd6e:::obj-fill-8:head# 2020-09-08T15:58:09.758 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c218e297:::obj-fill-173:head# 2020-09-08T15:58:09.758 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c2bc66fe:::obj-fill-252:head# 2020-09-08T15:58:09.759 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c3b55903:::obj-fill-428:head# 2020-09-08T15:58:09.759 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c51907b0:::obj-fill-457:head# 2020-09-08T15:58:09.760 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c561dc83:::obj-fill-75:head# 2020-09-08T15:58:09.760 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c5d1e1a9:::obj-fill-268:head# 2020-09-08T15:58:09.761 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c60ab0d0:::obj-fill-303:head# 2020-09-08T15:58:09.761 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c644ce52:::obj-fill-514:head# 2020-09-08T15:58:09.762 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c6ab3a11:::obj-fill-407:head# 2020-09-08T15:58:09.762 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c74377bf:::obj-fill-432:head# 2020-09-08T15:58:09.763 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c767fff6:::obj-fill-531:head# 2020-09-08T15:58:09.764 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c7a9adad:::obj-fill-475:head# 2020-09-08T15:58:09.765 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c7e3a9c2:::obj-fill-465:head# 2020-09-08T15:58:09.766 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c850aed7:::obj-fill-424:head# 2020-09-08T15:58:09.767 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c8a0088a:::obj-fill-329:head# 2020-09-08T15:58:09.767 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:c9d419f9:::obj-fill-176:head# 2020-09-08T15:58:09.768 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:caf25ec2:::obj-fill-274:head# 2020-09-08T15:58:09.769 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:cb625830:::obj-fill-70:head# 2020-09-08T15:58:09.769 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:cbb65125:::obj-fill-529:head# 2020-09-08T15:58:09.770 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:cbe2544c:::obj-fill-3:head# 2020-09-08T15:58:09.770 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:cbfce4ee:::obj-fill-455:head# 2020-09-08T15:58:09.771 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:cc62419c:::obj-fill-498:head# 2020-09-08T15:58:09.772 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:cce831fa:::obj-fill-160:head# 2020-09-08T15:58:09.772 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:cda71af4:::obj-fill-122:head# 2020-09-08T15:58:09.773 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:cea7a728:::obj-fill-265:head# 2020-09-08T15:58:09.774 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:cee19f0a:::obj-fill-142:head# 2020-09-08T15:58:09.774 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:cf22117e:::obj-fill-499:head# 2020-09-08T15:58:09.774 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:cfbfa66d:::obj-fill-66:head# 2020-09-08T15:58:09.774 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:cfc2552c:::obj-fill-211:head# 2020-09-08T15:58:09.775 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:cfc563e8:::obj-fill-392:head# 2020-09-08T15:58:09.775 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d02d8880:::obj-fill-362:head# 2020-09-08T15:58:09.776 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d054947e:::obj-fill-67:head# 2020-09-08T15:58:09.776 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d061c977:::obj-fill-164:head# 2020-09-08T15:58:09.777 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d06a5f57:::obj-fill-296:head# 2020-09-08T15:58:09.777 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d110062a:::obj-fill-343:head# 2020-09-08T15:58:09.778 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d1b8ad47:::obj-fill-383:head# 2020-09-08T15:58:09.778 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d1e80db6:::obj-fill-117:head# 2020-09-08T15:58:09.779 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d210027e:::obj-fill-231:head# 2020-09-08T15:58:09.780 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d24428ed:::obj-fill-199:head# 2020-09-08T15:58:09.780 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d27c3c4b:::obj-fill-154:head# 2020-09-08T15:58:09.780 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d28957e3:::obj-fill-263:head# 2020-09-08T15:58:09.781 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d2d44da7:::obj-fill-544:head# 2020-09-08T15:58:09.781 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d31004a4:::obj-fill-434:head# 2020-09-08T15:58:09.781 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d32487c3:::obj-fill-385:head# 2020-09-08T15:58:09.782 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d340891c:::obj-fill-12:head# 2020-09-08T15:58:09.782 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d4135728:::obj-fill-310:head# 2020-09-08T15:58:09.782 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d5a43972:::obj-fill-9:head# 2020-09-08T15:58:09.783 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d5efeb15:::obj-fill-347:head# 2020-09-08T15:58:09.783 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d6463f70:::obj-fill-536:head# 2020-09-08T15:58:09.784 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d666d9b7:::obj-fill-420:head# 2020-09-08T15:58:09.785 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d6e86688:::obj-fill-166:head# 2020-09-08T15:58:09.785 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d730370d:::obj-fill-206:head# 2020-09-08T15:58:09.786 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d783551c:::obj-fill-109:head# 2020-09-08T15:58:09.787 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d7f77e5f:::obj-fill-551:head# 2020-09-08T15:58:09.787 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d843056c:::obj-fill-291:head# 2020-09-08T15:58:09.788 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d84eb173:::obj-fill-221:head# 2020-09-08T15:58:09.788 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d8dd069c:::obj-fill-60:head# 2020-09-08T15:58:09.788 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d8f2f750:::obj-fill-562:head# 2020-09-08T15:58:09.788 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d8f80ac2:::obj-fill-179:head# 2020-09-08T15:58:09.789 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:d9f904cf:::obj-fill-308:head# 2020-09-08T15:58:09.789 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:db0a534b:::obj-fill-410:head# 2020-09-08T15:58:09.790 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:dc4403f4:::obj-fill-416:head# 2020-09-08T15:58:09.790 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:dc66c3ca:::obj-fill-220:head# 2020-09-08T15:58:09.791 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:dc8198dc:::obj-fill-596:head# 2020-09-08T15:58:09.791 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:dcbade2b:::obj-fill-10:head# 2020-09-08T15:58:09.791 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ddb787ea:::obj-fill-556:head# 2020-09-08T15:58:09.793 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:de58065b:::obj-fill-306:head# 2020-09-08T15:58:09.793 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:deaa6fab:::obj-fill-194:head# 2020-09-08T15:58:09.793 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:dfee7714:::obj-fill-202:head# 2020-09-08T15:58:09.793 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:dff5df4a:::obj-fill-565:head# 2020-09-08T15:58:09.793 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:e2053442:::obj-fill-107:head# 2020-09-08T15:58:09.794 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:e32055b8:::obj-fill-57:head# 2020-09-08T15:58:09.794 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:e37fac1e:::obj-fill-161:head# 2020-09-08T15:58:09.795 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:e388f5aa:::obj-fill-273:head# 2020-09-08T15:58:09.795 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:e38b1f4d:::obj-fill-393:head# 2020-09-08T15:58:09.795 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:e4792474:::obj-fill-158:head# 2020-09-08T15:58:09.796 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:e4899cb0:::obj-fill-270:head# 2020-09-08T15:58:09.796 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:e62ae9f1:::obj-fill-288:head# 2020-09-08T15:58:09.796 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:e64fd95a:::obj-fill-449:head# 2020-09-08T15:58:09.797 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:e6682cfc:::obj-fill-373:head# 2020-09-08T15:58:09.797 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:e716717b:::obj-fill-178:head# 2020-09-08T15:58:09.798 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:e80226af:::obj-fill-354:head# 2020-09-08T15:58:09.798 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:e83a5940:::obj-fill-564:head# 2020-09-08T15:58:09.799 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:e854bfbe:::obj-fill-589:head# 2020-09-08T15:58:09.799 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:e8b197bc:::obj-fill-89:head# 2020-09-08T15:58:09.800 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:e92fca88:::obj-fill-397:head# 2020-09-08T15:58:09.800 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:e94d8f7b:::obj-fill-261:head# 2020-09-08T15:58:09.801 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:e98cc0a4:::obj-fill-525:head# 2020-09-08T15:58:09.801 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ea5a9459:::obj-fill-431:head# 2020-09-08T15:58:09.802 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ebc54d47:::obj-fill-258:head# 2020-09-08T15:58:09.803 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ec0002dd:::obj-fill-205:head# 2020-09-08T15:58:09.803 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ec740b5c:::obj-fill-46:head# 2020-09-08T15:58:09.803 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ed35dda4:::obj-fill-170:head# 2020-09-08T15:58:09.804 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ed51b8f7:::obj-fill-91:head# 2020-09-08T15:58:09.804 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:edd96161:::obj-fill-48:head# 2020-09-08T15:58:09.805 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ee3f0d4b:::obj-fill-47:head# 2020-09-08T15:58:09.805 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ee4784dd:::obj-fill-480:head# 2020-09-08T15:58:09.806 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ee5a8271:::obj-fill-198:head# 2020-09-08T15:58:09.806 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ef745b66:::obj-fill-145:head# 2020-09-08T15:58:09.807 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:efa5309d:::obj-fill-215:head# 2020-09-08T15:58:09.807 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:efbdd3a1:::obj-fill-276:head# 2020-09-08T15:58:09.808 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:f059d4c0:::obj-fill-482:head# 2020-09-08T15:58:09.808 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:f0f9fb7a:::obj-fill-379:head# 2020-09-08T15:58:09.808 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:f16a3656:::obj-fill-462:head# 2020-09-08T15:58:09.809 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:f1b395ae:::obj-fill-25:head# 2020-09-08T15:58:09.809 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:f5876dad:::obj-fill-359:head# 2020-09-08T15:58:09.809 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:f5a283cd:::obj-fill-534:head# 2020-09-08T15:58:09.810 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:f5cd905a:::obj-fill-358:head# 2020-09-08T15:58:09.811 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:f5e48302:::obj-fill-406:head# 2020-09-08T15:58:09.812 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:f5ea65fc:::obj-fill-52:head# 2020-09-08T15:58:09.812 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:f642de6b:::obj-fill-204:head# 2020-09-08T15:58:09.812 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:f716eafd:::obj-fill-502:head# 2020-09-08T15:58:09.813 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:f752e9cb:::obj-fill-23:head# 2020-09-08T15:58:09.813 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:f85fe42c:::obj-fill-346:head# 2020-09-08T15:58:09.815 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:f882fd3b:::obj-fill-355:head# 2020-09-08T15:58:09.815 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:fa133332:::obj-fill-309:head# 2020-09-08T15:58:09.816 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:fa875e52:::obj-fill-64:head# 2020-09-08T15:58:09.816 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:fad91a22:::obj-fill-481:head# 2020-09-08T15:58:09.816 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:fbbc3122:::obj-fill-111:head# 2020-09-08T15:58:09.817 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:fc539ddb:::obj-fill-181:head# 2020-09-08T15:58:09.817 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:fc54128d:::obj-fill-104:head# 2020-09-08T15:58:09.818 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:fe00aded:::obj-fill-365:head# 2020-09-08T15:58:09.819 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:fe1e9971:::obj-fill-189:head# 2020-09-08T15:58:09.819 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ff0e0563:::obj-fill-508:head# 2020-09-08T15:58:09.820 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ff4e156c:::obj-fill-441:head# 2020-09-08T15:58:09.821 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:ffa355f7:::obj-fill-500:head# 2020-09-08T15:58:09.822 INFO:tasks.workunit.client.0.smithi065.stderr:Read #1:fff6c93b:::obj-fill-277:head# 2020-09-08T15:58:09.822 INFO:tasks.workunit.client.0.smithi065.stderr:Export successful 2020-09-08T15:58:09.822 INFO:tasks.workunit.client.0.smithi065.stdout: marking collection for removal 2020-09-08T15:58:09.823 INFO:tasks.workunit.client.0.smithi065.stdout:setting '_remove' omap key 2020-09-08T15:58:09.823 INFO:tasks.workunit.client.0.smithi065.stdout:finish_remove_pgs 1.0_head removing 1.0 2020-09-08T15:58:10.871 INFO:tasks.workunit.client.0.smithi065.stderr:Remove successful 2020-09-08T15:58:11.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:477: TEST_backfill_multi_partial: activate_osd td/osd-backfill-space 1 2020-09-08T15:58:11.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/osd-backfill-space 2020-09-08T15:58:11.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:58:11.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=1 2020-09-08T15:58:11.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:58:11.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/osd-backfill-space/1 2020-09-08T15:58:11.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T15:58:11.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:58:11.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:58:11.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:58:11.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2020-09-08T15:58:11.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2020-09-08T15:58:11.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:58:11.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:58:11.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T15:58:11.361 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:58:11.361 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:58:11.361 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:58:11.362 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:58:11.362 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:58:11.362 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:58:11.363 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:58:11.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:58:11.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:58:11.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T15:58:11.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T15:58:11.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:58:11.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:58:11.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:58:11.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:58:11.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:58:11.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/osd-backfill-space/1 2020-09-08T15:58:11.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.1 2020-09-08T15:58:11.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 1 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:58:11.366 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/osd-backfill-space/1/whoami 2020-09-08T15:58:11.366 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T15:58:11.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 1 = 1 ']' 2020-09-08T15:58:11.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:58:11.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:58:11.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:58:11.372 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:58:11.377+0000 7fc37b8b4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:58:11.374 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:58:11.379+0000 7fc37b8b4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:58:11.377 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:58:11.380+0000 7fc37b8b4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:58:11.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 1 2020-09-08T15:58:11.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:58:11.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T15:58:11.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:58:11.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:58:11.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:58:11.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:58:11.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:58:11.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:58:11.750 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T15:58:11.894 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:58:11.898+0000 7fc37b8b4ec0 -1 Falling back to public interface 2020-09-08T15:58:12.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:58:12.909 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:58:12.908+0000 7fc37b8b4ec0 -1 osd.1 36 log_to_monitors {default=true} 2020-09-08T15:58:13.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:58:13.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:58:13.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:58:13.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:58:13.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T15:58:13.160 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T15:58:13.736 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up out weight 0 up_from 41 up_thru 34 down_at 37 last_clean_interval [10,36) [v2:127.0.0.1:6810/203561,v1:127.0.0.1:6811/203561] [v2:127.0.0.1:6812/203561,v1:127.0.0.1:6813/203561] exists,up 7a372dc9-d171-46e1-bc31-12a3e2311ac0 2020-09-08T15:58:13.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:58:13.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:58:13.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:58:13.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:479: TEST_backfill_multi_partial: ceph pg dump pgs 2020-09-08T15:58:14.107 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:58:14.108 INFO:tasks.workunit.client.0.smithi065.stdout:3.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:58:08.494018+0000 0'0 40:30 [2,0] 2 [2,0] 2 0'0 2020-09-08T15:57:10.462737+0000 0'0 2020-09-08T15:57:10.462737+0000 0 2020-09-08T15:58:14.108 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 573 0 0 0 0 1496103 0 0 73 73 stale+active+clean 2020-09-08T15:57:07.252587+0000 36'573 36:603 [1] 1 [1] 1 0'0 2020-09-08T15:57:05.166131+0000 0'0 2020-09-08T15:57:05.166131+0000 0 2020-09-08T15:58:14.108 INFO:tasks.workunit.client.0.smithi065.stdout:2.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:58:08.494186+0000 0'0 40:42 [2,0] 2 [2,0] 2 0'0 2020-09-08T15:57:07.796898+0000 0'0 2020-09-08T15:57:07.796898+0000 0 2020-09-08T15:58:14.109 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:58:14.109 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:58:14.109 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:58:14.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:481: TEST_backfill_multi_partial: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=1 2020-09-08T15:58:14.118 INFO:tasks.workunit.client.0.smithi065.stderr:1+0 records in 2020-09-08T15:58:14.118 INFO:tasks.workunit.client.0.smithi065.stderr:1+0 records out 2020-09-08T15:58:14.119 INFO:tasks.workunit.client.0.smithi065.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 8.0199e-05 s, 12.8 MB/s 2020-09-08T15:58:14.119 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: seq 1 600 2020-09-08T15:58:14.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:14.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-1 td/osd-backfill-space/datafile 2020-09-08T15:58:14.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:14.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-2 td/osd-backfill-space/datafile 2020-09-08T15:58:14.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:14.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-3 td/osd-backfill-space/datafile 2020-09-08T15:58:14.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:14.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-4 td/osd-backfill-space/datafile 2020-09-08T15:58:14.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:14.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-5 td/osd-backfill-space/datafile 2020-09-08T15:58:14.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:14.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-6 td/osd-backfill-space/datafile 2020-09-08T15:58:14.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:14.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-7 td/osd-backfill-space/datafile 2020-09-08T15:58:15.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:15.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-8 td/osd-backfill-space/datafile 2020-09-08T15:58:15.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:15.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-9 td/osd-backfill-space/datafile 2020-09-08T15:58:15.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:15.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-10 td/osd-backfill-space/datafile 2020-09-08T15:58:15.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:15.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-11 td/osd-backfill-space/datafile 2020-09-08T15:58:15.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:15.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-12 td/osd-backfill-space/datafile 2020-09-08T15:58:15.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:15.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-13 td/osd-backfill-space/datafile 2020-09-08T15:58:15.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:15.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-14 td/osd-backfill-space/datafile 2020-09-08T15:58:15.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:15.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-15 td/osd-backfill-space/datafile 2020-09-08T15:58:16.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:16.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-16 td/osd-backfill-space/datafile 2020-09-08T15:58:16.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:16.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-17 td/osd-backfill-space/datafile 2020-09-08T15:58:16.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:16.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-18 td/osd-backfill-space/datafile 2020-09-08T15:58:16.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:16.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-19 td/osd-backfill-space/datafile 2020-09-08T15:58:16.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:16.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-20 td/osd-backfill-space/datafile 2020-09-08T15:58:16.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:16.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-21 td/osd-backfill-space/datafile 2020-09-08T15:58:16.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:16.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-22 td/osd-backfill-space/datafile 2020-09-08T15:58:16.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:16.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-23 td/osd-backfill-space/datafile 2020-09-08T15:58:17.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:17.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-24 td/osd-backfill-space/datafile 2020-09-08T15:58:17.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:17.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-25 td/osd-backfill-space/datafile 2020-09-08T15:58:17.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:17.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-26 td/osd-backfill-space/datafile 2020-09-08T15:58:17.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:17.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-27 td/osd-backfill-space/datafile 2020-09-08T15:58:17.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:17.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-28 td/osd-backfill-space/datafile 2020-09-08T15:58:17.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:17.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-29 td/osd-backfill-space/datafile 2020-09-08T15:58:17.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:17.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-30 td/osd-backfill-space/datafile 2020-09-08T15:58:17.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:17.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-31 td/osd-backfill-space/datafile 2020-09-08T15:58:18.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:18.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-32 td/osd-backfill-space/datafile 2020-09-08T15:58:18.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:18.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-33 td/osd-backfill-space/datafile 2020-09-08T15:58:18.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:18.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-34 td/osd-backfill-space/datafile 2020-09-08T15:58:18.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:18.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-35 td/osd-backfill-space/datafile 2020-09-08T15:58:18.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:18.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-36 td/osd-backfill-space/datafile 2020-09-08T15:58:18.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:18.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-37 td/osd-backfill-space/datafile 2020-09-08T15:58:18.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:18.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-38 td/osd-backfill-space/datafile 2020-09-08T15:58:18.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:18.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-39 td/osd-backfill-space/datafile 2020-09-08T15:58:19.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:19.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-40 td/osd-backfill-space/datafile 2020-09-08T15:58:19.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:19.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-41 td/osd-backfill-space/datafile 2020-09-08T15:58:19.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:19.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-42 td/osd-backfill-space/datafile 2020-09-08T15:58:19.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:19.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-43 td/osd-backfill-space/datafile 2020-09-08T15:58:19.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:19.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-44 td/osd-backfill-space/datafile 2020-09-08T15:58:19.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:19.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-45 td/osd-backfill-space/datafile 2020-09-08T15:58:19.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:19.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-46 td/osd-backfill-space/datafile 2020-09-08T15:58:19.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:19.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-47 td/osd-backfill-space/datafile 2020-09-08T15:58:20.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:20.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-48 td/osd-backfill-space/datafile 2020-09-08T15:58:20.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:20.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-49 td/osd-backfill-space/datafile 2020-09-08T15:58:20.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:20.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-50 td/osd-backfill-space/datafile 2020-09-08T15:58:20.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:20.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-51 td/osd-backfill-space/datafile 2020-09-08T15:58:20.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:20.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-52 td/osd-backfill-space/datafile 2020-09-08T15:58:20.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:20.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-53 td/osd-backfill-space/datafile 2020-09-08T15:58:20.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:20.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-54 td/osd-backfill-space/datafile 2020-09-08T15:58:20.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:20.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-55 td/osd-backfill-space/datafile 2020-09-08T15:58:21.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:21.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-56 td/osd-backfill-space/datafile 2020-09-08T15:58:21.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:21.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-57 td/osd-backfill-space/datafile 2020-09-08T15:58:21.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:21.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-58 td/osd-backfill-space/datafile 2020-09-08T15:58:21.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:21.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-59 td/osd-backfill-space/datafile 2020-09-08T15:58:21.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:21.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-60 td/osd-backfill-space/datafile 2020-09-08T15:58:21.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:21.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-61 td/osd-backfill-space/datafile 2020-09-08T15:58:21.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:21.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-62 td/osd-backfill-space/datafile 2020-09-08T15:58:21.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:21.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-63 td/osd-backfill-space/datafile 2020-09-08T15:58:22.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:22.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-64 td/osd-backfill-space/datafile 2020-09-08T15:58:22.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:22.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-65 td/osd-backfill-space/datafile 2020-09-08T15:58:22.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:22.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-66 td/osd-backfill-space/datafile 2020-09-08T15:58:22.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:22.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-67 td/osd-backfill-space/datafile 2020-09-08T15:58:22.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:22.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-68 td/osd-backfill-space/datafile 2020-09-08T15:58:22.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:22.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-69 td/osd-backfill-space/datafile 2020-09-08T15:58:22.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:22.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-70 td/osd-backfill-space/datafile 2020-09-08T15:58:22.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:22.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-71 td/osd-backfill-space/datafile 2020-09-08T15:58:23.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:23.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-72 td/osd-backfill-space/datafile 2020-09-08T15:58:23.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:23.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-73 td/osd-backfill-space/datafile 2020-09-08T15:58:23.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:23.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-74 td/osd-backfill-space/datafile 2020-09-08T15:58:23.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:23.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-75 td/osd-backfill-space/datafile 2020-09-08T15:58:23.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:23.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-76 td/osd-backfill-space/datafile 2020-09-08T15:58:23.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:23.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-77 td/osd-backfill-space/datafile 2020-09-08T15:58:23.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:23.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-78 td/osd-backfill-space/datafile 2020-09-08T15:58:23.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:23.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-79 td/osd-backfill-space/datafile 2020-09-08T15:58:24.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:24.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-80 td/osd-backfill-space/datafile 2020-09-08T15:58:24.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:24.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-81 td/osd-backfill-space/datafile 2020-09-08T15:58:24.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:24.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-82 td/osd-backfill-space/datafile 2020-09-08T15:58:24.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:24.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-83 td/osd-backfill-space/datafile 2020-09-08T15:58:24.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:24.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-84 td/osd-backfill-space/datafile 2020-09-08T15:58:24.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:24.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-85 td/osd-backfill-space/datafile 2020-09-08T15:58:24.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:24.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-86 td/osd-backfill-space/datafile 2020-09-08T15:58:24.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:24.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-87 td/osd-backfill-space/datafile 2020-09-08T15:58:25.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:25.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-88 td/osd-backfill-space/datafile 2020-09-08T15:58:25.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:25.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-89 td/osd-backfill-space/datafile 2020-09-08T15:58:25.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:25.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-90 td/osd-backfill-space/datafile 2020-09-08T15:58:25.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:25.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-91 td/osd-backfill-space/datafile 2020-09-08T15:58:25.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:25.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-92 td/osd-backfill-space/datafile 2020-09-08T15:58:25.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:25.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-93 td/osd-backfill-space/datafile 2020-09-08T15:58:25.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:25.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-94 td/osd-backfill-space/datafile 2020-09-08T15:58:25.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:25.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-95 td/osd-backfill-space/datafile 2020-09-08T15:58:26.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:26.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-96 td/osd-backfill-space/datafile 2020-09-08T15:58:26.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:26.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-97 td/osd-backfill-space/datafile 2020-09-08T15:58:26.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:26.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-98 td/osd-backfill-space/datafile 2020-09-08T15:58:26.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:26.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-99 td/osd-backfill-space/datafile 2020-09-08T15:58:26.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:26.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-100 td/osd-backfill-space/datafile 2020-09-08T15:58:26.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:26.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-101 td/osd-backfill-space/datafile 2020-09-08T15:58:26.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:26.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-102 td/osd-backfill-space/datafile 2020-09-08T15:58:26.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:26.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-103 td/osd-backfill-space/datafile 2020-09-08T15:58:27.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:27.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-104 td/osd-backfill-space/datafile 2020-09-08T15:58:27.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:27.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-105 td/osd-backfill-space/datafile 2020-09-08T15:58:27.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:27.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-106 td/osd-backfill-space/datafile 2020-09-08T15:58:27.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:27.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-107 td/osd-backfill-space/datafile 2020-09-08T15:58:27.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:27.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-108 td/osd-backfill-space/datafile 2020-09-08T15:58:27.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:27.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-109 td/osd-backfill-space/datafile 2020-09-08T15:58:27.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:27.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-110 td/osd-backfill-space/datafile 2020-09-08T15:58:27.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:27.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-111 td/osd-backfill-space/datafile 2020-09-08T15:58:28.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:28.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-112 td/osd-backfill-space/datafile 2020-09-08T15:58:28.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:28.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-113 td/osd-backfill-space/datafile 2020-09-08T15:58:28.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:28.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-114 td/osd-backfill-space/datafile 2020-09-08T15:58:28.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:28.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-115 td/osd-backfill-space/datafile 2020-09-08T15:58:28.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:28.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-116 td/osd-backfill-space/datafile 2020-09-08T15:58:28.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:28.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-117 td/osd-backfill-space/datafile 2020-09-08T15:58:28.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:28.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-118 td/osd-backfill-space/datafile 2020-09-08T15:58:29.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:29.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-119 td/osd-backfill-space/datafile 2020-09-08T15:58:29.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:29.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-120 td/osd-backfill-space/datafile 2020-09-08T15:58:29.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:29.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-121 td/osd-backfill-space/datafile 2020-09-08T15:58:29.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:29.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-122 td/osd-backfill-space/datafile 2020-09-08T15:58:29.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:29.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-123 td/osd-backfill-space/datafile 2020-09-08T15:58:29.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:29.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-124 td/osd-backfill-space/datafile 2020-09-08T15:58:29.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:29.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-125 td/osd-backfill-space/datafile 2020-09-08T15:58:29.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:29.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-126 td/osd-backfill-space/datafile 2020-09-08T15:58:30.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:30.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-127 td/osd-backfill-space/datafile 2020-09-08T15:58:30.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:30.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-128 td/osd-backfill-space/datafile 2020-09-08T15:58:30.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:30.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-129 td/osd-backfill-space/datafile 2020-09-08T15:58:30.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:30.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-130 td/osd-backfill-space/datafile 2020-09-08T15:58:30.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:30.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-131 td/osd-backfill-space/datafile 2020-09-08T15:58:30.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:30.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-132 td/osd-backfill-space/datafile 2020-09-08T15:58:30.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:30.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-133 td/osd-backfill-space/datafile 2020-09-08T15:58:30.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:30.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-134 td/osd-backfill-space/datafile 2020-09-08T15:58:31.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:31.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-135 td/osd-backfill-space/datafile 2020-09-08T15:58:31.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:31.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-136 td/osd-backfill-space/datafile 2020-09-08T15:58:31.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:31.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-137 td/osd-backfill-space/datafile 2020-09-08T15:58:31.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:31.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-138 td/osd-backfill-space/datafile 2020-09-08T15:58:31.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:31.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-139 td/osd-backfill-space/datafile 2020-09-08T15:58:31.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:31.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-140 td/osd-backfill-space/datafile 2020-09-08T15:58:31.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:31.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-141 td/osd-backfill-space/datafile 2020-09-08T15:58:31.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:31.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-142 td/osd-backfill-space/datafile 2020-09-08T15:58:32.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:32.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-143 td/osd-backfill-space/datafile 2020-09-08T15:58:32.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:32.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-144 td/osd-backfill-space/datafile 2020-09-08T15:58:32.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:32.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-145 td/osd-backfill-space/datafile 2020-09-08T15:58:32.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:32.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-146 td/osd-backfill-space/datafile 2020-09-08T15:58:32.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:32.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-147 td/osd-backfill-space/datafile 2020-09-08T15:58:32.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:32.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-148 td/osd-backfill-space/datafile 2020-09-08T15:58:32.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:32.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-149 td/osd-backfill-space/datafile 2020-09-08T15:58:32.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:32.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-150 td/osd-backfill-space/datafile 2020-09-08T15:58:33.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:33.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-151 td/osd-backfill-space/datafile 2020-09-08T15:58:33.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:33.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-152 td/osd-backfill-space/datafile 2020-09-08T15:58:33.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:33.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-153 td/osd-backfill-space/datafile 2020-09-08T15:58:33.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:33.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-154 td/osd-backfill-space/datafile 2020-09-08T15:58:33.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:33.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-155 td/osd-backfill-space/datafile 2020-09-08T15:58:33.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:33.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-156 td/osd-backfill-space/datafile 2020-09-08T15:58:33.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:33.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-157 td/osd-backfill-space/datafile 2020-09-08T15:58:33.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:33.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-158 td/osd-backfill-space/datafile 2020-09-08T15:58:34.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:34.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-159 td/osd-backfill-space/datafile 2020-09-08T15:58:34.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:34.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-160 td/osd-backfill-space/datafile 2020-09-08T15:58:34.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:34.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-161 td/osd-backfill-space/datafile 2020-09-08T15:58:34.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:34.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-162 td/osd-backfill-space/datafile 2020-09-08T15:58:34.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:34.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-163 td/osd-backfill-space/datafile 2020-09-08T15:58:34.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:34.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-164 td/osd-backfill-space/datafile 2020-09-08T15:58:34.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:34.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-165 td/osd-backfill-space/datafile 2020-09-08T15:58:34.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:34.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-166 td/osd-backfill-space/datafile 2020-09-08T15:58:35.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:35.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-167 td/osd-backfill-space/datafile 2020-09-08T15:58:35.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:35.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-168 td/osd-backfill-space/datafile 2020-09-08T15:58:35.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:35.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-169 td/osd-backfill-space/datafile 2020-09-08T15:58:35.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:35.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-170 td/osd-backfill-space/datafile 2020-09-08T15:58:35.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:35.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-171 td/osd-backfill-space/datafile 2020-09-08T15:58:35.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:35.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-172 td/osd-backfill-space/datafile 2020-09-08T15:58:35.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:35.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-173 td/osd-backfill-space/datafile 2020-09-08T15:58:36.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:36.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-174 td/osd-backfill-space/datafile 2020-09-08T15:58:36.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:36.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-175 td/osd-backfill-space/datafile 2020-09-08T15:58:36.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:36.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-176 td/osd-backfill-space/datafile 2020-09-08T15:58:36.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:36.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-177 td/osd-backfill-space/datafile 2020-09-08T15:58:36.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:36.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-178 td/osd-backfill-space/datafile 2020-09-08T15:58:36.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:36.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-179 td/osd-backfill-space/datafile 2020-09-08T15:58:36.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:36.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-180 td/osd-backfill-space/datafile 2020-09-08T15:58:36.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:36.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-181 td/osd-backfill-space/datafile 2020-09-08T15:58:37.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:37.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-182 td/osd-backfill-space/datafile 2020-09-08T15:58:37.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:37.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-183 td/osd-backfill-space/datafile 2020-09-08T15:58:37.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:37.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-184 td/osd-backfill-space/datafile 2020-09-08T15:58:37.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:37.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-185 td/osd-backfill-space/datafile 2020-09-08T15:58:37.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:37.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-186 td/osd-backfill-space/datafile 2020-09-08T15:58:37.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:37.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-187 td/osd-backfill-space/datafile 2020-09-08T15:58:37.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:37.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-188 td/osd-backfill-space/datafile 2020-09-08T15:58:37.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:37.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-189 td/osd-backfill-space/datafile 2020-09-08T15:58:38.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:38.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-190 td/osd-backfill-space/datafile 2020-09-08T15:58:38.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:38.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-191 td/osd-backfill-space/datafile 2020-09-08T15:58:38.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:38.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-192 td/osd-backfill-space/datafile 2020-09-08T15:58:38.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:38.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-193 td/osd-backfill-space/datafile 2020-09-08T15:58:38.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:38.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-194 td/osd-backfill-space/datafile 2020-09-08T15:58:38.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:38.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-195 td/osd-backfill-space/datafile 2020-09-08T15:58:38.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:38.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-196 td/osd-backfill-space/datafile 2020-09-08T15:58:38.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:38.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-197 td/osd-backfill-space/datafile 2020-09-08T15:58:39.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:39.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-198 td/osd-backfill-space/datafile 2020-09-08T15:58:39.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:39.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-199 td/osd-backfill-space/datafile 2020-09-08T15:58:39.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:39.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-200 td/osd-backfill-space/datafile 2020-09-08T15:58:39.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:39.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-201 td/osd-backfill-space/datafile 2020-09-08T15:58:39.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:39.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-202 td/osd-backfill-space/datafile 2020-09-08T15:58:39.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:39.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-203 td/osd-backfill-space/datafile 2020-09-08T15:58:39.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:39.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-204 td/osd-backfill-space/datafile 2020-09-08T15:58:39.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:39.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-205 td/osd-backfill-space/datafile 2020-09-08T15:58:40.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:40.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-206 td/osd-backfill-space/datafile 2020-09-08T15:58:40.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:40.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-207 td/osd-backfill-space/datafile 2020-09-08T15:58:40.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:40.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-208 td/osd-backfill-space/datafile 2020-09-08T15:58:40.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:40.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-209 td/osd-backfill-space/datafile 2020-09-08T15:58:40.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:40.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-210 td/osd-backfill-space/datafile 2020-09-08T15:58:40.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:40.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-211 td/osd-backfill-space/datafile 2020-09-08T15:58:40.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:40.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-212 td/osd-backfill-space/datafile 2020-09-08T15:58:40.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:40.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-213 td/osd-backfill-space/datafile 2020-09-08T15:58:41.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:41.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-214 td/osd-backfill-space/datafile 2020-09-08T15:58:41.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:41.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-215 td/osd-backfill-space/datafile 2020-09-08T15:58:41.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:41.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-216 td/osd-backfill-space/datafile 2020-09-08T15:58:41.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:41.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-217 td/osd-backfill-space/datafile 2020-09-08T15:58:41.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:41.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-218 td/osd-backfill-space/datafile 2020-09-08T15:58:41.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:41.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-219 td/osd-backfill-space/datafile 2020-09-08T15:58:41.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:41.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-220 td/osd-backfill-space/datafile 2020-09-08T15:58:41.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:41.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-221 td/osd-backfill-space/datafile 2020-09-08T15:58:42.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:42.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-222 td/osd-backfill-space/datafile 2020-09-08T15:58:42.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:42.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-223 td/osd-backfill-space/datafile 2020-09-08T15:58:42.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:42.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-224 td/osd-backfill-space/datafile 2020-09-08T15:58:42.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:42.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-225 td/osd-backfill-space/datafile 2020-09-08T15:58:42.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:42.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-226 td/osd-backfill-space/datafile 2020-09-08T15:58:42.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:42.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-227 td/osd-backfill-space/datafile 2020-09-08T15:58:42.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:42.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-228 td/osd-backfill-space/datafile 2020-09-08T15:58:42.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:42.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-229 td/osd-backfill-space/datafile 2020-09-08T15:58:43.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:43.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-230 td/osd-backfill-space/datafile 2020-09-08T15:58:43.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:43.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-231 td/osd-backfill-space/datafile 2020-09-08T15:58:43.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:43.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-232 td/osd-backfill-space/datafile 2020-09-08T15:58:43.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:43.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-233 td/osd-backfill-space/datafile 2020-09-08T15:58:43.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:43.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-234 td/osd-backfill-space/datafile 2020-09-08T15:58:43.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:43.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-235 td/osd-backfill-space/datafile 2020-09-08T15:58:43.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:43.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-236 td/osd-backfill-space/datafile 2020-09-08T15:58:43.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:43.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-237 td/osd-backfill-space/datafile 2020-09-08T15:58:44.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:44.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-238 td/osd-backfill-space/datafile 2020-09-08T15:58:44.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:44.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-239 td/osd-backfill-space/datafile 2020-09-08T15:58:44.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:44.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-240 td/osd-backfill-space/datafile 2020-09-08T15:58:44.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:44.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-241 td/osd-backfill-space/datafile 2020-09-08T15:58:44.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:44.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-242 td/osd-backfill-space/datafile 2020-09-08T15:58:44.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:44.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-243 td/osd-backfill-space/datafile 2020-09-08T15:58:45.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:45.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-244 td/osd-backfill-space/datafile 2020-09-08T15:58:45.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:45.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-245 td/osd-backfill-space/datafile 2020-09-08T15:58:45.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:45.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-246 td/osd-backfill-space/datafile 2020-09-08T15:58:45.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:45.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-247 td/osd-backfill-space/datafile 2020-09-08T15:58:45.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:45.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-248 td/osd-backfill-space/datafile 2020-09-08T15:58:45.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:45.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-249 td/osd-backfill-space/datafile 2020-09-08T15:58:45.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:45.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-250 td/osd-backfill-space/datafile 2020-09-08T15:58:46.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:46.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-251 td/osd-backfill-space/datafile 2020-09-08T15:58:46.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:46.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-252 td/osd-backfill-space/datafile 2020-09-08T15:58:46.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:46.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-253 td/osd-backfill-space/datafile 2020-09-08T15:58:46.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:46.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-254 td/osd-backfill-space/datafile 2020-09-08T15:58:46.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:46.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-255 td/osd-backfill-space/datafile 2020-09-08T15:58:46.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:46.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-256 td/osd-backfill-space/datafile 2020-09-08T15:58:46.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:46.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-257 td/osd-backfill-space/datafile 2020-09-08T15:58:46.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:46.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-258 td/osd-backfill-space/datafile 2020-09-08T15:58:47.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:47.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-259 td/osd-backfill-space/datafile 2020-09-08T15:58:47.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:47.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-260 td/osd-backfill-space/datafile 2020-09-08T15:58:47.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:47.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-261 td/osd-backfill-space/datafile 2020-09-08T15:58:47.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:47.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-262 td/osd-backfill-space/datafile 2020-09-08T15:58:47.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:47.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-263 td/osd-backfill-space/datafile 2020-09-08T15:58:47.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:47.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-264 td/osd-backfill-space/datafile 2020-09-08T15:58:47.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:47.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-265 td/osd-backfill-space/datafile 2020-09-08T15:58:47.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:47.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-266 td/osd-backfill-space/datafile 2020-09-08T15:58:48.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:48.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-267 td/osd-backfill-space/datafile 2020-09-08T15:58:48.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:48.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-268 td/osd-backfill-space/datafile 2020-09-08T15:58:48.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:48.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-269 td/osd-backfill-space/datafile 2020-09-08T15:58:48.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:48.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-270 td/osd-backfill-space/datafile 2020-09-08T15:58:48.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:48.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-271 td/osd-backfill-space/datafile 2020-09-08T15:58:48.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:48.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-272 td/osd-backfill-space/datafile 2020-09-08T15:58:48.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:48.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-273 td/osd-backfill-space/datafile 2020-09-08T15:58:49.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:49.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-274 td/osd-backfill-space/datafile 2020-09-08T15:58:49.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:49.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-275 td/osd-backfill-space/datafile 2020-09-08T15:58:49.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:49.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-276 td/osd-backfill-space/datafile 2020-09-08T15:58:49.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:49.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-277 td/osd-backfill-space/datafile 2020-09-08T15:58:49.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:49.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-278 td/osd-backfill-space/datafile 2020-09-08T15:58:49.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:49.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-279 td/osd-backfill-space/datafile 2020-09-08T15:58:49.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:49.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-280 td/osd-backfill-space/datafile 2020-09-08T15:58:49.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:49.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-281 td/osd-backfill-space/datafile 2020-09-08T15:58:50.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:50.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-282 td/osd-backfill-space/datafile 2020-09-08T15:58:50.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:50.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-283 td/osd-backfill-space/datafile 2020-09-08T15:58:50.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:50.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-284 td/osd-backfill-space/datafile 2020-09-08T15:58:50.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:50.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-285 td/osd-backfill-space/datafile 2020-09-08T15:58:50.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:50.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-286 td/osd-backfill-space/datafile 2020-09-08T15:58:50.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:50.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-287 td/osd-backfill-space/datafile 2020-09-08T15:58:50.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:50.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-288 td/osd-backfill-space/datafile 2020-09-08T15:58:51.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:51.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-289 td/osd-backfill-space/datafile 2020-09-08T15:58:51.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:51.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-290 td/osd-backfill-space/datafile 2020-09-08T15:58:51.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:51.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-291 td/osd-backfill-space/datafile 2020-09-08T15:58:51.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:51.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-292 td/osd-backfill-space/datafile 2020-09-08T15:58:51.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:51.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-293 td/osd-backfill-space/datafile 2020-09-08T15:58:51.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:51.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-294 td/osd-backfill-space/datafile 2020-09-08T15:58:51.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:51.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-295 td/osd-backfill-space/datafile 2020-09-08T15:58:51.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:51.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-296 td/osd-backfill-space/datafile 2020-09-08T15:58:52.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:52.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-297 td/osd-backfill-space/datafile 2020-09-08T15:58:52.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:52.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-298 td/osd-backfill-space/datafile 2020-09-08T15:58:52.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:52.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-299 td/osd-backfill-space/datafile 2020-09-08T15:58:52.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:52.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-300 td/osd-backfill-space/datafile 2020-09-08T15:58:52.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:52.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-301 td/osd-backfill-space/datafile 2020-09-08T15:58:52.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:52.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-302 td/osd-backfill-space/datafile 2020-09-08T15:58:52.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:52.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-303 td/osd-backfill-space/datafile 2020-09-08T15:58:52.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:52.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-304 td/osd-backfill-space/datafile 2020-09-08T15:58:53.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:53.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-305 td/osd-backfill-space/datafile 2020-09-08T15:58:53.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:53.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-306 td/osd-backfill-space/datafile 2020-09-08T15:58:53.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:53.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-307 td/osd-backfill-space/datafile 2020-09-08T15:58:53.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:53.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-308 td/osd-backfill-space/datafile 2020-09-08T15:58:53.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:53.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-309 td/osd-backfill-space/datafile 2020-09-08T15:58:53.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:53.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-310 td/osd-backfill-space/datafile 2020-09-08T15:58:53.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:53.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-311 td/osd-backfill-space/datafile 2020-09-08T15:58:54.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:54.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-312 td/osd-backfill-space/datafile 2020-09-08T15:58:54.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:54.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-313 td/osd-backfill-space/datafile 2020-09-08T15:58:54.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:54.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-314 td/osd-backfill-space/datafile 2020-09-08T15:58:54.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:54.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-315 td/osd-backfill-space/datafile 2020-09-08T15:58:54.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:54.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-316 td/osd-backfill-space/datafile 2020-09-08T15:58:54.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:54.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-317 td/osd-backfill-space/datafile 2020-09-08T15:58:54.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:54.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-318 td/osd-backfill-space/datafile 2020-09-08T15:58:55.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:55.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-319 td/osd-backfill-space/datafile 2020-09-08T15:58:55.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:55.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-320 td/osd-backfill-space/datafile 2020-09-08T15:58:55.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:55.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-321 td/osd-backfill-space/datafile 2020-09-08T15:58:55.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:55.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-322 td/osd-backfill-space/datafile 2020-09-08T15:58:55.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:55.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-323 td/osd-backfill-space/datafile 2020-09-08T15:58:55.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:55.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-324 td/osd-backfill-space/datafile 2020-09-08T15:58:55.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:55.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-325 td/osd-backfill-space/datafile 2020-09-08T15:58:55.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:55.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-326 td/osd-backfill-space/datafile 2020-09-08T15:58:56.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:56.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-327 td/osd-backfill-space/datafile 2020-09-08T15:58:56.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:56.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-328 td/osd-backfill-space/datafile 2020-09-08T15:58:56.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:56.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-329 td/osd-backfill-space/datafile 2020-09-08T15:58:56.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:56.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-330 td/osd-backfill-space/datafile 2020-09-08T15:58:56.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:56.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-331 td/osd-backfill-space/datafile 2020-09-08T15:58:56.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:56.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-332 td/osd-backfill-space/datafile 2020-09-08T15:58:56.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:56.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-333 td/osd-backfill-space/datafile 2020-09-08T15:58:56.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:56.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-334 td/osd-backfill-space/datafile 2020-09-08T15:58:57.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:57.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-335 td/osd-backfill-space/datafile 2020-09-08T15:58:57.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:57.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-336 td/osd-backfill-space/datafile 2020-09-08T15:58:57.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:57.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-337 td/osd-backfill-space/datafile 2020-09-08T15:58:57.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:57.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-338 td/osd-backfill-space/datafile 2020-09-08T15:58:57.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:57.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-339 td/osd-backfill-space/datafile 2020-09-08T15:58:57.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:57.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-340 td/osd-backfill-space/datafile 2020-09-08T15:58:57.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:57.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-341 td/osd-backfill-space/datafile 2020-09-08T15:58:58.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:58.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-342 td/osd-backfill-space/datafile 2020-09-08T15:58:58.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:58.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-343 td/osd-backfill-space/datafile 2020-09-08T15:58:58.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:58.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-344 td/osd-backfill-space/datafile 2020-09-08T15:58:58.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:58.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-345 td/osd-backfill-space/datafile 2020-09-08T15:58:58.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:58.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-346 td/osd-backfill-space/datafile 2020-09-08T15:58:58.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:58.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-347 td/osd-backfill-space/datafile 2020-09-08T15:58:58.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:58.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-348 td/osd-backfill-space/datafile 2020-09-08T15:58:58.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:58.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-349 td/osd-backfill-space/datafile 2020-09-08T15:58:59.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:59.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-350 td/osd-backfill-space/datafile 2020-09-08T15:58:59.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:59.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-351 td/osd-backfill-space/datafile 2020-09-08T15:58:59.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:59.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-352 td/osd-backfill-space/datafile 2020-09-08T15:58:59.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:59.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-353 td/osd-backfill-space/datafile 2020-09-08T15:58:59.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:59.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-354 td/osd-backfill-space/datafile 2020-09-08T15:58:59.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:59.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-355 td/osd-backfill-space/datafile 2020-09-08T15:58:59.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:58:59.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-356 td/osd-backfill-space/datafile 2020-09-08T15:59:00.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:00.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-357 td/osd-backfill-space/datafile 2020-09-08T15:59:00.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:00.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-358 td/osd-backfill-space/datafile 2020-09-08T15:59:00.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:00.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-359 td/osd-backfill-space/datafile 2020-09-08T15:59:00.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:00.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-360 td/osd-backfill-space/datafile 2020-09-08T15:59:00.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:00.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-361 td/osd-backfill-space/datafile 2020-09-08T15:59:00.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:00.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-362 td/osd-backfill-space/datafile 2020-09-08T15:59:00.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:00.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-363 td/osd-backfill-space/datafile 2020-09-08T15:59:00.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:00.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-364 td/osd-backfill-space/datafile 2020-09-08T15:59:01.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:01.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-365 td/osd-backfill-space/datafile 2020-09-08T15:59:01.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:01.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-366 td/osd-backfill-space/datafile 2020-09-08T15:59:01.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:01.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-367 td/osd-backfill-space/datafile 2020-09-08T15:59:01.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:01.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-368 td/osd-backfill-space/datafile 2020-09-08T15:59:01.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:01.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-369 td/osd-backfill-space/datafile 2020-09-08T15:59:01.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:01.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-370 td/osd-backfill-space/datafile 2020-09-08T15:59:01.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:01.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-371 td/osd-backfill-space/datafile 2020-09-08T15:59:01.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:01.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-372 td/osd-backfill-space/datafile 2020-09-08T15:59:02.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:02.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-373 td/osd-backfill-space/datafile 2020-09-08T15:59:02.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:02.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-374 td/osd-backfill-space/datafile 2020-09-08T15:59:02.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:02.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-375 td/osd-backfill-space/datafile 2020-09-08T15:59:02.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:02.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-376 td/osd-backfill-space/datafile 2020-09-08T15:59:02.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:02.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-377 td/osd-backfill-space/datafile 2020-09-08T15:59:02.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:02.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-378 td/osd-backfill-space/datafile 2020-09-08T15:59:02.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:02.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-379 td/osd-backfill-space/datafile 2020-09-08T15:59:02.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:03.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-380 td/osd-backfill-space/datafile 2020-09-08T15:59:03.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:03.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-381 td/osd-backfill-space/datafile 2020-09-08T15:59:03.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:03.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-382 td/osd-backfill-space/datafile 2020-09-08T15:59:03.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:03.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-383 td/osd-backfill-space/datafile 2020-09-08T15:59:03.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:03.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-384 td/osd-backfill-space/datafile 2020-09-08T15:59:03.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:03.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-385 td/osd-backfill-space/datafile 2020-09-08T15:59:03.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:03.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-386 td/osd-backfill-space/datafile 2020-09-08T15:59:03.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:03.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-387 td/osd-backfill-space/datafile 2020-09-08T15:59:04.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:04.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-388 td/osd-backfill-space/datafile 2020-09-08T15:59:04.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:04.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-389 td/osd-backfill-space/datafile 2020-09-08T15:59:04.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:04.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-390 td/osd-backfill-space/datafile 2020-09-08T15:59:04.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:04.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-391 td/osd-backfill-space/datafile 2020-09-08T15:59:04.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:04.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-392 td/osd-backfill-space/datafile 2020-09-08T15:59:04.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:04.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-393 td/osd-backfill-space/datafile 2020-09-08T15:59:04.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:04.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-394 td/osd-backfill-space/datafile 2020-09-08T15:59:04.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:04.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-395 td/osd-backfill-space/datafile 2020-09-08T15:59:05.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:05.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-396 td/osd-backfill-space/datafile 2020-09-08T15:59:05.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:05.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-397 td/osd-backfill-space/datafile 2020-09-08T15:59:05.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:05.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-398 td/osd-backfill-space/datafile 2020-09-08T15:59:05.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:05.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-399 td/osd-backfill-space/datafile 2020-09-08T15:59:05.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:05.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-400 td/osd-backfill-space/datafile 2020-09-08T15:59:05.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:05.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-401 td/osd-backfill-space/datafile 2020-09-08T15:59:05.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:05.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-402 td/osd-backfill-space/datafile 2020-09-08T15:59:06.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:06.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-403 td/osd-backfill-space/datafile 2020-09-08T15:59:06.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:06.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-404 td/osd-backfill-space/datafile 2020-09-08T15:59:06.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:06.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-405 td/osd-backfill-space/datafile 2020-09-08T15:59:06.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:06.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-406 td/osd-backfill-space/datafile 2020-09-08T15:59:06.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:06.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-407 td/osd-backfill-space/datafile 2020-09-08T15:59:06.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:06.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-408 td/osd-backfill-space/datafile 2020-09-08T15:59:06.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:06.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-409 td/osd-backfill-space/datafile 2020-09-08T15:59:06.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:06.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-410 td/osd-backfill-space/datafile 2020-09-08T15:59:07.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:07.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-411 td/osd-backfill-space/datafile 2020-09-08T15:59:07.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:07.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-412 td/osd-backfill-space/datafile 2020-09-08T15:59:07.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:07.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-413 td/osd-backfill-space/datafile 2020-09-08T15:59:07.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:07.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-414 td/osd-backfill-space/datafile 2020-09-08T15:59:07.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:07.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-415 td/osd-backfill-space/datafile 2020-09-08T15:59:07.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:07.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-416 td/osd-backfill-space/datafile 2020-09-08T15:59:07.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:07.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-417 td/osd-backfill-space/datafile 2020-09-08T15:59:07.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:07.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-418 td/osd-backfill-space/datafile 2020-09-08T15:59:08.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:08.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-419 td/osd-backfill-space/datafile 2020-09-08T15:59:08.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:08.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-420 td/osd-backfill-space/datafile 2020-09-08T15:59:08.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:08.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-421 td/osd-backfill-space/datafile 2020-09-08T15:59:08.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:08.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-422 td/osd-backfill-space/datafile 2020-09-08T15:59:08.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:08.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-423 td/osd-backfill-space/datafile 2020-09-08T15:59:08.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:08.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-424 td/osd-backfill-space/datafile 2020-09-08T15:59:08.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:08.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-425 td/osd-backfill-space/datafile 2020-09-08T15:59:09.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:09.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-426 td/osd-backfill-space/datafile 2020-09-08T15:59:09.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:09.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-427 td/osd-backfill-space/datafile 2020-09-08T15:59:09.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:09.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-428 td/osd-backfill-space/datafile 2020-09-08T15:59:09.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:09.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-429 td/osd-backfill-space/datafile 2020-09-08T15:59:09.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:09.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-430 td/osd-backfill-space/datafile 2020-09-08T15:59:09.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:09.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-431 td/osd-backfill-space/datafile 2020-09-08T15:59:09.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:09.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-432 td/osd-backfill-space/datafile 2020-09-08T15:59:09.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:09.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-433 td/osd-backfill-space/datafile 2020-09-08T15:59:10.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:10.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-434 td/osd-backfill-space/datafile 2020-09-08T15:59:10.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:10.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-435 td/osd-backfill-space/datafile 2020-09-08T15:59:10.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:10.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-436 td/osd-backfill-space/datafile 2020-09-08T15:59:10.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:10.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-437 td/osd-backfill-space/datafile 2020-09-08T15:59:10.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:10.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-438 td/osd-backfill-space/datafile 2020-09-08T15:59:10.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:10.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-439 td/osd-backfill-space/datafile 2020-09-08T15:59:10.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:10.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-440 td/osd-backfill-space/datafile 2020-09-08T15:59:11.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:11.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-441 td/osd-backfill-space/datafile 2020-09-08T15:59:11.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:11.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-442 td/osd-backfill-space/datafile 2020-09-08T15:59:11.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:11.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-443 td/osd-backfill-space/datafile 2020-09-08T15:59:11.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:11.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-444 td/osd-backfill-space/datafile 2020-09-08T15:59:11.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:11.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-445 td/osd-backfill-space/datafile 2020-09-08T15:59:11.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:11.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-446 td/osd-backfill-space/datafile 2020-09-08T15:59:11.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:11.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-447 td/osd-backfill-space/datafile 2020-09-08T15:59:11.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:11.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-448 td/osd-backfill-space/datafile 2020-09-08T15:59:12.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:12.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-449 td/osd-backfill-space/datafile 2020-09-08T15:59:12.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:12.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-450 td/osd-backfill-space/datafile 2020-09-08T15:59:12.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:12.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-451 td/osd-backfill-space/datafile 2020-09-08T15:59:12.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:12.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-452 td/osd-backfill-space/datafile 2020-09-08T15:59:12.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:12.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-453 td/osd-backfill-space/datafile 2020-09-08T15:59:12.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:12.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-454 td/osd-backfill-space/datafile 2020-09-08T15:59:12.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:12.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-455 td/osd-backfill-space/datafile 2020-09-08T15:59:12.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:12.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-456 td/osd-backfill-space/datafile 2020-09-08T15:59:13.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:13.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-457 td/osd-backfill-space/datafile 2020-09-08T15:59:13.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:13.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-458 td/osd-backfill-space/datafile 2020-09-08T15:59:13.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:13.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-459 td/osd-backfill-space/datafile 2020-09-08T15:59:13.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:13.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-460 td/osd-backfill-space/datafile 2020-09-08T15:59:13.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:13.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-461 td/osd-backfill-space/datafile 2020-09-08T15:59:13.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:13.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-462 td/osd-backfill-space/datafile 2020-09-08T15:59:13.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:13.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-463 td/osd-backfill-space/datafile 2020-09-08T15:59:14.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:14.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-464 td/osd-backfill-space/datafile 2020-09-08T15:59:14.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:14.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-465 td/osd-backfill-space/datafile 2020-09-08T15:59:14.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:14.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-466 td/osd-backfill-space/datafile 2020-09-08T15:59:14.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:14.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-467 td/osd-backfill-space/datafile 2020-09-08T15:59:14.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:14.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-468 td/osd-backfill-space/datafile 2020-09-08T15:59:14.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:14.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-469 td/osd-backfill-space/datafile 2020-09-08T15:59:14.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:14.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-470 td/osd-backfill-space/datafile 2020-09-08T15:59:14.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:14.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-471 td/osd-backfill-space/datafile 2020-09-08T15:59:15.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:15.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-472 td/osd-backfill-space/datafile 2020-09-08T15:59:15.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:15.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-473 td/osd-backfill-space/datafile 2020-09-08T15:59:15.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:15.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-474 td/osd-backfill-space/datafile 2020-09-08T15:59:15.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:15.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-475 td/osd-backfill-space/datafile 2020-09-08T15:59:15.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:15.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-476 td/osd-backfill-space/datafile 2020-09-08T15:59:16.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:16.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-477 td/osd-backfill-space/datafile 2020-09-08T15:59:16.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:16.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-478 td/osd-backfill-space/datafile 2020-09-08T15:59:16.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:16.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-479 td/osd-backfill-space/datafile 2020-09-08T15:59:16.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:16.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-480 td/osd-backfill-space/datafile 2020-09-08T15:59:16.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:16.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-481 td/osd-backfill-space/datafile 2020-09-08T15:59:16.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:16.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-482 td/osd-backfill-space/datafile 2020-09-08T15:59:16.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:16.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-483 td/osd-backfill-space/datafile 2020-09-08T15:59:17.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:17.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-484 td/osd-backfill-space/datafile 2020-09-08T15:59:17.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:17.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-485 td/osd-backfill-space/datafile 2020-09-08T15:59:17.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:17.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-486 td/osd-backfill-space/datafile 2020-09-08T15:59:17.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:17.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-487 td/osd-backfill-space/datafile 2020-09-08T15:59:17.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:17.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-488 td/osd-backfill-space/datafile 2020-09-08T15:59:17.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:17.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-489 td/osd-backfill-space/datafile 2020-09-08T15:59:17.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:17.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-490 td/osd-backfill-space/datafile 2020-09-08T15:59:17.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:17.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-491 td/osd-backfill-space/datafile 2020-09-08T15:59:18.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:18.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-492 td/osd-backfill-space/datafile 2020-09-08T15:59:18.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:18.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-493 td/osd-backfill-space/datafile 2020-09-08T15:59:18.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:18.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-494 td/osd-backfill-space/datafile 2020-09-08T15:59:18.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:18.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-495 td/osd-backfill-space/datafile 2020-09-08T15:59:18.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:18.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-496 td/osd-backfill-space/datafile 2020-09-08T15:59:18.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:18.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-497 td/osd-backfill-space/datafile 2020-09-08T15:59:18.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:18.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-498 td/osd-backfill-space/datafile 2020-09-08T15:59:19.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:19.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-499 td/osd-backfill-space/datafile 2020-09-08T15:59:19.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:19.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-500 td/osd-backfill-space/datafile 2020-09-08T15:59:19.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:19.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-501 td/osd-backfill-space/datafile 2020-09-08T15:59:19.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:19.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-502 td/osd-backfill-space/datafile 2020-09-08T15:59:19.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:19.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-503 td/osd-backfill-space/datafile 2020-09-08T15:59:19.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:19.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-504 td/osd-backfill-space/datafile 2020-09-08T15:59:19.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:19.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-505 td/osd-backfill-space/datafile 2020-09-08T15:59:19.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:19.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-506 td/osd-backfill-space/datafile 2020-09-08T15:59:20.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:20.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-507 td/osd-backfill-space/datafile 2020-09-08T15:59:20.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:20.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-508 td/osd-backfill-space/datafile 2020-09-08T15:59:20.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:20.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-509 td/osd-backfill-space/datafile 2020-09-08T15:59:20.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:20.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-510 td/osd-backfill-space/datafile 2020-09-08T15:59:20.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:20.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-511 td/osd-backfill-space/datafile 2020-09-08T15:59:20.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:20.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-512 td/osd-backfill-space/datafile 2020-09-08T15:59:20.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:20.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-513 td/osd-backfill-space/datafile 2020-09-08T15:59:21.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:21.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-514 td/osd-backfill-space/datafile 2020-09-08T15:59:21.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:21.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-515 td/osd-backfill-space/datafile 2020-09-08T15:59:21.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:21.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-516 td/osd-backfill-space/datafile 2020-09-08T15:59:21.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:21.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-517 td/osd-backfill-space/datafile 2020-09-08T15:59:21.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:21.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-518 td/osd-backfill-space/datafile 2020-09-08T15:59:21.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:21.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-519 td/osd-backfill-space/datafile 2020-09-08T15:59:21.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:21.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-520 td/osd-backfill-space/datafile 2020-09-08T15:59:21.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:21.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-521 td/osd-backfill-space/datafile 2020-09-08T15:59:22.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:22.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-522 td/osd-backfill-space/datafile 2020-09-08T15:59:22.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:22.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-523 td/osd-backfill-space/datafile 2020-09-08T15:59:22.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:22.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-524 td/osd-backfill-space/datafile 2020-09-08T15:59:22.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:22.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-525 td/osd-backfill-space/datafile 2020-09-08T15:59:22.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:22.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-526 td/osd-backfill-space/datafile 2020-09-08T15:59:22.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:22.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-527 td/osd-backfill-space/datafile 2020-09-08T15:59:22.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:22.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-528 td/osd-backfill-space/datafile 2020-09-08T15:59:22.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:22.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-529 td/osd-backfill-space/datafile 2020-09-08T15:59:23.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:23.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-530 td/osd-backfill-space/datafile 2020-09-08T15:59:23.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:23.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-531 td/osd-backfill-space/datafile 2020-09-08T15:59:23.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:23.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-532 td/osd-backfill-space/datafile 2020-09-08T15:59:23.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:23.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-533 td/osd-backfill-space/datafile 2020-09-08T15:59:23.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:23.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-534 td/osd-backfill-space/datafile 2020-09-08T15:59:23.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:23.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-535 td/osd-backfill-space/datafile 2020-09-08T15:59:23.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:23.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-536 td/osd-backfill-space/datafile 2020-09-08T15:59:24.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:24.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-537 td/osd-backfill-space/datafile 2020-09-08T15:59:24.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:24.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-538 td/osd-backfill-space/datafile 2020-09-08T15:59:24.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:24.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-539 td/osd-backfill-space/datafile 2020-09-08T15:59:24.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:24.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-540 td/osd-backfill-space/datafile 2020-09-08T15:59:24.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:24.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-541 td/osd-backfill-space/datafile 2020-09-08T15:59:24.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:24.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-542 td/osd-backfill-space/datafile 2020-09-08T15:59:24.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:24.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-543 td/osd-backfill-space/datafile 2020-09-08T15:59:24.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:24.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-544 td/osd-backfill-space/datafile 2020-09-08T15:59:25.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:25.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-545 td/osd-backfill-space/datafile 2020-09-08T15:59:25.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:25.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-546 td/osd-backfill-space/datafile 2020-09-08T15:59:25.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:25.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-547 td/osd-backfill-space/datafile 2020-09-08T15:59:25.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:25.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-548 td/osd-backfill-space/datafile 2020-09-08T15:59:25.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:25.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-549 td/osd-backfill-space/datafile 2020-09-08T15:59:25.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:25.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-550 td/osd-backfill-space/datafile 2020-09-08T15:59:25.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:25.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-551 td/osd-backfill-space/datafile 2020-09-08T15:59:25.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:25.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-552 td/osd-backfill-space/datafile 2020-09-08T15:59:26.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:26.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-553 td/osd-backfill-space/datafile 2020-09-08T15:59:26.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:26.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-554 td/osd-backfill-space/datafile 2020-09-08T15:59:26.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:26.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-555 td/osd-backfill-space/datafile 2020-09-08T15:59:26.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:26.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-556 td/osd-backfill-space/datafile 2020-09-08T15:59:26.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:26.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-557 td/osd-backfill-space/datafile 2020-09-08T15:59:26.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:26.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-558 td/osd-backfill-space/datafile 2020-09-08T15:59:26.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:26.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-559 td/osd-backfill-space/datafile 2020-09-08T15:59:26.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:26.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-560 td/osd-backfill-space/datafile 2020-09-08T15:59:27.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:27.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-561 td/osd-backfill-space/datafile 2020-09-08T15:59:27.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:27.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-562 td/osd-backfill-space/datafile 2020-09-08T15:59:27.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:27.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-563 td/osd-backfill-space/datafile 2020-09-08T15:59:27.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:27.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-564 td/osd-backfill-space/datafile 2020-09-08T15:59:27.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:27.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-565 td/osd-backfill-space/datafile 2020-09-08T15:59:27.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:27.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-566 td/osd-backfill-space/datafile 2020-09-08T15:59:27.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:27.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-567 td/osd-backfill-space/datafile 2020-09-08T15:59:28.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:28.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-568 td/osd-backfill-space/datafile 2020-09-08T15:59:28.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:28.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-569 td/osd-backfill-space/datafile 2020-09-08T15:59:28.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:28.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-570 td/osd-backfill-space/datafile 2020-09-08T15:59:28.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:28.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-571 td/osd-backfill-space/datafile 2020-09-08T15:59:28.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:28.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-572 td/osd-backfill-space/datafile 2020-09-08T15:59:28.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:28.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-573 td/osd-backfill-space/datafile 2020-09-08T15:59:28.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:28.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-574 td/osd-backfill-space/datafile 2020-09-08T15:59:28.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:28.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-575 td/osd-backfill-space/datafile 2020-09-08T15:59:29.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:29.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-576 td/osd-backfill-space/datafile 2020-09-08T15:59:29.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:29.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-577 td/osd-backfill-space/datafile 2020-09-08T15:59:29.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:29.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-578 td/osd-backfill-space/datafile 2020-09-08T15:59:29.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:29.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-579 td/osd-backfill-space/datafile 2020-09-08T15:59:29.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:29.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-580 td/osd-backfill-space/datafile 2020-09-08T15:59:29.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:29.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-581 td/osd-backfill-space/datafile 2020-09-08T15:59:29.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:29.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-582 td/osd-backfill-space/datafile 2020-09-08T15:59:30.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:30.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-583 td/osd-backfill-space/datafile 2020-09-08T15:59:30.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:30.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-584 td/osd-backfill-space/datafile 2020-09-08T15:59:30.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:30.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-585 td/osd-backfill-space/datafile 2020-09-08T15:59:30.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:30.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-586 td/osd-backfill-space/datafile 2020-09-08T15:59:30.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:30.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-587 td/osd-backfill-space/datafile 2020-09-08T15:59:30.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:30.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-588 td/osd-backfill-space/datafile 2020-09-08T15:59:30.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:30.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-589 td/osd-backfill-space/datafile 2020-09-08T15:59:30.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:30.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-590 td/osd-backfill-space/datafile 2020-09-08T15:59:31.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:31.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-591 td/osd-backfill-space/datafile 2020-09-08T15:59:31.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:31.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-592 td/osd-backfill-space/datafile 2020-09-08T15:59:31.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:31.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-593 td/osd-backfill-space/datafile 2020-09-08T15:59:31.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:31.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-594 td/osd-backfill-space/datafile 2020-09-08T15:59:31.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:31.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-595 td/osd-backfill-space/datafile 2020-09-08T15:59:31.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:31.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-596 td/osd-backfill-space/datafile 2020-09-08T15:59:31.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:31.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-597 td/osd-backfill-space/datafile 2020-09-08T15:59:32.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:32.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-598 td/osd-backfill-space/datafile 2020-09-08T15:59:32.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:32.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-599 td/osd-backfill-space/datafile 2020-09-08T15:59:32.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:482: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T15:59:32.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:484: TEST_backfill_multi_partial: rados -p test1 put obj-1-600 td/osd-backfill-space/datafile 2020-09-08T15:59:32.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:487: TEST_backfill_multi_partial: ceph pg dump pgs 2020-09-08T15:59:32.773 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T15:59:32.773 INFO:tasks.workunit.client.0.smithi065.stdout:3.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:58:08.494018+0000 0'0 40:31 [2,0] 2 [2,0] 2 0'0 2020-09-08T15:57:10.462737+0000 0'0 2020-09-08T15:57:10.462737+0000 0 2020-09-08T15:59:32.773 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 573 0 0 0 0 1496103 0 0 73 73 stale+active+clean 2020-09-08T15:57:07.252587+0000 36'573 36:603 [1] 1 [1] 1 0'0 2020-09-08T15:57:05.166131+0000 0'0 2020-09-08T15:57:05.166131+0000 0 2020-09-08T15:59:32.774 INFO:tasks.workunit.client.0.smithi065.stdout:2.0 562 0 0 0 0 575488 0 0 62 62 active+clean 2020-09-08T15:58:08.494186+0000 41'562 41:605 [2,0] 2 [2,0] 2 0'0 2020-09-08T15:57:07.796898+0000 0'0 2020-09-08T15:57:07.796898+0000 0 2020-09-08T15:59:32.774 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T15:59:32.774 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T15:59:32.775 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T15:59:32.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:489: TEST_backfill_multi_partial: _objectstore_tool_nowait td/osd-backfill-space 2 --op export --pgid 2.0 --file td/osd-backfill-space/export.out 2020-09-08T15:59:32.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1207: _objectstore_tool_nowait: local dir=td/osd-backfill-space 2020-09-08T15:59:32.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1208: _objectstore_tool_nowait: shift 2020-09-08T15:59:32.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1209: _objectstore_tool_nowait: local id=2 2020-09-08T15:59:32.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1210: _objectstore_tool_nowait: shift 2020-09-08T15:59:32.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1212: _objectstore_tool_nowait: kill_daemons td/osd-backfill-space TERM osd.2 2020-09-08T15:59:32.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T15:59:32.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T15:59:32.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T15:59:32.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T15:59:32.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T15:59:32.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T15:59:32.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1214: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-backfill-space 2 --op export --pgid 2.0 --file td/osd-backfill-space/export.out 2020-09-08T15:59:32.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local dir=td/osd-backfill-space 2020-09-08T15:59:32.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2020-09-08T15:59:32.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local id=2 2020-09-08T15:59:32.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1198: _objectstore_tool_nodown: shift 2020-09-08T15:59:32.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: _objectstore_tool_nodown: local osd_data=td/osd-backfill-space/2 2020-09-08T15:59:32.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1202: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-space/2 --op export --pgid 2.0 --file td/osd-backfill-space/export.out 2020-09-08T15:59:34.641 INFO:tasks.workunit.client.0.smithi065.stderr:Exporting 2.0 info 2.0( v 41'600 (41'500,41'600] local-lis/les=39/40 n=600 ec=26/26 lis/c=39/39 les/c/f=40/40/0 sis=39) 2020-09-08T15:59:34.648 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:00f101c6:::obj-1-121:head# 2020-09-08T15:59:34.649 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:0168051e:::obj-1-571:head# 2020-09-08T15:59:34.649 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:01b67738:::obj-1-182:head# 2020-09-08T15:59:34.650 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:040dbc59:::obj-1-23:head# 2020-09-08T15:59:34.656 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:0415ce6e:::obj-1-20:head# 2020-09-08T15:59:34.664 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:058b28d7:::obj-1-572:head# 2020-09-08T15:59:34.664 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:059d2e5c:::obj-1-87:head# 2020-09-08T15:59:34.665 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:05a823ca:::obj-1-52:head# 2020-09-08T15:59:34.665 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:05b8b7fe:::obj-1-119:head# 2020-09-08T15:59:34.666 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:05c9492b:::obj-1-78:head# 2020-09-08T15:59:34.667 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:05e91e96:::obj-1-393:head# 2020-09-08T15:59:34.667 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:07bdb780:::obj-1-204:head# 2020-09-08T15:59:34.668 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:07cfbd49:::obj-1-318:head# 2020-09-08T15:59:34.668 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:084a829f:::obj-1-112:head# 2020-09-08T15:59:34.669 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:08cedd34:::obj-1-438:head# 2020-09-08T15:59:34.669 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:0941af69:::obj-1-117:head# 2020-09-08T15:59:34.670 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:09607265:::obj-1-429:head# 2020-09-08T15:59:34.670 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:0be86f7e:::obj-1-568:head# 2020-09-08T15:59:34.671 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:0ca5819d:::obj-1-327:head# 2020-09-08T15:59:34.671 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:0cd02051:::obj-1-208:head# 2020-09-08T15:59:34.673 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:0d0264b5:::obj-1-171:head# 2020-09-08T15:59:34.674 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:0d195060:::obj-1-420:head# 2020-09-08T15:59:34.674 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:0d362b19:::obj-1-219:head# 2020-09-08T15:59:34.675 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:0dea6f4d:::obj-1-61:head# 2020-09-08T15:59:34.675 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:0ecd8390:::obj-1-132:head# 2020-09-08T15:59:34.676 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:0f49e2fa:::obj-1-200:head# 2020-09-08T15:59:34.676 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:0f7bb95f:::obj-1-268:head# 2020-09-08T15:59:34.677 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:0fabf252:::obj-1-441:head# 2020-09-08T15:59:34.678 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:0fb1697a:::obj-1-443:head# 2020-09-08T15:59:34.678 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:105d3efe:::obj-1-490:head# 2020-09-08T15:59:34.678 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:10f52c01:::obj-1-449:head# 2020-09-08T15:59:34.679 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:11965425:::obj-1-335:head# 2020-09-08T15:59:34.680 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:11c9f5f8:::obj-1-565:head# 2020-09-08T15:59:34.680 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:11cfcfb6:::obj-1-588:head# 2020-09-08T15:59:34.680 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:11d46f0a:::obj-1-387:head# 2020-09-08T15:59:34.681 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:11ebb0d6:::obj-1-214:head# 2020-09-08T15:59:34.681 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1295e402:::obj-1-178:head# 2020-09-08T15:59:34.682 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:12c996c1:::obj-1-517:head# 2020-09-08T15:59:34.682 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:133dec15:::obj-1-475:head# 2020-09-08T15:59:34.682 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1475c981:::obj-1-505:head# 2020-09-08T15:59:34.683 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:148e92a4:::obj-1-509:head# 2020-09-08T15:59:34.684 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1490b121:::obj-1-172:head# 2020-09-08T15:59:34.684 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:14ce082c:::obj-1-99:head# 2020-09-08T15:59:34.685 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1552ad99:::obj-1-41:head# 2020-09-08T15:59:34.685 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:15544270:::obj-1-271:head# 2020-09-08T15:59:34.685 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1589d957:::obj-1-86:head# 2020-09-08T15:59:34.686 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:16db3947:::obj-1-477:head# 2020-09-08T15:59:34.687 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:16dc98bd:::obj-1-375:head# 2020-09-08T15:59:34.687 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:17e54db3:::obj-1-196:head# 2020-09-08T15:59:34.687 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:17f2ad3f:::obj-1-10:head# 2020-09-08T15:59:34.687 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:18075e41:::obj-1-55:head# 2020-09-08T15:59:34.687 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:18086253:::obj-1-71:head# 2020-09-08T15:59:34.688 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:191cf8d8:::obj-1-372:head# 2020-09-08T15:59:34.689 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:19311f70:::obj-1-454:head# 2020-09-08T15:59:34.689 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:198318e4:::obj-1-464:head# 2020-09-08T15:59:34.689 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1999d806:::obj-1-163:head# 2020-09-08T15:59:34.689 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1a92cab7:::obj-1-412:head# 2020-09-08T15:59:34.690 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1b16c0f6:::obj-1-210:head# 2020-09-08T15:59:34.690 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1b53ed46:::obj-1-577:head# 2020-09-08T15:59:34.691 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1b5c5a8d:::obj-1-556:head# 2020-09-08T15:59:34.691 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1c12c05e:::obj-1-79:head# 2020-09-08T15:59:34.691 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1c571ba5:::obj-1-262:head# 2020-09-08T15:59:34.693 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1c5f42b7:::obj-1-92:head# 2020-09-08T15:59:34.694 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1c6ad881:::obj-1-312:head# 2020-09-08T15:59:34.695 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1c89877b:::obj-1-142:head# 2020-09-08T15:59:34.695 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1e4168ca:::obj-1-282:head# 2020-09-08T15:59:34.695 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1e424445:::obj-1-484:head# 2020-09-08T15:59:34.696 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1e467959:::obj-1-22:head# 2020-09-08T15:59:34.697 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1eaf7e7c:::obj-1-392:head# 2020-09-08T15:59:34.698 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1f06c86d:::obj-1-307:head# 2020-09-08T15:59:34.698 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1f2ee1f8:::obj-1-306:head# 2020-09-08T15:59:34.699 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:1f4ef040:::obj-1-349:head# 2020-09-08T15:59:34.699 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:2039481f:::obj-1-545:head# 2020-09-08T15:59:34.700 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:22233df0:::obj-1-543:head# 2020-09-08T15:59:34.700 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:2225184e:::obj-1-266:head# 2020-09-08T15:59:34.701 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:234766bb:::obj-1-281:head# 2020-09-08T15:59:34.701 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:2372e022:::obj-1-205:head# 2020-09-08T15:59:34.702 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:2379547b:::obj-1-113:head# 2020-09-08T15:59:34.710 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:23ae14bf:::obj-1-531:head# 2020-09-08T15:59:34.710 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:23bc5f90:::obj-1-452:head# 2020-09-08T15:59:34.711 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:23fbef3d:::obj-1-82:head# 2020-09-08T15:59:34.711 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:24106c2b:::obj-1-232:head# 2020-09-08T15:59:34.712 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:2529b4e4:::obj-1-75:head# 2020-09-08T15:59:34.713 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:25a24ae7:::obj-1-459:head# 2020-09-08T15:59:34.713 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:26627aa9:::obj-1-7:head# 2020-09-08T15:59:34.714 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:26b77221:::obj-1-227:head# 2020-09-08T15:59:34.715 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:27450826:::obj-1-344:head# 2020-09-08T15:59:34.715 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:278905af:::obj-1-592:head# 2020-09-08T15:59:34.716 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:27ad0d2d:::obj-1-136:head# 2020-09-08T15:59:34.716 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:28a8c213:::obj-1-118:head# 2020-09-08T15:59:34.717 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:28c0c009:::obj-1-74:head# 2020-09-08T15:59:34.717 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:2a214708:::obj-1-260:head# 2020-09-08T15:59:34.718 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:2a67e195:::obj-1-474:head# 2020-09-08T15:59:34.718 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:2aa852ff:::obj-1-5:head# 2020-09-08T15:59:34.719 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:2ba1fb52:::obj-1-563:head# 2020-09-08T15:59:34.719 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:2bae8cb9:::obj-1-320:head# 2020-09-08T15:59:34.719 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:2c569d02:::obj-1-139:head# 2020-09-08T15:59:34.720 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:2c71d691:::obj-1-201:head# 2020-09-08T15:59:34.722 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:2c88e92c:::obj-1-389:head# 2020-09-08T15:59:34.723 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:2d659109:::obj-1-580:head# 2020-09-08T15:59:34.724 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:2d74ea60:::obj-1-230:head# 2020-09-08T15:59:34.724 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:2de96edf:::obj-1-233:head# 2020-09-08T15:59:34.725 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:2e43da40:::obj-1-382:head# 2020-09-08T15:59:34.725 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:2e530c9f:::obj-1-358:head# 2020-09-08T15:59:34.726 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:2ed02239:::obj-1-81:head# 2020-09-08T15:59:34.726 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:30264a0c:::obj-1-373:head# 2020-09-08T15:59:34.727 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:302ca5e7:::obj-1-206:head# 2020-09-08T15:59:34.727 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:309878e8:::obj-1-508:head# 2020-09-08T15:59:34.727 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:309a0ac3:::obj-1-188:head# 2020-09-08T15:59:34.728 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:30f030e9:::obj-1-53:head# 2020-09-08T15:59:34.728 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:31242a73:::obj-1-528:head# 2020-09-08T15:59:34.729 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:31463825:::obj-1-34:head# 2020-09-08T15:59:34.730 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3166dc86:::obj-1-355:head# 2020-09-08T15:59:34.730 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:31baa2fa:::obj-1-252:head# 2020-09-08T15:59:34.730 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:31d8935e:::obj-1-193:head# 2020-09-08T15:59:34.730 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:32670b14:::obj-1-305:head# 2020-09-08T15:59:34.731 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:33da02fa:::obj-1-114:head# 2020-09-08T15:59:34.731 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:34373133:::obj-1-446:head# 2020-09-08T15:59:34.732 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:347b7083:::obj-1-89:head# 2020-09-08T15:59:34.732 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:349125c1:::obj-1-148:head# 2020-09-08T15:59:34.733 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:34b80eee:::obj-1-138:head# 2020-09-08T15:59:34.734 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:34db48f8:::obj-1-49:head# 2020-09-08T15:59:34.734 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3669ff0c:::obj-1-313:head# 2020-09-08T15:59:34.734 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:36c1b610:::obj-1-249:head# 2020-09-08T15:59:34.734 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:374c250b:::obj-1-324:head# 2020-09-08T15:59:34.735 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3761a149:::obj-1-342:head# 2020-09-08T15:59:34.736 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:379ff95a:::obj-1-341:head# 2020-09-08T15:59:34.736 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:37dc15a6:::obj-1-26:head# 2020-09-08T15:59:34.737 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:38130e33:::obj-1-552:head# 2020-09-08T15:59:34.737 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:39c44880:::obj-1-538:head# 2020-09-08T15:59:34.737 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3a08dec9:::obj-1-368:head# 2020-09-08T15:59:34.737 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3a2b46a6:::obj-1-407:head# 2020-09-08T15:59:34.737 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3a7dfe0a:::obj-1-285:head# 2020-09-08T15:59:34.743 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3aebb144:::obj-1-248:head# 2020-09-08T15:59:34.744 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3b08b36f:::obj-1-310:head# 2020-09-08T15:59:34.745 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3b28ffa3:::obj-1-295:head# 2020-09-08T15:59:34.746 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3ba79bd1:::obj-1-444:head# 2020-09-08T15:59:34.765 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3c05df8d:::obj-1-319:head# 2020-09-08T15:59:34.766 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3c57e6a9:::obj-1-436:head# 2020-09-08T15:59:34.766 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3c73d8ee:::obj-1-298:head# 2020-09-08T15:59:34.766 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3cb6ae2a:::obj-1-400:head# 2020-09-08T15:59:34.766 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3cb71491:::obj-1-328:head# 2020-09-08T15:59:34.767 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3cb842fe:::obj-1-541:head# 2020-09-08T15:59:34.767 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3cf6835e:::obj-1-496:head# 2020-09-08T15:59:34.767 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3cf78507:::obj-1-573:head# 2020-09-08T15:59:34.767 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3d0dab84:::obj-1-554:head# 2020-09-08T15:59:34.767 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3d1a5f9d:::obj-1-323:head# 2020-09-08T15:59:34.767 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3da5f3a2:::obj-1-414:head# 2020-09-08T15:59:34.768 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3dbb65f0:::obj-1-440:head# 2020-09-08T15:59:34.768 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3dc94618:::obj-1-223:head# 2020-09-08T15:59:34.768 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3df3d5ab:::obj-1-25:head# 2020-09-08T15:59:34.769 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3e167988:::obj-1-336:head# 2020-09-08T15:59:34.769 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3e4ef3bd:::obj-1-104:head# 2020-09-08T15:59:34.769 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3e9e1efd:::obj-1-357:head# 2020-09-08T15:59:34.769 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3ebbe3a7:::obj-1-42:head# 2020-09-08T15:59:34.770 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3ec80373:::obj-1-403:head# 2020-09-08T15:59:34.770 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3ed086e4:::obj-1-13:head# 2020-09-08T15:59:34.770 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:3fe8e157:::obj-1-164:head# 2020-09-08T15:59:34.770 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:401ddfd4:::obj-1-379:head# 2020-09-08T15:59:34.770 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:4092f6cd:::obj-1-430:head# 2020-09-08T15:59:34.771 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:414bd7cc:::obj-1-562:head# 2020-09-08T15:59:34.772 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:422bd9d0:::obj-1-287:head# 2020-09-08T15:59:34.772 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:4255002d:::obj-1-578:head# 2020-09-08T15:59:34.772 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:4270725c:::obj-1-109:head# 2020-09-08T15:59:34.776 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:42836669:::obj-1-31:head# 2020-09-08T15:59:34.777 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:428d93ef:::obj-1-32:head# 2020-09-08T15:59:34.777 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:4327ef5b:::obj-1-453:head# 2020-09-08T15:59:34.778 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:440eb07b:::obj-1-236:head# 2020-09-08T15:59:34.779 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:442a028a:::obj-1-365:head# 2020-09-08T15:59:34.779 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:449ca54a:::obj-1-161:head# 2020-09-08T15:59:34.780 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:45128c3b:::obj-1-343:head# 2020-09-08T15:59:34.780 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:45801bf6:::obj-1-264:head# 2020-09-08T15:59:34.781 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:45896f61:::obj-1-48:head# 2020-09-08T15:59:34.782 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:459b7f1c:::obj-1-190:head# 2020-09-08T15:59:34.782 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:466af96a:::obj-1-486:head# 2020-09-08T15:59:34.783 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:47387ce4:::obj-1-575:head# 2020-09-08T15:59:34.783 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:47c94cc8:::obj-1-564:head# 2020-09-08T15:59:34.784 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:47d7f8ed:::obj-1-544:head# 2020-09-08T15:59:34.785 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:47fc0ec3:::obj-1-558:head# 2020-09-08T15:59:34.785 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:48ba42d8:::obj-1-156:head# 2020-09-08T15:59:34.786 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:494e269e:::obj-1-600:head# 2020-09-08T15:59:34.786 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:49646095:::obj-1-73:head# 2020-09-08T15:59:34.786 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:49eb65ab:::obj-1-374:head# 2020-09-08T15:59:34.787 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:4a0075a4:::obj-1-432:head# 2020-09-08T15:59:34.787 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:4af1ffc2:::obj-1-72:head# 2020-09-08T15:59:34.787 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:4bc1c46f:::obj-1-346:head# 2020-09-08T15:59:34.788 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:4bd55e68:::obj-1-93:head# 2020-09-08T15:59:34.788 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:4c6d2760:::obj-1-198:head# 2020-09-08T15:59:34.789 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:4cb9be3b:::obj-1-451:head# 2020-09-08T15:59:34.789 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:4d260a64:::obj-1-514:head# 2020-09-08T15:59:34.790 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:4d7d6284:::obj-1-583:head# 2020-09-08T15:59:34.790 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:4e79ac02:::obj-1-437:head# 2020-09-08T15:59:34.791 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:4e980099:::obj-1-507:head# 2020-09-08T15:59:34.792 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:4ea8f99c:::obj-1-211:head# 2020-09-08T15:59:34.792 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:4eabdc2a:::obj-1-590:head# 2020-09-08T15:59:34.793 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:4f97fd73:::obj-1-243:head# 2020-09-08T15:59:34.800 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:4fe00224:::obj-1-229:head# 2020-09-08T15:59:34.800 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:4fead9ab:::obj-1-476:head# 2020-09-08T15:59:34.801 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:4ffddfd7:::obj-1-462:head# 2020-09-08T15:59:34.801 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:5085c04d:::obj-1-100:head# 2020-09-08T15:59:34.802 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:50a8b465:::obj-1-574:head# 2020-09-08T15:59:34.802 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:518a151f:::obj-1-189:head# 2020-09-08T15:59:34.802 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:519afc95:::obj-1-314:head# 2020-09-08T15:59:34.803 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:52199781:::obj-1-202:head# 2020-09-08T15:59:34.804 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:52313062:::obj-1-337:head# 2020-09-08T15:59:34.804 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:526a5196:::obj-1-225:head# 2020-09-08T15:59:34.805 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:53128d32:::obj-1-483:head# 2020-09-08T15:59:34.805 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:53c2bb21:::obj-1-532:head# 2020-09-08T15:59:34.805 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:53fa4f3c:::obj-1-423:head# 2020-09-08T15:59:34.806 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:541c1d30:::obj-1-143:head# 2020-09-08T15:59:34.806 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:548d20c3:::obj-1-352:head# 2020-09-08T15:59:34.807 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:54e4c6f9:::obj-1-101:head# 2020-09-08T15:59:34.807 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:55016e06:::obj-1-276:head# 2020-09-08T15:59:34.808 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:5510c784:::obj-1-491:head# 2020-09-08T15:59:34.808 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:551275ef:::obj-1-239:head# 2020-09-08T15:59:34.809 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:556df001:::obj-1-46:head# 2020-09-08T15:59:34.810 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:558fb5b1:::obj-1-536:head# 2020-09-08T15:59:34.810 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:56390d98:::obj-1-64:head# 2020-09-08T15:59:34.811 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:564f962a:::obj-1-125:head# 2020-09-08T15:59:34.811 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:56936e94:::obj-1-251:head# 2020-09-08T15:59:34.811 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:57585d3d:::obj-1-294:head# 2020-09-08T15:59:34.812 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:5764cf7b:::obj-1-479:head# 2020-09-08T15:59:34.812 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:5782341a:::obj-1-218:head# 2020-09-08T15:59:34.813 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:57d07a1a:::obj-1-317:head# 2020-09-08T15:59:34.813 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:58700205:::obj-1-176:head# 2020-09-08T15:59:34.813 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:58aee718:::obj-1-434:head# 2020-09-08T15:59:34.814 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:594c9d52:::obj-1-458:head# 2020-09-08T15:59:34.814 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:5a70b555:::obj-1-279:head# 2020-09-08T15:59:34.814 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:5b02568b:::obj-1-586:head# 2020-09-08T15:59:34.815 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:5b69cdcf:::obj-1-391:head# 2020-09-08T15:59:34.815 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:5cf151b5:::obj-1-510:head# 2020-09-08T15:59:34.816 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:5d7fd07f:::obj-1-152:head# 2020-09-08T15:59:34.816 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:5de288d7:::obj-1-235:head# 2020-09-08T15:59:34.816 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:5ec497cd:::obj-1-44:head# 2020-09-08T15:59:34.818 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:5fb3a09f:::obj-1-518:head# 2020-09-08T15:59:34.818 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:5ff3c2ef:::obj-1-470:head# 2020-09-08T15:59:34.818 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:601efcb1:::obj-1-549:head# 2020-09-08T15:59:34.818 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:60831338:::obj-1-263:head# 2020-09-08T15:59:34.819 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:6092777b:::obj-1-145:head# 2020-09-08T15:59:34.819 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:60b17206:::obj-1-411:head# 2020-09-08T15:59:34.820 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:610c957c:::obj-1-278:head# 2020-09-08T15:59:34.820 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:613b5ef4:::obj-1-504:head# 2020-09-08T15:59:34.821 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:61ed7d60:::obj-1-274:head# 2020-09-08T15:59:34.821 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:621b6751:::obj-1-212:head# 2020-09-08T15:59:34.821 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:62b0aba9:::obj-1-253:head# 2020-09-08T15:59:34.823 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:64017240:::obj-1-102:head# 2020-09-08T15:59:34.823 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:645f4f49:::obj-1-332:head# 2020-09-08T15:59:34.823 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:65db82b9:::obj-1-334:head# 2020-09-08T15:59:34.823 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:667422e5:::obj-1-465:head# 2020-09-08T15:59:34.824 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:66c50bc2:::obj-1-322:head# 2020-09-08T15:59:34.825 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:681a4577:::obj-1-511:head# 2020-09-08T15:59:34.825 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:6874e007:::obj-1-398:head# 2020-09-08T15:59:34.826 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:693746c1:::obj-1-582:head# 2020-09-08T15:59:34.826 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:69638b0c:::obj-1-8:head# 2020-09-08T15:59:34.826 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:6967de6e:::obj-1-331:head# 2020-09-08T15:59:34.827 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:69da97aa:::obj-1-340:head# 2020-09-08T15:59:34.827 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:6b3a50a6:::obj-1-144:head# 2020-09-08T15:59:34.828 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:6be4ef26:::obj-1-579:head# 2020-09-08T15:59:34.828 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:6d735549:::obj-1-599:head# 2020-09-08T15:59:34.829 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:6e22c25e:::obj-1-9:head# 2020-09-08T15:59:34.829 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:6e2ced4e:::obj-1-370:head# 2020-09-08T15:59:34.829 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:6e961169:::obj-1-428:head# 2020-09-08T15:59:34.830 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:6efcbbee:::obj-1-168:head# 2020-09-08T15:59:34.830 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:6f20741c:::obj-1-33:head# 2020-09-08T15:59:34.831 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:6fe4c885:::obj-1-273:head# 2020-09-08T15:59:34.831 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:6fffdea2:::obj-1-425:head# 2020-09-08T15:59:34.831 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:70716852:::obj-1-593:head# 2020-09-08T15:59:34.832 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:70919606:::obj-1-515:head# 2020-09-08T15:59:34.832 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:70c39d76:::obj-1-467:head# 2020-09-08T15:59:34.833 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:70f57ad3:::obj-1-361:head# 2020-09-08T15:59:34.833 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:7177c7b5:::obj-1-503:head# 2020-09-08T15:59:34.834 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:719b69bd:::obj-1-497:head# 2020-09-08T15:59:34.834 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:724f9347:::obj-1-6:head# 2020-09-08T15:59:34.835 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:726d9f6b:::obj-1-111:head# 2020-09-08T15:59:34.835 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:72a91baf:::obj-1-439:head# 2020-09-08T15:59:34.836 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:72aa43ee:::obj-1-534:head# 2020-09-08T15:59:34.836 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:72c40e11:::obj-1-288:head# 2020-09-08T15:59:34.837 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:74196d45:::obj-1-246:head# 2020-09-08T15:59:34.837 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:743f42b1:::obj-1-326:head# 2020-09-08T15:59:34.838 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:7523b538:::obj-1-494:head# 2020-09-08T15:59:34.838 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:75310ed6:::obj-1-364:head# 2020-09-08T15:59:34.839 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:7568e0bc:::obj-1-585:head# 2020-09-08T15:59:34.839 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:760219a3:::obj-1-353:head# 2020-09-08T15:59:34.840 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:763338c9:::obj-1-555:head# 2020-09-08T15:59:34.840 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:77bc2d65:::obj-1-386:head# 2020-09-08T15:59:34.840 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:77ed0c7a:::obj-1-492:head# 2020-09-08T15:59:34.840 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:785a4052:::obj-1-456:head# 2020-09-08T15:59:34.841 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:796799c3:::obj-1-195:head# 2020-09-08T15:59:34.841 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:79caf0c1:::obj-1-445:head# 2020-09-08T15:59:34.842 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:7af5b3e4:::obj-1-217:head# 2020-09-08T15:59:34.842 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:7b3a9063:::obj-1-169:head# 2020-09-08T15:59:34.843 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:7b509a92:::obj-1-561:head# 2020-09-08T15:59:34.843 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:7bc646b1:::obj-1-415:head# 2020-09-08T15:59:34.844 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:7c2f9188:::obj-1-482:head# 2020-09-08T15:59:34.845 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:7d0da936:::obj-1-11:head# 2020-09-08T15:59:34.846 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:7d25ca2d:::obj-1-242:head# 2020-09-08T15:59:34.846 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:7d64f81e:::obj-1-473:head# 2020-09-08T15:59:34.846 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:7ef2ea1b:::obj-1-417:head# 2020-09-08T15:59:34.847 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:7f52b238:::obj-1-308:head# 2020-09-08T15:59:34.851 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:7f7a313c:::obj-1-551:head# 2020-09-08T15:59:34.851 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:806827a7:::obj-1-472:head# 2020-09-08T15:59:34.852 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:8112c3ab:::obj-1-45:head# 2020-09-08T15:59:34.853 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:81365b55:::obj-1-315:head# 2020-09-08T15:59:34.853 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:818ffdc3:::obj-1-345:head# 2020-09-08T15:59:34.854 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:81babab8:::obj-1-535:head# 2020-09-08T15:59:34.854 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:8288f652:::obj-1-347:head# 2020-09-08T15:59:34.855 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:8312eadd:::obj-1-14:head# 2020-09-08T15:59:34.864 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:83b89bc7:::obj-1-137:head# 2020-09-08T15:59:34.865 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:84a12321:::obj-1-134:head# 2020-09-08T15:59:34.865 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:84b26d62:::obj-1-408:head# 2020-09-08T15:59:34.866 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:84bbb26e:::obj-1-43:head# 2020-09-08T15:59:34.866 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:86fc0014:::obj-1-222:head# 2020-09-08T15:59:34.866 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:87488bf4:::obj-1-174:head# 2020-09-08T15:59:34.867 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:8754389a:::obj-1-65:head# 2020-09-08T15:59:34.867 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:87a6ad67:::obj-1-366:head# 2020-09-08T15:59:34.868 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:87d32b83:::obj-1-513:head# 2020-09-08T15:59:34.869 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:8813a346:::obj-1-540:head# 2020-09-08T15:59:34.869 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:88146951:::obj-1-216:head# 2020-09-08T15:59:34.870 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:8820800d:::obj-1-83:head# 2020-09-08T15:59:34.870 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:88319745:::obj-1-98:head# 2020-09-08T15:59:34.870 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:88c969b8:::obj-1-54:head# 2020-09-08T15:59:34.871 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:895a2d53:::obj-1-150:head# 2020-09-08T15:59:34.871 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:8ae006a0:::obj-1-241:head# 2020-09-08T15:59:34.872 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:8bd44e64:::obj-1-300:head# 2020-09-08T15:59:34.872 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:8beb257f:::obj-1-3:head# 2020-09-08T15:59:34.873 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:8cd8c743:::obj-1-527:head# 2020-09-08T15:59:34.874 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:8daa99c7:::obj-1-237:head# 2020-09-08T15:59:34.874 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:8f5bccbf:::obj-1-59:head# 2020-09-08T15:59:34.875 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:8f6d9945:::obj-1-151:head# 2020-09-08T15:59:34.875 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:8f7c568c:::obj-1-261:head# 2020-09-08T15:59:34.876 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:8fbc59a9:::obj-1-589:head# 2020-09-08T15:59:34.876 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:90225d94:::obj-1-194:head# 2020-09-08T15:59:34.877 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:904c50d3:::obj-1-63:head# 2020-09-08T15:59:34.877 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:90e1bd79:::obj-1-450:head# 2020-09-08T15:59:34.878 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9274b06d:::obj-1-460:head# 2020-09-08T15:59:34.878 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:92af41f5:::obj-1-409:head# 2020-09-08T15:59:34.879 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:935a08d6:::obj-1-192:head# 2020-09-08T15:59:34.880 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:935f8a13:::obj-1-24:head# 2020-09-08T15:59:34.880 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:95230148:::obj-1-280:head# 2020-09-08T15:59:34.881 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:95342eb0:::obj-1-390:head# 2020-09-08T15:59:34.881 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9659d09c:::obj-1-292:head# 2020-09-08T15:59:34.882 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:970e8cb4:::obj-1-18:head# 2020-09-08T15:59:34.889 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:97d21cf1:::obj-1-80:head# 2020-09-08T15:59:34.890 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:982bdb12:::obj-1-302:head# 2020-09-08T15:59:34.890 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:985dfd75:::obj-1-91:head# 2020-09-08T15:59:34.892 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:986d245a:::obj-1-154:head# 2020-09-08T15:59:34.893 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:98a03e99:::obj-1-529:head# 2020-09-08T15:59:34.893 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:98b7103e:::obj-1-275:head# 2020-09-08T15:59:34.894 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:990f0ecf:::obj-1-427:head# 2020-09-08T15:59:34.895 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:996c1f26:::obj-1-96:head# 2020-09-08T15:59:34.896 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:99bd2018:::obj-1-17:head# 2020-09-08T15:59:34.897 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9a7434c9:::obj-1-469:head# 2020-09-08T15:59:34.897 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9a8e36cc:::obj-1-598:head# 2020-09-08T15:59:34.897 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9abcc369:::obj-1-442:head# 2020-09-08T15:59:34.898 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9b0ea06e:::obj-1-231:head# 2020-09-08T15:59:34.898 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9b34e80d:::obj-1-378:head# 2020-09-08T15:59:34.899 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9b55a2a9:::obj-1-60:head# 2020-09-08T15:59:34.900 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9be3f2da:::obj-1-597:head# 2020-09-08T15:59:34.901 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9bf62c88:::obj-1-447:head# 2020-09-08T15:59:34.901 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9c31857b:::obj-1-272:head# 2020-09-08T15:59:34.902 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9c533e91:::obj-1-19:head# 2020-09-08T15:59:34.903 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9ca70688:::obj-1-570:head# 2020-09-08T15:59:34.903 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9ccce337:::obj-1-147:head# 2020-09-08T15:59:34.903 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9d4b2dfc:::obj-1-267:head# 2020-09-08T15:59:34.903 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9d4df969:::obj-1-286:head# 2020-09-08T15:59:34.904 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9d714651:::obj-1-495:head# 2020-09-08T15:59:34.904 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9da65518:::obj-1-498:head# 2020-09-08T15:59:34.905 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9e94f27b:::obj-1-209:head# 2020-09-08T15:59:34.905 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9f39e910:::obj-1-354:head# 2020-09-08T15:59:34.906 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9f8f9ef4:::obj-1-226:head# 2020-09-08T15:59:34.906 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:9fcd3f36:::obj-1-47:head# 2020-09-08T15:59:34.907 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a0326d7d:::obj-1-338:head# 2020-09-08T15:59:34.907 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a05e7475:::obj-1-62:head# 2020-09-08T15:59:34.908 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a0955052:::obj-1-533:head# 2020-09-08T15:59:34.908 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a0aa6848:::obj-1-38:head# 2020-09-08T15:59:34.909 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a0fdc285:::obj-1-133:head# 2020-09-08T15:59:34.909 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a10290b8:::obj-1-245:head# 2020-09-08T15:59:34.916 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a118a8a8:::obj-1-500:head# 2020-09-08T15:59:34.917 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a11a4079:::obj-1-199:head# 2020-09-08T15:59:34.918 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a1b3ec36:::obj-1-15:head# 2020-09-08T15:59:34.922 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a1f5079b:::obj-1-468:head# 2020-09-08T15:59:34.922 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a1ff04b5:::obj-1-167:head# 2020-09-08T15:59:34.924 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a21cc437:::obj-1-128:head# 2020-09-08T15:59:34.924 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a2966c77:::obj-1-140:head# 2020-09-08T15:59:34.925 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a321e537:::obj-1-184:head# 2020-09-08T15:59:34.925 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a33418d8:::obj-1-488:head# 2020-09-08T15:59:34.926 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a38b1c1a:::obj-1-584:head# 2020-09-08T15:59:34.926 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a3f83221:::obj-1-158:head# 2020-09-08T15:59:34.927 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a46e33eb:::obj-1-106:head# 2020-09-08T15:59:34.927 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a491460d:::obj-1-421:head# 2020-09-08T15:59:34.928 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a4dd813b:::obj-1-530:head# 2020-09-08T15:59:34.929 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a4e0d96d:::obj-1-351:head# 2020-09-08T15:59:34.929 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a52657b4:::obj-1-557:head# 2020-09-08T15:59:34.930 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a5b3bca6:::obj-1-277:head# 2020-09-08T15:59:34.931 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a5f5a9fb:::obj-1-170:head# 2020-09-08T15:59:34.932 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a6aeed57:::obj-1-141:head# 2020-09-08T15:59:34.932 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a6dda70f:::obj-1-471:head# 2020-09-08T15:59:34.933 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a71186c0:::obj-1-406:head# 2020-09-08T15:59:34.934 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a764ad8c:::obj-1-221:head# 2020-09-08T15:59:34.940 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a7b63473:::obj-1-131:head# 2020-09-08T15:59:34.959 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a88042fa:::obj-1-296:head# 2020-09-08T15:59:34.965 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:a8805fe0:::obj-1-213:head# 2020-09-08T15:59:34.966 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:aa4f12b1:::obj-1-270:head# 2020-09-08T15:59:34.983 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:ab27f701:::obj-1-399:head# 2020-09-08T15:59:34.991 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:ab8027c1:::obj-1-360:head# 2020-09-08T15:59:34.993 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:ac3ef8ab:::obj-1-371:head# 2020-09-08T15:59:34.993 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:ac4db76d:::obj-1-405:head# 2020-09-08T15:59:34.993 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:ad53cb29:::obj-1-256:head# 2020-09-08T15:59:34.997 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:ad704c16:::obj-1-485:head# 2020-09-08T15:59:34.997 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:adec4920:::obj-1-107:head# 2020-09-08T15:59:35.013 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:ae3a94b3:::obj-1-95:head# 2020-09-08T15:59:35.014 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:ae92616e:::obj-1-448:head# 2020-09-08T15:59:35.014 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:ae975168:::obj-1-426:head# 2020-09-08T15:59:35.014 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:aee8fd62:::obj-1-27:head# 2020-09-08T15:59:35.014 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:af38aa87:::obj-1-50:head# 2020-09-08T15:59:35.018 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:b0327eb3:::obj-1-380:head# 2020-09-08T15:59:35.018 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:b03cd166:::obj-1-203:head# 2020-09-08T15:59:35.018 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:b06f06e0:::obj-1-126:head# 2020-09-08T15:59:35.018 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:b0972538:::obj-1-506:head# 2020-09-08T15:59:35.019 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:b0cfb86a:::obj-1-359:head# 2020-09-08T15:59:35.019 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:b10adb1c:::obj-1-333:head# 2020-09-08T15:59:35.019 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:b20b9004:::obj-1-401:head# 2020-09-08T15:59:35.019 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:b2113757:::obj-1-4:head# 2020-09-08T15:59:35.019 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:b22441e9:::obj-1-29:head# 2020-09-08T15:59:35.020 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:b2472384:::obj-1-207:head# 2020-09-08T15:59:35.020 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:b2604227:::obj-1-502:head# 2020-09-08T15:59:35.020 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:b3277f89:::obj-1-175:head# 2020-09-08T15:59:35.020 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:b3d09e0d:::obj-1-258:head# 2020-09-08T15:59:35.020 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:b3e9969a:::obj-1-499:head# 2020-09-08T15:59:35.021 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:b4892e7d:::obj-1-155:head# 2020-09-08T15:59:35.021 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:b4b76084:::obj-1-581:head# 2020-09-08T15:59:35.021 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:b6e47ae5:::obj-1-215:head# 2020-09-08T15:59:35.021 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:b75af5ff:::obj-1-228:head# 2020-09-08T15:59:35.021 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:b8e2e20f:::obj-1-220:head# 2020-09-08T15:59:35.021 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:b8e80c4e:::obj-1-576:head# 2020-09-08T15:59:35.022 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:ba502aee:::obj-1-255:head# 2020-09-08T15:59:35.022 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:ba9c3e6e:::obj-1-57:head# 2020-09-08T15:59:35.022 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:bb068062:::obj-1-461:head# 2020-09-08T15:59:35.022 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:bb16c115:::obj-1-157:head# 2020-09-08T15:59:35.022 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:bb447914:::obj-1-481:head# 2020-09-08T15:59:35.023 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:bb6c8e0f:::obj-1-348:head# 2020-09-08T15:59:35.023 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:bb77d6d0:::obj-1-301:head# 2020-09-08T15:59:35.023 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:bc51c5f6:::obj-1-422:head# 2020-09-08T15:59:35.023 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:bc838d5c:::obj-1-35:head# 2020-09-08T15:59:35.023 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:bceae5eb:::obj-1-56:head# 2020-09-08T15:59:35.024 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:bea17ef6:::obj-1-84:head# 2020-09-08T15:59:35.024 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:beb88be5:::obj-1-396:head# 2020-09-08T15:59:35.024 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:beed7b18:::obj-1-569:head# 2020-09-08T15:59:35.024 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:bf0bff49:::obj-1-385:head# 2020-09-08T15:59:35.029 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:bf545d5a:::obj-1-69:head# 2020-09-08T15:59:35.030 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:bf560a7f:::obj-1-40:head# 2020-09-08T15:59:35.030 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:bff6999c:::obj-1-240:head# 2020-09-08T15:59:35.030 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:c0a33d38:::obj-1-321:head# 2020-09-08T15:59:35.030 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:c1e4c9b4:::obj-1-299:head# 2020-09-08T15:59:35.031 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:c1ec515a:::obj-1-16:head# 2020-09-08T15:59:35.031 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:c22de3c8:::obj-1-110:head# 2020-09-08T15:59:35.031 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:c231cd7c:::obj-1-58:head# 2020-09-08T15:59:35.031 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:c2ee6ace:::obj-1-186:head# 2020-09-08T15:59:35.031 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:c32bfef2:::obj-1-181:head# 2020-09-08T15:59:35.031 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:c575a298:::obj-1-466:head# 2020-09-08T15:59:35.032 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:c58c3f80:::obj-1-493:head# 2020-09-08T15:59:35.032 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:c6442cf2:::obj-1-455:head# 2020-09-08T15:59:35.032 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:c6619413:::obj-1-37:head# 2020-09-08T15:59:35.032 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:c6c2f8e5:::obj-1-519:head# 2020-09-08T15:59:35.032 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:c6f811a2:::obj-1-180:head# 2020-09-08T15:59:35.033 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:c72af975:::obj-1-21:head# 2020-09-08T15:59:35.033 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:c73eb350:::obj-1-356:head# 2020-09-08T15:59:35.033 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:c7a683da:::obj-1-410:head# 2020-09-08T15:59:35.033 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:c7eb9bcc:::obj-1-553:head# 2020-09-08T15:59:35.033 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:c886df99:::obj-1-269:head# 2020-09-08T15:59:35.034 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:c932e3ec:::obj-1-135:head# 2020-09-08T15:59:35.034 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:c9b6507a:::obj-1-520:head# 2020-09-08T15:59:35.034 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:c9e3b064:::obj-1-244:head# 2020-09-08T15:59:35.034 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:cb705d66:::obj-1-377:head# 2020-09-08T15:59:35.034 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:cc80e25c:::obj-1-115:head# 2020-09-08T15:59:35.035 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:cd1ec88e:::obj-1-297:head# 2020-09-08T15:59:35.035 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:cd7e6936:::obj-1-234:head# 2020-09-08T15:59:35.035 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:ce32b69c:::obj-1-30:head# 2020-09-08T15:59:35.035 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:cf2b123c:::obj-1-293:head# 2020-09-08T15:59:35.035 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:cf2e80a9:::obj-1-542:head# 2020-09-08T15:59:35.039 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:cf51da6a:::obj-1-284:head# 2020-09-08T15:59:35.040 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:cf590f42:::obj-1-381:head# 2020-09-08T15:59:35.040 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:cf68a2b1:::obj-1-68:head# 2020-09-08T15:59:35.040 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:cf6aefb6:::obj-1-28:head# 2020-09-08T15:59:35.040 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:cfd8e6af:::obj-1-105:head# 2020-09-08T15:59:35.040 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d0640bad:::obj-1-254:head# 2020-09-08T15:59:35.041 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d101cda5:::obj-1-259:head# 2020-09-08T15:59:35.041 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d1be9386:::obj-1-416:head# 2020-09-08T15:59:35.041 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d243f036:::obj-1-265:head# 2020-09-08T15:59:35.041 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d2808c34:::obj-1-159:head# 2020-09-08T15:59:35.041 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d3415824:::obj-1-39:head# 2020-09-08T15:59:35.042 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d424f07a:::obj-1-547:head# 2020-09-08T15:59:35.042 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d44139f2:::obj-1-289:head# 2020-09-08T15:59:35.042 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d46015ab:::obj-1-546:head# 2020-09-08T15:59:35.042 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d4e503db:::obj-1-525:head# 2020-09-08T15:59:35.042 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d4e97d18:::obj-1-85:head# 2020-09-08T15:59:35.042 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d511492e:::obj-1-388:head# 2020-09-08T15:59:35.043 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d526a7fa:::obj-1-12:head# 2020-09-08T15:59:35.043 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d5667b59:::obj-1-369:head# 2020-09-08T15:59:35.043 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d57f2261:::obj-1-419:head# 2020-09-08T15:59:35.043 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d57f281b:::obj-1-250:head# 2020-09-08T15:59:35.043 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d6e05894:::obj-1-166:head# 2020-09-08T15:59:35.044 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d7689481:::obj-1-424:head# 2020-09-08T15:59:35.044 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d7d27743:::obj-1-129:head# 2020-09-08T15:59:35.044 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d7e4d3e9:::obj-1-127:head# 2020-09-08T15:59:35.048 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d7f1422a:::obj-1-594:head# 2020-09-08T15:59:35.048 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d8469fd2:::obj-1-153:head# 2020-09-08T15:59:35.048 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d84efd9e:::obj-1-435:head# 2020-09-08T15:59:35.048 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d883004b:::obj-1-162:head# 2020-09-08T15:59:35.049 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d8b60854:::obj-1-257:head# 2020-09-08T15:59:35.049 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d91aaae6:::obj-1-1:head# 2020-09-08T15:59:35.049 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d98695ca:::obj-1-524:head# 2020-09-08T15:59:35.049 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:d9ae97c8:::obj-1-177:head# 2020-09-08T15:59:35.049 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:da1713bd:::obj-1-309:head# 2020-09-08T15:59:35.050 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:da37824c:::obj-1-2:head# 2020-09-08T15:59:35.050 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:dab221b0:::obj-1-526:head# 2020-09-08T15:59:35.050 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:db27d885:::obj-1-363:head# 2020-09-08T15:59:35.050 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:dc001d76:::obj-1-329:head# 2020-09-08T15:59:35.050 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:dc4f4119:::obj-1-122:head# 2020-09-08T15:59:35.050 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:dcc36eb7:::obj-1-283:head# 2020-09-08T15:59:35.051 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:df7da06c:::obj-1-124:head# 2020-09-08T15:59:35.051 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:df7fcacb:::obj-1-330:head# 2020-09-08T15:59:35.051 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e05cbe31:::obj-1-413:head# 2020-09-08T15:59:35.051 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e1060a54:::obj-1-384:head# 2020-09-08T15:59:35.051 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e15b839b:::obj-1-316:head# 2020-09-08T15:59:35.056 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e161b6e5:::obj-1-103:head# 2020-09-08T15:59:35.057 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e1d1d79c:::obj-1-512:head# 2020-09-08T15:59:35.057 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e224b482:::obj-1-501:head# 2020-09-08T15:59:35.057 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e22d6f76:::obj-1-70:head# 2020-09-08T15:59:35.057 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e2bd801c:::obj-1-523:head# 2020-09-08T15:59:35.057 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e3d9f395:::obj-1-397:head# 2020-09-08T15:59:35.058 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e474ea25:::obj-1-457:head# 2020-09-08T15:59:35.058 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e49e1ff3:::obj-1-130:head# 2020-09-08T15:59:35.058 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e56c67a0:::obj-1-191:head# 2020-09-08T15:59:35.058 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e576e921:::obj-1-376:head# 2020-09-08T15:59:35.058 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e619fd26:::obj-1-395:head# 2020-09-08T15:59:35.059 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e625bdc5:::obj-1-522:head# 2020-09-08T15:59:35.059 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e68a0fa6:::obj-1-394:head# 2020-09-08T15:59:35.059 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e6cf260f:::obj-1-77:head# 2020-09-08T15:59:35.059 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e6d6255a:::obj-1-108:head# 2020-09-08T15:59:35.059 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e7a35d2f:::obj-1-116:head# 2020-09-08T15:59:35.060 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e7b07de5:::obj-1-238:head# 2020-09-08T15:59:35.060 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e8037aba:::obj-1-404:head# 2020-09-08T15:59:35.062 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e8e8b34f:::obj-1-291:head# 2020-09-08T15:59:35.063 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:e987cd7a:::obj-1-123:head# 2020-09-08T15:59:35.063 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:ea534db1:::obj-1-311:head# 2020-09-08T15:59:35.063 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:eabcc188:::obj-1-325:head# 2020-09-08T15:59:35.063 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:eb086660:::obj-1-595:head# 2020-09-08T15:59:35.064 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:eb2235d3:::obj-1-596:head# 2020-09-08T15:59:35.064 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:eb35ae40:::obj-1-516:head# 2020-09-08T15:59:35.064 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:eb360a13:::obj-1-224:head# 2020-09-08T15:59:35.064 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:eb3a3ea1:::obj-1-120:head# 2020-09-08T15:59:35.064 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:ebca9f6e:::obj-1-290:head# 2020-09-08T15:59:35.064 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:ec81db71:::obj-1-478:head# 2020-09-08T15:59:35.065 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:edeafa4c:::obj-1-362:head# 2020-09-08T15:59:35.065 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:eeb5261b:::obj-1-539:head# 2020-09-08T15:59:35.065 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:eec00eee:::obj-1-567:head# 2020-09-08T15:59:35.065 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:ef075e10:::obj-1-463:head# 2020-09-08T15:59:35.067 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:ef8e37d9:::obj-1-94:head# 2020-09-08T15:59:35.067 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:efad7f67:::obj-1-197:head# 2020-09-08T15:59:35.067 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:efe09ea7:::obj-1-537:head# 2020-09-08T15:59:35.068 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f0445019:::obj-1-480:head# 2020-09-08T15:59:35.068 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f08a432c:::obj-1-489:head# 2020-09-08T15:59:35.068 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f0bd9006:::obj-1-487:head# 2020-09-08T15:59:35.068 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f11a115d:::obj-1-591:head# 2020-09-08T15:59:35.068 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f232e0af:::obj-1-146:head# 2020-09-08T15:59:35.069 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f258db54:::obj-1-521:head# 2020-09-08T15:59:35.071 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f29cc204:::obj-1-566:head# 2020-09-08T15:59:35.071 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f2ae2451:::obj-1-66:head# 2020-09-08T15:59:35.071 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f318810a:::obj-1-160:head# 2020-09-08T15:59:35.072 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f3c35a0d:::obj-1-67:head# 2020-09-08T15:59:35.072 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f3ce9c90:::obj-1-88:head# 2020-09-08T15:59:35.072 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f3e3e81f:::obj-1-304:head# 2020-09-08T15:59:35.072 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f3f65b0a:::obj-1-367:head# 2020-09-08T15:59:35.072 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f4ea014b:::obj-1-149:head# 2020-09-08T15:59:35.074 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f52d115b:::obj-1-383:head# 2020-09-08T15:59:35.074 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f590311e:::obj-1-76:head# 2020-09-08T15:59:35.074 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f5a37734:::obj-1-51:head# 2020-09-08T15:59:35.074 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f5e2e77c:::obj-1-179:head# 2020-09-08T15:59:35.074 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f5e381bc:::obj-1-173:head# 2020-09-08T15:59:35.075 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f6c0ae0b:::obj-1-247:head# 2020-09-08T15:59:35.075 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f6db8a82:::obj-1-548:head# 2020-09-08T15:59:35.076 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f6e2dc46:::obj-1-36:head# 2020-09-08T15:59:35.076 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f76ee569:::obj-1-587:head# 2020-09-08T15:59:35.077 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f773b9ed:::obj-1-550:head# 2020-09-08T15:59:35.077 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f7e1adad:::obj-1-350:head# 2020-09-08T15:59:35.078 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f7eebf7a:::obj-1-559:head# 2020-09-08T15:59:35.078 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f877f025:::obj-1-187:head# 2020-09-08T15:59:35.079 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f992f9e9:::obj-1-402:head# 2020-09-08T15:59:35.079 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:f9fe960a:::obj-1-418:head# 2020-09-08T15:59:35.079 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:fa9b882f:::obj-1-165:head# 2020-09-08T15:59:35.080 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:fbd6461c:::obj-1-339:head# 2020-09-08T15:59:35.080 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:fbeab28d:::obj-1-431:head# 2020-09-08T15:59:35.081 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:fdea4138:::obj-1-185:head# 2020-09-08T15:59:35.081 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:fdfa7c9b:::obj-1-183:head# 2020-09-08T15:59:35.082 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:fe1ba57e:::obj-1-90:head# 2020-09-08T15:59:35.083 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:feb7adea:::obj-1-560:head# 2020-09-08T15:59:35.083 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:ffab306e:::obj-1-97:head# 2020-09-08T15:59:35.083 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:ffdfd397:::obj-1-433:head# 2020-09-08T15:59:35.084 INFO:tasks.workunit.client.0.smithi065.stderr:Read #2:ffe8cf04:::obj-1-303:head# 2020-09-08T15:59:35.084 INFO:tasks.workunit.client.0.smithi065.stderr:Export successful 2020-09-08T15:59:35.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1215: _objectstore_tool_nowait: activate_osd td/osd-backfill-space 2 2020-09-08T15:59:35.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/osd-backfill-space 2020-09-08T15:59:35.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T15:59:35.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=2 2020-09-08T15:59:35.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T15:59:35.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/osd-backfill-space/2 2020-09-08T15:59:35.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T15:59:35.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T15:59:35.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T15:59:35.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T15:59:35.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2020-09-08T15:59:35.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2020-09-08T15:59:35.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T15:59:35.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T15:59:35.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T15:59:35.357 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T15:59:35.357 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T15:59:35.358 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T15:59:35.358 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T15:59:35.358 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T15:59:35.358 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T15:59:35.358 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:59:35.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T15:59:35.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T15:59:35.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T15:59:35.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T15:59:35.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T15:59:35.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T15:59:35.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:59:35.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T15:59:35.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T15:59:35.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/osd-backfill-space/2 2020-09-08T15:59:35.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.2 2020-09-08T15:59:35.362 INFO:tasks.workunit.client.0.smithi065.stderr:start osd.2 2020-09-08T15:59:35.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 2 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T15:59:35.362 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/osd-backfill-space/2/whoami 2020-09-08T15:59:35.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 2 = 2 ']' 2020-09-08T15:59:35.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T15:59:35.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T15:59:35.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T15:59:35.383 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:59:35.388+0000 7f439055bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:59:35.385 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:59:35.390+0000 7f439055bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:59:35.387 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:59:35.392+0000 7f439055bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T15:59:35.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 2 2020-09-08T15:59:35.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T15:59:35.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T15:59:35.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T15:59:35.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T15:59:35.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:59:35.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T15:59:35.767 INFO:tasks.workunit.client.0.smithi065.stderr:0 2020-09-08T15:59:35.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:59:35.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:59:35.912 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:59:35.916+0000 7f439055bec0 -1 Falling back to public interface 2020-09-08T15:59:36.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T15:59:36.849 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T15:59:36.854+0000 7f439055bec0 -1 osd.2 41 log_to_monitors {default=true} 2020-09-08T15:59:37.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T15:59:37.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T15:59:37.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T15:59:37.182 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T15:59:37.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T15:59:37.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T15:59:37.733 INFO:tasks.workunit.client.0.smithi065.stderr:osd.2 up in weight 1 up_from 44 up_thru 44 down_at 42 last_clean_interval [14,41) [v2:127.0.0.1:6818/216296,v1:127.0.0.1:6819/216296] [v2:127.0.0.1:6820/216296,v1:127.0.0.1:6821/216296] exists,up e23572dd-8b8f-4ce8-8315-ba2876ddb8af 2020-09-08T15:59:37.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T15:59:37.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T15:59:37.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T15:59:37.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:490: TEST_backfill_multi_partial: kill_daemon td/osd-backfill-space/osd.1.pid TERM 2020-09-08T15:59:37.734 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: cat td/osd-backfill-space/osd.1.pid 2020-09-08T15:59:37.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: local pid=203561 2020-09-08T15:59:37.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: local send_signal=TERM 2020-09-08T15:59:37.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2020-09-08T15:59:37.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:258: kill_daemon: local exit_code=1 2020-09-08T15:59:37.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2020-09-08T15:59:37.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 203561 2020-09-08T15:59:37.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2020-09-08T15:59:37.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2020-09-08T15:59:37.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.1 2020-09-08T15:59:37.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2020-09-08T15:59:37.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 203561 2020-09-08T15:59:37.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:265: kill_daemon: exit_code=0 2020-09-08T15:59:37.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:266: kill_daemon: break 2020-09-08T15:59:37.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:271: kill_daemon: return 0 2020-09-08T15:59:37.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:491: TEST_backfill_multi_partial: _objectstore_tool_nodown td/osd-backfill-space 1 --force --op remove --pgid 2.0 2020-09-08T15:59:37.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local dir=td/osd-backfill-space 2020-09-08T15:59:37.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2020-09-08T15:59:37.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local id=1 2020-09-08T15:59:37.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1198: _objectstore_tool_nodown: shift 2020-09-08T15:59:37.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: _objectstore_tool_nodown: local osd_data=td/osd-backfill-space/1 2020-09-08T15:59:37.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1202: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-space/1 --force --op remove --pgid 2.0 2020-09-08T15:59:38.700 INFO:tasks.workunit.client.0.smithi065.stderr:PG '2.0' not found 2020-09-08T15:59:38.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1203: _objectstore_tool_nodown: return 1 2020-09-08T15:59:38.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:492: TEST_backfill_multi_partial: _objectstore_tool_nodown td/osd-backfill-space 1 --op import --pgid 2.0 --file td/osd-backfill-space/export.out 2020-09-08T15:59:38.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local dir=td/osd-backfill-space 2020-09-08T15:59:38.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2020-09-08T15:59:38.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local id=1 2020-09-08T15:59:38.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1198: _objectstore_tool_nodown: shift 2020-09-08T15:59:38.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: _objectstore_tool_nodown: local osd_data=td/osd-backfill-space/1 2020-09-08T15:59:38.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1202: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-space/1 --op import --pgid 2.0 --file td/osd-backfill-space/export.out 2020-09-08T15:59:39.605 INFO:tasks.workunit.client.0.smithi065.stdout:get_pg_num_history pg_num_history pg_num_history(e44 pg_nums {1={20=1},2={26=1},3={31=1}} deleted_pools ) 2020-09-08T15:59:39.605 INFO:tasks.workunit.client.0.smithi065.stdout:Importing pgid 2.0 2020-09-08T15:59:39.606 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:00f101c6:::obj-1-121:head# 2020-09-08T15:59:39.606 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:39.669 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:0168051e:::obj-1-571:head# 2020-09-08T15:59:39.669 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:39.702 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:01b67738:::obj-1-182:head# 2020-09-08T15:59:39.702 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:39.735 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:040dbc59:::obj-1-23:head# 2020-09-08T15:59:39.736 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:39.770 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:0415ce6e:::obj-1-20:head# 2020-09-08T15:59:39.770 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:39.802 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:058b28d7:::obj-1-572:head# 2020-09-08T15:59:39.803 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:39.836 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:059d2e5c:::obj-1-87:head# 2020-09-08T15:59:39.836 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:39.861 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:05a823ca:::obj-1-52:head# 2020-09-08T15:59:39.862 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:39.886 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:05b8b7fe:::obj-1-119:head# 2020-09-08T15:59:39.887 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:39.917 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:05c9492b:::obj-1-78:head# 2020-09-08T15:59:39.918 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:39.937 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:05e91e96:::obj-1-393:head# 2020-09-08T15:59:39.937 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:39.962 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:07bdb780:::obj-1-204:head# 2020-09-08T15:59:39.962 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:39.987 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:07cfbd49:::obj-1-318:head# 2020-09-08T15:59:39.987 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.012 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:084a829f:::obj-1-112:head# 2020-09-08T15:59:40.012 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.037 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:08cedd34:::obj-1-438:head# 2020-09-08T15:59:40.037 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.079 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:0941af69:::obj-1-117:head# 2020-09-08T15:59:40.079 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.104 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:09607265:::obj-1-429:head# 2020-09-08T15:59:40.104 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.130 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:0be86f7e:::obj-1-568:head# 2020-09-08T15:59:40.131 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.154 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:0ca5819d:::obj-1-327:head# 2020-09-08T15:59:40.154 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.179 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:0cd02051:::obj-1-208:head# 2020-09-08T15:59:40.180 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.204 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:0d0264b5:::obj-1-171:head# 2020-09-08T15:59:40.205 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.229 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:0d195060:::obj-1-420:head# 2020-09-08T15:59:40.230 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.257 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:0d362b19:::obj-1-219:head# 2020-09-08T15:59:40.257 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.280 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:0dea6f4d:::obj-1-61:head# 2020-09-08T15:59:40.280 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.305 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:0ecd8390:::obj-1-132:head# 2020-09-08T15:59:40.305 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.330 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:0f49e2fa:::obj-1-200:head# 2020-09-08T15:59:40.330 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.355 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:0f7bb95f:::obj-1-268:head# 2020-09-08T15:59:40.355 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.380 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:0fabf252:::obj-1-441:head# 2020-09-08T15:59:40.380 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.405 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:0fb1697a:::obj-1-443:head# 2020-09-08T15:59:40.406 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.430 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:105d3efe:::obj-1-490:head# 2020-09-08T15:59:40.431 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.455 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:10f52c01:::obj-1-449:head# 2020-09-08T15:59:40.456 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.481 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:11965425:::obj-1-335:head# 2020-09-08T15:59:40.481 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.506 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:11c9f5f8:::obj-1-565:head# 2020-09-08T15:59:40.506 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.533 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:11cfcfb6:::obj-1-588:head# 2020-09-08T15:59:40.533 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.556 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:11d46f0a:::obj-1-387:head# 2020-09-08T15:59:40.556 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.581 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:11ebb0d6:::obj-1-214:head# 2020-09-08T15:59:40.581 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.606 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1295e402:::obj-1-178:head# 2020-09-08T15:59:40.607 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.631 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:12c996c1:::obj-1-517:head# 2020-09-08T15:59:40.632 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.656 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:133dec15:::obj-1-475:head# 2020-09-08T15:59:40.657 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.690 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1475c981:::obj-1-505:head# 2020-09-08T15:59:40.690 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.723 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:148e92a4:::obj-1-509:head# 2020-09-08T15:59:40.724 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.757 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1490b121:::obj-1-172:head# 2020-09-08T15:59:40.757 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.793 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:14ce082c:::obj-1-99:head# 2020-09-08T15:59:40.793 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.816 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1552ad99:::obj-1-41:head# 2020-09-08T15:59:40.816 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.842 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:15544270:::obj-1-271:head# 2020-09-08T15:59:40.842 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.866 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1589d957:::obj-1-86:head# 2020-09-08T15:59:40.866 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.891 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:16db3947:::obj-1-477:head# 2020-09-08T15:59:40.891 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.916 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:16dc98bd:::obj-1-375:head# 2020-09-08T15:59:40.916 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.941 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:17e54db3:::obj-1-196:head# 2020-09-08T15:59:40.941 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:40.999 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:17f2ad3f:::obj-1-10:head# 2020-09-08T15:59:41.000 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.033 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:18075e41:::obj-1-55:head# 2020-09-08T15:59:41.033 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.066 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:18086253:::obj-1-71:head# 2020-09-08T15:59:41.067 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.100 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:191cf8d8:::obj-1-372:head# 2020-09-08T15:59:41.101 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.133 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:19311f70:::obj-1-454:head# 2020-09-08T15:59:41.134 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.175 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:198318e4:::obj-1-464:head# 2020-09-08T15:59:41.176 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.251 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1999d806:::obj-1-163:head# 2020-09-08T15:59:41.251 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.309 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1a92cab7:::obj-1-412:head# 2020-09-08T15:59:41.310 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.343 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1b16c0f6:::obj-1-210:head# 2020-09-08T15:59:41.343 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.376 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1b53ed46:::obj-1-577:head# 2020-09-08T15:59:41.377 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.410 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1b5c5a8d:::obj-1-556:head# 2020-09-08T15:59:41.410 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.443 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1c12c05e:::obj-1-79:head# 2020-09-08T15:59:41.443 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.476 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1c571ba5:::obj-1-262:head# 2020-09-08T15:59:41.477 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.510 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1c5f42b7:::obj-1-92:head# 2020-09-08T15:59:41.510 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.543 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1c6ad881:::obj-1-312:head# 2020-09-08T15:59:41.544 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.577 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1c89877b:::obj-1-142:head# 2020-09-08T15:59:41.577 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.619 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1e4168ca:::obj-1-282:head# 2020-09-08T15:59:41.619 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.652 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1e424445:::obj-1-484:head# 2020-09-08T15:59:41.652 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.686 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1e467959:::obj-1-22:head# 2020-09-08T15:59:41.686 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.719 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1eaf7e7c:::obj-1-392:head# 2020-09-08T15:59:41.719 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.753 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1f06c86d:::obj-1-307:head# 2020-09-08T15:59:41.753 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.790 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1f2ee1f8:::obj-1-306:head# 2020-09-08T15:59:41.790 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.819 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:1f4ef040:::obj-1-349:head# 2020-09-08T15:59:41.820 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.853 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:2039481f:::obj-1-545:head# 2020-09-08T15:59:41.853 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.886 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:22233df0:::obj-1-543:head# 2020-09-08T15:59:41.887 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.920 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:2225184e:::obj-1-266:head# 2020-09-08T15:59:41.920 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.953 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:234766bb:::obj-1-281:head# 2020-09-08T15:59:41.954 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:41.987 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:2372e022:::obj-1-205:head# 2020-09-08T15:59:41.987 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.020 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:2379547b:::obj-1-113:head# 2020-09-08T15:59:42.020 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.053 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:23ae14bf:::obj-1-531:head# 2020-09-08T15:59:42.054 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.100 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:23bc5f90:::obj-1-452:head# 2020-09-08T15:59:42.101 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.120 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:23fbef3d:::obj-1-82:head# 2020-09-08T15:59:42.121 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.154 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:24106c2b:::obj-1-232:head# 2020-09-08T15:59:42.155 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.179 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:2529b4e4:::obj-1-75:head# 2020-09-08T15:59:42.180 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.204 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:25a24ae7:::obj-1-459:head# 2020-09-08T15:59:42.204 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.229 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:26627aa9:::obj-1-7:head# 2020-09-08T15:59:42.229 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.254 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:26b77221:::obj-1-227:head# 2020-09-08T15:59:42.255 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.279 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:27450826:::obj-1-344:head# 2020-09-08T15:59:42.280 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.305 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:278905af:::obj-1-592:head# 2020-09-08T15:59:42.306 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.330 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:27ad0d2d:::obj-1-136:head# 2020-09-08T15:59:42.331 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.355 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:28a8c213:::obj-1-118:head# 2020-09-08T15:59:42.356 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.380 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:28c0c009:::obj-1-74:head# 2020-09-08T15:59:42.381 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.407 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:2a214708:::obj-1-260:head# 2020-09-08T15:59:42.408 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.430 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:2a67e195:::obj-1-474:head# 2020-09-08T15:59:42.431 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.456 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:2aa852ff:::obj-1-5:head# 2020-09-08T15:59:42.457 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.480 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:2ba1fb52:::obj-1-563:head# 2020-09-08T15:59:42.481 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.505 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:2bae8cb9:::obj-1-320:head# 2020-09-08T15:59:42.506 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.531 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:2c569d02:::obj-1-139:head# 2020-09-08T15:59:42.531 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.556 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:2c71d691:::obj-1-201:head# 2020-09-08T15:59:42.557 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.585 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:2c88e92c:::obj-1-389:head# 2020-09-08T15:59:42.585 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.606 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:2d659109:::obj-1-580:head# 2020-09-08T15:59:42.607 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.632 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:2d74ea60:::obj-1-230:head# 2020-09-08T15:59:42.632 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.656 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:2de96edf:::obj-1-233:head# 2020-09-08T15:59:42.657 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.682 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:2e43da40:::obj-1-382:head# 2020-09-08T15:59:42.683 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.706 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:2e530c9f:::obj-1-358:head# 2020-09-08T15:59:42.707 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.732 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:2ed02239:::obj-1-81:head# 2020-09-08T15:59:42.732 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.757 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:30264a0c:::obj-1-373:head# 2020-09-08T15:59:42.757 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.782 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:302ca5e7:::obj-1-206:head# 2020-09-08T15:59:42.782 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.817 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:309878e8:::obj-1-508:head# 2020-09-08T15:59:42.817 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.849 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:309a0ac3:::obj-1-188:head# 2020-09-08T15:59:42.850 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.874 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:30f030e9:::obj-1-53:head# 2020-09-08T15:59:42.874 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.907 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:31242a73:::obj-1-528:head# 2020-09-08T15:59:42.911 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.924 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:31463825:::obj-1-34:head# 2020-09-08T15:59:42.924 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:42.962 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3166dc86:::obj-1-355:head# 2020-09-08T15:59:42.963 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.033 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:31baa2fa:::obj-1-252:head# 2020-09-08T15:59:43.033 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.091 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:31d8935e:::obj-1-193:head# 2020-09-08T15:59:43.092 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.166 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:32670b14:::obj-1-305:head# 2020-09-08T15:59:43.167 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.192 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:33da02fa:::obj-1-114:head# 2020-09-08T15:59:43.192 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.217 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:34373133:::obj-1-446:head# 2020-09-08T15:59:43.218 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.284 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:347b7083:::obj-1-89:head# 2020-09-08T15:59:43.284 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.326 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:349125c1:::obj-1-148:head# 2020-09-08T15:59:43.326 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.351 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:34b80eee:::obj-1-138:head# 2020-09-08T15:59:43.351 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.384 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:34db48f8:::obj-1-49:head# 2020-09-08T15:59:43.385 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.418 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3669ff0c:::obj-1-313:head# 2020-09-08T15:59:43.418 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.452 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:36c1b610:::obj-1-249:head# 2020-09-08T15:59:43.452 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.485 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:374c250b:::obj-1-324:head# 2020-09-08T15:59:43.485 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.518 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3761a149:::obj-1-342:head# 2020-09-08T15:59:43.519 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.552 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:379ff95a:::obj-1-341:head# 2020-09-08T15:59:43.552 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.593 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:37dc15a6:::obj-1-26:head# 2020-09-08T15:59:43.593 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.635 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:38130e33:::obj-1-552:head# 2020-09-08T15:59:43.636 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.660 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:39c44880:::obj-1-538:head# 2020-09-08T15:59:43.661 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.694 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3a08dec9:::obj-1-368:head# 2020-09-08T15:59:43.694 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.727 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3a2b46a6:::obj-1-407:head# 2020-09-08T15:59:43.728 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.761 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3a7dfe0a:::obj-1-285:head# 2020-09-08T15:59:43.761 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.794 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3aebb144:::obj-1-248:head# 2020-09-08T15:59:43.794 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.828 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3b08b36f:::obj-1-310:head# 2020-09-08T15:59:43.828 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.861 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3b28ffa3:::obj-1-295:head# 2020-09-08T15:59:43.862 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.897 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3ba79bd1:::obj-1-444:head# 2020-09-08T15:59:43.897 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.928 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3c05df8d:::obj-1-319:head# 2020-09-08T15:59:43.928 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.961 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3c57e6a9:::obj-1-436:head# 2020-09-08T15:59:43.962 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:43.995 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3c73d8ee:::obj-1-298:head# 2020-09-08T15:59:43.995 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.037 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3cb6ae2a:::obj-1-400:head# 2020-09-08T15:59:44.038 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.087 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3cb71491:::obj-1-328:head# 2020-09-08T15:59:44.088 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.134 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3cb842fe:::obj-1-541:head# 2020-09-08T15:59:44.135 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.170 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3cf6835e:::obj-1-496:head# 2020-09-08T15:59:44.171 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.212 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3cf78507:::obj-1-573:head# 2020-09-08T15:59:44.212 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.287 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3d0dab84:::obj-1-554:head# 2020-09-08T15:59:44.288 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.346 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3d1a5f9d:::obj-1-323:head# 2020-09-08T15:59:44.346 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.388 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3da5f3a2:::obj-1-414:head# 2020-09-08T15:59:44.388 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.429 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3dbb65f0:::obj-1-440:head# 2020-09-08T15:59:44.430 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.471 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3dc94618:::obj-1-223:head# 2020-09-08T15:59:44.472 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.513 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3df3d5ab:::obj-1-25:head# 2020-09-08T15:59:44.513 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.555 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3e167988:::obj-1-336:head# 2020-09-08T15:59:44.555 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.605 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3e4ef3bd:::obj-1-104:head# 2020-09-08T15:59:44.605 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.638 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3e9e1efd:::obj-1-357:head# 2020-09-08T15:59:44.676 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.678 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3ebbe3a7:::obj-1-42:head# 2020-09-08T15:59:44.678 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.705 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3ec80373:::obj-1-403:head# 2020-09-08T15:59:44.706 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.738 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3ed086e4:::obj-1-13:head# 2020-09-08T15:59:44.739 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.772 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:3fe8e157:::obj-1-164:head# 2020-09-08T15:59:44.772 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.806 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:401ddfd4:::obj-1-379:head# 2020-09-08T15:59:44.806 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.839 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:4092f6cd:::obj-1-430:head# 2020-09-08T15:59:44.839 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.881 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:414bd7cc:::obj-1-562:head# 2020-09-08T15:59:44.881 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.914 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:422bd9d0:::obj-1-287:head# 2020-09-08T15:59:44.915 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:44.965 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:4255002d:::obj-1-578:head# 2020-09-08T15:59:44.965 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.023 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:4270725c:::obj-1-109:head# 2020-09-08T15:59:45.023 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.073 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:42836669:::obj-1-31:head# 2020-09-08T15:59:45.074 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.123 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:428d93ef:::obj-1-32:head# 2020-09-08T15:59:45.124 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.174 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:4327ef5b:::obj-1-453:head# 2020-09-08T15:59:45.174 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.253 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:440eb07b:::obj-1-236:head# 2020-09-08T15:59:45.253 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.307 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:442a028a:::obj-1-365:head# 2020-09-08T15:59:45.308 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.341 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:449ca54a:::obj-1-161:head# 2020-09-08T15:59:45.341 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.374 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:45128c3b:::obj-1-343:head# 2020-09-08T15:59:45.375 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.408 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:45801bf6:::obj-1-264:head# 2020-09-08T15:59:45.408 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.441 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:45896f61:::obj-1-48:head# 2020-09-08T15:59:45.442 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.475 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:459b7f1c:::obj-1-190:head# 2020-09-08T15:59:45.475 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.508 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:466af96a:::obj-1-486:head# 2020-09-08T15:59:45.509 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.544 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:47387ce4:::obj-1-575:head# 2020-09-08T15:59:45.544 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.577 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:47c94cc8:::obj-1-564:head# 2020-09-08T15:59:45.578 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.611 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:47d7f8ed:::obj-1-544:head# 2020-09-08T15:59:45.611 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.644 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:47fc0ec3:::obj-1-558:head# 2020-09-08T15:59:45.645 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.686 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:48ba42d8:::obj-1-156:head# 2020-09-08T15:59:45.686 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.720 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:494e269e:::obj-1-600:head# 2020-09-08T15:59:45.720 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.753 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:49646095:::obj-1-73:head# 2020-09-08T15:59:45.753 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.786 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:49eb65ab:::obj-1-374:head# 2020-09-08T15:59:45.787 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.837 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:4a0075a4:::obj-1-432:head# 2020-09-08T15:59:45.837 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.887 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:4af1ffc2:::obj-1-72:head# 2020-09-08T15:59:45.887 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.937 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:4bc1c46f:::obj-1-346:head# 2020-09-08T15:59:45.938 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:45.988 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:4bd55e68:::obj-1-93:head# 2020-09-08T15:59:45.988 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:46.046 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:4c6d2760:::obj-1-198:head# 2020-09-08T15:59:46.046 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:46.105 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:4cb9be3b:::obj-1-451:head# 2020-09-08T15:59:46.105 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:46.164 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:4d260a64:::obj-1-514:head# 2020-09-08T15:59:46.164 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:46.213 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:4d7d6284:::obj-1-583:head# 2020-09-08T15:59:46.214 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:46.264 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:4e79ac02:::obj-1-437:head# 2020-09-08T15:59:46.264 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:46.314 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:4e980099:::obj-1-507:head# 2020-09-08T15:59:46.315 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:46.364 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:4ea8f99c:::obj-1-211:head# 2020-09-08T15:59:46.365 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:46.398 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:4eabdc2a:::obj-1-590:head# 2020-09-08T15:59:46.398 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:46.431 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:4f97fd73:::obj-1-243:head# 2020-09-08T15:59:46.432 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:46.465 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:4fe00224:::obj-1-229:head# 2020-09-08T15:59:46.465 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:46.498 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:4fead9ab:::obj-1-476:head# 2020-09-08T15:59:46.501 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:46.548 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:4ffddfd7:::obj-1-462:head# 2020-09-08T15:59:46.549 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:46.607 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:5085c04d:::obj-1-100:head# 2020-09-08T15:59:46.607 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:46.657 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:50a8b465:::obj-1-574:head# 2020-09-08T15:59:46.658 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:46.891 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:518a151f:::obj-1-189:head# 2020-09-08T15:59:46.891 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:46.941 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:519afc95:::obj-1-314:head# 2020-09-08T15:59:46.942 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:47.046 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:52199781:::obj-1-202:head# 2020-09-08T15:59:47.046 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:47.092 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:52313062:::obj-1-337:head# 2020-09-08T15:59:47.092 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:47.142 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:526a5196:::obj-1-225:head# 2020-09-08T15:59:47.143 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:47.203 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:53128d32:::obj-1-483:head# 2020-09-08T15:59:47.203 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:47.297 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:53c2bb21:::obj-1-532:head# 2020-09-08T15:59:47.297 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:47.326 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:53fa4f3c:::obj-1-423:head# 2020-09-08T15:59:47.327 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:47.376 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:541c1d30:::obj-1-143:head# 2020-09-08T15:59:47.377 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:47.427 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:548d20c3:::obj-1-352:head# 2020-09-08T15:59:47.427 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:47.486 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:54e4c6f9:::obj-1-101:head# 2020-09-08T15:59:47.486 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:47.536 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:55016e06:::obj-1-276:head# 2020-09-08T15:59:47.536 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:47.586 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:5510c784:::obj-1-491:head# 2020-09-08T15:59:47.586 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:47.636 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:551275ef:::obj-1-239:head# 2020-09-08T15:59:47.637 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:47.687 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:556df001:::obj-1-46:head# 2020-09-08T15:59:47.687 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:47.737 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:558fb5b1:::obj-1-536:head# 2020-09-08T15:59:47.737 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:47.787 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:56390d98:::obj-1-64:head# 2020-09-08T15:59:47.787 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:47.838 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:564f962a:::obj-1-125:head# 2020-09-08T15:59:47.839 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:47.888 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:56936e94:::obj-1-251:head# 2020-09-08T15:59:47.888 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:47.938 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:57585d3d:::obj-1-294:head# 2020-09-08T15:59:47.938 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:47.990 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:5764cf7b:::obj-1-479:head# 2020-09-08T15:59:47.991 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.023 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:5782341a:::obj-1-218:head# 2020-09-08T15:59:48.023 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.058 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:57d07a1a:::obj-1-317:head# 2020-09-08T15:59:48.059 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.089 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:58700205:::obj-1-176:head# 2020-09-08T15:59:48.089 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.122 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:58aee718:::obj-1-434:head# 2020-09-08T15:59:48.123 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.155 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:594c9d52:::obj-1-458:head# 2020-09-08T15:59:48.156 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.189 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:5a70b555:::obj-1-279:head# 2020-09-08T15:59:48.189 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.223 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:5b02568b:::obj-1-586:head# 2020-09-08T15:59:48.223 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.256 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:5b69cdcf:::obj-1-391:head# 2020-09-08T15:59:48.256 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.289 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:5cf151b5:::obj-1-510:head# 2020-09-08T15:59:48.290 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.317 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:5d7fd07f:::obj-1-152:head# 2020-09-08T15:59:48.317 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.339 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:5de288d7:::obj-1-235:head# 2020-09-08T15:59:48.340 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.365 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:5ec497cd:::obj-1-44:head# 2020-09-08T15:59:48.365 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.390 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:5fb3a09f:::obj-1-518:head# 2020-09-08T15:59:48.390 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.415 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:5ff3c2ef:::obj-1-470:head# 2020-09-08T15:59:48.415 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.465 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:601efcb1:::obj-1-549:head# 2020-09-08T15:59:48.466 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.521 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:60831338:::obj-1-263:head# 2020-09-08T15:59:48.521 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.571 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:6092777b:::obj-1-145:head# 2020-09-08T15:59:48.571 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.624 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:60b17206:::obj-1-411:head# 2020-09-08T15:59:48.625 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.675 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:610c957c:::obj-1-278:head# 2020-09-08T15:59:48.675 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.726 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:613b5ef4:::obj-1-504:head# 2020-09-08T15:59:48.726 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.775 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:61ed7d60:::obj-1-274:head# 2020-09-08T15:59:48.775 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.825 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:621b6751:::obj-1-212:head# 2020-09-08T15:59:48.826 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.876 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:62b0aba9:::obj-1-253:head# 2020-09-08T15:59:48.876 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:48.967 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:64017240:::obj-1-102:head# 2020-09-08T15:59:48.968 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.060 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:645f4f49:::obj-1-332:head# 2020-09-08T15:59:49.060 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.110 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:65db82b9:::obj-1-334:head# 2020-09-08T15:59:49.110 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.145 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:667422e5:::obj-1-465:head# 2020-09-08T15:59:49.146 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.236 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:66c50bc2:::obj-1-322:head# 2020-09-08T15:59:49.236 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.287 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:681a4577:::obj-1-511:head# 2020-09-08T15:59:49.287 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.353 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:6874e007:::obj-1-398:head# 2020-09-08T15:59:49.353 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.387 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:693746c1:::obj-1-582:head# 2020-09-08T15:59:49.387 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.420 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:69638b0c:::obj-1-8:head# 2020-09-08T15:59:49.420 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.462 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:6967de6e:::obj-1-331:head# 2020-09-08T15:59:49.462 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.487 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:69da97aa:::obj-1-340:head# 2020-09-08T15:59:49.487 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.512 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:6b3a50a6:::obj-1-144:head# 2020-09-08T15:59:49.512 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.545 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:6be4ef26:::obj-1-579:head# 2020-09-08T15:59:49.546 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.570 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:6d735549:::obj-1-599:head# 2020-09-08T15:59:49.571 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.595 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:6e22c25e:::obj-1-9:head# 2020-09-08T15:59:49.596 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.620 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:6e2ced4e:::obj-1-370:head# 2020-09-08T15:59:49.621 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.654 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:6e961169:::obj-1-428:head# 2020-09-08T15:59:49.655 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.670 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:6efcbbee:::obj-1-168:head# 2020-09-08T15:59:49.671 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.695 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:6f20741c:::obj-1-33:head# 2020-09-08T15:59:49.696 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.720 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:6fe4c885:::obj-1-273:head# 2020-09-08T15:59:49.721 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.745 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:6fffdea2:::obj-1-425:head# 2020-09-08T15:59:49.752 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.770 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:70716852:::obj-1-593:head# 2020-09-08T15:59:49.771 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.795 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:70919606:::obj-1-515:head# 2020-09-08T15:59:49.796 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.820 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:70c39d76:::obj-1-467:head# 2020-09-08T15:59:49.821 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.845 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:70f57ad3:::obj-1-361:head# 2020-09-08T15:59:49.846 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.875 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:7177c7b5:::obj-1-503:head# 2020-09-08T15:59:49.876 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.896 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:719b69bd:::obj-1-497:head# 2020-09-08T15:59:49.896 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.920 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:724f9347:::obj-1-6:head# 2020-09-08T15:59:49.921 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.956 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:726d9f6b:::obj-1-111:head# 2020-09-08T15:59:49.957 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:49.979 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:72a91baf:::obj-1-439:head# 2020-09-08T15:59:49.979 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.004 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:72aa43ee:::obj-1-534:head# 2020-09-08T15:59:50.004 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.029 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:72c40e11:::obj-1-288:head# 2020-09-08T15:59:50.029 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.054 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:74196d45:::obj-1-246:head# 2020-09-08T15:59:50.055 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.080 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:743f42b1:::obj-1-326:head# 2020-09-08T15:59:50.080 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.104 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:7523b538:::obj-1-494:head# 2020-09-08T15:59:50.104 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.129 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:75310ed6:::obj-1-364:head# 2020-09-08T15:59:50.129 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.161 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:7568e0bc:::obj-1-585:head# 2020-09-08T15:59:50.162 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.190 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:760219a3:::obj-1-353:head# 2020-09-08T15:59:50.190 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.204 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:763338c9:::obj-1-555:head# 2020-09-08T15:59:50.204 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.229 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:77bc2d65:::obj-1-386:head# 2020-09-08T15:59:50.229 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.254 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:77ed0c7a:::obj-1-492:head# 2020-09-08T15:59:50.255 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.279 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:785a4052:::obj-1-456:head# 2020-09-08T15:59:50.279 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.304 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:796799c3:::obj-1-195:head# 2020-09-08T15:59:50.305 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.329 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:79caf0c1:::obj-1-445:head# 2020-09-08T15:59:50.329 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.355 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:7af5b3e4:::obj-1-217:head# 2020-09-08T15:59:50.355 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.379 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:7b3a9063:::obj-1-169:head# 2020-09-08T15:59:50.380 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.413 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:7b509a92:::obj-1-561:head# 2020-09-08T15:59:50.413 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.446 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:7bc646b1:::obj-1-415:head# 2020-09-08T15:59:50.446 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.479 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:7c2f9188:::obj-1-482:head# 2020-09-08T15:59:50.480 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.513 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:7d0da936:::obj-1-11:head# 2020-09-08T15:59:50.513 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.546 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:7d25ca2d:::obj-1-242:head# 2020-09-08T15:59:50.546 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.588 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:7d64f81e:::obj-1-473:head# 2020-09-08T15:59:50.588 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.621 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:7ef2ea1b:::obj-1-417:head# 2020-09-08T15:59:50.622 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.654 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:7f52b238:::obj-1-308:head# 2020-09-08T15:59:50.655 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.688 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:7f7a313c:::obj-1-551:head# 2020-09-08T15:59:50.688 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.738 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:806827a7:::obj-1-472:head# 2020-09-08T15:59:50.738 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.771 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:8112c3ab:::obj-1-45:head# 2020-09-08T15:59:50.771 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.804 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:81365b55:::obj-1-315:head# 2020-09-08T15:59:50.805 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.838 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:818ffdc3:::obj-1-345:head# 2020-09-08T15:59:50.838 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.871 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:81babab8:::obj-1-535:head# 2020-09-08T15:59:50.871 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.904 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:8288f652:::obj-1-347:head# 2020-09-08T15:59:50.905 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.938 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:8312eadd:::obj-1-14:head# 2020-09-08T15:59:50.938 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:50.981 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:83b89bc7:::obj-1-137:head# 2020-09-08T15:59:50.982 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.030 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:84a12321:::obj-1-134:head# 2020-09-08T15:59:51.030 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.063 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:84b26d62:::obj-1-408:head# 2020-09-08T15:59:51.063 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.096 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:84bbb26e:::obj-1-43:head# 2020-09-08T15:59:51.097 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.130 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:86fc0014:::obj-1-222:head# 2020-09-08T15:59:51.130 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.171 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:87488bf4:::obj-1-174:head# 2020-09-08T15:59:51.172 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.245 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:8754389a:::obj-1-65:head# 2020-09-08T15:59:51.245 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.305 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:87a6ad67:::obj-1-366:head# 2020-09-08T15:59:51.305 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.342 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:87d32b83:::obj-1-513:head# 2020-09-08T15:59:51.342 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.374 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:8813a346:::obj-1-540:head# 2020-09-08T15:59:51.375 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.405 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:88146951:::obj-1-216:head# 2020-09-08T15:59:51.405 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.438 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:8820800d:::obj-1-83:head# 2020-09-08T15:59:51.439 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.472 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:88319745:::obj-1-98:head# 2020-09-08T15:59:51.472 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.505 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:88c969b8:::obj-1-54:head# 2020-09-08T15:59:51.505 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.547 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:895a2d53:::obj-1-150:head# 2020-09-08T15:59:51.547 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.580 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:8ae006a0:::obj-1-241:head# 2020-09-08T15:59:51.580 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.613 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:8bd44e64:::obj-1-300:head# 2020-09-08T15:59:51.614 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.647 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:8beb257f:::obj-1-3:head# 2020-09-08T15:59:51.647 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.680 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:8cd8c743:::obj-1-527:head# 2020-09-08T15:59:51.680 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.715 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:8daa99c7:::obj-1-237:head# 2020-09-08T15:59:51.715 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.748 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:8f5bccbf:::obj-1-59:head# 2020-09-08T15:59:51.748 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.780 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:8f6d9945:::obj-1-151:head# 2020-09-08T15:59:51.781 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.822 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:8f7c568c:::obj-1-261:head# 2020-09-08T15:59:51.822 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.855 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:8fbc59a9:::obj-1-589:head# 2020-09-08T15:59:51.855 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.888 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:90225d94:::obj-1-194:head# 2020-09-08T15:59:51.889 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.930 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:904c50d3:::obj-1-63:head# 2020-09-08T15:59:51.931 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.963 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:90e1bd79:::obj-1-450:head# 2020-09-08T15:59:51.964 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:51.997 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9274b06d:::obj-1-460:head# 2020-09-08T15:59:51.998 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.033 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:92af41f5:::obj-1-409:head# 2020-09-08T15:59:52.033 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.064 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:935a08d6:::obj-1-192:head# 2020-09-08T15:59:52.064 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.097 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:935f8a13:::obj-1-24:head# 2020-09-08T15:59:52.097 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.130 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:95230148:::obj-1-280:head# 2020-09-08T15:59:52.131 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.163 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:95342eb0:::obj-1-390:head# 2020-09-08T15:59:52.164 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.197 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9659d09c:::obj-1-292:head# 2020-09-08T15:59:52.197 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.230 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:970e8cb4:::obj-1-18:head# 2020-09-08T15:59:52.231 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.264 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:97d21cf1:::obj-1-80:head# 2020-09-08T15:59:52.264 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.289 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:982bdb12:::obj-1-302:head# 2020-09-08T15:59:52.289 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.322 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:985dfd75:::obj-1-91:head# 2020-09-08T15:59:52.322 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.347 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:986d245a:::obj-1-154:head# 2020-09-08T15:59:52.347 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.372 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:98a03e99:::obj-1-529:head# 2020-09-08T15:59:52.372 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.397 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:98b7103e:::obj-1-275:head# 2020-09-08T15:59:52.397 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.422 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:990f0ecf:::obj-1-427:head# 2020-09-08T15:59:52.422 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.447 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:996c1f26:::obj-1-96:head# 2020-09-08T15:59:52.447 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.472 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:99bd2018:::obj-1-17:head# 2020-09-08T15:59:52.472 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.502 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9a7434c9:::obj-1-469:head# 2020-09-08T15:59:52.502 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.522 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9a8e36cc:::obj-1-598:head# 2020-09-08T15:59:52.522 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.548 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9abcc369:::obj-1-442:head# 2020-09-08T15:59:52.549 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.572 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9b0ea06e:::obj-1-231:head# 2020-09-08T15:59:52.573 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.597 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9b34e80d:::obj-1-378:head# 2020-09-08T15:59:52.598 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.622 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9b55a2a9:::obj-1-60:head# 2020-09-08T15:59:52.623 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.647 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9be3f2da:::obj-1-597:head# 2020-09-08T15:59:52.648 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.673 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9bf62c88:::obj-1-447:head# 2020-09-08T15:59:52.673 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.697 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9c31857b:::obj-1-272:head# 2020-09-08T15:59:52.698 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.727 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9c533e91:::obj-1-19:head# 2020-09-08T15:59:52.728 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.747 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9ca70688:::obj-1-570:head# 2020-09-08T15:59:52.748 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.781 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9ccce337:::obj-1-147:head# 2020-09-08T15:59:52.781 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.814 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9d4b2dfc:::obj-1-267:head# 2020-09-08T15:59:52.814 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.848 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9d4df969:::obj-1-286:head# 2020-09-08T15:59:52.848 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.881 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9d714651:::obj-1-495:head# 2020-09-08T15:59:52.881 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.918 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9da65518:::obj-1-498:head# 2020-09-08T15:59:52.919 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:52.948 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9e94f27b:::obj-1-209:head# 2020-09-08T15:59:52.948 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.027 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9f39e910:::obj-1-354:head# 2020-09-08T15:59:53.027 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.072 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9f8f9ef4:::obj-1-226:head# 2020-09-08T15:59:53.073 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.106 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:9fcd3f36:::obj-1-47:head# 2020-09-08T15:59:53.106 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.139 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a0326d7d:::obj-1-338:head# 2020-09-08T15:59:53.140 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.172 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a05e7475:::obj-1-62:head# 2020-09-08T15:59:53.173 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.228 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a0955052:::obj-1-533:head# 2020-09-08T15:59:53.229 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.306 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a0aa6848:::obj-1-38:head# 2020-09-08T15:59:53.306 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.339 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a0fdc285:::obj-1-133:head# 2020-09-08T15:59:53.340 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.373 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a10290b8:::obj-1-245:head# 2020-09-08T15:59:53.373 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.406 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a118a8a8:::obj-1-500:head# 2020-09-08T15:59:53.406 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.464 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a11a4079:::obj-1-199:head# 2020-09-08T15:59:53.465 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.498 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a1b3ec36:::obj-1-15:head# 2020-09-08T15:59:53.498 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.531 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a1f5079b:::obj-1-468:head# 2020-09-08T15:59:53.531 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.565 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a1ff04b5:::obj-1-167:head# 2020-09-08T15:59:53.566 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.612 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a21cc437:::obj-1-128:head# 2020-09-08T15:59:53.612 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.640 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a2966c77:::obj-1-140:head# 2020-09-08T15:59:53.640 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.673 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a321e537:::obj-1-184:head# 2020-09-08T15:59:53.673 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.706 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a33418d8:::obj-1-488:head# 2020-09-08T15:59:53.706 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.739 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a38b1c1a:::obj-1-584:head# 2020-09-08T15:59:53.740 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.773 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a3f83221:::obj-1-158:head# 2020-09-08T15:59:53.773 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.806 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a46e33eb:::obj-1-106:head# 2020-09-08T15:59:53.806 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.851 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a491460d:::obj-1-421:head# 2020-09-08T15:59:53.852 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.873 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a4dd813b:::obj-1-530:head# 2020-09-08T15:59:53.873 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.906 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a4e0d96d:::obj-1-351:head# 2020-09-08T15:59:53.907 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.939 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a52657b4:::obj-1-557:head# 2020-09-08T15:59:53.940 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:53.973 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a5b3bca6:::obj-1-277:head# 2020-09-08T15:59:53.973 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.006 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a5f5a9fb:::obj-1-170:head# 2020-09-08T15:59:54.007 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.039 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a6aeed57:::obj-1-141:head# 2020-09-08T15:59:54.040 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.073 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a6dda70f:::obj-1-471:head# 2020-09-08T15:59:54.073 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.106 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a71186c0:::obj-1-406:head# 2020-09-08T15:59:54.107 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.140 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a764ad8c:::obj-1-221:head# 2020-09-08T15:59:54.141 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.173 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a7b63473:::obj-1-131:head# 2020-09-08T15:59:54.174 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.206 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a88042fa:::obj-1-296:head# 2020-09-08T15:59:54.207 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.240 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:a8805fe0:::obj-1-213:head# 2020-09-08T15:59:54.240 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.273 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:aa4f12b1:::obj-1-270:head# 2020-09-08T15:59:54.274 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.306 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:ab27f701:::obj-1-399:head# 2020-09-08T15:59:54.307 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.382 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:ab8027c1:::obj-1-360:head# 2020-09-08T15:59:54.383 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.423 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:ac3ef8ab:::obj-1-371:head# 2020-09-08T15:59:54.423 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.460 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:ac4db76d:::obj-1-405:head# 2020-09-08T15:59:54.460 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.490 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:ad53cb29:::obj-1-256:head# 2020-09-08T15:59:54.490 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.540 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:ad704c16:::obj-1-485:head# 2020-09-08T15:59:54.541 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.573 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:adec4920:::obj-1-107:head# 2020-09-08T15:59:54.574 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.606 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:ae3a94b3:::obj-1-95:head# 2020-09-08T15:59:54.607 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.640 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:ae92616e:::obj-1-448:head# 2020-09-08T15:59:54.640 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.673 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:ae975168:::obj-1-426:head# 2020-09-08T15:59:54.673 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.707 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:aee8fd62:::obj-1-27:head# 2020-09-08T15:59:54.707 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.740 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:af38aa87:::obj-1-50:head# 2020-09-08T15:59:54.741 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.773 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:b0327eb3:::obj-1-380:head# 2020-09-08T15:59:54.774 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.807 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:b03cd166:::obj-1-203:head# 2020-09-08T15:59:54.807 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.840 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:b06f06e0:::obj-1-126:head# 2020-09-08T15:59:54.840 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.873 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:b0972538:::obj-1-506:head# 2020-09-08T15:59:54.874 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.907 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:b0cfb86a:::obj-1-359:head# 2020-09-08T15:59:54.907 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:54.941 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:b10adb1c:::obj-1-333:head# 2020-09-08T15:59:54.941 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.009 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:b20b9004:::obj-1-401:head# 2020-09-08T15:59:55.010 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.040 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:b2113757:::obj-1-4:head# 2020-09-08T15:59:55.040 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.073 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:b22441e9:::obj-1-29:head# 2020-09-08T15:59:55.074 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.107 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:b2472384:::obj-1-207:head# 2020-09-08T15:59:55.107 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.131 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:b2604227:::obj-1-502:head# 2020-09-08T15:59:55.132 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.165 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:b3277f89:::obj-1-175:head# 2020-09-08T15:59:55.165 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.219 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:b3d09e0d:::obj-1-258:head# 2020-09-08T15:59:55.220 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.282 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:b3e9969a:::obj-1-499:head# 2020-09-08T15:59:55.282 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.315 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:b4892e7d:::obj-1-155:head# 2020-09-08T15:59:55.315 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.348 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:b4b76084:::obj-1-581:head# 2020-09-08T15:59:55.349 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.382 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:b6e47ae5:::obj-1-215:head# 2020-09-08T15:59:55.382 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.415 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:b75af5ff:::obj-1-228:head# 2020-09-08T15:59:55.415 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.448 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:b8e2e20f:::obj-1-220:head# 2020-09-08T15:59:55.449 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.482 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:b8e80c4e:::obj-1-576:head# 2020-09-08T15:59:55.482 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.515 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:ba502aee:::obj-1-255:head# 2020-09-08T15:59:55.515 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.548 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:ba9c3e6e:::obj-1-57:head# 2020-09-08T15:59:55.549 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.586 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:bb068062:::obj-1-461:head# 2020-09-08T15:59:55.587 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.615 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:bb16c115:::obj-1-157:head# 2020-09-08T15:59:55.615 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.648 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:bb447914:::obj-1-481:head# 2020-09-08T15:59:55.649 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.683 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:bb6c8e0f:::obj-1-348:head# 2020-09-08T15:59:55.683 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.715 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:bb77d6d0:::obj-1-301:head# 2020-09-08T15:59:55.715 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.757 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:bc51c5f6:::obj-1-422:head# 2020-09-08T15:59:55.757 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.790 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:bc838d5c:::obj-1-35:head# 2020-09-08T15:59:55.791 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.824 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:bceae5eb:::obj-1-56:head# 2020-09-08T15:59:55.824 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.865 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:bea17ef6:::obj-1-84:head# 2020-09-08T15:59:55.866 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.907 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:beb88be5:::obj-1-396:head# 2020-09-08T15:59:55.907 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.940 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:beed7b18:::obj-1-569:head# 2020-09-08T15:59:55.941 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:55.974 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:bf0bff49:::obj-1-385:head# 2020-09-08T15:59:55.974 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.007 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:bf545d5a:::obj-1-69:head# 2020-09-08T15:59:56.007 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.040 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:bf560a7f:::obj-1-40:head# 2020-09-08T15:59:56.041 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.085 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:bff6999c:::obj-1-240:head# 2020-09-08T15:59:56.086 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.107 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:c0a33d38:::obj-1-321:head# 2020-09-08T15:59:56.107 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.140 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:c1e4c9b4:::obj-1-299:head# 2020-09-08T15:59:56.141 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.174 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:c1ec515a:::obj-1-16:head# 2020-09-08T15:59:56.174 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.207 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:c22de3c8:::obj-1-110:head# 2020-09-08T15:59:56.208 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.240 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:c231cd7c:::obj-1-58:head# 2020-09-08T15:59:56.241 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.274 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:c2ee6ace:::obj-1-186:head# 2020-09-08T15:59:56.274 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.307 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:c32bfef2:::obj-1-181:head# 2020-09-08T15:59:56.307 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.349 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:c575a298:::obj-1-466:head# 2020-09-08T15:59:56.349 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.384 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:c58c3f80:::obj-1-493:head# 2020-09-08T15:59:56.385 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.424 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:c6442cf2:::obj-1-455:head# 2020-09-08T15:59:56.425 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.457 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:c6619413:::obj-1-37:head# 2020-09-08T15:59:56.458 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.490 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:c6c2f8e5:::obj-1-519:head# 2020-09-08T15:59:56.491 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.524 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:c6f811a2:::obj-1-180:head# 2020-09-08T15:59:56.524 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.557 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:c72af975:::obj-1-21:head# 2020-09-08T15:59:56.558 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.591 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:c73eb350:::obj-1-356:head# 2020-09-08T15:59:56.591 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.627 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:c7a683da:::obj-1-410:head# 2020-09-08T15:59:56.627 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.663 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:c7eb9bcc:::obj-1-553:head# 2020-09-08T15:59:56.663 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.692 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:c886df99:::obj-1-269:head# 2020-09-08T15:59:56.692 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.724 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:c932e3ec:::obj-1-135:head# 2020-09-08T15:59:56.724 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.758 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:c9b6507a:::obj-1-520:head# 2020-09-08T15:59:56.759 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.791 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:c9e3b064:::obj-1-244:head# 2020-09-08T15:59:56.791 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.824 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:cb705d66:::obj-1-377:head# 2020-09-08T15:59:56.825 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.857 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:cc80e25c:::obj-1-115:head# 2020-09-08T15:59:56.858 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.898 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:cd1ec88e:::obj-1-297:head# 2020-09-08T15:59:56.898 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.933 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:cd7e6936:::obj-1-234:head# 2020-09-08T15:59:56.933 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:56.993 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:ce32b69c:::obj-1-30:head# 2020-09-08T15:59:56.993 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.049 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:cf2b123c:::obj-1-293:head# 2020-09-08T15:59:57.050 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.082 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:cf2e80a9:::obj-1-542:head# 2020-09-08T15:59:57.083 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.119 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:cf51da6a:::obj-1-284:head# 2020-09-08T15:59:57.119 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.149 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:cf590f42:::obj-1-381:head# 2020-09-08T15:59:57.150 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.183 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:cf68a2b1:::obj-1-68:head# 2020-09-08T15:59:57.183 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.260 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:cf6aefb6:::obj-1-28:head# 2020-09-08T15:59:57.260 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.291 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:cfd8e6af:::obj-1-105:head# 2020-09-08T15:59:57.291 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.332 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d0640bad:::obj-1-254:head# 2020-09-08T15:59:57.333 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.369 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d101cda5:::obj-1-259:head# 2020-09-08T15:59:57.369 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.408 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d1be9386:::obj-1-416:head# 2020-09-08T15:59:57.409 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.449 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d243f036:::obj-1-265:head# 2020-09-08T15:59:57.449 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.491 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d2808c34:::obj-1-159:head# 2020-09-08T15:59:57.491 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.524 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d3415824:::obj-1-39:head# 2020-09-08T15:59:57.525 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.566 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d424f07a:::obj-1-547:head# 2020-09-08T15:59:57.566 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.608 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d44139f2:::obj-1-289:head# 2020-09-08T15:59:57.608 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.651 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d46015ab:::obj-1-546:head# 2020-09-08T15:59:57.651 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.691 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d4e503db:::obj-1-525:head# 2020-09-08T15:59:57.692 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.733 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d4e97d18:::obj-1-85:head# 2020-09-08T15:59:57.733 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.774 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d511492e:::obj-1-388:head# 2020-09-08T15:59:57.775 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.816 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d526a7fa:::obj-1-12:head# 2020-09-08T15:59:57.816 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.866 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d5667b59:::obj-1-369:head# 2020-09-08T15:59:57.867 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.908 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d57f2261:::obj-1-419:head# 2020-09-08T15:59:57.908 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.949 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d57f281b:::obj-1-250:head# 2020-09-08T15:59:57.950 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:57.991 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d6e05894:::obj-1-166:head# 2020-09-08T15:59:57.991 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.033 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d7689481:::obj-1-424:head# 2020-09-08T15:59:58.033 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.074 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d7d27743:::obj-1-129:head# 2020-09-08T15:59:58.075 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.116 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d7e4d3e9:::obj-1-127:head# 2020-09-08T15:59:58.116 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.163 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d7f1422a:::obj-1-594:head# 2020-09-08T15:59:58.163 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.199 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d8469fd2:::obj-1-153:head# 2020-09-08T15:59:58.200 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.241 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d84efd9e:::obj-1-435:head# 2020-09-08T15:59:58.242 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.275 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d883004b:::obj-1-162:head# 2020-09-08T15:59:58.275 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.308 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d8b60854:::obj-1-257:head# 2020-09-08T15:59:58.308 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.343 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d91aaae6:::obj-1-1:head# 2020-09-08T15:59:58.343 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.375 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d98695ca:::obj-1-524:head# 2020-09-08T15:59:58.375 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.408 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:d9ae97c8:::obj-1-177:head# 2020-09-08T15:59:58.408 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.441 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:da1713bd:::obj-1-309:head# 2020-09-08T15:59:58.442 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.475 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:da37824c:::obj-1-2:head# 2020-09-08T15:59:58.475 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.509 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:dab221b0:::obj-1-526:head# 2020-09-08T15:59:58.510 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.541 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:db27d885:::obj-1-363:head# 2020-09-08T15:59:58.542 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.578 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:dc001d76:::obj-1-329:head# 2020-09-08T15:59:58.578 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.617 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:dc4f4119:::obj-1-122:head# 2020-09-08T15:59:58.617 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.660 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:dcc36eb7:::obj-1-283:head# 2020-09-08T15:59:58.660 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.697 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:df7da06c:::obj-1-124:head# 2020-09-08T15:59:58.701 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.725 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:df7fcacb:::obj-1-330:head# 2020-09-08T15:59:58.725 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.758 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e05cbe31:::obj-1-413:head# 2020-09-08T15:59:58.759 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.791 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e1060a54:::obj-1-384:head# 2020-09-08T15:59:58.792 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.825 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e15b839b:::obj-1-316:head# 2020-09-08T15:59:58.825 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.858 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e161b6e5:::obj-1-103:head# 2020-09-08T15:59:58.859 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.902 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e1d1d79c:::obj-1-512:head# 2020-09-08T15:59:58.902 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.925 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e224b482:::obj-1-501:head# 2020-09-08T15:59:58.925 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:58.991 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e22d6f76:::obj-1-70:head# 2020-09-08T15:59:58.992 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.050 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e2bd801c:::obj-1-523:head# 2020-09-08T15:59:59.050 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.083 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e3d9f395:::obj-1-397:head# 2020-09-08T15:59:59.084 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.116 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e474ea25:::obj-1-457:head# 2020-09-08T15:59:59.117 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.150 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e49e1ff3:::obj-1-130:head# 2020-09-08T15:59:59.150 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.183 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e56c67a0:::obj-1-191:head# 2020-09-08T15:59:59.184 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.276 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e576e921:::obj-1-376:head# 2020-09-08T15:59:59.276 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.308 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e619fd26:::obj-1-395:head# 2020-09-08T15:59:59.309 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.351 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e625bdc5:::obj-1-522:head# 2020-09-08T15:59:59.351 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.418 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e68a0fa6:::obj-1-394:head# 2020-09-08T15:59:59.418 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.450 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e6cf260f:::obj-1-77:head# 2020-09-08T15:59:59.450 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.488 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e6d6255a:::obj-1-108:head# 2020-09-08T15:59:59.489 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.517 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e7a35d2f:::obj-1-116:head# 2020-09-08T15:59:59.517 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.550 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e7b07de5:::obj-1-238:head# 2020-09-08T15:59:59.550 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.592 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e8037aba:::obj-1-404:head# 2020-09-08T15:59:59.592 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.634 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e8e8b34f:::obj-1-291:head# 2020-09-08T15:59:59.635 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.667 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:e987cd7a:::obj-1-123:head# 2020-09-08T15:59:59.667 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.701 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:ea534db1:::obj-1-311:head# 2020-09-08T15:59:59.701 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.733 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:eabcc188:::obj-1-325:head# 2020-09-08T15:59:59.734 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.767 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:eb086660:::obj-1-595:head# 2020-09-08T15:59:59.767 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.800 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:eb2235d3:::obj-1-596:head# 2020-09-08T15:59:59.801 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.834 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:eb35ae40:::obj-1-516:head# 2020-09-08T15:59:59.834 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.867 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:eb360a13:::obj-1-224:head# 2020-09-08T15:59:59.867 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.892 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:eb3a3ea1:::obj-1-120:head# 2020-09-08T15:59:59.892 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.925 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:ebca9f6e:::obj-1-290:head# 2020-09-08T15:59:59.926 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T15:59:59.959 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:ec81db71:::obj-1-478:head# 2020-09-08T15:59:59.959 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.000 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:edeafa4c:::obj-1-362:head# 2020-09-08T16:00:00.001 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.025 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:eeb5261b:::obj-1-539:head# 2020-09-08T16:00:00.026 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.059 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:eec00eee:::obj-1-567:head# 2020-09-08T16:00:00.059 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.092 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:ef075e10:::obj-1-463:head# 2020-09-08T16:00:00.092 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.125 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:ef8e37d9:::obj-1-94:head# 2020-09-08T16:00:00.126 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.159 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:efad7f67:::obj-1-197:head# 2020-09-08T16:00:00.159 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.200 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:efe09ea7:::obj-1-537:head# 2020-09-08T16:00:00.201 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.234 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f0445019:::obj-1-480:head# 2020-09-08T16:00:00.235 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.267 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f08a432c:::obj-1-489:head# 2020-09-08T16:00:00.267 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.300 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f0bd9006:::obj-1-487:head# 2020-09-08T16:00:00.301 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.334 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f11a115d:::obj-1-591:head# 2020-09-08T16:00:00.335 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.367 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f232e0af:::obj-1-146:head# 2020-09-08T16:00:00.368 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.400 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f258db54:::obj-1-521:head# 2020-09-08T16:00:00.401 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.434 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f29cc204:::obj-1-566:head# 2020-09-08T16:00:00.434 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.467 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f2ae2451:::obj-1-66:head# 2020-09-08T16:00:00.468 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.500 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f318810a:::obj-1-160:head# 2020-09-08T16:00:00.501 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.534 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f3c35a0d:::obj-1-67:head# 2020-09-08T16:00:00.534 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.567 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f3ce9c90:::obj-1-88:head# 2020-09-08T16:00:00.568 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.600 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f3e3e81f:::obj-1-304:head# 2020-09-08T16:00:00.601 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.634 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f3f65b0a:::obj-1-367:head# 2020-09-08T16:00:00.634 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.667 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f4ea014b:::obj-1-149:head# 2020-09-08T16:00:00.668 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.701 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f52d115b:::obj-1-383:head# 2020-09-08T16:00:00.701 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.742 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f590311e:::obj-1-76:head# 2020-09-08T16:00:00.743 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.784 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f5a37734:::obj-1-51:head# 2020-09-08T16:00:00.784 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.817 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f5e2e77c:::obj-1-179:head# 2020-09-08T16:00:00.818 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.851 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f5e381bc:::obj-1-173:head# 2020-09-08T16:00:00.851 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.884 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f6c0ae0b:::obj-1-247:head# 2020-09-08T16:00:00.884 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.922 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f6db8a82:::obj-1-548:head# 2020-09-08T16:00:00.923 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:00.953 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f6e2dc46:::obj-1-36:head# 2020-09-08T16:00:00.953 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:01.024 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f76ee569:::obj-1-587:head# 2020-09-08T16:00:01.025 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:01.059 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f773b9ed:::obj-1-550:head# 2020-09-08T16:00:01.059 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:01.094 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f7e1adad:::obj-1-350:head# 2020-09-08T16:00:01.095 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:01.126 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f7eebf7a:::obj-1-559:head# 2020-09-08T16:00:01.126 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:01.159 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f877f025:::obj-1-187:head# 2020-09-08T16:00:01.160 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:01.209 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f992f9e9:::obj-1-402:head# 2020-09-08T16:00:01.210 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:01.251 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:f9fe960a:::obj-1-418:head# 2020-09-08T16:00:01.251 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:01.284 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:fa9b882f:::obj-1-165:head# 2020-09-08T16:00:01.285 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:01.309 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:fbd6461c:::obj-1-339:head# 2020-09-08T16:00:01.309 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:01.334 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:fbeab28d:::obj-1-431:head# 2020-09-08T16:00:01.334 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:01.359 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:fdea4138:::obj-1-185:head# 2020-09-08T16:00:01.360 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:01.384 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:fdfa7c9b:::obj-1-183:head# 2020-09-08T16:00:01.384 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:01.409 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:fe1ba57e:::obj-1-90:head# 2020-09-08T16:00:01.410 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:01.434 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:feb7adea:::obj-1-560:head# 2020-09-08T16:00:01.435 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:01.468 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:ffab306e:::obj-1-97:head# 2020-09-08T16:00:01.468 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:01.493 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:ffdfd397:::obj-1-433:head# 2020-09-08T16:00:01.493 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:01.518 INFO:tasks.workunit.client.0.smithi065.stdout:Write #2:ffe8cf04:::obj-1-303:head# 2020-09-08T16:00:01.518 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:01.543 INFO:tasks.workunit.client.0.smithi065.stdout:write_pg epoch 41 info 2.0( v 41'600 (41'500,41'600] local-lis/les=39/40 n=600 ec=26/26 lis/c=39/39 les/c/f=40/40/0 sis=39) 2020-09-08T16:00:01.576 INFO:tasks.workunit.client.0.smithi065.stdout:Import successful 2020-09-08T16:00:02.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:493: TEST_backfill_multi_partial: _objectstore_tool_nodown td/osd-backfill-space 1 --op import --pgid 1.0 --file td/osd-backfill-space/fillexport.out 2020-09-08T16:00:02.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local dir=td/osd-backfill-space 2020-09-08T16:00:02.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2020-09-08T16:00:02.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local id=1 2020-09-08T16:00:02.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1198: _objectstore_tool_nodown: shift 2020-09-08T16:00:02.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: _objectstore_tool_nodown: local osd_data=td/osd-backfill-space/1 2020-09-08T16:00:02.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1202: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-space/1 --op import --pgid 1.0 --file td/osd-backfill-space/fillexport.out 2020-09-08T16:00:02.926 INFO:tasks.workunit.client.0.smithi065.stdout:get_pg_num_history pg_num_history pg_num_history(e44 pg_nums {1={20=1},2={26=1},3={31=1}} deleted_pools ) 2020-09-08T16:00:02.927 INFO:tasks.workunit.client.0.smithi065.stdout:Importing pgid 1.0 2020-09-08T16:00:02.927 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:0002d87b:::obj-fill-318:head# 2020-09-08T16:00:02.927 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.026 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:00676868:::obj-fill-583:head# 2020-09-08T16:00:03.027 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.060 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:00f4514e:::obj-fill-547:head# 2020-09-08T16:00:03.060 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.093 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:01596a3c:::obj-fill-533:head# 2020-09-08T16:00:03.093 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.126 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:0285e89c:::obj-fill-190:head# 2020-09-08T16:00:03.127 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.160 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:02bd591e:::obj-fill-463:head# 2020-09-08T16:00:03.160 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.221 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:02c01ffe:::obj-fill-28:head# 2020-09-08T16:00:03.222 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.276 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:03ada31e:::obj-fill-285:head# 2020-09-08T16:00:03.277 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.318 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:03b07c3f:::obj-fill-568:head# 2020-09-08T16:00:03.318 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.361 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:03b85770:::obj-fill-573:head# 2020-09-08T16:00:03.370 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.401 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:03dcbe89:::obj-fill-375:head# 2020-09-08T16:00:03.402 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.443 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:04231826:::obj-fill-594:head# 2020-09-08T16:00:03.443 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.485 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:04d48684:::obj-fill-421:head# 2020-09-08T16:00:03.485 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.526 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:05385fcc:::obj-fill-299:head# 2020-09-08T16:00:03.527 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.576 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:05785d38:::obj-fill-159:head# 2020-09-08T16:00:03.577 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.626 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:057ec231:::obj-fill-138:head# 2020-09-08T16:00:03.627 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.669 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:06058b5e:::obj-fill-569:head# 2020-09-08T16:00:03.669 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.710 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:06d2a3d9:::obj-fill-284:head# 2020-09-08T16:00:03.711 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.760 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:07597b63:::obj-fill-459:head# 2020-09-08T16:00:03.760 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.801 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:075f4069:::obj-fill-550:head# 2020-09-08T16:00:03.802 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.839 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:08234052:::obj-fill-17:head# 2020-09-08T16:00:03.839 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.877 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:091ce2ec:::obj-fill-472:head# 2020-09-08T16:00:03.877 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.918 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:095fd509:::obj-fill-210:head# 2020-09-08T16:00:03.919 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.952 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:0a52a594:::obj-fill-116:head# 2020-09-08T16:00:03.952 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:03.985 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:0a63716b:::obj-fill-225:head# 2020-09-08T16:00:03.985 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.018 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:0b0fa6fb:::obj-fill-541:head# 2020-09-08T16:00:04.019 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.051 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:0b673f72:::obj-fill-232:head# 2020-09-08T16:00:04.052 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.085 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:0bbcd1b2:::obj-fill-582:head# 2020-09-08T16:00:04.086 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.118 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:0caf8ce3:::obj-fill-214:head# 2020-09-08T16:00:04.119 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.152 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:0d94b9fb:::obj-fill-415:head# 2020-09-08T16:00:04.153 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.185 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:0de4e6f7:::obj-fill-94:head# 2020-09-08T16:00:04.185 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.218 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:0ef75768:::obj-fill-489:head# 2020-09-08T16:00:04.219 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.252 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:0f67284f:::obj-fill-213:head# 2020-09-08T16:00:04.252 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.285 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:0f823df2:::obj-fill-234:head# 2020-09-08T16:00:04.286 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.319 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:1005c08d:::obj-fill-490:head# 2020-09-08T16:00:04.319 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.352 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:1039525f:::obj-fill-369:head# 2020-09-08T16:00:04.352 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.409 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:105fb36c:::obj-fill-226:head# 2020-09-08T16:00:04.409 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.468 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:111abdeb:::obj-fill-554:head# 2020-09-08T16:00:04.469 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.502 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:11392f3d:::obj-fill-453:head# 2020-09-08T16:00:04.502 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.541 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:1169976c:::obj-fill-417:head# 2020-09-08T16:00:04.542 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.568 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:11840a2a:::obj-fill-477:head# 2020-09-08T16:00:04.569 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.602 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:11a4832e:::obj-fill-279:head# 2020-09-08T16:00:04.602 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.636 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:11a4d2f6:::obj-fill-256:head# 2020-09-08T16:00:04.636 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.669 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:12d52a31:::obj-fill-22:head# 2020-09-08T16:00:04.669 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.702 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:133c45db:::obj-fill-257:head# 2020-09-08T16:00:04.702 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.735 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:13563256:::obj-fill-150:head# 2020-09-08T16:00:04.736 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.777 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:13c09e00:::obj-fill-71:head# 2020-09-08T16:00:04.777 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.810 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:13e9fbed:::obj-fill-242:head# 2020-09-08T16:00:04.811 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.843 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:13fae6c2:::obj-fill-163:head# 2020-09-08T16:00:04.845 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.877 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:145025e0:::obj-fill-543:head# 2020-09-08T16:00:04.877 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.910 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:14517c84:::obj-fill-13:head# 2020-09-08T16:00:04.911 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:04.944 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:14802e9c:::obj-fill-127:head# 2020-09-08T16:00:04.946 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.028 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:150f1c96:::obj-fill-62:head# 2020-09-08T16:00:05.029 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.060 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:155e90a2:::obj-fill-537:head# 2020-09-08T16:00:05.061 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.110 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:1632c776:::obj-fill-262:head# 2020-09-08T16:00:05.111 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.144 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:163bde28:::obj-fill-523:head# 2020-09-08T16:00:05.144 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.177 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:169c4ad0:::obj-fill-85:head# 2020-09-08T16:00:05.178 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.237 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:16c4da1d:::obj-fill-436:head# 2020-09-08T16:00:05.238 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.294 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:17b28c32:::obj-fill-345:head# 2020-09-08T16:00:05.294 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.327 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:17b34255:::obj-fill-577:head# 2020-09-08T16:00:05.328 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.360 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:17d2541f:::obj-fill-426:head# 2020-09-08T16:00:05.361 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.394 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:17ea19f2:::obj-fill-542:head# 2020-09-08T16:00:05.394 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.427 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:189155ea:::obj-fill-496:head# 2020-09-08T16:00:05.427 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.460 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:191a6d81:::obj-fill-548:head# 2020-09-08T16:00:05.461 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.494 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:1a964993:::obj-fill-576:head# 2020-09-08T16:00:05.494 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.555 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:1aa623dc:::obj-fill-356:head# 2020-09-08T16:00:05.555 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.585 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:1abe5c38:::obj-fill-561:head# 2020-09-08T16:00:05.586 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.619 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:1bddc06b:::obj-fill-7:head# 2020-09-08T16:00:05.620 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.652 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:1be86b71:::obj-fill-295:head# 2020-09-08T16:00:05.653 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.686 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:1c499bca:::obj-fill-240:head# 2020-09-08T16:00:05.686 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.719 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:1c545e27:::obj-fill-509:head# 2020-09-08T16:00:05.719 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.752 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:1c63c8f4:::obj-fill-4:head# 2020-09-08T16:00:05.753 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.786 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:1d5a8f59:::obj-fill-377:head# 2020-09-08T16:00:05.786 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.831 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:1d85b5df:::obj-fill-201:head# 2020-09-08T16:00:05.831 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.869 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:1d9a0d5b:::obj-fill-581:head# 2020-09-08T16:00:05.869 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.911 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:1dcf5667:::obj-fill-488:head# 2020-09-08T16:00:05.911 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.954 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:1fa3090d:::obj-fill-458:head# 2020-09-08T16:00:05.955 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:05.994 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:1fe937f6:::obj-fill-337:head# 2020-09-08T16:00:05.995 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.036 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:1ff54542:::obj-fill-349:head# 2020-09-08T16:00:06.036 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.077 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:20d9e0ca:::obj-fill-367:head# 2020-09-08T16:00:06.078 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.119 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:21b8e3bb:::obj-fill-538:head# 2020-09-08T16:00:06.119 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.169 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:227183d4:::obj-fill-235:head# 2020-09-08T16:00:06.170 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.211 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:229e5e5d:::obj-fill-522:head# 2020-09-08T16:00:06.211 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.253 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:234f8861:::obj-fill-476:head# 2020-09-08T16:00:06.253 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.294 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:23ac2c9d:::obj-fill-471:head# 2020-09-08T16:00:06.295 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.336 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:25db1742:::obj-fill-200:head# 2020-09-08T16:00:06.337 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.378 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:264f8545:::obj-fill-230:head# 2020-09-08T16:00:06.378 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.419 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:267ba97f:::obj-fill-493:head# 2020-09-08T16:00:06.420 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.452 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:26b067e8:::obj-fill-208:head# 2020-09-08T16:00:06.453 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.486 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:26f521cb:::obj-fill-300:head# 2020-09-08T16:00:06.486 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.519 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:27e70a11:::obj-fill-368:head# 2020-09-08T16:00:06.520 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.553 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:29357d4a:::obj-fill-456:head# 2020-09-08T16:00:06.553 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.586 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:29f2567e:::obj-fill-414:head# 2020-09-08T16:00:06.586 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.619 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2a10cbb6:::obj-fill-228:head# 2020-09-08T16:00:06.620 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.653 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2a1519a6:::obj-fill-148:head# 2020-09-08T16:00:06.653 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.686 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2a686ca6:::obj-fill-411:head# 2020-09-08T16:00:06.686 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.719 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2ab3f384:::obj-fill-77:head# 2020-09-08T16:00:06.720 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.753 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2ae6a1d0:::obj-fill-187:head# 2020-09-08T16:00:06.753 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.786 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2b890959:::obj-fill-222:head# 2020-09-08T16:00:06.787 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.820 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2bcc26c4:::obj-fill-114:head# 2020-09-08T16:00:06.820 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.853 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2bd3a3a2:::obj-fill-281:head# 2020-09-08T16:00:06.853 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.895 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2c1a21d7:::obj-fill-505:head# 2020-09-08T16:00:06.895 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.928 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2c255347:::obj-fill-95:head# 2020-09-08T16:00:06.928 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:06.993 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2c2a3f62:::obj-fill-131:head# 2020-09-08T16:00:06.994 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.061 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2c7d92ce:::obj-fill-442:head# 2020-09-08T16:00:07.062 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.100 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2d1ad117:::obj-fill-443:head# 2020-09-08T16:00:07.101 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.128 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2d57b2f7:::obj-fill-192:head# 2020-09-08T16:00:07.128 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.228 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2d7b53ea:::obj-fill-79:head# 2020-09-08T16:00:07.228 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.295 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2db25266:::obj-fill-121:head# 2020-09-08T16:00:07.295 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.328 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2e27853e:::obj-fill-473:head# 2020-09-08T16:00:07.329 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.361 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2f12cb21:::obj-fill-386:head# 2020-09-08T16:00:07.362 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.395 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2f957332:::obj-fill-422:head# 2020-09-08T16:00:07.395 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.428 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:2feae493:::obj-fill-301:head# 2020-09-08T16:00:07.429 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.462 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:302c95d2:::obj-fill-110:head# 2020-09-08T16:00:07.462 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.495 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:302d6b76:::obj-fill-374:head# 2020-09-08T16:00:07.495 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.528 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:30581f34:::obj-fill-313:head# 2020-09-08T16:00:07.529 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.562 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:307e86ac:::obj-fill-381:head# 2020-09-08T16:00:07.562 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.595 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:30ab77bf:::obj-fill-275:head# 2020-09-08T16:00:07.595 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.631 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:31127e6d:::obj-fill-250:head# 2020-09-08T16:00:07.631 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.662 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:32c93500:::obj-fill-155:head# 2020-09-08T16:00:07.662 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.695 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:339880b7:::obj-fill-227:head# 2020-09-08T16:00:07.695 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.728 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:34069e1e:::obj-fill-292:head# 2020-09-08T16:00:07.729 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.762 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:346dff31:::obj-fill-157:head# 2020-09-08T16:00:07.762 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.795 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:34ade0f1:::obj-fill-575:head# 2020-09-08T16:00:07.796 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.828 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:34bbae43:::obj-fill-90:head# 2020-09-08T16:00:07.829 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.862 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:34e97cf8:::obj-fill-334:head# 2020-09-08T16:00:07.862 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.896 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:35d7ccc2:::obj-fill-510:head# 2020-09-08T16:00:07.896 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.928 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:35f519b6:::obj-fill-513:head# 2020-09-08T16:00:07.929 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:07.962 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:364727e8:::obj-fill-130:head# 2020-09-08T16:00:07.962 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.003 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:364c0361:::obj-fill-586:head# 2020-09-08T16:00:08.004 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.038 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:368e7baf:::obj-fill-546:head# 2020-09-08T16:00:08.038 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.070 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:36ffb224:::obj-fill-82:head# 2020-09-08T16:00:08.071 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.104 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:371cb800:::obj-fill-330:head# 2020-09-08T16:00:08.104 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.137 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:37d5378d:::obj-fill-175:head# 2020-09-08T16:00:08.137 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.171 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:385593f3:::obj-fill-325:head# 2020-09-08T16:00:08.171 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.204 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:388d5073:::obj-fill-317:head# 2020-09-08T16:00:08.204 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.238 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:394af079:::obj-fill-59:head# 2020-09-08T16:00:08.239 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.270 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:3a41ad37:::obj-fill-409:head# 2020-09-08T16:00:08.271 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.303 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:3b3c63d2:::obj-fill-136:head# 2020-09-08T16:00:08.304 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.340 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:3bb50131:::obj-fill-512:head# 2020-09-08T16:00:08.340 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.379 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:3bb52bb5:::obj-fill-188:head# 2020-09-08T16:00:08.379 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.420 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:3c0683d1:::obj-fill-372:head# 2020-09-08T16:00:08.421 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.464 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:3c67d3f4:::obj-fill-249:head# 2020-09-08T16:00:08.465 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.504 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:3c6a4a4c:::obj-fill-495:head# 2020-09-08T16:00:08.504 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.545 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:3c7fc8c9:::obj-fill-324:head# 2020-09-08T16:00:08.546 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.592 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:3d940c50:::obj-fill-591:head# 2020-09-08T16:00:08.593 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.630 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:3ed5508e:::obj-fill-558:head# 2020-09-08T16:00:08.631 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.674 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:3f598316:::obj-fill-389:head# 2020-09-08T16:00:08.674 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.712 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:401cd0ce:::obj-fill-251:head# 2020-09-08T16:00:08.712 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.754 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:40fae006:::obj-fill-14:head# 2020-09-08T16:00:08.754 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.797 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:4120b10f:::obj-fill-165:head# 2020-09-08T16:00:08.797 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.837 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:41b382c2:::obj-fill-289:head# 2020-09-08T16:00:08.838 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.880 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:4277cdea:::obj-fill-319:head# 2020-09-08T16:00:08.880 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.921 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:42978c3c:::obj-fill-174:head# 2020-09-08T16:00:08.921 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:08.975 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:42b08dc2:::obj-fill-553:head# 2020-09-08T16:00:08.976 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.052 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:42ec4bf6:::obj-fill-209:head# 2020-09-08T16:00:09.053 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.071 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:430c129d:::obj-fill-448:head# 2020-09-08T16:00:09.071 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.105 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:4335d553:::obj-fill-600:head# 2020-09-08T16:00:09.105 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.137 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:44804f62:::obj-fill-532:head# 2020-09-08T16:00:09.137 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.210 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:44954d54:::obj-fill-2:head# 2020-09-08T16:00:09.210 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.246 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:4502f904:::obj-fill-429:head# 2020-09-08T16:00:09.247 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.287 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:4568ddcb:::obj-fill-382:head# 2020-09-08T16:00:09.288 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.321 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:45939974:::obj-fill-563:head# 2020-09-08T16:00:09.322 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.355 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:462a5bbd:::obj-fill-567:head# 2020-09-08T16:00:09.355 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.387 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:47773ae4:::obj-fill-307:head# 2020-09-08T16:00:09.388 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.437 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:4802b263:::obj-fill-387:head# 2020-09-08T16:00:09.438 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.505 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:483d938e:::obj-fill-128:head# 2020-09-08T16:00:09.505 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.542 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:48a7ad29:::obj-fill-147:head# 2020-09-08T16:00:09.542 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.571 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:493b61ce:::obj-fill-454:head# 2020-09-08T16:00:09.571 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.605 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:4afb70fe:::obj-fill-186:head# 2020-09-08T16:00:09.606 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.637 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:4bff08e3:::obj-fill-352:head# 2020-09-08T16:00:09.638 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.671 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:4c01eabe:::obj-fill-370:head# 2020-09-08T16:00:09.671 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.704 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:4c131560:::obj-fill-6:head# 2020-09-08T16:00:09.705 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.739 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:4c4c5e14:::obj-fill-350:head# 2020-09-08T16:00:09.740 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.771 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:4c80dc2c:::obj-fill-357:head# 2020-09-08T16:00:09.772 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.804 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:4c9dee9b:::obj-fill-540:head# 2020-09-08T16:00:09.804 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.838 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:4ce40c18:::obj-fill-280:head# 2020-09-08T16:00:09.838 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.871 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:4d854fc3:::obj-fill-585:head# 2020-09-08T16:00:09.871 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.904 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:4f615b53:::obj-fill-101:head# 2020-09-08T16:00:09.904 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.938 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5042b30f:::obj-fill-84:head# 2020-09-08T16:00:09.938 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:09.971 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:507dc08b:::obj-fill-336:head# 2020-09-08T16:00:09.971 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.004 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:512fcf5a:::obj-fill-169:head# 2020-09-08T16:00:10.004 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.046 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:51a0c8f8:::obj-fill-578:head# 2020-09-08T16:00:10.046 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.087 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:51fd05a2:::obj-fill-425:head# 2020-09-08T16:00:10.088 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.121 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:52400ebc:::obj-fill-81:head# 2020-09-08T16:00:10.121 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.154 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5288d40c:::obj-fill-16:head# 2020-09-08T16:00:10.155 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.189 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5295b0ee:::obj-fill-224:head# 2020-09-08T16:00:10.189 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.221 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:531e4c60:::obj-fill-103:head# 2020-09-08T16:00:10.221 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.254 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:54259f28:::obj-fill-584:head# 2020-09-08T16:00:10.255 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.289 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:542d619c:::obj-fill-528:head# 2020-09-08T16:00:10.289 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.323 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5503ca3e:::obj-fill-494:head# 2020-09-08T16:00:10.323 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.356 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5555c48b:::obj-fill-403:head# 2020-09-08T16:00:10.356 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.389 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:558d1ec7:::obj-fill-447:head# 2020-09-08T16:00:10.390 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.432 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:55aa2233:::obj-fill-21:head# 2020-09-08T16:00:10.432 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.464 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:55aaf8c4:::obj-fill-29:head# 2020-09-08T16:00:10.464 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.498 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:55e246e1:::obj-fill-65:head# 2020-09-08T16:00:10.498 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.534 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:563b14a8:::obj-fill-120:head# 2020-09-08T16:00:10.534 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.581 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:56e1df25:::obj-fill-305:head# 2020-09-08T16:00:10.581 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.614 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5702979c:::obj-fill-73:head# 2020-09-08T16:00:10.615 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.651 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:570722ba:::obj-fill-219:head# 2020-09-08T16:00:10.651 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.682 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:57f7a09b:::obj-fill-571:head# 2020-09-08T16:00:10.683 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.726 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:585309ba:::obj-fill-144:head# 2020-09-08T16:00:10.727 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.756 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:585c7c9c:::obj-fill-437:head# 2020-09-08T16:00:10.756 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.789 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:587c63db:::obj-fill-182:head# 2020-09-08T16:00:10.790 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.823 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:58f34d6b:::obj-fill-598:head# 2020-09-08T16:00:10.823 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.856 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:58f40088:::obj-fill-298:head# 2020-09-08T16:00:10.856 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.889 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:591e150c:::obj-fill-32:head# 2020-09-08T16:00:10.890 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.923 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:59971ddb:::obj-fill-559:head# 2020-09-08T16:00:10.923 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:10.975 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5adafca4:::obj-fill-56:head# 2020-09-08T16:00:10.975 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.042 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5b32b04f:::obj-fill-484:head# 2020-09-08T16:00:11.042 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.073 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5bdaeb16:::obj-fill-99:head# 2020-09-08T16:00:11.073 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.106 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5c1d6f4b:::obj-fill-133:head# 2020-09-08T16:00:11.107 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.140 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5c92b8f1:::obj-fill-255:head# 2020-09-08T16:00:11.140 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.201 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5ca4850f:::obj-fill-238:head# 2020-09-08T16:00:11.201 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.253 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5d928a5b:::obj-fill-395:head# 2020-09-08T16:00:11.254 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.281 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5dd49320:::obj-fill-423:head# 2020-09-08T16:00:11.282 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.315 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5e7bc368:::obj-fill-506:head# 2020-09-08T16:00:11.315 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.348 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5ebd5ee3:::obj-fill-322:head# 2020-09-08T16:00:11.348 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.381 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5edeedf1:::obj-fill-557:head# 2020-09-08T16:00:11.382 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.423 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:5facf8e2:::obj-fill-15:head# 2020-09-08T16:00:11.423 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.465 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:603a2c76:::obj-fill-439:head# 2020-09-08T16:00:11.465 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.498 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:60b30714:::obj-fill-53:head# 2020-09-08T16:00:11.498 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.531 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:612b4a8a:::obj-fill-412:head# 2020-09-08T16:00:11.532 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.565 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:61a111b6:::obj-fill-87:head# 2020-09-08T16:00:11.566 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.610 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:63a0e8a2:::obj-fill-266:head# 2020-09-08T16:00:11.611 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.631 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:63aa4d60:::obj-fill-68:head# 2020-09-08T16:00:11.632 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.665 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:63ac5b95:::obj-fill-405:head# 2020-09-08T16:00:11.665 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.698 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:6415a9e3:::obj-fill-400:head# 2020-09-08T16:00:11.698 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.731 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:64ba03ae:::obj-fill-20:head# 2020-09-08T16:00:11.732 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.770 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:6512f015:::obj-fill-597:head# 2020-09-08T16:00:11.771 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.798 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:65433104:::obj-fill-504:head# 2020-09-08T16:00:11.799 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.832 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:65950c58:::obj-fill-86:head# 2020-09-08T16:00:11.832 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.865 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:65b6b2d7:::obj-fill-39:head# 2020-09-08T16:00:11.866 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.900 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:661c8afd:::obj-fill-267:head# 2020-09-08T16:00:11.901 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.932 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:66f87c94:::obj-fill-229:head# 2020-09-08T16:00:11.932 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.966 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:67292cef:::obj-fill-93:head# 2020-09-08T16:00:11.966 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:11.998 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:67f0e12c:::obj-fill-363:head# 2020-09-08T16:00:11.999 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.032 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:696eb83b:::obj-fill-185:head# 2020-09-08T16:00:12.032 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.069 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:6b33981c:::obj-fill-259:head# 2020-09-08T16:00:12.070 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.098 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:6b5a527c:::obj-fill-485:head# 2020-09-08T16:00:12.099 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.132 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:6b6f1852:::obj-fill-390:head# 2020-09-08T16:00:12.132 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.165 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:6ba5c5f8:::obj-fill-304:head# 2020-09-08T16:00:12.165 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.198 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:6bce929d:::obj-fill-518:head# 2020-09-08T16:00:12.199 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.232 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:6c8ffc04:::obj-fill-61:head# 2020-09-08T16:00:12.232 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.265 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:6ca7e551:::obj-fill-40:head# 2020-09-08T16:00:12.265 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.298 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:6caff2cd:::obj-fill-332:head# 2020-09-08T16:00:12.299 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.337 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:6ce4adc7:::obj-fill-574:head# 2020-09-08T16:00:12.337 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.365 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:6d09d770:::obj-fill-74:head# 2020-09-08T16:00:12.366 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.405 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:6e039822:::obj-fill-278:head# 2020-09-08T16:00:12.406 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.432 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:6f2cd109:::obj-fill-297:head# 2020-09-08T16:00:12.432 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.465 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:6f3754c4:::obj-fill-88:head# 2020-09-08T16:00:12.466 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.498 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:6f86cfd2:::obj-fill-511:head# 2020-09-08T16:00:12.499 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.533 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:6fe3f3f7:::obj-fill-193:head# 2020-09-08T16:00:12.534 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.568 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7002c57d:::obj-fill-50:head# 2020-09-08T16:00:12.568 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.599 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7030b2a3:::obj-fill-217:head# 2020-09-08T16:00:12.599 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.632 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:70665087:::obj-fill-51:head# 2020-09-08T16:00:12.632 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.665 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:70a0f5e0:::obj-fill-11:head# 2020-09-08T16:00:12.666 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.715 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:71f4643d:::obj-fill-236:head# 2020-09-08T16:00:12.716 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.749 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:722fbd0f:::obj-fill-302:head# 2020-09-08T16:00:12.749 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.782 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:72584da9:::obj-fill-445:head# 2020-09-08T16:00:12.783 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.815 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:72d91d24:::obj-fill-218:head# 2020-09-08T16:00:12.816 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.849 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:72f7268b:::obj-fill-106:head# 2020-09-08T16:00:12.849 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.882 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:74077abf:::obj-fill-435:head# 2020-09-08T16:00:12.882 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.915 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:740ca050:::obj-fill-112:head# 2020-09-08T16:00:12.916 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:12.949 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7435e881:::obj-fill-78:head# 2020-09-08T16:00:12.949 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.024 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:74ba0bb7:::obj-fill-478:head# 2020-09-08T16:00:13.025 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.057 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:74d82091:::obj-fill-96:head# 2020-09-08T16:00:13.057 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.097 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7515f56c:::obj-fill-483:head# 2020-09-08T16:00:13.097 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.124 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7550d6fe:::obj-fill-286:head# 2020-09-08T16:00:13.124 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.157 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:75807edc:::obj-fill-223:head# 2020-09-08T16:00:13.158 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.209 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:762ba324:::obj-fill-172:head# 2020-09-08T16:00:13.209 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.249 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:76369bda:::obj-fill-570:head# 2020-09-08T16:00:13.249 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.282 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7667a5b0:::obj-fill-196:head# 2020-09-08T16:00:13.282 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.315 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:77736c0c:::obj-fill-566:head# 2020-09-08T16:00:13.316 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.351 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:77fb47a4:::obj-fill-314:head# 2020-09-08T16:00:13.351 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.382 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:785ad894:::obj-fill-80:head# 2020-09-08T16:00:13.383 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.416 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:785e3d14:::obj-fill-530:head# 2020-09-08T16:00:13.416 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.449 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:788efef4:::obj-fill-595:head# 2020-09-08T16:00:13.450 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.483 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:789ec5ab:::obj-fill-44:head# 2020-09-08T16:00:13.483 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.516 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:798a3fa8:::obj-fill-517:head# 2020-09-08T16:00:13.516 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.562 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:79a105ef:::obj-fill-315:head# 2020-09-08T16:00:13.563 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.594 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:79d02f04:::obj-fill-243:head# 2020-09-08T16:00:13.595 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.624 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7a00dfcb:::obj-fill-402:head# 2020-09-08T16:00:13.625 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.658 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7b982684:::obj-fill-168:head# 2020-09-08T16:00:13.658 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.691 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7bb36851:::obj-fill-440:head# 2020-09-08T16:00:13.691 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.724 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7bb49d8c:::obj-fill-55:head# 2020-09-08T16:00:13.725 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.757 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7c77b783:::obj-fill-580:head# 2020-09-08T16:00:13.758 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.799 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7c89d75b:::obj-fill-555:head# 2020-09-08T16:00:13.799 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.841 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7d12fb67:::obj-fill-399:head# 2020-09-08T16:00:13.841 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.883 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7d139961:::obj-fill-92:head# 2020-09-08T16:00:13.883 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.924 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7d39ffd0:::obj-fill-135:head# 2020-09-08T16:00:13.925 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:13.967 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7e534cc4:::obj-fill-282:head# 2020-09-08T16:00:13.968 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.008 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7e7a08e0:::obj-fill-108:head# 2020-09-08T16:00:14.008 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.041 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7e8e2b67:::obj-fill-244:head# 2020-09-08T16:00:14.041 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.074 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7eea215e:::obj-fill-139:head# 2020-09-08T16:00:14.075 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.107 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7efa3c6e:::obj-fill-408:head# 2020-09-08T16:00:14.108 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.141 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7f03a24b:::obj-fill-45:head# 2020-09-08T16:00:14.141 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.175 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7f6a2e2b:::obj-fill-427:head# 2020-09-08T16:00:14.175 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.208 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7fb0abd6:::obj-fill-479:head# 2020-09-08T16:00:14.208 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.241 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:7fb77de1:::obj-fill-167:head# 2020-09-08T16:00:14.241 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.274 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:80012a03:::obj-fill-105:head# 2020-09-08T16:00:14.275 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.308 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:80075ae5:::obj-fill-376:head# 2020-09-08T16:00:14.308 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.341 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8089baa5:::obj-fill-97:head# 2020-09-08T16:00:14.341 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.374 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:80d0b4c5:::obj-fill-123:head# 2020-09-08T16:00:14.375 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.409 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:810f319f:::obj-fill-552:head# 2020-09-08T16:00:14.409 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.444 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:81427ef2:::obj-fill-474:head# 2020-09-08T16:00:14.444 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.497 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:818d780c:::obj-fill-33:head# 2020-09-08T16:00:14.497 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.550 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:819f31b9:::obj-fill-366:head# 2020-09-08T16:00:14.550 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.583 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8205549d:::obj-fill-125:head# 2020-09-08T16:00:14.584 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.616 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:821f56e5:::obj-fill-339:head# 2020-09-08T16:00:14.617 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.650 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:822807c6:::obj-fill-69:head# 2020-09-08T16:00:14.651 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.683 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:822fcf61:::obj-fill-560:head# 2020-09-08T16:00:14.683 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.716 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:82ad696b:::obj-fill-149:head# 2020-09-08T16:00:14.717 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.750 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:835cc771:::obj-fill-446:head# 2020-09-08T16:00:14.750 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.783 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8386bee1:::obj-fill-137:head# 2020-09-08T16:00:14.783 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.816 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:83c1303a:::obj-fill-311:head# 2020-09-08T16:00:14.817 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.850 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:83cf1c2a:::obj-fill-360:head# 2020-09-08T16:00:14.850 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.891 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:83d70321:::obj-fill-351:head# 2020-09-08T16:00:14.892 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.925 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:83ef162d:::obj-fill-331:head# 2020-09-08T16:00:14.925 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:14.974 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:840f8f20:::obj-fill-398:head# 2020-09-08T16:00:14.975 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.044 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:84d2e456:::obj-fill-207:head# 2020-09-08T16:00:15.045 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.091 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:856697ff:::obj-fill-333:head# 2020-09-08T16:00:15.092 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.125 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:858be937:::obj-fill-418:head# 2020-09-08T16:00:15.125 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.183 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:85a0b302:::obj-fill-438:head# 2020-09-08T16:00:15.184 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.242 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:85fa942e:::obj-fill-272:head# 2020-09-08T16:00:15.242 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.275 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:863eb6f8:::obj-fill-320:head# 2020-09-08T16:00:15.275 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.308 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:868d4588:::obj-fill-19:head# 2020-09-08T16:00:15.308 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.341 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8759d023:::obj-fill-466:head# 2020-09-08T16:00:15.363 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.375 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:88072111:::obj-fill-312:head# 2020-09-08T16:00:15.376 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.408 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:886edcef:::obj-fill-380:head# 2020-09-08T16:00:15.409 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.442 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:88ce753e:::obj-fill-43:head# 2020-09-08T16:00:15.443 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.475 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:890e1d83:::obj-fill-590:head# 2020-09-08T16:00:15.475 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.508 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:891566a3:::obj-fill-341:head# 2020-09-08T16:00:15.509 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.542 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:891ca235:::obj-fill-177:head# 2020-09-08T16:00:15.542 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.575 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:897fa9d0:::obj-fill-283:head# 2020-09-08T16:00:15.575 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.608 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:89cd304b:::obj-fill-592:head# 2020-09-08T16:00:15.609 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.649 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:89d04c4a:::obj-fill-388:head# 2020-09-08T16:00:15.650 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.675 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:89db45d9:::obj-fill-247:head# 2020-09-08T16:00:15.676 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.708 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8ad879c5:::obj-fill-492:head# 2020-09-08T16:00:15.709 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.742 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8af4b5de:::obj-fill-37:head# 2020-09-08T16:00:15.742 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.775 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8b132e86:::obj-fill-35:head# 2020-09-08T16:00:15.776 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.808 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8b80a60a:::obj-fill-100:head# 2020-09-08T16:00:15.809 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.842 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8bb64fa6:::obj-fill-599:head# 2020-09-08T16:00:15.843 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.875 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8bed03f5:::obj-fill-5:head# 2020-09-08T16:00:15.876 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.908 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8c60e135:::obj-fill-470:head# 2020-09-08T16:00:15.909 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.942 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8c774623:::obj-fill-38:head# 2020-09-08T16:00:15.942 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:15.975 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8cc528ae:::obj-fill-519:head# 2020-09-08T16:00:15.976 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.008 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8cf73826:::obj-fill-460:head# 2020-09-08T16:00:16.009 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.042 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8d3564b3:::obj-fill-452:head# 2020-09-08T16:00:16.042 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.075 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8dfe1ca2:::obj-fill-469:head# 2020-09-08T16:00:16.075 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.108 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8e527672:::obj-fill-246:head# 2020-09-08T16:00:16.109 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.158 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8e96103f:::obj-fill-444:head# 2020-09-08T16:00:16.159 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.192 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8ed6417f:::obj-fill-146:head# 2020-09-08T16:00:16.192 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.225 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8eda2ffc:::obj-fill-539:head# 2020-09-08T16:00:16.226 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.275 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8f08dd48:::obj-fill-26:head# 2020-09-08T16:00:16.276 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.325 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8f111b25:::obj-fill-18:head# 2020-09-08T16:00:16.326 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.368 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:8fde63f8:::obj-fill-338:head# 2020-09-08T16:00:16.368 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.409 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:9030746d:::obj-fill-468:head# 2020-09-08T16:00:16.409 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.450 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:9115d8a1:::obj-fill-260:head# 2020-09-08T16:00:16.451 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.496 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:91649909:::obj-fill-140:head# 2020-09-08T16:00:16.496 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.534 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:91c1081d:::obj-fill-404:head# 2020-09-08T16:00:16.534 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.575 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:91f42503:::obj-fill-216:head# 2020-09-08T16:00:16.576 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.617 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:927b34a0:::obj-fill-63:head# 2020-09-08T16:00:16.617 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.660 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:92a00a91:::obj-fill-467:head# 2020-09-08T16:00:16.660 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.702 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:930a7268:::obj-fill-450:head# 2020-09-08T16:00:16.703 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.734 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:93c3d0bf:::obj-fill-118:head# 2020-09-08T16:00:16.734 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.776 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:93ca7c9e:::obj-fill-132:head# 2020-09-08T16:00:16.776 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.809 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:942435d5:::obj-fill-378:head# 2020-09-08T16:00:16.809 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.842 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:9445f8c5:::obj-fill-245:head# 2020-09-08T16:00:16.843 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.881 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:9457c8d9:::obj-fill-535:head# 2020-09-08T16:00:16.882 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.909 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:950dc56e:::obj-fill-348:head# 2020-09-08T16:00:16.909 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.943 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:9559ee1d:::obj-fill-545:head# 2020-09-08T16:00:16.943 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:16.990 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:957c5cc4:::obj-fill-212:head# 2020-09-08T16:00:16.990 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.051 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:95bdac02:::obj-fill-588:head# 2020-09-08T16:00:17.051 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.084 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:95f202af:::obj-fill-126:head# 2020-09-08T16:00:17.084 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.117 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:96789003:::obj-fill-83:head# 2020-09-08T16:00:17.118 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.151 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:96d494a8:::obj-fill-316:head# 2020-09-08T16:00:17.151 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.184 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:97adb85b:::obj-fill-233:head# 2020-09-08T16:00:17.185 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.266 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:980d998c:::obj-fill-197:head# 2020-09-08T16:00:17.266 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.301 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:98235c44:::obj-fill-396:head# 2020-09-08T16:00:17.301 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.334 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:987d3b87:::obj-fill-327:head# 2020-09-08T16:00:17.335 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.367 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:990a5e24:::obj-fill-515:head# 2020-09-08T16:00:17.368 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.426 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:995fec05:::obj-fill-191:head# 2020-09-08T16:00:17.426 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.459 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:9a769b75:::obj-fill-587:head# 2020-09-08T16:00:17.460 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.493 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:9b141990:::obj-fill-394:head# 2020-09-08T16:00:17.493 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.534 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:9bb108fb:::obj-fill-579:head# 2020-09-08T16:00:17.535 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.567 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:9ce19d92:::obj-fill-361:head# 2020-09-08T16:00:17.568 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.602 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:9d8c3f95:::obj-fill-572:head# 2020-09-08T16:00:17.602 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.634 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:9e283e00:::obj-fill-254:head# 2020-09-08T16:00:17.635 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.668 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:9e3a1a61:::obj-fill-58:head# 2020-09-08T16:00:17.668 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.701 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:9e8f6029:::obj-fill-41:head# 2020-09-08T16:00:17.701 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.734 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:9ef117aa:::obj-fill-520:head# 2020-09-08T16:00:17.735 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.768 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:9f3bdfc2:::obj-fill-184:head# 2020-09-08T16:00:17.768 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.801 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:9fd89320:::obj-fill-364:head# 2020-09-08T16:00:17.801 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.834 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:9feb7062:::obj-fill-419:head# 2020-09-08T16:00:17.835 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.868 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a07504c4:::obj-fill-516:head# 2020-09-08T16:00:17.868 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.901 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a1897e34:::obj-fill-153:head# 2020-09-08T16:00:17.901 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.943 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a19a9d76:::obj-fill-30:head# 2020-09-08T16:00:17.943 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:17.976 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a1a49c98:::obj-fill-98:head# 2020-09-08T16:00:17.976 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.009 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a1ea911a:::obj-fill-36:head# 2020-09-08T16:00:18.010 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.043 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a24bad98:::obj-fill-335:head# 2020-09-08T16:00:18.043 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.076 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a263b16f:::obj-fill-326:head# 2020-09-08T16:00:18.077 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.109 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a27d661e:::obj-fill-152:head# 2020-09-08T16:00:18.110 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.143 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a282a129:::obj-fill-451:head# 2020-09-08T16:00:18.143 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.176 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a28f05ba:::obj-fill-241:head# 2020-09-08T16:00:18.176 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.210 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a2cdc5cc:::obj-fill-180:head# 2020-09-08T16:00:18.210 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.243 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a30777ea:::obj-fill-486:head# 2020-09-08T16:00:18.243 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.269 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a3a65661:::obj-fill-151:head# 2020-09-08T16:00:18.273 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.293 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a3cb2967:::obj-fill-195:head# 2020-09-08T16:00:18.293 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.318 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a3ffc098:::obj-fill-293:head# 2020-09-08T16:00:18.319 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.343 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a4a31ccc:::obj-fill-413:head# 2020-09-08T16:00:18.343 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.369 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a51c3677:::obj-fill-384:head# 2020-09-08T16:00:18.369 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.393 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a5e941a7:::obj-fill-141:head# 2020-09-08T16:00:18.393 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.418 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a6cdd8b2:::obj-fill-342:head# 2020-09-08T16:00:18.418 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.443 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a6e20b86:::obj-fill-593:head# 2020-09-08T16:00:18.443 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.468 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a7a9ccf9:::obj-fill-129:head# 2020-09-08T16:00:18.469 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.493 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a7b702d3:::obj-fill-49:head# 2020-09-08T16:00:18.493 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.518 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a8daf8bd:::obj-fill-391:head# 2020-09-08T16:00:18.519 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.543 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:a99c3cef:::obj-fill-171:head# 2020-09-08T16:00:18.544 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.568 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:aabb5718:::obj-fill-521:head# 2020-09-08T16:00:18.568 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.593 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ab0cb851:::obj-fill-183:head# 2020-09-08T16:00:18.593 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.618 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ab7a05e4:::obj-fill-203:head# 2020-09-08T16:00:18.618 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.643 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ab7dda83:::obj-fill-113:head# 2020-09-08T16:00:18.644 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.677 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:abb3502c:::obj-fill-461:head# 2020-09-08T16:00:18.677 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.710 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ac1c41be:::obj-fill-162:head# 2020-09-08T16:00:18.710 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.743 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ac2114ba:::obj-fill-239:head# 2020-09-08T16:00:18.744 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.777 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ad355fca:::obj-fill-271:head# 2020-09-08T16:00:18.777 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.810 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ad4634a0:::obj-fill-487:head# 2020-09-08T16:00:18.810 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.843 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:add2bb13:::obj-fill-31:head# 2020-09-08T16:00:18.844 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.877 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:aeb6258d:::obj-fill-124:head# 2020-09-08T16:00:18.877 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.910 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:af17f7d7:::obj-fill-464:head# 2020-09-08T16:00:18.910 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.943 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:af1e1cf0:::obj-fill-237:head# 2020-09-08T16:00:18.944 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:18.990 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:afc439ce:::obj-fill-248:head# 2020-09-08T16:00:18.991 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.044 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:afceab4d:::obj-fill-527:head# 2020-09-08T16:00:19.045 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.077 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b03af40c:::obj-fill-143:head# 2020-09-08T16:00:19.077 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.110 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b04cf0db:::obj-fill-507:head# 2020-09-08T16:00:19.111 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.143 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b07896f0:::obj-fill-269:head# 2020-09-08T16:00:19.144 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.178 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b0b954d5:::obj-fill-524:head# 2020-09-08T16:00:19.178 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.232 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b1cbfcb7:::obj-fill-134:head# 2020-09-08T16:00:19.233 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.293 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b2978fd3:::obj-fill-27:head# 2020-09-08T16:00:19.294 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.327 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b394798f:::obj-fill-156:head# 2020-09-08T16:00:19.328 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.362 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b3c6f36d:::obj-fill-401:head# 2020-09-08T16:00:19.363 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.394 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b3f8e5ac:::obj-fill-290:head# 2020-09-08T16:00:19.394 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.427 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b41ed5f8:::obj-fill-76:head# 2020-09-08T16:00:19.427 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.460 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b4878e76:::obj-fill-253:head# 2020-09-08T16:00:19.461 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.498 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b4e19741:::obj-fill-503:head# 2020-09-08T16:00:19.499 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.550 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b53a3690:::obj-fill-264:head# 2020-09-08T16:00:19.551 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.617 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b545ab4f:::obj-fill-24:head# 2020-09-08T16:00:19.617 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.644 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b55af5e6:::obj-fill-491:head# 2020-09-08T16:00:19.644 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.677 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b57edf82:::obj-fill-526:head# 2020-09-08T16:00:19.678 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.710 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b589d2be:::obj-fill-323:head# 2020-09-08T16:00:19.711 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.744 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b6207f32:::obj-fill-344:head# 2020-09-08T16:00:19.744 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.777 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b757ee2e:::obj-fill-433:head# 2020-09-08T16:00:19.777 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.810 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b75cc479:::obj-fill-34:head# 2020-09-08T16:00:19.811 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.844 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b7b03117:::obj-fill-42:head# 2020-09-08T16:00:19.844 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.879 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b7e6205d:::obj-fill-501:head# 2020-09-08T16:00:19.880 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.911 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b8d18b7a:::obj-fill-353:head# 2020-09-08T16:00:19.911 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.944 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b9189c29:::obj-fill-328:head# 2020-09-08T16:00:19.944 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:19.977 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b98e07aa:::obj-fill-54:head# 2020-09-08T16:00:19.978 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.010 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:b9cd1e9a:::obj-fill-371:head# 2020-09-08T16:00:20.011 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.044 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:bc3322bb:::obj-fill-340:head# 2020-09-08T16:00:20.044 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.077 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:bcf43161:::obj-fill-294:head# 2020-09-08T16:00:20.078 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.110 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:bd07fc4f:::obj-fill-549:head# 2020-09-08T16:00:20.111 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.144 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:bdf48e47:::obj-fill-430:head# 2020-09-08T16:00:20.144 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.177 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:be01c111:::obj-fill-1:head# 2020-09-08T16:00:20.178 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.215 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:be3a4bc7:::obj-fill-102:head# 2020-09-08T16:00:20.216 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.244 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:be8e1fcd:::obj-fill-321:head# 2020-09-08T16:00:20.244 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.280 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:bf5fcbac:::obj-fill-287:head# 2020-09-08T16:00:20.281 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.311 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:bf806d14:::obj-fill-115:head# 2020-09-08T16:00:20.311 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.344 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:bfb28823:::obj-fill-72:head# 2020-09-08T16:00:20.344 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.377 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:bfef805e:::obj-fill-119:head# 2020-09-08T16:00:20.378 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.411 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c02f8e10:::obj-fill-497:head# 2020-09-08T16:00:20.411 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.444 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c050cd6e:::obj-fill-8:head# 2020-09-08T16:00:20.445 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.478 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c218e297:::obj-fill-173:head# 2020-09-08T16:00:20.478 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.511 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c2bc66fe:::obj-fill-252:head# 2020-09-08T16:00:20.511 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.544 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c3b55903:::obj-fill-428:head# 2020-09-08T16:00:20.545 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.577 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c51907b0:::obj-fill-457:head# 2020-09-08T16:00:20.578 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.603 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c561dc83:::obj-fill-75:head# 2020-09-08T16:00:20.603 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.628 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c5d1e1a9:::obj-fill-268:head# 2020-09-08T16:00:20.628 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.653 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c60ab0d0:::obj-fill-303:head# 2020-09-08T16:00:20.653 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.678 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c644ce52:::obj-fill-514:head# 2020-09-08T16:00:20.679 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.703 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c6ab3a11:::obj-fill-407:head# 2020-09-08T16:00:20.703 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.728 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c74377bf:::obj-fill-432:head# 2020-09-08T16:00:20.728 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.753 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c767fff6:::obj-fill-531:head# 2020-09-08T16:00:20.753 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.777 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c7a9adad:::obj-fill-475:head# 2020-09-08T16:00:20.778 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.802 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c7e3a9c2:::obj-fill-465:head# 2020-09-08T16:00:20.803 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.828 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c850aed7:::obj-fill-424:head# 2020-09-08T16:00:20.829 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.853 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c8a0088a:::obj-fill-329:head# 2020-09-08T16:00:20.853 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.878 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:c9d419f9:::obj-fill-176:head# 2020-09-08T16:00:20.878 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.904 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:caf25ec2:::obj-fill-274:head# 2020-09-08T16:00:20.904 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.928 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:cb625830:::obj-fill-70:head# 2020-09-08T16:00:20.928 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:20.998 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:cbb65125:::obj-fill-529:head# 2020-09-08T16:00:20.999 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.053 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:cbe2544c:::obj-fill-3:head# 2020-09-08T16:00:21.053 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.087 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:cbfce4ee:::obj-fill-455:head# 2020-09-08T16:00:21.087 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.119 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:cc62419c:::obj-fill-498:head# 2020-09-08T16:00:21.120 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.153 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:cce831fa:::obj-fill-160:head# 2020-09-08T16:00:21.153 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.186 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:cda71af4:::obj-fill-122:head# 2020-09-08T16:00:21.186 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.283 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:cea7a728:::obj-fill-265:head# 2020-09-08T16:00:21.283 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.319 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:cee19f0a:::obj-fill-142:head# 2020-09-08T16:00:21.320 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.353 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:cf22117e:::obj-fill-499:head# 2020-09-08T16:00:21.353 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.387 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:cfbfa66d:::obj-fill-66:head# 2020-09-08T16:00:21.387 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.419 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:cfc2552c:::obj-fill-211:head# 2020-09-08T16:00:21.420 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.453 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:cfc563e8:::obj-fill-392:head# 2020-09-08T16:00:21.453 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.486 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d02d8880:::obj-fill-362:head# 2020-09-08T16:00:21.487 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.520 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d054947e:::obj-fill-67:head# 2020-09-08T16:00:21.521 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.553 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d061c977:::obj-fill-164:head# 2020-09-08T16:00:21.553 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.586 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d06a5f57:::obj-fill-296:head# 2020-09-08T16:00:21.587 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.619 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d110062a:::obj-fill-343:head# 2020-09-08T16:00:21.620 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.653 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d1b8ad47:::obj-fill-383:head# 2020-09-08T16:00:21.653 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.686 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d1e80db6:::obj-fill-117:head# 2020-09-08T16:00:21.687 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.720 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d210027e:::obj-fill-231:head# 2020-09-08T16:00:21.720 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.753 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d24428ed:::obj-fill-199:head# 2020-09-08T16:00:21.753 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.786 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d27c3c4b:::obj-fill-154:head# 2020-09-08T16:00:21.787 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.828 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d28957e3:::obj-fill-263:head# 2020-09-08T16:00:21.828 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.861 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d2d44da7:::obj-fill-544:head# 2020-09-08T16:00:21.862 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.895 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d31004a4:::obj-fill-434:head# 2020-09-08T16:00:21.895 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.928 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d32487c3:::obj-fill-385:head# 2020-09-08T16:00:21.928 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.961 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d340891c:::obj-fill-12:head# 2020-09-08T16:00:21.962 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:21.995 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d4135728:::obj-fill-310:head# 2020-09-08T16:00:21.995 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.028 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d5a43972:::obj-fill-9:head# 2020-09-08T16:00:22.029 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.062 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d5efeb15:::obj-fill-347:head# 2020-09-08T16:00:22.062 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.095 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d6463f70:::obj-fill-536:head# 2020-09-08T16:00:22.095 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.128 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d666d9b7:::obj-fill-420:head# 2020-09-08T16:00:22.129 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.162 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d6e86688:::obj-fill-166:head# 2020-09-08T16:00:22.163 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.195 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d730370d:::obj-fill-206:head# 2020-09-08T16:00:22.195 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.228 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d783551c:::obj-fill-109:head# 2020-09-08T16:00:22.229 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.270 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d7f77e5f:::obj-fill-551:head# 2020-09-08T16:00:22.271 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.303 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d843056c:::obj-fill-291:head# 2020-09-08T16:00:22.304 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.337 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d84eb173:::obj-fill-221:head# 2020-09-08T16:00:22.337 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.370 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d8dd069c:::obj-fill-60:head# 2020-09-08T16:00:22.371 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.404 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d8f2f750:::obj-fill-562:head# 2020-09-08T16:00:22.404 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.437 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d8f80ac2:::obj-fill-179:head# 2020-09-08T16:00:22.437 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.470 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:d9f904cf:::obj-fill-308:head# 2020-09-08T16:00:22.471 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.508 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:db0a534b:::obj-fill-410:head# 2020-09-08T16:00:22.508 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.537 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:dc4403f4:::obj-fill-416:head# 2020-09-08T16:00:22.537 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.570 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:dc66c3ca:::obj-fill-220:head# 2020-09-08T16:00:22.570 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.615 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:dc8198dc:::obj-fill-596:head# 2020-09-08T16:00:22.615 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.637 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:dcbade2b:::obj-fill-10:head# 2020-09-08T16:00:22.638 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.670 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ddb787ea:::obj-fill-556:head# 2020-09-08T16:00:22.671 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.705 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:de58065b:::obj-fill-306:head# 2020-09-08T16:00:22.705 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.740 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:deaa6fab:::obj-fill-194:head# 2020-09-08T16:00:22.741 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.772 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:dfee7714:::obj-fill-202:head# 2020-09-08T16:00:22.772 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.812 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:dff5df4a:::obj-fill-565:head# 2020-09-08T16:00:22.814 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.846 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:e2053442:::obj-fill-107:head# 2020-09-08T16:00:22.846 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.879 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:e32055b8:::obj-fill-57:head# 2020-09-08T16:00:22.879 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.914 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:e37fac1e:::obj-fill-161:head# 2020-09-08T16:00:22.915 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:22.945 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:e388f5aa:::obj-fill-273:head# 2020-09-08T16:00:22.946 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.006 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:e38b1f4d:::obj-fill-393:head# 2020-09-08T16:00:23.006 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.062 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:e4792474:::obj-fill-158:head# 2020-09-08T16:00:23.062 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.095 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:e4899cb0:::obj-fill-270:head# 2020-09-08T16:00:23.096 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.120 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:e62ae9f1:::obj-fill-288:head# 2020-09-08T16:00:23.121 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.153 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:e64fd95a:::obj-fill-449:head# 2020-09-08T16:00:23.154 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.234 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:e6682cfc:::obj-fill-373:head# 2020-09-08T16:00:23.235 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.262 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:e716717b:::obj-fill-178:head# 2020-09-08T16:00:23.262 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.287 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:e80226af:::obj-fill-354:head# 2020-09-08T16:00:23.287 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.320 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:e83a5940:::obj-fill-564:head# 2020-09-08T16:00:23.321 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.357 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:e854bfbe:::obj-fill-589:head# 2020-09-08T16:00:23.357 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.387 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:e8b197bc:::obj-fill-89:head# 2020-09-08T16:00:23.387 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.420 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:e92fca88:::obj-fill-397:head# 2020-09-08T16:00:23.421 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.456 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:e94d8f7b:::obj-fill-261:head# 2020-09-08T16:00:23.456 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.487 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:e98cc0a4:::obj-fill-525:head# 2020-09-08T16:00:23.488 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.520 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ea5a9459:::obj-fill-431:head# 2020-09-08T16:00:23.521 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.561 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ebc54d47:::obj-fill-258:head# 2020-09-08T16:00:23.561 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.587 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ec0002dd:::obj-fill-205:head# 2020-09-08T16:00:23.587 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.621 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ec740b5c:::obj-fill-46:head# 2020-09-08T16:00:23.621 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.654 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ed35dda4:::obj-fill-170:head# 2020-09-08T16:00:23.654 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.687 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ed51b8f7:::obj-fill-91:head# 2020-09-08T16:00:23.688 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.720 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:edd96161:::obj-fill-48:head# 2020-09-08T16:00:23.721 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.754 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ee3f0d4b:::obj-fill-47:head# 2020-09-08T16:00:23.755 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.787 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ee4784dd:::obj-fill-480:head# 2020-09-08T16:00:23.788 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.821 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ee5a8271:::obj-fill-198:head# 2020-09-08T16:00:23.821 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.856 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ef745b66:::obj-fill-145:head# 2020-09-08T16:00:23.856 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.887 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:efa5309d:::obj-fill-215:head# 2020-09-08T16:00:23.888 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.921 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:efbdd3a1:::obj-fill-276:head# 2020-09-08T16:00:23.921 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.954 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:f059d4c0:::obj-fill-482:head# 2020-09-08T16:00:23.955 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:23.987 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:f0f9fb7a:::obj-fill-379:head# 2020-09-08T16:00:23.988 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.021 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:f16a3656:::obj-fill-462:head# 2020-09-08T16:00:24.022 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.062 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:f1b395ae:::obj-fill-25:head# 2020-09-08T16:00:24.063 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.096 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:f5876dad:::obj-fill-359:head# 2020-09-08T16:00:24.096 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.129 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:f5a283cd:::obj-fill-534:head# 2020-09-08T16:00:24.130 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.163 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:f5cd905a:::obj-fill-358:head# 2020-09-08T16:00:24.163 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.196 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:f5e48302:::obj-fill-406:head# 2020-09-08T16:00:24.196 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.230 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:f5ea65fc:::obj-fill-52:head# 2020-09-08T16:00:24.230 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.262 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:f642de6b:::obj-fill-204:head# 2020-09-08T16:00:24.263 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.296 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:f716eafd:::obj-fill-502:head# 2020-09-08T16:00:24.296 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.329 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:f752e9cb:::obj-fill-23:head# 2020-09-08T16:00:24.330 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.363 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:f85fe42c:::obj-fill-346:head# 2020-09-08T16:00:24.363 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.396 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:f882fd3b:::obj-fill-355:head# 2020-09-08T16:00:24.396 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.429 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:fa133332:::obj-fill-309:head# 2020-09-08T16:00:24.430 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.463 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:fa875e52:::obj-fill-64:head# 2020-09-08T16:00:24.463 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.496 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:fad91a22:::obj-fill-481:head# 2020-09-08T16:00:24.496 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.530 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:fbbc3122:::obj-fill-111:head# 2020-09-08T16:00:24.530 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.571 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:fc539ddb:::obj-fill-181:head# 2020-09-08T16:00:24.571 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.638 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:fc54128d:::obj-fill-104:head# 2020-09-08T16:00:24.638 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.671 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:fe00aded:::obj-fill-365:head# 2020-09-08T16:00:24.671 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.704 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:fe1e9971:::obj-fill-189:head# 2020-09-08T16:00:24.705 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.738 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ff0e0563:::obj-fill-508:head# 2020-09-08T16:00:24.738 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.771 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ff4e156c:::obj-fill-441:head# 2020-09-08T16:00:24.772 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.804 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:ffa355f7:::obj-fill-500:head# 2020-09-08T16:00:24.805 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.838 INFO:tasks.workunit.client.0.smithi065.stdout:Write #1:fff6c93b:::obj-fill-277:head# 2020-09-08T16:00:24.838 INFO:tasks.workunit.client.0.smithi065.stdout:snapset 0=[]:{} 2020-09-08T16:00:24.871 INFO:tasks.workunit.client.0.smithi065.stdout:write_pg epoch 36 info 1.0( v 36'600 (36'500,36'600] local-lis/les=23/24 n=600 ec=20/20 lis/c=23/23 les/c/f=24/24/0 sis=23) 2020-09-08T16:00:24.921 INFO:tasks.workunit.client.0.smithi065.stdout:Import successful 2020-09-08T16:00:25.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:494: TEST_backfill_multi_partial: ceph pg dump pgs 2020-09-08T16:00:25.828 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T16:00:25.829 INFO:tasks.workunit.client.0.smithi065.stdout:3.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:59:49.676797+0000 0'0 46:44 [2,0] 2 [2,0] 2 0'0 2020-09-08T15:57:10.462737+0000 0'0 2020-09-08T15:57:10.462737+0000 0 2020-09-08T16:00:25.829 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 573 0 0 0 0 1496103 0 0 73 73 stale+active+clean 2020-09-08T15:57:07.252587+0000 36'573 36:603 [1] 1 [1] 1 0'0 2020-09-08T15:57:05.166131+0000 0'0 2020-09-08T15:57:05.166131+0000 0 2020-09-08T16:00:25.829 INFO:tasks.workunit.client.0.smithi065.stdout:2.0 600 0 0 0 0 614400 0 0 100 100 active+clean 2020-09-08T15:59:49.635020+0000 41'600 46:656 [2,0] 2 [2,0] 2 0'0 2020-09-08T15:57:07.796898+0000 0'0 2020-09-08T15:57:07.796898+0000 0 2020-09-08T16:00:25.829 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T16:00:25.830 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T16:00:25.830 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:00:25.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:495: TEST_backfill_multi_partial: sleep 20 2020-09-08T16:00:45.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:496: TEST_backfill_multi_partial: ceph pg dump pgs 2020-09-08T16:00:46.227 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T16:00:46.362 INFO:tasks.workunit.client.0.smithi065.stdout:3.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T15:59:49.676797+0000 0'0 46:44 [2,0] 2 [2,0] 2 0'0 2020-09-08T15:57:10.462737+0000 0'0 2020-09-08T15:57:10.462737+0000 0 2020-09-08T16:00:46.362 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 573 0 0 0 0 1496103 0 0 73 73 stale+active+clean 2020-09-08T15:57:07.252587+0000 36'573 36:603 [1] 1 [1] 1 0'0 2020-09-08T15:57:05.166131+0000 0'0 2020-09-08T15:57:05.166131+0000 0 2020-09-08T16:00:46.363 INFO:tasks.workunit.client.0.smithi065.stdout:2.0 600 0 0 0 0 614400 0 0 100 100 active+clean 2020-09-08T15:59:49.635020+0000 41'600 46:656 [2,0] 2 [2,0] 2 0'0 2020-09-08T15:57:07.796898+0000 0'0 2020-09-08T15:57:07.796898+0000 0 2020-09-08T16:00:46.363 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T16:00:46.363 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T16:00:46.364 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:00:46.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:499: TEST_backfill_multi_partial: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=2611 count=1 2020-09-08T16:00:46.367 INFO:tasks.workunit.client.0.smithi065.stderr:1+0 records in 2020-09-08T16:00:46.367 INFO:tasks.workunit.client.0.smithi065.stderr:1+0 records out 2020-09-08T16:00:46.367 INFO:tasks.workunit.client.0.smithi065.stderr:2611 bytes (2.6 kB, 2.5 KiB) copied, 8.1098e-05 s, 32.2 MB/s 2020-09-08T16:00:46.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: seq 1 600 2020-09-08T16:00:46.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:46.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:46.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:46.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-1 td/osd-backfill-space/datafile 2020-09-08T16:00:46.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:46.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-1 td/osd-backfill-space/datafile 2020-09-08T16:00:46.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:46.454 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:46.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:46.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-2 td/osd-backfill-space/datafile 2020-09-08T16:00:46.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:46.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-2 td/osd-backfill-space/datafile 2020-09-08T16:00:46.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:46.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:46.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:46.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-3 td/osd-backfill-space/datafile 2020-09-08T16:00:46.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:46.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-3 td/osd-backfill-space/datafile 2020-09-08T16:00:46.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:46.897 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:46.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:46.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-4 td/osd-backfill-space/datafile 2020-09-08T16:00:47.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:47.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-4 td/osd-backfill-space/datafile 2020-09-08T16:00:47.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:47.181 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:47.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:47.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-5 td/osd-backfill-space/datafile 2020-09-08T16:00:47.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:47.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-5 td/osd-backfill-space/datafile 2020-09-08T16:00:47.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:47.432 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:47.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:47.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-6 td/osd-backfill-space/datafile 2020-09-08T16:00:47.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:47.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-6 td/osd-backfill-space/datafile 2020-09-08T16:00:47.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:47.641 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:47.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:47.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-7 td/osd-backfill-space/datafile 2020-09-08T16:00:47.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:47.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-7 td/osd-backfill-space/datafile 2020-09-08T16:00:47.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:47.858 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:47.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:47.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-8 td/osd-backfill-space/datafile 2020-09-08T16:00:47.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:47.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-8 td/osd-backfill-space/datafile 2020-09-08T16:00:48.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:48.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:48.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:48.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-9 td/osd-backfill-space/datafile 2020-09-08T16:00:48.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:48.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-9 td/osd-backfill-space/datafile 2020-09-08T16:00:48.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:48.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:48.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:48.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-10 td/osd-backfill-space/datafile 2020-09-08T16:00:48.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:48.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-10 td/osd-backfill-space/datafile 2020-09-08T16:00:48.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:48.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:48.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:48.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-11 td/osd-backfill-space/datafile 2020-09-08T16:00:48.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:48.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-11 td/osd-backfill-space/datafile 2020-09-08T16:00:48.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:48.769 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:48.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:48.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-12 td/osd-backfill-space/datafile 2020-09-08T16:00:48.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:48.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-12 td/osd-backfill-space/datafile 2020-09-08T16:00:49.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:49.051 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:49.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:49.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-13 td/osd-backfill-space/datafile 2020-09-08T16:00:49.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:49.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-13 td/osd-backfill-space/datafile 2020-09-08T16:00:49.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:49.331 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:49.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:49.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-14 td/osd-backfill-space/datafile 2020-09-08T16:00:49.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:49.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-14 td/osd-backfill-space/datafile 2020-09-08T16:00:49.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:49.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:49.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:49.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-15 td/osd-backfill-space/datafile 2020-09-08T16:00:49.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:49.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-15 td/osd-backfill-space/datafile 2020-09-08T16:00:49.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:49.751 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:49.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:49.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-16 td/osd-backfill-space/datafile 2020-09-08T16:00:49.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:49.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-16 td/osd-backfill-space/datafile 2020-09-08T16:00:49.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:49.961 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:49.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:49.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-17 td/osd-backfill-space/datafile 2020-09-08T16:00:50.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:50.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-17 td/osd-backfill-space/datafile 2020-09-08T16:00:50.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:50.185 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:50.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:50.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-18 td/osd-backfill-space/datafile 2020-09-08T16:00:50.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:50.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-18 td/osd-backfill-space/datafile 2020-09-08T16:00:50.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:50.415 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:50.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:50.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-19 td/osd-backfill-space/datafile 2020-09-08T16:00:50.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:50.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-19 td/osd-backfill-space/datafile 2020-09-08T16:00:50.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:50.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:50.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:50.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-20 td/osd-backfill-space/datafile 2020-09-08T16:00:50.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:50.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-20 td/osd-backfill-space/datafile 2020-09-08T16:00:50.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:50.846 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:50.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:50.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-21 td/osd-backfill-space/datafile 2020-09-08T16:00:50.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:50.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-21 td/osd-backfill-space/datafile 2020-09-08T16:00:51.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:51.091 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:51.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:51.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-22 td/osd-backfill-space/datafile 2020-09-08T16:00:51.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:51.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-22 td/osd-backfill-space/datafile 2020-09-08T16:00:51.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:51.327 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:51.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:51.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-23 td/osd-backfill-space/datafile 2020-09-08T16:00:51.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:51.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-23 td/osd-backfill-space/datafile 2020-09-08T16:00:51.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:51.541 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:51.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:51.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-24 td/osd-backfill-space/datafile 2020-09-08T16:00:51.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:51.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-24 td/osd-backfill-space/datafile 2020-09-08T16:00:51.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:51.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:51.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:51.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-25 td/osd-backfill-space/datafile 2020-09-08T16:00:51.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:51.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-25 td/osd-backfill-space/datafile 2020-09-08T16:00:51.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:51.960 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:51.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:51.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-26 td/osd-backfill-space/datafile 2020-09-08T16:00:52.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:52.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-26 td/osd-backfill-space/datafile 2020-09-08T16:00:52.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:52.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:52.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:52.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-27 td/osd-backfill-space/datafile 2020-09-08T16:00:52.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:52.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-27 td/osd-backfill-space/datafile 2020-09-08T16:00:52.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:52.436 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:52.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:52.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-28 td/osd-backfill-space/datafile 2020-09-08T16:00:52.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:52.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-28 td/osd-backfill-space/datafile 2020-09-08T16:00:52.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:52.671 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:52.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:52.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-29 td/osd-backfill-space/datafile 2020-09-08T16:00:52.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:52.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-29 td/osd-backfill-space/datafile 2020-09-08T16:00:52.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:52.883 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:52.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:52.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-30 td/osd-backfill-space/datafile 2020-09-08T16:00:52.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:52.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-30 td/osd-backfill-space/datafile 2020-09-08T16:00:53.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:53.106 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:53.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:53.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-31 td/osd-backfill-space/datafile 2020-09-08T16:00:53.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:53.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-31 td/osd-backfill-space/datafile 2020-09-08T16:00:53.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:53.349 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:53.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:53.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-32 td/osd-backfill-space/datafile 2020-09-08T16:00:53.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:53.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-32 td/osd-backfill-space/datafile 2020-09-08T16:00:53.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:53.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:53.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:53.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-33 td/osd-backfill-space/datafile 2020-09-08T16:00:53.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:53.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-33 td/osd-backfill-space/datafile 2020-09-08T16:00:54.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:54.007 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:54.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:54.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-34 td/osd-backfill-space/datafile 2020-09-08T16:00:54.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:54.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-34 td/osd-backfill-space/datafile 2020-09-08T16:00:54.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:54.227 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:54.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:54.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-35 td/osd-backfill-space/datafile 2020-09-08T16:00:54.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:54.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-35 td/osd-backfill-space/datafile 2020-09-08T16:00:54.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:54.444 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:54.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:54.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-36 td/osd-backfill-space/datafile 2020-09-08T16:00:54.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:54.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-36 td/osd-backfill-space/datafile 2020-09-08T16:00:54.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:54.662 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:54.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:54.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-37 td/osd-backfill-space/datafile 2020-09-08T16:00:54.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:54.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-37 td/osd-backfill-space/datafile 2020-09-08T16:00:54.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:54.888 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:54.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:54.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-38 td/osd-backfill-space/datafile 2020-09-08T16:00:55.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:55.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-38 td/osd-backfill-space/datafile 2020-09-08T16:00:55.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:55.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:55.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:55.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-39 td/osd-backfill-space/datafile 2020-09-08T16:00:55.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:55.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-39 td/osd-backfill-space/datafile 2020-09-08T16:00:55.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:55.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:55.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:55.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-40 td/osd-backfill-space/datafile 2020-09-08T16:00:55.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:55.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-40 td/osd-backfill-space/datafile 2020-09-08T16:00:55.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:55.625 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:55.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:55.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-41 td/osd-backfill-space/datafile 2020-09-08T16:00:55.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:55.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-41 td/osd-backfill-space/datafile 2020-09-08T16:00:55.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:55.852 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:55.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:55.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-42 td/osd-backfill-space/datafile 2020-09-08T16:00:55.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:55.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-42 td/osd-backfill-space/datafile 2020-09-08T16:00:56.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:56.076 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:56.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:56.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-43 td/osd-backfill-space/datafile 2020-09-08T16:00:56.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:56.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-43 td/osd-backfill-space/datafile 2020-09-08T16:00:56.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:56.302 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:56.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:56.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-44 td/osd-backfill-space/datafile 2020-09-08T16:00:56.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:56.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-44 td/osd-backfill-space/datafile 2020-09-08T16:00:56.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:56.520 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:56.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:56.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-45 td/osd-backfill-space/datafile 2020-09-08T16:00:56.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:56.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-45 td/osd-backfill-space/datafile 2020-09-08T16:00:56.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:56.737 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:56.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:56.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-46 td/osd-backfill-space/datafile 2020-09-08T16:00:56.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:56.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-46 td/osd-backfill-space/datafile 2020-09-08T16:00:56.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:56.957 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:56.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:56.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-47 td/osd-backfill-space/datafile 2020-09-08T16:00:57.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:57.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-47 td/osd-backfill-space/datafile 2020-09-08T16:00:57.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:57.189 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:57.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:57.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-48 td/osd-backfill-space/datafile 2020-09-08T16:00:57.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:57.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-48 td/osd-backfill-space/datafile 2020-09-08T16:00:57.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:57.424 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:57.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:57.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-49 td/osd-backfill-space/datafile 2020-09-08T16:00:57.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:57.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-49 td/osd-backfill-space/datafile 2020-09-08T16:00:57.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:57.641 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:57.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:57.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-50 td/osd-backfill-space/datafile 2020-09-08T16:00:57.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:57.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-50 td/osd-backfill-space/datafile 2020-09-08T16:00:57.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:57.867 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:57.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:57.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-51 td/osd-backfill-space/datafile 2020-09-08T16:00:57.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:57.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-51 td/osd-backfill-space/datafile 2020-09-08T16:00:58.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:58.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:58.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:58.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-52 td/osd-backfill-space/datafile 2020-09-08T16:00:58.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:58.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-52 td/osd-backfill-space/datafile 2020-09-08T16:00:58.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:58.378 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:58.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:58.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-53 td/osd-backfill-space/datafile 2020-09-08T16:00:58.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:58.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-53 td/osd-backfill-space/datafile 2020-09-08T16:00:58.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:58.612 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:58.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:58.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-54 td/osd-backfill-space/datafile 2020-09-08T16:00:58.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:58.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-54 td/osd-backfill-space/datafile 2020-09-08T16:00:58.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:58.834 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:58.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:58.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-55 td/osd-backfill-space/datafile 2020-09-08T16:00:58.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:58.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-55 td/osd-backfill-space/datafile 2020-09-08T16:00:59.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:59.105 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:59.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:59.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-56 td/osd-backfill-space/datafile 2020-09-08T16:00:59.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:59.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-56 td/osd-backfill-space/datafile 2020-09-08T16:00:59.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:59.332 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:59.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:59.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-57 td/osd-backfill-space/datafile 2020-09-08T16:00:59.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:59.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-57 td/osd-backfill-space/datafile 2020-09-08T16:00:59.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:59.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:59.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:59.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-58 td/osd-backfill-space/datafile 2020-09-08T16:00:59.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:59.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-58 td/osd-backfill-space/datafile 2020-09-08T16:00:59.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:00:59.809 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:00:59.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:59.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-59 td/osd-backfill-space/datafile 2020-09-08T16:00:59.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:00:59.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-59 td/osd-backfill-space/datafile 2020-09-08T16:01:00.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:00.042 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:00.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:00.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-60 td/osd-backfill-space/datafile 2020-09-08T16:01:00.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:00.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-60 td/osd-backfill-space/datafile 2020-09-08T16:01:00.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:00.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:00.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:00.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-61 td/osd-backfill-space/datafile 2020-09-08T16:01:00.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:00.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-61 td/osd-backfill-space/datafile 2020-09-08T16:01:00.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:00.521 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:00.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:00.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-62 td/osd-backfill-space/datafile 2020-09-08T16:01:00.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:00.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-62 td/osd-backfill-space/datafile 2020-09-08T16:01:00.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:00.762 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:00.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:00.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-63 td/osd-backfill-space/datafile 2020-09-08T16:01:00.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:00.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-63 td/osd-backfill-space/datafile 2020-09-08T16:01:01.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:01.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:01.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:01.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-64 td/osd-backfill-space/datafile 2020-09-08T16:01:01.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:01.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-64 td/osd-backfill-space/datafile 2020-09-08T16:01:01.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:01.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:01.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:01.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-65 td/osd-backfill-space/datafile 2020-09-08T16:01:01.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:01.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-65 td/osd-backfill-space/datafile 2020-09-08T16:01:01.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:01.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:01.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:01.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-66 td/osd-backfill-space/datafile 2020-09-08T16:01:01.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:01.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-66 td/osd-backfill-space/datafile 2020-09-08T16:01:01.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:01.766 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:01.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:01.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-67 td/osd-backfill-space/datafile 2020-09-08T16:01:01.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:01.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-67 td/osd-backfill-space/datafile 2020-09-08T16:01:02.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:02.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:02.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:02.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-68 td/osd-backfill-space/datafile 2020-09-08T16:01:02.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:02.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-68 td/osd-backfill-space/datafile 2020-09-08T16:01:02.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:02.243 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:02.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:02.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-69 td/osd-backfill-space/datafile 2020-09-08T16:01:02.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:02.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-69 td/osd-backfill-space/datafile 2020-09-08T16:01:02.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:02.478 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:02.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:02.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-70 td/osd-backfill-space/datafile 2020-09-08T16:01:02.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:02.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-70 td/osd-backfill-space/datafile 2020-09-08T16:01:02.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:02.712 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:02.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:02.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-71 td/osd-backfill-space/datafile 2020-09-08T16:01:02.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:02.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-71 td/osd-backfill-space/datafile 2020-09-08T16:01:02.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:02.962 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:02.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:02.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-72 td/osd-backfill-space/datafile 2020-09-08T16:01:03.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:03.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-72 td/osd-backfill-space/datafile 2020-09-08T16:01:03.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:03.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:03.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:03.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-73 td/osd-backfill-space/datafile 2020-09-08T16:01:03.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:03.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-73 td/osd-backfill-space/datafile 2020-09-08T16:01:03.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:03.457 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:03.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:03.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-74 td/osd-backfill-space/datafile 2020-09-08T16:01:03.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:03.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-74 td/osd-backfill-space/datafile 2020-09-08T16:01:03.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:03.675 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:03.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:03.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-75 td/osd-backfill-space/datafile 2020-09-08T16:01:03.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:03.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-75 td/osd-backfill-space/datafile 2020-09-08T16:01:03.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:03.903 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:03.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:03.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-76 td/osd-backfill-space/datafile 2020-09-08T16:01:04.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:04.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-76 td/osd-backfill-space/datafile 2020-09-08T16:01:04.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:04.159 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:04.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:04.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-77 td/osd-backfill-space/datafile 2020-09-08T16:01:04.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:04.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-77 td/osd-backfill-space/datafile 2020-09-08T16:01:04.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:04.427 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:04.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:04.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-78 td/osd-backfill-space/datafile 2020-09-08T16:01:04.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:04.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-78 td/osd-backfill-space/datafile 2020-09-08T16:01:04.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:04.670 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:04.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:04.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-79 td/osd-backfill-space/datafile 2020-09-08T16:01:04.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:04.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-79 td/osd-backfill-space/datafile 2020-09-08T16:01:04.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:04.938 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:04.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:04.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-80 td/osd-backfill-space/datafile 2020-09-08T16:01:05.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:05.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-80 td/osd-backfill-space/datafile 2020-09-08T16:01:05.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:05.180 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:05.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:05.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-81 td/osd-backfill-space/datafile 2020-09-08T16:01:05.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:05.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-81 td/osd-backfill-space/datafile 2020-09-08T16:01:05.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:05.422 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:05.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:05.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-82 td/osd-backfill-space/datafile 2020-09-08T16:01:05.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:05.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-82 td/osd-backfill-space/datafile 2020-09-08T16:01:05.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:05.643 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:05.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:05.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-83 td/osd-backfill-space/datafile 2020-09-08T16:01:05.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:05.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-83 td/osd-backfill-space/datafile 2020-09-08T16:01:05.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:05.857 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:05.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:05.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-84 td/osd-backfill-space/datafile 2020-09-08T16:01:05.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:05.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-84 td/osd-backfill-space/datafile 2020-09-08T16:01:06.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:06.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:06.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:06.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-85 td/osd-backfill-space/datafile 2020-09-08T16:01:06.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:06.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-85 td/osd-backfill-space/datafile 2020-09-08T16:01:06.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:06.318 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:06.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:06.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-86 td/osd-backfill-space/datafile 2020-09-08T16:01:06.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:06.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-86 td/osd-backfill-space/datafile 2020-09-08T16:01:06.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:06.561 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:06.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:06.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-87 td/osd-backfill-space/datafile 2020-09-08T16:01:06.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:06.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-87 td/osd-backfill-space/datafile 2020-09-08T16:01:06.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:06.794 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:06.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:06.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-88 td/osd-backfill-space/datafile 2020-09-08T16:01:06.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:06.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-88 td/osd-backfill-space/datafile 2020-09-08T16:01:07.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:07.054 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:07.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:07.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-89 td/osd-backfill-space/datafile 2020-09-08T16:01:07.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:07.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-89 td/osd-backfill-space/datafile 2020-09-08T16:01:07.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:07.330 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:07.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:07.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-90 td/osd-backfill-space/datafile 2020-09-08T16:01:07.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:07.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-90 td/osd-backfill-space/datafile 2020-09-08T16:01:07.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:07.572 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:07.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:07.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-91 td/osd-backfill-space/datafile 2020-09-08T16:01:07.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:07.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-91 td/osd-backfill-space/datafile 2020-09-08T16:01:07.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:07.797 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:07.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:07.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-92 td/osd-backfill-space/datafile 2020-09-08T16:01:07.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:07.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-92 td/osd-backfill-space/datafile 2020-09-08T16:01:08.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:08.032 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:08.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:08.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-93 td/osd-backfill-space/datafile 2020-09-08T16:01:08.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:08.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-93 td/osd-backfill-space/datafile 2020-09-08T16:01:08.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:08.233 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:08.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:08.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-94 td/osd-backfill-space/datafile 2020-09-08T16:01:08.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:08.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-94 td/osd-backfill-space/datafile 2020-09-08T16:01:08.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:08.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:08.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:08.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-95 td/osd-backfill-space/datafile 2020-09-08T16:01:08.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:08.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-95 td/osd-backfill-space/datafile 2020-09-08T16:01:08.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:08.676 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:08.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:08.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-96 td/osd-backfill-space/datafile 2020-09-08T16:01:08.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:08.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-96 td/osd-backfill-space/datafile 2020-09-08T16:01:08.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:08.894 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:08.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:08.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-97 td/osd-backfill-space/datafile 2020-09-08T16:01:09.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:09.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-97 td/osd-backfill-space/datafile 2020-09-08T16:01:09.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:09.146 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:09.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:09.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-98 td/osd-backfill-space/datafile 2020-09-08T16:01:09.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:09.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-98 td/osd-backfill-space/datafile 2020-09-08T16:01:09.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:09.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:09.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:09.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-99 td/osd-backfill-space/datafile 2020-09-08T16:01:09.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:09.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-99 td/osd-backfill-space/datafile 2020-09-08T16:01:09.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:09.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:09.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:09.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-100 td/osd-backfill-space/datafile 2020-09-08T16:01:09.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:09.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-100 td/osd-backfill-space/datafile 2020-09-08T16:01:09.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:09.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:09.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:09.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-101 td/osd-backfill-space/datafile 2020-09-08T16:01:09.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:09.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-101 td/osd-backfill-space/datafile 2020-09-08T16:01:10.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:10.082 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:10.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:10.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-102 td/osd-backfill-space/datafile 2020-09-08T16:01:10.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:10.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-102 td/osd-backfill-space/datafile 2020-09-08T16:01:10.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:10.308 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:10.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:10.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-103 td/osd-backfill-space/datafile 2020-09-08T16:01:10.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:10.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-103 td/osd-backfill-space/datafile 2020-09-08T16:01:10.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:10.534 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:10.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:10.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-104 td/osd-backfill-space/datafile 2020-09-08T16:01:10.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:10.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-104 td/osd-backfill-space/datafile 2020-09-08T16:01:10.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:10.760 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:10.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:10.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-105 td/osd-backfill-space/datafile 2020-09-08T16:01:10.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:10.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-105 td/osd-backfill-space/datafile 2020-09-08T16:01:10.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:10.979 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:10.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:10.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-106 td/osd-backfill-space/datafile 2020-09-08T16:01:11.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:11.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-106 td/osd-backfill-space/datafile 2020-09-08T16:01:11.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:11.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:11.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:11.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-107 td/osd-backfill-space/datafile 2020-09-08T16:01:11.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:11.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-107 td/osd-backfill-space/datafile 2020-09-08T16:01:11.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:11.440 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:11.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:11.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-108 td/osd-backfill-space/datafile 2020-09-08T16:01:11.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:11.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-108 td/osd-backfill-space/datafile 2020-09-08T16:01:11.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:11.656 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:11.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:11.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-109 td/osd-backfill-space/datafile 2020-09-08T16:01:11.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:11.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-109 td/osd-backfill-space/datafile 2020-09-08T16:01:11.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:11.865 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:11.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:11.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-110 td/osd-backfill-space/datafile 2020-09-08T16:01:11.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:11.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-110 td/osd-backfill-space/datafile 2020-09-08T16:01:12.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:12.066 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:12.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:12.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-111 td/osd-backfill-space/datafile 2020-09-08T16:01:12.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:12.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-111 td/osd-backfill-space/datafile 2020-09-08T16:01:12.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:12.292 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:12.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:12.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-112 td/osd-backfill-space/datafile 2020-09-08T16:01:12.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:12.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-112 td/osd-backfill-space/datafile 2020-09-08T16:01:12.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:12.501 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:12.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:12.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-113 td/osd-backfill-space/datafile 2020-09-08T16:01:12.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:12.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-113 td/osd-backfill-space/datafile 2020-09-08T16:01:12.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:12.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:12.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:12.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-114 td/osd-backfill-space/datafile 2020-09-08T16:01:12.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:12.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-114 td/osd-backfill-space/datafile 2020-09-08T16:01:12.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:12.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:12.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:12.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-115 td/osd-backfill-space/datafile 2020-09-08T16:01:13.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:13.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-115 td/osd-backfill-space/datafile 2020-09-08T16:01:13.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:13.235 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:13.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:13.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-116 td/osd-backfill-space/datafile 2020-09-08T16:01:13.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:13.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-116 td/osd-backfill-space/datafile 2020-09-08T16:01:13.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:13.460 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:13.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:13.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-117 td/osd-backfill-space/datafile 2020-09-08T16:01:13.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:13.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-117 td/osd-backfill-space/datafile 2020-09-08T16:01:13.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:13.673 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:13.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:13.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-118 td/osd-backfill-space/datafile 2020-09-08T16:01:13.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:13.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-118 td/osd-backfill-space/datafile 2020-09-08T16:01:13.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:13.890 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:13.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:13.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-119 td/osd-backfill-space/datafile 2020-09-08T16:01:14.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:14.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-119 td/osd-backfill-space/datafile 2020-09-08T16:01:14.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:14.117 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:14.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:14.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-120 td/osd-backfill-space/datafile 2020-09-08T16:01:14.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:14.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-120 td/osd-backfill-space/datafile 2020-09-08T16:01:14.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:14.334 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:14.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:14.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-121 td/osd-backfill-space/datafile 2020-09-08T16:01:14.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:14.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-121 td/osd-backfill-space/datafile 2020-09-08T16:01:14.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:14.552 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:14.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:14.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-122 td/osd-backfill-space/datafile 2020-09-08T16:01:14.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:14.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-122 td/osd-backfill-space/datafile 2020-09-08T16:01:14.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:14.928 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:14.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:14.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-123 td/osd-backfill-space/datafile 2020-09-08T16:01:15.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:15.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-123 td/osd-backfill-space/datafile 2020-09-08T16:01:15.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:15.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:15.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:15.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-124 td/osd-backfill-space/datafile 2020-09-08T16:01:15.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:15.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-124 td/osd-backfill-space/datafile 2020-09-08T16:01:15.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:15.423 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:15.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:15.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-125 td/osd-backfill-space/datafile 2020-09-08T16:01:15.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:15.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-125 td/osd-backfill-space/datafile 2020-09-08T16:01:15.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:15.653 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:15.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:15.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-126 td/osd-backfill-space/datafile 2020-09-08T16:01:15.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:15.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-126 td/osd-backfill-space/datafile 2020-09-08T16:01:15.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:15.857 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:15.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:15.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-127 td/osd-backfill-space/datafile 2020-09-08T16:01:15.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:15.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-127 td/osd-backfill-space/datafile 2020-09-08T16:01:16.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:16.082 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:16.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:16.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-128 td/osd-backfill-space/datafile 2020-09-08T16:01:16.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:16.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-128 td/osd-backfill-space/datafile 2020-09-08T16:01:16.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:16.284 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:16.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:16.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-129 td/osd-backfill-space/datafile 2020-09-08T16:01:16.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:16.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-129 td/osd-backfill-space/datafile 2020-09-08T16:01:16.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:16.502 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:16.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:16.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-130 td/osd-backfill-space/datafile 2020-09-08T16:01:16.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:16.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-130 td/osd-backfill-space/datafile 2020-09-08T16:01:16.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:16.729 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:16.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:16.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-131 td/osd-backfill-space/datafile 2020-09-08T16:01:16.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:16.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-131 td/osd-backfill-space/datafile 2020-09-08T16:01:16.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:16.959 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:16.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:16.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-132 td/osd-backfill-space/datafile 2020-09-08T16:01:17.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:17.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-132 td/osd-backfill-space/datafile 2020-09-08T16:01:17.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:17.269 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:17.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:17.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-133 td/osd-backfill-space/datafile 2020-09-08T16:01:17.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:17.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-133 td/osd-backfill-space/datafile 2020-09-08T16:01:17.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:17.430 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:17.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:17.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-134 td/osd-backfill-space/datafile 2020-09-08T16:01:17.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:17.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-134 td/osd-backfill-space/datafile 2020-09-08T16:01:17.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:17.648 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:17.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:17.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-135 td/osd-backfill-space/datafile 2020-09-08T16:01:17.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:17.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-135 td/osd-backfill-space/datafile 2020-09-08T16:01:17.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:17.849 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:17.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:17.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-136 td/osd-backfill-space/datafile 2020-09-08T16:01:17.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:17.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-136 td/osd-backfill-space/datafile 2020-09-08T16:01:18.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:18.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:18.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:18.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-137 td/osd-backfill-space/datafile 2020-09-08T16:01:18.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:18.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-137 td/osd-backfill-space/datafile 2020-09-08T16:01:18.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:18.259 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:18.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:18.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-138 td/osd-backfill-space/datafile 2020-09-08T16:01:18.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:18.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-138 td/osd-backfill-space/datafile 2020-09-08T16:01:18.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:18.468 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:18.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:18.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-139 td/osd-backfill-space/datafile 2020-09-08T16:01:18.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:18.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-139 td/osd-backfill-space/datafile 2020-09-08T16:01:18.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:18.694 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:18.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:18.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-140 td/osd-backfill-space/datafile 2020-09-08T16:01:18.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:18.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-140 td/osd-backfill-space/datafile 2020-09-08T16:01:18.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:18.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:18.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:18.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-141 td/osd-backfill-space/datafile 2020-09-08T16:01:19.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:19.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-141 td/osd-backfill-space/datafile 2020-09-08T16:01:19.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:19.183 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:19.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:19.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-142 td/osd-backfill-space/datafile 2020-09-08T16:01:19.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:19.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-142 td/osd-backfill-space/datafile 2020-09-08T16:01:19.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:19.434 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:19.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:19.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-143 td/osd-backfill-space/datafile 2020-09-08T16:01:19.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:19.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-143 td/osd-backfill-space/datafile 2020-09-08T16:01:19.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:19.648 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:19.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:19.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-144 td/osd-backfill-space/datafile 2020-09-08T16:01:19.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:19.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-144 td/osd-backfill-space/datafile 2020-09-08T16:01:19.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:19.849 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:19.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:19.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-145 td/osd-backfill-space/datafile 2020-09-08T16:01:19.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:19.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-145 td/osd-backfill-space/datafile 2020-09-08T16:01:20.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:20.075 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:20.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:20.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-146 td/osd-backfill-space/datafile 2020-09-08T16:01:20.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:20.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-146 td/osd-backfill-space/datafile 2020-09-08T16:01:20.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:20.293 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:20.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:20.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-147 td/osd-backfill-space/datafile 2020-09-08T16:01:20.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:20.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-147 td/osd-backfill-space/datafile 2020-09-08T16:01:20.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:20.736 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:20.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:20.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-148 td/osd-backfill-space/datafile 2020-09-08T16:01:20.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:20.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-148 td/osd-backfill-space/datafile 2020-09-08T16:01:20.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:20.958 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:20.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:20.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-149 td/osd-backfill-space/datafile 2020-09-08T16:01:21.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:21.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-149 td/osd-backfill-space/datafile 2020-09-08T16:01:21.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:21.188 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:21.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:21.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-150 td/osd-backfill-space/datafile 2020-09-08T16:01:21.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:21.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-150 td/osd-backfill-space/datafile 2020-09-08T16:01:21.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:21.439 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:21.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:21.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-151 td/osd-backfill-space/datafile 2020-09-08T16:01:21.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:21.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-151 td/osd-backfill-space/datafile 2020-09-08T16:01:21.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:21.657 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:21.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:21.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-152 td/osd-backfill-space/datafile 2020-09-08T16:01:21.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:21.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-152 td/osd-backfill-space/datafile 2020-09-08T16:01:21.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:21.874 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:21.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:21.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-153 td/osd-backfill-space/datafile 2020-09-08T16:01:21.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:21.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-153 td/osd-backfill-space/datafile 2020-09-08T16:01:22.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:22.108 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:22.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:22.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-154 td/osd-backfill-space/datafile 2020-09-08T16:01:22.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:22.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-154 td/osd-backfill-space/datafile 2020-09-08T16:01:22.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:22.334 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:22.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:22.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-155 td/osd-backfill-space/datafile 2020-09-08T16:01:22.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:22.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-155 td/osd-backfill-space/datafile 2020-09-08T16:01:22.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:22.560 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:22.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:22.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-156 td/osd-backfill-space/datafile 2020-09-08T16:01:22.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:22.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-156 td/osd-backfill-space/datafile 2020-09-08T16:01:22.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:22.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:22.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:22.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-157 td/osd-backfill-space/datafile 2020-09-08T16:01:22.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:22.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-157 td/osd-backfill-space/datafile 2020-09-08T16:01:22.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:22.995 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:22.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:22.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-158 td/osd-backfill-space/datafile 2020-09-08T16:01:23.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:23.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-158 td/osd-backfill-space/datafile 2020-09-08T16:01:23.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:23.227 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:23.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:23.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-159 td/osd-backfill-space/datafile 2020-09-08T16:01:23.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:23.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-159 td/osd-backfill-space/datafile 2020-09-08T16:01:23.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:23.449 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:23.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:23.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-160 td/osd-backfill-space/datafile 2020-09-08T16:01:23.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:23.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-160 td/osd-backfill-space/datafile 2020-09-08T16:01:23.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:23.650 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:23.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:23.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-161 td/osd-backfill-space/datafile 2020-09-08T16:01:23.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:23.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-161 td/osd-backfill-space/datafile 2020-09-08T16:01:23.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:23.851 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:23.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:23.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-162 td/osd-backfill-space/datafile 2020-09-08T16:01:23.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:23.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-162 td/osd-backfill-space/datafile 2020-09-08T16:01:24.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:24.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:24.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:24.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-163 td/osd-backfill-space/datafile 2020-09-08T16:01:24.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:24.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-163 td/osd-backfill-space/datafile 2020-09-08T16:01:24.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:24.278 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:24.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:24.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-164 td/osd-backfill-space/datafile 2020-09-08T16:01:24.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:24.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-164 td/osd-backfill-space/datafile 2020-09-08T16:01:24.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:24.506 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:24.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:24.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-165 td/osd-backfill-space/datafile 2020-09-08T16:01:24.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:24.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-165 td/osd-backfill-space/datafile 2020-09-08T16:01:24.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:24.736 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:24.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:24.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-166 td/osd-backfill-space/datafile 2020-09-08T16:01:24.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:24.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-166 td/osd-backfill-space/datafile 2020-09-08T16:01:24.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:24.956 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:24.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:24.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-167 td/osd-backfill-space/datafile 2020-09-08T16:01:25.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:25.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-167 td/osd-backfill-space/datafile 2020-09-08T16:01:25.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:25.230 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:25.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:25.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-168 td/osd-backfill-space/datafile 2020-09-08T16:01:25.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:25.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-168 td/osd-backfill-space/datafile 2020-09-08T16:01:25.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:25.490 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:25.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:25.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-169 td/osd-backfill-space/datafile 2020-09-08T16:01:25.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:25.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-169 td/osd-backfill-space/datafile 2020-09-08T16:01:25.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:25.711 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:25.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:25.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-170 td/osd-backfill-space/datafile 2020-09-08T16:01:25.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:25.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-170 td/osd-backfill-space/datafile 2020-09-08T16:01:25.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:25.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:25.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:25.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-171 td/osd-backfill-space/datafile 2020-09-08T16:01:26.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:26.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-171 td/osd-backfill-space/datafile 2020-09-08T16:01:26.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:26.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:26.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:26.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-172 td/osd-backfill-space/datafile 2020-09-08T16:01:26.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:26.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-172 td/osd-backfill-space/datafile 2020-09-08T16:01:26.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:26.360 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:26.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:26.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-173 td/osd-backfill-space/datafile 2020-09-08T16:01:26.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:26.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-173 td/osd-backfill-space/datafile 2020-09-08T16:01:26.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:26.578 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:26.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:26.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-174 td/osd-backfill-space/datafile 2020-09-08T16:01:26.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:26.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-174 td/osd-backfill-space/datafile 2020-09-08T16:01:26.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:26.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:26.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:26.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-175 td/osd-backfill-space/datafile 2020-09-08T16:01:26.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:26.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-175 td/osd-backfill-space/datafile 2020-09-08T16:01:27.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:27.022 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:27.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:27.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-176 td/osd-backfill-space/datafile 2020-09-08T16:01:27.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:27.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-176 td/osd-backfill-space/datafile 2020-09-08T16:01:27.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:27.230 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:27.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:27.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-177 td/osd-backfill-space/datafile 2020-09-08T16:01:27.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:27.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-177 td/osd-backfill-space/datafile 2020-09-08T16:01:27.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:27.448 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:27.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:27.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-178 td/osd-backfill-space/datafile 2020-09-08T16:01:27.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:27.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-178 td/osd-backfill-space/datafile 2020-09-08T16:01:27.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:27.674 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:27.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:27.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-179 td/osd-backfill-space/datafile 2020-09-08T16:01:27.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:27.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-179 td/osd-backfill-space/datafile 2020-09-08T16:01:27.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:27.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:27.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:27.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-180 td/osd-backfill-space/datafile 2020-09-08T16:01:28.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:28.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-180 td/osd-backfill-space/datafile 2020-09-08T16:01:28.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:28.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:28.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:28.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-181 td/osd-backfill-space/datafile 2020-09-08T16:01:28.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:28.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-181 td/osd-backfill-space/datafile 2020-09-08T16:01:28.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:28.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:28.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:28.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-182 td/osd-backfill-space/datafile 2020-09-08T16:01:28.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:28.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-182 td/osd-backfill-space/datafile 2020-09-08T16:01:28.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:28.603 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:28.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:28.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-183 td/osd-backfill-space/datafile 2020-09-08T16:01:28.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:28.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-183 td/osd-backfill-space/datafile 2020-09-08T16:01:28.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:28.821 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:28.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:28.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-184 td/osd-backfill-space/datafile 2020-09-08T16:01:28.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:28.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-184 td/osd-backfill-space/datafile 2020-09-08T16:01:29.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:29.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:29.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:29.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-185 td/osd-backfill-space/datafile 2020-09-08T16:01:29.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:29.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-185 td/osd-backfill-space/datafile 2020-09-08T16:01:29.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:29.340 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:29.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:29.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-186 td/osd-backfill-space/datafile 2020-09-08T16:01:29.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:29.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-186 td/osd-backfill-space/datafile 2020-09-08T16:01:29.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:29.567 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:29.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:29.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-187 td/osd-backfill-space/datafile 2020-09-08T16:01:29.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:29.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-187 td/osd-backfill-space/datafile 2020-09-08T16:01:29.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:29.801 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:29.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:29.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-188 td/osd-backfill-space/datafile 2020-09-08T16:01:29.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:29.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-188 td/osd-backfill-space/datafile 2020-09-08T16:01:30.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:30.051 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:30.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:30.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-189 td/osd-backfill-space/datafile 2020-09-08T16:01:30.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:30.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-189 td/osd-backfill-space/datafile 2020-09-08T16:01:30.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:30.285 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:30.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:30.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-190 td/osd-backfill-space/datafile 2020-09-08T16:01:30.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:30.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-190 td/osd-backfill-space/datafile 2020-09-08T16:01:30.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:30.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:30.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:30.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-191 td/osd-backfill-space/datafile 2020-09-08T16:01:30.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:30.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-191 td/osd-backfill-space/datafile 2020-09-08T16:01:30.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:30.728 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:30.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:30.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-192 td/osd-backfill-space/datafile 2020-09-08T16:01:30.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:30.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-192 td/osd-backfill-space/datafile 2020-09-08T16:01:30.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:30.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:30.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:30.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-193 td/osd-backfill-space/datafile 2020-09-08T16:01:31.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:31.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-193 td/osd-backfill-space/datafile 2020-09-08T16:01:31.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:31.232 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:31.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:31.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-194 td/osd-backfill-space/datafile 2020-09-08T16:01:31.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:31.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-194 td/osd-backfill-space/datafile 2020-09-08T16:01:31.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:31.465 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:31.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:31.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-195 td/osd-backfill-space/datafile 2020-09-08T16:01:31.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:31.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-195 td/osd-backfill-space/datafile 2020-09-08T16:01:31.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:31.682 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:31.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:31.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-196 td/osd-backfill-space/datafile 2020-09-08T16:01:31.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:31.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-196 td/osd-backfill-space/datafile 2020-09-08T16:01:31.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:31.909 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:31.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:31.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-197 td/osd-backfill-space/datafile 2020-09-08T16:01:32.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:32.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-197 td/osd-backfill-space/datafile 2020-09-08T16:01:32.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:32.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:32.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:32.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-198 td/osd-backfill-space/datafile 2020-09-08T16:01:32.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:32.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-198 td/osd-backfill-space/datafile 2020-09-08T16:01:32.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:32.370 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:32.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:32.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-199 td/osd-backfill-space/datafile 2020-09-08T16:01:32.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:32.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-199 td/osd-backfill-space/datafile 2020-09-08T16:01:32.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:32.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:32.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:32.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-200 td/osd-backfill-space/datafile 2020-09-08T16:01:32.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:32.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-200 td/osd-backfill-space/datafile 2020-09-08T16:01:32.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:32.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:32.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:32.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-201 td/osd-backfill-space/datafile 2020-09-08T16:01:32.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:32.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-201 td/osd-backfill-space/datafile 2020-09-08T16:01:33.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:33.047 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:33.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:33.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-202 td/osd-backfill-space/datafile 2020-09-08T16:01:33.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:33.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-202 td/osd-backfill-space/datafile 2020-09-08T16:01:33.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:33.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:33.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:33.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-203 td/osd-backfill-space/datafile 2020-09-08T16:01:33.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:33.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-203 td/osd-backfill-space/datafile 2020-09-08T16:01:33.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:33.526 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:33.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:33.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-204 td/osd-backfill-space/datafile 2020-09-08T16:01:33.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:33.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-204 td/osd-backfill-space/datafile 2020-09-08T16:01:33.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:33.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:33.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:33.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-205 td/osd-backfill-space/datafile 2020-09-08T16:01:33.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:33.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-205 td/osd-backfill-space/datafile 2020-09-08T16:01:33.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:33.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:33.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:33.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-206 td/osd-backfill-space/datafile 2020-09-08T16:01:34.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:34.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-206 td/osd-backfill-space/datafile 2020-09-08T16:01:34.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:34.205 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:34.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:34.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-207 td/osd-backfill-space/datafile 2020-09-08T16:01:34.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:34.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-207 td/osd-backfill-space/datafile 2020-09-08T16:01:34.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:34.419 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:34.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:34.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-208 td/osd-backfill-space/datafile 2020-09-08T16:01:34.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:34.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-208 td/osd-backfill-space/datafile 2020-09-08T16:01:34.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:34.647 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:34.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:34.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-209 td/osd-backfill-space/datafile 2020-09-08T16:01:34.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:34.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-209 td/osd-backfill-space/datafile 2020-09-08T16:01:34.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:34.871 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:34.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:34.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-210 td/osd-backfill-space/datafile 2020-09-08T16:01:34.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:34.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-210 td/osd-backfill-space/datafile 2020-09-08T16:01:35.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:35.097 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:35.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:35.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-211 td/osd-backfill-space/datafile 2020-09-08T16:01:35.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:35.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-211 td/osd-backfill-space/datafile 2020-09-08T16:01:35.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:35.357 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:35.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:35.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-212 td/osd-backfill-space/datafile 2020-09-08T16:01:35.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:35.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-212 td/osd-backfill-space/datafile 2020-09-08T16:01:35.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:35.582 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:35.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:35.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-213 td/osd-backfill-space/datafile 2020-09-08T16:01:35.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:35.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-213 td/osd-backfill-space/datafile 2020-09-08T16:01:35.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:35.806 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:35.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:35.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-214 td/osd-backfill-space/datafile 2020-09-08T16:01:35.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:35.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-214 td/osd-backfill-space/datafile 2020-09-08T16:01:36.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:36.017 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:36.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:36.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-215 td/osd-backfill-space/datafile 2020-09-08T16:01:36.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:36.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-215 td/osd-backfill-space/datafile 2020-09-08T16:01:36.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:36.244 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:36.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:36.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-216 td/osd-backfill-space/datafile 2020-09-08T16:01:36.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:36.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-216 td/osd-backfill-space/datafile 2020-09-08T16:01:36.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:36.461 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:36.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:36.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-217 td/osd-backfill-space/datafile 2020-09-08T16:01:36.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:36.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-217 td/osd-backfill-space/datafile 2020-09-08T16:01:36.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:36.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:36.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:36.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-218 td/osd-backfill-space/datafile 2020-09-08T16:01:36.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:36.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-218 td/osd-backfill-space/datafile 2020-09-08T16:01:36.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:36.905 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:36.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:36.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-219 td/osd-backfill-space/datafile 2020-09-08T16:01:37.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:37.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-219 td/osd-backfill-space/datafile 2020-09-08T16:01:37.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:37.131 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:37.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:37.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-220 td/osd-backfill-space/datafile 2020-09-08T16:01:37.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:37.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-220 td/osd-backfill-space/datafile 2020-09-08T16:01:37.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:37.377 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:37.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:37.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-221 td/osd-backfill-space/datafile 2020-09-08T16:01:37.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:37.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-221 td/osd-backfill-space/datafile 2020-09-08T16:01:37.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:37.612 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:37.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:37.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-222 td/osd-backfill-space/datafile 2020-09-08T16:01:37.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:37.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-222 td/osd-backfill-space/datafile 2020-09-08T16:01:37.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:37.842 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:37.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:37.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-223 td/osd-backfill-space/datafile 2020-09-08T16:01:37.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:37.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-223 td/osd-backfill-space/datafile 2020-09-08T16:01:38.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:38.079 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:38.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:38.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-224 td/osd-backfill-space/datafile 2020-09-08T16:01:38.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:38.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-224 td/osd-backfill-space/datafile 2020-09-08T16:01:38.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:38.295 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:38.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:38.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-225 td/osd-backfill-space/datafile 2020-09-08T16:01:38.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:38.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-225 td/osd-backfill-space/datafile 2020-09-08T16:01:38.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:38.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:38.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:38.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-226 td/osd-backfill-space/datafile 2020-09-08T16:01:38.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:38.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-226 td/osd-backfill-space/datafile 2020-09-08T16:01:38.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:38.762 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:38.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:38.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-227 td/osd-backfill-space/datafile 2020-09-08T16:01:38.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:38.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-227 td/osd-backfill-space/datafile 2020-09-08T16:01:38.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:38.988 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:38.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:38.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-228 td/osd-backfill-space/datafile 2020-09-08T16:01:39.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:39.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-228 td/osd-backfill-space/datafile 2020-09-08T16:01:39.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:39.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:39.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:39.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-229 td/osd-backfill-space/datafile 2020-09-08T16:01:39.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:39.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-229 td/osd-backfill-space/datafile 2020-09-08T16:01:39.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:39.457 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:39.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:39.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-230 td/osd-backfill-space/datafile 2020-09-08T16:01:39.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:39.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-230 td/osd-backfill-space/datafile 2020-09-08T16:01:39.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:39.683 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:39.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:39.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-231 td/osd-backfill-space/datafile 2020-09-08T16:01:39.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:39.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-231 td/osd-backfill-space/datafile 2020-09-08T16:01:39.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:39.918 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:39.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:39.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-232 td/osd-backfill-space/datafile 2020-09-08T16:01:40.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:40.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-232 td/osd-backfill-space/datafile 2020-09-08T16:01:40.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:40.177 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:40.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:40.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-233 td/osd-backfill-space/datafile 2020-09-08T16:01:40.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:40.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-233 td/osd-backfill-space/datafile 2020-09-08T16:01:40.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:40.462 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:40.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:40.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-234 td/osd-backfill-space/datafile 2020-09-08T16:01:40.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:40.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-234 td/osd-backfill-space/datafile 2020-09-08T16:01:40.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:40.695 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:40.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:40.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-235 td/osd-backfill-space/datafile 2020-09-08T16:01:40.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:40.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-235 td/osd-backfill-space/datafile 2020-09-08T16:01:40.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:40.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:40.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:40.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-236 td/osd-backfill-space/datafile 2020-09-08T16:01:41.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:41.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-236 td/osd-backfill-space/datafile 2020-09-08T16:01:41.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:41.157 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:41.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:41.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-237 td/osd-backfill-space/datafile 2020-09-08T16:01:41.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:41.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-237 td/osd-backfill-space/datafile 2020-09-08T16:01:41.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:41.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:41.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:41.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-238 td/osd-backfill-space/datafile 2020-09-08T16:01:41.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:41.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-238 td/osd-backfill-space/datafile 2020-09-08T16:01:41.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:41.624 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:41.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:41.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-239 td/osd-backfill-space/datafile 2020-09-08T16:01:41.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:41.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-239 td/osd-backfill-space/datafile 2020-09-08T16:01:41.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:41.867 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:41.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:41.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-240 td/osd-backfill-space/datafile 2020-09-08T16:01:41.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:41.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-240 td/osd-backfill-space/datafile 2020-09-08T16:01:42.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:42.102 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:42.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:42.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-241 td/osd-backfill-space/datafile 2020-09-08T16:01:42.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:42.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-241 td/osd-backfill-space/datafile 2020-09-08T16:01:42.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:42.337 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:42.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:42.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-242 td/osd-backfill-space/datafile 2020-09-08T16:01:42.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:42.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-242 td/osd-backfill-space/datafile 2020-09-08T16:01:42.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:42.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:42.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:42.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-243 td/osd-backfill-space/datafile 2020-09-08T16:01:42.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:42.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-243 td/osd-backfill-space/datafile 2020-09-08T16:01:42.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:42.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:42.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:42.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-244 td/osd-backfill-space/datafile 2020-09-08T16:01:42.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:42.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-244 td/osd-backfill-space/datafile 2020-09-08T16:01:43.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:43.047 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:43.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:43.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-245 td/osd-backfill-space/datafile 2020-09-08T16:01:43.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:43.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-245 td/osd-backfill-space/datafile 2020-09-08T16:01:43.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:43.306 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:43.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:43.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-246 td/osd-backfill-space/datafile 2020-09-08T16:01:43.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:43.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-246 td/osd-backfill-space/datafile 2020-09-08T16:01:43.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:43.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:43.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:43.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-247 td/osd-backfill-space/datafile 2020-09-08T16:01:43.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:43.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-247 td/osd-backfill-space/datafile 2020-09-08T16:01:43.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:43.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:43.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:43.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-248 td/osd-backfill-space/datafile 2020-09-08T16:01:43.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:43.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-248 td/osd-backfill-space/datafile 2020-09-08T16:01:43.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:43.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:43.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:43.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-249 td/osd-backfill-space/datafile 2020-09-08T16:01:44.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:44.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-249 td/osd-backfill-space/datafile 2020-09-08T16:01:44.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:44.227 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:44.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:44.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-250 td/osd-backfill-space/datafile 2020-09-08T16:01:44.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:44.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-250 td/osd-backfill-space/datafile 2020-09-08T16:01:44.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:44.470 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:44.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:44.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-251 td/osd-backfill-space/datafile 2020-09-08T16:01:44.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:44.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-251 td/osd-backfill-space/datafile 2020-09-08T16:01:44.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:44.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:44.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:44.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-252 td/osd-backfill-space/datafile 2020-09-08T16:01:44.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:44.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-252 td/osd-backfill-space/datafile 2020-09-08T16:01:44.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:44.972 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:44.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:44.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-253 td/osd-backfill-space/datafile 2020-09-08T16:01:45.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:45.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-253 td/osd-backfill-space/datafile 2020-09-08T16:01:45.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:45.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:45.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:45.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-254 td/osd-backfill-space/datafile 2020-09-08T16:01:45.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:45.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-254 td/osd-backfill-space/datafile 2020-09-08T16:01:45.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:45.508 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:45.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:45.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-255 td/osd-backfill-space/datafile 2020-09-08T16:01:45.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:45.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-255 td/osd-backfill-space/datafile 2020-09-08T16:01:45.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:45.759 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:45.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:45.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-256 td/osd-backfill-space/datafile 2020-09-08T16:01:45.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:45.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-256 td/osd-backfill-space/datafile 2020-09-08T16:01:46.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:46.010 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:46.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:46.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-257 td/osd-backfill-space/datafile 2020-09-08T16:01:46.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:46.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-257 td/osd-backfill-space/datafile 2020-09-08T16:01:46.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:46.270 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:46.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:46.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-258 td/osd-backfill-space/datafile 2020-09-08T16:01:46.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:46.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-258 td/osd-backfill-space/datafile 2020-09-08T16:01:46.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:46.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:46.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:46.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-259 td/osd-backfill-space/datafile 2020-09-08T16:01:46.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:46.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-259 td/osd-backfill-space/datafile 2020-09-08T16:01:46.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:46.955 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:46.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:46.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-260 td/osd-backfill-space/datafile 2020-09-08T16:01:47.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:47.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-260 td/osd-backfill-space/datafile 2020-09-08T16:01:47.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:47.198 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:47.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:47.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-261 td/osd-backfill-space/datafile 2020-09-08T16:01:47.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:47.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-261 td/osd-backfill-space/datafile 2020-09-08T16:01:47.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:47.441 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:47.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:47.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-262 td/osd-backfill-space/datafile 2020-09-08T16:01:47.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:47.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-262 td/osd-backfill-space/datafile 2020-09-08T16:01:47.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:47.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:47.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:47.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-263 td/osd-backfill-space/datafile 2020-09-08T16:01:47.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:48.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-263 td/osd-backfill-space/datafile 2020-09-08T16:01:48.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:48.048 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:48.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:48.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-264 td/osd-backfill-space/datafile 2020-09-08T16:01:48.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:48.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-264 td/osd-backfill-space/datafile 2020-09-08T16:01:48.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:48.178 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:48.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:48.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-265 td/osd-backfill-space/datafile 2020-09-08T16:01:48.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:48.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-265 td/osd-backfill-space/datafile 2020-09-08T16:01:48.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:48.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:48.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:48.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-266 td/osd-backfill-space/datafile 2020-09-08T16:01:48.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:48.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-266 td/osd-backfill-space/datafile 2020-09-08T16:01:48.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:48.648 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:48.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:48.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-267 td/osd-backfill-space/datafile 2020-09-08T16:01:48.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:48.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-267 td/osd-backfill-space/datafile 2020-09-08T16:01:48.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:48.891 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:48.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:48.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-268 td/osd-backfill-space/datafile 2020-09-08T16:01:49.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:49.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-268 td/osd-backfill-space/datafile 2020-09-08T16:01:49.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:49.182 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:49.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:49.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-269 td/osd-backfill-space/datafile 2020-09-08T16:01:49.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:49.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-269 td/osd-backfill-space/datafile 2020-09-08T16:01:49.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:49.445 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:49.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:49.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-270 td/osd-backfill-space/datafile 2020-09-08T16:01:49.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:49.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-270 td/osd-backfill-space/datafile 2020-09-08T16:01:49.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:49.696 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:49.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:49.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-271 td/osd-backfill-space/datafile 2020-09-08T16:01:49.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:49.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-271 td/osd-backfill-space/datafile 2020-09-08T16:01:49.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:49.953 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:49.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:49.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-272 td/osd-backfill-space/datafile 2020-09-08T16:01:50.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:50.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-272 td/osd-backfill-space/datafile 2020-09-08T16:01:50.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:50.188 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:50.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:50.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-273 td/osd-backfill-space/datafile 2020-09-08T16:01:50.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:50.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-273 td/osd-backfill-space/datafile 2020-09-08T16:01:50.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:50.430 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:50.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:50.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-274 td/osd-backfill-space/datafile 2020-09-08T16:01:50.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:50.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-274 td/osd-backfill-space/datafile 2020-09-08T16:01:50.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:50.681 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:50.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:50.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-275 td/osd-backfill-space/datafile 2020-09-08T16:01:50.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:50.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-275 td/osd-backfill-space/datafile 2020-09-08T16:01:50.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:50.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:50.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:50.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-276 td/osd-backfill-space/datafile 2020-09-08T16:01:51.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:51.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-276 td/osd-backfill-space/datafile 2020-09-08T16:01:51.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:51.193 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:51.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:51.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-277 td/osd-backfill-space/datafile 2020-09-08T16:01:51.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:51.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-277 td/osd-backfill-space/datafile 2020-09-08T16:01:51.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:51.443 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:51.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:51.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-278 td/osd-backfill-space/datafile 2020-09-08T16:01:51.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:51.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-278 td/osd-backfill-space/datafile 2020-09-08T16:01:51.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:51.679 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:51.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:51.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-279 td/osd-backfill-space/datafile 2020-09-08T16:01:51.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:51.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-279 td/osd-backfill-space/datafile 2020-09-08T16:01:51.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:51.917 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:51.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:51.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-280 td/osd-backfill-space/datafile 2020-09-08T16:01:52.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:52.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-280 td/osd-backfill-space/datafile 2020-09-08T16:01:52.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:52.410 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:52.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:52.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-281 td/osd-backfill-space/datafile 2020-09-08T16:01:52.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:52.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-281 td/osd-backfill-space/datafile 2020-09-08T16:01:52.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:52.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:52.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:52.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-282 td/osd-backfill-space/datafile 2020-09-08T16:01:52.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:52.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-282 td/osd-backfill-space/datafile 2020-09-08T16:01:52.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:52.908 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:52.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:52.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-283 td/osd-backfill-space/datafile 2020-09-08T16:01:53.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:53.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-283 td/osd-backfill-space/datafile 2020-09-08T16:01:53.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:53.184 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:53.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:53.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-284 td/osd-backfill-space/datafile 2020-09-08T16:01:53.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:53.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-284 td/osd-backfill-space/datafile 2020-09-08T16:01:53.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:53.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:53.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:53.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-285 td/osd-backfill-space/datafile 2020-09-08T16:01:53.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:53.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-285 td/osd-backfill-space/datafile 2020-09-08T16:01:53.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:53.698 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:53.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:53.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-286 td/osd-backfill-space/datafile 2020-09-08T16:01:53.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:53.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-286 td/osd-backfill-space/datafile 2020-09-08T16:01:53.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:53.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:53.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:53.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-287 td/osd-backfill-space/datafile 2020-09-08T16:01:54.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:54.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-287 td/osd-backfill-space/datafile 2020-09-08T16:01:54.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:54.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:54.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:54.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-288 td/osd-backfill-space/datafile 2020-09-08T16:01:54.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:54.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-288 td/osd-backfill-space/datafile 2020-09-08T16:01:54.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:54.406 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:54.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:54.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-289 td/osd-backfill-space/datafile 2020-09-08T16:01:54.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:54.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-289 td/osd-backfill-space/datafile 2020-09-08T16:01:54.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:54.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:54.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:54.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-290 td/osd-backfill-space/datafile 2020-09-08T16:01:54.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:54.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-290 td/osd-backfill-space/datafile 2020-09-08T16:01:54.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:54.897 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:54.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:54.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-291 td/osd-backfill-space/datafile 2020-09-08T16:01:55.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:55.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-291 td/osd-backfill-space/datafile 2020-09-08T16:01:55.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:55.197 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:55.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:55.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-292 td/osd-backfill-space/datafile 2020-09-08T16:01:55.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:55.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-292 td/osd-backfill-space/datafile 2020-09-08T16:01:55.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:55.461 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:55.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:55.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-293 td/osd-backfill-space/datafile 2020-09-08T16:01:55.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:55.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-293 td/osd-backfill-space/datafile 2020-09-08T16:01:55.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:55.703 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:55.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:55.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-294 td/osd-backfill-space/datafile 2020-09-08T16:01:55.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:55.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-294 td/osd-backfill-space/datafile 2020-09-08T16:01:55.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:55.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:55.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:55.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-295 td/osd-backfill-space/datafile 2020-09-08T16:01:56.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:56.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-295 td/osd-backfill-space/datafile 2020-09-08T16:01:56.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:56.176 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:56.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:56.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-296 td/osd-backfill-space/datafile 2020-09-08T16:01:56.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:56.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-296 td/osd-backfill-space/datafile 2020-09-08T16:01:56.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:56.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:56.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:56.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-297 td/osd-backfill-space/datafile 2020-09-08T16:01:56.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:56.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-297 td/osd-backfill-space/datafile 2020-09-08T16:01:56.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:56.642 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:56.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:56.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-298 td/osd-backfill-space/datafile 2020-09-08T16:01:56.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:56.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-298 td/osd-backfill-space/datafile 2020-09-08T16:01:56.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:56.897 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:56.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:56.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-299 td/osd-backfill-space/datafile 2020-09-08T16:01:57.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:57.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-299 td/osd-backfill-space/datafile 2020-09-08T16:01:57.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:57.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:57.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:57.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-300 td/osd-backfill-space/datafile 2020-09-08T16:01:57.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:57.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-300 td/osd-backfill-space/datafile 2020-09-08T16:01:57.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:57.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:57.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:57.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-301 td/osd-backfill-space/datafile 2020-09-08T16:01:57.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:57.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-301 td/osd-backfill-space/datafile 2020-09-08T16:01:57.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:57.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:57.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:57.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-302 td/osd-backfill-space/datafile 2020-09-08T16:01:57.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:57.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-302 td/osd-backfill-space/datafile 2020-09-08T16:01:57.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:57.865 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:57.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:57.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-303 td/osd-backfill-space/datafile 2020-09-08T16:01:57.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:57.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-303 td/osd-backfill-space/datafile 2020-09-08T16:01:58.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:58.108 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:58.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:58.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-304 td/osd-backfill-space/datafile 2020-09-08T16:01:58.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:58.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-304 td/osd-backfill-space/datafile 2020-09-08T16:01:58.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:58.351 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:58.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:58.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-305 td/osd-backfill-space/datafile 2020-09-08T16:01:58.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:58.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-305 td/osd-backfill-space/datafile 2020-09-08T16:01:58.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:58.611 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:58.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:58.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-306 td/osd-backfill-space/datafile 2020-09-08T16:01:58.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:58.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-306 td/osd-backfill-space/datafile 2020-09-08T16:01:58.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:58.862 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:58.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:58.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-307 td/osd-backfill-space/datafile 2020-09-08T16:01:58.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:58.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-307 td/osd-backfill-space/datafile 2020-09-08T16:01:59.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:59.096 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:59.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:59.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-308 td/osd-backfill-space/datafile 2020-09-08T16:01:59.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:59.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-308 td/osd-backfill-space/datafile 2020-09-08T16:01:59.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:59.339 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:59.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:59.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-309 td/osd-backfill-space/datafile 2020-09-08T16:01:59.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:59.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-309 td/osd-backfill-space/datafile 2020-09-08T16:01:59.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:59.583 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:59.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:59.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-310 td/osd-backfill-space/datafile 2020-09-08T16:01:59.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:59.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-310 td/osd-backfill-space/datafile 2020-09-08T16:01:59.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:01:59.836 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:01:59.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:59.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-311 td/osd-backfill-space/datafile 2020-09-08T16:01:59.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:01:59.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-311 td/osd-backfill-space/datafile 2020-09-08T16:02:00.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:00.061 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:00.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:00.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-312 td/osd-backfill-space/datafile 2020-09-08T16:02:00.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:00.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-312 td/osd-backfill-space/datafile 2020-09-08T16:02:00.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:00.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:00.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:00.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-313 td/osd-backfill-space/datafile 2020-09-08T16:02:00.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:00.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-313 td/osd-backfill-space/datafile 2020-09-08T16:02:00.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:00.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:00.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:00.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-314 td/osd-backfill-space/datafile 2020-09-08T16:02:00.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:00.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-314 td/osd-backfill-space/datafile 2020-09-08T16:02:00.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:00.788 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:00.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:00.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-315 td/osd-backfill-space/datafile 2020-09-08T16:02:00.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:00.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-315 td/osd-backfill-space/datafile 2020-09-08T16:02:01.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:01.048 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:01.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:01.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-316 td/osd-backfill-space/datafile 2020-09-08T16:02:01.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:01.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-316 td/osd-backfill-space/datafile 2020-09-08T16:02:01.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:01.338 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:01.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:01.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-317 td/osd-backfill-space/datafile 2020-09-08T16:02:01.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:01.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-317 td/osd-backfill-space/datafile 2020-09-08T16:02:01.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:01.590 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:01.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:01.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-318 td/osd-backfill-space/datafile 2020-09-08T16:02:01.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:01.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-318 td/osd-backfill-space/datafile 2020-09-08T16:02:01.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:01.818 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:01.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:01.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-319 td/osd-backfill-space/datafile 2020-09-08T16:02:01.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:01.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-319 td/osd-backfill-space/datafile 2020-09-08T16:02:02.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:02.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:02.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:02.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-320 td/osd-backfill-space/datafile 2020-09-08T16:02:02.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:02.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-320 td/osd-backfill-space/datafile 2020-09-08T16:02:02.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:02.313 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:02.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:02.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-321 td/osd-backfill-space/datafile 2020-09-08T16:02:02.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:02.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-321 td/osd-backfill-space/datafile 2020-09-08T16:02:02.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:02.548 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:02.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:02.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-322 td/osd-backfill-space/datafile 2020-09-08T16:02:02.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:02.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-322 td/osd-backfill-space/datafile 2020-09-08T16:02:02.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:02.790 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:02.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:02.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-323 td/osd-backfill-space/datafile 2020-09-08T16:02:02.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:02.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-323 td/osd-backfill-space/datafile 2020-09-08T16:02:03.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:03.033 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:03.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:03.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-324 td/osd-backfill-space/datafile 2020-09-08T16:02:03.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:03.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-324 td/osd-backfill-space/datafile 2020-09-08T16:02:03.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:03.301 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:03.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:03.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-325 td/osd-backfill-space/datafile 2020-09-08T16:02:03.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:03.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-325 td/osd-backfill-space/datafile 2020-09-08T16:02:03.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:03.562 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:03.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:03.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-326 td/osd-backfill-space/datafile 2020-09-08T16:02:03.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:03.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-326 td/osd-backfill-space/datafile 2020-09-08T16:02:03.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:03.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:03.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:03.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-327 td/osd-backfill-space/datafile 2020-09-08T16:02:03.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:03.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-327 td/osd-backfill-space/datafile 2020-09-08T16:02:04.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:04.014 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:04.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:04.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-328 td/osd-backfill-space/datafile 2020-09-08T16:02:04.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:04.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-328 td/osd-backfill-space/datafile 2020-09-08T16:02:04.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:04.260 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:04.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:04.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-329 td/osd-backfill-space/datafile 2020-09-08T16:02:04.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:04.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-329 td/osd-backfill-space/datafile 2020-09-08T16:02:04.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:04.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:04.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:04.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-330 td/osd-backfill-space/datafile 2020-09-08T16:02:04.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:04.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-330 td/osd-backfill-space/datafile 2020-09-08T16:02:04.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:04.735 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:04.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:04.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-331 td/osd-backfill-space/datafile 2020-09-08T16:02:04.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:04.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-331 td/osd-backfill-space/datafile 2020-09-08T16:02:04.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:04.987 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:04.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:04.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-332 td/osd-backfill-space/datafile 2020-09-08T16:02:05.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:05.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-332 td/osd-backfill-space/datafile 2020-09-08T16:02:05.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:05.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:05.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:05.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-333 td/osd-backfill-space/datafile 2020-09-08T16:02:05.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:05.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-333 td/osd-backfill-space/datafile 2020-09-08T16:02:05.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:05.488 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:05.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:05.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-334 td/osd-backfill-space/datafile 2020-09-08T16:02:05.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:05.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-334 td/osd-backfill-space/datafile 2020-09-08T16:02:05.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:05.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:05.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:05.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-335 td/osd-backfill-space/datafile 2020-09-08T16:02:05.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:05.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-335 td/osd-backfill-space/datafile 2020-09-08T16:02:05.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:05.973 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:05.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:05.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-336 td/osd-backfill-space/datafile 2020-09-08T16:02:06.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:06.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-336 td/osd-backfill-space/datafile 2020-09-08T16:02:06.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:06.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:06.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:06.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-337 td/osd-backfill-space/datafile 2020-09-08T16:02:06.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:06.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-337 td/osd-backfill-space/datafile 2020-09-08T16:02:06.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:06.471 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:06.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:06.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-338 td/osd-backfill-space/datafile 2020-09-08T16:02:06.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:06.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-338 td/osd-backfill-space/datafile 2020-09-08T16:02:06.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:06.702 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:06.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:06.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-339 td/osd-backfill-space/datafile 2020-09-08T16:02:06.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:06.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-339 td/osd-backfill-space/datafile 2020-09-08T16:02:06.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:06.936 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:06.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:06.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-340 td/osd-backfill-space/datafile 2020-09-08T16:02:07.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:07.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-340 td/osd-backfill-space/datafile 2020-09-08T16:02:07.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:07.229 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:07.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:07.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-341 td/osd-backfill-space/datafile 2020-09-08T16:02:07.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:07.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-341 td/osd-backfill-space/datafile 2020-09-08T16:02:07.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:07.489 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:07.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:07.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-342 td/osd-backfill-space/datafile 2020-09-08T16:02:07.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:07.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-342 td/osd-backfill-space/datafile 2020-09-08T16:02:07.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:07.732 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:07.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:07.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-343 td/osd-backfill-space/datafile 2020-09-08T16:02:07.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:07.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-343 td/osd-backfill-space/datafile 2020-09-08T16:02:07.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:07.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:07.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:07.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-344 td/osd-backfill-space/datafile 2020-09-08T16:02:08.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:08.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-344 td/osd-backfill-space/datafile 2020-09-08T16:02:08.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:08.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:08.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:08.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-345 td/osd-backfill-space/datafile 2020-09-08T16:02:08.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:08.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-345 td/osd-backfill-space/datafile 2020-09-08T16:02:08.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:08.478 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:08.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:08.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-346 td/osd-backfill-space/datafile 2020-09-08T16:02:08.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:08.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-346 td/osd-backfill-space/datafile 2020-09-08T16:02:08.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:08.711 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:08.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:08.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-347 td/osd-backfill-space/datafile 2020-09-08T16:02:08.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:08.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-347 td/osd-backfill-space/datafile 2020-09-08T16:02:08.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:08.946 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:08.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:08.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-348 td/osd-backfill-space/datafile 2020-09-08T16:02:09.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:09.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-348 td/osd-backfill-space/datafile 2020-09-08T16:02:09.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:09.205 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:09.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:09.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-349 td/osd-backfill-space/datafile 2020-09-08T16:02:09.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:09.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-349 td/osd-backfill-space/datafile 2020-09-08T16:02:09.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:09.448 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:09.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:09.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-350 td/osd-backfill-space/datafile 2020-09-08T16:02:09.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:09.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-350 td/osd-backfill-space/datafile 2020-09-08T16:02:09.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:09.683 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:09.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:09.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-351 td/osd-backfill-space/datafile 2020-09-08T16:02:09.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:09.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-351 td/osd-backfill-space/datafile 2020-09-08T16:02:09.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:09.917 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:09.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:09.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-352 td/osd-backfill-space/datafile 2020-09-08T16:02:10.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:10.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-352 td/osd-backfill-space/datafile 2020-09-08T16:02:10.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:10.187 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:10.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:10.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-353 td/osd-backfill-space/datafile 2020-09-08T16:02:10.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:10.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-353 td/osd-backfill-space/datafile 2020-09-08T16:02:10.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:10.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:10.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:10.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-354 td/osd-backfill-space/datafile 2020-09-08T16:02:10.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:10.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-354 td/osd-backfill-space/datafile 2020-09-08T16:02:10.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:10.695 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:10.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:10.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-355 td/osd-backfill-space/datafile 2020-09-08T16:02:10.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:10.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-355 td/osd-backfill-space/datafile 2020-09-08T16:02:10.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:10.938 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:10.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:10.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-356 td/osd-backfill-space/datafile 2020-09-08T16:02:11.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:11.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-356 td/osd-backfill-space/datafile 2020-09-08T16:02:11.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:11.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:11.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:11.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-357 td/osd-backfill-space/datafile 2020-09-08T16:02:11.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:11.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-357 td/osd-backfill-space/datafile 2020-09-08T16:02:11.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:11.444 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:11.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:11.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-358 td/osd-backfill-space/datafile 2020-09-08T16:02:11.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:11.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-358 td/osd-backfill-space/datafile 2020-09-08T16:02:11.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:11.675 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:11.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:11.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-359 td/osd-backfill-space/datafile 2020-09-08T16:02:11.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:11.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-359 td/osd-backfill-space/datafile 2020-09-08T16:02:11.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:11.918 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:11.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:11.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-360 td/osd-backfill-space/datafile 2020-09-08T16:02:12.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:12.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-360 td/osd-backfill-space/datafile 2020-09-08T16:02:12.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:12.160 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:12.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:12.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-361 td/osd-backfill-space/datafile 2020-09-08T16:02:12.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:12.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-361 td/osd-backfill-space/datafile 2020-09-08T16:02:12.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:12.395 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:12.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:12.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-362 td/osd-backfill-space/datafile 2020-09-08T16:02:12.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:12.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-362 td/osd-backfill-space/datafile 2020-09-08T16:02:12.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:12.658 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:12.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:12.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-363 td/osd-backfill-space/datafile 2020-09-08T16:02:12.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:12.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-363 td/osd-backfill-space/datafile 2020-09-08T16:02:12.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:12.897 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:12.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:12.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-364 td/osd-backfill-space/datafile 2020-09-08T16:02:13.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:13.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-364 td/osd-backfill-space/datafile 2020-09-08T16:02:13.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:13.144 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:13.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:13.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-365 td/osd-backfill-space/datafile 2020-09-08T16:02:13.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:13.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-365 td/osd-backfill-space/datafile 2020-09-08T16:02:13.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:13.400 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:13.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:13.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-366 td/osd-backfill-space/datafile 2020-09-08T16:02:13.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:13.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-366 td/osd-backfill-space/datafile 2020-09-08T16:02:13.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:13.642 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:13.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:13.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-367 td/osd-backfill-space/datafile 2020-09-08T16:02:13.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:13.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-367 td/osd-backfill-space/datafile 2020-09-08T16:02:13.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:13.893 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:13.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:13.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-368 td/osd-backfill-space/datafile 2020-09-08T16:02:14.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:14.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-368 td/osd-backfill-space/datafile 2020-09-08T16:02:14.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:14.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:14.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:14.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-369 td/osd-backfill-space/datafile 2020-09-08T16:02:14.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:14.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-369 td/osd-backfill-space/datafile 2020-09-08T16:02:14.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:14.371 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:14.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:14.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-370 td/osd-backfill-space/datafile 2020-09-08T16:02:14.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:14.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-370 td/osd-backfill-space/datafile 2020-09-08T16:02:14.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:14.607 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:14.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:14.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-371 td/osd-backfill-space/datafile 2020-09-08T16:02:14.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:14.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-371 td/osd-backfill-space/datafile 2020-09-08T16:02:14.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:14.844 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:14.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:14.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-372 td/osd-backfill-space/datafile 2020-09-08T16:02:14.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:14.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-372 td/osd-backfill-space/datafile 2020-09-08T16:02:15.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:15.083 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:15.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:15.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-373 td/osd-backfill-space/datafile 2020-09-08T16:02:15.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:15.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-373 td/osd-backfill-space/datafile 2020-09-08T16:02:15.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:15.334 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:15.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:15.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-374 td/osd-backfill-space/datafile 2020-09-08T16:02:15.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:15.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-374 td/osd-backfill-space/datafile 2020-09-08T16:02:15.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:15.576 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:15.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:15.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-375 td/osd-backfill-space/datafile 2020-09-08T16:02:15.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:15.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-375 td/osd-backfill-space/datafile 2020-09-08T16:02:15.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:15.836 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:15.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:15.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-376 td/osd-backfill-space/datafile 2020-09-08T16:02:15.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:15.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-376 td/osd-backfill-space/datafile 2020-09-08T16:02:16.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:16.083 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:16.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:16.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-377 td/osd-backfill-space/datafile 2020-09-08T16:02:16.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:16.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-377 td/osd-backfill-space/datafile 2020-09-08T16:02:16.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:16.330 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:16.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:16.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-378 td/osd-backfill-space/datafile 2020-09-08T16:02:16.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:16.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-378 td/osd-backfill-space/datafile 2020-09-08T16:02:16.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:16.589 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:16.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:16.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-379 td/osd-backfill-space/datafile 2020-09-08T16:02:16.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:16.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-379 td/osd-backfill-space/datafile 2020-09-08T16:02:16.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:16.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:16.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:16.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-380 td/osd-backfill-space/datafile 2020-09-08T16:02:16.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:16.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-380 td/osd-backfill-space/datafile 2020-09-08T16:02:17.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:17.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:17.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:17.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-381 td/osd-backfill-space/datafile 2020-09-08T16:02:17.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:17.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-381 td/osd-backfill-space/datafile 2020-09-08T16:02:17.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:17.337 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:17.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:17.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-382 td/osd-backfill-space/datafile 2020-09-08T16:02:17.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:17.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-382 td/osd-backfill-space/datafile 2020-09-08T16:02:17.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:17.577 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:17.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:17.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-383 td/osd-backfill-space/datafile 2020-09-08T16:02:17.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:17.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-383 td/osd-backfill-space/datafile 2020-09-08T16:02:17.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:17.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:17.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:17.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-384 td/osd-backfill-space/datafile 2020-09-08T16:02:17.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:17.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-384 td/osd-backfill-space/datafile 2020-09-08T16:02:18.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:18.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:18.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:18.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-385 td/osd-backfill-space/datafile 2020-09-08T16:02:18.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:18.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-385 td/osd-backfill-space/datafile 2020-09-08T16:02:18.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:18.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:18.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:18.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-386 td/osd-backfill-space/datafile 2020-09-08T16:02:18.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:18.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-386 td/osd-backfill-space/datafile 2020-09-08T16:02:18.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:18.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:18.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:18.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-387 td/osd-backfill-space/datafile 2020-09-08T16:02:18.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:18.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-387 td/osd-backfill-space/datafile 2020-09-08T16:02:18.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:18.959 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:18.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:18.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-388 td/osd-backfill-space/datafile 2020-09-08T16:02:19.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:19.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-388 td/osd-backfill-space/datafile 2020-09-08T16:02:19.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:19.226 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:19.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:19.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-389 td/osd-backfill-space/datafile 2020-09-08T16:02:19.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:19.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-389 td/osd-backfill-space/datafile 2020-09-08T16:02:19.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:19.477 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:19.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:19.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-390 td/osd-backfill-space/datafile 2020-09-08T16:02:19.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:19.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-390 td/osd-backfill-space/datafile 2020-09-08T16:02:19.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:19.737 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:19.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:19.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-391 td/osd-backfill-space/datafile 2020-09-08T16:02:19.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:19.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-391 td/osd-backfill-space/datafile 2020-09-08T16:02:19.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:19.980 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:19.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:19.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-392 td/osd-backfill-space/datafile 2020-09-08T16:02:20.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:20.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-392 td/osd-backfill-space/datafile 2020-09-08T16:02:20.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:20.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:20.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:20.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-393 td/osd-backfill-space/datafile 2020-09-08T16:02:20.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:20.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-393 td/osd-backfill-space/datafile 2020-09-08T16:02:20.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:20.482 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:20.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:20.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-394 td/osd-backfill-space/datafile 2020-09-08T16:02:20.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:20.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-394 td/osd-backfill-space/datafile 2020-09-08T16:02:20.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:20.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:20.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:20.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-395 td/osd-backfill-space/datafile 2020-09-08T16:02:20.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:20.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-395 td/osd-backfill-space/datafile 2020-09-08T16:02:21.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:21.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:21.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:21.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-396 td/osd-backfill-space/datafile 2020-09-08T16:02:21.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:21.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-396 td/osd-backfill-space/datafile 2020-09-08T16:02:21.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:21.260 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:21.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:21.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-397 td/osd-backfill-space/datafile 2020-09-08T16:02:21.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:21.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-397 td/osd-backfill-space/datafile 2020-09-08T16:02:21.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:21.503 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:21.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:21.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-398 td/osd-backfill-space/datafile 2020-09-08T16:02:21.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:21.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-398 td/osd-backfill-space/datafile 2020-09-08T16:02:21.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:21.754 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:21.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:21.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-399 td/osd-backfill-space/datafile 2020-09-08T16:02:21.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:21.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-399 td/osd-backfill-space/datafile 2020-09-08T16:02:21.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:21.988 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:21.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:21.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-400 td/osd-backfill-space/datafile 2020-09-08T16:02:22.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:22.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-400 td/osd-backfill-space/datafile 2020-09-08T16:02:22.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:22.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:22.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:22.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-401 td/osd-backfill-space/datafile 2020-09-08T16:02:22.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:22.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-401 td/osd-backfill-space/datafile 2020-09-08T16:02:22.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:22.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:22.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:22.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-402 td/osd-backfill-space/datafile 2020-09-08T16:02:22.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:22.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-402 td/osd-backfill-space/datafile 2020-09-08T16:02:22.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:22.742 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:22.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:22.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-403 td/osd-backfill-space/datafile 2020-09-08T16:02:22.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:22.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-403 td/osd-backfill-space/datafile 2020-09-08T16:02:22.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:22.976 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:22.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:22.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-404 td/osd-backfill-space/datafile 2020-09-08T16:02:23.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:23.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-404 td/osd-backfill-space/datafile 2020-09-08T16:02:23.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:23.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:23.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:23.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-405 td/osd-backfill-space/datafile 2020-09-08T16:02:23.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:23.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-405 td/osd-backfill-space/datafile 2020-09-08T16:02:23.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:23.647 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:23.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:23.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-406 td/osd-backfill-space/datafile 2020-09-08T16:02:23.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:23.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-406 td/osd-backfill-space/datafile 2020-09-08T16:02:23.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:23.906 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:23.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:23.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-407 td/osd-backfill-space/datafile 2020-09-08T16:02:24.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:24.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-407 td/osd-backfill-space/datafile 2020-09-08T16:02:24.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:24.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:24.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:24.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-408 td/osd-backfill-space/datafile 2020-09-08T16:02:24.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:24.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-408 td/osd-backfill-space/datafile 2020-09-08T16:02:24.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:24.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:24.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:24.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-409 td/osd-backfill-space/datafile 2020-09-08T16:02:24.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:24.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-409 td/osd-backfill-space/datafile 2020-09-08T16:02:24.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:24.661 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:24.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:24.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-410 td/osd-backfill-space/datafile 2020-09-08T16:02:24.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:24.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-410 td/osd-backfill-space/datafile 2020-09-08T16:02:24.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:24.901 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:24.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:24.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-411 td/osd-backfill-space/datafile 2020-09-08T16:02:25.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:25.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-411 td/osd-backfill-space/datafile 2020-09-08T16:02:25.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:25.185 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:25.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:25.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-412 td/osd-backfill-space/datafile 2020-09-08T16:02:25.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:25.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-412 td/osd-backfill-space/datafile 2020-09-08T16:02:25.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:25.456 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:25.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:25.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-413 td/osd-backfill-space/datafile 2020-09-08T16:02:25.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:25.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-413 td/osd-backfill-space/datafile 2020-09-08T16:02:25.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:25.714 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:25.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:25.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-414 td/osd-backfill-space/datafile 2020-09-08T16:02:25.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:25.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-414 td/osd-backfill-space/datafile 2020-09-08T16:02:25.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:25.948 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:25.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:25.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-415 td/osd-backfill-space/datafile 2020-09-08T16:02:26.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:26.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-415 td/osd-backfill-space/datafile 2020-09-08T16:02:26.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:26.182 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:26.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:26.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-416 td/osd-backfill-space/datafile 2020-09-08T16:02:26.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:26.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-416 td/osd-backfill-space/datafile 2020-09-08T16:02:26.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:26.434 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:26.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:26.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-417 td/osd-backfill-space/datafile 2020-09-08T16:02:26.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:26.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-417 td/osd-backfill-space/datafile 2020-09-08T16:02:26.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:26.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:26.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:26.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-418 td/osd-backfill-space/datafile 2020-09-08T16:02:26.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:26.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-418 td/osd-backfill-space/datafile 2020-09-08T16:02:26.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:26.902 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:26.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:26.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-419 td/osd-backfill-space/datafile 2020-09-08T16:02:27.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:27.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-419 td/osd-backfill-space/datafile 2020-09-08T16:02:27.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:27.144 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:27.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:27.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-420 td/osd-backfill-space/datafile 2020-09-08T16:02:27.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:27.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-420 td/osd-backfill-space/datafile 2020-09-08T16:02:27.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:27.421 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:27.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:27.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-421 td/osd-backfill-space/datafile 2020-09-08T16:02:27.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:27.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-421 td/osd-backfill-space/datafile 2020-09-08T16:02:27.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:27.672 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:27.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:27.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-422 td/osd-backfill-space/datafile 2020-09-08T16:02:27.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:27.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-422 td/osd-backfill-space/datafile 2020-09-08T16:02:27.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:27.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:27.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:27.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-423 td/osd-backfill-space/datafile 2020-09-08T16:02:28.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:28.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-423 td/osd-backfill-space/datafile 2020-09-08T16:02:28.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:28.149 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:28.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:28.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-424 td/osd-backfill-space/datafile 2020-09-08T16:02:28.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:28.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-424 td/osd-backfill-space/datafile 2020-09-08T16:02:28.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:28.409 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:28.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:28.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-425 td/osd-backfill-space/datafile 2020-09-08T16:02:28.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:28.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-425 td/osd-backfill-space/datafile 2020-09-08T16:02:28.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:28.660 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:28.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:28.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-426 td/osd-backfill-space/datafile 2020-09-08T16:02:28.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:28.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-426 td/osd-backfill-space/datafile 2020-09-08T16:02:28.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:28.894 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:28.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:28.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-427 td/osd-backfill-space/datafile 2020-09-08T16:02:29.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:29.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-427 td/osd-backfill-space/datafile 2020-09-08T16:02:29.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:29.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:29.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:29.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-428 td/osd-backfill-space/datafile 2020-09-08T16:02:29.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:29.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-428 td/osd-backfill-space/datafile 2020-09-08T16:02:29.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:29.397 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:29.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:29.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-429 td/osd-backfill-space/datafile 2020-09-08T16:02:29.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:29.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-429 td/osd-backfill-space/datafile 2020-09-08T16:02:29.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:29.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:29.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:29.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-430 td/osd-backfill-space/datafile 2020-09-08T16:02:29.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:29.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-430 td/osd-backfill-space/datafile 2020-09-08T16:02:29.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:29.874 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:29.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:29.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-431 td/osd-backfill-space/datafile 2020-09-08T16:02:29.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:29.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-431 td/osd-backfill-space/datafile 2020-09-08T16:02:30.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:30.125 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:30.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:30.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-432 td/osd-backfill-space/datafile 2020-09-08T16:02:30.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:30.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-432 td/osd-backfill-space/datafile 2020-09-08T16:02:30.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:30.359 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:30.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:30.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-433 td/osd-backfill-space/datafile 2020-09-08T16:02:30.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:30.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-433 td/osd-backfill-space/datafile 2020-09-08T16:02:30.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:30.619 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:30.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:30.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-434 td/osd-backfill-space/datafile 2020-09-08T16:02:30.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:30.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-434 td/osd-backfill-space/datafile 2020-09-08T16:02:30.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:30.853 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:30.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:30.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-435 td/osd-backfill-space/datafile 2020-09-08T16:02:30.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:30.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-435 td/osd-backfill-space/datafile 2020-09-08T16:02:31.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:31.096 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:31.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:31.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-436 td/osd-backfill-space/datafile 2020-09-08T16:02:31.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:31.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-436 td/osd-backfill-space/datafile 2020-09-08T16:02:31.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:31.356 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:31.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:31.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-437 td/osd-backfill-space/datafile 2020-09-08T16:02:31.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:31.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-437 td/osd-backfill-space/datafile 2020-09-08T16:02:31.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:31.599 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:31.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:31.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-438 td/osd-backfill-space/datafile 2020-09-08T16:02:31.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:31.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-438 td/osd-backfill-space/datafile 2020-09-08T16:02:31.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:31.841 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:31.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:31.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-439 td/osd-backfill-space/datafile 2020-09-08T16:02:31.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:31.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-439 td/osd-backfill-space/datafile 2020-09-08T16:02:32.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:32.095 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:32.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:32.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-440 td/osd-backfill-space/datafile 2020-09-08T16:02:32.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:32.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-440 td/osd-backfill-space/datafile 2020-09-08T16:02:32.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:32.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:32.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:32.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-441 td/osd-backfill-space/datafile 2020-09-08T16:02:32.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:32.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-441 td/osd-backfill-space/datafile 2020-09-08T16:02:32.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:32.578 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:32.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:32.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-442 td/osd-backfill-space/datafile 2020-09-08T16:02:32.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:32.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-442 td/osd-backfill-space/datafile 2020-09-08T16:02:32.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:32.813 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:32.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:32.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-443 td/osd-backfill-space/datafile 2020-09-08T16:02:32.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:32.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-443 td/osd-backfill-space/datafile 2020-09-08T16:02:33.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:33.097 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:33.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:33.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-444 td/osd-backfill-space/datafile 2020-09-08T16:02:33.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:33.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-444 td/osd-backfill-space/datafile 2020-09-08T16:02:33.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:33.335 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:33.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:33.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-445 td/osd-backfill-space/datafile 2020-09-08T16:02:33.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:33.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-445 td/osd-backfill-space/datafile 2020-09-08T16:02:33.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:33.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:33.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:33.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-446 td/osd-backfill-space/datafile 2020-09-08T16:02:33.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:33.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-446 td/osd-backfill-space/datafile 2020-09-08T16:02:33.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:33.817 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:33.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:33.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-447 td/osd-backfill-space/datafile 2020-09-08T16:02:33.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:33.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-447 td/osd-backfill-space/datafile 2020-09-08T16:02:34.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:34.053 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:34.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:34.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-448 td/osd-backfill-space/datafile 2020-09-08T16:02:34.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:34.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-448 td/osd-backfill-space/datafile 2020-09-08T16:02:34.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:34.304 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:34.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:34.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-449 td/osd-backfill-space/datafile 2020-09-08T16:02:34.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:34.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-449 td/osd-backfill-space/datafile 2020-09-08T16:02:34.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:34.546 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:34.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:34.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-450 td/osd-backfill-space/datafile 2020-09-08T16:02:34.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:34.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-450 td/osd-backfill-space/datafile 2020-09-08T16:02:34.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:34.789 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:34.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:34.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-451 td/osd-backfill-space/datafile 2020-09-08T16:02:34.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:34.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-451 td/osd-backfill-space/datafile 2020-09-08T16:02:35.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:35.056 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:35.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:35.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-452 td/osd-backfill-space/datafile 2020-09-08T16:02:35.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:35.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-452 td/osd-backfill-space/datafile 2020-09-08T16:02:35.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:35.308 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:35.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:35.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-453 td/osd-backfill-space/datafile 2020-09-08T16:02:35.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:35.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-453 td/osd-backfill-space/datafile 2020-09-08T16:02:35.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:35.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:35.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:35.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-454 td/osd-backfill-space/datafile 2020-09-08T16:02:35.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:35.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-454 td/osd-backfill-space/datafile 2020-09-08T16:02:35.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:35.803 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:35.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:35.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-455 td/osd-backfill-space/datafile 2020-09-08T16:02:35.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:35.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-455 td/osd-backfill-space/datafile 2020-09-08T16:02:36.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:36.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:36.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:36.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-456 td/osd-backfill-space/datafile 2020-09-08T16:02:36.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:36.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-456 td/osd-backfill-space/datafile 2020-09-08T16:02:36.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:36.270 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:36.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:36.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-457 td/osd-backfill-space/datafile 2020-09-08T16:02:36.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:36.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-457 td/osd-backfill-space/datafile 2020-09-08T16:02:36.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:36.505 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:36.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:36.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-458 td/osd-backfill-space/datafile 2020-09-08T16:02:36.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:36.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-458 td/osd-backfill-space/datafile 2020-09-08T16:02:36.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:36.756 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:36.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:36.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-459 td/osd-backfill-space/datafile 2020-09-08T16:02:36.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:36.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-459 td/osd-backfill-space/datafile 2020-09-08T16:02:36.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:36.999 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:37.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:37.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-460 td/osd-backfill-space/datafile 2020-09-08T16:02:37.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:37.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-460 td/osd-backfill-space/datafile 2020-09-08T16:02:37.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:37.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:37.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:37.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-461 td/osd-backfill-space/datafile 2020-09-08T16:02:37.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:37.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-461 td/osd-backfill-space/datafile 2020-09-08T16:02:37.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:37.510 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:37.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:37.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-462 td/osd-backfill-space/datafile 2020-09-08T16:02:37.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:37.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-462 td/osd-backfill-space/datafile 2020-09-08T16:02:37.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:37.744 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:37.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:37.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-463 td/osd-backfill-space/datafile 2020-09-08T16:02:37.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:37.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-463 td/osd-backfill-space/datafile 2020-09-08T16:02:37.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:37.979 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:37.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:37.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-464 td/osd-backfill-space/datafile 2020-09-08T16:02:38.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:38.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-464 td/osd-backfill-space/datafile 2020-09-08T16:02:38.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:38.213 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:38.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:38.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-465 td/osd-backfill-space/datafile 2020-09-08T16:02:38.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:38.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-465 td/osd-backfill-space/datafile 2020-09-08T16:02:38.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:38.456 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:38.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:38.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-466 td/osd-backfill-space/datafile 2020-09-08T16:02:38.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:38.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-466 td/osd-backfill-space/datafile 2020-09-08T16:02:38.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:38.715 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:38.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:38.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-467 td/osd-backfill-space/datafile 2020-09-08T16:02:38.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:38.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-467 td/osd-backfill-space/datafile 2020-09-08T16:02:38.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:38.964 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:38.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:38.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-468 td/osd-backfill-space/datafile 2020-09-08T16:02:39.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:39.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-468 td/osd-backfill-space/datafile 2020-09-08T16:02:39.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:39.226 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:39.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:39.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-469 td/osd-backfill-space/datafile 2020-09-08T16:02:39.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:39.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-469 td/osd-backfill-space/datafile 2020-09-08T16:02:39.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:39.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:39.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:39.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-470 td/osd-backfill-space/datafile 2020-09-08T16:02:39.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:39.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-470 td/osd-backfill-space/datafile 2020-09-08T16:02:39.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:39.703 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:39.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:39.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-471 td/osd-backfill-space/datafile 2020-09-08T16:02:39.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:39.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-471 td/osd-backfill-space/datafile 2020-09-08T16:02:39.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:39.946 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:39.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:39.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-472 td/osd-backfill-space/datafile 2020-09-08T16:02:40.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:40.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-472 td/osd-backfill-space/datafile 2020-09-08T16:02:40.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:40.181 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:40.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:40.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-473 td/osd-backfill-space/datafile 2020-09-08T16:02:40.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:40.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-473 td/osd-backfill-space/datafile 2020-09-08T16:02:40.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:40.449 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:40.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:40.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-474 td/osd-backfill-space/datafile 2020-09-08T16:02:40.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:40.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-474 td/osd-backfill-space/datafile 2020-09-08T16:02:40.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:40.711 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:40.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:40.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-475 td/osd-backfill-space/datafile 2020-09-08T16:02:40.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:40.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-475 td/osd-backfill-space/datafile 2020-09-08T16:02:40.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:40.942 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:40.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:40.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-476 td/osd-backfill-space/datafile 2020-09-08T16:02:41.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:41.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-476 td/osd-backfill-space/datafile 2020-09-08T16:02:41.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:41.193 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:41.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:41.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-477 td/osd-backfill-space/datafile 2020-09-08T16:02:41.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:41.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-477 td/osd-backfill-space/datafile 2020-09-08T16:02:41.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:41.432 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:41.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:41.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-478 td/osd-backfill-space/datafile 2020-09-08T16:02:41.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:41.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-478 td/osd-backfill-space/datafile 2020-09-08T16:02:41.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:41.662 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:41.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:41.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-479 td/osd-backfill-space/datafile 2020-09-08T16:02:41.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:41.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-479 td/osd-backfill-space/datafile 2020-09-08T16:02:41.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:41.903 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:41.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:41.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-480 td/osd-backfill-space/datafile 2020-09-08T16:02:42.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:42.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-480 td/osd-backfill-space/datafile 2020-09-08T16:02:42.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:42.141 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:42.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:42.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-481 td/osd-backfill-space/datafile 2020-09-08T16:02:42.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:42.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-481 td/osd-backfill-space/datafile 2020-09-08T16:02:42.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:42.391 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:42.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:42.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-482 td/osd-backfill-space/datafile 2020-09-08T16:02:42.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:42.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-482 td/osd-backfill-space/datafile 2020-09-08T16:02:42.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:42.625 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:42.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:42.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-483 td/osd-backfill-space/datafile 2020-09-08T16:02:42.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:42.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-483 td/osd-backfill-space/datafile 2020-09-08T16:02:42.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:42.860 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:42.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:42.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-484 td/osd-backfill-space/datafile 2020-09-08T16:02:42.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:42.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-484 td/osd-backfill-space/datafile 2020-09-08T16:02:43.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:43.095 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:43.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:43.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-485 td/osd-backfill-space/datafile 2020-09-08T16:02:43.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:43.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-485 td/osd-backfill-space/datafile 2020-09-08T16:02:43.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:43.354 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:43.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:43.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-486 td/osd-backfill-space/datafile 2020-09-08T16:02:43.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:43.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-486 td/osd-backfill-space/datafile 2020-09-08T16:02:43.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:43.596 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:43.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:43.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-487 td/osd-backfill-space/datafile 2020-09-08T16:02:43.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:43.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-487 td/osd-backfill-space/datafile 2020-09-08T16:02:43.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:43.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:43.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:43.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-488 td/osd-backfill-space/datafile 2020-09-08T16:02:43.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:43.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-488 td/osd-backfill-space/datafile 2020-09-08T16:02:44.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:44.082 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:44.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:44.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-489 td/osd-backfill-space/datafile 2020-09-08T16:02:44.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:44.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-489 td/osd-backfill-space/datafile 2020-09-08T16:02:44.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:44.325 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:44.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:44.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-490 td/osd-backfill-space/datafile 2020-09-08T16:02:44.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:44.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-490 td/osd-backfill-space/datafile 2020-09-08T16:02:44.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:44.559 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:44.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:44.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-491 td/osd-backfill-space/datafile 2020-09-08T16:02:44.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:44.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-491 td/osd-backfill-space/datafile 2020-09-08T16:02:44.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:44.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:44.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:44.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-492 td/osd-backfill-space/datafile 2020-09-08T16:02:44.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:44.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-492 td/osd-backfill-space/datafile 2020-09-08T16:02:45.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:45.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:45.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:45.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-493 td/osd-backfill-space/datafile 2020-09-08T16:02:45.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:45.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-493 td/osd-backfill-space/datafile 2020-09-08T16:02:45.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:45.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:45.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:45.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-494 td/osd-backfill-space/datafile 2020-09-08T16:02:45.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:45.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-494 td/osd-backfill-space/datafile 2020-09-08T16:02:45.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:45.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:45.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:45.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-495 td/osd-backfill-space/datafile 2020-09-08T16:02:45.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:45.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-495 td/osd-backfill-space/datafile 2020-09-08T16:02:45.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:45.800 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:45.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:45.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-496 td/osd-backfill-space/datafile 2020-09-08T16:02:45.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:45.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-496 td/osd-backfill-space/datafile 2020-09-08T16:02:46.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:46.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:46.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:46.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-497 td/osd-backfill-space/datafile 2020-09-08T16:02:46.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:46.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-497 td/osd-backfill-space/datafile 2020-09-08T16:02:46.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:46.309 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:46.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:46.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-498 td/osd-backfill-space/datafile 2020-09-08T16:02:46.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:46.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-498 td/osd-backfill-space/datafile 2020-09-08T16:02:46.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:46.577 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:46.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:46.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-499 td/osd-backfill-space/datafile 2020-09-08T16:02:46.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:46.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-499 td/osd-backfill-space/datafile 2020-09-08T16:02:46.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:46.836 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:46.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:46.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-500 td/osd-backfill-space/datafile 2020-09-08T16:02:46.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:46.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-500 td/osd-backfill-space/datafile 2020-09-08T16:02:47.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:47.105 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:47.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:47.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-501 td/osd-backfill-space/datafile 2020-09-08T16:02:47.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:47.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-501 td/osd-backfill-space/datafile 2020-09-08T16:02:47.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:47.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:47.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:47.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-502 td/osd-backfill-space/datafile 2020-09-08T16:02:47.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:47.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-502 td/osd-backfill-space/datafile 2020-09-08T16:02:47.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:47.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:47.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:47.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-503 td/osd-backfill-space/datafile 2020-09-08T16:02:47.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:47.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-503 td/osd-backfill-space/datafile 2020-09-08T16:02:47.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:47.850 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:47.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:47.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-504 td/osd-backfill-space/datafile 2020-09-08T16:02:47.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:47.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-504 td/osd-backfill-space/datafile 2020-09-08T16:02:48.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:48.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:48.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:48.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-505 td/osd-backfill-space/datafile 2020-09-08T16:02:48.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:48.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-505 td/osd-backfill-space/datafile 2020-09-08T16:02:48.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:48.327 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:48.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:48.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-506 td/osd-backfill-space/datafile 2020-09-08T16:02:48.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:48.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-506 td/osd-backfill-space/datafile 2020-09-08T16:02:48.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:48.578 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:48.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:48.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-507 td/osd-backfill-space/datafile 2020-09-08T16:02:48.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:48.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-507 td/osd-backfill-space/datafile 2020-09-08T16:02:48.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:48.821 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:48.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:48.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-508 td/osd-backfill-space/datafile 2020-09-08T16:02:48.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:48.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-508 td/osd-backfill-space/datafile 2020-09-08T16:02:49.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:49.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:49.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:49.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-509 td/osd-backfill-space/datafile 2020-09-08T16:02:49.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:49.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-509 td/osd-backfill-space/datafile 2020-09-08T16:02:49.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:49.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:49.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:49.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-510 td/osd-backfill-space/datafile 2020-09-08T16:02:49.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:49.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-510 td/osd-backfill-space/datafile 2020-09-08T16:02:49.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:49.767 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:49.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:49.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-511 td/osd-backfill-space/datafile 2020-09-08T16:02:49.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:49.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-511 td/osd-backfill-space/datafile 2020-09-08T16:02:50.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:50.035 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:50.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:50.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-512 td/osd-backfill-space/datafile 2020-09-08T16:02:50.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:50.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-512 td/osd-backfill-space/datafile 2020-09-08T16:02:50.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:50.252 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:50.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:50.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-513 td/osd-backfill-space/datafile 2020-09-08T16:02:50.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:50.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-513 td/osd-backfill-space/datafile 2020-09-08T16:02:50.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:50.494 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:50.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:50.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-514 td/osd-backfill-space/datafile 2020-09-08T16:02:50.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:50.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-514 td/osd-backfill-space/datafile 2020-09-08T16:02:50.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:50.747 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:50.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:50.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-515 td/osd-backfill-space/datafile 2020-09-08T16:02:50.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:50.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-515 td/osd-backfill-space/datafile 2020-09-08T16:02:51.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:51.006 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:51.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:51.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-516 td/osd-backfill-space/datafile 2020-09-08T16:02:51.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:51.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-516 td/osd-backfill-space/datafile 2020-09-08T16:02:51.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:51.253 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:51.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:51.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-517 td/osd-backfill-space/datafile 2020-09-08T16:02:51.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:51.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-517 td/osd-backfill-space/datafile 2020-09-08T16:02:51.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:51.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:51.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:51.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-518 td/osd-backfill-space/datafile 2020-09-08T16:02:51.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:51.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-518 td/osd-backfill-space/datafile 2020-09-08T16:02:51.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:51.742 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:51.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:51.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-519 td/osd-backfill-space/datafile 2020-09-08T16:02:51.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:51.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-519 td/osd-backfill-space/datafile 2020-09-08T16:02:51.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:51.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:51.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:51.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-520 td/osd-backfill-space/datafile 2020-09-08T16:02:52.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:52.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-520 td/osd-backfill-space/datafile 2020-09-08T16:02:52.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:52.227 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:52.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:52.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-521 td/osd-backfill-space/datafile 2020-09-08T16:02:52.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:52.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-521 td/osd-backfill-space/datafile 2020-09-08T16:02:52.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:52.478 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:52.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:52.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-522 td/osd-backfill-space/datafile 2020-09-08T16:02:52.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:52.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-522 td/osd-backfill-space/datafile 2020-09-08T16:02:52.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:52.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:52.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:52.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-523 td/osd-backfill-space/datafile 2020-09-08T16:02:52.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:52.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-523 td/osd-backfill-space/datafile 2020-09-08T16:02:52.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:52.956 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:52.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:52.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-524 td/osd-backfill-space/datafile 2020-09-08T16:02:53.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:53.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-524 td/osd-backfill-space/datafile 2020-09-08T16:02:53.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:53.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:53.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:53.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-525 td/osd-backfill-space/datafile 2020-09-08T16:02:53.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:53.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-525 td/osd-backfill-space/datafile 2020-09-08T16:02:53.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:53.466 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:53.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:53.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-526 td/osd-backfill-space/datafile 2020-09-08T16:02:53.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:53.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-526 td/osd-backfill-space/datafile 2020-09-08T16:02:53.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:53.709 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:53.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:53.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-527 td/osd-backfill-space/datafile 2020-09-08T16:02:53.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:53.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-527 td/osd-backfill-space/datafile 2020-09-08T16:02:53.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:53.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:53.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:53.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-528 td/osd-backfill-space/datafile 2020-09-08T16:02:54.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:54.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-528 td/osd-backfill-space/datafile 2020-09-08T16:02:54.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:54.186 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:54.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:54.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-529 td/osd-backfill-space/datafile 2020-09-08T16:02:54.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:54.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-529 td/osd-backfill-space/datafile 2020-09-08T16:02:54.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:54.438 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:54.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:54.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-530 td/osd-backfill-space/datafile 2020-09-08T16:02:54.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:54.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-530 td/osd-backfill-space/datafile 2020-09-08T16:02:54.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:54.873 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:54.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:54.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-531 td/osd-backfill-space/datafile 2020-09-08T16:02:55.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:55.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-531 td/osd-backfill-space/datafile 2020-09-08T16:02:55.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:55.141 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:55.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:55.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-532 td/osd-backfill-space/datafile 2020-09-08T16:02:55.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:55.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-532 td/osd-backfill-space/datafile 2020-09-08T16:02:55.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:55.425 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:55.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:55.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-533 td/osd-backfill-space/datafile 2020-09-08T16:02:55.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:55.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-533 td/osd-backfill-space/datafile 2020-09-08T16:02:55.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:55.709 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:55.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:55.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-534 td/osd-backfill-space/datafile 2020-09-08T16:02:55.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:55.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-534 td/osd-backfill-space/datafile 2020-09-08T16:02:55.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:55.994 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:55.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:55.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-535 td/osd-backfill-space/datafile 2020-09-08T16:02:56.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:56.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-535 td/osd-backfill-space/datafile 2020-09-08T16:02:56.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:56.253 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:56.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:56.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-536 td/osd-backfill-space/datafile 2020-09-08T16:02:56.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:56.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-536 td/osd-backfill-space/datafile 2020-09-08T16:02:56.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:56.506 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:56.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:56.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-537 td/osd-backfill-space/datafile 2020-09-08T16:02:56.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:56.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-537 td/osd-backfill-space/datafile 2020-09-08T16:02:56.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:56.768 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:56.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:56.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-538 td/osd-backfill-space/datafile 2020-09-08T16:02:56.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:56.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-538 td/osd-backfill-space/datafile 2020-09-08T16:02:57.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:57.044 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:57.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:57.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-539 td/osd-backfill-space/datafile 2020-09-08T16:02:57.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:57.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-539 td/osd-backfill-space/datafile 2020-09-08T16:02:57.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:57.335 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:57.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:57.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-540 td/osd-backfill-space/datafile 2020-09-08T16:02:57.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:57.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-540 td/osd-backfill-space/datafile 2020-09-08T16:02:57.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:57.603 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:57.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:57.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-541 td/osd-backfill-space/datafile 2020-09-08T16:02:57.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:57.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-541 td/osd-backfill-space/datafile 2020-09-08T16:02:57.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:57.854 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:57.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:57.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-542 td/osd-backfill-space/datafile 2020-09-08T16:02:57.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:57.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-542 td/osd-backfill-space/datafile 2020-09-08T16:02:58.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:58.097 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:58.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:58.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-543 td/osd-backfill-space/datafile 2020-09-08T16:02:58.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:58.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-543 td/osd-backfill-space/datafile 2020-09-08T16:02:58.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:58.373 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:58.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:58.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-544 td/osd-backfill-space/datafile 2020-09-08T16:02:58.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:58.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-544 td/osd-backfill-space/datafile 2020-09-08T16:02:58.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:58.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:58.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:58.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-545 td/osd-backfill-space/datafile 2020-09-08T16:02:58.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:58.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-545 td/osd-backfill-space/datafile 2020-09-08T16:02:58.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:58.902 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:58.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:58.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-546 td/osd-backfill-space/datafile 2020-09-08T16:02:59.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:59.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-546 td/osd-backfill-space/datafile 2020-09-08T16:02:59.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:59.176 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:59.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:59.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-547 td/osd-backfill-space/datafile 2020-09-08T16:02:59.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:59.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-547 td/osd-backfill-space/datafile 2020-09-08T16:02:59.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:59.427 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:59.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:59.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-548 td/osd-backfill-space/datafile 2020-09-08T16:02:59.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:59.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-548 td/osd-backfill-space/datafile 2020-09-08T16:02:59.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:59.662 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:59.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:59.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-549 td/osd-backfill-space/datafile 2020-09-08T16:02:59.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:59.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-549 td/osd-backfill-space/datafile 2020-09-08T16:02:59.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:02:59.896 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:02:59.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:02:59.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-550 td/osd-backfill-space/datafile 2020-09-08T16:03:00.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:00.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-550 td/osd-backfill-space/datafile 2020-09-08T16:03:00.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:00.139 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:00.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:00.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-551 td/osd-backfill-space/datafile 2020-09-08T16:03:00.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:00.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-551 td/osd-backfill-space/datafile 2020-09-08T16:03:00.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:00.391 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:00.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:00.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-552 td/osd-backfill-space/datafile 2020-09-08T16:03:00.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:00.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-552 td/osd-backfill-space/datafile 2020-09-08T16:03:00.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:00.633 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:00.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:00.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-553 td/osd-backfill-space/datafile 2020-09-08T16:03:00.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:00.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-553 td/osd-backfill-space/datafile 2020-09-08T16:03:00.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:00.877 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:00.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:00.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-554 td/osd-backfill-space/datafile 2020-09-08T16:03:01.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:01.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-554 td/osd-backfill-space/datafile 2020-09-08T16:03:01.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:01.144 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:01.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:01.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-555 td/osd-backfill-space/datafile 2020-09-08T16:03:01.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:01.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-555 td/osd-backfill-space/datafile 2020-09-08T16:03:01.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:01.412 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:01.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:01.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-556 td/osd-backfill-space/datafile 2020-09-08T16:03:01.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:01.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-556 td/osd-backfill-space/datafile 2020-09-08T16:03:01.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:01.672 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:01.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:01.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-557 td/osd-backfill-space/datafile 2020-09-08T16:03:01.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:01.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-557 td/osd-backfill-space/datafile 2020-09-08T16:03:01.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:01.915 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:01.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:01.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-558 td/osd-backfill-space/datafile 2020-09-08T16:03:02.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:02.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-558 td/osd-backfill-space/datafile 2020-09-08T16:03:02.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:02.166 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:02.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:02.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-559 td/osd-backfill-space/datafile 2020-09-08T16:03:02.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:02.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-559 td/osd-backfill-space/datafile 2020-09-08T16:03:02.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:02.409 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:02.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:02.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-560 td/osd-backfill-space/datafile 2020-09-08T16:03:02.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:02.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-560 td/osd-backfill-space/datafile 2020-09-08T16:03:02.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:02.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:02.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:02.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-561 td/osd-backfill-space/datafile 2020-09-08T16:03:02.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:02.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-561 td/osd-backfill-space/datafile 2020-09-08T16:03:02.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:02.915 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:02.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:02.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-562 td/osd-backfill-space/datafile 2020-09-08T16:03:03.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:03.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-562 td/osd-backfill-space/datafile 2020-09-08T16:03:03.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:03.194 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:03.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:03.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-563 td/osd-backfill-space/datafile 2020-09-08T16:03:03.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:03.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-563 td/osd-backfill-space/datafile 2020-09-08T16:03:03.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:03.418 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:03.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:03.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-564 td/osd-backfill-space/datafile 2020-09-08T16:03:03.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:03.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-564 td/osd-backfill-space/datafile 2020-09-08T16:03:03.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:03.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:03.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:03.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-565 td/osd-backfill-space/datafile 2020-09-08T16:03:03.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:03.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-565 td/osd-backfill-space/datafile 2020-09-08T16:03:03.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:03.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:03.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:03.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-566 td/osd-backfill-space/datafile 2020-09-08T16:03:04.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:04.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-566 td/osd-backfill-space/datafile 2020-09-08T16:03:04.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:04.171 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:04.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:04.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-567 td/osd-backfill-space/datafile 2020-09-08T16:03:04.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:04.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-567 td/osd-backfill-space/datafile 2020-09-08T16:03:04.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:04.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:04.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:04.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-568 td/osd-backfill-space/datafile 2020-09-08T16:03:04.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:04.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-568 td/osd-backfill-space/datafile 2020-09-08T16:03:04.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:04.657 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:04.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:04.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-569 td/osd-backfill-space/datafile 2020-09-08T16:03:04.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:04.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-569 td/osd-backfill-space/datafile 2020-09-08T16:03:04.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:04.917 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:04.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:04.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-570 td/osd-backfill-space/datafile 2020-09-08T16:03:05.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:05.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-570 td/osd-backfill-space/datafile 2020-09-08T16:03:05.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:05.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:05.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:05.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-571 td/osd-backfill-space/datafile 2020-09-08T16:03:05.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:05.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-571 td/osd-backfill-space/datafile 2020-09-08T16:03:05.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:05.427 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:05.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:05.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-572 td/osd-backfill-space/datafile 2020-09-08T16:03:05.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:05.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-572 td/osd-backfill-space/datafile 2020-09-08T16:03:05.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:05.679 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:05.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:05.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-573 td/osd-backfill-space/datafile 2020-09-08T16:03:05.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:05.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-573 td/osd-backfill-space/datafile 2020-09-08T16:03:05.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:05.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:05.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:05.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-574 td/osd-backfill-space/datafile 2020-09-08T16:03:06.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:06.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-574 td/osd-backfill-space/datafile 2020-09-08T16:03:06.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:06.181 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:06.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:06.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-575 td/osd-backfill-space/datafile 2020-09-08T16:03:06.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:06.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-575 td/osd-backfill-space/datafile 2020-09-08T16:03:06.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:06.432 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:06.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:06.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-576 td/osd-backfill-space/datafile 2020-09-08T16:03:06.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:06.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-576 td/osd-backfill-space/datafile 2020-09-08T16:03:06.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:06.683 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:06.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:06.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-577 td/osd-backfill-space/datafile 2020-09-08T16:03:06.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:06.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-577 td/osd-backfill-space/datafile 2020-09-08T16:03:06.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:06.943 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:06.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:06.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-578 td/osd-backfill-space/datafile 2020-09-08T16:03:07.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:07.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-578 td/osd-backfill-space/datafile 2020-09-08T16:03:07.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:07.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:07.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:07.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-579 td/osd-backfill-space/datafile 2020-09-08T16:03:07.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:07.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-579 td/osd-backfill-space/datafile 2020-09-08T16:03:07.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:07.481 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:07.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:07.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-580 td/osd-backfill-space/datafile 2020-09-08T16:03:07.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:07.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-580 td/osd-backfill-space/datafile 2020-09-08T16:03:07.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:07.738 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:07.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:07.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-581 td/osd-backfill-space/datafile 2020-09-08T16:03:07.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:07.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-581 td/osd-backfill-space/datafile 2020-09-08T16:03:07.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:07.989 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:07.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:07.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-582 td/osd-backfill-space/datafile 2020-09-08T16:03:08.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:08.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-582 td/osd-backfill-space/datafile 2020-09-08T16:03:08.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:08.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:08.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:08.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-583 td/osd-backfill-space/datafile 2020-09-08T16:03:08.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:08.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-583 td/osd-backfill-space/datafile 2020-09-08T16:03:08.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:08.501 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:08.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:08.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-584 td/osd-backfill-space/datafile 2020-09-08T16:03:08.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:08.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-584 td/osd-backfill-space/datafile 2020-09-08T16:03:08.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:08.766 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:08.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:08.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-585 td/osd-backfill-space/datafile 2020-09-08T16:03:08.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:08.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-585 td/osd-backfill-space/datafile 2020-09-08T16:03:09.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:09.042 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:09.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:09.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-586 td/osd-backfill-space/datafile 2020-09-08T16:03:09.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:09.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-586 td/osd-backfill-space/datafile 2020-09-08T16:03:09.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:09.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:09.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:09.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-587 td/osd-backfill-space/datafile 2020-09-08T16:03:09.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:09.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-587 td/osd-backfill-space/datafile 2020-09-08T16:03:09.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:09.587 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:09.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:09.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-588 td/osd-backfill-space/datafile 2020-09-08T16:03:09.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:09.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-588 td/osd-backfill-space/datafile 2020-09-08T16:03:09.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:09.854 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:09.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:09.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-589 td/osd-backfill-space/datafile 2020-09-08T16:03:09.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:09.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-589 td/osd-backfill-space/datafile 2020-09-08T16:03:10.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:10.106 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:10.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:10.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-590 td/osd-backfill-space/datafile 2020-09-08T16:03:10.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:10.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-590 td/osd-backfill-space/datafile 2020-09-08T16:03:10.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:10.382 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:10.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:10.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-591 td/osd-backfill-space/datafile 2020-09-08T16:03:10.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:10.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-591 td/osd-backfill-space/datafile 2020-09-08T16:03:10.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:10.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:10.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:10.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-592 td/osd-backfill-space/datafile 2020-09-08T16:03:10.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:10.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-592 td/osd-backfill-space/datafile 2020-09-08T16:03:10.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:10.917 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:10.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:10.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-593 td/osd-backfill-space/datafile 2020-09-08T16:03:11.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:11.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-593 td/osd-backfill-space/datafile 2020-09-08T16:03:11.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:11.177 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:11.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:11.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-594 td/osd-backfill-space/datafile 2020-09-08T16:03:11.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:11.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-594 td/osd-backfill-space/datafile 2020-09-08T16:03:11.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:11.478 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:11.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:11.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-595 td/osd-backfill-space/datafile 2020-09-08T16:03:11.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:11.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-595 td/osd-backfill-space/datafile 2020-09-08T16:03:11.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:11.747 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:11.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:11.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-596 td/osd-backfill-space/datafile 2020-09-08T16:03:11.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:11.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-596 td/osd-backfill-space/datafile 2020-09-08T16:03:11.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:11.997 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:11.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:11.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-597 td/osd-backfill-space/datafile 2020-09-08T16:03:12.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:12.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-597 td/osd-backfill-space/datafile 2020-09-08T16:03:12.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:12.248 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:12.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:12.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-598 td/osd-backfill-space/datafile 2020-09-08T16:03:12.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:12.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-598 td/osd-backfill-space/datafile 2020-09-08T16:03:12.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:12.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:12.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:12.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-599 td/osd-backfill-space/datafile 2020-09-08T16:03:12.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:12.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-599 td/osd-backfill-space/datafile 2020-09-08T16:03:12.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2020-09-08T16:03:12.775 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:03:12.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:12.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-600 td/osd-backfill-space/datafile 2020-09-08T16:03:12.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2020-09-08T16:03:12.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-600 td/osd-backfill-space/datafile 2020-09-08T16:03:13.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:508: TEST_backfill_multi_partial: kill_daemon td/osd-backfill-space/osd.2.pid TERM 2020-09-08T16:03:13.043 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: cat td/osd-backfill-space/osd.2.pid 2020-09-08T16:03:13.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: local pid=216296 2020-09-08T16:03:13.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: local send_signal=TERM 2020-09-08T16:03:13.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2020-09-08T16:03:13.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:258: kill_daemon: local exit_code=1 2020-09-08T16:03:13.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2020-09-08T16:03:13.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 216296 2020-09-08T16:03:13.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2020-09-08T16:03:13.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2020-09-08T16:03:13.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.1 2020-09-08T16:03:13.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2020-09-08T16:03:13.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 216296 2020-09-08T16:03:13.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:265: kill_daemon: exit_code=0 2020-09-08T16:03:13.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:266: kill_daemon: break 2020-09-08T16:03:13.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:271: kill_daemon: return 0 2020-09-08T16:03:13.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:509: TEST_backfill_multi_partial: ceph osd out osd.2 2020-09-08T16:03:13.709 INFO:tasks.workunit.client.0.smithi065.stderr:osd.2 is already out. 2020-09-08T16:03:13.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:511: TEST_backfill_multi_partial: activate_osd td/osd-backfill-space 1 2020-09-08T16:03:13.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/osd-backfill-space 2020-09-08T16:03:13.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T16:03:13.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=1 2020-09-08T16:03:13.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T16:03:13.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/osd-backfill-space/1 2020-09-08T16:03:13.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:03:13.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:03:13.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:03:13.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:03:13.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2020-09-08T16:03:13.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2020-09-08T16:03:13.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T16:03:13.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T16:03:13.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:03:13.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T16:03:13.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:03:13.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:03:13.725 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:03:13.725 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:03:13.725 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:03:13.726 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:03:13.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:03:13.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:03:13.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:03:13.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:03:13.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:03:13.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:03:13.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:03:13.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T16:03:13.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T16:03:13.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/osd-backfill-space/1 2020-09-08T16:03:13.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.1 2020-09-08T16:03:13.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 1 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:03:13.729 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/osd-backfill-space/1/whoami 2020-09-08T16:03:13.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 1 = 1 ']' 2020-09-08T16:03:13.730 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T16:03:13.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T16:03:13.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T16:03:13.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T16:03:13.746 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:03:13.751+0000 7eff39b2bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:03:13.747 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:03:13.752+0000 7eff39b2bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:03:13.748 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:03:13.753+0000 7eff39b2bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:03:14.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 1 2020-09-08T16:03:14.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:03:14.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T16:03:14.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:03:14.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:03:14.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:03:14.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:03:14.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:03:14.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:03:14.136 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:03:14.268 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:03:14.272+0000 7eff39b2bec0 -1 Falling back to public interface 2020-09-08T16:03:14.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:03:15.335 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:03:15.340+0000 7eff39b2bec0 -1 osd.1 44 log_to_monitors {default=true} 2020-09-08T16:03:15.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:03:15.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:03:15.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:03:15.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:03:15.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:03:15.546 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:03:16.044 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up out weight 0 up_from 49 up_thru 50 down_at 46 last_clean_interval [41,44) [v2:127.0.0.1:6810/242224,v1:127.0.0.1:6811/242224] [v2:127.0.0.1:6812/242224,v1:127.0.0.1:6813/242224] exists,up 7a372dc9-d171-46e1-bc31-12a3e2311ac0 2020-09-08T16:03:16.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:03:16.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:03:16.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:03:16.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:512: TEST_backfill_multi_partial: ceph osd in osd.1 2020-09-08T16:03:16.648 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already in. 2020-09-08T16:03:16.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:513: TEST_backfill_multi_partial: sleep 30 2020-09-08T16:03:46.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:515: TEST_backfill_multi_partial: wait_for_not_backfilling 240 2020-09-08T16:03:46.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:82: wait_for_not_backfilling: local timeout=240 2020-09-08T16:03:46.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:83: wait_for_not_backfilling: wait_for_not_state backfilling 240 2020-09-08T16:03:46.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:53: wait_for_not_state: local state=backfilling 2020-09-08T16:03:46.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:54: wait_for_not_state: local num_in_state=-1 2020-09-08T16:03:46.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:55: wait_for_not_state: local cur_in_state 2020-09-08T16:03:46.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: delays=($(get_timeout_delays $2 5)) 2020-09-08T16:03:46.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: get_timeout_delays 240 5 2020-09-08T16:03:46.665 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:03:46.665 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:03:46.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:03:46.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:03:46.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:03:46.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: local -a delays 2020-09-08T16:03:46.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:57: wait_for_not_state: local -i loop=0 2020-09-08T16:03:46.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:59: wait_for_not_state: flush_pg_stats 2020-09-08T16:03:46.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:03:46.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:03:47.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:03:47.198 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:03:47.198 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T16:03:47.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:03:47.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:03:47.199 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:03:47.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836569 2020-09-08T16:03:47.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836569 2020-09-08T16:03:47.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836569' 2020-09-08T16:03:47.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:03:47.331 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:03:47.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=210453397513 2020-09-08T16:03:47.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 210453397513 2020-09-08T16:03:47.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836569 1-210453397513' 2020-09-08T16:03:47.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:03:47.465 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:03:47.560 INFO:tasks.workunit.client.0.smithi065.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-09-08T16:03:47.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq= 2020-09-08T16:03:47.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z '' 2020-09-08T16:03:47.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: continue 2020-09-08T16:03:47.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:03:47.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836569 2020-09-08T16:03:47.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:03:47.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:03:47.576 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836569 2020-09-08T16:03:47.576 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:03:47.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836569 2020-09-08T16:03:47.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836569' 2020-09-08T16:03:47.577 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:03:47.577 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836569 2020-09-08T16:03:47.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836566 -lt 21474836569 2020-09-08T16:03:47.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:03:48.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:03:48.961 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:03:49.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836569 -lt 21474836569 2020-09-08T16:03:49.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:03:49.374 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-210453397513 2020-09-08T16:03:49.387 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:03:49.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:03:49.388 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-210453397513 2020-09-08T16:03:49.388 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:03:49.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=210453397513 2020-09-08T16:03:49.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 210453397513' 2020-09-08T16:03:49.398 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:03:49.398 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 210453397513 2020-09-08T16:03:49.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 210453397513 -lt 210453397513 2020-09-08T16:03:49.774 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: get_num_pgs 2020-09-08T16:03:49.774 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:03:49.774 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:03:50.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: test 3 == 0 2020-09-08T16:03:50.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:03:50.303 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:03:50.304 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:03:50.304 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:03:50.304 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:03:50.304 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:03:50.304 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:03:50.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=1 2020-09-08T16:03:50.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 1 = 0 2020-09-08T16:03:50.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 1 '!=' -1 2020-09-08T16:03:50.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:68: wait_for_not_state: loop=0 2020-09-08T16:03:50.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:69: wait_for_not_state: num_in_state=1 2020-09-08T16:03:50.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 5 2020-09-08T16:03:55.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:03:55.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:03:55.682 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:03:55.682 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:03:55.682 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:03:55.682 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:03:55.682 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:03:55.683 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:03:56.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=1 2020-09-08T16:03:56.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 1 = 0 2020-09-08T16:03:56.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 1 '!=' 1 2020-09-08T16:03:56.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 1 >= 17 )) 2020-09-08T16:03:56.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 10 2020-09-08T16:04:06.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:04:06.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:04:06.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:04:06.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:04:06.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:04:06.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:04:06.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:04:06.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:04:06.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=1 2020-09-08T16:04:06.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 1 = 0 2020-09-08T16:04:06.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 1 '!=' 1 2020-09-08T16:04:06.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 2 >= 17 )) 2020-09-08T16:04:06.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 15 2020-09-08T16:04:21.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:04:21.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:04:21.481 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:04:21.481 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:04:21.481 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:04:21.481 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:04:21.482 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:04:21.482 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:04:21.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=1 2020-09-08T16:04:21.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 1 = 0 2020-09-08T16:04:21.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 1 '!=' 1 2020-09-08T16:04:21.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 3 >= 17 )) 2020-09-08T16:04:21.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 15 2020-09-08T16:04:36.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:04:36.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:04:36.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:04:36.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:04:36.881 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:04:36.881 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:04:36.881 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:04:36.881 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:04:37.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=1 2020-09-08T16:04:37.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 1 = 0 2020-09-08T16:04:37.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 1 '!=' 1 2020-09-08T16:04:37.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 4 >= 17 )) 2020-09-08T16:04:37.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 15 2020-09-08T16:04:52.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:04:52.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:04:52.278 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:04:52.278 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:04:52.278 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:04:52.278 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:04:52.278 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:04:52.279 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:04:52.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=0 2020-09-08T16:04:52.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 0 = 0 2020-09-08T16:04:52.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: break 2020-09-08T16:04:52.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:77: wait_for_not_state: return 0 2020-09-08T16:04:52.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:516: TEST_backfill_multi_partial: wait_for_not_activating 60 2020-09-08T16:04:52.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:88: wait_for_not_activating: local timeout=60 2020-09-08T16:04:52.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:89: wait_for_not_activating: wait_for_not_state activating 60 2020-09-08T16:04:52.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:53: wait_for_not_state: local state=activating 2020-09-08T16:04:52.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:54: wait_for_not_state: local num_in_state=-1 2020-09-08T16:04:52.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:55: wait_for_not_state: local cur_in_state 2020-09-08T16:04:52.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: delays=($(get_timeout_delays $2 5)) 2020-09-08T16:04:52.672 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: get_timeout_delays 60 5 2020-09-08T16:04:52.672 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:04:52.672 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:04:52.672 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:04:52.672 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:04:52.673 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:04:52.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: local -a delays 2020-09-08T16:04:52.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:57: wait_for_not_state: local -i loop=0 2020-09-08T16:04:52.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:59: wait_for_not_state: flush_pg_stats 2020-09-08T16:04:52.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:04:52.711 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:04:53.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:04:53.108 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:04:53.108 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T16:04:53.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:04:53.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:04:53.109 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:04:53.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836584 2020-09-08T16:04:53.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836584 2020-09-08T16:04:53.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836584' 2020-09-08T16:04:53.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:04:53.242 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:04:53.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=210453397528 2020-09-08T16:04:53.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 210453397528 2020-09-08T16:04:53.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836584 1-210453397528' 2020-09-08T16:04:53.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:04:53.375 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:04:53.466 INFO:tasks.workunit.client.0.smithi065.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-09-08T16:04:53.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq= 2020-09-08T16:04:53.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z '' 2020-09-08T16:04:53.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: continue 2020-09-08T16:04:53.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:04:53.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836584 2020-09-08T16:04:53.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:04:53.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:04:53.471 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836584 2020-09-08T16:04:53.471 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:04:53.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836584 2020-09-08T16:04:53.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836584' 2020-09-08T16:04:53.472 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:04:53.472 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836584 2020-09-08T16:04:53.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836582 -lt 21474836584 2020-09-08T16:04:53.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:04:54.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:04:54.865 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:04:55.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836584 -lt 21474836584 2020-09-08T16:04:55.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:04:55.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-210453397528 2020-09-08T16:04:55.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:04:55.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:04:55.273 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-210453397528 2020-09-08T16:04:55.274 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:04:55.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=210453397528 2020-09-08T16:04:55.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 210453397528' 2020-09-08T16:04:55.275 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:04:55.275 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 210453397528 2020-09-08T16:04:55.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 210453397528 -lt 210453397528 2020-09-08T16:04:55.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: get_num_pgs 2020-09-08T16:04:55.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:04:55.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:04:56.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: test 3 == 0 2020-09-08T16:04:56.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:04:56.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state activating 2020-09-08T16:04:56.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=activating 2020-09-08T16:04:56.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:04:56.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("activating"))' 2020-09-08T16:04:56.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:04:56.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("activating"))] | length' 2020-09-08T16:04:56.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=0 2020-09-08T16:04:56.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 0 = 0 2020-09-08T16:04:56.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: break 2020-09-08T16:04:56.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:77: wait_for_not_state: return 0 2020-09-08T16:04:56.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:518: TEST_backfill_multi_partial: flush_pg_stats 2020-09-08T16:04:56.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:04:56.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:04:56.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:04:56.982 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:04:56.982 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T16:04:56.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:04:56.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:04:56.983 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:04:57.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836587 2020-09-08T16:04:57.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836587 2020-09-08T16:04:57.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836587' 2020-09-08T16:04:57.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:04:57.121 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:04:57.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=210453397531 2020-09-08T16:04:57.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 210453397531 2020-09-08T16:04:57.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836587 1-210453397531' 2020-09-08T16:04:57.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:04:57.254 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:04:57.347 INFO:tasks.workunit.client.0.smithi065.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-09-08T16:04:57.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq= 2020-09-08T16:04:57.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z '' 2020-09-08T16:04:57.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: continue 2020-09-08T16:04:57.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:04:57.349 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836587 2020-09-08T16:04:57.349 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:04:57.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:04:57.350 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836587 2020-09-08T16:04:57.350 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:04:57.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836587 2020-09-08T16:04:57.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836587' 2020-09-08T16:04:57.352 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:04:57.352 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836587 2020-09-08T16:04:57.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836584 -lt 21474836587 2020-09-08T16:04:57.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:04:58.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:04:58.751 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:04:59.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836587 -lt 21474836587 2020-09-08T16:04:59.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:04:59.159 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-210453397531 2020-09-08T16:04:59.160 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:04:59.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:04:59.161 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-210453397531 2020-09-08T16:04:59.161 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:04:59.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=210453397531 2020-09-08T16:04:59.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 210453397531' 2020-09-08T16:04:59.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:04:59.162 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 210453397531 2020-09-08T16:04:59.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 210453397531 -lt 210453397531 2020-09-08T16:04:59.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:519: TEST_backfill_multi_partial: ceph pg dump pgs 2020-09-08T16:04:59.943 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T16:04:59.943 INFO:tasks.workunit.client.0.smithi065.stdout:3.0 600 0 600 0 0 1566600 0 0 100 100 active+undersized+degraded+remapped+backfill_toofull 2020-09-08T16:04:47.513757+0000 46'600 56:678 [1,0] 1 [0] 0 0'0 2020-09-08T15:57:10.462737+0000 0'0 2020-09-08T15:57:10.462737+0000 0 2020-09-08T16:04:59.944 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 600 0 0 0 0 1566600 0 0 100 100 active+clean 2020-09-08T16:03:16.974754+0000 36'600 55:652 [1] 1 [1] 1 0'0 2020-09-08T15:57:05.166131+0000 0'0 2020-09-08T15:57:05.166131+0000 0 2020-09-08T16:04:59.944 INFO:tasks.workunit.client.0.smithi065.stdout:2.0 600 0 0 0 0 1566600 0 0 10 10 active+clean 2020-09-08T16:04:46.146671+0000 46'1200 56:2486 [1,0] 1 [1,0] 1 0'0 2020-09-08T15:57:07.796898+0000 0'0 2020-09-08T15:57:07.796898+0000 0 2020-09-08T16:04:59.944 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T16:04:59.944 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T16:04:59.945 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:04:59.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:521: TEST_backfill_multi_partial: ERRORS=0 2020-09-08T16:04:59.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:522: TEST_backfill_multi_partial: get_num_in_state backfill_toofull 2020-09-08T16:04:59.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfill_toofull 2020-09-08T16:04:59.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:04:59.955 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfill_toofull"))' 2020-09-08T16:04:59.955 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:04:59.955 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfill_toofull"))] | length' 2020-09-08T16:05:00.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:522: TEST_backfill_multi_partial: '[' 1 '!=' 1 ']' 2020-09-08T16:05:00.334 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:528: TEST_backfill_multi_partial: get_num_in_state active+clean 2020-09-08T16:05:00.334 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=active+clean 2020-09-08T16:05:00.335 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:05:00.335 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("active+clean"))' 2020-09-08T16:05:00.335 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:05:00.335 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("active+clean"))] | length' 2020-09-08T16:05:00.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:528: TEST_backfill_multi_partial: '[' 2 '!=' 2 ']' 2020-09-08T16:05:00.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:534: TEST_backfill_multi_partial: '[' 0 '!=' 0 ']' 2020-09-08T16:05:00.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:539: TEST_backfill_multi_partial: delete_pool fillpool 2020-09-08T16:05:00.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=fillpool 2020-09-08T16:05:00.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete fillpool fillpool --yes-i-really-really-mean-it 2020-09-08T16:05:01.248 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'fillpool' does not exist 2020-09-08T16:05:01.256 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:540: TEST_backfill_multi_partial: seq 1 2 2020-09-08T16:05:01.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:540: TEST_backfill_multi_partial: for i in $(seq 1 $pools) 2020-09-08T16:05:01.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:542: TEST_backfill_multi_partial: delete_pool test1 2020-09-08T16:05:01.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test1 2020-09-08T16:05:01.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2020-09-08T16:05:01.766 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test1' does not exist 2020-09-08T16:05:01.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:540: TEST_backfill_multi_partial: for i in $(seq 1 $pools) 2020-09-08T16:05:01.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:542: TEST_backfill_multi_partial: delete_pool test2 2020-09-08T16:05:01.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test2 2020-09-08T16:05:01.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test2 test2 --yes-i-really-really-mean-it 2020-09-08T16:05:02.337 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test2' does not exist 2020-09-08T16:05:02.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:544: TEST_backfill_multi_partial: kill_daemons td/osd-backfill-space 2020-09-08T16:05:02.346 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:05:02.349 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:05:02.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:05:02.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:05:02.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:05:02.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:05:02.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:545: TEST_backfill_multi_partial: grep -q 'num_bytes mismatch' td/osd-backfill-space/osd.0.log td/osd-backfill-space/osd.1.log td/osd-backfill-space/osd.2.log 2020-09-08T16:05:02.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:38: run: teardown td/osd-backfill-space 2020-09-08T16:05:02.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2020-09-08T16:05:02.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:05:02.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2020-09-08T16:05:02.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:05:02.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:05:02.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:05:02.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:05:02.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:05:02.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:05:02.704 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:05:02.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:05:02.705 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:05:02.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:05:02.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:05:02.706 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:05:02.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:05:02.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:05:02.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:05:02.708 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:05:02.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:05:02.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:05:02.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2020-09-08T16:05:02.766 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:05:02.767 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:05:02.767 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:05:02.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.154687 2020-09-08T16:05:02.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:05:02.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:05:02.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:35: run: for func in $funcs 2020-09-08T16:05:02.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:36: run: setup td/osd-backfill-space 2020-09-08T16:05:02.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-space 2020-09-08T16:05:02.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-space 2020-09-08T16:05:02.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2020-09-08T16:05:02.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:05:02.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2020-09-08T16:05:02.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:05:02.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:05:02.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:05:02.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:05:02.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:05:02.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:05:02.773 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:05:02.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:05:02.773 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:05:02.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:05:02.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:05:02.774 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:05:02.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:05:02.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:05:02.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:05:02.775 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:05:02.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:05:02.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:05:02.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2020-09-08T16:05:02.779 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:05:02.779 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:05:02.779 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:05:02.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.154687 2020-09-08T16:05:02.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:05:02.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:05:02.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-space 2020-09-08T16:05:02.782 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T16:05:02.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:05:02.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:05:02.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.154687 2020-09-08T16:05:02.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T16:05:02.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T16:05:02.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T16:05:02.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2020-09-08T16:05:02.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:37: run: TEST_backfill_test_multi td/osd-backfill-space 2020-09-08T16:05:02.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:191: TEST_backfill_test_multi: local dir=td/osd-backfill-space 2020-09-08T16:05:02.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:192: TEST_backfill_test_multi: local pools=8 2020-09-08T16:05:02.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:193: TEST_backfill_test_multi: local OSDS=20 2020-09-08T16:05:02.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:195: TEST_backfill_test_multi: run_mon td/osd-backfill-space a 2020-09-08T16:05:02.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-space 2020-09-08T16:05:02.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T16:05:02.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T16:05:02.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T16:05:02.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-space/a 2020-09-08T16:05:02.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2020-09-08T16:05:03.068 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T16:05:03.069 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:05:03.069 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:05:03.069 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:05:03.069 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:05:03.069 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:05:03.070 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:05:03.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T16:05:03.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T16:05:03.249 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T16:05:03.249 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:05:03.249 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:05:03.250 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T16:05:03.250 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T16:05:03.251 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:05:03.251 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:05:03.251 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:05:03.251 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:05:03.252 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:05:03.252 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:05:03.252 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.154687/ceph-mon.a.asok 2020-09-08T16:05:03.252 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:05:03.252 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.154687/ceph-mon.a.asok config get fsid 2020-09-08T16:05:03.343 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T16:05:03.343 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:05:03.343 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:05:03.344 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T16:05:03.344 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T16:05:03.344 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:05:03.344 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:05:03.344 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:05:03.345 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:05:03.346 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:05:03.346 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:05:03.346 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.154687/ceph-mon.a.asok 2020-09-08T16:05:03.346 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:05:03.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.154687/ceph-mon.a.asok config get mon_host 2020-09-08T16:05:03.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:196: TEST_backfill_test_multi: run_mgr td/osd-backfill-space x 2020-09-08T16:05:03.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-space 2020-09-08T16:05:03.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T16:05:03.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T16:05:03.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T16:05:03.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-space/x 2020-09-08T16:05:03.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T16:05:04.335 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T16:05:04.335 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:05:04.335 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:05:04.335 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:05:04.336 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:05:04.336 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:05:04.336 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:05:04.337 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:05:04.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:05:04.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:197: TEST_backfill_test_multi: export CEPH_ARGS 2020-09-08T16:05:04.361 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: expr 20 - 1 2020-09-08T16:05:04.362 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: seq 0 19 2020-09-08T16:05:04.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:05:04.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:201: TEST_backfill_test_multi: run_osd td/osd-backfill-space 0 2020-09-08T16:05:04.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:05:04.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:05:04.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T16:05:04.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:05:04.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/0 2020-09-08T16:05:04.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:05:04.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:05:04.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:05:04.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:05:04.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2020-09-08T16:05:04.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2020-09-08T16:05:04.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:05:04.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:05:04.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:05:04.371 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:05:04.372 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:05:04.372 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:05:04.372 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:05:04.372 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:05:04.372 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:05:04.373 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:05:04.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:05:04.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:05:04.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:05:04.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:05:04.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:05:04.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:05:04.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:05:04.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:05:04.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:05:04.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:05:04.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:05:04.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/0 2020-09-08T16:05:04.384 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:05:04.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=83a88f75-38e5-47fd-b31f-f2e53f7c7ed2 2020-09-08T16:05:04.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 83a88f75-38e5-47fd-b31f-f2e53f7c7ed2' 2020-09-08T16:05:04.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:05:04.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCwq1df9T87FxAAprm9v4WG4ipFmaPHU3itqA== 2020-09-08T16:05:04.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCwq1df9T87FxAAprm9v4WG4ipFmaPHU3itqA=="}' 2020-09-08T16:05:04.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 83a88f75-38e5-47fd-b31f-f2e53f7c7ed2 -i td/osd-backfill-space/0/new.json 2020-09-08T16:05:04.387 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 83a88f75-38e5-47fd-b31f-f2e53f7c7ed2 2020-09-08T16:05:04.725 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:05:04.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/0/new.json 2020-09-08T16:05:04.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCwq1df9T87FxAAprm9v4WG4ipFmaPHU3itqA== --osd-uuid 83a88f75-38e5-47fd-b31f-f2e53f7c7ed2 2020-09-08T16:05:04.764 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:04.769+0000 7f3636127ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:04.765 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:04.771+0000 7f3636127ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:04.766 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:04.771+0000 7f3636127ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:04.767 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:04.772+0000 7f3636127ec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T16:05:04.767 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:04.772+0000 7f3636127ec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T16:05:04.767 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:04.772+0000 7f3636127ec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T16:05:04.804 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:04.809+0000 7f3636127ec0 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2020-09-08T16:05:08.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2020-09-08T16:05:08.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:05:08.930 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T16:05:08.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T16:05:08.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:05:09.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T16:05:09.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:05:09.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:05:09.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:05:09.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:05:09.467 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T16:05:09.491 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:09.496+0000 7f685759eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:09.511 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:09.516+0000 7f685759eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:09.512 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:09.517+0000 7f685759eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:09.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T16:05:09.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:05:09.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T16:05:09.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:05:09.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:05:09.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:05:09.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:05:09.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:05:09.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:05:09.866 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:05:10.028 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:10.033+0000 7f685759eec0 -1 Falling back to public interface 2020-09-08T16:05:10.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:05:10.819 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:10.824+0000 7f685759eec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T16:05:11.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:05:11.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:05:11.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:05:11.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:05:11.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:05:11.283 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:05:11.712 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/244668,v1:127.0.0.1:6803/244668] [v2:127.0.0.1:6804/244668,v1:127.0.0.1:6805/244668] exists,up 83a88f75-38e5-47fd-b31f-f2e53f7c7ed2 2020-09-08T16:05:11.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:05:11.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:05:11.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:05:11.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:05:11.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:201: TEST_backfill_test_multi: run_osd td/osd-backfill-space 1 2020-09-08T16:05:11.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:05:11.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:05:11.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T16:05:11.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:05:11.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/1 2020-09-08T16:05:11.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:05:11.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:05:11.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:05:11.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:05:11.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2020-09-08T16:05:11.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2020-09-08T16:05:11.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:05:11.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:05:11.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:05:11.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:05:11.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:05:11.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:05:11.717 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:05:11.717 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:05:11.717 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:05:11.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:05:11.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:05:11.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:05:11.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:05:11.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:05:11.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:05:11.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:05:11.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:05:11.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:05:11.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:05:11.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:05:11.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:05:11.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/1 2020-09-08T16:05:11.720 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:05:11.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=1d6069b9-9961-499c-8147-e5110b631d3d 2020-09-08T16:05:11.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 1d6069b9-9961-499c-8147-e5110b631d3d' 2020-09-08T16:05:11.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:05:11.722 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 1d6069b9-9961-499c-8147-e5110b631d3d 2020-09-08T16:05:11.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQC3q1dfPR7SKxAAmCdN/yxOxVPVxJiHpaRH8g== 2020-09-08T16:05:11.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQC3q1dfPR7SKxAAmCdN/yxOxVPVxJiHpaRH8g=="}' 2020-09-08T16:05:11.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 1d6069b9-9961-499c-8147-e5110b631d3d -i td/osd-backfill-space/1/new.json 2020-09-08T16:05:12.234 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:05:12.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/1/new.json 2020-09-08T16:05:12.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQC3q1dfPR7SKxAAmCdN/yxOxVPVxJiHpaRH8g== --osd-uuid 1d6069b9-9961-499c-8147-e5110b631d3d 2020-09-08T16:05:12.285 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:12.279+0000 7f9ebb1d9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:12.285 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:12.280+0000 7f9ebb1d9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:12.285 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:12.282+0000 7f9ebb1d9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:12.286 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:12.282+0000 7f9ebb1d9ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T16:05:12.286 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:12.282+0000 7f9ebb1d9ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T16:05:12.286 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:12.282+0000 7f9ebb1d9ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T16:05:12.328 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:12.333+0000 7f9ebb1d9ec0 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2020-09-08T16:05:16.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2020-09-08T16:05:16.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:05:16.263 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T16:05:16.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T16:05:16.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:05:16.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T16:05:16.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:05:16.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:05:16.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:05:16.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:05:16.804 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T16:05:16.828 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:16.833+0000 7f3bf9f96ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:16.844 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:16.849+0000 7f3bf9f96ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:16.845 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:16.850+0000 7f3bf9f96ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:17.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T16:05:17.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:05:17.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T16:05:17.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:05:17.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:05:17.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:05:17.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:05:17.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:05:17.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:05:17.204 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:05:17.361 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:17.366+0000 7f3bf9f96ec0 -1 Falling back to public interface 2020-09-08T16:05:17.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:05:18.161 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:18.166+0000 7f3bf9f96ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T16:05:18.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:05:18.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:05:18.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:05:18.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:05:18.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:05:18.630 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:05:19.051 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/245662,v1:127.0.0.1:6811/245662] [v2:127.0.0.1:6812/245662,v1:127.0.0.1:6813/245662] exists,up 1d6069b9-9961-499c-8147-e5110b631d3d 2020-09-08T16:05:19.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:05:19.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:05:19.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:05:19.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:05:19.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:201: TEST_backfill_test_multi: run_osd td/osd-backfill-space 2 2020-09-08T16:05:19.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:05:19.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:05:19.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T16:05:19.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:05:19.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/2 2020-09-08T16:05:19.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:05:19.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:05:19.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:05:19.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:05:19.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2020-09-08T16:05:19.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2020-09-08T16:05:19.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:05:19.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:05:19.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:05:19.057 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:05:19.057 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:05:19.057 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:05:19.057 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:05:19.058 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:05:19.058 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:05:19.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:05:19.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:05:19.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:05:19.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:05:19.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:05:19.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:05:19.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:05:19.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:05:19.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:05:19.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:05:19.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:05:19.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:05:19.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/2 2020-09-08T16:05:19.061 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:05:19.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=c2723b6f-8510-478f-9d88-7d5d2bf3b0e7 2020-09-08T16:05:19.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 c2723b6f-8510-478f-9d88-7d5d2bf3b0e7' 2020-09-08T16:05:19.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:05:19.063 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 c2723b6f-8510-478f-9d88-7d5d2bf3b0e7 2020-09-08T16:05:19.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQC/q1dfXGpsBBAAZLJAb7hLWp+pEUPZn8m5ww== 2020-09-08T16:05:19.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQC/q1dfXGpsBBAAZLJAb7hLWp+pEUPZn8m5ww=="}' 2020-09-08T16:05:19.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new c2723b6f-8510-478f-9d88-7d5d2bf3b0e7 -i td/osd-backfill-space/2/new.json 2020-09-08T16:05:19.609 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:05:19.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/2/new.json 2020-09-08T16:05:19.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQC/q1dfXGpsBBAAZLJAb7hLWp+pEUPZn8m5ww== --osd-uuid c2723b6f-8510-478f-9d88-7d5d2bf3b0e7 2020-09-08T16:05:19.649 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:19.654+0000 7f8bb357fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:19.650 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:19.655+0000 7f8bb357fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:19.652 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:19.657+0000 7f8bb357fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:19.653 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:19.658+0000 7f8bb357fec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T16:05:19.653 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:19.658+0000 7f8bb357fec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T16:05:19.653 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:19.658+0000 7f8bb357fec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T16:05:19.702 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:19.707+0000 7f8bb357fec0 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2020-09-08T16:05:24.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2020-09-08T16:05:24.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:05:24.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T16:05:24.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:05:24.023 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T16:05:24.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T16:05:24.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:05:24.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:05:24.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:05:24.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:05:24.576 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T16:05:24.600 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:24.605+0000 7f4354596ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:24.601 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:24.606+0000 7f4354596ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:24.603 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:24.608+0000 7f4354596ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:24.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T16:05:24.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:05:24.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T16:05:24.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:05:24.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:05:24.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:05:24.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:05:24.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:05:24.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:05:24.981 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:05:25.118 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:25.123+0000 7f4354596ec0 -1 Falling back to public interface 2020-09-08T16:05:25.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:05:25.900 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:25.905+0000 7f4354596ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T16:05:26.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:05:26.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:05:26.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:05:26.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:05:26.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:05:26.390 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:05:26.868 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/246656,v1:127.0.0.1:6819/246656] [v2:127.0.0.1:6820/246656,v1:127.0.0.1:6821/246656] exists,up c2723b6f-8510-478f-9d88-7d5d2bf3b0e7 2020-09-08T16:05:26.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:05:26.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:05:26.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:05:26.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:05:26.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:201: TEST_backfill_test_multi: run_osd td/osd-backfill-space 3 2020-09-08T16:05:26.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:05:26.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:05:26.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T16:05:26.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:05:26.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/3 2020-09-08T16:05:26.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:05:26.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:05:26.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:05:26.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:05:26.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/3' 2020-09-08T16:05:26.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/3/journal' 2020-09-08T16:05:26.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:05:26.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:05:26.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:05:26.873 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:05:26.873 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:05:26.873 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:05:26.873 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:05:26.874 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:05:26.874 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:05:26.874 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:05:26.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:05:26.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:05:26.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:05:26.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:05:26.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:05:26.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:05:26.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:05:26.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:05:26.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:05:26.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:05:26.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:05:26.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/3 2020-09-08T16:05:26.876 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:05:26.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=79050bfb-dbf4-4a36-b711-fef58c4a969d 2020-09-08T16:05:26.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 79050bfb-dbf4-4a36-b711-fef58c4a969d' 2020-09-08T16:05:26.878 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:05:26.878 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 79050bfb-dbf4-4a36-b711-fef58c4a969d 2020-09-08T16:05:26.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDGq1dflyEpNRAAhg3YrZog1oZwf0bCIUvVOw== 2020-09-08T16:05:26.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDGq1dflyEpNRAAhg3YrZog1oZwf0bCIUvVOw=="}' 2020-09-08T16:05:26.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 79050bfb-dbf4-4a36-b711-fef58c4a969d -i td/osd-backfill-space/3/new.json 2020-09-08T16:05:27.392 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T16:05:27.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/3/new.json 2020-09-08T16:05:27.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDGq1dflyEpNRAAhg3YrZog1oZwf0bCIUvVOw== --osd-uuid 79050bfb-dbf4-4a36-b711-fef58c4a969d 2020-09-08T16:05:27.433 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:27.436+0000 7f1f200ccec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:27.433 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:27.438+0000 7f1f200ccec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:27.435 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:27.440+0000 7f1f200ccec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:27.436 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:27.441+0000 7f1f200ccec0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2020-09-08T16:05:27.436 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:27.441+0000 7f1f200ccec0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2020-09-08T16:05:27.437 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:27.441+0000 7f1f200ccec0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2020-09-08T16:05:27.482 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:27.488+0000 7f1f200ccec0 -1 bluestore(td/osd-backfill-space/3) _read_fsid unparsable uuid 2020-09-08T16:05:31.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/3/keyring 2020-09-08T16:05:31.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:05:31.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T16:05:31.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:05:31.684 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T16:05:32.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T16:05:32.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:05:32.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:05:32.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:05:32.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:05:32.233 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T16:05:32.258 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:32.263+0000 7fee23564ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:32.259 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:32.265+0000 7fee23564ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:32.261 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:32.266+0000 7fee23564ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:32.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T16:05:32.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:05:32.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T16:05:32.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:05:32.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:05:32.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:05:32.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:05:32.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:05:32.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:05:32.662 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:05:32.778 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:32.784+0000 7fee23564ec0 -1 Falling back to public interface 2020-09-08T16:05:33.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:05:33.575 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:33.579+0000 7fee23564ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T16:05:34.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:05:34.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:05:34.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:05:34.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:05:34.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:05:34.056 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:05:34.499 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/247650,v1:127.0.0.1:6827/247650] [v2:127.0.0.1:6828/247650,v1:127.0.0.1:6829/247650] exists,up 79050bfb-dbf4-4a36-b711-fef58c4a969d 2020-09-08T16:05:34.499 INFO:tasks.workunit.client.0.smithi065.stdout:add osd4 b582c749-07c0-4dd9-ad4e-03cd60fd59a2 2020-09-08T16:05:34.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:05:34.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:05:34.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:05:34.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:05:34.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:201: TEST_backfill_test_multi: run_osd td/osd-backfill-space 4 2020-09-08T16:05:34.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:05:34.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:05:34.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=4 2020-09-08T16:05:34.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:05:34.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/4 2020-09-08T16:05:34.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:05:34.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:05:34.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:05:34.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:05:34.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/4' 2020-09-08T16:05:34.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/4/journal' 2020-09-08T16:05:34.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:05:34.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:05:34.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:05:34.504 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:05:34.504 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:05:34.505 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:05:34.505 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:05:34.505 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:05:34.505 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:05:34.505 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:05:34.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:05:34.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:05:34.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:05:34.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:05:34.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:05:34.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:05:34.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:05:34.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:05:34.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:05:34.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:05:34.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:05:34.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/4 2020-09-08T16:05:34.509 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:05:34.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=b582c749-07c0-4dd9-ad4e-03cd60fd59a2 2020-09-08T16:05:34.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd4 b582c749-07c0-4dd9-ad4e-03cd60fd59a2' 2020-09-08T16:05:34.510 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:05:34.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDOq1dfQ6AXHxAA0R0/SDo0i+7yGKhLEH9GPg== 2020-09-08T16:05:34.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDOq1dfQ6AXHxAA0R0/SDo0i+7yGKhLEH9GPg=="}' 2020-09-08T16:05:34.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new b582c749-07c0-4dd9-ad4e-03cd60fd59a2 -i td/osd-backfill-space/4/new.json 2020-09-08T16:05:35.058 INFO:tasks.workunit.client.0.smithi065.stdout:4 2020-09-08T16:05:35.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/4/new.json 2020-09-08T16:05:35.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 4 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDOq1dfQ6AXHxAA0R0/SDo0i+7yGKhLEH9GPg== --osd-uuid b582c749-07c0-4dd9-ad4e-03cd60fd59a2 2020-09-08T16:05:35.097 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:35.102+0000 7f297175bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:35.099 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:35.104+0000 7f297175bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:35.100 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:35.105+0000 7f297175bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:35.101 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:35.106+0000 7f297175bec0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2020-09-08T16:05:35.101 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:35.106+0000 7f297175bec0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2020-09-08T16:05:35.101 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:35.106+0000 7f297175bec0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2020-09-08T16:05:35.190 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:35.195+0000 7f297175bec0 -1 bluestore(td/osd-backfill-space/4) _read_fsid unparsable uuid 2020-09-08T16:05:39.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/4/keyring 2020-09-08T16:05:39.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:05:39.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd4 key to auth repository 2020-09-08T16:05:39.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:05:39.555 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd4 key to auth repository 2020-09-08T16:05:40.098 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.4 2020-09-08T16:05:40.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.4 2020-09-08T16:05:40.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 4 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:05:40.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:05:40.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:05:40.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:05:40.124 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:40.129+0000 7f4912847ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:40.149 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:40.154+0000 7f4912847ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:40.150 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:40.156+0000 7f4912847ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:40.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 4 2020-09-08T16:05:40.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:05:40.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=4 2020-09-08T16:05:40.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:05:40.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:05:40.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:05:40.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:05:40.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:05:40.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:05:40.506 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:05:40.669 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:40.674+0000 7f4912847ec0 -1 Falling back to public interface 2020-09-08T16:05:40.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:05:41.440 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:41.446+0000 7f4912847ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-09-08T16:05:41.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:05:41.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:05:41.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:05:41.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:05:41.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:05:41.900 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:05:42.310 INFO:tasks.workunit.client.0.smithi065.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/248644,v1:127.0.0.1:6835/248644] [v2:127.0.0.1:6836/248644,v1:127.0.0.1:6837/248644] exists,up b582c749-07c0-4dd9-ad4e-03cd60fd59a2 2020-09-08T16:05:42.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:05:42.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:05:42.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:05:42.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:05:42.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:201: TEST_backfill_test_multi: run_osd td/osd-backfill-space 5 2020-09-08T16:05:42.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:05:42.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:05:42.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=5 2020-09-08T16:05:42.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:05:42.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/5 2020-09-08T16:05:42.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:05:42.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:05:42.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:05:42.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:05:42.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/5' 2020-09-08T16:05:42.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/5/journal' 2020-09-08T16:05:42.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:05:42.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:05:42.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:05:42.315 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:05:42.315 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:05:42.315 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:05:42.315 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:05:42.316 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:05:42.316 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:05:42.316 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:05:42.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:05:42.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:05:42.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:05:42.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:05:42.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:05:42.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:05:42.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:05:42.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:05:42.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:05:42.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:05:42.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:05:42.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/5 2020-09-08T16:05:42.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:05:42.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=19621543-b881-4ff4-b94a-b99b8deebf21 2020-09-08T16:05:42.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd5 19621543-b881-4ff4-b94a-b99b8deebf21' 2020-09-08T16:05:42.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:05:42.320 INFO:tasks.workunit.client.0.smithi065.stdout:add osd5 19621543-b881-4ff4-b94a-b99b8deebf21 2020-09-08T16:05:42.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDWq1dfMwvzExAAFsCD36l7fhyixFgETc6C3w== 2020-09-08T16:05:42.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDWq1dfMwvzExAAFsCD36l7fhyixFgETc6C3w=="}' 2020-09-08T16:05:42.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 19621543-b881-4ff4-b94a-b99b8deebf21 -i td/osd-backfill-space/5/new.json 2020-09-08T16:05:42.858 INFO:tasks.workunit.client.0.smithi065.stdout:5 2020-09-08T16:05:42.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/5/new.json 2020-09-08T16:05:42.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 5 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDWq1dfMwvzExAAFsCD36l7fhyixFgETc6C3w== --osd-uuid 19621543-b881-4ff4-b94a-b99b8deebf21 2020-09-08T16:05:42.897 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:42.902+0000 7f3bc9e48ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:42.933 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:42.939+0000 7f3bc9e48ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:42.934 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:42.939+0000 7f3bc9e48ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:42.935 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:42.940+0000 7f3bc9e48ec0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2020-09-08T16:05:42.935 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:42.940+0000 7f3bc9e48ec0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2020-09-08T16:05:42.936 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:42.940+0000 7f3bc9e48ec0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2020-09-08T16:05:42.992 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:42.997+0000 7f3bc9e48ec0 -1 bluestore(td/osd-backfill-space/5) _read_fsid unparsable uuid 2020-09-08T16:05:47.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/5/keyring 2020-09-08T16:05:47.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:05:47.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd5 key to auth repository 2020-09-08T16:05:47.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:05:47.480 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd5 key to auth repository 2020-09-08T16:05:48.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.5 2020-09-08T16:05:48.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 5 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:05:48.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:05:48.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:05:48.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:05:48.022 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.5 2020-09-08T16:05:48.046 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:48.050+0000 7f8411122ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:48.057 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:48.061+0000 7f8411122ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:48.058 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:48.062+0000 7f8411122ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:48.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 5 2020-09-08T16:05:48.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:05:48.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=5 2020-09-08T16:05:48.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:05:48.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:05:48.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:05:48.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:05:48.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:05:48.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T16:05:48.427 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:05:48.574 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:48.577+0000 7f8411122ec0 -1 Falling back to public interface 2020-09-08T16:05:48.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:05:49.408 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:49.412+0000 7f8411122ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-09-08T16:05:49.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:05:49.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:05:49.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:05:49.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:05:49.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T16:05:49.820 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:05:50.259 INFO:tasks.workunit.client.0.smithi065.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/249648,v1:127.0.0.1:6843/249648] [v2:127.0.0.1:6844/249648,v1:127.0.0.1:6845/249648] exists,up 19621543-b881-4ff4-b94a-b99b8deebf21 2020-09-08T16:05:50.260 INFO:tasks.workunit.client.0.smithi065.stdout:add osd6 8ac9ef5c-d085-49ae-bf65-2f1733bf7b6a 2020-09-08T16:05:50.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:05:50.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:05:50.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:05:50.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:05:50.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:201: TEST_backfill_test_multi: run_osd td/osd-backfill-space 6 2020-09-08T16:05:50.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:05:50.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:05:50.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=6 2020-09-08T16:05:50.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:05:50.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/6 2020-09-08T16:05:50.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:05:50.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:05:50.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:05:50.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:05:50.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/6' 2020-09-08T16:05:50.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/6/journal' 2020-09-08T16:05:50.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:05:50.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:05:50.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:05:50.267 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:05:50.267 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:05:50.268 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:05:50.268 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:05:50.268 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:05:50.268 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:05:50.268 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:05:50.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:05:50.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:05:50.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:05:50.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:05:50.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:05:50.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:05:50.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:05:50.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:05:50.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:05:50.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:05:50.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:05:50.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/6 2020-09-08T16:05:50.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:05:50.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=8ac9ef5c-d085-49ae-bf65-2f1733bf7b6a 2020-09-08T16:05:50.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd6 8ac9ef5c-d085-49ae-bf65-2f1733bf7b6a' 2020-09-08T16:05:50.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:05:50.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDeq1dfQb/EEBAAKYV1aAiBU6RbWK7/M0y37A== 2020-09-08T16:05:50.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDeq1dfQb/EEBAAKYV1aAiBU6RbWK7/M0y37A=="}' 2020-09-08T16:05:50.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 8ac9ef5c-d085-49ae-bf65-2f1733bf7b6a -i td/osd-backfill-space/6/new.json 2020-09-08T16:05:50.882 INFO:tasks.workunit.client.0.smithi065.stdout:6 2020-09-08T16:05:50.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/6/new.json 2020-09-08T16:05:50.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 6 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/6 --osd-journal=td/osd-backfill-space/6/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDeq1dfQb/EEBAAKYV1aAiBU6RbWK7/M0y37A== --osd-uuid 8ac9ef5c-d085-49ae-bf65-2f1733bf7b6a 2020-09-08T16:05:50.921 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:50.926+0000 7f0b63fdcec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:50.922 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:50.927+0000 7f0b63fdcec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:50.924 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:50.929+0000 7f0b63fdcec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:50.925 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:50.930+0000 7f0b63fdcec0 -1 bluestore(td/osd-backfill-space/6/block) _read_bdev_label failed to open td/osd-backfill-space/6/block: (2) No such file or directory 2020-09-08T16:05:50.925 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:50.930+0000 7f0b63fdcec0 -1 bluestore(td/osd-backfill-space/6/block) _read_bdev_label failed to open td/osd-backfill-space/6/block: (2) No such file or directory 2020-09-08T16:05:50.925 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:50.930+0000 7f0b63fdcec0 -1 bluestore(td/osd-backfill-space/6/block) _read_bdev_label failed to open td/osd-backfill-space/6/block: (2) No such file or directory 2020-09-08T16:05:50.974 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:50.971+0000 7f0b63fdcec0 -1 bluestore(td/osd-backfill-space/6) _read_fsid unparsable uuid 2020-09-08T16:05:55.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/6/keyring 2020-09-08T16:05:55.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:05:55.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd6 key to auth repository 2020-09-08T16:05:55.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:05:55.493 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd6 key to auth repository 2020-09-08T16:05:56.026 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.6 2020-09-08T16:05:56.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.6 2020-09-08T16:05:56.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 6 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/6 --osd-journal=td/osd-backfill-space/6/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:05:56.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:05:56.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:05:56.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:05:56.052 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:56.057+0000 7f4179f01ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:56.065 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:56.071+0000 7f4179f01ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:56.066 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:56.071+0000 7f4179f01ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:56.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 6 2020-09-08T16:05:56.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:05:56.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=6 2020-09-08T16:05:56.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:05:56.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:05:56.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:05:56.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:05:56.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:05:56.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.6 up' 2020-09-08T16:05:56.430 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:05:56.583 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:56.588+0000 7f4179f01ec0 -1 Falling back to public interface 2020-09-08T16:05:56.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:05:57.375 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:57.380+0000 7f4179f01ec0 -1 osd.6 0 log_to_monitors {default=true} 2020-09-08T16:05:57.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:05:57.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:05:57.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:05:57.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:05:57.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.6 up' 2020-09-08T16:05:57.835 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:05:58.260 INFO:tasks.workunit.client.0.smithi065.stdout:osd.6 up in weight 1 up_from 35 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/250642,v1:127.0.0.1:6851/250642] [v2:127.0.0.1:6852/250642,v1:127.0.0.1:6853/250642] exists,up 8ac9ef5c-d085-49ae-bf65-2f1733bf7b6a 2020-09-08T16:05:58.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:05:58.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:05:58.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:05:58.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:05:58.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:201: TEST_backfill_test_multi: run_osd td/osd-backfill-space 7 2020-09-08T16:05:58.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:05:58.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:05:58.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=7 2020-09-08T16:05:58.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:05:58.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/7 2020-09-08T16:05:58.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:05:58.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:05:58.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:05:58.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:05:58.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/7' 2020-09-08T16:05:58.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/7/journal' 2020-09-08T16:05:58.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:05:58.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:05:58.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:05:58.264 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:05:58.265 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:05:58.265 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:05:58.265 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:05:58.265 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:05:58.265 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:05:58.266 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:05:58.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:05:58.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:05:58.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:05:58.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:05:58.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:05:58.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:05:58.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:05:58.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:05:58.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:05:58.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:05:58.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:05:58.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/7 2020-09-08T16:05:58.268 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:05:58.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=3095dfca-ad6d-4bce-a7e2-81bc77e89338 2020-09-08T16:05:58.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd7 3095dfca-ad6d-4bce-a7e2-81bc77e89338' 2020-09-08T16:05:58.269 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:05:58.270 INFO:tasks.workunit.client.0.smithi065.stdout:add osd7 3095dfca-ad6d-4bce-a7e2-81bc77e89338 2020-09-08T16:05:58.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDmq1dfftzqEBAAxZkQ45hW7SX1Qj2YrN2Qjg== 2020-09-08T16:05:58.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDmq1dfftzqEBAAxZkQ45hW7SX1Qj2YrN2Qjg=="}' 2020-09-08T16:05:58.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 3095dfca-ad6d-4bce-a7e2-81bc77e89338 -i td/osd-backfill-space/7/new.json 2020-09-08T16:05:58.899 INFO:tasks.workunit.client.0.smithi065.stdout:7 2020-09-08T16:05:58.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/7/new.json 2020-09-08T16:05:58.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 7 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/7 --osd-journal=td/osd-backfill-space/7/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDmq1dfftzqEBAAxZkQ45hW7SX1Qj2YrN2Qjg== --osd-uuid 3095dfca-ad6d-4bce-a7e2-81bc77e89338 2020-09-08T16:05:58.943 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:58.943+0000 7f23fef02ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:58.944 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:58.945+0000 7f23fef02ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:58.945 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:58.946+0000 7f23fef02ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:05:58.945 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:58.947+0000 7f23fef02ec0 -1 bluestore(td/osd-backfill-space/7/block) _read_bdev_label failed to open td/osd-backfill-space/7/block: (2) No such file or directory 2020-09-08T16:05:58.945 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:58.947+0000 7f23fef02ec0 -1 bluestore(td/osd-backfill-space/7/block) _read_bdev_label failed to open td/osd-backfill-space/7/block: (2) No such file or directory 2020-09-08T16:05:58.945 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:58.947+0000 7f23fef02ec0 -1 bluestore(td/osd-backfill-space/7/block) _read_bdev_label failed to open td/osd-backfill-space/7/block: (2) No such file or directory 2020-09-08T16:05:58.995 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:05:59.000+0000 7f23fef02ec0 -1 bluestore(td/osd-backfill-space/7) _read_fsid unparsable uuid 2020-09-08T16:06:03.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/7/keyring 2020-09-08T16:06:03.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:06:03.471 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd7 key to auth repository 2020-09-08T16:06:03.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd7 key to auth repository 2020-09-08T16:06:03.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/7/keyring auth add osd.7 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:06:04.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.7 2020-09-08T16:06:04.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:06:04.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:06:04.010 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.7 2020-09-08T16:06:04.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:06:04.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 7 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/7 --osd-journal=td/osd-backfill-space/7/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:06:04.038 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:04.041+0000 7f10398a0ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:04.052 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:04.055+0000 7f10398a0ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:04.053 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:04.056+0000 7f10398a0ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:04.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 7 2020-09-08T16:06:04.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:06:04.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=7 2020-09-08T16:06:04.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:06:04.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:06:04.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:06:04.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:06:04.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:06:04.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.7 up' 2020-09-08T16:06:04.410 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:06:04.567 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:04.573+0000 7f10398a0ec0 -1 Falling back to public interface 2020-09-08T16:06:04.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:06:05.360 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:05.365+0000 7f10398a0ec0 -1 osd.7 0 log_to_monitors {default=true} 2020-09-08T16:06:05.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:06:05.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:06:05.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:06:05.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:06:05.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.7 up' 2020-09-08T16:06:05.811 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:06:06.217 INFO:tasks.workunit.client.0.smithi065.stdout:osd.7 up in weight 1 up_from 40 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6858/251637,v1:127.0.0.1:6859/251637] [v2:127.0.0.1:6860/251637,v1:127.0.0.1:6861/251637] exists,up 3095dfca-ad6d-4bce-a7e2-81bc77e89338 2020-09-08T16:06:06.218 INFO:tasks.workunit.client.0.smithi065.stdout:add osd8 45abed65-fcfc-4430-a414-8e5403a9547a 2020-09-08T16:06:06.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:06:06.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:06:06.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:06:06.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:06:06.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:201: TEST_backfill_test_multi: run_osd td/osd-backfill-space 8 2020-09-08T16:06:06.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:06:06.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:06:06.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=8 2020-09-08T16:06:06.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:06:06.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/8 2020-09-08T16:06:06.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:06:06.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:06:06.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:06:06.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:06:06.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/8' 2020-09-08T16:06:06.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/8/journal' 2020-09-08T16:06:06.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:06:06.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:06:06.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:06:06.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:06:06.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:06:06.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:06:06.222 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:06:06.222 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:06:06.223 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:06:06.229 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:06:06.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:06:06.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:06:06.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:06:06.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:06:06.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:06:06.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:06:06.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:06:06.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:06:06.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:06:06.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:06:06.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:06:06.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/8 2020-09-08T16:06:06.235 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:06:06.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=45abed65-fcfc-4430-a414-8e5403a9547a 2020-09-08T16:06:06.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd8 45abed65-fcfc-4430-a414-8e5403a9547a' 2020-09-08T16:06:06.236 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:06:06.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDuq1dfuqEyDhAAjliEsDqV7B/v2RABt65keA== 2020-09-08T16:06:06.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDuq1dfuqEyDhAAjliEsDqV7B/v2RABt65keA=="}' 2020-09-08T16:06:06.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 45abed65-fcfc-4430-a414-8e5403a9547a -i td/osd-backfill-space/8/new.json 2020-09-08T16:06:06.904 INFO:tasks.workunit.client.0.smithi065.stdout:8 2020-09-08T16:06:06.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/8/new.json 2020-09-08T16:06:06.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 8 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/8 --osd-journal=td/osd-backfill-space/8/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDuq1dfuqEyDhAAjliEsDqV7B/v2RABt65keA== --osd-uuid 45abed65-fcfc-4430-a414-8e5403a9547a 2020-09-08T16:06:06.944 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:06.949+0000 7fba52d3fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:06.946 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:06.951+0000 7fba52d3fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:06.947 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:06.953+0000 7fba52d3fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:06.948 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:06.953+0000 7fba52d3fec0 -1 bluestore(td/osd-backfill-space/8/block) _read_bdev_label failed to open td/osd-backfill-space/8/block: (2) No such file or directory 2020-09-08T16:06:06.949 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:06.953+0000 7fba52d3fec0 -1 bluestore(td/osd-backfill-space/8/block) _read_bdev_label failed to open td/osd-backfill-space/8/block: (2) No such file or directory 2020-09-08T16:06:06.949 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:06.953+0000 7fba52d3fec0 -1 bluestore(td/osd-backfill-space/8/block) _read_bdev_label failed to open td/osd-backfill-space/8/block: (2) No such file or directory 2020-09-08T16:06:06.985 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:06.990+0000 7fba52d3fec0 -1 bluestore(td/osd-backfill-space/8) _read_fsid unparsable uuid 2020-09-08T16:06:11.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/8/keyring 2020-09-08T16:06:11.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:06:11.472 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd8 key to auth repository 2020-09-08T16:06:11.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd8 key to auth repository 2020-09-08T16:06:11.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/8/keyring auth add osd.8 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:06:12.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.8 2020-09-08T16:06:12.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 8 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/8 --osd-journal=td/osd-backfill-space/8/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:06:12.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:06:12.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:06:12.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:06:12.013 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.8 2020-09-08T16:06:12.037 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:12.042+0000 7f26461faec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:12.048 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:12.050+0000 7f26461faec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:12.048 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:12.051+0000 7f26461faec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:12.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 8 2020-09-08T16:06:12.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:06:12.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=8 2020-09-08T16:06:12.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:06:12.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:06:12.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:06:12.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:06:12.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:06:12.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.8 up' 2020-09-08T16:06:12.410 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:06:12.562 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:12.567+0000 7f26461faec0 -1 Falling back to public interface 2020-09-08T16:06:12.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:06:13.346 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:13.351+0000 7f26461faec0 -1 osd.8 0 log_to_monitors {default=true} 2020-09-08T16:06:13.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:06:13.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:06:13.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:06:13.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:06:13.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.8 up' 2020-09-08T16:06:13.805 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:06:14.266 INFO:tasks.workunit.client.0.smithi065.stdout:osd.8 up in weight 1 up_from 45 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6866/252633,v1:127.0.0.1:6867/252633] [v2:127.0.0.1:6868/252633,v1:127.0.0.1:6869/252633] exists,up 45abed65-fcfc-4430-a414-8e5403a9547a 2020-09-08T16:06:14.267 INFO:tasks.workunit.client.0.smithi065.stdout:add osd9 e41fde5b-41c4-4f99-8264-e31124644f99 2020-09-08T16:06:14.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:06:14.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:06:14.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:06:14.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:06:14.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:201: TEST_backfill_test_multi: run_osd td/osd-backfill-space 9 2020-09-08T16:06:14.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:06:14.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:06:14.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=9 2020-09-08T16:06:14.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:06:14.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/9 2020-09-08T16:06:14.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:06:14.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:06:14.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:06:14.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:06:14.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/9' 2020-09-08T16:06:14.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/9/journal' 2020-09-08T16:06:14.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:06:14.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:06:14.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:06:14.271 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:06:14.271 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:06:14.271 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:06:14.271 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:06:14.272 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:06:14.272 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:06:14.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:06:14.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:06:14.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:06:14.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:06:14.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:06:14.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:06:14.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:06:14.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:06:14.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:06:14.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:06:14.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:06:14.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:06:14.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/9 2020-09-08T16:06:14.276 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:06:14.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=e41fde5b-41c4-4f99-8264-e31124644f99 2020-09-08T16:06:14.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd9 e41fde5b-41c4-4f99-8264-e31124644f99' 2020-09-08T16:06:14.277 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:06:14.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQD2q1dfm/Q/ERAA3rdjFyhIV11zwNewQTx5iQ== 2020-09-08T16:06:14.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQD2q1dfm/Q/ERAA3rdjFyhIV11zwNewQTx5iQ=="}' 2020-09-08T16:06:14.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new e41fde5b-41c4-4f99-8264-e31124644f99 -i td/osd-backfill-space/9/new.json 2020-09-08T16:06:14.787 INFO:tasks.workunit.client.0.smithi065.stdout:9 2020-09-08T16:06:14.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/9/new.json 2020-09-08T16:06:14.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 9 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/9 --osd-journal=td/osd-backfill-space/9/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQD2q1dfm/Q/ERAA3rdjFyhIV11zwNewQTx5iQ== --osd-uuid e41fde5b-41c4-4f99-8264-e31124644f99 2020-09-08T16:06:14.826 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:14.831+0000 7fdcffc98ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:14.827 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:14.833+0000 7fdcffc98ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:14.828 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:14.833+0000 7fdcffc98ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:14.829 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:14.834+0000 7fdcffc98ec0 -1 bluestore(td/osd-backfill-space/9/block) _read_bdev_label failed to open td/osd-backfill-space/9/block: (2) No such file or directory 2020-09-08T16:06:14.829 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:14.834+0000 7fdcffc98ec0 -1 bluestore(td/osd-backfill-space/9/block) _read_bdev_label failed to open td/osd-backfill-space/9/block: (2) No such file or directory 2020-09-08T16:06:14.829 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:14.834+0000 7fdcffc98ec0 -1 bluestore(td/osd-backfill-space/9/block) _read_bdev_label failed to open td/osd-backfill-space/9/block: (2) No such file or directory 2020-09-08T16:06:14.880 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:14.885+0000 7fdcffc98ec0 -1 bluestore(td/osd-backfill-space/9) _read_fsid unparsable uuid 2020-09-08T16:06:19.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/9/keyring 2020-09-08T16:06:19.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:06:19.549 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd9 key to auth repository 2020-09-08T16:06:19.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd9 key to auth repository 2020-09-08T16:06:19.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/9/keyring auth add osd.9 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:06:20.080 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.9 2020-09-08T16:06:20.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.9 2020-09-08T16:06:20.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 9 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/9 --osd-journal=td/osd-backfill-space/9/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:06:20.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:06:20.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:06:20.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:06:20.106 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:20.111+0000 7f6e28eebec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:20.122 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:20.128+0000 7f6e28eebec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:20.123 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:20.128+0000 7f6e28eebec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:20.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 9 2020-09-08T16:06:20.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:06:20.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=9 2020-09-08T16:06:20.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:06:20.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:06:20.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:06:20.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:06:20.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:06:20.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.9 up' 2020-09-08T16:06:20.517 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:06:20.642 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:20.647+0000 7f6e28eebec0 -1 Falling back to public interface 2020-09-08T16:06:20.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:06:21.432 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:21.437+0000 7f6e28eebec0 -1 osd.9 0 log_to_monitors {default=true} 2020-09-08T16:06:21.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:06:21.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:06:21.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:06:21.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:06:21.908 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:06:21.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.9 up' 2020-09-08T16:06:22.318 INFO:tasks.workunit.client.0.smithi065.stdout:osd.9 up in weight 1 up_from 50 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6874/253628,v1:127.0.0.1:6875/253628] [v2:127.0.0.1:6876/253628,v1:127.0.0.1:6877/253628] exists,up e41fde5b-41c4-4f99-8264-e31124644f99 2020-09-08T16:06:22.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:06:22.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:06:22.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:06:22.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:06:22.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:201: TEST_backfill_test_multi: run_osd td/osd-backfill-space 10 2020-09-08T16:06:22.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:06:22.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:06:22.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=10 2020-09-08T16:06:22.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:06:22.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/10 2020-09-08T16:06:22.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:06:22.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:06:22.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:06:22.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:06:22.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/10' 2020-09-08T16:06:22.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/10/journal' 2020-09-08T16:06:22.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:06:22.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:06:22.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:06:22.327 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:06:22.327 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:06:22.328 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:06:22.328 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:06:22.328 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:06:22.328 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:06:22.328 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:06:22.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:06:22.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:06:22.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:06:22.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:06:22.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:06:22.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:06:22.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:06:22.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:06:22.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:06:22.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:06:22.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:06:22.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/10 2020-09-08T16:06:22.331 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:06:22.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=b4470bc8-5ad7-40e2-8dd2-4ae698af9cf1 2020-09-08T16:06:22.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd10 b4470bc8-5ad7-40e2-8dd2-4ae698af9cf1' 2020-09-08T16:06:22.332 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:06:22.333 INFO:tasks.workunit.client.0.smithi065.stdout:add osd10 b4470bc8-5ad7-40e2-8dd2-4ae698af9cf1 2020-09-08T16:06:22.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQD+q1dfKx5uFBAAlxSkJFSZdb5ciHBHbVE1Yg== 2020-09-08T16:06:22.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQD+q1dfKx5uFBAAlxSkJFSZdb5ciHBHbVE1Yg=="}' 2020-09-08T16:06:22.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new b4470bc8-5ad7-40e2-8dd2-4ae698af9cf1 -i td/osd-backfill-space/10/new.json 2020-09-08T16:06:22.967 INFO:tasks.workunit.client.0.smithi065.stdout:10 2020-09-08T16:06:22.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/10/new.json 2020-09-08T16:06:22.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 10 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/10 --osd-journal=td/osd-backfill-space/10/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQD+q1dfKx5uFBAAlxSkJFSZdb5ciHBHbVE1Yg== --osd-uuid b4470bc8-5ad7-40e2-8dd2-4ae698af9cf1 2020-09-08T16:06:23.013 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:23.010+0000 7f1516a30ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:23.015 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:23.011+0000 7f1516a30ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:23.015 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:23.013+0000 7f1516a30ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:23.015 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:23.013+0000 7f1516a30ec0 -1 bluestore(td/osd-backfill-space/10/block) _read_bdev_label failed to open td/osd-backfill-space/10/block: (2) No such file or directory 2020-09-08T16:06:23.015 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:23.013+0000 7f1516a30ec0 -1 bluestore(td/osd-backfill-space/10/block) _read_bdev_label failed to open td/osd-backfill-space/10/block: (2) No such file or directory 2020-09-08T16:06:23.016 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:23.013+0000 7f1516a30ec0 -1 bluestore(td/osd-backfill-space/10/block) _read_bdev_label failed to open td/osd-backfill-space/10/block: (2) No such file or directory 2020-09-08T16:06:23.094 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:23.099+0000 7f1516a30ec0 -1 bluestore(td/osd-backfill-space/10) _read_fsid unparsable uuid 2020-09-08T16:06:27.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/10/keyring 2020-09-08T16:06:27.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:06:27.899 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd10 key to auth repository 2020-09-08T16:06:27.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd10 key to auth repository 2020-09-08T16:06:27.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/10/keyring auth add osd.10 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:06:28.434 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.10 2020-09-08T16:06:28.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.10 2020-09-08T16:06:28.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:06:28.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 10 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/10 --osd-journal=td/osd-backfill-space/10/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:06:28.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:06:28.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:06:28.460 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:28.465+0000 7f27e929dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:28.461 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:28.467+0000 7f27e929dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:28.462 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:28.467+0000 7f27e929dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:28.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 10 2020-09-08T16:06:28.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:06:28.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=10 2020-09-08T16:06:28.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:06:28.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:06:28.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:06:28.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:06:28.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:06:28.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.10 up' 2020-09-08T16:06:28.836 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:06:28.983 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:28.986+0000 7f27e929dec0 -1 Falling back to public interface 2020-09-08T16:06:29.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:06:29.798 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:29.803+0000 7f27e929dec0 -1 osd.10 0 log_to_monitors {default=true} 2020-09-08T16:06:30.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:06:30.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:06:30.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:06:30.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:06:30.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.10 up' 2020-09-08T16:06:30.233 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:06:30.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:06:31.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:06:31.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:06:31.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T16:06:31.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.10 up' 2020-09-08T16:06:31.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:06:31.664 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:06:32.088 INFO:tasks.workunit.client.0.smithi065.stdout:osd.10 up in weight 1 up_from 55 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6882/254622,v1:127.0.0.1:6883/254622] [v2:127.0.0.1:6884/254622,v1:127.0.0.1:6885/254622] exists,up b4470bc8-5ad7-40e2-8dd2-4ae698af9cf1 2020-09-08T16:06:32.088 INFO:tasks.workunit.client.0.smithi065.stdout:add osd11 b8ebc167-2d95-4a3d-8890-d8c839adccf2 2020-09-08T16:06:32.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:06:32.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:06:32.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:06:32.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:06:32.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:201: TEST_backfill_test_multi: run_osd td/osd-backfill-space 11 2020-09-08T16:06:32.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:06:32.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:06:32.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=11 2020-09-08T16:06:32.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:06:32.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/11 2020-09-08T16:06:32.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:06:32.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:06:32.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:06:32.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:06:32.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/11' 2020-09-08T16:06:32.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/11/journal' 2020-09-08T16:06:32.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:06:32.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:06:32.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:06:32.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:06:32.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:06:32.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:06:32.093 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:06:32.093 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:06:32.093 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:06:32.094 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:06:32.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:06:32.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:06:32.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:06:32.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:06:32.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:06:32.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:06:32.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:06:32.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:06:32.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:06:32.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:06:32.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:06:32.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/11 2020-09-08T16:06:32.097 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:06:32.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=b8ebc167-2d95-4a3d-8890-d8c839adccf2 2020-09-08T16:06:32.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd11 b8ebc167-2d95-4a3d-8890-d8c839adccf2' 2020-09-08T16:06:32.098 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:06:32.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAIrFdfFYrlBRAAK3hOC/hXIQ8/rH7xHlCp+Q== 2020-09-08T16:06:32.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAIrFdfFYrlBRAAK3hOC/hXIQ8/rH7xHlCp+Q=="}' 2020-09-08T16:06:32.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new b8ebc167-2d95-4a3d-8890-d8c839adccf2 -i td/osd-backfill-space/11/new.json 2020-09-08T16:06:32.787 INFO:tasks.workunit.client.0.smithi065.stdout:11 2020-09-08T16:06:32.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/11/new.json 2020-09-08T16:06:32.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 11 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/11 --osd-journal=td/osd-backfill-space/11/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAIrFdfFYrlBRAAK3hOC/hXIQ8/rH7xHlCp+Q== --osd-uuid b8ebc167-2d95-4a3d-8890-d8c839adccf2 2020-09-08T16:06:32.826 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:32.830+0000 7fbfd4c08ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:32.827 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:32.831+0000 7fbfd4c08ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:32.829 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:32.833+0000 7fbfd4c08ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:32.829 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:32.834+0000 7fbfd4c08ec0 -1 bluestore(td/osd-backfill-space/11/block) _read_bdev_label failed to open td/osd-backfill-space/11/block: (2) No such file or directory 2020-09-08T16:06:32.830 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:32.834+0000 7fbfd4c08ec0 -1 bluestore(td/osd-backfill-space/11/block) _read_bdev_label failed to open td/osd-backfill-space/11/block: (2) No such file or directory 2020-09-08T16:06:32.830 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:32.834+0000 7fbfd4c08ec0 -1 bluestore(td/osd-backfill-space/11/block) _read_bdev_label failed to open td/osd-backfill-space/11/block: (2) No such file or directory 2020-09-08T16:06:32.889 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:32.893+0000 7fbfd4c08ec0 -1 bluestore(td/osd-backfill-space/11) _read_fsid unparsable uuid 2020-09-08T16:06:37.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/11/keyring 2020-09-08T16:06:37.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:06:37.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd11 key to auth repository 2020-09-08T16:06:37.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/11/keyring auth add osd.11 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:06:37.203 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd11 key to auth repository 2020-09-08T16:06:37.742 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.11 2020-09-08T16:06:37.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.11 2020-09-08T16:06:37.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:06:37.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 11 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/11 --osd-journal=td/osd-backfill-space/11/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:06:37.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:06:37.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:06:37.766 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:37.770+0000 7f973dfe2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:37.788 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:37.792+0000 7f973dfe2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:37.790 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:37.794+0000 7f973dfe2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:38.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 11 2020-09-08T16:06:38.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:06:38.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=11 2020-09-08T16:06:38.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:06:38.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:06:38.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:06:38.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:06:38.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:06:38.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.11 up' 2020-09-08T16:06:38.136 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:06:38.310 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:38.314+0000 7f973dfe2ec0 -1 Falling back to public interface 2020-09-08T16:06:38.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:06:39.114 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:39.119+0000 7f973dfe2ec0 -1 osd.11 0 log_to_monitors {default=true} 2020-09-08T16:06:39.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:06:39.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:06:39.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:06:39.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:06:39.576 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:06:39.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.11 up' 2020-09-08T16:06:39.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:06:40.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:06:40.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:06:40.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T16:06:40.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:06:40.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.11 up' 2020-09-08T16:06:40.987 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:06:41.425 INFO:tasks.workunit.client.0.smithi065.stdout:osd.11 up in weight 1 up_from 60 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6890/255642,v1:127.0.0.1:6891/255642] [v2:127.0.0.1:6892/255642,v1:127.0.0.1:6893/255642] exists,up b8ebc167-2d95-4a3d-8890-d8c839adccf2 2020-09-08T16:06:41.426 INFO:tasks.workunit.client.0.smithi065.stdout:add osd12 4c1a7a68-b7f1-4009-bfda-98f82d356d7d 2020-09-08T16:06:41.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:06:41.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:06:41.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:06:41.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:06:41.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:201: TEST_backfill_test_multi: run_osd td/osd-backfill-space 12 2020-09-08T16:06:41.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:06:41.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:06:41.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=12 2020-09-08T16:06:41.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:06:41.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/12 2020-09-08T16:06:41.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:06:41.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:06:41.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:06:41.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:06:41.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/12' 2020-09-08T16:06:41.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/12/journal' 2020-09-08T16:06:41.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:06:41.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:06:41.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:06:41.430 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:06:41.430 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:06:41.430 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:06:41.430 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:06:41.431 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:06:41.431 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:06:41.431 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:06:41.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:06:41.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:06:41.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:06:41.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:06:41.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:06:41.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:06:41.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:06:41.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:06:41.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:06:41.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:06:41.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:06:41.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/12 2020-09-08T16:06:41.434 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:06:41.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=4c1a7a68-b7f1-4009-bfda-98f82d356d7d 2020-09-08T16:06:41.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd12 4c1a7a68-b7f1-4009-bfda-98f82d356d7d' 2020-09-08T16:06:41.434 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:06:41.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQARrFdfyoXBGhAAXDzbNrR3/Zu85MkAKl83Mw== 2020-09-08T16:06:41.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQARrFdfyoXBGhAAXDzbNrR3/Zu85MkAKl83Mw=="}' 2020-09-08T16:06:41.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 4c1a7a68-b7f1-4009-bfda-98f82d356d7d -i td/osd-backfill-space/12/new.json 2020-09-08T16:06:41.962 INFO:tasks.workunit.client.0.smithi065.stdout:12 2020-09-08T16:06:41.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/12/new.json 2020-09-08T16:06:41.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 12 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/12 --osd-journal=td/osd-backfill-space/12/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQARrFdfyoXBGhAAXDzbNrR3/Zu85MkAKl83Mw== --osd-uuid 4c1a7a68-b7f1-4009-bfda-98f82d356d7d 2020-09-08T16:06:42.001 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:42.006+0000 7faad60a5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:42.003 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:42.008+0000 7faad60a5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:42.005 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:42.010+0000 7faad60a5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:42.005 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:42.010+0000 7faad60a5ec0 -1 bluestore(td/osd-backfill-space/12/block) _read_bdev_label failed to open td/osd-backfill-space/12/block: (2) No such file or directory 2020-09-08T16:06:42.006 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:42.010+0000 7faad60a5ec0 -1 bluestore(td/osd-backfill-space/12/block) _read_bdev_label failed to open td/osd-backfill-space/12/block: (2) No such file or directory 2020-09-08T16:06:42.006 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:42.010+0000 7faad60a5ec0 -1 bluestore(td/osd-backfill-space/12/block) _read_bdev_label failed to open td/osd-backfill-space/12/block: (2) No such file or directory 2020-09-08T16:06:42.139 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:42.144+0000 7faad60a5ec0 -1 bluestore(td/osd-backfill-space/12) _read_fsid unparsable uuid 2020-09-08T16:06:46.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/12/keyring 2020-09-08T16:06:46.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:06:46.354 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd12 key to auth repository 2020-09-08T16:06:46.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd12 key to auth repository 2020-09-08T16:06:46.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/12/keyring auth add osd.12 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:06:46.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.12 2020-09-08T16:06:46.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 12 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/12 --osd-journal=td/osd-backfill-space/12/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:06:46.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:06:46.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:06:46.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:06:46.903 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.12 2020-09-08T16:06:46.927 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:46.932+0000 7f8e2987eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:46.935 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:46.940+0000 7f8e2987eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:46.937 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:46.942+0000 7f8e2987eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:47.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 12 2020-09-08T16:06:47.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:06:47.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=12 2020-09-08T16:06:47.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:06:47.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:06:47.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:06:47.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:06:47.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:06:47.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.12 up' 2020-09-08T16:06:47.309 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:06:47.459 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:47.464+0000 7f8e2987eec0 -1 Falling back to public interface 2020-09-08T16:06:47.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:06:48.295 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:48.299+0000 7f8e2987eec0 -1 osd.12 0 log_to_monitors {default=true} 2020-09-08T16:06:48.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:06:48.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:06:48.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:06:48.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:06:48.719 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:06:48.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.12 up' 2020-09-08T16:06:49.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:06:50.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:06:50.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:06:50.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T16:06:50.141 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:06:50.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:06:50.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.12 up' 2020-09-08T16:06:50.550 INFO:tasks.workunit.client.0.smithi065.stdout:osd.12 up in weight 1 up_from 65 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6898/256671,v1:127.0.0.1:6899/256671] [v2:127.0.0.1:6900/256671,v1:127.0.0.1:6901/256671] exists,up 4c1a7a68-b7f1-4009-bfda-98f82d356d7d 2020-09-08T16:06:50.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:06:50.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:06:50.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:06:50.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:06:50.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:201: TEST_backfill_test_multi: run_osd td/osd-backfill-space 13 2020-09-08T16:06:50.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:06:50.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:06:50.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=13 2020-09-08T16:06:50.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:06:50.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/13 2020-09-08T16:06:50.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:06:50.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:06:50.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:06:50.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:06:50.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/13' 2020-09-08T16:06:50.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/13/journal' 2020-09-08T16:06:50.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:06:50.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:06:50.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:06:50.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:06:50.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:06:50.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:06:50.555 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:06:50.555 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:06:50.555 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:06:50.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:06:50.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:06:50.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:06:50.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:06:50.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:06:50.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:06:50.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:06:50.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:06:50.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:06:50.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:06:50.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:06:50.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:06:50.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/13 2020-09-08T16:06:50.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:06:50.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=627ab968-897d-475b-994c-3f27b67e25b3 2020-09-08T16:06:50.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd13 627ab968-897d-475b-994c-3f27b67e25b3' 2020-09-08T16:06:50.560 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:06:50.560 INFO:tasks.workunit.client.0.smithi065.stdout:add osd13 627ab968-897d-475b-994c-3f27b67e25b3 2020-09-08T16:06:50.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAarFdf4A0qIhAAO/O6Sbsrq9a0D8/06kQIEg== 2020-09-08T16:06:50.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAarFdf4A0qIhAAO/O6Sbsrq9a0D8/06kQIEg=="}' 2020-09-08T16:06:50.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 627ab968-897d-475b-994c-3f27b67e25b3 -i td/osd-backfill-space/13/new.json 2020-09-08T16:06:51.135 INFO:tasks.workunit.client.0.smithi065.stdout:13 2020-09-08T16:06:51.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/13/new.json 2020-09-08T16:06:51.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 13 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/13 --osd-journal=td/osd-backfill-space/13/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAarFdf4A0qIhAAO/O6Sbsrq9a0D8/06kQIEg== --osd-uuid 627ab968-897d-475b-994c-3f27b67e25b3 2020-09-08T16:06:51.179 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:51.179+0000 7f711f688ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:51.180 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:51.181+0000 7f711f688ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:51.180 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:51.181+0000 7f711f688ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:51.180 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:51.182+0000 7f711f688ec0 -1 bluestore(td/osd-backfill-space/13/block) _read_bdev_label failed to open td/osd-backfill-space/13/block: (2) No such file or directory 2020-09-08T16:06:51.180 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:51.182+0000 7f711f688ec0 -1 bluestore(td/osd-backfill-space/13/block) _read_bdev_label failed to open td/osd-backfill-space/13/block: (2) No such file or directory 2020-09-08T16:06:51.180 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:51.182+0000 7f711f688ec0 -1 bluestore(td/osd-backfill-space/13/block) _read_bdev_label failed to open td/osd-backfill-space/13/block: (2) No such file or directory 2020-09-08T16:06:51.260 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:51.265+0000 7f711f688ec0 -1 bluestore(td/osd-backfill-space/13) _read_fsid unparsable uuid 2020-09-08T16:06:56.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/13/keyring 2020-09-08T16:06:56.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:06:56.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd13 key to auth repository 2020-09-08T16:06:56.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/13/keyring auth add osd.13 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:06:56.006 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd13 key to auth repository 2020-09-08T16:06:56.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.13 2020-09-08T16:06:56.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:06:56.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 13 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/13 --osd-journal=td/osd-backfill-space/13/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:06:56.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:06:56.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:06:56.548 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.13 2020-09-08T16:06:56.572 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:56.577+0000 7efc4dadfec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:56.584 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:56.589+0000 7efc4dadfec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:56.587 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:56.590+0000 7efc4dadfec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:56.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 13 2020-09-08T16:06:56.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:06:56.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=13 2020-09-08T16:06:56.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:06:56.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:06:56.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:06:56.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:06:56.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:06:56.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.13 up' 2020-09-08T16:06:56.945 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:06:57.101 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:57.106+0000 7efc4dadfec0 -1 Falling back to public interface 2020-09-08T16:06:57.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:06:57.886 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:57.891+0000 7efc4dadfec0 -1 osd.13 0 log_to_monitors {default=true} 2020-09-08T16:06:58.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:06:58.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:06:58.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:06:58.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:06:58.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.13 up' 2020-09-08T16:06:58.356 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:06:58.940 INFO:tasks.workunit.client.0.smithi065.stdout:osd.13 up in weight 1 up_from 70 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6906/257691,v1:127.0.0.1:6907/257691] [v2:127.0.0.1:6908/257691,v1:127.0.0.1:6909/257691] exists,up 627ab968-897d-475b-994c-3f27b67e25b3 2020-09-08T16:06:58.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:06:58.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:06:58.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:06:58.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:06:58.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:201: TEST_backfill_test_multi: run_osd td/osd-backfill-space 14 2020-09-08T16:06:58.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:06:58.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:06:58.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=14 2020-09-08T16:06:58.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:06:58.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/14 2020-09-08T16:06:58.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:06:58.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:06:58.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:06:58.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:06:58.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/14' 2020-09-08T16:06:58.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/14/journal' 2020-09-08T16:06:58.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:06:58.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:06:58.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:06:58.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:06:58.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:06:58.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:06:58.945 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:06:58.945 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:06:58.945 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:06:58.946 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:06:58.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:06:58.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:06:58.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:06:58.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:06:58.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:06:58.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:06:58.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:06:58.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:06:58.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:06:58.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:06:58.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:06:58.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/14 2020-09-08T16:06:58.948 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:06:58.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=0dbc789f-c0d2-42cd-a49a-6a2e2a024ec5 2020-09-08T16:06:58.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd14 0dbc789f-c0d2-42cd-a49a-6a2e2a024ec5' 2020-09-08T16:06:58.950 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:06:58.950 INFO:tasks.workunit.client.0.smithi065.stdout:add osd14 0dbc789f-c0d2-42cd-a49a-6a2e2a024ec5 2020-09-08T16:06:58.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAirFdfWN99ORAAp0udJ5ewYonX2ZtISQZCAA== 2020-09-08T16:06:58.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAirFdfWN99ORAAp0udJ5ewYonX2ZtISQZCAA=="}' 2020-09-08T16:06:58.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 0dbc789f-c0d2-42cd-a49a-6a2e2a024ec5 -i td/osd-backfill-space/14/new.json 2020-09-08T16:06:59.566 INFO:tasks.workunit.client.0.smithi065.stdout:14 2020-09-08T16:06:59.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/14/new.json 2020-09-08T16:06:59.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 14 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/14 --osd-journal=td/osd-backfill-space/14/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAirFdfWN99ORAAp0udJ5ewYonX2ZtISQZCAA== --osd-uuid 0dbc789f-c0d2-42cd-a49a-6a2e2a024ec5 2020-09-08T16:06:59.605 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:59.610+0000 7fcd59958ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:59.606 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:59.612+0000 7fcd59958ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:59.608 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:59.613+0000 7fcd59958ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:06:59.609 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:59.614+0000 7fcd59958ec0 -1 bluestore(td/osd-backfill-space/14/block) _read_bdev_label failed to open td/osd-backfill-space/14/block: (2) No such file or directory 2020-09-08T16:06:59.609 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:59.614+0000 7fcd59958ec0 -1 bluestore(td/osd-backfill-space/14/block) _read_bdev_label failed to open td/osd-backfill-space/14/block: (2) No such file or directory 2020-09-08T16:06:59.609 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:59.614+0000 7fcd59958ec0 -1 bluestore(td/osd-backfill-space/14/block) _read_bdev_label failed to open td/osd-backfill-space/14/block: (2) No such file or directory 2020-09-08T16:06:59.674 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:06:59.679+0000 7fcd59958ec0 -1 bluestore(td/osd-backfill-space/14) _read_fsid unparsable uuid 2020-09-08T16:07:04.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/14/keyring 2020-09-08T16:07:04.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:07:04.492 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd14 key to auth repository 2020-09-08T16:07:04.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd14 key to auth repository 2020-09-08T16:07:04.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/14/keyring auth add osd.14 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:07:05.033 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.14 2020-09-08T16:07:05.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.14 2020-09-08T16:07:05.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:07:05.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:07:05.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:07:05.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 14 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/14 --osd-journal=td/osd-backfill-space/14/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:07:05.058 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:05.063+0000 7f65663c9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:05.072 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:05.077+0000 7f65663c9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:05.073 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:05.078+0000 7f65663c9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:05.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 14 2020-09-08T16:07:05.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:07:05.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=14 2020-09-08T16:07:05.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:07:05.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:07:05.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:07:05.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:07:05.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:07:05.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.14 up' 2020-09-08T16:07:05.444 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:07:05.591 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:05.596+0000 7f65663c9ec0 -1 Falling back to public interface 2020-09-08T16:07:05.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:07:06.464 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:06.469+0000 7f65663c9ec0 -1 osd.14 0 log_to_monitors {default=true} 2020-09-08T16:07:06.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:07:06.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:07:06.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:07:06.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:07:06.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.14 up' 2020-09-08T16:07:06.845 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:07:07.260 INFO:tasks.workunit.client.0.smithi065.stdout:osd.14 up in weight 1 up_from 75 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6914/258687,v1:127.0.0.1:6915/258687] [v2:127.0.0.1:6916/258687,v1:127.0.0.1:6917/258687] exists,up 0dbc789f-c0d2-42cd-a49a-6a2e2a024ec5 2020-09-08T16:07:07.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:07:07.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:07:07.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:07:07.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:07:07.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:201: TEST_backfill_test_multi: run_osd td/osd-backfill-space 15 2020-09-08T16:07:07.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:07:07.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:07:07.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=15 2020-09-08T16:07:07.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:07:07.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/15 2020-09-08T16:07:07.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:07:07.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:07:07.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:07:07.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:07:07.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/15' 2020-09-08T16:07:07.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/15/journal' 2020-09-08T16:07:07.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:07:07.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:07:07.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:07:07.279 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:07:07.279 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:07:07.279 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:07:07.280 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:07:07.280 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:07:07.280 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:07:07.280 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:07:07.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:07:07.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:07:07.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:07:07.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:07:07.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:07:07.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:07:07.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:07:07.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:07:07.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:07:07.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:07:07.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:07:07.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/15 2020-09-08T16:07:07.283 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:07:07.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=6a0e4a01-aaec-42b3-9cf9-a9fcc225421c 2020-09-08T16:07:07.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd15 6a0e4a01-aaec-42b3-9cf9-a9fcc225421c' 2020-09-08T16:07:07.284 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:07:07.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQArrFdf6O7oEBAAqkwSmmjrPM9UhwVIzmsRAg== 2020-09-08T16:07:07.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQArrFdf6O7oEBAAqkwSmmjrPM9UhwVIzmsRAg=="}' 2020-09-08T16:07:07.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 6a0e4a01-aaec-42b3-9cf9-a9fcc225421c -i td/osd-backfill-space/15/new.json 2020-09-08T16:07:07.285 INFO:tasks.workunit.client.0.smithi065.stdout:add osd15 6a0e4a01-aaec-42b3-9cf9-a9fcc225421c 2020-09-08T16:07:07.886 INFO:tasks.workunit.client.0.smithi065.stdout:15 2020-09-08T16:07:07.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/15/new.json 2020-09-08T16:07:07.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 15 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/15 --osd-journal=td/osd-backfill-space/15/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQArrFdf6O7oEBAAqkwSmmjrPM9UhwVIzmsRAg== --osd-uuid 6a0e4a01-aaec-42b3-9cf9-a9fcc225421c 2020-09-08T16:07:07.925 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:07.930+0000 7f4a6ef83ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:07.926 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:07.931+0000 7f4a6ef83ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:07.928 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:07.933+0000 7f4a6ef83ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:07.928 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:07.934+0000 7f4a6ef83ec0 -1 bluestore(td/osd-backfill-space/15/block) _read_bdev_label failed to open td/osd-backfill-space/15/block: (2) No such file or directory 2020-09-08T16:07:07.929 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:07.934+0000 7f4a6ef83ec0 -1 bluestore(td/osd-backfill-space/15/block) _read_bdev_label failed to open td/osd-backfill-space/15/block: (2) No such file or directory 2020-09-08T16:07:07.929 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:07.934+0000 7f4a6ef83ec0 -1 bluestore(td/osd-backfill-space/15/block) _read_bdev_label failed to open td/osd-backfill-space/15/block: (2) No such file or directory 2020-09-08T16:07:08.034 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:08.040+0000 7f4a6ef83ec0 -1 bluestore(td/osd-backfill-space/15) _read_fsid unparsable uuid 2020-09-08T16:07:12.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/15/keyring 2020-09-08T16:07:12.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:07:12.801 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd15 key to auth repository 2020-09-08T16:07:12.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd15 key to auth repository 2020-09-08T16:07:12.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/15/keyring auth add osd.15 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:07:13.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.15 2020-09-08T16:07:13.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 15 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/15 --osd-journal=td/osd-backfill-space/15/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:07:13.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:07:13.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:07:13.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:07:13.352 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.15 2020-09-08T16:07:13.376 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:13.381+0000 7f1cb8feaec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:13.386 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:13.383+0000 7f1cb8feaec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:13.386 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:13.384+0000 7f1cb8feaec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:13.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 15 2020-09-08T16:07:13.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:07:13.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=15 2020-09-08T16:07:13.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:07:13.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:07:13.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:07:13.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:07:13.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:07:13.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.15 up' 2020-09-08T16:07:13.750 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:07:13.899 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:13.903+0000 7f1cb8feaec0 -1 Falling back to public interface 2020-09-08T16:07:14.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:07:14.727 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:14.732+0000 7f1cb8feaec0 -1 osd.15 0 log_to_monitors {default=true} 2020-09-08T16:07:15.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:07:15.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:07:15.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:07:15.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.15 up' 2020-09-08T16:07:15.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:07:15.173 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:07:15.675 INFO:tasks.workunit.client.0.smithi065.stdout:osd.15 up in weight 1 up_from 80 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6922/259683,v1:127.0.0.1:6923/259683] [v2:127.0.0.1:6924/259683,v1:127.0.0.1:6925/259683] exists,up 6a0e4a01-aaec-42b3-9cf9-a9fcc225421c 2020-09-08T16:07:15.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:07:15.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:07:15.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:07:15.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:07:15.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:201: TEST_backfill_test_multi: run_osd td/osd-backfill-space 16 2020-09-08T16:07:15.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:07:15.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:07:15.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=16 2020-09-08T16:07:15.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:07:15.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/16 2020-09-08T16:07:15.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:07:15.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:07:15.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:07:15.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:07:15.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/16' 2020-09-08T16:07:15.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/16/journal' 2020-09-08T16:07:15.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:07:15.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:07:15.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:07:15.680 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:07:15.681 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:07:15.681 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:07:15.681 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:07:15.681 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:07:15.681 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:07:15.682 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:07:15.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:07:15.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:07:15.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:07:15.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:07:15.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:07:15.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:07:15.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:07:15.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:07:15.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:07:15.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:07:15.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:07:15.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/16 2020-09-08T16:07:15.684 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:07:15.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=ddbe35bd-794b-4b27-b341-9e40cec700d6 2020-09-08T16:07:15.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd16 ddbe35bd-794b-4b27-b341-9e40cec700d6' 2020-09-08T16:07:15.693 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:07:15.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAzrFdfVUKgKRAADLEgABwXPrrWuxSm3CTmcQ== 2020-09-08T16:07:15.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAzrFdfVUKgKRAADLEgABwXPrrWuxSm3CTmcQ=="}' 2020-09-08T16:07:15.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new ddbe35bd-794b-4b27-b341-9e40cec700d6 -i td/osd-backfill-space/16/new.json 2020-09-08T16:07:15.694 INFO:tasks.workunit.client.0.smithi065.stdout:add osd16 ddbe35bd-794b-4b27-b341-9e40cec700d6 2020-09-08T16:07:16.373 INFO:tasks.workunit.client.0.smithi065.stdout:16 2020-09-08T16:07:16.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/16/new.json 2020-09-08T16:07:16.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 16 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/16 --osd-journal=td/osd-backfill-space/16/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAzrFdfVUKgKRAADLEgABwXPrrWuxSm3CTmcQ== --osd-uuid ddbe35bd-794b-4b27-b341-9e40cec700d6 2020-09-08T16:07:16.413 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:16.418+0000 7f9bfc4fbec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:16.421 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:16.420+0000 7f9bfc4fbec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:16.422 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:16.420+0000 7f9bfc4fbec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:16.422 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:16.421+0000 7f9bfc4fbec0 -1 bluestore(td/osd-backfill-space/16/block) _read_bdev_label failed to open td/osd-backfill-space/16/block: (2) No such file or directory 2020-09-08T16:07:16.422 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:16.421+0000 7f9bfc4fbec0 -1 bluestore(td/osd-backfill-space/16/block) _read_bdev_label failed to open td/osd-backfill-space/16/block: (2) No such file or directory 2020-09-08T16:07:16.423 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:16.421+0000 7f9bfc4fbec0 -1 bluestore(td/osd-backfill-space/16/block) _read_bdev_label failed to open td/osd-backfill-space/16/block: (2) No such file or directory 2020-09-08T16:07:16.534 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:16.539+0000 7f9bfc4fbec0 -1 bluestore(td/osd-backfill-space/16) _read_fsid unparsable uuid 2020-09-08T16:07:21.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/16/keyring 2020-09-08T16:07:21.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:07:21.451 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd16 key to auth repository 2020-09-08T16:07:21.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd16 key to auth repository 2020-09-08T16:07:21.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/16/keyring auth add osd.16 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:07:21.985 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.16 2020-09-08T16:07:21.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.16 2020-09-08T16:07:21.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 16 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/16 --osd-journal=td/osd-backfill-space/16/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:07:21.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:07:21.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:07:21.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:07:22.010 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:22.014+0000 7fd2cabeaec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:22.018 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:22.022+0000 7fd2cabeaec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:22.020 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:22.024+0000 7fd2cabeaec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:22.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 16 2020-09-08T16:07:22.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:07:22.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=16 2020-09-08T16:07:22.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:07:22.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:07:22.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:07:22.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:07:22.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:07:22.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.16 up' 2020-09-08T16:07:22.388 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:07:22.534 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:22.538+0000 7fd2cabeaec0 -1 Falling back to public interface 2020-09-08T16:07:22.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:07:23.337 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:23.341+0000 7fd2cabeaec0 -1 osd.16 0 log_to_monitors {default=true} 2020-09-08T16:07:23.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:07:23.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:07:23.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:07:23.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:07:23.802 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:07:23.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.16 up' 2020-09-08T16:07:24.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:07:25.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:07:25.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:07:25.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T16:07:25.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:07:25.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.16 up' 2020-09-08T16:07:25.214 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:07:25.683 INFO:tasks.workunit.client.0.smithi065.stdout:osd.16 up in weight 1 up_from 85 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6930/260677,v1:127.0.0.1:6931/260677] [v2:127.0.0.1:6932/260677,v1:127.0.0.1:6933/260677] exists,up ddbe35bd-794b-4b27-b341-9e40cec700d6 2020-09-08T16:07:25.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:07:25.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:07:25.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:07:25.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:07:25.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:201: TEST_backfill_test_multi: run_osd td/osd-backfill-space 17 2020-09-08T16:07:25.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:07:25.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:07:25.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=17 2020-09-08T16:07:25.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:07:25.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/17 2020-09-08T16:07:25.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:07:25.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:07:25.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:07:25.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:07:25.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/17' 2020-09-08T16:07:25.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/17/journal' 2020-09-08T16:07:25.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:07:25.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:07:25.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:07:25.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:07:25.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:07:25.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:07:25.688 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:07:25.688 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:07:25.689 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:07:25.689 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:07:25.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:07:25.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:07:25.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:07:25.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:07:25.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:07:25.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:07:25.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:07:25.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:07:25.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:07:25.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:07:25.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:07:25.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/17 2020-09-08T16:07:25.693 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:07:25.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=97b12917-abb2-459e-b3cd-96cf1101a0ee 2020-09-08T16:07:25.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd17 97b12917-abb2-459e-b3cd-96cf1101a0ee' 2020-09-08T16:07:25.695 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:07:25.695 INFO:tasks.workunit.client.0.smithi065.stdout:add osd17 97b12917-abb2-459e-b3cd-96cf1101a0ee 2020-09-08T16:07:25.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQA9rFdfz+4XKhAAQE6un2LgBK0eZovl2GJFkA== 2020-09-08T16:07:25.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQA9rFdfz+4XKhAAQE6un2LgBK0eZovl2GJFkA=="}' 2020-09-08T16:07:25.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 97b12917-abb2-459e-b3cd-96cf1101a0ee -i td/osd-backfill-space/17/new.json 2020-09-08T16:07:26.230 INFO:tasks.workunit.client.0.smithi065.stdout:17 2020-09-08T16:07:26.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/17/new.json 2020-09-08T16:07:26.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 17 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/17 --osd-journal=td/osd-backfill-space/17/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQA9rFdfz+4XKhAAQE6un2LgBK0eZovl2GJFkA== --osd-uuid 97b12917-abb2-459e-b3cd-96cf1101a0ee 2020-09-08T16:07:26.269 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:26.273+0000 7f6848f91ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:26.297 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:26.301+0000 7f6848f91ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:26.298 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:26.302+0000 7f6848f91ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:26.299 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:26.303+0000 7f6848f91ec0 -1 bluestore(td/osd-backfill-space/17/block) _read_bdev_label failed to open td/osd-backfill-space/17/block: (2) No such file or directory 2020-09-08T16:07:26.299 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:26.303+0000 7f6848f91ec0 -1 bluestore(td/osd-backfill-space/17/block) _read_bdev_label failed to open td/osd-backfill-space/17/block: (2) No such file or directory 2020-09-08T16:07:26.299 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:26.303+0000 7f6848f91ec0 -1 bluestore(td/osd-backfill-space/17/block) _read_bdev_label failed to open td/osd-backfill-space/17/block: (2) No such file or directory 2020-09-08T16:07:26.486 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:26.490+0000 7f6848f91ec0 -1 bluestore(td/osd-backfill-space/17) _read_fsid unparsable uuid 2020-09-08T16:07:31.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/17/keyring 2020-09-08T16:07:31.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:07:31.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd17 key to auth repository 2020-09-08T16:07:31.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/17/keyring auth add osd.17 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:07:31.396 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd17 key to auth repository 2020-09-08T16:07:31.946 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.17 2020-09-08T16:07:31.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.17 2020-09-08T16:07:31.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:07:31.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 17 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/17 --osd-journal=td/osd-backfill-space/17/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:07:31.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:07:31.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:07:31.972 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:31.977+0000 7efe6f801ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:31.974 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:31.979+0000 7efe6f801ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:31.975 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:31.980+0000 7efe6f801ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:32.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 17 2020-09-08T16:07:32.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:07:32.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=17 2020-09-08T16:07:32.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:07:32.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:07:32.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:07:32.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:07:32.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:07:32.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.17 up' 2020-09-08T16:07:32.347 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:07:32.490 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:32.495+0000 7efe6f801ec0 -1 Falling back to public interface 2020-09-08T16:07:32.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:07:33.330 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:33.331+0000 7efe6f801ec0 -1 osd.17 0 log_to_monitors {default=true} 2020-09-08T16:07:33.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:07:33.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:07:33.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:07:33.752 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:07:33.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:07:33.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.17 up' 2020-09-08T16:07:34.195 INFO:tasks.workunit.client.0.smithi065.stdout:osd.17 up in weight 1 up_from 90 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6938/261697,v1:127.0.0.1:6939/261697] [v2:127.0.0.1:6940/261697,v1:127.0.0.1:6941/261697] exists,up 97b12917-abb2-459e-b3cd-96cf1101a0ee 2020-09-08T16:07:34.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:07:34.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:07:34.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:07:34.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:07:34.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:201: TEST_backfill_test_multi: run_osd td/osd-backfill-space 18 2020-09-08T16:07:34.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:07:34.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:07:34.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=18 2020-09-08T16:07:34.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:07:34.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/18 2020-09-08T16:07:34.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:07:34.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:07:34.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:07:34.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:07:34.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/18' 2020-09-08T16:07:34.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/18/journal' 2020-09-08T16:07:34.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:07:34.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:07:34.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:07:34.206 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:07:34.206 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:07:34.206 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:07:34.207 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:07:34.207 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:07:34.207 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:07:34.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:07:34.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:07:34.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:07:34.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:07:34.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:07:34.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:07:34.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:07:34.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:07:34.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:07:34.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:07:34.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:07:34.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:07:34.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/18 2020-09-08T16:07:34.213 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:07:34.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=af95c222-93db-4c37-96be-a2dc2fa2739f 2020-09-08T16:07:34.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd18 af95c222-93db-4c37-96be-a2dc2fa2739f' 2020-09-08T16:07:34.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:07:34.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBGrFdfiWkeDRAA6e43600r0+0J2E3T8Uo6gQ== 2020-09-08T16:07:34.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBGrFdfiWkeDRAA6e43600r0+0J2E3T8Uo6gQ=="}' 2020-09-08T16:07:34.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new af95c222-93db-4c37-96be-a2dc2fa2739f -i td/osd-backfill-space/18/new.json 2020-09-08T16:07:34.217 INFO:tasks.workunit.client.0.smithi065.stdout:add osd18 af95c222-93db-4c37-96be-a2dc2fa2739f 2020-09-08T16:07:34.770 INFO:tasks.workunit.client.0.smithi065.stdout:18 2020-09-08T16:07:34.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/18/new.json 2020-09-08T16:07:34.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 18 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/18 --osd-journal=td/osd-backfill-space/18/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBGrFdfiWkeDRAA6e43600r0+0J2E3T8Uo6gQ== --osd-uuid af95c222-93db-4c37-96be-a2dc2fa2739f 2020-09-08T16:07:34.809 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:34.814+0000 7f3ca4f94ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:34.820 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:34.825+0000 7f3ca4f94ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:34.821 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:34.825+0000 7f3ca4f94ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:34.821 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:34.826+0000 7f3ca4f94ec0 -1 bluestore(td/osd-backfill-space/18/block) _read_bdev_label failed to open td/osd-backfill-space/18/block: (2) No such file or directory 2020-09-08T16:07:34.822 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:34.826+0000 7f3ca4f94ec0 -1 bluestore(td/osd-backfill-space/18/block) _read_bdev_label failed to open td/osd-backfill-space/18/block: (2) No such file or directory 2020-09-08T16:07:34.822 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:34.826+0000 7f3ca4f94ec0 -1 bluestore(td/osd-backfill-space/18/block) _read_bdev_label failed to open td/osd-backfill-space/18/block: (2) No such file or directory 2020-09-08T16:07:34.887 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:34.892+0000 7f3ca4f94ec0 -1 bluestore(td/osd-backfill-space/18) _read_fsid unparsable uuid 2020-09-08T16:07:40.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/18/keyring 2020-09-08T16:07:40.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:07:40.156 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd18 key to auth repository 2020-09-08T16:07:40.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd18 key to auth repository 2020-09-08T16:07:40.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/18/keyring auth add osd.18 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:07:40.695 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.18 2020-09-08T16:07:40.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.18 2020-09-08T16:07:40.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 18 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/18 --osd-journal=td/osd-backfill-space/18/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:07:40.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:07:40.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:07:40.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:07:40.730 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:40.727+0000 7fad961a9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:40.730 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:40.729+0000 7fad961a9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:40.731 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:40.731+0000 7fad961a9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:41.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 18 2020-09-08T16:07:41.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:07:41.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=18 2020-09-08T16:07:41.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:07:41.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:07:41.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:07:41.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:07:41.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:07:41.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.18 up' 2020-09-08T16:07:41.093 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:07:41.241 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:41.246+0000 7fad961a9ec0 -1 Falling back to public interface 2020-09-08T16:07:41.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:07:42.107 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:42.112+0000 7fad961a9ec0 -1 osd.18 0 log_to_monitors {default=true} 2020-09-08T16:07:42.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:07:42.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:07:42.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:07:42.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.18 up' 2020-09-08T16:07:42.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:07:42.507 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:07:42.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:07:43.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:07:43.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:07:43.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T16:07:43.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:07:43.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.18 up' 2020-09-08T16:07:43.943 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:07:44.341 INFO:tasks.workunit.client.0.smithi065.stdout:osd.18 up in weight 1 up_from 95 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6946/262691,v1:127.0.0.1:6947/262691] [v2:127.0.0.1:6948/262691,v1:127.0.0.1:6949/262691] exists,up af95c222-93db-4c37-96be-a2dc2fa2739f 2020-09-08T16:07:44.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:07:44.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:07:44.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:07:44.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:199: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:07:44.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:201: TEST_backfill_test_multi: run_osd td/osd-backfill-space 19 2020-09-08T16:07:44.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:07:44.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:07:44.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=19 2020-09-08T16:07:44.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:07:44.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/19 2020-09-08T16:07:44.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:07:44.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:07:44.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:07:44.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:07:44.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/19' 2020-09-08T16:07:44.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/19/journal' 2020-09-08T16:07:44.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:07:44.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:07:44.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:07:44.346 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:07:44.346 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:07:44.346 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:07:44.346 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:07:44.351 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:07:44.351 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:07:44.351 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:07:44.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:07:44.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:07:44.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:07:44.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:07:44.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:07:44.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:07:44.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:07:44.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:07:44.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:07:44.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:07:44.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:07:44.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/19 2020-09-08T16:07:44.355 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:07:44.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=26e51669-3526-48d6-b372-d7301e4a7ede 2020-09-08T16:07:44.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd19 26e51669-3526-48d6-b372-d7301e4a7ede' 2020-09-08T16:07:44.356 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:07:44.356 INFO:tasks.workunit.client.0.smithi065.stdout:add osd19 26e51669-3526-48d6-b372-d7301e4a7ede 2020-09-08T16:07:44.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBQrFdfJbvDFRAAB9ubQBFmpddfx4C111SU2A== 2020-09-08T16:07:44.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBQrFdfJbvDFRAAB9ubQBFmpddfx4C111SU2A=="}' 2020-09-08T16:07:44.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 26e51669-3526-48d6-b372-d7301e4a7ede -i td/osd-backfill-space/19/new.json 2020-09-08T16:07:45.060 INFO:tasks.workunit.client.0.smithi065.stdout:19 2020-09-08T16:07:45.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/19/new.json 2020-09-08T16:07:45.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 19 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/19 --osd-journal=td/osd-backfill-space/19/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBQrFdfJbvDFRAAB9ubQBFmpddfx4C111SU2A== --osd-uuid 26e51669-3526-48d6-b372-d7301e4a7ede 2020-09-08T16:07:45.099 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:45.104+0000 7f59de2c4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:45.100 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:45.106+0000 7f59de2c4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:45.101 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:45.107+0000 7f59de2c4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:45.102 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:45.107+0000 7f59de2c4ec0 -1 bluestore(td/osd-backfill-space/19/block) _read_bdev_label failed to open td/osd-backfill-space/19/block: (2) No such file or directory 2020-09-08T16:07:45.102 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:45.107+0000 7f59de2c4ec0 -1 bluestore(td/osd-backfill-space/19/block) _read_bdev_label failed to open td/osd-backfill-space/19/block: (2) No such file or directory 2020-09-08T16:07:45.103 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:45.107+0000 7f59de2c4ec0 -1 bluestore(td/osd-backfill-space/19/block) _read_bdev_label failed to open td/osd-backfill-space/19/block: (2) No such file or directory 2020-09-08T16:07:45.220 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:45.225+0000 7f59de2c4ec0 -1 bluestore(td/osd-backfill-space/19) _read_fsid unparsable uuid 2020-09-08T16:07:50.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/19/keyring 2020-09-08T16:07:50.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:07:50.088 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd19 key to auth repository 2020-09-08T16:07:50.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd19 key to auth repository 2020-09-08T16:07:50.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/19/keyring auth add osd.19 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:07:50.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.19 2020-09-08T16:07:50.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 19 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/19 --osd-journal=td/osd-backfill-space/19/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:07:50.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:07:50.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:07:50.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:07:50.660 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.19 2020-09-08T16:07:50.683 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:50.688+0000 7fa5dad58ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:50.685 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:50.690+0000 7fa5dad58ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:50.686 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:50.691+0000 7fa5dad58ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:07:51.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 19 2020-09-08T16:07:51.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:07:51.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=19 2020-09-08T16:07:51.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:07:51.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:07:51.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:07:51.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:07:51.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:07:51.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.19 up' 2020-09-08T16:07:51.059 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:07:51.209 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:51.214+0000 7fa5dad58ec0 -1 Falling back to public interface 2020-09-08T16:07:51.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:07:52.031 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:07:52.036+0000 7fa5dad58ec0 -1 osd.19 0 log_to_monitors {default=true} 2020-09-08T16:07:52.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:07:52.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:07:52.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:07:52.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:07:52.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.19 up' 2020-09-08T16:07:52.458 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:07:52.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:07:53.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:07:53.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:07:53.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T16:07:53.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.19 up' 2020-09-08T16:07:53.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:07:53.911 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:07:54.314 INFO:tasks.workunit.client.0.smithi065.stdout:osd.19 up in weight 1 up_from 100 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6954/263719,v1:127.0.0.1:6955/263719] [v2:127.0.0.1:6956/263719,v1:127.0.0.1:6957/263719] exists,up 26e51669-3526-48d6-b372-d7301e4a7ede 2020-09-08T16:07:54.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:07:54.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:07:54.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:07:54.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:204: TEST_backfill_test_multi: ceph osd set-backfillfull-ratio .85 2020-09-08T16:07:55.137 INFO:tasks.workunit.client.0.smithi065.stderr:osd set-backfillfull-ratio 0.85 2020-09-08T16:07:55.146 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:206: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:07:55.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:206: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:07:55.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:208: TEST_backfill_test_multi: create_pool test1 1 1 2020-09-08T16:07:55.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test1 1 1 2020-09-08T16:07:55.718 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test1' already exists 2020-09-08T16:07:55.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:07:56.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:209: TEST_backfill_test_multi: ceph osd pool set test1 size 1 --yes-i-really-mean-it 2020-09-08T16:07:57.947 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 1 2020-09-08T16:07:57.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:206: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:07:57.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:208: TEST_backfill_test_multi: create_pool test2 1 1 2020-09-08T16:07:57.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test2 1 1 2020-09-08T16:07:58.982 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test2' already exists 2020-09-08T16:07:58.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:07:59.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:209: TEST_backfill_test_multi: ceph osd pool set test2 size 1 --yes-i-really-mean-it 2020-09-08T16:08:00.945 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 2 size to 1 2020-09-08T16:08:00.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:206: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:00.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:208: TEST_backfill_test_multi: create_pool test3 1 1 2020-09-08T16:08:00.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test3 1 1 2020-09-08T16:08:01.844 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test3' already exists 2020-09-08T16:08:01.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:08:02.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:209: TEST_backfill_test_multi: ceph osd pool set test3 size 1 --yes-i-really-mean-it 2020-09-08T16:08:03.725 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 3 size to 1 2020-09-08T16:08:03.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:206: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:03.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:208: TEST_backfill_test_multi: create_pool test4 1 1 2020-09-08T16:08:03.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test4 1 1 2020-09-08T16:08:04.618 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test4' already exists 2020-09-08T16:08:04.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:08:05.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:209: TEST_backfill_test_multi: ceph osd pool set test4 size 1 --yes-i-really-mean-it 2020-09-08T16:08:06.806 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 4 size to 1 2020-09-08T16:08:06.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:206: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:06.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:208: TEST_backfill_test_multi: create_pool test5 1 1 2020-09-08T16:08:06.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test5 1 1 2020-09-08T16:08:07.679 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test5' already exists 2020-09-08T16:08:07.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:08:08.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:209: TEST_backfill_test_multi: ceph osd pool set test5 size 1 --yes-i-really-mean-it 2020-09-08T16:08:09.610 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 5 size to 1 2020-09-08T16:08:09.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:206: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:09.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:208: TEST_backfill_test_multi: create_pool test6 1 1 2020-09-08T16:08:09.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test6 1 1 2020-09-08T16:08:10.241 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test6' already exists 2020-09-08T16:08:10.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:08:11.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:209: TEST_backfill_test_multi: ceph osd pool set test6 size 1 --yes-i-really-mean-it 2020-09-08T16:08:12.756 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 6 size to 1 2020-09-08T16:08:12.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:206: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:12.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:208: TEST_backfill_test_multi: create_pool test7 1 1 2020-09-08T16:08:12.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test7 1 1 2020-09-08T16:08:13.695 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test7' already exists 2020-09-08T16:08:13.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:08:14.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:209: TEST_backfill_test_multi: ceph osd pool set test7 size 1 --yes-i-really-mean-it 2020-09-08T16:08:15.513 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 7 size to 1 2020-09-08T16:08:15.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:206: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:15.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:208: TEST_backfill_test_multi: create_pool test8 1 1 2020-09-08T16:08:15.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test8 1 1 2020-09-08T16:08:16.307 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test8' already exists 2020-09-08T16:08:16.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:08:17.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:209: TEST_backfill_test_multi: ceph osd pool set test8 size 1 --yes-i-really-mean-it 2020-09-08T16:08:18.308 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 8 size to 1 2020-09-08T16:08:18.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:212: TEST_backfill_test_multi: wait_for_clean 2020-09-08T16:08:18.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:08:18.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:08:18.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:08:18.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:08:18.318 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:08:18.318 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:08:18.319 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:08:18.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:08:18.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:08:18.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:08:18.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:08:18.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:08:18.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:08:18.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:08:18.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:08:18.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:08:18.861 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:08:18.861 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:08:18.862 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:08:18.862 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T16:08:18.862 INFO:tasks.workunit.client.0.smithi065.stderr:5 2020-09-08T16:08:18.862 INFO:tasks.workunit.client.0.smithi065.stderr:6 2020-09-08T16:08:18.863 INFO:tasks.workunit.client.0.smithi065.stderr:7 2020-09-08T16:08:18.863 INFO:tasks.workunit.client.0.smithi065.stderr:8 2020-09-08T16:08:18.863 INFO:tasks.workunit.client.0.smithi065.stderr:9 2020-09-08T16:08:18.863 INFO:tasks.workunit.client.0.smithi065.stderr:10 2020-09-08T16:08:18.864 INFO:tasks.workunit.client.0.smithi065.stderr:11 2020-09-08T16:08:18.864 INFO:tasks.workunit.client.0.smithi065.stderr:12 2020-09-08T16:08:18.864 INFO:tasks.workunit.client.0.smithi065.stderr:13 2020-09-08T16:08:18.864 INFO:tasks.workunit.client.0.smithi065.stderr:14 2020-09-08T16:08:18.864 INFO:tasks.workunit.client.0.smithi065.stderr:15 2020-09-08T16:08:18.865 INFO:tasks.workunit.client.0.smithi065.stderr:16 2020-09-08T16:08:18.865 INFO:tasks.workunit.client.0.smithi065.stderr:17 2020-09-08T16:08:18.865 INFO:tasks.workunit.client.0.smithi065.stderr:18 2020-09-08T16:08:18.865 INFO:tasks.workunit.client.0.smithi065.stderr:19' 2020-09-08T16:08:18.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:08:18.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:08:18.866 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:08:19.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836521 2020-09-08T16:08:19.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836521 2020-09-08T16:08:19.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836521' 2020-09-08T16:08:19.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:08:19.163 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:08:19.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672998 2020-09-08T16:08:19.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672998 2020-09-08T16:08:19.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836521 1-42949672998' 2020-09-08T16:08:19.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:08:19.297 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:08:19.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509477 2020-09-08T16:08:19.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509477 2020-09-08T16:08:19.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836521 1-42949672998 2-64424509477' 2020-09-08T16:08:19.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:08:19.430 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:08:19.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345955 2020-09-08T16:08:19.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345955 2020-09-08T16:08:19.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836521 1-42949672998 2-64424509477 3-85899345955' 2020-09-08T16:08:19.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:08:19.565 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:08:19.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182435 2020-09-08T16:08:19.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182435 2020-09-08T16:08:19.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836521 1-42949672998 2-64424509477 3-85899345955 4-107374182435' 2020-09-08T16:08:19.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:08:19.700 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T16:08:19.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018912 2020-09-08T16:08:19.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018912 2020-09-08T16:08:19.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836521 1-42949672998 2-64424509477 3-85899345955 4-107374182435 5-128849018912' 2020-09-08T16:08:19.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:08:19.835 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2020-09-08T16:08:19.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=150323855391 2020-09-08T16:08:19.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 150323855391 2020-09-08T16:08:19.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836521 1-42949672998 2-64424509477 3-85899345955 4-107374182435 5-128849018912 6-150323855391' 2020-09-08T16:08:19.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:08:19.970 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2020-09-08T16:08:20.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=171798691869 2020-09-08T16:08:20.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 171798691869 2020-09-08T16:08:20.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836521 1-42949672998 2-64424509477 3-85899345955 4-107374182435 5-128849018912 6-150323855391 7-171798691869' 2020-09-08T16:08:20.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:08:20.103 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2020-09-08T16:08:20.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=193273528348 2020-09-08T16:08:20.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 193273528348 2020-09-08T16:08:20.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836521 1-42949672998 2-64424509477 3-85899345955 4-107374182435 5-128849018912 6-150323855391 7-171798691869 8-193273528348' 2020-09-08T16:08:20.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:08:20.236 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2020-09-08T16:08:20.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=214748364826 2020-09-08T16:08:20.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 214748364826 2020-09-08T16:08:20.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836521 1-42949672998 2-64424509477 3-85899345955 4-107374182435 5-128849018912 6-150323855391 7-171798691869 8-193273528348 9-214748364826' 2020-09-08T16:08:20.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:08:20.370 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2020-09-08T16:08:20.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=236223201305 2020-09-08T16:08:20.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 236223201305 2020-09-08T16:08:20.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836521 1-42949672998 2-64424509477 3-85899345955 4-107374182435 5-128849018912 6-150323855391 7-171798691869 8-193273528348 9-214748364826 10-236223201305' 2020-09-08T16:08:20.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:08:20.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.11 flush_pg_stats 2020-09-08T16:08:20.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=257698037783 2020-09-08T16:08:20.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 257698037783 2020-09-08T16:08:20.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836521 1-42949672998 2-64424509477 3-85899345955 4-107374182435 5-128849018912 6-150323855391 7-171798691869 8-193273528348 9-214748364826 10-236223201305 11-257698037783' 2020-09-08T16:08:20.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:08:20.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.12 flush_pg_stats 2020-09-08T16:08:20.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=279172874262 2020-09-08T16:08:20.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 279172874262 2020-09-08T16:08:20.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836521 1-42949672998 2-64424509477 3-85899345955 4-107374182435 5-128849018912 6-150323855391 7-171798691869 8-193273528348 9-214748364826 10-236223201305 11-257698037783 12-279172874262' 2020-09-08T16:08:20.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:08:20.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.13 flush_pg_stats 2020-09-08T16:08:20.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=300647710739 2020-09-08T16:08:20.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 300647710739 2020-09-08T16:08:20.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836521 1-42949672998 2-64424509477 3-85899345955 4-107374182435 5-128849018912 6-150323855391 7-171798691869 8-193273528348 9-214748364826 10-236223201305 11-257698037783 12-279172874262 13-300647710739' 2020-09-08T16:08:20.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:08:20.936 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.14 flush_pg_stats 2020-09-08T16:08:21.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=322122547217 2020-09-08T16:08:21.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 322122547217 2020-09-08T16:08:21.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836521 1-42949672998 2-64424509477 3-85899345955 4-107374182435 5-128849018912 6-150323855391 7-171798691869 8-193273528348 9-214748364826 10-236223201305 11-257698037783 12-279172874262 13-300647710739 14-322122547217' 2020-09-08T16:08:21.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:08:21.069 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.15 flush_pg_stats 2020-09-08T16:08:21.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=343597383697 2020-09-08T16:08:21.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 343597383697 2020-09-08T16:08:21.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836521 1-42949672998 2-64424509477 3-85899345955 4-107374182435 5-128849018912 6-150323855391 7-171798691869 8-193273528348 9-214748364826 10-236223201305 11-257698037783 12-279172874262 13-300647710739 14-322122547217 15-343597383697' 2020-09-08T16:08:21.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:08:21.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.16 flush_pg_stats 2020-09-08T16:08:21.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=365072220174 2020-09-08T16:08:21.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 365072220174 2020-09-08T16:08:21.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836521 1-42949672998 2-64424509477 3-85899345955 4-107374182435 5-128849018912 6-150323855391 7-171798691869 8-193273528348 9-214748364826 10-236223201305 11-257698037783 12-279172874262 13-300647710739 14-322122547217 15-343597383697 16-365072220174' 2020-09-08T16:08:21.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:08:21.336 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.17 flush_pg_stats 2020-09-08T16:08:21.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=386547056652 2020-09-08T16:08:21.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 386547056652 2020-09-08T16:08:21.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836521 1-42949672998 2-64424509477 3-85899345955 4-107374182435 5-128849018912 6-150323855391 7-171798691869 8-193273528348 9-214748364826 10-236223201305 11-257698037783 12-279172874262 13-300647710739 14-322122547217 15-343597383697 16-365072220174 17-386547056652' 2020-09-08T16:08:21.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:08:21.470 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.18 flush_pg_stats 2020-09-08T16:08:21.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=408021893131 2020-09-08T16:08:21.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 408021893131 2020-09-08T16:08:21.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836521 1-42949672998 2-64424509477 3-85899345955 4-107374182435 5-128849018912 6-150323855391 7-171798691869 8-193273528348 9-214748364826 10-236223201305 11-257698037783 12-279172874262 13-300647710739 14-322122547217 15-343597383697 16-365072220174 17-386547056652 18-408021893131' 2020-09-08T16:08:21.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:08:21.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.19 flush_pg_stats 2020-09-08T16:08:21.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=429496729608 2020-09-08T16:08:21.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 429496729608 2020-09-08T16:08:21.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836521 1-42949672998 2-64424509477 3-85899345955 4-107374182435 5-128849018912 6-150323855391 7-171798691869 8-193273528348 9-214748364826 10-236223201305 11-257698037783 12-279172874262 13-300647710739 14-322122547217 15-343597383697 16-365072220174 17-386547056652 18-408021893131 19-429496729608' 2020-09-08T16:08:21.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:08:21.740 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836521 2020-09-08T16:08:21.740 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:08:21.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:08:21.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836521 2020-09-08T16:08:21.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:08:21.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836521 2020-09-08T16:08:21.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836521' 2020-09-08T16:08:21.742 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:08:21.742 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836521 2020-09-08T16:08:22.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836521 -lt 21474836521 2020-09-08T16:08:22.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:08:22.136 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672998 2020-09-08T16:08:22.136 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:08:22.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:08:22.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672998 2020-09-08T16:08:22.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:08:22.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672998 2020-09-08T16:08:22.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672998' 2020-09-08T16:08:22.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:08:22.138 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672998 2020-09-08T16:08:22.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672999 -lt 42949672998 2020-09-08T16:08:22.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:08:22.560 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509477 2020-09-08T16:08:22.561 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:08:22.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:08:22.561 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509477 2020-09-08T16:08:22.562 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:08:22.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509477 2020-09-08T16:08:22.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509477' 2020-09-08T16:08:22.563 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:08:22.565 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509477 2020-09-08T16:08:22.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509477 -lt 64424509477 2020-09-08T16:08:22.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:08:22.963 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345955 2020-09-08T16:08:22.964 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:08:22.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:08:22.964 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345955 2020-09-08T16:08:22.965 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:08:22.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345955 2020-09-08T16:08:22.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345955' 2020-09-08T16:08:22.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:08:22.967 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345955 2020-09-08T16:08:23.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345956 -lt 85899345955 2020-09-08T16:08:23.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:08:23.382 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182435 2020-09-08T16:08:23.382 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:08:23.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:08:23.383 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182435 2020-09-08T16:08:23.384 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:08:23.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182435 2020-09-08T16:08:23.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182435' 2020-09-08T16:08:23.385 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:08:23.385 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182435 2020-09-08T16:08:23.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182435 -lt 107374182435 2020-09-08T16:08:23.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:08:23.811 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018912 2020-09-08T16:08:23.811 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:08:23.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T16:08:23.812 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018912 2020-09-08T16:08:23.813 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:08:23.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018912 2020-09-08T16:08:23.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018912' 2020-09-08T16:08:23.824 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T16:08:23.825 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018912 2020-09-08T16:08:24.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018913 -lt 128849018912 2020-09-08T16:08:24.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:08:24.221 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 6-150323855391 2020-09-08T16:08:24.221 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:08:24.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=6 2020-09-08T16:08:24.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 6-150323855391 2020-09-08T16:08:24.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:08:24.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=150323855391 2020-09-08T16:08:24.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.6 seq 150323855391' 2020-09-08T16:08:24.223 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.6 seq 150323855391 2020-09-08T16:08:24.228 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 6 2020-09-08T16:08:24.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 150323855392 -lt 150323855391 2020-09-08T16:08:24.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:08:24.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 7-171798691869 2020-09-08T16:08:24.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:08:24.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=7 2020-09-08T16:08:24.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 7-171798691869 2020-09-08T16:08:24.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:08:24.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=171798691869 2020-09-08T16:08:24.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.7 seq 171798691869' 2020-09-08T16:08:24.666 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 7 2020-09-08T16:08:24.667 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.7 seq 171798691869 2020-09-08T16:08:25.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 171798691870 -lt 171798691869 2020-09-08T16:08:25.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:08:25.068 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 8-193273528348 2020-09-08T16:08:25.068 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:08:25.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=8 2020-09-08T16:08:25.069 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 8-193273528348 2020-09-08T16:08:25.069 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:08:25.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=193273528348 2020-09-08T16:08:25.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.8 seq 193273528348' 2020-09-08T16:08:25.072 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 8 2020-09-08T16:08:25.072 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.8 seq 193273528348 2020-09-08T16:08:25.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 193273528348 -lt 193273528348 2020-09-08T16:08:25.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:08:25.466 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 9-214748364826 2020-09-08T16:08:25.466 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:08:25.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=9 2020-09-08T16:08:25.467 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 9-214748364826 2020-09-08T16:08:25.468 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:08:25.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=214748364826 2020-09-08T16:08:25.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.9 seq 214748364826' 2020-09-08T16:08:25.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 9 2020-09-08T16:08:25.469 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.9 seq 214748364826 2020-09-08T16:08:25.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 214748364827 -lt 214748364826 2020-09-08T16:08:25.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:08:25.871 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 10-236223201305 2020-09-08T16:08:25.872 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:08:25.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=10 2020-09-08T16:08:25.873 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 10-236223201305 2020-09-08T16:08:25.874 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:08:25.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=236223201305 2020-09-08T16:08:25.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.10 seq 236223201305' 2020-09-08T16:08:25.874 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 10 2020-09-08T16:08:25.875 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.10 seq 236223201305 2020-09-08T16:08:26.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 236223201307 -lt 236223201305 2020-09-08T16:08:26.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:08:26.285 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 11-257698037783 2020-09-08T16:08:26.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:08:26.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=11 2020-09-08T16:08:26.288 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 11-257698037783 2020-09-08T16:08:26.288 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:08:26.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=257698037783 2020-09-08T16:08:26.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.11 seq 257698037783' 2020-09-08T16:08:26.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 11 2020-09-08T16:08:26.289 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.11 seq 257698037783 2020-09-08T16:08:26.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 257698037784 -lt 257698037783 2020-09-08T16:08:26.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:08:26.692 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 12-279172874262 2020-09-08T16:08:26.693 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:08:26.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=12 2020-09-08T16:08:26.695 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 12-279172874262 2020-09-08T16:08:26.695 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:08:26.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=279172874262 2020-09-08T16:08:26.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.12 seq 279172874262' 2020-09-08T16:08:26.696 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 12 2020-09-08T16:08:26.696 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.12 seq 279172874262 2020-09-08T16:08:27.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 279172874263 -lt 279172874262 2020-09-08T16:08:27.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:08:27.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 13-300647710739 2020-09-08T16:08:27.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:08:27.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=13 2020-09-08T16:08:27.094 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 13-300647710739 2020-09-08T16:08:27.094 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:08:27.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=300647710739 2020-09-08T16:08:27.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.13 seq 300647710739' 2020-09-08T16:08:27.095 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 13 2020-09-08T16:08:27.095 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.13 seq 300647710739 2020-09-08T16:08:27.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 300647710740 -lt 300647710739 2020-09-08T16:08:27.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:08:27.495 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 14-322122547217 2020-09-08T16:08:27.495 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:08:27.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=14 2020-09-08T16:08:27.497 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 14-322122547217 2020-09-08T16:08:27.497 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:08:27.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=322122547217 2020-09-08T16:08:27.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.14 seq 322122547217' 2020-09-08T16:08:27.498 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 14 2020-09-08T16:08:27.498 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.14 seq 322122547217 2020-09-08T16:08:27.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 322122547218 -lt 322122547217 2020-09-08T16:08:27.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:08:27.896 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 15-343597383697 2020-09-08T16:08:27.896 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:08:27.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=15 2020-09-08T16:08:27.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 15-343597383697 2020-09-08T16:08:27.901 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:08:27.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=343597383697 2020-09-08T16:08:27.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.15 seq 343597383697' 2020-09-08T16:08:27.901 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 15 2020-09-08T16:08:27.902 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.15 seq 343597383697 2020-09-08T16:08:28.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 343597383698 -lt 343597383697 2020-09-08T16:08:28.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:08:28.297 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 16-365072220174 2020-09-08T16:08:28.297 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:08:28.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=16 2020-09-08T16:08:28.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 16-365072220174 2020-09-08T16:08:28.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:08:28.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=365072220174 2020-09-08T16:08:28.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.16 seq 365072220174' 2020-09-08T16:08:28.301 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 16 2020-09-08T16:08:28.301 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.16 seq 365072220174 2020-09-08T16:08:28.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 365072220175 -lt 365072220174 2020-09-08T16:08:28.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:08:28.696 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 17-386547056652 2020-09-08T16:08:28.696 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:08:28.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=17 2020-09-08T16:08:28.697 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 17-386547056652 2020-09-08T16:08:28.697 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:08:28.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=386547056652 2020-09-08T16:08:28.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.17 seq 386547056652' 2020-09-08T16:08:28.698 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 17 2020-09-08T16:08:28.699 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.17 seq 386547056652 2020-09-08T16:08:29.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 386547056653 -lt 386547056652 2020-09-08T16:08:29.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:08:29.098 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 18-408021893131 2020-09-08T16:08:29.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:08:29.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=18 2020-09-08T16:08:29.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 18-408021893131 2020-09-08T16:08:29.100 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:08:29.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=408021893131 2020-09-08T16:08:29.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.18 seq 408021893131' 2020-09-08T16:08:29.102 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 18 2020-09-08T16:08:29.103 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.18 seq 408021893131 2020-09-08T16:08:29.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 408021893132 -lt 408021893131 2020-09-08T16:08:29.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:08:29.531 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 19-429496729608 2020-09-08T16:08:29.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:08:29.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=19 2020-09-08T16:08:29.533 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 19-429496729608 2020-09-08T16:08:29.533 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:08:29.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=429496729608 2020-09-08T16:08:29.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.19 seq 429496729608' 2020-09-08T16:08:29.534 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 19 2020-09-08T16:08:29.534 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.19 seq 429496729608 2020-09-08T16:08:29.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 429496729609 -lt 429496729608 2020-09-08T16:08:29.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:08:29.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:08:29.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:08:30.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 8 == 0 2020-09-08T16:08:30.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:08:30.473 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:08:30.473 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:08:30.473 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:08:30.473 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:08:30.474 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:08:30.474 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:08:30.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=8 2020-09-08T16:08:30.861 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:08:30.861 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:08:30.862 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:08:31.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 8 = 8 2020-09-08T16:08:31.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:08:31.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:08:31.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:214: TEST_backfill_test_multi: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=4 2020-09-08T16:08:31.388 INFO:tasks.workunit.client.0.smithi065.stderr:4+0 records in 2020-09-08T16:08:31.388 INFO:tasks.workunit.client.0.smithi065.stderr:4+0 records out 2020-09-08T16:08:31.389 INFO:tasks.workunit.client.0.smithi065.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 6.9102e-05 s, 59.3 MB/s 2020-09-08T16:08:31.389 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: seq 1 600 2020-09-08T16:08:31.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:31.390 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:31.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:31.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj1 td/osd-backfill-space/datafile 2020-09-08T16:08:31.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:31.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj1 td/osd-backfill-space/datafile 2020-09-08T16:08:31.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:31.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj1 td/osd-backfill-space/datafile 2020-09-08T16:08:31.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:31.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj1 td/osd-backfill-space/datafile 2020-09-08T16:08:31.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:31.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj1 td/osd-backfill-space/datafile 2020-09-08T16:08:31.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:31.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj1 td/osd-backfill-space/datafile 2020-09-08T16:08:31.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:31.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj1 td/osd-backfill-space/datafile 2020-09-08T16:08:31.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:31.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj1 td/osd-backfill-space/datafile 2020-09-08T16:08:32.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:32.035 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:32.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:32.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj2 td/osd-backfill-space/datafile 2020-09-08T16:08:32.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:32.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj2 td/osd-backfill-space/datafile 2020-09-08T16:08:32.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:32.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj2 td/osd-backfill-space/datafile 2020-09-08T16:08:32.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:32.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj2 td/osd-backfill-space/datafile 2020-09-08T16:08:32.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:32.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj2 td/osd-backfill-space/datafile 2020-09-08T16:08:32.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:32.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj2 td/osd-backfill-space/datafile 2020-09-08T16:08:32.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:32.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj2 td/osd-backfill-space/datafile 2020-09-08T16:08:32.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:32.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj2 td/osd-backfill-space/datafile 2020-09-08T16:08:32.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:32.731 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:32.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:32.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj3 td/osd-backfill-space/datafile 2020-09-08T16:08:32.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:32.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj3 td/osd-backfill-space/datafile 2020-09-08T16:08:32.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:32.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj3 td/osd-backfill-space/datafile 2020-09-08T16:08:32.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:32.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj3 td/osd-backfill-space/datafile 2020-09-08T16:08:33.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:33.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj3 td/osd-backfill-space/datafile 2020-09-08T16:08:33.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:33.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj3 td/osd-backfill-space/datafile 2020-09-08T16:08:33.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:33.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj3 td/osd-backfill-space/datafile 2020-09-08T16:08:33.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:33.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj3 td/osd-backfill-space/datafile 2020-09-08T16:08:33.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:33.363 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:33.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:33.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj4 td/osd-backfill-space/datafile 2020-09-08T16:08:33.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:33.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj4 td/osd-backfill-space/datafile 2020-09-08T16:08:33.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:33.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj4 td/osd-backfill-space/datafile 2020-09-08T16:08:33.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:33.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj4 td/osd-backfill-space/datafile 2020-09-08T16:08:33.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:33.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj4 td/osd-backfill-space/datafile 2020-09-08T16:08:33.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:33.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj4 td/osd-backfill-space/datafile 2020-09-08T16:08:33.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:33.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj4 td/osd-backfill-space/datafile 2020-09-08T16:08:33.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:33.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj4 td/osd-backfill-space/datafile 2020-09-08T16:08:34.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:34.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:34.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:34.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj5 td/osd-backfill-space/datafile 2020-09-08T16:08:34.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:34.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj5 td/osd-backfill-space/datafile 2020-09-08T16:08:34.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:34.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj5 td/osd-backfill-space/datafile 2020-09-08T16:08:34.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:34.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj5 td/osd-backfill-space/datafile 2020-09-08T16:08:34.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:34.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj5 td/osd-backfill-space/datafile 2020-09-08T16:08:34.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:34.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj5 td/osd-backfill-space/datafile 2020-09-08T16:08:34.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:34.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj5 td/osd-backfill-space/datafile 2020-09-08T16:08:34.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:34.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj5 td/osd-backfill-space/datafile 2020-09-08T16:08:34.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:34.823 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:34.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:34.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj6 td/osd-backfill-space/datafile 2020-09-08T16:08:34.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:34.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj6 td/osd-backfill-space/datafile 2020-09-08T16:08:34.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:34.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj6 td/osd-backfill-space/datafile 2020-09-08T16:08:35.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:35.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj6 td/osd-backfill-space/datafile 2020-09-08T16:08:35.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:35.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj6 td/osd-backfill-space/datafile 2020-09-08T16:08:35.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:35.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj6 td/osd-backfill-space/datafile 2020-09-08T16:08:35.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:35.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj6 td/osd-backfill-space/datafile 2020-09-08T16:08:35.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:35.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj6 td/osd-backfill-space/datafile 2020-09-08T16:08:35.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:35.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:35.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:35.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj7 td/osd-backfill-space/datafile 2020-09-08T16:08:35.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:35.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj7 td/osd-backfill-space/datafile 2020-09-08T16:08:35.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:35.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj7 td/osd-backfill-space/datafile 2020-09-08T16:08:35.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:35.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj7 td/osd-backfill-space/datafile 2020-09-08T16:08:35.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:35.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj7 td/osd-backfill-space/datafile 2020-09-08T16:08:35.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:35.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj7 td/osd-backfill-space/datafile 2020-09-08T16:08:35.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:35.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj7 td/osd-backfill-space/datafile 2020-09-08T16:08:36.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:36.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj7 td/osd-backfill-space/datafile 2020-09-08T16:08:36.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:36.096 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:36.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:36.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj8 td/osd-backfill-space/datafile 2020-09-08T16:08:36.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:36.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj8 td/osd-backfill-space/datafile 2020-09-08T16:08:36.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:36.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj8 td/osd-backfill-space/datafile 2020-09-08T16:08:36.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:36.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj8 td/osd-backfill-space/datafile 2020-09-08T16:08:36.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:36.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj8 td/osd-backfill-space/datafile 2020-09-08T16:08:36.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:36.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj8 td/osd-backfill-space/datafile 2020-09-08T16:08:36.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:36.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj8 td/osd-backfill-space/datafile 2020-09-08T16:08:36.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:36.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj8 td/osd-backfill-space/datafile 2020-09-08T16:08:36.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:36.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:36.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:36.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj9 td/osd-backfill-space/datafile 2020-09-08T16:08:36.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:36.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj9 td/osd-backfill-space/datafile 2020-09-08T16:08:36.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:36.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj9 td/osd-backfill-space/datafile 2020-09-08T16:08:37.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:37.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj9 td/osd-backfill-space/datafile 2020-09-08T16:08:37.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:37.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj9 td/osd-backfill-space/datafile 2020-09-08T16:08:37.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:37.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj9 td/osd-backfill-space/datafile 2020-09-08T16:08:37.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:37.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj9 td/osd-backfill-space/datafile 2020-09-08T16:08:37.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:37.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj9 td/osd-backfill-space/datafile 2020-09-08T16:08:37.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:37.419 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:37.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:37.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj10 td/osd-backfill-space/datafile 2020-09-08T16:08:37.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:37.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj10 td/osd-backfill-space/datafile 2020-09-08T16:08:37.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:37.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj10 td/osd-backfill-space/datafile 2020-09-08T16:08:37.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:37.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj10 td/osd-backfill-space/datafile 2020-09-08T16:08:37.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:37.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj10 td/osd-backfill-space/datafile 2020-09-08T16:08:37.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:37.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj10 td/osd-backfill-space/datafile 2020-09-08T16:08:37.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:37.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj10 td/osd-backfill-space/datafile 2020-09-08T16:08:37.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:37.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj10 td/osd-backfill-space/datafile 2020-09-08T16:08:38.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:38.043 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:38.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:38.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj11 td/osd-backfill-space/datafile 2020-09-08T16:08:38.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:38.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj11 td/osd-backfill-space/datafile 2020-09-08T16:08:38.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:38.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj11 td/osd-backfill-space/datafile 2020-09-08T16:08:38.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:38.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj11 td/osd-backfill-space/datafile 2020-09-08T16:08:38.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:38.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj11 td/osd-backfill-space/datafile 2020-09-08T16:08:38.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:38.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj11 td/osd-backfill-space/datafile 2020-09-08T16:08:38.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:38.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj11 td/osd-backfill-space/datafile 2020-09-08T16:08:38.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:38.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj11 td/osd-backfill-space/datafile 2020-09-08T16:08:38.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:38.867 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:38.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:38.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj12 td/osd-backfill-space/datafile 2020-09-08T16:08:38.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:38.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj12 td/osd-backfill-space/datafile 2020-09-08T16:08:39.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:39.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj12 td/osd-backfill-space/datafile 2020-09-08T16:08:39.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:39.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj12 td/osd-backfill-space/datafile 2020-09-08T16:08:39.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:39.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj12 td/osd-backfill-space/datafile 2020-09-08T16:08:39.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:39.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj12 td/osd-backfill-space/datafile 2020-09-08T16:08:39.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:39.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj12 td/osd-backfill-space/datafile 2020-09-08T16:08:39.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:39.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj12 td/osd-backfill-space/datafile 2020-09-08T16:08:39.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:39.481 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:39.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:39.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj13 td/osd-backfill-space/datafile 2020-09-08T16:08:39.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:39.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj13 td/osd-backfill-space/datafile 2020-09-08T16:08:39.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:39.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj13 td/osd-backfill-space/datafile 2020-09-08T16:08:39.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:39.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj13 td/osd-backfill-space/datafile 2020-09-08T16:08:39.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:39.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj13 td/osd-backfill-space/datafile 2020-09-08T16:08:39.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:39.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj13 td/osd-backfill-space/datafile 2020-09-08T16:08:40.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:40.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj13 td/osd-backfill-space/datafile 2020-09-08T16:08:40.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:40.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj13 td/osd-backfill-space/datafile 2020-09-08T16:08:40.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:40.174 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:40.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:40.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj14 td/osd-backfill-space/datafile 2020-09-08T16:08:40.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:40.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj14 td/osd-backfill-space/datafile 2020-09-08T16:08:40.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:40.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj14 td/osd-backfill-space/datafile 2020-09-08T16:08:40.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:40.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj14 td/osd-backfill-space/datafile 2020-09-08T16:08:40.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:40.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj14 td/osd-backfill-space/datafile 2020-09-08T16:08:40.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:40.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj14 td/osd-backfill-space/datafile 2020-09-08T16:08:40.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:40.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj14 td/osd-backfill-space/datafile 2020-09-08T16:08:40.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:40.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj14 td/osd-backfill-space/datafile 2020-09-08T16:08:40.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:40.860 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:40.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:40.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj15 td/osd-backfill-space/datafile 2020-09-08T16:08:40.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:40.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj15 td/osd-backfill-space/datafile 2020-09-08T16:08:41.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:41.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj15 td/osd-backfill-space/datafile 2020-09-08T16:08:41.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:41.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj15 td/osd-backfill-space/datafile 2020-09-08T16:08:41.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:41.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj15 td/osd-backfill-space/datafile 2020-09-08T16:08:41.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:41.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj15 td/osd-backfill-space/datafile 2020-09-08T16:08:41.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:41.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj15 td/osd-backfill-space/datafile 2020-09-08T16:08:41.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:41.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj15 td/osd-backfill-space/datafile 2020-09-08T16:08:41.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:41.472 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:41.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:41.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj16 td/osd-backfill-space/datafile 2020-09-08T16:08:41.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:41.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj16 td/osd-backfill-space/datafile 2020-09-08T16:08:41.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:41.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj16 td/osd-backfill-space/datafile 2020-09-08T16:08:41.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:41.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj16 td/osd-backfill-space/datafile 2020-09-08T16:08:41.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:41.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj16 td/osd-backfill-space/datafile 2020-09-08T16:08:41.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:41.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj16 td/osd-backfill-space/datafile 2020-09-08T16:08:41.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:41.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj16 td/osd-backfill-space/datafile 2020-09-08T16:08:42.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:42.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj16 td/osd-backfill-space/datafile 2020-09-08T16:08:42.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:42.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:42.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:42.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj17 td/osd-backfill-space/datafile 2020-09-08T16:08:42.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:42.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj17 td/osd-backfill-space/datafile 2020-09-08T16:08:42.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:42.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj17 td/osd-backfill-space/datafile 2020-09-08T16:08:42.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:42.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj17 td/osd-backfill-space/datafile 2020-09-08T16:08:42.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:42.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj17 td/osd-backfill-space/datafile 2020-09-08T16:08:42.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:42.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj17 td/osd-backfill-space/datafile 2020-09-08T16:08:42.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:42.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj17 td/osd-backfill-space/datafile 2020-09-08T16:08:42.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:42.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj17 td/osd-backfill-space/datafile 2020-09-08T16:08:42.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:42.795 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:42.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:42.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj18 td/osd-backfill-space/datafile 2020-09-08T16:08:42.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:42.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj18 td/osd-backfill-space/datafile 2020-09-08T16:08:42.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:42.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj18 td/osd-backfill-space/datafile 2020-09-08T16:08:43.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:43.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj18 td/osd-backfill-space/datafile 2020-09-08T16:08:43.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:43.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj18 td/osd-backfill-space/datafile 2020-09-08T16:08:43.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:43.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj18 td/osd-backfill-space/datafile 2020-09-08T16:08:43.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:43.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj18 td/osd-backfill-space/datafile 2020-09-08T16:08:43.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:43.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj18 td/osd-backfill-space/datafile 2020-09-08T16:08:43.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:43.415 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:43.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:43.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj19 td/osd-backfill-space/datafile 2020-09-08T16:08:43.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:43.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj19 td/osd-backfill-space/datafile 2020-09-08T16:08:43.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:43.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj19 td/osd-backfill-space/datafile 2020-09-08T16:08:43.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:43.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj19 td/osd-backfill-space/datafile 2020-09-08T16:08:43.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:43.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj19 td/osd-backfill-space/datafile 2020-09-08T16:08:43.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:43.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj19 td/osd-backfill-space/datafile 2020-09-08T16:08:43.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:43.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj19 td/osd-backfill-space/datafile 2020-09-08T16:08:44.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:44.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj19 td/osd-backfill-space/datafile 2020-09-08T16:08:44.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:44.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:44.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:44.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj20 td/osd-backfill-space/datafile 2020-09-08T16:08:44.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:44.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj20 td/osd-backfill-space/datafile 2020-09-08T16:08:44.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:44.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj20 td/osd-backfill-space/datafile 2020-09-08T16:08:44.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:44.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj20 td/osd-backfill-space/datafile 2020-09-08T16:08:44.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:44.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj20 td/osd-backfill-space/datafile 2020-09-08T16:08:44.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:44.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj20 td/osd-backfill-space/datafile 2020-09-08T16:08:44.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:44.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj20 td/osd-backfill-space/datafile 2020-09-08T16:08:44.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:44.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj20 td/osd-backfill-space/datafile 2020-09-08T16:08:44.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:44.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:44.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:44.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj21 td/osd-backfill-space/datafile 2020-09-08T16:08:44.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:44.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj21 td/osd-backfill-space/datafile 2020-09-08T16:08:44.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:44.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj21 td/osd-backfill-space/datafile 2020-09-08T16:08:45.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:45.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj21 td/osd-backfill-space/datafile 2020-09-08T16:08:45.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:45.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj21 td/osd-backfill-space/datafile 2020-09-08T16:08:45.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:45.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj21 td/osd-backfill-space/datafile 2020-09-08T16:08:45.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:45.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj21 td/osd-backfill-space/datafile 2020-09-08T16:08:45.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:45.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj21 td/osd-backfill-space/datafile 2020-09-08T16:08:45.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:45.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:45.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:45.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj22 td/osd-backfill-space/datafile 2020-09-08T16:08:45.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:45.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj22 td/osd-backfill-space/datafile 2020-09-08T16:08:45.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:45.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj22 td/osd-backfill-space/datafile 2020-09-08T16:08:45.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:45.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj22 td/osd-backfill-space/datafile 2020-09-08T16:08:45.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:45.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj22 td/osd-backfill-space/datafile 2020-09-08T16:08:45.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:45.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj22 td/osd-backfill-space/datafile 2020-09-08T16:08:45.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:45.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj22 td/osd-backfill-space/datafile 2020-09-08T16:08:46.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:46.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj22 td/osd-backfill-space/datafile 2020-09-08T16:08:46.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:46.096 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:46.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:46.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj23 td/osd-backfill-space/datafile 2020-09-08T16:08:46.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:46.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj23 td/osd-backfill-space/datafile 2020-09-08T16:08:46.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:46.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj23 td/osd-backfill-space/datafile 2020-09-08T16:08:46.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:46.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj23 td/osd-backfill-space/datafile 2020-09-08T16:08:46.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:46.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj23 td/osd-backfill-space/datafile 2020-09-08T16:08:46.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:46.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj23 td/osd-backfill-space/datafile 2020-09-08T16:08:46.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:46.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj23 td/osd-backfill-space/datafile 2020-09-08T16:08:46.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:46.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj23 td/osd-backfill-space/datafile 2020-09-08T16:08:46.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:46.791 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:46.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:46.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj24 td/osd-backfill-space/datafile 2020-09-08T16:08:46.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:46.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj24 td/osd-backfill-space/datafile 2020-09-08T16:08:46.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:46.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj24 td/osd-backfill-space/datafile 2020-09-08T16:08:47.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:47.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj24 td/osd-backfill-space/datafile 2020-09-08T16:08:47.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:47.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj24 td/osd-backfill-space/datafile 2020-09-08T16:08:47.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:47.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj24 td/osd-backfill-space/datafile 2020-09-08T16:08:47.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:47.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj24 td/osd-backfill-space/datafile 2020-09-08T16:08:47.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:47.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj24 td/osd-backfill-space/datafile 2020-09-08T16:08:47.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:47.409 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:47.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:47.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj25 td/osd-backfill-space/datafile 2020-09-08T16:08:47.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:47.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj25 td/osd-backfill-space/datafile 2020-09-08T16:08:47.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:47.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj25 td/osd-backfill-space/datafile 2020-09-08T16:08:47.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:47.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj25 td/osd-backfill-space/datafile 2020-09-08T16:08:47.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:47.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj25 td/osd-backfill-space/datafile 2020-09-08T16:08:47.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:47.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj25 td/osd-backfill-space/datafile 2020-09-08T16:08:47.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:47.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj25 td/osd-backfill-space/datafile 2020-09-08T16:08:47.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:47.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj25 td/osd-backfill-space/datafile 2020-09-08T16:08:48.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:48.038 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:48.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:48.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj26 td/osd-backfill-space/datafile 2020-09-08T16:08:48.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:48.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj26 td/osd-backfill-space/datafile 2020-09-08T16:08:48.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:48.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj26 td/osd-backfill-space/datafile 2020-09-08T16:08:48.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:48.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj26 td/osd-backfill-space/datafile 2020-09-08T16:08:48.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:48.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj26 td/osd-backfill-space/datafile 2020-09-08T16:08:48.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:48.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj26 td/osd-backfill-space/datafile 2020-09-08T16:08:48.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:48.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj26 td/osd-backfill-space/datafile 2020-09-08T16:08:48.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:48.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj26 td/osd-backfill-space/datafile 2020-09-08T16:08:48.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:48.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:48.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:48.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj27 td/osd-backfill-space/datafile 2020-09-08T16:08:48.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:48.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj27 td/osd-backfill-space/datafile 2020-09-08T16:08:48.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:48.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj27 td/osd-backfill-space/datafile 2020-09-08T16:08:49.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:49.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj27 td/osd-backfill-space/datafile 2020-09-08T16:08:49.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:49.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj27 td/osd-backfill-space/datafile 2020-09-08T16:08:49.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:49.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj27 td/osd-backfill-space/datafile 2020-09-08T16:08:49.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:49.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj27 td/osd-backfill-space/datafile 2020-09-08T16:08:49.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:49.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj27 td/osd-backfill-space/datafile 2020-09-08T16:08:49.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:49.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:49.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:49.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj28 td/osd-backfill-space/datafile 2020-09-08T16:08:49.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:49.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj28 td/osd-backfill-space/datafile 2020-09-08T16:08:49.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:49.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj28 td/osd-backfill-space/datafile 2020-09-08T16:08:49.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:49.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj28 td/osd-backfill-space/datafile 2020-09-08T16:08:49.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:49.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj28 td/osd-backfill-space/datafile 2020-09-08T16:08:49.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:49.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj28 td/osd-backfill-space/datafile 2020-09-08T16:08:49.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:49.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj28 td/osd-backfill-space/datafile 2020-09-08T16:08:50.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:50.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj28 td/osd-backfill-space/datafile 2020-09-08T16:08:50.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:50.106 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:50.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:50.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj29 td/osd-backfill-space/datafile 2020-09-08T16:08:50.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:50.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj29 td/osd-backfill-space/datafile 2020-09-08T16:08:50.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:50.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj29 td/osd-backfill-space/datafile 2020-09-08T16:08:50.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:50.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj29 td/osd-backfill-space/datafile 2020-09-08T16:08:50.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:50.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj29 td/osd-backfill-space/datafile 2020-09-08T16:08:50.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:50.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj29 td/osd-backfill-space/datafile 2020-09-08T16:08:50.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:50.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj29 td/osd-backfill-space/datafile 2020-09-08T16:08:51.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:51.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj29 td/osd-backfill-space/datafile 2020-09-08T16:08:51.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:51.111 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:51.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:51.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj30 td/osd-backfill-space/datafile 2020-09-08T16:08:51.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:51.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj30 td/osd-backfill-space/datafile 2020-09-08T16:08:51.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:51.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj30 td/osd-backfill-space/datafile 2020-09-08T16:08:51.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:51.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj30 td/osd-backfill-space/datafile 2020-09-08T16:08:51.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:51.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj30 td/osd-backfill-space/datafile 2020-09-08T16:08:51.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:51.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj30 td/osd-backfill-space/datafile 2020-09-08T16:08:51.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:51.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj30 td/osd-backfill-space/datafile 2020-09-08T16:08:51.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:51.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj30 td/osd-backfill-space/datafile 2020-09-08T16:08:51.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:51.739 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:51.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:51.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj31 td/osd-backfill-space/datafile 2020-09-08T16:08:51.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:51.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj31 td/osd-backfill-space/datafile 2020-09-08T16:08:51.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:51.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj31 td/osd-backfill-space/datafile 2020-09-08T16:08:51.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:51.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj31 td/osd-backfill-space/datafile 2020-09-08T16:08:52.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:52.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj31 td/osd-backfill-space/datafile 2020-09-08T16:08:52.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:52.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj31 td/osd-backfill-space/datafile 2020-09-08T16:08:52.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:52.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj31 td/osd-backfill-space/datafile 2020-09-08T16:08:52.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:52.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj31 td/osd-backfill-space/datafile 2020-09-08T16:08:52.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:52.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:52.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:52.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj32 td/osd-backfill-space/datafile 2020-09-08T16:08:52.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:52.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj32 td/osd-backfill-space/datafile 2020-09-08T16:08:52.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:52.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj32 td/osd-backfill-space/datafile 2020-09-08T16:08:52.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:52.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj32 td/osd-backfill-space/datafile 2020-09-08T16:08:52.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:52.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj32 td/osd-backfill-space/datafile 2020-09-08T16:08:52.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:52.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj32 td/osd-backfill-space/datafile 2020-09-08T16:08:52.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:52.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj32 td/osd-backfill-space/datafile 2020-09-08T16:08:52.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:52.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj32 td/osd-backfill-space/datafile 2020-09-08T16:08:53.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:53.013 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:53.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:53.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj33 td/osd-backfill-space/datafile 2020-09-08T16:08:53.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:53.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj33 td/osd-backfill-space/datafile 2020-09-08T16:08:53.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:53.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj33 td/osd-backfill-space/datafile 2020-09-08T16:08:53.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:53.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj33 td/osd-backfill-space/datafile 2020-09-08T16:08:53.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:53.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj33 td/osd-backfill-space/datafile 2020-09-08T16:08:53.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:53.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj33 td/osd-backfill-space/datafile 2020-09-08T16:08:53.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:53.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj33 td/osd-backfill-space/datafile 2020-09-08T16:08:53.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:53.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj33 td/osd-backfill-space/datafile 2020-09-08T16:08:53.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:53.632 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:53.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:53.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj34 td/osd-backfill-space/datafile 2020-09-08T16:08:53.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:53.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj34 td/osd-backfill-space/datafile 2020-09-08T16:08:53.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:53.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj34 td/osd-backfill-space/datafile 2020-09-08T16:08:53.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:53.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj34 td/osd-backfill-space/datafile 2020-09-08T16:08:53.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:53.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj34 td/osd-backfill-space/datafile 2020-09-08T16:08:54.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:54.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj34 td/osd-backfill-space/datafile 2020-09-08T16:08:54.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:54.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj34 td/osd-backfill-space/datafile 2020-09-08T16:08:54.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:54.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj34 td/osd-backfill-space/datafile 2020-09-08T16:08:54.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:54.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:54.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:54.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj35 td/osd-backfill-space/datafile 2020-09-08T16:08:54.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:54.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj35 td/osd-backfill-space/datafile 2020-09-08T16:08:54.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:54.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj35 td/osd-backfill-space/datafile 2020-09-08T16:08:54.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:54.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj35 td/osd-backfill-space/datafile 2020-09-08T16:08:54.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:54.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj35 td/osd-backfill-space/datafile 2020-09-08T16:08:54.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:54.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj35 td/osd-backfill-space/datafile 2020-09-08T16:08:54.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:54.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj35 td/osd-backfill-space/datafile 2020-09-08T16:08:54.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:54.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj35 td/osd-backfill-space/datafile 2020-09-08T16:08:55.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:55.031 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:55.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:55.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj36 td/osd-backfill-space/datafile 2020-09-08T16:08:55.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:55.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj36 td/osd-backfill-space/datafile 2020-09-08T16:08:55.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:55.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj36 td/osd-backfill-space/datafile 2020-09-08T16:08:55.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:55.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj36 td/osd-backfill-space/datafile 2020-09-08T16:08:55.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:55.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj36 td/osd-backfill-space/datafile 2020-09-08T16:08:55.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:55.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj36 td/osd-backfill-space/datafile 2020-09-08T16:08:55.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:55.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj36 td/osd-backfill-space/datafile 2020-09-08T16:08:55.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:55.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj36 td/osd-backfill-space/datafile 2020-09-08T16:08:55.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:55.633 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:55.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:55.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj37 td/osd-backfill-space/datafile 2020-09-08T16:08:55.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:55.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj37 td/osd-backfill-space/datafile 2020-09-08T16:08:55.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:55.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj37 td/osd-backfill-space/datafile 2020-09-08T16:08:55.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:55.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj37 td/osd-backfill-space/datafile 2020-09-08T16:08:55.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:55.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj37 td/osd-backfill-space/datafile 2020-09-08T16:08:56.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:56.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj37 td/osd-backfill-space/datafile 2020-09-08T16:08:56.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:56.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj37 td/osd-backfill-space/datafile 2020-09-08T16:08:56.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:56.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj37 td/osd-backfill-space/datafile 2020-09-08T16:08:56.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:56.278 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:56.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:56.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj38 td/osd-backfill-space/datafile 2020-09-08T16:08:56.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:56.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj38 td/osd-backfill-space/datafile 2020-09-08T16:08:56.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:56.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj38 td/osd-backfill-space/datafile 2020-09-08T16:08:56.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:56.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj38 td/osd-backfill-space/datafile 2020-09-08T16:08:56.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:56.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj38 td/osd-backfill-space/datafile 2020-09-08T16:08:56.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:56.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj38 td/osd-backfill-space/datafile 2020-09-08T16:08:56.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:56.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj38 td/osd-backfill-space/datafile 2020-09-08T16:08:56.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:56.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj38 td/osd-backfill-space/datafile 2020-09-08T16:08:56.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:56.939 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:56.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:56.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj39 td/osd-backfill-space/datafile 2020-09-08T16:08:57.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:57.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj39 td/osd-backfill-space/datafile 2020-09-08T16:08:57.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:57.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj39 td/osd-backfill-space/datafile 2020-09-08T16:08:57.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:57.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj39 td/osd-backfill-space/datafile 2020-09-08T16:08:57.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:57.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj39 td/osd-backfill-space/datafile 2020-09-08T16:08:57.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:57.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj39 td/osd-backfill-space/datafile 2020-09-08T16:08:57.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:57.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj39 td/osd-backfill-space/datafile 2020-09-08T16:08:57.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:57.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj39 td/osd-backfill-space/datafile 2020-09-08T16:08:57.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:57.551 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:57.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:57.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj40 td/osd-backfill-space/datafile 2020-09-08T16:08:57.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:57.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj40 td/osd-backfill-space/datafile 2020-09-08T16:08:57.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:57.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj40 td/osd-backfill-space/datafile 2020-09-08T16:08:57.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:57.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj40 td/osd-backfill-space/datafile 2020-09-08T16:08:57.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:57.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj40 td/osd-backfill-space/datafile 2020-09-08T16:08:57.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:57.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj40 td/osd-backfill-space/datafile 2020-09-08T16:08:58.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:58.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj40 td/osd-backfill-space/datafile 2020-09-08T16:08:58.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:58.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj40 td/osd-backfill-space/datafile 2020-09-08T16:08:58.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:58.180 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:58.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:58.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj41 td/osd-backfill-space/datafile 2020-09-08T16:08:58.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:58.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj41 td/osd-backfill-space/datafile 2020-09-08T16:08:58.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:58.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj41 td/osd-backfill-space/datafile 2020-09-08T16:08:58.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:58.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj41 td/osd-backfill-space/datafile 2020-09-08T16:08:58.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:58.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj41 td/osd-backfill-space/datafile 2020-09-08T16:08:58.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:58.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj41 td/osd-backfill-space/datafile 2020-09-08T16:08:58.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:58.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj41 td/osd-backfill-space/datafile 2020-09-08T16:08:58.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:58.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj41 td/osd-backfill-space/datafile 2020-09-08T16:08:58.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:58.850 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:58.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:58.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj42 td/osd-backfill-space/datafile 2020-09-08T16:08:58.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:58.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj42 td/osd-backfill-space/datafile 2020-09-08T16:08:59.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:59.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj42 td/osd-backfill-space/datafile 2020-09-08T16:08:59.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:59.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj42 td/osd-backfill-space/datafile 2020-09-08T16:08:59.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:59.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj42 td/osd-backfill-space/datafile 2020-09-08T16:08:59.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:59.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj42 td/osd-backfill-space/datafile 2020-09-08T16:08:59.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:59.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj42 td/osd-backfill-space/datafile 2020-09-08T16:08:59.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:59.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj42 td/osd-backfill-space/datafile 2020-09-08T16:08:59.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:08:59.569 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:08:59.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:59.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj43 td/osd-backfill-space/datafile 2020-09-08T16:08:59.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:59.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj43 td/osd-backfill-space/datafile 2020-09-08T16:08:59.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:59.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj43 td/osd-backfill-space/datafile 2020-09-08T16:08:59.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:59.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj43 td/osd-backfill-space/datafile 2020-09-08T16:08:59.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:59.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj43 td/osd-backfill-space/datafile 2020-09-08T16:08:59.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:08:59.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj43 td/osd-backfill-space/datafile 2020-09-08T16:09:00.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:00.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj43 td/osd-backfill-space/datafile 2020-09-08T16:09:00.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:00.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj43 td/osd-backfill-space/datafile 2020-09-08T16:09:00.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:00.206 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:00.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:00.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj44 td/osd-backfill-space/datafile 2020-09-08T16:09:00.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:00.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj44 td/osd-backfill-space/datafile 2020-09-08T16:09:00.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:00.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj44 td/osd-backfill-space/datafile 2020-09-08T16:09:00.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:00.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj44 td/osd-backfill-space/datafile 2020-09-08T16:09:00.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:00.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj44 td/osd-backfill-space/datafile 2020-09-08T16:09:00.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:00.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj44 td/osd-backfill-space/datafile 2020-09-08T16:09:00.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:00.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj44 td/osd-backfill-space/datafile 2020-09-08T16:09:00.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:00.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj44 td/osd-backfill-space/datafile 2020-09-08T16:09:00.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:00.893 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:00.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:00.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj45 td/osd-backfill-space/datafile 2020-09-08T16:09:00.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:00.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj45 td/osd-backfill-space/datafile 2020-09-08T16:09:01.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:01.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj45 td/osd-backfill-space/datafile 2020-09-08T16:09:01.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:01.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj45 td/osd-backfill-space/datafile 2020-09-08T16:09:01.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:01.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj45 td/osd-backfill-space/datafile 2020-09-08T16:09:01.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:01.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj45 td/osd-backfill-space/datafile 2020-09-08T16:09:01.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:01.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj45 td/osd-backfill-space/datafile 2020-09-08T16:09:01.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:01.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj45 td/osd-backfill-space/datafile 2020-09-08T16:09:01.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:01.505 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:01.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:01.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj46 td/osd-backfill-space/datafile 2020-09-08T16:09:01.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:01.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj46 td/osd-backfill-space/datafile 2020-09-08T16:09:01.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:01.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj46 td/osd-backfill-space/datafile 2020-09-08T16:09:01.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:01.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj46 td/osd-backfill-space/datafile 2020-09-08T16:09:01.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:01.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj46 td/osd-backfill-space/datafile 2020-09-08T16:09:01.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:01.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj46 td/osd-backfill-space/datafile 2020-09-08T16:09:01.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:01.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj46 td/osd-backfill-space/datafile 2020-09-08T16:09:02.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:02.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj46 td/osd-backfill-space/datafile 2020-09-08T16:09:02.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:02.149 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:02.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:02.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj47 td/osd-backfill-space/datafile 2020-09-08T16:09:02.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:02.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj47 td/osd-backfill-space/datafile 2020-09-08T16:09:02.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:02.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj47 td/osd-backfill-space/datafile 2020-09-08T16:09:02.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:02.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj47 td/osd-backfill-space/datafile 2020-09-08T16:09:02.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:02.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj47 td/osd-backfill-space/datafile 2020-09-08T16:09:02.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:02.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj47 td/osd-backfill-space/datafile 2020-09-08T16:09:02.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:02.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj47 td/osd-backfill-space/datafile 2020-09-08T16:09:02.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:02.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj47 td/osd-backfill-space/datafile 2020-09-08T16:09:02.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:02.811 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:02.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:02.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj48 td/osd-backfill-space/datafile 2020-09-08T16:09:02.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:02.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj48 td/osd-backfill-space/datafile 2020-09-08T16:09:02.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:02.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj48 td/osd-backfill-space/datafile 2020-09-08T16:09:03.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:03.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj48 td/osd-backfill-space/datafile 2020-09-08T16:09:03.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:03.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj48 td/osd-backfill-space/datafile 2020-09-08T16:09:03.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:03.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj48 td/osd-backfill-space/datafile 2020-09-08T16:09:03.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:03.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj48 td/osd-backfill-space/datafile 2020-09-08T16:09:03.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:03.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj48 td/osd-backfill-space/datafile 2020-09-08T16:09:03.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:03.440 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:03.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:03.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj49 td/osd-backfill-space/datafile 2020-09-08T16:09:03.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:03.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj49 td/osd-backfill-space/datafile 2020-09-08T16:09:03.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:03.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj49 td/osd-backfill-space/datafile 2020-09-08T16:09:03.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:03.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj49 td/osd-backfill-space/datafile 2020-09-08T16:09:03.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:03.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj49 td/osd-backfill-space/datafile 2020-09-08T16:09:03.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:03.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj49 td/osd-backfill-space/datafile 2020-09-08T16:09:03.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:03.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj49 td/osd-backfill-space/datafile 2020-09-08T16:09:03.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:03.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj49 td/osd-backfill-space/datafile 2020-09-08T16:09:04.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:04.067 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:04.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:04.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj50 td/osd-backfill-space/datafile 2020-09-08T16:09:04.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:04.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj50 td/osd-backfill-space/datafile 2020-09-08T16:09:04.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:04.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj50 td/osd-backfill-space/datafile 2020-09-08T16:09:04.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:04.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj50 td/osd-backfill-space/datafile 2020-09-08T16:09:04.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:04.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj50 td/osd-backfill-space/datafile 2020-09-08T16:09:04.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:04.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj50 td/osd-backfill-space/datafile 2020-09-08T16:09:04.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:04.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj50 td/osd-backfill-space/datafile 2020-09-08T16:09:04.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:04.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj50 td/osd-backfill-space/datafile 2020-09-08T16:09:04.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:04.805 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:04.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:04.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj51 td/osd-backfill-space/datafile 2020-09-08T16:09:04.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:04.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj51 td/osd-backfill-space/datafile 2020-09-08T16:09:04.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:04.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj51 td/osd-backfill-space/datafile 2020-09-08T16:09:05.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:05.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj51 td/osd-backfill-space/datafile 2020-09-08T16:09:05.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:05.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj51 td/osd-backfill-space/datafile 2020-09-08T16:09:05.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:05.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj51 td/osd-backfill-space/datafile 2020-09-08T16:09:05.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:05.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj51 td/osd-backfill-space/datafile 2020-09-08T16:09:05.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:05.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj51 td/osd-backfill-space/datafile 2020-09-08T16:09:05.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:05.408 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:05.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:05.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj52 td/osd-backfill-space/datafile 2020-09-08T16:09:05.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:05.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj52 td/osd-backfill-space/datafile 2020-09-08T16:09:05.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:05.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj52 td/osd-backfill-space/datafile 2020-09-08T16:09:05.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:05.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj52 td/osd-backfill-space/datafile 2020-09-08T16:09:05.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:05.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj52 td/osd-backfill-space/datafile 2020-09-08T16:09:05.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:05.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj52 td/osd-backfill-space/datafile 2020-09-08T16:09:05.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:05.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj52 td/osd-backfill-space/datafile 2020-09-08T16:09:05.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:05.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj52 td/osd-backfill-space/datafile 2020-09-08T16:09:06.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:06.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:06.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:06.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj53 td/osd-backfill-space/datafile 2020-09-08T16:09:06.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:06.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj53 td/osd-backfill-space/datafile 2020-09-08T16:09:06.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:06.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj53 td/osd-backfill-space/datafile 2020-09-08T16:09:06.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:06.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj53 td/osd-backfill-space/datafile 2020-09-08T16:09:06.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:06.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj53 td/osd-backfill-space/datafile 2020-09-08T16:09:06.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:06.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj53 td/osd-backfill-space/datafile 2020-09-08T16:09:06.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:06.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj53 td/osd-backfill-space/datafile 2020-09-08T16:09:06.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:06.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj53 td/osd-backfill-space/datafile 2020-09-08T16:09:06.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:06.706 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:06.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:06.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj54 td/osd-backfill-space/datafile 2020-09-08T16:09:06.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:06.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj54 td/osd-backfill-space/datafile 2020-09-08T16:09:06.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:06.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj54 td/osd-backfill-space/datafile 2020-09-08T16:09:06.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:06.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj54 td/osd-backfill-space/datafile 2020-09-08T16:09:07.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:07.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj54 td/osd-backfill-space/datafile 2020-09-08T16:09:07.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:07.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj54 td/osd-backfill-space/datafile 2020-09-08T16:09:07.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:07.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj54 td/osd-backfill-space/datafile 2020-09-08T16:09:07.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:07.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj54 td/osd-backfill-space/datafile 2020-09-08T16:09:07.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:07.325 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:07.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:07.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj55 td/osd-backfill-space/datafile 2020-09-08T16:09:07.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:07.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj55 td/osd-backfill-space/datafile 2020-09-08T16:09:07.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:07.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj55 td/osd-backfill-space/datafile 2020-09-08T16:09:07.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:07.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj55 td/osd-backfill-space/datafile 2020-09-08T16:09:07.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:07.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj55 td/osd-backfill-space/datafile 2020-09-08T16:09:07.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:07.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj55 td/osd-backfill-space/datafile 2020-09-08T16:09:07.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:07.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj55 td/osd-backfill-space/datafile 2020-09-08T16:09:07.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:07.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj55 td/osd-backfill-space/datafile 2020-09-08T16:09:07.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:07.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:07.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:07.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj56 td/osd-backfill-space/datafile 2020-09-08T16:09:08.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:08.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj56 td/osd-backfill-space/datafile 2020-09-08T16:09:08.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:08.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj56 td/osd-backfill-space/datafile 2020-09-08T16:09:08.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:08.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj56 td/osd-backfill-space/datafile 2020-09-08T16:09:08.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:08.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj56 td/osd-backfill-space/datafile 2020-09-08T16:09:08.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:08.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj56 td/osd-backfill-space/datafile 2020-09-08T16:09:08.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:08.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj56 td/osd-backfill-space/datafile 2020-09-08T16:09:08.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:08.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj56 td/osd-backfill-space/datafile 2020-09-08T16:09:08.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:08.623 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:08.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:08.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj57 td/osd-backfill-space/datafile 2020-09-08T16:09:08.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:08.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj57 td/osd-backfill-space/datafile 2020-09-08T16:09:08.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:08.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj57 td/osd-backfill-space/datafile 2020-09-08T16:09:08.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:08.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj57 td/osd-backfill-space/datafile 2020-09-08T16:09:08.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:08.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj57 td/osd-backfill-space/datafile 2020-09-08T16:09:09.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:09.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj57 td/osd-backfill-space/datafile 2020-09-08T16:09:09.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:09.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj57 td/osd-backfill-space/datafile 2020-09-08T16:09:09.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:09.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj57 td/osd-backfill-space/datafile 2020-09-08T16:09:09.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:09.260 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:09.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:09.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj58 td/osd-backfill-space/datafile 2020-09-08T16:09:09.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:09.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj58 td/osd-backfill-space/datafile 2020-09-08T16:09:09.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:09.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj58 td/osd-backfill-space/datafile 2020-09-08T16:09:09.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:09.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj58 td/osd-backfill-space/datafile 2020-09-08T16:09:09.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:09.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj58 td/osd-backfill-space/datafile 2020-09-08T16:09:10.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:10.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj58 td/osd-backfill-space/datafile 2020-09-08T16:09:10.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:10.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj58 td/osd-backfill-space/datafile 2020-09-08T16:09:10.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:10.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj58 td/osd-backfill-space/datafile 2020-09-08T16:09:10.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:10.297 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:10.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:10.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj59 td/osd-backfill-space/datafile 2020-09-08T16:09:10.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:10.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj59 td/osd-backfill-space/datafile 2020-09-08T16:09:10.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:10.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj59 td/osd-backfill-space/datafile 2020-09-08T16:09:10.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:10.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj59 td/osd-backfill-space/datafile 2020-09-08T16:09:10.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:10.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj59 td/osd-backfill-space/datafile 2020-09-08T16:09:10.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:10.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj59 td/osd-backfill-space/datafile 2020-09-08T16:09:10.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:10.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj59 td/osd-backfill-space/datafile 2020-09-08T16:09:10.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:10.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj59 td/osd-backfill-space/datafile 2020-09-08T16:09:10.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:10.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:10.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:10.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj60 td/osd-backfill-space/datafile 2020-09-08T16:09:11.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:11.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj60 td/osd-backfill-space/datafile 2020-09-08T16:09:11.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:11.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj60 td/osd-backfill-space/datafile 2020-09-08T16:09:11.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:11.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj60 td/osd-backfill-space/datafile 2020-09-08T16:09:11.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:11.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj60 td/osd-backfill-space/datafile 2020-09-08T16:09:11.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:11.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj60 td/osd-backfill-space/datafile 2020-09-08T16:09:11.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:11.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj60 td/osd-backfill-space/datafile 2020-09-08T16:09:11.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:11.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj60 td/osd-backfill-space/datafile 2020-09-08T16:09:11.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:11.545 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:11.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:11.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj61 td/osd-backfill-space/datafile 2020-09-08T16:09:11.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:11.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj61 td/osd-backfill-space/datafile 2020-09-08T16:09:11.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:11.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj61 td/osd-backfill-space/datafile 2020-09-08T16:09:11.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:11.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj61 td/osd-backfill-space/datafile 2020-09-08T16:09:11.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:11.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj61 td/osd-backfill-space/datafile 2020-09-08T16:09:11.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:11.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj61 td/osd-backfill-space/datafile 2020-09-08T16:09:12.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:12.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj61 td/osd-backfill-space/datafile 2020-09-08T16:09:12.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:12.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj61 td/osd-backfill-space/datafile 2020-09-08T16:09:12.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:12.198 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:12.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:12.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj62 td/osd-backfill-space/datafile 2020-09-08T16:09:12.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:12.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj62 td/osd-backfill-space/datafile 2020-09-08T16:09:12.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:12.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj62 td/osd-backfill-space/datafile 2020-09-08T16:09:12.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:12.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj62 td/osd-backfill-space/datafile 2020-09-08T16:09:12.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:12.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj62 td/osd-backfill-space/datafile 2020-09-08T16:09:12.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:12.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj62 td/osd-backfill-space/datafile 2020-09-08T16:09:12.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:12.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj62 td/osd-backfill-space/datafile 2020-09-08T16:09:12.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:12.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj62 td/osd-backfill-space/datafile 2020-09-08T16:09:12.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:12.869 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:12.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:12.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj63 td/osd-backfill-space/datafile 2020-09-08T16:09:12.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:12.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj63 td/osd-backfill-space/datafile 2020-09-08T16:09:13.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:13.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj63 td/osd-backfill-space/datafile 2020-09-08T16:09:13.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:13.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj63 td/osd-backfill-space/datafile 2020-09-08T16:09:13.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:13.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj63 td/osd-backfill-space/datafile 2020-09-08T16:09:13.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:13.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj63 td/osd-backfill-space/datafile 2020-09-08T16:09:13.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:13.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj63 td/osd-backfill-space/datafile 2020-09-08T16:09:13.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:13.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj63 td/osd-backfill-space/datafile 2020-09-08T16:09:13.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:13.471 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:13.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:13.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj64 td/osd-backfill-space/datafile 2020-09-08T16:09:13.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:13.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj64 td/osd-backfill-space/datafile 2020-09-08T16:09:13.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:13.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj64 td/osd-backfill-space/datafile 2020-09-08T16:09:13.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:13.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj64 td/osd-backfill-space/datafile 2020-09-08T16:09:13.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:13.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj64 td/osd-backfill-space/datafile 2020-09-08T16:09:13.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:13.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj64 td/osd-backfill-space/datafile 2020-09-08T16:09:13.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:13.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj64 td/osd-backfill-space/datafile 2020-09-08T16:09:14.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:14.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj64 td/osd-backfill-space/datafile 2020-09-08T16:09:14.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:14.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:14.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:14.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj65 td/osd-backfill-space/datafile 2020-09-08T16:09:14.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:14.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj65 td/osd-backfill-space/datafile 2020-09-08T16:09:14.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:14.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj65 td/osd-backfill-space/datafile 2020-09-08T16:09:14.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:14.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj65 td/osd-backfill-space/datafile 2020-09-08T16:09:14.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:14.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj65 td/osd-backfill-space/datafile 2020-09-08T16:09:14.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:14.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj65 td/osd-backfill-space/datafile 2020-09-08T16:09:14.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:14.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj65 td/osd-backfill-space/datafile 2020-09-08T16:09:14.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:14.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj65 td/osd-backfill-space/datafile 2020-09-08T16:09:14.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:14.805 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:14.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:14.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj66 td/osd-backfill-space/datafile 2020-09-08T16:09:14.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:14.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj66 td/osd-backfill-space/datafile 2020-09-08T16:09:15.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:15.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj66 td/osd-backfill-space/datafile 2020-09-08T16:09:15.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:15.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj66 td/osd-backfill-space/datafile 2020-09-08T16:09:15.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:15.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj66 td/osd-backfill-space/datafile 2020-09-08T16:09:15.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:15.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj66 td/osd-backfill-space/datafile 2020-09-08T16:09:15.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:15.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj66 td/osd-backfill-space/datafile 2020-09-08T16:09:15.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:15.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj66 td/osd-backfill-space/datafile 2020-09-08T16:09:15.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:15.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:15.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:15.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj67 td/osd-backfill-space/datafile 2020-09-08T16:09:15.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:15.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj67 td/osd-backfill-space/datafile 2020-09-08T16:09:15.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:15.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj67 td/osd-backfill-space/datafile 2020-09-08T16:09:15.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:15.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj67 td/osd-backfill-space/datafile 2020-09-08T16:09:15.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:15.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj67 td/osd-backfill-space/datafile 2020-09-08T16:09:15.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:15.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj67 td/osd-backfill-space/datafile 2020-09-08T16:09:16.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:16.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj67 td/osd-backfill-space/datafile 2020-09-08T16:09:16.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:16.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj67 td/osd-backfill-space/datafile 2020-09-08T16:09:16.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:16.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:16.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:16.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj68 td/osd-backfill-space/datafile 2020-09-08T16:09:16.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:16.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj68 td/osd-backfill-space/datafile 2020-09-08T16:09:16.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:16.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj68 td/osd-backfill-space/datafile 2020-09-08T16:09:16.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:16.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj68 td/osd-backfill-space/datafile 2020-09-08T16:09:16.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:16.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj68 td/osd-backfill-space/datafile 2020-09-08T16:09:16.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:16.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj68 td/osd-backfill-space/datafile 2020-09-08T16:09:16.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:16.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj68 td/osd-backfill-space/datafile 2020-09-08T16:09:16.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:16.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj68 td/osd-backfill-space/datafile 2020-09-08T16:09:16.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:16.888 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:16.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:16.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj69 td/osd-backfill-space/datafile 2020-09-08T16:09:16.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:16.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj69 td/osd-backfill-space/datafile 2020-09-08T16:09:17.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:17.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj69 td/osd-backfill-space/datafile 2020-09-08T16:09:17.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:17.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj69 td/osd-backfill-space/datafile 2020-09-08T16:09:17.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:17.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj69 td/osd-backfill-space/datafile 2020-09-08T16:09:17.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:17.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj69 td/osd-backfill-space/datafile 2020-09-08T16:09:17.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:17.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj69 td/osd-backfill-space/datafile 2020-09-08T16:09:17.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:17.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj69 td/osd-backfill-space/datafile 2020-09-08T16:09:17.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:17.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:17.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:17.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj70 td/osd-backfill-space/datafile 2020-09-08T16:09:17.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:17.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj70 td/osd-backfill-space/datafile 2020-09-08T16:09:17.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:17.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj70 td/osd-backfill-space/datafile 2020-09-08T16:09:17.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:17.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj70 td/osd-backfill-space/datafile 2020-09-08T16:09:17.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:17.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj70 td/osd-backfill-space/datafile 2020-09-08T16:09:17.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:17.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj70 td/osd-backfill-space/datafile 2020-09-08T16:09:17.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:17.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj70 td/osd-backfill-space/datafile 2020-09-08T16:09:18.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:18.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj70 td/osd-backfill-space/datafile 2020-09-08T16:09:18.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:18.127 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:18.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:18.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj71 td/osd-backfill-space/datafile 2020-09-08T16:09:18.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:18.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj71 td/osd-backfill-space/datafile 2020-09-08T16:09:18.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:18.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj71 td/osd-backfill-space/datafile 2020-09-08T16:09:18.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:18.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj71 td/osd-backfill-space/datafile 2020-09-08T16:09:18.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:18.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj71 td/osd-backfill-space/datafile 2020-09-08T16:09:18.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:18.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj71 td/osd-backfill-space/datafile 2020-09-08T16:09:18.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:18.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj71 td/osd-backfill-space/datafile 2020-09-08T16:09:18.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:18.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj71 td/osd-backfill-space/datafile 2020-09-08T16:09:18.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:18.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:18.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:18.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj72 td/osd-backfill-space/datafile 2020-09-08T16:09:18.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:18.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj72 td/osd-backfill-space/datafile 2020-09-08T16:09:18.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:18.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj72 td/osd-backfill-space/datafile 2020-09-08T16:09:19.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:19.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj72 td/osd-backfill-space/datafile 2020-09-08T16:09:19.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:19.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj72 td/osd-backfill-space/datafile 2020-09-08T16:09:19.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:19.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj72 td/osd-backfill-space/datafile 2020-09-08T16:09:19.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:19.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj72 td/osd-backfill-space/datafile 2020-09-08T16:09:19.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:19.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj72 td/osd-backfill-space/datafile 2020-09-08T16:09:19.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:19.411 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:19.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:19.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj73 td/osd-backfill-space/datafile 2020-09-08T16:09:19.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:19.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj73 td/osd-backfill-space/datafile 2020-09-08T16:09:19.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:19.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj73 td/osd-backfill-space/datafile 2020-09-08T16:09:19.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:19.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj73 td/osd-backfill-space/datafile 2020-09-08T16:09:19.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:19.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj73 td/osd-backfill-space/datafile 2020-09-08T16:09:19.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:19.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj73 td/osd-backfill-space/datafile 2020-09-08T16:09:19.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:19.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj73 td/osd-backfill-space/datafile 2020-09-08T16:09:20.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:20.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj73 td/osd-backfill-space/datafile 2020-09-08T16:09:20.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:20.089 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:20.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:20.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj74 td/osd-backfill-space/datafile 2020-09-08T16:09:20.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:20.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj74 td/osd-backfill-space/datafile 2020-09-08T16:09:20.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:20.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj74 td/osd-backfill-space/datafile 2020-09-08T16:09:20.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:20.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj74 td/osd-backfill-space/datafile 2020-09-08T16:09:20.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:20.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj74 td/osd-backfill-space/datafile 2020-09-08T16:09:20.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:20.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj74 td/osd-backfill-space/datafile 2020-09-08T16:09:20.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:20.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj74 td/osd-backfill-space/datafile 2020-09-08T16:09:20.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:20.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj74 td/osd-backfill-space/datafile 2020-09-08T16:09:20.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:20.835 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:20.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:20.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj75 td/osd-backfill-space/datafile 2020-09-08T16:09:20.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:20.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj75 td/osd-backfill-space/datafile 2020-09-08T16:09:20.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:20.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj75 td/osd-backfill-space/datafile 2020-09-08T16:09:21.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:21.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj75 td/osd-backfill-space/datafile 2020-09-08T16:09:21.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:21.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj75 td/osd-backfill-space/datafile 2020-09-08T16:09:21.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:21.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj75 td/osd-backfill-space/datafile 2020-09-08T16:09:21.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:21.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj75 td/osd-backfill-space/datafile 2020-09-08T16:09:21.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:21.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj75 td/osd-backfill-space/datafile 2020-09-08T16:09:21.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:21.471 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:21.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:21.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj76 td/osd-backfill-space/datafile 2020-09-08T16:09:21.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:21.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj76 td/osd-backfill-space/datafile 2020-09-08T16:09:21.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:21.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj76 td/osd-backfill-space/datafile 2020-09-08T16:09:21.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:21.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj76 td/osd-backfill-space/datafile 2020-09-08T16:09:21.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:21.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj76 td/osd-backfill-space/datafile 2020-09-08T16:09:21.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:21.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj76 td/osd-backfill-space/datafile 2020-09-08T16:09:21.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:21.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj76 td/osd-backfill-space/datafile 2020-09-08T16:09:22.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:22.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj76 td/osd-backfill-space/datafile 2020-09-08T16:09:22.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:22.124 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:22.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:22.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj77 td/osd-backfill-space/datafile 2020-09-08T16:09:22.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:22.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj77 td/osd-backfill-space/datafile 2020-09-08T16:09:22.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:22.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj77 td/osd-backfill-space/datafile 2020-09-08T16:09:22.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:22.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj77 td/osd-backfill-space/datafile 2020-09-08T16:09:22.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:22.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj77 td/osd-backfill-space/datafile 2020-09-08T16:09:22.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:22.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj77 td/osd-backfill-space/datafile 2020-09-08T16:09:22.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:22.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj77 td/osd-backfill-space/datafile 2020-09-08T16:09:22.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:22.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj77 td/osd-backfill-space/datafile 2020-09-08T16:09:22.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:22.803 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:22.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:22.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj78 td/osd-backfill-space/datafile 2020-09-08T16:09:22.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:22.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj78 td/osd-backfill-space/datafile 2020-09-08T16:09:22.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:22.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj78 td/osd-backfill-space/datafile 2020-09-08T16:09:23.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:23.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj78 td/osd-backfill-space/datafile 2020-09-08T16:09:23.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:23.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj78 td/osd-backfill-space/datafile 2020-09-08T16:09:23.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:23.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj78 td/osd-backfill-space/datafile 2020-09-08T16:09:23.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:23.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj78 td/osd-backfill-space/datafile 2020-09-08T16:09:23.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:23.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj78 td/osd-backfill-space/datafile 2020-09-08T16:09:23.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:23.432 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:23.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:23.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj79 td/osd-backfill-space/datafile 2020-09-08T16:09:23.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:23.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj79 td/osd-backfill-space/datafile 2020-09-08T16:09:23.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:23.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj79 td/osd-backfill-space/datafile 2020-09-08T16:09:23.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:23.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj79 td/osd-backfill-space/datafile 2020-09-08T16:09:23.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:23.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj79 td/osd-backfill-space/datafile 2020-09-08T16:09:23.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:23.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj79 td/osd-backfill-space/datafile 2020-09-08T16:09:23.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:23.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj79 td/osd-backfill-space/datafile 2020-09-08T16:09:24.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:24.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj79 td/osd-backfill-space/datafile 2020-09-08T16:09:24.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:24.077 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:24.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:24.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj80 td/osd-backfill-space/datafile 2020-09-08T16:09:24.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:24.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj80 td/osd-backfill-space/datafile 2020-09-08T16:09:24.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:24.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj80 td/osd-backfill-space/datafile 2020-09-08T16:09:24.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:24.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj80 td/osd-backfill-space/datafile 2020-09-08T16:09:24.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:24.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj80 td/osd-backfill-space/datafile 2020-09-08T16:09:24.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:24.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj80 td/osd-backfill-space/datafile 2020-09-08T16:09:24.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:24.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj80 td/osd-backfill-space/datafile 2020-09-08T16:09:24.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:24.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj80 td/osd-backfill-space/datafile 2020-09-08T16:09:24.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:24.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:24.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:24.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj81 td/osd-backfill-space/datafile 2020-09-08T16:09:24.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:24.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj81 td/osd-backfill-space/datafile 2020-09-08T16:09:24.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:24.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj81 td/osd-backfill-space/datafile 2020-09-08T16:09:25.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:25.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj81 td/osd-backfill-space/datafile 2020-09-08T16:09:25.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:25.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj81 td/osd-backfill-space/datafile 2020-09-08T16:09:25.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:25.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj81 td/osd-backfill-space/datafile 2020-09-08T16:09:25.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:25.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj81 td/osd-backfill-space/datafile 2020-09-08T16:09:25.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:25.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj81 td/osd-backfill-space/datafile 2020-09-08T16:09:25.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:25.425 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:25.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:25.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj82 td/osd-backfill-space/datafile 2020-09-08T16:09:25.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:25.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj82 td/osd-backfill-space/datafile 2020-09-08T16:09:25.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:25.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj82 td/osd-backfill-space/datafile 2020-09-08T16:09:25.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:25.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj82 td/osd-backfill-space/datafile 2020-09-08T16:09:25.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:25.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj82 td/osd-backfill-space/datafile 2020-09-08T16:09:25.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:25.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj82 td/osd-backfill-space/datafile 2020-09-08T16:09:25.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:25.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj82 td/osd-backfill-space/datafile 2020-09-08T16:09:25.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:25.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj82 td/osd-backfill-space/datafile 2020-09-08T16:09:26.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:26.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:26.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:26.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj83 td/osd-backfill-space/datafile 2020-09-08T16:09:26.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:26.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj83 td/osd-backfill-space/datafile 2020-09-08T16:09:26.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:26.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj83 td/osd-backfill-space/datafile 2020-09-08T16:09:26.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:26.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj83 td/osd-backfill-space/datafile 2020-09-08T16:09:26.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:26.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj83 td/osd-backfill-space/datafile 2020-09-08T16:09:26.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:26.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj83 td/osd-backfill-space/datafile 2020-09-08T16:09:26.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:26.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj83 td/osd-backfill-space/datafile 2020-09-08T16:09:26.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:26.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj83 td/osd-backfill-space/datafile 2020-09-08T16:09:26.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:26.707 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:26.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:26.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj84 td/osd-backfill-space/datafile 2020-09-08T16:09:26.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:26.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj84 td/osd-backfill-space/datafile 2020-09-08T16:09:26.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:26.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj84 td/osd-backfill-space/datafile 2020-09-08T16:09:26.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:26.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj84 td/osd-backfill-space/datafile 2020-09-08T16:09:27.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:27.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj84 td/osd-backfill-space/datafile 2020-09-08T16:09:27.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:27.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj84 td/osd-backfill-space/datafile 2020-09-08T16:09:27.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:27.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj84 td/osd-backfill-space/datafile 2020-09-08T16:09:27.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:27.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj84 td/osd-backfill-space/datafile 2020-09-08T16:09:27.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:27.343 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:27.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:27.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj85 td/osd-backfill-space/datafile 2020-09-08T16:09:27.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:27.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj85 td/osd-backfill-space/datafile 2020-09-08T16:09:27.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:27.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj85 td/osd-backfill-space/datafile 2020-09-08T16:09:27.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:27.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj85 td/osd-backfill-space/datafile 2020-09-08T16:09:27.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:27.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj85 td/osd-backfill-space/datafile 2020-09-08T16:09:27.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:27.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj85 td/osd-backfill-space/datafile 2020-09-08T16:09:27.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:27.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj85 td/osd-backfill-space/datafile 2020-09-08T16:09:27.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:27.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj85 td/osd-backfill-space/datafile 2020-09-08T16:09:27.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:27.971 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:27.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:27.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj86 td/osd-backfill-space/datafile 2020-09-08T16:09:28.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:28.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj86 td/osd-backfill-space/datafile 2020-09-08T16:09:28.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:28.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj86 td/osd-backfill-space/datafile 2020-09-08T16:09:28.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:28.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj86 td/osd-backfill-space/datafile 2020-09-08T16:09:28.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:28.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj86 td/osd-backfill-space/datafile 2020-09-08T16:09:28.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:28.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj86 td/osd-backfill-space/datafile 2020-09-08T16:09:28.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:28.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj86 td/osd-backfill-space/datafile 2020-09-08T16:09:28.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:28.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj86 td/osd-backfill-space/datafile 2020-09-08T16:09:28.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:28.658 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:28.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:28.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj87 td/osd-backfill-space/datafile 2020-09-08T16:09:28.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:28.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj87 td/osd-backfill-space/datafile 2020-09-08T16:09:28.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:28.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj87 td/osd-backfill-space/datafile 2020-09-08T16:09:28.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:28.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj87 td/osd-backfill-space/datafile 2020-09-08T16:09:28.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:28.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj87 td/osd-backfill-space/datafile 2020-09-08T16:09:29.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:29.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj87 td/osd-backfill-space/datafile 2020-09-08T16:09:29.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:29.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj87 td/osd-backfill-space/datafile 2020-09-08T16:09:29.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:29.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj87 td/osd-backfill-space/datafile 2020-09-08T16:09:29.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:29.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:29.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:29.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj88 td/osd-backfill-space/datafile 2020-09-08T16:09:29.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:29.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj88 td/osd-backfill-space/datafile 2020-09-08T16:09:29.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:29.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj88 td/osd-backfill-space/datafile 2020-09-08T16:09:29.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:29.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj88 td/osd-backfill-space/datafile 2020-09-08T16:09:29.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:29.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj88 td/osd-backfill-space/datafile 2020-09-08T16:09:29.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:29.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj88 td/osd-backfill-space/datafile 2020-09-08T16:09:29.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:29.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj88 td/osd-backfill-space/datafile 2020-09-08T16:09:29.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:29.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj88 td/osd-backfill-space/datafile 2020-09-08T16:09:29.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:29.974 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:29.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:29.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj89 td/osd-backfill-space/datafile 2020-09-08T16:09:30.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:30.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj89 td/osd-backfill-space/datafile 2020-09-08T16:09:30.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:30.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj89 td/osd-backfill-space/datafile 2020-09-08T16:09:30.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:30.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj89 td/osd-backfill-space/datafile 2020-09-08T16:09:30.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:30.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj89 td/osd-backfill-space/datafile 2020-09-08T16:09:30.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:30.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj89 td/osd-backfill-space/datafile 2020-09-08T16:09:30.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:30.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj89 td/osd-backfill-space/datafile 2020-09-08T16:09:30.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:30.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj89 td/osd-backfill-space/datafile 2020-09-08T16:09:30.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:30.760 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:30.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:30.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj90 td/osd-backfill-space/datafile 2020-09-08T16:09:30.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:30.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj90 td/osd-backfill-space/datafile 2020-09-08T16:09:30.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:30.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj90 td/osd-backfill-space/datafile 2020-09-08T16:09:30.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:30.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj90 td/osd-backfill-space/datafile 2020-09-08T16:09:31.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:31.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj90 td/osd-backfill-space/datafile 2020-09-08T16:09:31.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:31.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj90 td/osd-backfill-space/datafile 2020-09-08T16:09:31.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:31.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj90 td/osd-backfill-space/datafile 2020-09-08T16:09:31.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:31.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj90 td/osd-backfill-space/datafile 2020-09-08T16:09:31.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:31.380 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:31.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:31.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj91 td/osd-backfill-space/datafile 2020-09-08T16:09:31.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:31.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj91 td/osd-backfill-space/datafile 2020-09-08T16:09:31.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:31.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj91 td/osd-backfill-space/datafile 2020-09-08T16:09:31.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:31.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj91 td/osd-backfill-space/datafile 2020-09-08T16:09:31.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:31.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj91 td/osd-backfill-space/datafile 2020-09-08T16:09:31.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:31.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj91 td/osd-backfill-space/datafile 2020-09-08T16:09:31.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:31.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj91 td/osd-backfill-space/datafile 2020-09-08T16:09:31.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:31.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj91 td/osd-backfill-space/datafile 2020-09-08T16:09:32.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:32.034 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:32.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:32.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj92 td/osd-backfill-space/datafile 2020-09-08T16:09:32.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:32.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj92 td/osd-backfill-space/datafile 2020-09-08T16:09:32.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:32.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj92 td/osd-backfill-space/datafile 2020-09-08T16:09:32.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:32.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj92 td/osd-backfill-space/datafile 2020-09-08T16:09:32.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:32.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj92 td/osd-backfill-space/datafile 2020-09-08T16:09:32.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:32.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj92 td/osd-backfill-space/datafile 2020-09-08T16:09:32.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:32.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj92 td/osd-backfill-space/datafile 2020-09-08T16:09:32.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:32.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj92 td/osd-backfill-space/datafile 2020-09-08T16:09:32.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:32.745 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:32.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:32.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj93 td/osd-backfill-space/datafile 2020-09-08T16:09:32.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:32.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj93 td/osd-backfill-space/datafile 2020-09-08T16:09:32.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:32.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj93 td/osd-backfill-space/datafile 2020-09-08T16:09:32.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:32.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj93 td/osd-backfill-space/datafile 2020-09-08T16:09:33.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:33.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj93 td/osd-backfill-space/datafile 2020-09-08T16:09:33.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:33.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj93 td/osd-backfill-space/datafile 2020-09-08T16:09:33.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:33.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj93 td/osd-backfill-space/datafile 2020-09-08T16:09:33.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:33.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj93 td/osd-backfill-space/datafile 2020-09-08T16:09:33.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:33.373 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:33.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:33.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj94 td/osd-backfill-space/datafile 2020-09-08T16:09:33.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:33.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj94 td/osd-backfill-space/datafile 2020-09-08T16:09:33.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:33.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj94 td/osd-backfill-space/datafile 2020-09-08T16:09:33.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:33.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj94 td/osd-backfill-space/datafile 2020-09-08T16:09:33.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:33.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj94 td/osd-backfill-space/datafile 2020-09-08T16:09:33.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:33.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj94 td/osd-backfill-space/datafile 2020-09-08T16:09:33.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:33.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj94 td/osd-backfill-space/datafile 2020-09-08T16:09:33.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:33.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj94 td/osd-backfill-space/datafile 2020-09-08T16:09:34.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:34.001 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:34.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:34.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj95 td/osd-backfill-space/datafile 2020-09-08T16:09:34.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:34.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj95 td/osd-backfill-space/datafile 2020-09-08T16:09:34.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:34.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj95 td/osd-backfill-space/datafile 2020-09-08T16:09:34.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:34.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj95 td/osd-backfill-space/datafile 2020-09-08T16:09:34.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:34.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj95 td/osd-backfill-space/datafile 2020-09-08T16:09:34.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:34.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj95 td/osd-backfill-space/datafile 2020-09-08T16:09:34.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:34.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj95 td/osd-backfill-space/datafile 2020-09-08T16:09:34.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:34.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj95 td/osd-backfill-space/datafile 2020-09-08T16:09:34.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:34.680 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:34.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:34.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj96 td/osd-backfill-space/datafile 2020-09-08T16:09:34.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:34.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj96 td/osd-backfill-space/datafile 2020-09-08T16:09:34.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:34.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj96 td/osd-backfill-space/datafile 2020-09-08T16:09:34.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:34.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj96 td/osd-backfill-space/datafile 2020-09-08T16:09:35.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:35.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj96 td/osd-backfill-space/datafile 2020-09-08T16:09:35.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:35.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj96 td/osd-backfill-space/datafile 2020-09-08T16:09:35.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:35.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj96 td/osd-backfill-space/datafile 2020-09-08T16:09:35.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:35.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj96 td/osd-backfill-space/datafile 2020-09-08T16:09:35.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:35.342 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:35.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:35.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj97 td/osd-backfill-space/datafile 2020-09-08T16:09:35.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:35.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj97 td/osd-backfill-space/datafile 2020-09-08T16:09:35.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:35.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj97 td/osd-backfill-space/datafile 2020-09-08T16:09:35.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:35.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj97 td/osd-backfill-space/datafile 2020-09-08T16:09:35.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:35.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj97 td/osd-backfill-space/datafile 2020-09-08T16:09:35.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:35.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj97 td/osd-backfill-space/datafile 2020-09-08T16:09:35.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:35.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj97 td/osd-backfill-space/datafile 2020-09-08T16:09:35.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:35.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj97 td/osd-backfill-space/datafile 2020-09-08T16:09:36.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:36.021 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:36.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:36.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj98 td/osd-backfill-space/datafile 2020-09-08T16:09:36.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:36.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj98 td/osd-backfill-space/datafile 2020-09-08T16:09:36.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:36.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj98 td/osd-backfill-space/datafile 2020-09-08T16:09:36.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:36.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj98 td/osd-backfill-space/datafile 2020-09-08T16:09:36.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:36.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj98 td/osd-backfill-space/datafile 2020-09-08T16:09:36.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:36.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj98 td/osd-backfill-space/datafile 2020-09-08T16:09:36.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:36.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj98 td/osd-backfill-space/datafile 2020-09-08T16:09:36.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:36.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj98 td/osd-backfill-space/datafile 2020-09-08T16:09:36.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:36.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:36.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:36.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj99 td/osd-backfill-space/datafile 2020-09-08T16:09:36.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:36.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj99 td/osd-backfill-space/datafile 2020-09-08T16:09:36.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:36.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj99 td/osd-backfill-space/datafile 2020-09-08T16:09:36.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:36.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj99 td/osd-backfill-space/datafile 2020-09-08T16:09:37.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:37.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj99 td/osd-backfill-space/datafile 2020-09-08T16:09:37.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:37.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj99 td/osd-backfill-space/datafile 2020-09-08T16:09:37.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:37.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj99 td/osd-backfill-space/datafile 2020-09-08T16:09:37.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:37.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj99 td/osd-backfill-space/datafile 2020-09-08T16:09:37.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:37.360 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:37.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:37.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj100 td/osd-backfill-space/datafile 2020-09-08T16:09:37.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:37.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj100 td/osd-backfill-space/datafile 2020-09-08T16:09:37.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:37.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj100 td/osd-backfill-space/datafile 2020-09-08T16:09:37.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:37.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj100 td/osd-backfill-space/datafile 2020-09-08T16:09:37.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:37.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj100 td/osd-backfill-space/datafile 2020-09-08T16:09:37.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:37.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj100 td/osd-backfill-space/datafile 2020-09-08T16:09:37.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:37.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj100 td/osd-backfill-space/datafile 2020-09-08T16:09:37.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:37.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj100 td/osd-backfill-space/datafile 2020-09-08T16:09:38.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:38.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:38.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:38.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj101 td/osd-backfill-space/datafile 2020-09-08T16:09:38.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:38.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj101 td/osd-backfill-space/datafile 2020-09-08T16:09:38.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:38.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj101 td/osd-backfill-space/datafile 2020-09-08T16:09:38.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:38.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj101 td/osd-backfill-space/datafile 2020-09-08T16:09:38.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:38.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj101 td/osd-backfill-space/datafile 2020-09-08T16:09:38.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:38.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj101 td/osd-backfill-space/datafile 2020-09-08T16:09:38.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:38.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj101 td/osd-backfill-space/datafile 2020-09-08T16:09:38.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:38.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj101 td/osd-backfill-space/datafile 2020-09-08T16:09:38.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:38.734 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:38.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:38.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj102 td/osd-backfill-space/datafile 2020-09-08T16:09:38.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:38.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj102 td/osd-backfill-space/datafile 2020-09-08T16:09:38.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:38.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj102 td/osd-backfill-space/datafile 2020-09-08T16:09:38.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:38.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj102 td/osd-backfill-space/datafile 2020-09-08T16:09:39.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:39.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj102 td/osd-backfill-space/datafile 2020-09-08T16:09:39.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:39.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj102 td/osd-backfill-space/datafile 2020-09-08T16:09:39.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:39.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj102 td/osd-backfill-space/datafile 2020-09-08T16:09:39.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:39.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj102 td/osd-backfill-space/datafile 2020-09-08T16:09:39.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:39.371 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:39.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:39.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj103 td/osd-backfill-space/datafile 2020-09-08T16:09:39.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:39.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj103 td/osd-backfill-space/datafile 2020-09-08T16:09:39.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:39.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj103 td/osd-backfill-space/datafile 2020-09-08T16:09:39.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:39.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj103 td/osd-backfill-space/datafile 2020-09-08T16:09:39.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:39.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj103 td/osd-backfill-space/datafile 2020-09-08T16:09:39.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:39.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj103 td/osd-backfill-space/datafile 2020-09-08T16:09:39.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:39.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj103 td/osd-backfill-space/datafile 2020-09-08T16:09:39.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:39.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj103 td/osd-backfill-space/datafile 2020-09-08T16:09:40.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:40.032 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:40.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:40.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj104 td/osd-backfill-space/datafile 2020-09-08T16:09:40.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:40.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj104 td/osd-backfill-space/datafile 2020-09-08T16:09:40.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:40.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj104 td/osd-backfill-space/datafile 2020-09-08T16:09:40.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:40.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj104 td/osd-backfill-space/datafile 2020-09-08T16:09:40.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:40.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj104 td/osd-backfill-space/datafile 2020-09-08T16:09:40.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:40.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj104 td/osd-backfill-space/datafile 2020-09-08T16:09:40.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:40.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj104 td/osd-backfill-space/datafile 2020-09-08T16:09:40.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:40.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj104 td/osd-backfill-space/datafile 2020-09-08T16:09:40.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:40.995 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:40.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:40.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj105 td/osd-backfill-space/datafile 2020-09-08T16:09:41.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:41.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj105 td/osd-backfill-space/datafile 2020-09-08T16:09:41.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:41.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj105 td/osd-backfill-space/datafile 2020-09-08T16:09:41.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:41.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj105 td/osd-backfill-space/datafile 2020-09-08T16:09:41.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:41.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj105 td/osd-backfill-space/datafile 2020-09-08T16:09:41.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:41.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj105 td/osd-backfill-space/datafile 2020-09-08T16:09:41.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:41.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj105 td/osd-backfill-space/datafile 2020-09-08T16:09:41.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:41.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj105 td/osd-backfill-space/datafile 2020-09-08T16:09:41.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:41.623 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:41.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:41.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj106 td/osd-backfill-space/datafile 2020-09-08T16:09:41.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:41.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj106 td/osd-backfill-space/datafile 2020-09-08T16:09:41.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:41.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj106 td/osd-backfill-space/datafile 2020-09-08T16:09:41.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:41.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj106 td/osd-backfill-space/datafile 2020-09-08T16:09:41.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:41.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj106 td/osd-backfill-space/datafile 2020-09-08T16:09:42.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:42.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj106 td/osd-backfill-space/datafile 2020-09-08T16:09:42.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:42.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj106 td/osd-backfill-space/datafile 2020-09-08T16:09:42.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:42.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj106 td/osd-backfill-space/datafile 2020-09-08T16:09:42.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:42.284 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:42.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:42.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj107 td/osd-backfill-space/datafile 2020-09-08T16:09:42.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:42.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj107 td/osd-backfill-space/datafile 2020-09-08T16:09:42.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:42.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj107 td/osd-backfill-space/datafile 2020-09-08T16:09:42.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:42.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj107 td/osd-backfill-space/datafile 2020-09-08T16:09:42.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:42.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj107 td/osd-backfill-space/datafile 2020-09-08T16:09:42.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:42.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj107 td/osd-backfill-space/datafile 2020-09-08T16:09:42.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:42.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj107 td/osd-backfill-space/datafile 2020-09-08T16:09:42.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:42.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj107 td/osd-backfill-space/datafile 2020-09-08T16:09:42.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:42.948 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:42.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:42.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj108 td/osd-backfill-space/datafile 2020-09-08T16:09:43.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:43.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj108 td/osd-backfill-space/datafile 2020-09-08T16:09:43.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:43.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj108 td/osd-backfill-space/datafile 2020-09-08T16:09:43.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:43.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj108 td/osd-backfill-space/datafile 2020-09-08T16:09:43.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:43.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj108 td/osd-backfill-space/datafile 2020-09-08T16:09:43.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:43.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj108 td/osd-backfill-space/datafile 2020-09-08T16:09:43.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:43.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj108 td/osd-backfill-space/datafile 2020-09-08T16:09:43.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:43.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj108 td/osd-backfill-space/datafile 2020-09-08T16:09:43.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:43.582 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:43.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:43.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj109 td/osd-backfill-space/datafile 2020-09-08T16:09:43.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:43.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj109 td/osd-backfill-space/datafile 2020-09-08T16:09:43.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:43.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj109 td/osd-backfill-space/datafile 2020-09-08T16:09:43.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:43.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj109 td/osd-backfill-space/datafile 2020-09-08T16:09:43.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:43.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj109 td/osd-backfill-space/datafile 2020-09-08T16:09:43.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:43.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj109 td/osd-backfill-space/datafile 2020-09-08T16:09:44.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:44.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj109 td/osd-backfill-space/datafile 2020-09-08T16:09:44.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:44.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj109 td/osd-backfill-space/datafile 2020-09-08T16:09:44.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:44.210 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:44.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:44.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj110 td/osd-backfill-space/datafile 2020-09-08T16:09:44.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:44.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj110 td/osd-backfill-space/datafile 2020-09-08T16:09:44.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:44.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj110 td/osd-backfill-space/datafile 2020-09-08T16:09:44.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:44.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj110 td/osd-backfill-space/datafile 2020-09-08T16:09:44.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:44.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj110 td/osd-backfill-space/datafile 2020-09-08T16:09:44.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:44.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj110 td/osd-backfill-space/datafile 2020-09-08T16:09:44.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:44.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj110 td/osd-backfill-space/datafile 2020-09-08T16:09:44.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:44.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj110 td/osd-backfill-space/datafile 2020-09-08T16:09:44.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:44.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:44.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:44.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj111 td/osd-backfill-space/datafile 2020-09-08T16:09:44.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:44.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj111 td/osd-backfill-space/datafile 2020-09-08T16:09:45.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:45.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj111 td/osd-backfill-space/datafile 2020-09-08T16:09:45.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:45.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj111 td/osd-backfill-space/datafile 2020-09-08T16:09:45.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:45.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj111 td/osd-backfill-space/datafile 2020-09-08T16:09:45.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:45.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj111 td/osd-backfill-space/datafile 2020-09-08T16:09:45.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:45.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj111 td/osd-backfill-space/datafile 2020-09-08T16:09:45.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:45.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj111 td/osd-backfill-space/datafile 2020-09-08T16:09:45.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:45.585 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:45.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:45.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj112 td/osd-backfill-space/datafile 2020-09-08T16:09:45.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:45.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj112 td/osd-backfill-space/datafile 2020-09-08T16:09:45.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:45.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj112 td/osd-backfill-space/datafile 2020-09-08T16:09:45.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:45.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj112 td/osd-backfill-space/datafile 2020-09-08T16:09:45.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:45.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj112 td/osd-backfill-space/datafile 2020-09-08T16:09:45.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:45.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj112 td/osd-backfill-space/datafile 2020-09-08T16:09:46.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:46.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj112 td/osd-backfill-space/datafile 2020-09-08T16:09:46.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:46.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj112 td/osd-backfill-space/datafile 2020-09-08T16:09:46.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:46.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:46.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:46.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj113 td/osd-backfill-space/datafile 2020-09-08T16:09:46.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:46.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj113 td/osd-backfill-space/datafile 2020-09-08T16:09:46.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:46.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj113 td/osd-backfill-space/datafile 2020-09-08T16:09:46.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:46.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj113 td/osd-backfill-space/datafile 2020-09-08T16:09:46.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:46.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj113 td/osd-backfill-space/datafile 2020-09-08T16:09:46.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:46.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj113 td/osd-backfill-space/datafile 2020-09-08T16:09:46.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:46.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj113 td/osd-backfill-space/datafile 2020-09-08T16:09:46.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:46.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj113 td/osd-backfill-space/datafile 2020-09-08T16:09:47.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:47.025 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:47.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:47.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj114 td/osd-backfill-space/datafile 2020-09-08T16:09:47.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:47.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj114 td/osd-backfill-space/datafile 2020-09-08T16:09:47.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:47.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj114 td/osd-backfill-space/datafile 2020-09-08T16:09:47.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:47.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj114 td/osd-backfill-space/datafile 2020-09-08T16:09:47.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:47.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj114 td/osd-backfill-space/datafile 2020-09-08T16:09:47.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:47.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj114 td/osd-backfill-space/datafile 2020-09-08T16:09:47.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:47.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj114 td/osd-backfill-space/datafile 2020-09-08T16:09:47.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:47.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj114 td/osd-backfill-space/datafile 2020-09-08T16:09:47.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:47.637 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:47.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:47.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj115 td/osd-backfill-space/datafile 2020-09-08T16:09:47.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:47.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj115 td/osd-backfill-space/datafile 2020-09-08T16:09:47.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:47.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj115 td/osd-backfill-space/datafile 2020-09-08T16:09:47.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:47.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj115 td/osd-backfill-space/datafile 2020-09-08T16:09:47.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:47.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj115 td/osd-backfill-space/datafile 2020-09-08T16:09:48.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:48.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj115 td/osd-backfill-space/datafile 2020-09-08T16:09:48.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:48.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj115 td/osd-backfill-space/datafile 2020-09-08T16:09:48.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:48.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj115 td/osd-backfill-space/datafile 2020-09-08T16:09:48.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:48.316 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:48.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:48.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj116 td/osd-backfill-space/datafile 2020-09-08T16:09:48.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:48.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj116 td/osd-backfill-space/datafile 2020-09-08T16:09:48.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:48.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj116 td/osd-backfill-space/datafile 2020-09-08T16:09:48.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:48.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj116 td/osd-backfill-space/datafile 2020-09-08T16:09:48.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:48.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj116 td/osd-backfill-space/datafile 2020-09-08T16:09:48.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:48.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj116 td/osd-backfill-space/datafile 2020-09-08T16:09:48.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:48.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj116 td/osd-backfill-space/datafile 2020-09-08T16:09:48.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:48.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj116 td/osd-backfill-space/datafile 2020-09-08T16:09:48.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:48.960 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:48.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:48.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj117 td/osd-backfill-space/datafile 2020-09-08T16:09:49.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:49.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj117 td/osd-backfill-space/datafile 2020-09-08T16:09:49.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:49.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj117 td/osd-backfill-space/datafile 2020-09-08T16:09:49.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:49.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj117 td/osd-backfill-space/datafile 2020-09-08T16:09:49.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:49.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj117 td/osd-backfill-space/datafile 2020-09-08T16:09:49.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:49.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj117 td/osd-backfill-space/datafile 2020-09-08T16:09:49.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:49.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj117 td/osd-backfill-space/datafile 2020-09-08T16:09:49.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:49.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj117 td/osd-backfill-space/datafile 2020-09-08T16:09:49.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:49.638 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:49.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:49.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj118 td/osd-backfill-space/datafile 2020-09-08T16:09:49.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:49.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj118 td/osd-backfill-space/datafile 2020-09-08T16:09:49.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:49.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj118 td/osd-backfill-space/datafile 2020-09-08T16:09:49.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:49.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj118 td/osd-backfill-space/datafile 2020-09-08T16:09:49.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:49.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj118 td/osd-backfill-space/datafile 2020-09-08T16:09:50.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:50.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj118 td/osd-backfill-space/datafile 2020-09-08T16:09:50.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:50.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj118 td/osd-backfill-space/datafile 2020-09-08T16:09:50.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:50.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj118 td/osd-backfill-space/datafile 2020-09-08T16:09:50.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:50.317 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:50.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:50.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj119 td/osd-backfill-space/datafile 2020-09-08T16:09:50.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:50.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj119 td/osd-backfill-space/datafile 2020-09-08T16:09:50.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:50.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj119 td/osd-backfill-space/datafile 2020-09-08T16:09:50.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:50.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj119 td/osd-backfill-space/datafile 2020-09-08T16:09:50.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:50.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj119 td/osd-backfill-space/datafile 2020-09-08T16:09:50.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:50.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj119 td/osd-backfill-space/datafile 2020-09-08T16:09:50.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:50.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj119 td/osd-backfill-space/datafile 2020-09-08T16:09:50.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:50.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj119 td/osd-backfill-space/datafile 2020-09-08T16:09:50.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:50.959 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:50.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:50.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj120 td/osd-backfill-space/datafile 2020-09-08T16:09:51.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:51.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj120 td/osd-backfill-space/datafile 2020-09-08T16:09:51.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:51.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj120 td/osd-backfill-space/datafile 2020-09-08T16:09:51.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:51.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj120 td/osd-backfill-space/datafile 2020-09-08T16:09:51.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:51.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj120 td/osd-backfill-space/datafile 2020-09-08T16:09:51.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:51.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj120 td/osd-backfill-space/datafile 2020-09-08T16:09:51.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:51.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj120 td/osd-backfill-space/datafile 2020-09-08T16:09:51.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:51.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj120 td/osd-backfill-space/datafile 2020-09-08T16:09:51.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:51.636 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:51.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:51.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj121 td/osd-backfill-space/datafile 2020-09-08T16:09:51.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:51.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj121 td/osd-backfill-space/datafile 2020-09-08T16:09:51.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:51.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj121 td/osd-backfill-space/datafile 2020-09-08T16:09:51.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:51.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj121 td/osd-backfill-space/datafile 2020-09-08T16:09:51.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:51.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj121 td/osd-backfill-space/datafile 2020-09-08T16:09:52.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:52.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj121 td/osd-backfill-space/datafile 2020-09-08T16:09:52.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:52.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj121 td/osd-backfill-space/datafile 2020-09-08T16:09:52.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:52.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj121 td/osd-backfill-space/datafile 2020-09-08T16:09:52.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:52.285 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:52.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:52.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj122 td/osd-backfill-space/datafile 2020-09-08T16:09:52.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:52.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj122 td/osd-backfill-space/datafile 2020-09-08T16:09:52.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:52.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj122 td/osd-backfill-space/datafile 2020-09-08T16:09:52.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:52.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj122 td/osd-backfill-space/datafile 2020-09-08T16:09:52.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:52.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj122 td/osd-backfill-space/datafile 2020-09-08T16:09:52.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:52.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj122 td/osd-backfill-space/datafile 2020-09-08T16:09:52.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:52.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj122 td/osd-backfill-space/datafile 2020-09-08T16:09:52.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:52.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj122 td/osd-backfill-space/datafile 2020-09-08T16:09:52.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:52.939 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:52.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:52.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj123 td/osd-backfill-space/datafile 2020-09-08T16:09:53.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:53.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj123 td/osd-backfill-space/datafile 2020-09-08T16:09:53.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:53.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj123 td/osd-backfill-space/datafile 2020-09-08T16:09:53.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:53.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj123 td/osd-backfill-space/datafile 2020-09-08T16:09:53.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:53.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj123 td/osd-backfill-space/datafile 2020-09-08T16:09:53.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:53.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj123 td/osd-backfill-space/datafile 2020-09-08T16:09:53.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:53.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj123 td/osd-backfill-space/datafile 2020-09-08T16:09:53.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:53.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj123 td/osd-backfill-space/datafile 2020-09-08T16:09:53.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:53.551 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:53.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:53.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj124 td/osd-backfill-space/datafile 2020-09-08T16:09:53.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:53.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj124 td/osd-backfill-space/datafile 2020-09-08T16:09:53.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:53.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj124 td/osd-backfill-space/datafile 2020-09-08T16:09:53.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:53.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj124 td/osd-backfill-space/datafile 2020-09-08T16:09:53.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:53.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj124 td/osd-backfill-space/datafile 2020-09-08T16:09:53.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:53.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj124 td/osd-backfill-space/datafile 2020-09-08T16:09:54.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:54.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj124 td/osd-backfill-space/datafile 2020-09-08T16:09:54.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:54.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj124 td/osd-backfill-space/datafile 2020-09-08T16:09:54.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:54.179 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:54.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:54.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj125 td/osd-backfill-space/datafile 2020-09-08T16:09:54.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:54.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj125 td/osd-backfill-space/datafile 2020-09-08T16:09:54.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:54.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj125 td/osd-backfill-space/datafile 2020-09-08T16:09:54.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:54.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj125 td/osd-backfill-space/datafile 2020-09-08T16:09:54.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:54.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj125 td/osd-backfill-space/datafile 2020-09-08T16:09:54.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:54.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj125 td/osd-backfill-space/datafile 2020-09-08T16:09:54.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:54.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj125 td/osd-backfill-space/datafile 2020-09-08T16:09:54.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:54.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj125 td/osd-backfill-space/datafile 2020-09-08T16:09:54.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:54.862 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:54.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:54.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj126 td/osd-backfill-space/datafile 2020-09-08T16:09:54.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:54.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj126 td/osd-backfill-space/datafile 2020-09-08T16:09:55.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:55.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj126 td/osd-backfill-space/datafile 2020-09-08T16:09:55.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:55.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj126 td/osd-backfill-space/datafile 2020-09-08T16:09:55.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:55.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj126 td/osd-backfill-space/datafile 2020-09-08T16:09:55.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:55.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj126 td/osd-backfill-space/datafile 2020-09-08T16:09:55.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:55.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj126 td/osd-backfill-space/datafile 2020-09-08T16:09:55.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:55.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj126 td/osd-backfill-space/datafile 2020-09-08T16:09:55.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:55.510 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:55.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:55.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj127 td/osd-backfill-space/datafile 2020-09-08T16:09:55.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:55.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj127 td/osd-backfill-space/datafile 2020-09-08T16:09:55.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:55.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj127 td/osd-backfill-space/datafile 2020-09-08T16:09:55.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:55.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj127 td/osd-backfill-space/datafile 2020-09-08T16:09:55.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:55.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj127 td/osd-backfill-space/datafile 2020-09-08T16:09:55.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:55.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj127 td/osd-backfill-space/datafile 2020-09-08T16:09:55.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:55.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj127 td/osd-backfill-space/datafile 2020-09-08T16:09:56.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:56.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj127 td/osd-backfill-space/datafile 2020-09-08T16:09:56.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:56.139 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:56.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:56.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj128 td/osd-backfill-space/datafile 2020-09-08T16:09:56.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:56.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj128 td/osd-backfill-space/datafile 2020-09-08T16:09:56.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:56.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj128 td/osd-backfill-space/datafile 2020-09-08T16:09:56.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:56.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj128 td/osd-backfill-space/datafile 2020-09-08T16:09:56.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:56.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj128 td/osd-backfill-space/datafile 2020-09-08T16:09:56.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:56.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj128 td/osd-backfill-space/datafile 2020-09-08T16:09:56.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:56.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj128 td/osd-backfill-space/datafile 2020-09-08T16:09:56.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:56.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj128 td/osd-backfill-space/datafile 2020-09-08T16:09:56.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:56.792 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:56.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:56.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj129 td/osd-backfill-space/datafile 2020-09-08T16:09:56.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:56.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj129 td/osd-backfill-space/datafile 2020-09-08T16:09:56.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:56.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj129 td/osd-backfill-space/datafile 2020-09-08T16:09:57.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:57.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj129 td/osd-backfill-space/datafile 2020-09-08T16:09:57.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:57.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj129 td/osd-backfill-space/datafile 2020-09-08T16:09:57.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:57.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj129 td/osd-backfill-space/datafile 2020-09-08T16:09:57.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:57.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj129 td/osd-backfill-space/datafile 2020-09-08T16:09:57.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:57.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj129 td/osd-backfill-space/datafile 2020-09-08T16:09:57.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:57.431 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:57.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:57.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj130 td/osd-backfill-space/datafile 2020-09-08T16:09:57.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:57.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj130 td/osd-backfill-space/datafile 2020-09-08T16:09:57.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:57.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj130 td/osd-backfill-space/datafile 2020-09-08T16:09:57.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:57.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj130 td/osd-backfill-space/datafile 2020-09-08T16:09:57.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:57.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj130 td/osd-backfill-space/datafile 2020-09-08T16:09:57.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:57.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj130 td/osd-backfill-space/datafile 2020-09-08T16:09:57.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:57.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj130 td/osd-backfill-space/datafile 2020-09-08T16:09:57.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:57.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj130 td/osd-backfill-space/datafile 2020-09-08T16:09:58.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:58.057 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:58.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:58.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj131 td/osd-backfill-space/datafile 2020-09-08T16:09:58.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:58.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj131 td/osd-backfill-space/datafile 2020-09-08T16:09:58.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:58.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj131 td/osd-backfill-space/datafile 2020-09-08T16:09:58.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:58.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj131 td/osd-backfill-space/datafile 2020-09-08T16:09:58.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:58.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj131 td/osd-backfill-space/datafile 2020-09-08T16:09:58.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:58.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj131 td/osd-backfill-space/datafile 2020-09-08T16:09:58.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:58.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj131 td/osd-backfill-space/datafile 2020-09-08T16:09:58.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:58.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj131 td/osd-backfill-space/datafile 2020-09-08T16:09:58.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:58.728 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:58.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:58.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj132 td/osd-backfill-space/datafile 2020-09-08T16:09:58.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:58.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj132 td/osd-backfill-space/datafile 2020-09-08T16:09:58.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:58.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj132 td/osd-backfill-space/datafile 2020-09-08T16:09:58.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:58.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj132 td/osd-backfill-space/datafile 2020-09-08T16:09:59.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:59.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj132 td/osd-backfill-space/datafile 2020-09-08T16:09:59.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:59.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj132 td/osd-backfill-space/datafile 2020-09-08T16:09:59.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:59.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj132 td/osd-backfill-space/datafile 2020-09-08T16:09:59.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:59.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj132 td/osd-backfill-space/datafile 2020-09-08T16:09:59.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:09:59.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:09:59.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:59.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj133 td/osd-backfill-space/datafile 2020-09-08T16:09:59.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:59.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj133 td/osd-backfill-space/datafile 2020-09-08T16:09:59.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:59.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj133 td/osd-backfill-space/datafile 2020-09-08T16:09:59.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:59.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj133 td/osd-backfill-space/datafile 2020-09-08T16:09:59.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:59.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj133 td/osd-backfill-space/datafile 2020-09-08T16:09:59.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:59.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj133 td/osd-backfill-space/datafile 2020-09-08T16:09:59.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:59.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj133 td/osd-backfill-space/datafile 2020-09-08T16:09:59.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:09:59.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj133 td/osd-backfill-space/datafile 2020-09-08T16:10:00.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:00.009 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:00.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:00.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj134 td/osd-backfill-space/datafile 2020-09-08T16:10:00.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:00.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj134 td/osd-backfill-space/datafile 2020-09-08T16:10:00.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:00.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj134 td/osd-backfill-space/datafile 2020-09-08T16:10:00.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:00.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj134 td/osd-backfill-space/datafile 2020-09-08T16:10:00.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:00.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj134 td/osd-backfill-space/datafile 2020-09-08T16:10:00.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:00.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj134 td/osd-backfill-space/datafile 2020-09-08T16:10:00.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:00.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj134 td/osd-backfill-space/datafile 2020-09-08T16:10:00.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:00.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj134 td/osd-backfill-space/datafile 2020-09-08T16:10:00.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:00.689 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:00.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:00.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj135 td/osd-backfill-space/datafile 2020-09-08T16:10:00.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:00.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj135 td/osd-backfill-space/datafile 2020-09-08T16:10:00.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:00.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj135 td/osd-backfill-space/datafile 2020-09-08T16:10:00.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:00.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj135 td/osd-backfill-space/datafile 2020-09-08T16:10:00.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:01.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj135 td/osd-backfill-space/datafile 2020-09-08T16:10:01.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:01.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj135 td/osd-backfill-space/datafile 2020-09-08T16:10:01.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:01.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj135 td/osd-backfill-space/datafile 2020-09-08T16:10:01.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:01.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj135 td/osd-backfill-space/datafile 2020-09-08T16:10:01.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:01.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:01.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:01.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj136 td/osd-backfill-space/datafile 2020-09-08T16:10:01.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:01.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj136 td/osd-backfill-space/datafile 2020-09-08T16:10:01.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:01.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj136 td/osd-backfill-space/datafile 2020-09-08T16:10:01.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:01.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj136 td/osd-backfill-space/datafile 2020-09-08T16:10:01.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:01.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj136 td/osd-backfill-space/datafile 2020-09-08T16:10:01.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:01.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj136 td/osd-backfill-space/datafile 2020-09-08T16:10:01.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:01.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj136 td/osd-backfill-space/datafile 2020-09-08T16:10:01.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:01.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj136 td/osd-backfill-space/datafile 2020-09-08T16:10:02.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:02.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:02.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:02.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj137 td/osd-backfill-space/datafile 2020-09-08T16:10:02.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:02.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj137 td/osd-backfill-space/datafile 2020-09-08T16:10:02.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:02.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj137 td/osd-backfill-space/datafile 2020-09-08T16:10:02.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:02.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj137 td/osd-backfill-space/datafile 2020-09-08T16:10:02.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:02.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj137 td/osd-backfill-space/datafile 2020-09-08T16:10:02.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:02.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj137 td/osd-backfill-space/datafile 2020-09-08T16:10:02.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:02.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj137 td/osd-backfill-space/datafile 2020-09-08T16:10:02.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:02.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj137 td/osd-backfill-space/datafile 2020-09-08T16:10:02.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:02.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:02.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:02.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj138 td/osd-backfill-space/datafile 2020-09-08T16:10:02.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:02.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj138 td/osd-backfill-space/datafile 2020-09-08T16:10:02.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:02.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj138 td/osd-backfill-space/datafile 2020-09-08T16:10:02.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:02.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj138 td/osd-backfill-space/datafile 2020-09-08T16:10:03.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:03.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj138 td/osd-backfill-space/datafile 2020-09-08T16:10:03.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:03.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj138 td/osd-backfill-space/datafile 2020-09-08T16:10:03.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:03.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj138 td/osd-backfill-space/datafile 2020-09-08T16:10:03.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:03.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj138 td/osd-backfill-space/datafile 2020-09-08T16:10:03.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:03.355 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:03.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:03.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj139 td/osd-backfill-space/datafile 2020-09-08T16:10:03.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:03.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj139 td/osd-backfill-space/datafile 2020-09-08T16:10:03.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:03.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj139 td/osd-backfill-space/datafile 2020-09-08T16:10:03.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:03.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj139 td/osd-backfill-space/datafile 2020-09-08T16:10:03.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:03.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj139 td/osd-backfill-space/datafile 2020-09-08T16:10:03.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:03.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj139 td/osd-backfill-space/datafile 2020-09-08T16:10:03.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:03.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj139 td/osd-backfill-space/datafile 2020-09-08T16:10:03.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:03.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj139 td/osd-backfill-space/datafile 2020-09-08T16:10:03.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:03.955 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:03.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:03.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj140 td/osd-backfill-space/datafile 2020-09-08T16:10:04.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:04.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj140 td/osd-backfill-space/datafile 2020-09-08T16:10:04.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:04.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj140 td/osd-backfill-space/datafile 2020-09-08T16:10:04.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:04.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj140 td/osd-backfill-space/datafile 2020-09-08T16:10:04.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:04.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj140 td/osd-backfill-space/datafile 2020-09-08T16:10:04.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:04.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj140 td/osd-backfill-space/datafile 2020-09-08T16:10:04.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:04.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj140 td/osd-backfill-space/datafile 2020-09-08T16:10:04.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:04.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj140 td/osd-backfill-space/datafile 2020-09-08T16:10:04.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:04.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:04.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:04.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj141 td/osd-backfill-space/datafile 2020-09-08T16:10:04.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:04.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj141 td/osd-backfill-space/datafile 2020-09-08T16:10:04.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:04.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj141 td/osd-backfill-space/datafile 2020-09-08T16:10:04.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:04.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj141 td/osd-backfill-space/datafile 2020-09-08T16:10:04.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:04.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj141 td/osd-backfill-space/datafile 2020-09-08T16:10:05.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:05.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj141 td/osd-backfill-space/datafile 2020-09-08T16:10:05.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:05.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj141 td/osd-backfill-space/datafile 2020-09-08T16:10:05.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:05.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj141 td/osd-backfill-space/datafile 2020-09-08T16:10:05.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:05.295 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:05.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:05.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj142 td/osd-backfill-space/datafile 2020-09-08T16:10:05.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:05.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj142 td/osd-backfill-space/datafile 2020-09-08T16:10:05.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:05.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj142 td/osd-backfill-space/datafile 2020-09-08T16:10:05.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:05.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj142 td/osd-backfill-space/datafile 2020-09-08T16:10:05.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:05.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj142 td/osd-backfill-space/datafile 2020-09-08T16:10:05.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:05.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj142 td/osd-backfill-space/datafile 2020-09-08T16:10:05.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:05.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj142 td/osd-backfill-space/datafile 2020-09-08T16:10:05.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:05.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj142 td/osd-backfill-space/datafile 2020-09-08T16:10:05.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:05.923 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:05.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:05.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj143 td/osd-backfill-space/datafile 2020-09-08T16:10:06.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:06.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj143 td/osd-backfill-space/datafile 2020-09-08T16:10:06.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:06.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj143 td/osd-backfill-space/datafile 2020-09-08T16:10:06.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:06.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj143 td/osd-backfill-space/datafile 2020-09-08T16:10:06.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:06.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj143 td/osd-backfill-space/datafile 2020-09-08T16:10:06.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:06.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj143 td/osd-backfill-space/datafile 2020-09-08T16:10:06.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:06.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj143 td/osd-backfill-space/datafile 2020-09-08T16:10:06.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:06.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj143 td/osd-backfill-space/datafile 2020-09-08T16:10:06.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:06.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:06.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:06.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj144 td/osd-backfill-space/datafile 2020-09-08T16:10:06.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:06.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj144 td/osd-backfill-space/datafile 2020-09-08T16:10:06.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:06.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj144 td/osd-backfill-space/datafile 2020-09-08T16:10:06.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:06.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj144 td/osd-backfill-space/datafile 2020-09-08T16:10:06.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:06.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj144 td/osd-backfill-space/datafile 2020-09-08T16:10:07.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:07.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj144 td/osd-backfill-space/datafile 2020-09-08T16:10:07.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:07.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj144 td/osd-backfill-space/datafile 2020-09-08T16:10:07.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:07.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj144 td/osd-backfill-space/datafile 2020-09-08T16:10:07.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:07.288 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:07.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:07.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj145 td/osd-backfill-space/datafile 2020-09-08T16:10:07.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:07.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj145 td/osd-backfill-space/datafile 2020-09-08T16:10:07.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:07.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj145 td/osd-backfill-space/datafile 2020-09-08T16:10:07.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:07.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj145 td/osd-backfill-space/datafile 2020-09-08T16:10:07.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:07.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj145 td/osd-backfill-space/datafile 2020-09-08T16:10:07.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:07.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj145 td/osd-backfill-space/datafile 2020-09-08T16:10:07.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:07.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj145 td/osd-backfill-space/datafile 2020-09-08T16:10:07.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:07.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj145 td/osd-backfill-space/datafile 2020-09-08T16:10:07.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:07.899 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:07.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:07.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj146 td/osd-backfill-space/datafile 2020-09-08T16:10:07.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:07.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj146 td/osd-backfill-space/datafile 2020-09-08T16:10:08.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:08.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj146 td/osd-backfill-space/datafile 2020-09-08T16:10:08.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:08.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj146 td/osd-backfill-space/datafile 2020-09-08T16:10:08.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:08.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj146 td/osd-backfill-space/datafile 2020-09-08T16:10:08.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:08.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj146 td/osd-backfill-space/datafile 2020-09-08T16:10:08.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:08.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj146 td/osd-backfill-space/datafile 2020-09-08T16:10:08.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:08.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj146 td/osd-backfill-space/datafile 2020-09-08T16:10:08.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:08.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:08.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:08.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj147 td/osd-backfill-space/datafile 2020-09-08T16:10:08.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:08.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj147 td/osd-backfill-space/datafile 2020-09-08T16:10:08.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:08.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj147 td/osd-backfill-space/datafile 2020-09-08T16:10:08.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:08.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj147 td/osd-backfill-space/datafile 2020-09-08T16:10:08.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:08.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj147 td/osd-backfill-space/datafile 2020-09-08T16:10:08.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:08.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj147 td/osd-backfill-space/datafile 2020-09-08T16:10:09.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:09.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj147 td/osd-backfill-space/datafile 2020-09-08T16:10:09.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:09.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj147 td/osd-backfill-space/datafile 2020-09-08T16:10:09.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:09.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:09.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:09.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj148 td/osd-backfill-space/datafile 2020-09-08T16:10:09.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:09.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj148 td/osd-backfill-space/datafile 2020-09-08T16:10:09.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:09.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj148 td/osd-backfill-space/datafile 2020-09-08T16:10:09.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:09.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj148 td/osd-backfill-space/datafile 2020-09-08T16:10:09.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:09.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj148 td/osd-backfill-space/datafile 2020-09-08T16:10:09.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:09.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj148 td/osd-backfill-space/datafile 2020-09-08T16:10:09.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:09.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj148 td/osd-backfill-space/datafile 2020-09-08T16:10:09.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:09.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj148 td/osd-backfill-space/datafile 2020-09-08T16:10:09.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:09.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:09.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:09.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj149 td/osd-backfill-space/datafile 2020-09-08T16:10:09.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:09.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj149 td/osd-backfill-space/datafile 2020-09-08T16:10:09.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:09.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj149 td/osd-backfill-space/datafile 2020-09-08T16:10:10.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:10.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj149 td/osd-backfill-space/datafile 2020-09-08T16:10:10.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:10.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj149 td/osd-backfill-space/datafile 2020-09-08T16:10:10.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:10.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj149 td/osd-backfill-space/datafile 2020-09-08T16:10:10.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:10.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj149 td/osd-backfill-space/datafile 2020-09-08T16:10:10.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:10.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj149 td/osd-backfill-space/datafile 2020-09-08T16:10:10.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:10.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:10.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:10.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj150 td/osd-backfill-space/datafile 2020-09-08T16:10:10.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:10.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj150 td/osd-backfill-space/datafile 2020-09-08T16:10:10.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:10.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj150 td/osd-backfill-space/datafile 2020-09-08T16:10:10.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:10.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj150 td/osd-backfill-space/datafile 2020-09-08T16:10:10.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:10.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj150 td/osd-backfill-space/datafile 2020-09-08T16:10:10.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:10.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj150 td/osd-backfill-space/datafile 2020-09-08T16:10:11.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:11.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj150 td/osd-backfill-space/datafile 2020-09-08T16:10:11.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:11.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj150 td/osd-backfill-space/datafile 2020-09-08T16:10:11.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:11.185 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:11.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:11.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj151 td/osd-backfill-space/datafile 2020-09-08T16:10:11.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:11.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj151 td/osd-backfill-space/datafile 2020-09-08T16:10:11.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:11.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj151 td/osd-backfill-space/datafile 2020-09-08T16:10:11.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:11.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj151 td/osd-backfill-space/datafile 2020-09-08T16:10:11.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:11.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj151 td/osd-backfill-space/datafile 2020-09-08T16:10:11.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:11.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj151 td/osd-backfill-space/datafile 2020-09-08T16:10:11.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:11.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj151 td/osd-backfill-space/datafile 2020-09-08T16:10:11.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:11.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj151 td/osd-backfill-space/datafile 2020-09-08T16:10:11.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:11.814 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:11.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:11.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj152 td/osd-backfill-space/datafile 2020-09-08T16:10:12.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:12.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj152 td/osd-backfill-space/datafile 2020-09-08T16:10:12.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:12.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj152 td/osd-backfill-space/datafile 2020-09-08T16:10:12.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:12.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj152 td/osd-backfill-space/datafile 2020-09-08T16:10:12.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:12.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj152 td/osd-backfill-space/datafile 2020-09-08T16:10:12.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:12.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj152 td/osd-backfill-space/datafile 2020-09-08T16:10:12.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:12.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj152 td/osd-backfill-space/datafile 2020-09-08T16:10:12.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:12.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj152 td/osd-backfill-space/datafile 2020-09-08T16:10:12.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:12.810 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:12.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:12.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj153 td/osd-backfill-space/datafile 2020-09-08T16:10:12.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:12.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj153 td/osd-backfill-space/datafile 2020-09-08T16:10:12.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:12.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj153 td/osd-backfill-space/datafile 2020-09-08T16:10:13.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:13.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj153 td/osd-backfill-space/datafile 2020-09-08T16:10:13.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:13.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj153 td/osd-backfill-space/datafile 2020-09-08T16:10:13.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:13.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj153 td/osd-backfill-space/datafile 2020-09-08T16:10:13.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:13.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj153 td/osd-backfill-space/datafile 2020-09-08T16:10:13.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:13.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj153 td/osd-backfill-space/datafile 2020-09-08T16:10:13.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:13.439 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:13.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:13.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj154 td/osd-backfill-space/datafile 2020-09-08T16:10:13.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:13.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj154 td/osd-backfill-space/datafile 2020-09-08T16:10:13.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:13.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj154 td/osd-backfill-space/datafile 2020-09-08T16:10:13.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:13.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj154 td/osd-backfill-space/datafile 2020-09-08T16:10:13.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:13.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj154 td/osd-backfill-space/datafile 2020-09-08T16:10:13.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:13.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj154 td/osd-backfill-space/datafile 2020-09-08T16:10:13.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:13.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj154 td/osd-backfill-space/datafile 2020-09-08T16:10:13.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:13.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj154 td/osd-backfill-space/datafile 2020-09-08T16:10:14.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:14.057 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:14.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:14.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj155 td/osd-backfill-space/datafile 2020-09-08T16:10:14.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:14.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj155 td/osd-backfill-space/datafile 2020-09-08T16:10:14.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:14.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj155 td/osd-backfill-space/datafile 2020-09-08T16:10:14.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:14.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj155 td/osd-backfill-space/datafile 2020-09-08T16:10:14.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:14.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj155 td/osd-backfill-space/datafile 2020-09-08T16:10:14.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:14.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj155 td/osd-backfill-space/datafile 2020-09-08T16:10:14.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:14.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj155 td/osd-backfill-space/datafile 2020-09-08T16:10:14.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:14.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj155 td/osd-backfill-space/datafile 2020-09-08T16:10:14.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:14.745 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:14.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:14.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj156 td/osd-backfill-space/datafile 2020-09-08T16:10:14.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:14.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj156 td/osd-backfill-space/datafile 2020-09-08T16:10:14.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:14.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj156 td/osd-backfill-space/datafile 2020-09-08T16:10:14.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:14.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj156 td/osd-backfill-space/datafile 2020-09-08T16:10:15.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:15.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj156 td/osd-backfill-space/datafile 2020-09-08T16:10:15.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:15.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj156 td/osd-backfill-space/datafile 2020-09-08T16:10:15.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:15.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj156 td/osd-backfill-space/datafile 2020-09-08T16:10:15.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:15.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj156 td/osd-backfill-space/datafile 2020-09-08T16:10:15.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:15.389 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:15.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:15.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj157 td/osd-backfill-space/datafile 2020-09-08T16:10:15.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:15.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj157 td/osd-backfill-space/datafile 2020-09-08T16:10:15.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:15.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj157 td/osd-backfill-space/datafile 2020-09-08T16:10:15.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:15.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj157 td/osd-backfill-space/datafile 2020-09-08T16:10:15.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:15.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj157 td/osd-backfill-space/datafile 2020-09-08T16:10:15.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:15.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj157 td/osd-backfill-space/datafile 2020-09-08T16:10:15.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:15.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj157 td/osd-backfill-space/datafile 2020-09-08T16:10:15.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:15.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj157 td/osd-backfill-space/datafile 2020-09-08T16:10:16.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:16.009 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:16.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:16.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj158 td/osd-backfill-space/datafile 2020-09-08T16:10:16.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:16.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj158 td/osd-backfill-space/datafile 2020-09-08T16:10:16.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:16.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj158 td/osd-backfill-space/datafile 2020-09-08T16:10:16.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:16.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj158 td/osd-backfill-space/datafile 2020-09-08T16:10:16.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:16.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj158 td/osd-backfill-space/datafile 2020-09-08T16:10:16.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:16.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj158 td/osd-backfill-space/datafile 2020-09-08T16:10:16.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:16.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj158 td/osd-backfill-space/datafile 2020-09-08T16:10:16.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:16.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj158 td/osd-backfill-space/datafile 2020-09-08T16:10:16.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:16.704 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:16.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:16.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj159 td/osd-backfill-space/datafile 2020-09-08T16:10:16.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:16.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj159 td/osd-backfill-space/datafile 2020-09-08T16:10:16.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:16.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj159 td/osd-backfill-space/datafile 2020-09-08T16:10:16.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:16.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj159 td/osd-backfill-space/datafile 2020-09-08T16:10:17.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:17.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj159 td/osd-backfill-space/datafile 2020-09-08T16:10:17.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:17.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj159 td/osd-backfill-space/datafile 2020-09-08T16:10:17.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:17.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj159 td/osd-backfill-space/datafile 2020-09-08T16:10:17.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:17.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj159 td/osd-backfill-space/datafile 2020-09-08T16:10:17.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:17.335 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:17.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:17.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj160 td/osd-backfill-space/datafile 2020-09-08T16:10:17.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:17.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj160 td/osd-backfill-space/datafile 2020-09-08T16:10:17.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:17.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj160 td/osd-backfill-space/datafile 2020-09-08T16:10:17.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:17.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj160 td/osd-backfill-space/datafile 2020-09-08T16:10:17.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:17.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj160 td/osd-backfill-space/datafile 2020-09-08T16:10:17.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:17.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj160 td/osd-backfill-space/datafile 2020-09-08T16:10:17.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:17.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj160 td/osd-backfill-space/datafile 2020-09-08T16:10:18.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:18.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj160 td/osd-backfill-space/datafile 2020-09-08T16:10:18.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:18.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:18.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:18.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj161 td/osd-backfill-space/datafile 2020-09-08T16:10:18.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:18.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj161 td/osd-backfill-space/datafile 2020-09-08T16:10:18.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:18.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj161 td/osd-backfill-space/datafile 2020-09-08T16:10:18.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:18.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj161 td/osd-backfill-space/datafile 2020-09-08T16:10:18.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:18.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj161 td/osd-backfill-space/datafile 2020-09-08T16:10:18.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:18.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj161 td/osd-backfill-space/datafile 2020-09-08T16:10:18.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:18.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj161 td/osd-backfill-space/datafile 2020-09-08T16:10:18.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:18.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj161 td/osd-backfill-space/datafile 2020-09-08T16:10:18.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:18.773 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:18.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:18.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj162 td/osd-backfill-space/datafile 2020-09-08T16:10:18.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:18.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj162 td/osd-backfill-space/datafile 2020-09-08T16:10:18.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:18.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj162 td/osd-backfill-space/datafile 2020-09-08T16:10:19.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:19.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj162 td/osd-backfill-space/datafile 2020-09-08T16:10:19.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:19.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj162 td/osd-backfill-space/datafile 2020-09-08T16:10:19.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:19.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj162 td/osd-backfill-space/datafile 2020-09-08T16:10:19.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:19.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj162 td/osd-backfill-space/datafile 2020-09-08T16:10:19.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:19.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj162 td/osd-backfill-space/datafile 2020-09-08T16:10:19.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:19.409 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:19.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:19.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj163 td/osd-backfill-space/datafile 2020-09-08T16:10:19.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:19.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj163 td/osd-backfill-space/datafile 2020-09-08T16:10:19.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:19.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj163 td/osd-backfill-space/datafile 2020-09-08T16:10:19.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:19.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj163 td/osd-backfill-space/datafile 2020-09-08T16:10:19.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:19.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj163 td/osd-backfill-space/datafile 2020-09-08T16:10:19.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:19.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj163 td/osd-backfill-space/datafile 2020-09-08T16:10:19.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:19.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj163 td/osd-backfill-space/datafile 2020-09-08T16:10:19.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:19.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj163 td/osd-backfill-space/datafile 2020-09-08T16:10:20.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:20.054 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:20.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:20.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj164 td/osd-backfill-space/datafile 2020-09-08T16:10:20.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:20.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj164 td/osd-backfill-space/datafile 2020-09-08T16:10:20.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:20.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj164 td/osd-backfill-space/datafile 2020-09-08T16:10:20.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:20.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj164 td/osd-backfill-space/datafile 2020-09-08T16:10:20.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:20.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj164 td/osd-backfill-space/datafile 2020-09-08T16:10:20.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:20.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj164 td/osd-backfill-space/datafile 2020-09-08T16:10:20.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:20.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj164 td/osd-backfill-space/datafile 2020-09-08T16:10:20.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:20.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj164 td/osd-backfill-space/datafile 2020-09-08T16:10:20.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:20.767 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:20.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:20.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj165 td/osd-backfill-space/datafile 2020-09-08T16:10:20.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:20.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj165 td/osd-backfill-space/datafile 2020-09-08T16:10:20.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:20.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj165 td/osd-backfill-space/datafile 2020-09-08T16:10:21.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:21.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj165 td/osd-backfill-space/datafile 2020-09-08T16:10:21.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:21.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj165 td/osd-backfill-space/datafile 2020-09-08T16:10:21.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:21.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj165 td/osd-backfill-space/datafile 2020-09-08T16:10:21.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:21.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj165 td/osd-backfill-space/datafile 2020-09-08T16:10:21.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:21.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj165 td/osd-backfill-space/datafile 2020-09-08T16:10:21.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:21.428 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:21.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:21.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj166 td/osd-backfill-space/datafile 2020-09-08T16:10:21.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:21.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj166 td/osd-backfill-space/datafile 2020-09-08T16:10:21.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:21.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj166 td/osd-backfill-space/datafile 2020-09-08T16:10:21.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:21.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj166 td/osd-backfill-space/datafile 2020-09-08T16:10:21.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:21.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj166 td/osd-backfill-space/datafile 2020-09-08T16:10:21.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:21.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj166 td/osd-backfill-space/datafile 2020-09-08T16:10:21.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:21.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj166 td/osd-backfill-space/datafile 2020-09-08T16:10:21.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:21.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj166 td/osd-backfill-space/datafile 2020-09-08T16:10:22.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:22.040 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:22.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:22.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj167 td/osd-backfill-space/datafile 2020-09-08T16:10:22.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:22.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj167 td/osd-backfill-space/datafile 2020-09-08T16:10:22.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:22.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj167 td/osd-backfill-space/datafile 2020-09-08T16:10:22.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:22.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj167 td/osd-backfill-space/datafile 2020-09-08T16:10:22.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:22.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj167 td/osd-backfill-space/datafile 2020-09-08T16:10:22.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:22.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj167 td/osd-backfill-space/datafile 2020-09-08T16:10:22.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:22.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj167 td/osd-backfill-space/datafile 2020-09-08T16:10:22.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:22.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj167 td/osd-backfill-space/datafile 2020-09-08T16:10:22.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:22.843 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:22.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:22.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj168 td/osd-backfill-space/datafile 2020-09-08T16:10:22.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:22.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj168 td/osd-backfill-space/datafile 2020-09-08T16:10:23.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:23.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj168 td/osd-backfill-space/datafile 2020-09-08T16:10:23.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:23.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj168 td/osd-backfill-space/datafile 2020-09-08T16:10:23.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:23.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj168 td/osd-backfill-space/datafile 2020-09-08T16:10:23.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:23.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj168 td/osd-backfill-space/datafile 2020-09-08T16:10:23.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:23.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj168 td/osd-backfill-space/datafile 2020-09-08T16:10:23.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:23.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj168 td/osd-backfill-space/datafile 2020-09-08T16:10:23.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:23.472 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:23.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:23.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj169 td/osd-backfill-space/datafile 2020-09-08T16:10:23.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:23.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj169 td/osd-backfill-space/datafile 2020-09-08T16:10:23.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:23.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj169 td/osd-backfill-space/datafile 2020-09-08T16:10:23.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:23.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj169 td/osd-backfill-space/datafile 2020-09-08T16:10:23.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:23.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj169 td/osd-backfill-space/datafile 2020-09-08T16:10:23.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:23.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj169 td/osd-backfill-space/datafile 2020-09-08T16:10:23.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:23.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj169 td/osd-backfill-space/datafile 2020-09-08T16:10:24.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:24.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj169 td/osd-backfill-space/datafile 2020-09-08T16:10:24.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:24.091 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:24.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:24.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj170 td/osd-backfill-space/datafile 2020-09-08T16:10:24.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:24.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj170 td/osd-backfill-space/datafile 2020-09-08T16:10:24.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:24.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj170 td/osd-backfill-space/datafile 2020-09-08T16:10:24.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:24.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj170 td/osd-backfill-space/datafile 2020-09-08T16:10:24.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:24.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj170 td/osd-backfill-space/datafile 2020-09-08T16:10:24.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:24.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj170 td/osd-backfill-space/datafile 2020-09-08T16:10:24.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:24.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj170 td/osd-backfill-space/datafile 2020-09-08T16:10:24.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:24.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj170 td/osd-backfill-space/datafile 2020-09-08T16:10:24.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:24.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:24.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:24.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj171 td/osd-backfill-space/datafile 2020-09-08T16:10:24.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:24.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj171 td/osd-backfill-space/datafile 2020-09-08T16:10:24.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:24.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj171 td/osd-backfill-space/datafile 2020-09-08T16:10:25.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:25.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj171 td/osd-backfill-space/datafile 2020-09-08T16:10:25.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:25.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj171 td/osd-backfill-space/datafile 2020-09-08T16:10:25.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:25.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj171 td/osd-backfill-space/datafile 2020-09-08T16:10:25.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:25.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj171 td/osd-backfill-space/datafile 2020-09-08T16:10:25.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:25.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj171 td/osd-backfill-space/datafile 2020-09-08T16:10:25.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:25.415 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:25.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:25.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj172 td/osd-backfill-space/datafile 2020-09-08T16:10:25.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:25.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj172 td/osd-backfill-space/datafile 2020-09-08T16:10:25.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:25.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj172 td/osd-backfill-space/datafile 2020-09-08T16:10:25.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:25.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj172 td/osd-backfill-space/datafile 2020-09-08T16:10:25.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:25.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj172 td/osd-backfill-space/datafile 2020-09-08T16:10:25.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:25.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj172 td/osd-backfill-space/datafile 2020-09-08T16:10:25.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:25.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj172 td/osd-backfill-space/datafile 2020-09-08T16:10:25.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:25.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj172 td/osd-backfill-space/datafile 2020-09-08T16:10:26.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:26.051 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:26.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:26.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj173 td/osd-backfill-space/datafile 2020-09-08T16:10:26.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:26.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj173 td/osd-backfill-space/datafile 2020-09-08T16:10:26.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:26.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj173 td/osd-backfill-space/datafile 2020-09-08T16:10:26.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:26.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj173 td/osd-backfill-space/datafile 2020-09-08T16:10:26.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:26.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj173 td/osd-backfill-space/datafile 2020-09-08T16:10:26.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:26.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj173 td/osd-backfill-space/datafile 2020-09-08T16:10:26.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:26.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj173 td/osd-backfill-space/datafile 2020-09-08T16:10:26.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:26.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj173 td/osd-backfill-space/datafile 2020-09-08T16:10:26.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:26.755 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:26.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:26.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj174 td/osd-backfill-space/datafile 2020-09-08T16:10:26.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:26.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj174 td/osd-backfill-space/datafile 2020-09-08T16:10:26.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:26.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj174 td/osd-backfill-space/datafile 2020-09-08T16:10:26.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:26.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj174 td/osd-backfill-space/datafile 2020-09-08T16:10:27.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:27.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj174 td/osd-backfill-space/datafile 2020-09-08T16:10:27.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:27.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj174 td/osd-backfill-space/datafile 2020-09-08T16:10:27.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:27.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj174 td/osd-backfill-space/datafile 2020-09-08T16:10:27.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:27.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj174 td/osd-backfill-space/datafile 2020-09-08T16:10:27.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:27.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:27.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:27.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj175 td/osd-backfill-space/datafile 2020-09-08T16:10:27.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:27.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj175 td/osd-backfill-space/datafile 2020-09-08T16:10:27.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:27.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj175 td/osd-backfill-space/datafile 2020-09-08T16:10:27.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:27.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj175 td/osd-backfill-space/datafile 2020-09-08T16:10:27.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:27.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj175 td/osd-backfill-space/datafile 2020-09-08T16:10:27.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:27.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj175 td/osd-backfill-space/datafile 2020-09-08T16:10:27.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:27.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj175 td/osd-backfill-space/datafile 2020-09-08T16:10:27.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:27.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj175 td/osd-backfill-space/datafile 2020-09-08T16:10:28.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:28.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:28.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:28.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj176 td/osd-backfill-space/datafile 2020-09-08T16:10:28.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:28.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj176 td/osd-backfill-space/datafile 2020-09-08T16:10:28.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:28.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj176 td/osd-backfill-space/datafile 2020-09-08T16:10:28.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:28.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj176 td/osd-backfill-space/datafile 2020-09-08T16:10:28.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:28.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj176 td/osd-backfill-space/datafile 2020-09-08T16:10:28.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:28.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj176 td/osd-backfill-space/datafile 2020-09-08T16:10:28.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:28.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj176 td/osd-backfill-space/datafile 2020-09-08T16:10:28.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:28.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj176 td/osd-backfill-space/datafile 2020-09-08T16:10:28.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:28.682 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:28.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:28.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj177 td/osd-backfill-space/datafile 2020-09-08T16:10:28.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:28.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj177 td/osd-backfill-space/datafile 2020-09-08T16:10:28.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:28.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj177 td/osd-backfill-space/datafile 2020-09-08T16:10:28.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:28.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj177 td/osd-backfill-space/datafile 2020-09-08T16:10:29.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:29.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj177 td/osd-backfill-space/datafile 2020-09-08T16:10:29.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:29.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj177 td/osd-backfill-space/datafile 2020-09-08T16:10:29.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:29.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj177 td/osd-backfill-space/datafile 2020-09-08T16:10:29.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:29.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj177 td/osd-backfill-space/datafile 2020-09-08T16:10:29.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:29.326 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:29.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:29.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj178 td/osd-backfill-space/datafile 2020-09-08T16:10:29.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:29.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj178 td/osd-backfill-space/datafile 2020-09-08T16:10:29.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:29.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj178 td/osd-backfill-space/datafile 2020-09-08T16:10:29.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:29.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj178 td/osd-backfill-space/datafile 2020-09-08T16:10:29.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:29.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj178 td/osd-backfill-space/datafile 2020-09-08T16:10:29.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:29.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj178 td/osd-backfill-space/datafile 2020-09-08T16:10:29.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:29.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj178 td/osd-backfill-space/datafile 2020-09-08T16:10:29.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:29.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj178 td/osd-backfill-space/datafile 2020-09-08T16:10:29.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:29.946 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:29.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:29.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj179 td/osd-backfill-space/datafile 2020-09-08T16:10:30.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:30.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj179 td/osd-backfill-space/datafile 2020-09-08T16:10:30.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:30.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj179 td/osd-backfill-space/datafile 2020-09-08T16:10:30.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:30.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj179 td/osd-backfill-space/datafile 2020-09-08T16:10:30.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:30.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj179 td/osd-backfill-space/datafile 2020-09-08T16:10:30.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:30.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj179 td/osd-backfill-space/datafile 2020-09-08T16:10:30.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:30.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj179 td/osd-backfill-space/datafile 2020-09-08T16:10:30.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:30.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj179 td/osd-backfill-space/datafile 2020-09-08T16:10:30.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:30.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:30.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:30.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj180 td/osd-backfill-space/datafile 2020-09-08T16:10:30.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:30.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj180 td/osd-backfill-space/datafile 2020-09-08T16:10:30.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:30.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj180 td/osd-backfill-space/datafile 2020-09-08T16:10:30.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:30.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj180 td/osd-backfill-space/datafile 2020-09-08T16:10:30.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:31.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj180 td/osd-backfill-space/datafile 2020-09-08T16:10:31.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:31.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj180 td/osd-backfill-space/datafile 2020-09-08T16:10:31.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:31.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj180 td/osd-backfill-space/datafile 2020-09-08T16:10:31.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:31.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj180 td/osd-backfill-space/datafile 2020-09-08T16:10:31.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:31.253 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:31.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:31.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj181 td/osd-backfill-space/datafile 2020-09-08T16:10:31.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:31.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj181 td/osd-backfill-space/datafile 2020-09-08T16:10:31.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:31.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj181 td/osd-backfill-space/datafile 2020-09-08T16:10:31.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:31.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj181 td/osd-backfill-space/datafile 2020-09-08T16:10:31.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:31.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj181 td/osd-backfill-space/datafile 2020-09-08T16:10:31.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:31.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj181 td/osd-backfill-space/datafile 2020-09-08T16:10:31.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:31.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj181 td/osd-backfill-space/datafile 2020-09-08T16:10:31.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:31.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj181 td/osd-backfill-space/datafile 2020-09-08T16:10:31.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:31.877 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:31.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:31.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj182 td/osd-backfill-space/datafile 2020-09-08T16:10:31.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:31.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj182 td/osd-backfill-space/datafile 2020-09-08T16:10:32.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:32.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj182 td/osd-backfill-space/datafile 2020-09-08T16:10:32.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:32.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj182 td/osd-backfill-space/datafile 2020-09-08T16:10:32.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:32.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj182 td/osd-backfill-space/datafile 2020-09-08T16:10:32.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:32.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj182 td/osd-backfill-space/datafile 2020-09-08T16:10:32.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:32.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj182 td/osd-backfill-space/datafile 2020-09-08T16:10:32.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:32.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj182 td/osd-backfill-space/datafile 2020-09-08T16:10:32.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:32.560 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:32.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:32.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj183 td/osd-backfill-space/datafile 2020-09-08T16:10:32.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:32.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj183 td/osd-backfill-space/datafile 2020-09-08T16:10:32.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:32.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj183 td/osd-backfill-space/datafile 2020-09-08T16:10:32.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:32.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj183 td/osd-backfill-space/datafile 2020-09-08T16:10:32.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:32.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj183 td/osd-backfill-space/datafile 2020-09-08T16:10:33.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:33.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj183 td/osd-backfill-space/datafile 2020-09-08T16:10:33.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:33.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj183 td/osd-backfill-space/datafile 2020-09-08T16:10:33.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:33.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj183 td/osd-backfill-space/datafile 2020-09-08T16:10:33.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:33.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:33.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:33.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj184 td/osd-backfill-space/datafile 2020-09-08T16:10:33.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:33.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj184 td/osd-backfill-space/datafile 2020-09-08T16:10:33.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:33.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj184 td/osd-backfill-space/datafile 2020-09-08T16:10:33.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:33.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj184 td/osd-backfill-space/datafile 2020-09-08T16:10:33.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:33.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj184 td/osd-backfill-space/datafile 2020-09-08T16:10:33.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:33.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj184 td/osd-backfill-space/datafile 2020-09-08T16:10:33.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:33.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj184 td/osd-backfill-space/datafile 2020-09-08T16:10:33.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:33.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj184 td/osd-backfill-space/datafile 2020-09-08T16:10:33.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:33.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:33.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:33.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj185 td/osd-backfill-space/datafile 2020-09-08T16:10:33.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:33.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj185 td/osd-backfill-space/datafile 2020-09-08T16:10:34.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:34.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj185 td/osd-backfill-space/datafile 2020-09-08T16:10:34.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:34.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj185 td/osd-backfill-space/datafile 2020-09-08T16:10:34.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:34.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj185 td/osd-backfill-space/datafile 2020-09-08T16:10:34.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:34.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj185 td/osd-backfill-space/datafile 2020-09-08T16:10:34.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:34.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj185 td/osd-backfill-space/datafile 2020-09-08T16:10:34.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:34.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj185 td/osd-backfill-space/datafile 2020-09-08T16:10:34.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:34.598 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:34.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:34.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj186 td/osd-backfill-space/datafile 2020-09-08T16:10:34.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:34.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj186 td/osd-backfill-space/datafile 2020-09-08T16:10:34.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:34.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj186 td/osd-backfill-space/datafile 2020-09-08T16:10:34.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:34.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj186 td/osd-backfill-space/datafile 2020-09-08T16:10:34.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:34.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj186 td/osd-backfill-space/datafile 2020-09-08T16:10:34.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:34.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj186 td/osd-backfill-space/datafile 2020-09-08T16:10:35.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:35.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj186 td/osd-backfill-space/datafile 2020-09-08T16:10:35.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:35.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj186 td/osd-backfill-space/datafile 2020-09-08T16:10:35.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:35.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:35.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:35.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj187 td/osd-backfill-space/datafile 2020-09-08T16:10:35.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:35.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj187 td/osd-backfill-space/datafile 2020-09-08T16:10:35.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:35.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj187 td/osd-backfill-space/datafile 2020-09-08T16:10:35.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:35.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj187 td/osd-backfill-space/datafile 2020-09-08T16:10:35.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:35.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj187 td/osd-backfill-space/datafile 2020-09-08T16:10:35.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:35.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj187 td/osd-backfill-space/datafile 2020-09-08T16:10:35.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:35.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj187 td/osd-backfill-space/datafile 2020-09-08T16:10:35.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:35.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj187 td/osd-backfill-space/datafile 2020-09-08T16:10:35.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:35.852 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:35.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:35.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj188 td/osd-backfill-space/datafile 2020-09-08T16:10:35.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:35.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj188 td/osd-backfill-space/datafile 2020-09-08T16:10:36.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:36.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj188 td/osd-backfill-space/datafile 2020-09-08T16:10:36.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:36.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj188 td/osd-backfill-space/datafile 2020-09-08T16:10:36.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:36.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj188 td/osd-backfill-space/datafile 2020-09-08T16:10:36.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:36.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj188 td/osd-backfill-space/datafile 2020-09-08T16:10:36.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:36.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj188 td/osd-backfill-space/datafile 2020-09-08T16:10:36.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:36.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj188 td/osd-backfill-space/datafile 2020-09-08T16:10:36.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:36.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:36.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:36.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj189 td/osd-backfill-space/datafile 2020-09-08T16:10:36.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:36.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj189 td/osd-backfill-space/datafile 2020-09-08T16:10:36.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:36.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj189 td/osd-backfill-space/datafile 2020-09-08T16:10:36.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:36.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj189 td/osd-backfill-space/datafile 2020-09-08T16:10:36.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:36.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj189 td/osd-backfill-space/datafile 2020-09-08T16:10:36.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:36.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj189 td/osd-backfill-space/datafile 2020-09-08T16:10:37.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:37.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj189 td/osd-backfill-space/datafile 2020-09-08T16:10:37.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:37.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj189 td/osd-backfill-space/datafile 2020-09-08T16:10:37.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:37.225 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:37.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:37.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj190 td/osd-backfill-space/datafile 2020-09-08T16:10:37.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:37.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj190 td/osd-backfill-space/datafile 2020-09-08T16:10:37.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:37.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj190 td/osd-backfill-space/datafile 2020-09-08T16:10:37.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:37.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj190 td/osd-backfill-space/datafile 2020-09-08T16:10:37.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:37.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj190 td/osd-backfill-space/datafile 2020-09-08T16:10:37.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:37.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj190 td/osd-backfill-space/datafile 2020-09-08T16:10:37.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:37.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj190 td/osd-backfill-space/datafile 2020-09-08T16:10:37.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:37.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj190 td/osd-backfill-space/datafile 2020-09-08T16:10:37.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:37.837 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:37.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:37.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj191 td/osd-backfill-space/datafile 2020-09-08T16:10:37.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:37.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj191 td/osd-backfill-space/datafile 2020-09-08T16:10:38.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:38.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj191 td/osd-backfill-space/datafile 2020-09-08T16:10:38.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:38.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj191 td/osd-backfill-space/datafile 2020-09-08T16:10:38.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:38.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj191 td/osd-backfill-space/datafile 2020-09-08T16:10:38.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:38.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj191 td/osd-backfill-space/datafile 2020-09-08T16:10:38.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:38.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj191 td/osd-backfill-space/datafile 2020-09-08T16:10:38.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:38.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj191 td/osd-backfill-space/datafile 2020-09-08T16:10:38.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:38.578 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:38.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:38.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj192 td/osd-backfill-space/datafile 2020-09-08T16:10:38.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:38.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj192 td/osd-backfill-space/datafile 2020-09-08T16:10:38.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:38.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj192 td/osd-backfill-space/datafile 2020-09-08T16:10:38.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:38.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj192 td/osd-backfill-space/datafile 2020-09-08T16:10:38.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:38.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj192 td/osd-backfill-space/datafile 2020-09-08T16:10:38.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:38.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj192 td/osd-backfill-space/datafile 2020-09-08T16:10:39.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:39.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj192 td/osd-backfill-space/datafile 2020-09-08T16:10:39.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:39.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj192 td/osd-backfill-space/datafile 2020-09-08T16:10:39.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:39.210 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:39.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:39.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj193 td/osd-backfill-space/datafile 2020-09-08T16:10:39.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:39.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj193 td/osd-backfill-space/datafile 2020-09-08T16:10:39.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:39.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj193 td/osd-backfill-space/datafile 2020-09-08T16:10:39.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:39.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj193 td/osd-backfill-space/datafile 2020-09-08T16:10:39.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:39.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj193 td/osd-backfill-space/datafile 2020-09-08T16:10:39.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:39.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj193 td/osd-backfill-space/datafile 2020-09-08T16:10:39.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:39.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj193 td/osd-backfill-space/datafile 2020-09-08T16:10:39.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:39.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj193 td/osd-backfill-space/datafile 2020-09-08T16:10:39.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:39.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:39.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:39.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj194 td/osd-backfill-space/datafile 2020-09-08T16:10:39.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:39.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj194 td/osd-backfill-space/datafile 2020-09-08T16:10:39.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:39.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj194 td/osd-backfill-space/datafile 2020-09-08T16:10:40.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:40.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj194 td/osd-backfill-space/datafile 2020-09-08T16:10:40.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:40.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj194 td/osd-backfill-space/datafile 2020-09-08T16:10:40.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:40.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj194 td/osd-backfill-space/datafile 2020-09-08T16:10:40.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:40.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj194 td/osd-backfill-space/datafile 2020-09-08T16:10:40.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:40.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj194 td/osd-backfill-space/datafile 2020-09-08T16:10:40.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:40.593 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:40.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:40.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj195 td/osd-backfill-space/datafile 2020-09-08T16:10:40.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:40.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj195 td/osd-backfill-space/datafile 2020-09-08T16:10:40.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:40.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj195 td/osd-backfill-space/datafile 2020-09-08T16:10:40.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:40.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj195 td/osd-backfill-space/datafile 2020-09-08T16:10:40.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:40.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj195 td/osd-backfill-space/datafile 2020-09-08T16:10:40.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:40.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj195 td/osd-backfill-space/datafile 2020-09-08T16:10:41.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:41.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj195 td/osd-backfill-space/datafile 2020-09-08T16:10:41.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:41.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj195 td/osd-backfill-space/datafile 2020-09-08T16:10:41.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:41.237 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:41.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:41.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj196 td/osd-backfill-space/datafile 2020-09-08T16:10:41.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:41.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj196 td/osd-backfill-space/datafile 2020-09-08T16:10:41.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:41.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj196 td/osd-backfill-space/datafile 2020-09-08T16:10:41.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:41.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj196 td/osd-backfill-space/datafile 2020-09-08T16:10:41.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:41.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj196 td/osd-backfill-space/datafile 2020-09-08T16:10:41.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:41.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj196 td/osd-backfill-space/datafile 2020-09-08T16:10:41.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:41.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj196 td/osd-backfill-space/datafile 2020-09-08T16:10:41.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:41.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj196 td/osd-backfill-space/datafile 2020-09-08T16:10:41.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:41.851 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:41.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:41.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj197 td/osd-backfill-space/datafile 2020-09-08T16:10:41.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:41.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj197 td/osd-backfill-space/datafile 2020-09-08T16:10:42.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:42.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj197 td/osd-backfill-space/datafile 2020-09-08T16:10:42.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:42.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj197 td/osd-backfill-space/datafile 2020-09-08T16:10:42.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:42.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj197 td/osd-backfill-space/datafile 2020-09-08T16:10:42.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:42.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj197 td/osd-backfill-space/datafile 2020-09-08T16:10:42.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:42.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj197 td/osd-backfill-space/datafile 2020-09-08T16:10:42.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:42.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj197 td/osd-backfill-space/datafile 2020-09-08T16:10:42.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:42.494 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:42.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:42.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj198 td/osd-backfill-space/datafile 2020-09-08T16:10:42.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:42.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj198 td/osd-backfill-space/datafile 2020-09-08T16:10:42.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:42.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj198 td/osd-backfill-space/datafile 2020-09-08T16:10:42.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:42.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj198 td/osd-backfill-space/datafile 2020-09-08T16:10:42.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:42.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj198 td/osd-backfill-space/datafile 2020-09-08T16:10:42.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:42.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj198 td/osd-backfill-space/datafile 2020-09-08T16:10:42.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:42.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj198 td/osd-backfill-space/datafile 2020-09-08T16:10:43.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:43.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj198 td/osd-backfill-space/datafile 2020-09-08T16:10:43.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:43.398 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:43.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:43.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj199 td/osd-backfill-space/datafile 2020-09-08T16:10:43.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:43.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj199 td/osd-backfill-space/datafile 2020-09-08T16:10:43.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:43.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj199 td/osd-backfill-space/datafile 2020-09-08T16:10:43.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:43.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj199 td/osd-backfill-space/datafile 2020-09-08T16:10:43.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:43.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj199 td/osd-backfill-space/datafile 2020-09-08T16:10:43.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:43.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj199 td/osd-backfill-space/datafile 2020-09-08T16:10:43.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:43.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj199 td/osd-backfill-space/datafile 2020-09-08T16:10:43.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:43.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj199 td/osd-backfill-space/datafile 2020-09-08T16:10:44.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:44.034 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:44.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:44.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj200 td/osd-backfill-space/datafile 2020-09-08T16:10:44.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:44.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj200 td/osd-backfill-space/datafile 2020-09-08T16:10:44.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:44.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj200 td/osd-backfill-space/datafile 2020-09-08T16:10:44.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:44.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj200 td/osd-backfill-space/datafile 2020-09-08T16:10:44.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:44.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj200 td/osd-backfill-space/datafile 2020-09-08T16:10:44.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:44.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj200 td/osd-backfill-space/datafile 2020-09-08T16:10:44.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:44.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj200 td/osd-backfill-space/datafile 2020-09-08T16:10:44.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:44.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj200 td/osd-backfill-space/datafile 2020-09-08T16:10:44.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:44.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:44.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:44.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj201 td/osd-backfill-space/datafile 2020-09-08T16:10:44.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:44.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj201 td/osd-backfill-space/datafile 2020-09-08T16:10:44.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:44.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj201 td/osd-backfill-space/datafile 2020-09-08T16:10:44.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:44.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj201 td/osd-backfill-space/datafile 2020-09-08T16:10:45.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:45.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj201 td/osd-backfill-space/datafile 2020-09-08T16:10:45.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:45.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj201 td/osd-backfill-space/datafile 2020-09-08T16:10:45.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:45.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj201 td/osd-backfill-space/datafile 2020-09-08T16:10:45.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:45.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj201 td/osd-backfill-space/datafile 2020-09-08T16:10:45.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:45.349 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:45.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:45.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj202 td/osd-backfill-space/datafile 2020-09-08T16:10:45.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:45.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj202 td/osd-backfill-space/datafile 2020-09-08T16:10:45.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:45.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj202 td/osd-backfill-space/datafile 2020-09-08T16:10:45.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:45.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj202 td/osd-backfill-space/datafile 2020-09-08T16:10:45.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:45.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj202 td/osd-backfill-space/datafile 2020-09-08T16:10:45.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:45.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj202 td/osd-backfill-space/datafile 2020-09-08T16:10:45.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:45.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj202 td/osd-backfill-space/datafile 2020-09-08T16:10:45.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:45.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj202 td/osd-backfill-space/datafile 2020-09-08T16:10:45.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:45.995 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:45.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:45.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj203 td/osd-backfill-space/datafile 2020-09-08T16:10:46.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:46.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj203 td/osd-backfill-space/datafile 2020-09-08T16:10:46.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:46.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj203 td/osd-backfill-space/datafile 2020-09-08T16:10:46.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:46.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj203 td/osd-backfill-space/datafile 2020-09-08T16:10:46.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:46.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj203 td/osd-backfill-space/datafile 2020-09-08T16:10:46.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:46.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj203 td/osd-backfill-space/datafile 2020-09-08T16:10:46.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:46.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj203 td/osd-backfill-space/datafile 2020-09-08T16:10:46.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:46.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj203 td/osd-backfill-space/datafile 2020-09-08T16:10:46.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:46.673 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:46.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:46.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj204 td/osd-backfill-space/datafile 2020-09-08T16:10:46.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:46.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj204 td/osd-backfill-space/datafile 2020-09-08T16:10:46.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:46.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj204 td/osd-backfill-space/datafile 2020-09-08T16:10:46.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:46.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj204 td/osd-backfill-space/datafile 2020-09-08T16:10:47.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:47.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj204 td/osd-backfill-space/datafile 2020-09-08T16:10:47.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:47.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj204 td/osd-backfill-space/datafile 2020-09-08T16:10:47.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:47.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj204 td/osd-backfill-space/datafile 2020-09-08T16:10:47.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:47.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj204 td/osd-backfill-space/datafile 2020-09-08T16:10:47.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:47.334 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:47.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:47.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj205 td/osd-backfill-space/datafile 2020-09-08T16:10:47.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:47.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj205 td/osd-backfill-space/datafile 2020-09-08T16:10:47.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:47.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj205 td/osd-backfill-space/datafile 2020-09-08T16:10:47.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:47.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj205 td/osd-backfill-space/datafile 2020-09-08T16:10:47.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:47.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj205 td/osd-backfill-space/datafile 2020-09-08T16:10:47.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:47.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj205 td/osd-backfill-space/datafile 2020-09-08T16:10:47.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:47.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj205 td/osd-backfill-space/datafile 2020-09-08T16:10:47.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:47.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj205 td/osd-backfill-space/datafile 2020-09-08T16:10:47.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:47.946 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:47.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:47.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj206 td/osd-backfill-space/datafile 2020-09-08T16:10:48.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:48.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj206 td/osd-backfill-space/datafile 2020-09-08T16:10:48.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:48.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj206 td/osd-backfill-space/datafile 2020-09-08T16:10:48.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:48.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj206 td/osd-backfill-space/datafile 2020-09-08T16:10:48.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:48.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj206 td/osd-backfill-space/datafile 2020-09-08T16:10:48.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:48.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj206 td/osd-backfill-space/datafile 2020-09-08T16:10:48.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:48.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj206 td/osd-backfill-space/datafile 2020-09-08T16:10:48.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:48.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj206 td/osd-backfill-space/datafile 2020-09-08T16:10:48.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:48.633 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:48.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:48.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj207 td/osd-backfill-space/datafile 2020-09-08T16:10:48.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:48.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj207 td/osd-backfill-space/datafile 2020-09-08T16:10:48.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:48.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj207 td/osd-backfill-space/datafile 2020-09-08T16:10:48.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:48.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj207 td/osd-backfill-space/datafile 2020-09-08T16:10:49.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:49.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj207 td/osd-backfill-space/datafile 2020-09-08T16:10:49.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:49.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj207 td/osd-backfill-space/datafile 2020-09-08T16:10:49.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:49.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj207 td/osd-backfill-space/datafile 2020-09-08T16:10:49.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:49.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj207 td/osd-backfill-space/datafile 2020-09-08T16:10:49.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:49.378 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:49.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:49.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj208 td/osd-backfill-space/datafile 2020-09-08T16:10:49.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:49.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj208 td/osd-backfill-space/datafile 2020-09-08T16:10:49.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:49.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj208 td/osd-backfill-space/datafile 2020-09-08T16:10:49.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:49.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj208 td/osd-backfill-space/datafile 2020-09-08T16:10:49.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:49.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj208 td/osd-backfill-space/datafile 2020-09-08T16:10:49.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:49.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj208 td/osd-backfill-space/datafile 2020-09-08T16:10:49.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:49.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj208 td/osd-backfill-space/datafile 2020-09-08T16:10:49.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:49.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj208 td/osd-backfill-space/datafile 2020-09-08T16:10:50.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:50.039 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:50.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:50.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj209 td/osd-backfill-space/datafile 2020-09-08T16:10:50.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:50.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj209 td/osd-backfill-space/datafile 2020-09-08T16:10:50.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:50.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj209 td/osd-backfill-space/datafile 2020-09-08T16:10:50.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:50.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj209 td/osd-backfill-space/datafile 2020-09-08T16:10:50.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:50.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj209 td/osd-backfill-space/datafile 2020-09-08T16:10:50.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:50.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj209 td/osd-backfill-space/datafile 2020-09-08T16:10:50.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:50.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj209 td/osd-backfill-space/datafile 2020-09-08T16:10:50.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:50.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj209 td/osd-backfill-space/datafile 2020-09-08T16:10:50.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:50.737 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:50.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:50.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj210 td/osd-backfill-space/datafile 2020-09-08T16:10:50.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:50.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj210 td/osd-backfill-space/datafile 2020-09-08T16:10:50.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:50.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj210 td/osd-backfill-space/datafile 2020-09-08T16:10:50.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:50.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj210 td/osd-backfill-space/datafile 2020-09-08T16:10:51.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:51.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj210 td/osd-backfill-space/datafile 2020-09-08T16:10:51.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:51.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj210 td/osd-backfill-space/datafile 2020-09-08T16:10:51.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:51.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj210 td/osd-backfill-space/datafile 2020-09-08T16:10:51.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:51.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj210 td/osd-backfill-space/datafile 2020-09-08T16:10:51.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:51.372 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:51.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:51.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj211 td/osd-backfill-space/datafile 2020-09-08T16:10:51.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:51.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj211 td/osd-backfill-space/datafile 2020-09-08T16:10:51.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:51.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj211 td/osd-backfill-space/datafile 2020-09-08T16:10:51.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:51.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj211 td/osd-backfill-space/datafile 2020-09-08T16:10:51.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:51.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj211 td/osd-backfill-space/datafile 2020-09-08T16:10:51.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:51.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj211 td/osd-backfill-space/datafile 2020-09-08T16:10:51.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:51.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj211 td/osd-backfill-space/datafile 2020-09-08T16:10:51.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:51.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj211 td/osd-backfill-space/datafile 2020-09-08T16:10:52.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:52.033 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:52.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:52.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj212 td/osd-backfill-space/datafile 2020-09-08T16:10:52.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:52.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj212 td/osd-backfill-space/datafile 2020-09-08T16:10:52.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:52.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj212 td/osd-backfill-space/datafile 2020-09-08T16:10:52.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:52.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj212 td/osd-backfill-space/datafile 2020-09-08T16:10:52.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:52.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj212 td/osd-backfill-space/datafile 2020-09-08T16:10:52.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:52.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj212 td/osd-backfill-space/datafile 2020-09-08T16:10:52.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:52.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj212 td/osd-backfill-space/datafile 2020-09-08T16:10:52.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:52.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj212 td/osd-backfill-space/datafile 2020-09-08T16:10:52.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:52.720 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:52.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:52.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj213 td/osd-backfill-space/datafile 2020-09-08T16:10:52.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:52.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj213 td/osd-backfill-space/datafile 2020-09-08T16:10:52.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:52.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj213 td/osd-backfill-space/datafile 2020-09-08T16:10:52.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:52.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj213 td/osd-backfill-space/datafile 2020-09-08T16:10:53.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:53.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj213 td/osd-backfill-space/datafile 2020-09-08T16:10:53.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:53.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj213 td/osd-backfill-space/datafile 2020-09-08T16:10:53.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:53.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj213 td/osd-backfill-space/datafile 2020-09-08T16:10:53.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:53.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj213 td/osd-backfill-space/datafile 2020-09-08T16:10:53.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:53.348 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:53.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:53.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj214 td/osd-backfill-space/datafile 2020-09-08T16:10:53.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:53.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj214 td/osd-backfill-space/datafile 2020-09-08T16:10:53.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:53.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj214 td/osd-backfill-space/datafile 2020-09-08T16:10:53.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:53.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj214 td/osd-backfill-space/datafile 2020-09-08T16:10:53.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:53.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj214 td/osd-backfill-space/datafile 2020-09-08T16:10:53.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:53.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj214 td/osd-backfill-space/datafile 2020-09-08T16:10:53.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:53.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj214 td/osd-backfill-space/datafile 2020-09-08T16:10:54.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:54.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj214 td/osd-backfill-space/datafile 2020-09-08T16:10:54.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:54.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:54.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:54.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj215 td/osd-backfill-space/datafile 2020-09-08T16:10:54.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:54.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj215 td/osd-backfill-space/datafile 2020-09-08T16:10:54.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:54.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj215 td/osd-backfill-space/datafile 2020-09-08T16:10:54.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:54.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj215 td/osd-backfill-space/datafile 2020-09-08T16:10:54.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:54.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj215 td/osd-backfill-space/datafile 2020-09-08T16:10:54.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:54.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj215 td/osd-backfill-space/datafile 2020-09-08T16:10:54.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:54.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj215 td/osd-backfill-space/datafile 2020-09-08T16:10:54.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:54.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj215 td/osd-backfill-space/datafile 2020-09-08T16:10:54.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:54.772 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:54.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:54.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj216 td/osd-backfill-space/datafile 2020-09-08T16:10:54.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:54.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj216 td/osd-backfill-space/datafile 2020-09-08T16:10:54.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:54.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj216 td/osd-backfill-space/datafile 2020-09-08T16:10:55.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:55.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj216 td/osd-backfill-space/datafile 2020-09-08T16:10:55.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:55.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj216 td/osd-backfill-space/datafile 2020-09-08T16:10:55.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:55.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj216 td/osd-backfill-space/datafile 2020-09-08T16:10:55.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:55.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj216 td/osd-backfill-space/datafile 2020-09-08T16:10:55.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:55.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj216 td/osd-backfill-space/datafile 2020-09-08T16:10:55.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:55.408 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:55.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:55.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj217 td/osd-backfill-space/datafile 2020-09-08T16:10:55.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:55.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj217 td/osd-backfill-space/datafile 2020-09-08T16:10:55.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:55.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj217 td/osd-backfill-space/datafile 2020-09-08T16:10:55.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:55.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj217 td/osd-backfill-space/datafile 2020-09-08T16:10:55.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:55.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj217 td/osd-backfill-space/datafile 2020-09-08T16:10:55.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:55.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj217 td/osd-backfill-space/datafile 2020-09-08T16:10:55.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:55.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj217 td/osd-backfill-space/datafile 2020-09-08T16:10:55.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:55.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj217 td/osd-backfill-space/datafile 2020-09-08T16:10:56.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:56.045 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:56.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:56.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj218 td/osd-backfill-space/datafile 2020-09-08T16:10:56.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:56.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj218 td/osd-backfill-space/datafile 2020-09-08T16:10:56.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:56.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj218 td/osd-backfill-space/datafile 2020-09-08T16:10:56.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:56.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj218 td/osd-backfill-space/datafile 2020-09-08T16:10:56.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:56.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj218 td/osd-backfill-space/datafile 2020-09-08T16:10:56.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:56.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj218 td/osd-backfill-space/datafile 2020-09-08T16:10:56.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:56.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj218 td/osd-backfill-space/datafile 2020-09-08T16:10:56.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:56.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj218 td/osd-backfill-space/datafile 2020-09-08T16:10:56.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:56.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:56.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:56.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj219 td/osd-backfill-space/datafile 2020-09-08T16:10:56.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:56.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj219 td/osd-backfill-space/datafile 2020-09-08T16:10:56.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:56.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj219 td/osd-backfill-space/datafile 2020-09-08T16:10:56.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:56.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj219 td/osd-backfill-space/datafile 2020-09-08T16:10:57.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:57.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj219 td/osd-backfill-space/datafile 2020-09-08T16:10:57.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:57.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj219 td/osd-backfill-space/datafile 2020-09-08T16:10:57.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:57.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj219 td/osd-backfill-space/datafile 2020-09-08T16:10:57.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:57.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj219 td/osd-backfill-space/datafile 2020-09-08T16:10:57.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:57.344 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:57.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:57.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj220 td/osd-backfill-space/datafile 2020-09-08T16:10:57.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:57.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj220 td/osd-backfill-space/datafile 2020-09-08T16:10:57.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:57.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj220 td/osd-backfill-space/datafile 2020-09-08T16:10:57.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:57.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj220 td/osd-backfill-space/datafile 2020-09-08T16:10:57.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:57.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj220 td/osd-backfill-space/datafile 2020-09-08T16:10:57.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:57.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj220 td/osd-backfill-space/datafile 2020-09-08T16:10:57.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:57.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj220 td/osd-backfill-space/datafile 2020-09-08T16:10:57.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:57.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj220 td/osd-backfill-space/datafile 2020-09-08T16:10:57.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:57.974 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:57.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:57.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj221 td/osd-backfill-space/datafile 2020-09-08T16:10:58.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:58.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj221 td/osd-backfill-space/datafile 2020-09-08T16:10:58.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:58.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj221 td/osd-backfill-space/datafile 2020-09-08T16:10:58.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:58.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj221 td/osd-backfill-space/datafile 2020-09-08T16:10:58.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:58.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj221 td/osd-backfill-space/datafile 2020-09-08T16:10:58.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:58.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj221 td/osd-backfill-space/datafile 2020-09-08T16:10:58.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:58.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj221 td/osd-backfill-space/datafile 2020-09-08T16:10:58.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:58.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj221 td/osd-backfill-space/datafile 2020-09-08T16:10:58.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:58.659 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:58.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:58.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj222 td/osd-backfill-space/datafile 2020-09-08T16:10:58.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:58.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj222 td/osd-backfill-space/datafile 2020-09-08T16:10:58.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:58.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj222 td/osd-backfill-space/datafile 2020-09-08T16:10:58.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:58.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj222 td/osd-backfill-space/datafile 2020-09-08T16:10:58.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:58.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj222 td/osd-backfill-space/datafile 2020-09-08T16:10:59.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:59.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj222 td/osd-backfill-space/datafile 2020-09-08T16:10:59.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:59.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj222 td/osd-backfill-space/datafile 2020-09-08T16:10:59.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:59.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj222 td/osd-backfill-space/datafile 2020-09-08T16:10:59.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:59.313 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:59.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:59.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj223 td/osd-backfill-space/datafile 2020-09-08T16:10:59.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:59.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj223 td/osd-backfill-space/datafile 2020-09-08T16:10:59.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:59.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj223 td/osd-backfill-space/datafile 2020-09-08T16:10:59.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:59.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj223 td/osd-backfill-space/datafile 2020-09-08T16:10:59.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:59.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj223 td/osd-backfill-space/datafile 2020-09-08T16:10:59.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:59.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj223 td/osd-backfill-space/datafile 2020-09-08T16:10:59.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:59.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj223 td/osd-backfill-space/datafile 2020-09-08T16:10:59.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:59.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj223 td/osd-backfill-space/datafile 2020-09-08T16:10:59.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:10:59.916 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:10:59.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:10:59.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj224 td/osd-backfill-space/datafile 2020-09-08T16:11:00.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:00.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj224 td/osd-backfill-space/datafile 2020-09-08T16:11:00.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:00.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj224 td/osd-backfill-space/datafile 2020-09-08T16:11:00.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:00.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj224 td/osd-backfill-space/datafile 2020-09-08T16:11:00.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:00.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj224 td/osd-backfill-space/datafile 2020-09-08T16:11:00.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:00.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj224 td/osd-backfill-space/datafile 2020-09-08T16:11:00.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:00.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj224 td/osd-backfill-space/datafile 2020-09-08T16:11:00.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:00.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj224 td/osd-backfill-space/datafile 2020-09-08T16:11:00.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:00.644 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:00.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:00.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj225 td/osd-backfill-space/datafile 2020-09-08T16:11:00.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:00.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj225 td/osd-backfill-space/datafile 2020-09-08T16:11:00.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:00.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj225 td/osd-backfill-space/datafile 2020-09-08T16:11:00.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:00.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj225 td/osd-backfill-space/datafile 2020-09-08T16:11:00.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:00.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj225 td/osd-backfill-space/datafile 2020-09-08T16:11:01.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:01.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj225 td/osd-backfill-space/datafile 2020-09-08T16:11:01.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:01.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj225 td/osd-backfill-space/datafile 2020-09-08T16:11:01.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:01.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj225 td/osd-backfill-space/datafile 2020-09-08T16:11:01.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:01.273 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:01.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:01.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj226 td/osd-backfill-space/datafile 2020-09-08T16:11:01.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:01.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj226 td/osd-backfill-space/datafile 2020-09-08T16:11:01.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:01.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj226 td/osd-backfill-space/datafile 2020-09-08T16:11:01.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:01.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj226 td/osd-backfill-space/datafile 2020-09-08T16:11:01.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:01.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj226 td/osd-backfill-space/datafile 2020-09-08T16:11:01.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:01.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj226 td/osd-backfill-space/datafile 2020-09-08T16:11:01.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:01.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj226 td/osd-backfill-space/datafile 2020-09-08T16:11:01.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:01.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj226 td/osd-backfill-space/datafile 2020-09-08T16:11:01.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:01.887 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:01.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:01.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj227 td/osd-backfill-space/datafile 2020-09-08T16:11:01.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:01.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj227 td/osd-backfill-space/datafile 2020-09-08T16:11:02.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:02.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj227 td/osd-backfill-space/datafile 2020-09-08T16:11:02.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:02.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj227 td/osd-backfill-space/datafile 2020-09-08T16:11:02.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:02.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj227 td/osd-backfill-space/datafile 2020-09-08T16:11:02.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:02.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj227 td/osd-backfill-space/datafile 2020-09-08T16:11:02.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:02.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj227 td/osd-backfill-space/datafile 2020-09-08T16:11:02.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:02.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj227 td/osd-backfill-space/datafile 2020-09-08T16:11:02.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:02.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:02.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:02.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj228 td/osd-backfill-space/datafile 2020-09-08T16:11:02.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:02.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj228 td/osd-backfill-space/datafile 2020-09-08T16:11:02.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:02.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj228 td/osd-backfill-space/datafile 2020-09-08T16:11:02.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:02.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj228 td/osd-backfill-space/datafile 2020-09-08T16:11:02.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:02.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj228 td/osd-backfill-space/datafile 2020-09-08T16:11:02.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:02.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj228 td/osd-backfill-space/datafile 2020-09-08T16:11:03.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:03.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj228 td/osd-backfill-space/datafile 2020-09-08T16:11:03.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:03.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj228 td/osd-backfill-space/datafile 2020-09-08T16:11:03.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:03.190 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:03.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:03.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj229 td/osd-backfill-space/datafile 2020-09-08T16:11:03.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:03.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj229 td/osd-backfill-space/datafile 2020-09-08T16:11:03.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:03.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj229 td/osd-backfill-space/datafile 2020-09-08T16:11:03.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:03.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj229 td/osd-backfill-space/datafile 2020-09-08T16:11:03.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:03.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj229 td/osd-backfill-space/datafile 2020-09-08T16:11:03.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:03.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj229 td/osd-backfill-space/datafile 2020-09-08T16:11:03.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:03.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj229 td/osd-backfill-space/datafile 2020-09-08T16:11:03.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:03.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj229 td/osd-backfill-space/datafile 2020-09-08T16:11:03.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:03.819 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:03.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:03.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj230 td/osd-backfill-space/datafile 2020-09-08T16:11:03.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:03.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj230 td/osd-backfill-space/datafile 2020-09-08T16:11:03.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:03.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj230 td/osd-backfill-space/datafile 2020-09-08T16:11:04.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:04.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj230 td/osd-backfill-space/datafile 2020-09-08T16:11:04.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:04.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj230 td/osd-backfill-space/datafile 2020-09-08T16:11:04.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:04.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj230 td/osd-backfill-space/datafile 2020-09-08T16:11:04.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:04.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj230 td/osd-backfill-space/datafile 2020-09-08T16:11:04.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:04.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj230 td/osd-backfill-space/datafile 2020-09-08T16:11:04.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:04.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:04.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:04.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj231 td/osd-backfill-space/datafile 2020-09-08T16:11:04.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:04.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj231 td/osd-backfill-space/datafile 2020-09-08T16:11:04.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:04.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj231 td/osd-backfill-space/datafile 2020-09-08T16:11:04.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:04.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj231 td/osd-backfill-space/datafile 2020-09-08T16:11:04.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:04.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj231 td/osd-backfill-space/datafile 2020-09-08T16:11:05.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:05.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj231 td/osd-backfill-space/datafile 2020-09-08T16:11:05.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:05.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj231 td/osd-backfill-space/datafile 2020-09-08T16:11:05.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:05.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj231 td/osd-backfill-space/datafile 2020-09-08T16:11:05.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:05.294 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:05.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:05.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj232 td/osd-backfill-space/datafile 2020-09-08T16:11:05.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:05.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj232 td/osd-backfill-space/datafile 2020-09-08T16:11:05.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:05.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj232 td/osd-backfill-space/datafile 2020-09-08T16:11:05.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:05.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj232 td/osd-backfill-space/datafile 2020-09-08T16:11:05.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:05.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj232 td/osd-backfill-space/datafile 2020-09-08T16:11:05.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:05.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj232 td/osd-backfill-space/datafile 2020-09-08T16:11:05.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:05.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj232 td/osd-backfill-space/datafile 2020-09-08T16:11:05.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:05.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj232 td/osd-backfill-space/datafile 2020-09-08T16:11:05.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:05.947 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:05.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:05.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj233 td/osd-backfill-space/datafile 2020-09-08T16:11:06.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:06.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj233 td/osd-backfill-space/datafile 2020-09-08T16:11:06.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:06.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj233 td/osd-backfill-space/datafile 2020-09-08T16:11:06.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:06.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj233 td/osd-backfill-space/datafile 2020-09-08T16:11:06.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:06.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj233 td/osd-backfill-space/datafile 2020-09-08T16:11:06.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:06.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj233 td/osd-backfill-space/datafile 2020-09-08T16:11:06.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:06.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj233 td/osd-backfill-space/datafile 2020-09-08T16:11:06.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:06.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj233 td/osd-backfill-space/datafile 2020-09-08T16:11:06.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:06.609 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:06.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:06.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj234 td/osd-backfill-space/datafile 2020-09-08T16:11:06.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:06.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj234 td/osd-backfill-space/datafile 2020-09-08T16:11:06.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:06.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj234 td/osd-backfill-space/datafile 2020-09-08T16:11:06.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:06.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj234 td/osd-backfill-space/datafile 2020-09-08T16:11:06.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:06.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj234 td/osd-backfill-space/datafile 2020-09-08T16:11:07.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:07.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj234 td/osd-backfill-space/datafile 2020-09-08T16:11:07.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:07.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj234 td/osd-backfill-space/datafile 2020-09-08T16:11:07.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:07.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj234 td/osd-backfill-space/datafile 2020-09-08T16:11:07.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:07.237 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:07.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:07.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj235 td/osd-backfill-space/datafile 2020-09-08T16:11:07.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:07.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj235 td/osd-backfill-space/datafile 2020-09-08T16:11:07.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:07.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj235 td/osd-backfill-space/datafile 2020-09-08T16:11:07.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:07.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj235 td/osd-backfill-space/datafile 2020-09-08T16:11:07.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:07.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj235 td/osd-backfill-space/datafile 2020-09-08T16:11:07.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:07.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj235 td/osd-backfill-space/datafile 2020-09-08T16:11:07.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:07.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj235 td/osd-backfill-space/datafile 2020-09-08T16:11:07.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:07.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj235 td/osd-backfill-space/datafile 2020-09-08T16:11:07.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:07.865 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:07.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:07.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj236 td/osd-backfill-space/datafile 2020-09-08T16:11:07.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:07.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj236 td/osd-backfill-space/datafile 2020-09-08T16:11:08.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:08.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj236 td/osd-backfill-space/datafile 2020-09-08T16:11:08.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:08.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj236 td/osd-backfill-space/datafile 2020-09-08T16:11:08.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:08.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj236 td/osd-backfill-space/datafile 2020-09-08T16:11:08.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:08.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj236 td/osd-backfill-space/datafile 2020-09-08T16:11:08.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:08.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj236 td/osd-backfill-space/datafile 2020-09-08T16:11:08.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:08.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj236 td/osd-backfill-space/datafile 2020-09-08T16:11:08.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:08.561 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:08.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:08.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj237 td/osd-backfill-space/datafile 2020-09-08T16:11:08.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:08.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj237 td/osd-backfill-space/datafile 2020-09-08T16:11:08.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:08.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj237 td/osd-backfill-space/datafile 2020-09-08T16:11:08.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:08.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj237 td/osd-backfill-space/datafile 2020-09-08T16:11:08.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:08.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj237 td/osd-backfill-space/datafile 2020-09-08T16:11:08.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:08.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj237 td/osd-backfill-space/datafile 2020-09-08T16:11:09.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:09.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj237 td/osd-backfill-space/datafile 2020-09-08T16:11:09.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:09.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj237 td/osd-backfill-space/datafile 2020-09-08T16:11:09.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:09.256 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:09.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:09.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj238 td/osd-backfill-space/datafile 2020-09-08T16:11:09.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:09.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj238 td/osd-backfill-space/datafile 2020-09-08T16:11:09.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:09.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj238 td/osd-backfill-space/datafile 2020-09-08T16:11:09.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:09.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj238 td/osd-backfill-space/datafile 2020-09-08T16:11:09.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:09.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj238 td/osd-backfill-space/datafile 2020-09-08T16:11:09.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:09.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj238 td/osd-backfill-space/datafile 2020-09-08T16:11:09.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:09.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj238 td/osd-backfill-space/datafile 2020-09-08T16:11:09.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:09.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj238 td/osd-backfill-space/datafile 2020-09-08T16:11:09.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:09.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:09.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:09.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj239 td/osd-backfill-space/datafile 2020-09-08T16:11:09.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:09.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj239 td/osd-backfill-space/datafile 2020-09-08T16:11:10.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:10.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj239 td/osd-backfill-space/datafile 2020-09-08T16:11:10.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:10.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj239 td/osd-backfill-space/datafile 2020-09-08T16:11:10.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:10.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj239 td/osd-backfill-space/datafile 2020-09-08T16:11:10.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:10.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj239 td/osd-backfill-space/datafile 2020-09-08T16:11:10.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:10.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj239 td/osd-backfill-space/datafile 2020-09-08T16:11:10.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:10.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj239 td/osd-backfill-space/datafile 2020-09-08T16:11:10.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:10.639 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:10.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:10.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj240 td/osd-backfill-space/datafile 2020-09-08T16:11:10.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:10.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj240 td/osd-backfill-space/datafile 2020-09-08T16:11:10.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:10.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj240 td/osd-backfill-space/datafile 2020-09-08T16:11:10.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:10.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj240 td/osd-backfill-space/datafile 2020-09-08T16:11:10.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:10.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj240 td/osd-backfill-space/datafile 2020-09-08T16:11:11.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:11.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj240 td/osd-backfill-space/datafile 2020-09-08T16:11:11.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:11.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj240 td/osd-backfill-space/datafile 2020-09-08T16:11:11.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:11.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj240 td/osd-backfill-space/datafile 2020-09-08T16:11:11.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:11.275 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:11.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:11.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj241 td/osd-backfill-space/datafile 2020-09-08T16:11:11.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:11.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj241 td/osd-backfill-space/datafile 2020-09-08T16:11:11.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:11.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj241 td/osd-backfill-space/datafile 2020-09-08T16:11:11.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:11.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj241 td/osd-backfill-space/datafile 2020-09-08T16:11:11.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:11.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj241 td/osd-backfill-space/datafile 2020-09-08T16:11:11.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:11.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj241 td/osd-backfill-space/datafile 2020-09-08T16:11:11.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:11.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj241 td/osd-backfill-space/datafile 2020-09-08T16:11:11.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:11.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj241 td/osd-backfill-space/datafile 2020-09-08T16:11:11.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:11.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:11.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:11.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj242 td/osd-backfill-space/datafile 2020-09-08T16:11:11.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:11.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj242 td/osd-backfill-space/datafile 2020-09-08T16:11:12.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:12.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj242 td/osd-backfill-space/datafile 2020-09-08T16:11:12.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:12.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj242 td/osd-backfill-space/datafile 2020-09-08T16:11:12.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:12.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj242 td/osd-backfill-space/datafile 2020-09-08T16:11:12.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:12.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj242 td/osd-backfill-space/datafile 2020-09-08T16:11:12.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:12.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj242 td/osd-backfill-space/datafile 2020-09-08T16:11:12.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:12.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj242 td/osd-backfill-space/datafile 2020-09-08T16:11:12.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:12.606 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:12.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:12.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj243 td/osd-backfill-space/datafile 2020-09-08T16:11:12.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:12.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj243 td/osd-backfill-space/datafile 2020-09-08T16:11:12.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:12.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj243 td/osd-backfill-space/datafile 2020-09-08T16:11:12.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:12.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj243 td/osd-backfill-space/datafile 2020-09-08T16:11:12.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:12.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj243 td/osd-backfill-space/datafile 2020-09-08T16:11:12.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:12.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj243 td/osd-backfill-space/datafile 2020-09-08T16:11:13.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:13.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj243 td/osd-backfill-space/datafile 2020-09-08T16:11:13.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:13.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj243 td/osd-backfill-space/datafile 2020-09-08T16:11:13.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:13.217 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:13.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:13.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj244 td/osd-backfill-space/datafile 2020-09-08T16:11:13.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:13.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj244 td/osd-backfill-space/datafile 2020-09-08T16:11:13.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:13.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj244 td/osd-backfill-space/datafile 2020-09-08T16:11:13.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:13.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj244 td/osd-backfill-space/datafile 2020-09-08T16:11:13.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:13.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj244 td/osd-backfill-space/datafile 2020-09-08T16:11:13.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:13.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj244 td/osd-backfill-space/datafile 2020-09-08T16:11:13.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:13.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj244 td/osd-backfill-space/datafile 2020-09-08T16:11:13.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:13.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj244 td/osd-backfill-space/datafile 2020-09-08T16:11:13.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:13.837 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:13.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:13.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj245 td/osd-backfill-space/datafile 2020-09-08T16:11:13.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:13.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj245 td/osd-backfill-space/datafile 2020-09-08T16:11:14.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:14.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj245 td/osd-backfill-space/datafile 2020-09-08T16:11:14.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:14.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj245 td/osd-backfill-space/datafile 2020-09-08T16:11:14.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:14.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj245 td/osd-backfill-space/datafile 2020-09-08T16:11:14.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:14.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj245 td/osd-backfill-space/datafile 2020-09-08T16:11:14.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:14.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj245 td/osd-backfill-space/datafile 2020-09-08T16:11:14.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:14.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj245 td/osd-backfill-space/datafile 2020-09-08T16:11:14.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:14.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:14.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:14.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj246 td/osd-backfill-space/datafile 2020-09-08T16:11:14.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:14.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj246 td/osd-backfill-space/datafile 2020-09-08T16:11:15.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:15.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj246 td/osd-backfill-space/datafile 2020-09-08T16:11:15.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:15.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj246 td/osd-backfill-space/datafile 2020-09-08T16:11:15.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:15.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj246 td/osd-backfill-space/datafile 2020-09-08T16:11:15.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:15.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj246 td/osd-backfill-space/datafile 2020-09-08T16:11:15.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:15.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj246 td/osd-backfill-space/datafile 2020-09-08T16:11:15.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:15.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj246 td/osd-backfill-space/datafile 2020-09-08T16:11:15.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:15.560 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:15.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:15.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj247 td/osd-backfill-space/datafile 2020-09-08T16:11:15.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:15.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj247 td/osd-backfill-space/datafile 2020-09-08T16:11:15.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:15.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj247 td/osd-backfill-space/datafile 2020-09-08T16:11:15.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:15.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj247 td/osd-backfill-space/datafile 2020-09-08T16:11:15.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:15.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj247 td/osd-backfill-space/datafile 2020-09-08T16:11:15.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:15.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj247 td/osd-backfill-space/datafile 2020-09-08T16:11:16.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:16.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj247 td/osd-backfill-space/datafile 2020-09-08T16:11:16.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:16.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj247 td/osd-backfill-space/datafile 2020-09-08T16:11:16.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:16.197 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:16.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:16.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj248 td/osd-backfill-space/datafile 2020-09-08T16:11:16.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:16.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj248 td/osd-backfill-space/datafile 2020-09-08T16:11:16.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:16.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj248 td/osd-backfill-space/datafile 2020-09-08T16:11:16.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:16.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj248 td/osd-backfill-space/datafile 2020-09-08T16:11:16.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:16.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj248 td/osd-backfill-space/datafile 2020-09-08T16:11:16.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:16.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj248 td/osd-backfill-space/datafile 2020-09-08T16:11:16.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:16.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj248 td/osd-backfill-space/datafile 2020-09-08T16:11:16.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:16.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj248 td/osd-backfill-space/datafile 2020-09-08T16:11:16.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:16.867 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:16.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:16.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj249 td/osd-backfill-space/datafile 2020-09-08T16:11:16.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:16.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj249 td/osd-backfill-space/datafile 2020-09-08T16:11:17.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:17.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj249 td/osd-backfill-space/datafile 2020-09-08T16:11:17.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:17.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj249 td/osd-backfill-space/datafile 2020-09-08T16:11:17.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:17.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj249 td/osd-backfill-space/datafile 2020-09-08T16:11:17.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:17.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj249 td/osd-backfill-space/datafile 2020-09-08T16:11:17.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:17.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj249 td/osd-backfill-space/datafile 2020-09-08T16:11:17.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:17.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj249 td/osd-backfill-space/datafile 2020-09-08T16:11:17.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:17.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:17.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:17.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj250 td/osd-backfill-space/datafile 2020-09-08T16:11:17.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:17.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj250 td/osd-backfill-space/datafile 2020-09-08T16:11:17.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:17.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj250 td/osd-backfill-space/datafile 2020-09-08T16:11:17.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:17.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj250 td/osd-backfill-space/datafile 2020-09-08T16:11:17.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:17.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj250 td/osd-backfill-space/datafile 2020-09-08T16:11:17.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:17.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj250 td/osd-backfill-space/datafile 2020-09-08T16:11:17.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:17.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj250 td/osd-backfill-space/datafile 2020-09-08T16:11:18.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:18.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj250 td/osd-backfill-space/datafile 2020-09-08T16:11:18.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:18.110 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:18.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:18.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj251 td/osd-backfill-space/datafile 2020-09-08T16:11:18.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:18.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj251 td/osd-backfill-space/datafile 2020-09-08T16:11:18.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:18.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj251 td/osd-backfill-space/datafile 2020-09-08T16:11:18.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:18.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj251 td/osd-backfill-space/datafile 2020-09-08T16:11:18.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:18.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj251 td/osd-backfill-space/datafile 2020-09-08T16:11:18.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:18.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj251 td/osd-backfill-space/datafile 2020-09-08T16:11:18.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:18.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj251 td/osd-backfill-space/datafile 2020-09-08T16:11:18.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:18.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj251 td/osd-backfill-space/datafile 2020-09-08T16:11:18.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:18.793 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:18.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:18.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj252 td/osd-backfill-space/datafile 2020-09-08T16:11:18.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:18.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj252 td/osd-backfill-space/datafile 2020-09-08T16:11:18.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:18.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj252 td/osd-backfill-space/datafile 2020-09-08T16:11:19.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:19.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj252 td/osd-backfill-space/datafile 2020-09-08T16:11:19.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:19.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj252 td/osd-backfill-space/datafile 2020-09-08T16:11:19.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:19.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj252 td/osd-backfill-space/datafile 2020-09-08T16:11:19.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:19.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj252 td/osd-backfill-space/datafile 2020-09-08T16:11:19.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:19.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj252 td/osd-backfill-space/datafile 2020-09-08T16:11:19.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:19.421 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:19.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:19.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj253 td/osd-backfill-space/datafile 2020-09-08T16:11:19.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:19.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj253 td/osd-backfill-space/datafile 2020-09-08T16:11:19.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:19.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj253 td/osd-backfill-space/datafile 2020-09-08T16:11:19.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:19.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj253 td/osd-backfill-space/datafile 2020-09-08T16:11:19.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:19.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj253 td/osd-backfill-space/datafile 2020-09-08T16:11:19.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:19.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj253 td/osd-backfill-space/datafile 2020-09-08T16:11:19.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:19.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj253 td/osd-backfill-space/datafile 2020-09-08T16:11:20.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:20.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj253 td/osd-backfill-space/datafile 2020-09-08T16:11:20.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:20.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:20.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:20.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj254 td/osd-backfill-space/datafile 2020-09-08T16:11:20.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:20.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj254 td/osd-backfill-space/datafile 2020-09-08T16:11:20.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:20.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj254 td/osd-backfill-space/datafile 2020-09-08T16:11:20.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:20.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj254 td/osd-backfill-space/datafile 2020-09-08T16:11:20.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:20.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj254 td/osd-backfill-space/datafile 2020-09-08T16:11:20.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:20.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj254 td/osd-backfill-space/datafile 2020-09-08T16:11:20.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:20.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj254 td/osd-backfill-space/datafile 2020-09-08T16:11:20.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:20.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj254 td/osd-backfill-space/datafile 2020-09-08T16:11:20.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:20.845 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:20.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:20.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj255 td/osd-backfill-space/datafile 2020-09-08T16:11:20.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:20.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj255 td/osd-backfill-space/datafile 2020-09-08T16:11:20.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:20.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj255 td/osd-backfill-space/datafile 2020-09-08T16:11:21.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:21.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj255 td/osd-backfill-space/datafile 2020-09-08T16:11:21.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:21.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj255 td/osd-backfill-space/datafile 2020-09-08T16:11:21.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:21.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj255 td/osd-backfill-space/datafile 2020-09-08T16:11:21.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:21.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj255 td/osd-backfill-space/datafile 2020-09-08T16:11:21.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:21.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj255 td/osd-backfill-space/datafile 2020-09-08T16:11:21.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:21.457 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:21.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:21.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj256 td/osd-backfill-space/datafile 2020-09-08T16:11:21.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:21.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj256 td/osd-backfill-space/datafile 2020-09-08T16:11:21.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:21.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj256 td/osd-backfill-space/datafile 2020-09-08T16:11:21.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:21.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj256 td/osd-backfill-space/datafile 2020-09-08T16:11:21.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:21.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj256 td/osd-backfill-space/datafile 2020-09-08T16:11:21.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:21.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj256 td/osd-backfill-space/datafile 2020-09-08T16:11:21.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:21.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj256 td/osd-backfill-space/datafile 2020-09-08T16:11:22.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:22.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj256 td/osd-backfill-space/datafile 2020-09-08T16:11:22.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:22.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:22.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:22.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj257 td/osd-backfill-space/datafile 2020-09-08T16:11:22.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:22.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj257 td/osd-backfill-space/datafile 2020-09-08T16:11:22.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:22.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj257 td/osd-backfill-space/datafile 2020-09-08T16:11:22.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:22.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj257 td/osd-backfill-space/datafile 2020-09-08T16:11:22.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:22.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj257 td/osd-backfill-space/datafile 2020-09-08T16:11:22.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:22.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj257 td/osd-backfill-space/datafile 2020-09-08T16:11:22.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:22.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj257 td/osd-backfill-space/datafile 2020-09-08T16:11:22.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:22.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj257 td/osd-backfill-space/datafile 2020-09-08T16:11:22.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:22.754 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:22.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:22.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj258 td/osd-backfill-space/datafile 2020-09-08T16:11:22.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:22.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj258 td/osd-backfill-space/datafile 2020-09-08T16:11:22.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:22.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj258 td/osd-backfill-space/datafile 2020-09-08T16:11:22.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:22.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj258 td/osd-backfill-space/datafile 2020-09-08T16:11:23.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:23.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj258 td/osd-backfill-space/datafile 2020-09-08T16:11:23.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:23.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj258 td/osd-backfill-space/datafile 2020-09-08T16:11:23.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:23.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj258 td/osd-backfill-space/datafile 2020-09-08T16:11:23.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:23.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj258 td/osd-backfill-space/datafile 2020-09-08T16:11:23.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:23.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:23.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:23.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj259 td/osd-backfill-space/datafile 2020-09-08T16:11:23.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:23.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj259 td/osd-backfill-space/datafile 2020-09-08T16:11:23.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:23.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj259 td/osd-backfill-space/datafile 2020-09-08T16:11:23.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:23.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj259 td/osd-backfill-space/datafile 2020-09-08T16:11:23.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:23.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj259 td/osd-backfill-space/datafile 2020-09-08T16:11:23.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:23.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj259 td/osd-backfill-space/datafile 2020-09-08T16:11:23.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:23.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj259 td/osd-backfill-space/datafile 2020-09-08T16:11:24.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:24.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj259 td/osd-backfill-space/datafile 2020-09-08T16:11:24.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:24.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:24.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:24.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj260 td/osd-backfill-space/datafile 2020-09-08T16:11:24.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:24.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj260 td/osd-backfill-space/datafile 2020-09-08T16:11:24.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:24.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj260 td/osd-backfill-space/datafile 2020-09-08T16:11:24.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:24.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj260 td/osd-backfill-space/datafile 2020-09-08T16:11:24.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:24.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj260 td/osd-backfill-space/datafile 2020-09-08T16:11:24.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:24.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj260 td/osd-backfill-space/datafile 2020-09-08T16:11:24.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:24.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj260 td/osd-backfill-space/datafile 2020-09-08T16:11:24.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:24.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj260 td/osd-backfill-space/datafile 2020-09-08T16:11:24.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:24.789 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:24.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:24.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj261 td/osd-backfill-space/datafile 2020-09-08T16:11:24.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:24.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj261 td/osd-backfill-space/datafile 2020-09-08T16:11:24.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:24.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj261 td/osd-backfill-space/datafile 2020-09-08T16:11:25.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:25.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj261 td/osd-backfill-space/datafile 2020-09-08T16:11:25.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:25.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj261 td/osd-backfill-space/datafile 2020-09-08T16:11:25.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:25.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj261 td/osd-backfill-space/datafile 2020-09-08T16:11:25.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:25.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj261 td/osd-backfill-space/datafile 2020-09-08T16:11:25.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:25.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj261 td/osd-backfill-space/datafile 2020-09-08T16:11:25.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:25.509 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:25.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:25.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj262 td/osd-backfill-space/datafile 2020-09-08T16:11:25.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:25.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj262 td/osd-backfill-space/datafile 2020-09-08T16:11:25.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:25.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj262 td/osd-backfill-space/datafile 2020-09-08T16:11:25.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:25.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj262 td/osd-backfill-space/datafile 2020-09-08T16:11:25.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:25.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj262 td/osd-backfill-space/datafile 2020-09-08T16:11:25.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:25.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj262 td/osd-backfill-space/datafile 2020-09-08T16:11:26.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:26.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj262 td/osd-backfill-space/datafile 2020-09-08T16:11:26.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:26.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj262 td/osd-backfill-space/datafile 2020-09-08T16:11:26.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:26.188 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:26.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:26.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj263 td/osd-backfill-space/datafile 2020-09-08T16:11:26.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:26.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj263 td/osd-backfill-space/datafile 2020-09-08T16:11:26.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:26.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj263 td/osd-backfill-space/datafile 2020-09-08T16:11:26.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:26.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj263 td/osd-backfill-space/datafile 2020-09-08T16:11:26.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:26.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj263 td/osd-backfill-space/datafile 2020-09-08T16:11:26.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:26.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj263 td/osd-backfill-space/datafile 2020-09-08T16:11:26.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:26.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj263 td/osd-backfill-space/datafile 2020-09-08T16:11:26.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:26.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj263 td/osd-backfill-space/datafile 2020-09-08T16:11:26.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:26.867 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:26.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:26.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj264 td/osd-backfill-space/datafile 2020-09-08T16:11:26.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:26.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj264 td/osd-backfill-space/datafile 2020-09-08T16:11:27.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:27.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj264 td/osd-backfill-space/datafile 2020-09-08T16:11:27.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:27.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj264 td/osd-backfill-space/datafile 2020-09-08T16:11:27.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:27.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj264 td/osd-backfill-space/datafile 2020-09-08T16:11:27.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:27.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj264 td/osd-backfill-space/datafile 2020-09-08T16:11:27.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:27.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj264 td/osd-backfill-space/datafile 2020-09-08T16:11:27.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:27.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj264 td/osd-backfill-space/datafile 2020-09-08T16:11:27.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:27.478 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:27.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:27.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj265 td/osd-backfill-space/datafile 2020-09-08T16:11:27.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:27.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj265 td/osd-backfill-space/datafile 2020-09-08T16:11:27.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:27.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj265 td/osd-backfill-space/datafile 2020-09-08T16:11:27.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:27.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj265 td/osd-backfill-space/datafile 2020-09-08T16:11:27.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:27.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj265 td/osd-backfill-space/datafile 2020-09-08T16:11:27.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:27.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj265 td/osd-backfill-space/datafile 2020-09-08T16:11:27.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:27.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj265 td/osd-backfill-space/datafile 2020-09-08T16:11:28.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:28.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj265 td/osd-backfill-space/datafile 2020-09-08T16:11:28.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:28.098 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:28.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:28.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj266 td/osd-backfill-space/datafile 2020-09-08T16:11:28.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:28.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj266 td/osd-backfill-space/datafile 2020-09-08T16:11:28.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:28.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj266 td/osd-backfill-space/datafile 2020-09-08T16:11:28.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:28.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj266 td/osd-backfill-space/datafile 2020-09-08T16:11:28.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:28.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj266 td/osd-backfill-space/datafile 2020-09-08T16:11:28.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:28.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj266 td/osd-backfill-space/datafile 2020-09-08T16:11:28.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:28.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj266 td/osd-backfill-space/datafile 2020-09-08T16:11:28.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:28.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj266 td/osd-backfill-space/datafile 2020-09-08T16:11:28.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:28.776 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:28.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:28.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj267 td/osd-backfill-space/datafile 2020-09-08T16:11:28.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:28.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj267 td/osd-backfill-space/datafile 2020-09-08T16:11:28.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:28.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj267 td/osd-backfill-space/datafile 2020-09-08T16:11:29.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:29.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj267 td/osd-backfill-space/datafile 2020-09-08T16:11:29.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:29.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj267 td/osd-backfill-space/datafile 2020-09-08T16:11:29.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:29.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj267 td/osd-backfill-space/datafile 2020-09-08T16:11:29.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:29.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj267 td/osd-backfill-space/datafile 2020-09-08T16:11:29.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:29.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj267 td/osd-backfill-space/datafile 2020-09-08T16:11:29.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:29.395 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:29.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:29.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj268 td/osd-backfill-space/datafile 2020-09-08T16:11:29.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:29.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj268 td/osd-backfill-space/datafile 2020-09-08T16:11:29.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:29.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj268 td/osd-backfill-space/datafile 2020-09-08T16:11:29.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:29.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj268 td/osd-backfill-space/datafile 2020-09-08T16:11:29.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:29.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj268 td/osd-backfill-space/datafile 2020-09-08T16:11:29.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:29.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj268 td/osd-backfill-space/datafile 2020-09-08T16:11:29.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:29.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj268 td/osd-backfill-space/datafile 2020-09-08T16:11:29.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:29.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj268 td/osd-backfill-space/datafile 2020-09-08T16:11:30.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:30.007 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:30.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:30.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj269 td/osd-backfill-space/datafile 2020-09-08T16:11:30.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:30.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj269 td/osd-backfill-space/datafile 2020-09-08T16:11:30.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:30.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj269 td/osd-backfill-space/datafile 2020-09-08T16:11:30.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:30.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj269 td/osd-backfill-space/datafile 2020-09-08T16:11:30.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:30.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj269 td/osd-backfill-space/datafile 2020-09-08T16:11:30.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:30.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj269 td/osd-backfill-space/datafile 2020-09-08T16:11:30.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:30.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj269 td/osd-backfill-space/datafile 2020-09-08T16:11:30.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:30.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj269 td/osd-backfill-space/datafile 2020-09-08T16:11:30.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:30.678 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:30.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:30.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj270 td/osd-backfill-space/datafile 2020-09-08T16:11:30.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:30.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj270 td/osd-backfill-space/datafile 2020-09-08T16:11:30.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:30.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj270 td/osd-backfill-space/datafile 2020-09-08T16:11:30.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:30.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj270 td/osd-backfill-space/datafile 2020-09-08T16:11:31.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:31.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj270 td/osd-backfill-space/datafile 2020-09-08T16:11:31.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:31.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj270 td/osd-backfill-space/datafile 2020-09-08T16:11:31.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:31.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj270 td/osd-backfill-space/datafile 2020-09-08T16:11:31.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:31.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj270 td/osd-backfill-space/datafile 2020-09-08T16:11:31.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:31.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:31.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:31.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj271 td/osd-backfill-space/datafile 2020-09-08T16:11:31.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:31.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj271 td/osd-backfill-space/datafile 2020-09-08T16:11:31.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:31.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj271 td/osd-backfill-space/datafile 2020-09-08T16:11:31.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:31.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj271 td/osd-backfill-space/datafile 2020-09-08T16:11:31.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:31.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj271 td/osd-backfill-space/datafile 2020-09-08T16:11:31.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:31.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj271 td/osd-backfill-space/datafile 2020-09-08T16:11:31.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:31.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj271 td/osd-backfill-space/datafile 2020-09-08T16:11:31.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:31.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj271 td/osd-backfill-space/datafile 2020-09-08T16:11:31.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:31.934 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:31.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:31.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj272 td/osd-backfill-space/datafile 2020-09-08T16:11:32.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:32.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj272 td/osd-backfill-space/datafile 2020-09-08T16:11:32.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:32.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj272 td/osd-backfill-space/datafile 2020-09-08T16:11:32.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:32.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj272 td/osd-backfill-space/datafile 2020-09-08T16:11:32.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:32.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj272 td/osd-backfill-space/datafile 2020-09-08T16:11:32.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:32.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj272 td/osd-backfill-space/datafile 2020-09-08T16:11:32.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:32.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj272 td/osd-backfill-space/datafile 2020-09-08T16:11:32.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:32.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj272 td/osd-backfill-space/datafile 2020-09-08T16:11:32.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:32.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:32.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:32.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj273 td/osd-backfill-space/datafile 2020-09-08T16:11:32.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:32.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj273 td/osd-backfill-space/datafile 2020-09-08T16:11:32.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:32.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj273 td/osd-backfill-space/datafile 2020-09-08T16:11:32.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:32.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj273 td/osd-backfill-space/datafile 2020-09-08T16:11:32.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:32.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj273 td/osd-backfill-space/datafile 2020-09-08T16:11:33.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:33.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj273 td/osd-backfill-space/datafile 2020-09-08T16:11:33.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:33.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj273 td/osd-backfill-space/datafile 2020-09-08T16:11:33.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:33.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj273 td/osd-backfill-space/datafile 2020-09-08T16:11:33.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:33.257 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:33.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:33.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj274 td/osd-backfill-space/datafile 2020-09-08T16:11:33.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:33.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj274 td/osd-backfill-space/datafile 2020-09-08T16:11:33.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:33.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj274 td/osd-backfill-space/datafile 2020-09-08T16:11:33.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:33.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj274 td/osd-backfill-space/datafile 2020-09-08T16:11:33.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:33.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj274 td/osd-backfill-space/datafile 2020-09-08T16:11:33.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:33.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj274 td/osd-backfill-space/datafile 2020-09-08T16:11:33.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:33.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj274 td/osd-backfill-space/datafile 2020-09-08T16:11:33.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:33.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj274 td/osd-backfill-space/datafile 2020-09-08T16:11:33.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:33.868 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:33.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:33.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj275 td/osd-backfill-space/datafile 2020-09-08T16:11:33.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:33.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj275 td/osd-backfill-space/datafile 2020-09-08T16:11:34.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:34.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj275 td/osd-backfill-space/datafile 2020-09-08T16:11:34.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:34.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj275 td/osd-backfill-space/datafile 2020-09-08T16:11:34.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:34.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj275 td/osd-backfill-space/datafile 2020-09-08T16:11:34.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:34.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj275 td/osd-backfill-space/datafile 2020-09-08T16:11:34.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:34.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj275 td/osd-backfill-space/datafile 2020-09-08T16:11:34.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:34.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj275 td/osd-backfill-space/datafile 2020-09-08T16:11:34.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:34.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:34.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:34.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj276 td/osd-backfill-space/datafile 2020-09-08T16:11:34.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:34.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj276 td/osd-backfill-space/datafile 2020-09-08T16:11:34.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:34.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj276 td/osd-backfill-space/datafile 2020-09-08T16:11:34.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:34.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj276 td/osd-backfill-space/datafile 2020-09-08T16:11:34.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:34.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj276 td/osd-backfill-space/datafile 2020-09-08T16:11:34.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:34.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj276 td/osd-backfill-space/datafile 2020-09-08T16:11:35.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:35.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj276 td/osd-backfill-space/datafile 2020-09-08T16:11:35.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:35.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj276 td/osd-backfill-space/datafile 2020-09-08T16:11:35.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:35.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:35.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:35.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj277 td/osd-backfill-space/datafile 2020-09-08T16:11:35.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:35.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj277 td/osd-backfill-space/datafile 2020-09-08T16:11:35.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:35.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj277 td/osd-backfill-space/datafile 2020-09-08T16:11:35.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:35.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj277 td/osd-backfill-space/datafile 2020-09-08T16:11:35.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:35.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj277 td/osd-backfill-space/datafile 2020-09-08T16:11:35.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:35.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj277 td/osd-backfill-space/datafile 2020-09-08T16:11:35.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:35.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj277 td/osd-backfill-space/datafile 2020-09-08T16:11:35.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:35.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj277 td/osd-backfill-space/datafile 2020-09-08T16:11:35.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:35.903 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:35.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:35.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj278 td/osd-backfill-space/datafile 2020-09-08T16:11:35.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:35.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj278 td/osd-backfill-space/datafile 2020-09-08T16:11:36.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:36.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj278 td/osd-backfill-space/datafile 2020-09-08T16:11:36.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:36.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj278 td/osd-backfill-space/datafile 2020-09-08T16:11:36.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:36.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj278 td/osd-backfill-space/datafile 2020-09-08T16:11:36.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:36.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj278 td/osd-backfill-space/datafile 2020-09-08T16:11:36.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:36.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj278 td/osd-backfill-space/datafile 2020-09-08T16:11:36.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:36.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj278 td/osd-backfill-space/datafile 2020-09-08T16:11:36.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:36.590 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:36.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:36.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj279 td/osd-backfill-space/datafile 2020-09-08T16:11:36.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:36.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj279 td/osd-backfill-space/datafile 2020-09-08T16:11:36.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:36.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj279 td/osd-backfill-space/datafile 2020-09-08T16:11:36.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:36.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj279 td/osd-backfill-space/datafile 2020-09-08T16:11:36.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:36.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj279 td/osd-backfill-space/datafile 2020-09-08T16:11:36.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:36.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj279 td/osd-backfill-space/datafile 2020-09-08T16:11:37.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:37.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj279 td/osd-backfill-space/datafile 2020-09-08T16:11:37.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:37.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj279 td/osd-backfill-space/datafile 2020-09-08T16:11:37.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:37.201 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:37.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:37.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj280 td/osd-backfill-space/datafile 2020-09-08T16:11:37.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:37.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj280 td/osd-backfill-space/datafile 2020-09-08T16:11:37.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:37.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj280 td/osd-backfill-space/datafile 2020-09-08T16:11:37.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:37.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj280 td/osd-backfill-space/datafile 2020-09-08T16:11:37.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:37.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj280 td/osd-backfill-space/datafile 2020-09-08T16:11:37.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:37.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj280 td/osd-backfill-space/datafile 2020-09-08T16:11:37.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:37.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj280 td/osd-backfill-space/datafile 2020-09-08T16:11:37.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:37.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj280 td/osd-backfill-space/datafile 2020-09-08T16:11:37.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:37.812 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:37.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:37.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj281 td/osd-backfill-space/datafile 2020-09-08T16:11:37.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:37.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj281 td/osd-backfill-space/datafile 2020-09-08T16:11:37.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:37.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj281 td/osd-backfill-space/datafile 2020-09-08T16:11:38.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:38.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj281 td/osd-backfill-space/datafile 2020-09-08T16:11:38.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:38.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj281 td/osd-backfill-space/datafile 2020-09-08T16:11:38.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:38.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj281 td/osd-backfill-space/datafile 2020-09-08T16:11:38.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:38.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj281 td/osd-backfill-space/datafile 2020-09-08T16:11:38.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:38.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj281 td/osd-backfill-space/datafile 2020-09-08T16:11:38.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:38.508 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:38.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:38.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj282 td/osd-backfill-space/datafile 2020-09-08T16:11:38.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:38.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj282 td/osd-backfill-space/datafile 2020-09-08T16:11:38.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:38.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj282 td/osd-backfill-space/datafile 2020-09-08T16:11:38.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:38.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj282 td/osd-backfill-space/datafile 2020-09-08T16:11:38.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:38.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj282 td/osd-backfill-space/datafile 2020-09-08T16:11:38.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:38.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj282 td/osd-backfill-space/datafile 2020-09-08T16:11:38.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:38.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj282 td/osd-backfill-space/datafile 2020-09-08T16:11:39.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:39.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj282 td/osd-backfill-space/datafile 2020-09-08T16:11:39.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:39.127 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:39.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:39.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj283 td/osd-backfill-space/datafile 2020-09-08T16:11:39.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:39.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj283 td/osd-backfill-space/datafile 2020-09-08T16:11:39.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:39.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj283 td/osd-backfill-space/datafile 2020-09-08T16:11:39.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:39.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj283 td/osd-backfill-space/datafile 2020-09-08T16:11:39.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:39.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj283 td/osd-backfill-space/datafile 2020-09-08T16:11:39.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:39.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj283 td/osd-backfill-space/datafile 2020-09-08T16:11:39.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:39.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj283 td/osd-backfill-space/datafile 2020-09-08T16:11:39.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:39.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj283 td/osd-backfill-space/datafile 2020-09-08T16:11:39.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:39.739 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:39.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:39.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj284 td/osd-backfill-space/datafile 2020-09-08T16:11:39.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:39.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj284 td/osd-backfill-space/datafile 2020-09-08T16:11:39.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:39.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj284 td/osd-backfill-space/datafile 2020-09-08T16:11:39.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:39.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj284 td/osd-backfill-space/datafile 2020-09-08T16:11:40.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:40.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj284 td/osd-backfill-space/datafile 2020-09-08T16:11:40.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:40.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj284 td/osd-backfill-space/datafile 2020-09-08T16:11:40.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:40.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj284 td/osd-backfill-space/datafile 2020-09-08T16:11:40.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:40.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj284 td/osd-backfill-space/datafile 2020-09-08T16:11:40.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:40.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:40.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:40.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj285 td/osd-backfill-space/datafile 2020-09-08T16:11:40.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:40.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj285 td/osd-backfill-space/datafile 2020-09-08T16:11:40.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:40.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj285 td/osd-backfill-space/datafile 2020-09-08T16:11:40.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:40.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj285 td/osd-backfill-space/datafile 2020-09-08T16:11:40.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:40.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj285 td/osd-backfill-space/datafile 2020-09-08T16:11:40.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:40.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj285 td/osd-backfill-space/datafile 2020-09-08T16:11:40.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:40.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj285 td/osd-backfill-space/datafile 2020-09-08T16:11:41.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:41.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj285 td/osd-backfill-space/datafile 2020-09-08T16:11:41.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:41.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:41.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:41.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj286 td/osd-backfill-space/datafile 2020-09-08T16:11:41.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:41.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj286 td/osd-backfill-space/datafile 2020-09-08T16:11:41.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:41.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj286 td/osd-backfill-space/datafile 2020-09-08T16:11:41.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:41.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj286 td/osd-backfill-space/datafile 2020-09-08T16:11:41.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:41.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj286 td/osd-backfill-space/datafile 2020-09-08T16:11:41.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:41.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj286 td/osd-backfill-space/datafile 2020-09-08T16:11:41.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:41.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj286 td/osd-backfill-space/datafile 2020-09-08T16:11:41.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:41.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj286 td/osd-backfill-space/datafile 2020-09-08T16:11:41.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:41.765 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:41.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:41.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj287 td/osd-backfill-space/datafile 2020-09-08T16:11:41.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:41.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj287 td/osd-backfill-space/datafile 2020-09-08T16:11:41.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:41.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj287 td/osd-backfill-space/datafile 2020-09-08T16:11:41.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:41.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj287 td/osd-backfill-space/datafile 2020-09-08T16:11:42.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:42.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj287 td/osd-backfill-space/datafile 2020-09-08T16:11:42.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:42.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj287 td/osd-backfill-space/datafile 2020-09-08T16:11:42.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:42.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj287 td/osd-backfill-space/datafile 2020-09-08T16:11:42.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:42.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj287 td/osd-backfill-space/datafile 2020-09-08T16:11:42.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:42.410 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:42.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:42.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj288 td/osd-backfill-space/datafile 2020-09-08T16:11:42.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:42.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj288 td/osd-backfill-space/datafile 2020-09-08T16:11:42.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:42.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj288 td/osd-backfill-space/datafile 2020-09-08T16:11:42.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:42.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj288 td/osd-backfill-space/datafile 2020-09-08T16:11:42.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:42.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj288 td/osd-backfill-space/datafile 2020-09-08T16:11:42.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:42.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj288 td/osd-backfill-space/datafile 2020-09-08T16:11:42.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:42.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj288 td/osd-backfill-space/datafile 2020-09-08T16:11:42.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:42.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj288 td/osd-backfill-space/datafile 2020-09-08T16:11:43.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:43.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:43.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:43.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj289 td/osd-backfill-space/datafile 2020-09-08T16:11:43.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:43.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj289 td/osd-backfill-space/datafile 2020-09-08T16:11:43.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:43.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj289 td/osd-backfill-space/datafile 2020-09-08T16:11:43.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:43.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj289 td/osd-backfill-space/datafile 2020-09-08T16:11:43.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:43.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj289 td/osd-backfill-space/datafile 2020-09-08T16:11:43.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:43.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj289 td/osd-backfill-space/datafile 2020-09-08T16:11:43.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:43.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj289 td/osd-backfill-space/datafile 2020-09-08T16:11:43.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:43.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj289 td/osd-backfill-space/datafile 2020-09-08T16:11:43.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:43.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:43.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:43.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj290 td/osd-backfill-space/datafile 2020-09-08T16:11:43.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:43.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj290 td/osd-backfill-space/datafile 2020-09-08T16:11:43.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:43.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj290 td/osd-backfill-space/datafile 2020-09-08T16:11:43.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:43.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj290 td/osd-backfill-space/datafile 2020-09-08T16:11:43.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:43.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj290 td/osd-backfill-space/datafile 2020-09-08T16:11:44.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:44.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj290 td/osd-backfill-space/datafile 2020-09-08T16:11:44.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:44.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj290 td/osd-backfill-space/datafile 2020-09-08T16:11:44.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:44.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj290 td/osd-backfill-space/datafile 2020-09-08T16:11:44.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:44.344 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:44.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:44.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj291 td/osd-backfill-space/datafile 2020-09-08T16:11:44.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:44.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj291 td/osd-backfill-space/datafile 2020-09-08T16:11:44.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:44.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj291 td/osd-backfill-space/datafile 2020-09-08T16:11:44.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:44.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj291 td/osd-backfill-space/datafile 2020-09-08T16:11:44.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:44.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj291 td/osd-backfill-space/datafile 2020-09-08T16:11:44.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:44.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj291 td/osd-backfill-space/datafile 2020-09-08T16:11:44.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:44.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj291 td/osd-backfill-space/datafile 2020-09-08T16:11:44.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:44.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj291 td/osd-backfill-space/datafile 2020-09-08T16:11:45.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:45.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:45.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:45.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj292 td/osd-backfill-space/datafile 2020-09-08T16:11:45.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:45.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj292 td/osd-backfill-space/datafile 2020-09-08T16:11:45.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:45.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj292 td/osd-backfill-space/datafile 2020-09-08T16:11:45.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:45.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj292 td/osd-backfill-space/datafile 2020-09-08T16:11:45.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:45.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj292 td/osd-backfill-space/datafile 2020-09-08T16:11:45.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:45.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj292 td/osd-backfill-space/datafile 2020-09-08T16:11:45.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:45.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj292 td/osd-backfill-space/datafile 2020-09-08T16:11:45.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:45.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj292 td/osd-backfill-space/datafile 2020-09-08T16:11:46.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:46.035 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:46.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:46.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj293 td/osd-backfill-space/datafile 2020-09-08T16:11:46.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:46.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj293 td/osd-backfill-space/datafile 2020-09-08T16:11:46.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:46.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj293 td/osd-backfill-space/datafile 2020-09-08T16:11:46.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:46.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj293 td/osd-backfill-space/datafile 2020-09-08T16:11:46.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:46.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj293 td/osd-backfill-space/datafile 2020-09-08T16:11:46.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:46.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj293 td/osd-backfill-space/datafile 2020-09-08T16:11:46.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:46.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj293 td/osd-backfill-space/datafile 2020-09-08T16:11:46.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:46.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj293 td/osd-backfill-space/datafile 2020-09-08T16:11:46.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:46.763 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:46.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:46.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj294 td/osd-backfill-space/datafile 2020-09-08T16:11:46.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:46.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj294 td/osd-backfill-space/datafile 2020-09-08T16:11:46.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:46.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj294 td/osd-backfill-space/datafile 2020-09-08T16:11:46.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:46.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj294 td/osd-backfill-space/datafile 2020-09-08T16:11:47.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:47.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj294 td/osd-backfill-space/datafile 2020-09-08T16:11:47.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:47.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj294 td/osd-backfill-space/datafile 2020-09-08T16:11:47.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:47.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj294 td/osd-backfill-space/datafile 2020-09-08T16:11:47.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:47.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj294 td/osd-backfill-space/datafile 2020-09-08T16:11:47.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:47.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:47.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:47.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj295 td/osd-backfill-space/datafile 2020-09-08T16:11:47.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:47.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj295 td/osd-backfill-space/datafile 2020-09-08T16:11:47.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:47.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj295 td/osd-backfill-space/datafile 2020-09-08T16:11:47.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:47.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj295 td/osd-backfill-space/datafile 2020-09-08T16:11:47.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:47.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj295 td/osd-backfill-space/datafile 2020-09-08T16:11:47.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:47.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj295 td/osd-backfill-space/datafile 2020-09-08T16:11:47.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:47.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj295 td/osd-backfill-space/datafile 2020-09-08T16:11:47.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:47.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj295 td/osd-backfill-space/datafile 2020-09-08T16:11:47.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:47.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:47.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:47.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj296 td/osd-backfill-space/datafile 2020-09-08T16:11:48.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:48.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj296 td/osd-backfill-space/datafile 2020-09-08T16:11:48.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:48.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj296 td/osd-backfill-space/datafile 2020-09-08T16:11:48.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:48.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj296 td/osd-backfill-space/datafile 2020-09-08T16:11:48.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:48.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj296 td/osd-backfill-space/datafile 2020-09-08T16:11:48.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:48.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj296 td/osd-backfill-space/datafile 2020-09-08T16:11:48.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:48.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj296 td/osd-backfill-space/datafile 2020-09-08T16:11:48.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:48.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj296 td/osd-backfill-space/datafile 2020-09-08T16:11:48.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:48.690 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:48.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:48.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj297 td/osd-backfill-space/datafile 2020-09-08T16:11:48.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:48.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj297 td/osd-backfill-space/datafile 2020-09-08T16:11:48.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:48.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj297 td/osd-backfill-space/datafile 2020-09-08T16:11:48.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:48.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj297 td/osd-backfill-space/datafile 2020-09-08T16:11:49.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:49.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj297 td/osd-backfill-space/datafile 2020-09-08T16:11:49.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:49.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj297 td/osd-backfill-space/datafile 2020-09-08T16:11:49.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:49.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj297 td/osd-backfill-space/datafile 2020-09-08T16:11:49.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:49.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj297 td/osd-backfill-space/datafile 2020-09-08T16:11:49.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:49.318 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:49.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:49.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj298 td/osd-backfill-space/datafile 2020-09-08T16:11:49.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:49.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj298 td/osd-backfill-space/datafile 2020-09-08T16:11:49.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:49.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj298 td/osd-backfill-space/datafile 2020-09-08T16:11:49.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:49.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj298 td/osd-backfill-space/datafile 2020-09-08T16:11:49.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:49.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj298 td/osd-backfill-space/datafile 2020-09-08T16:11:49.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:49.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj298 td/osd-backfill-space/datafile 2020-09-08T16:11:49.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:49.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj298 td/osd-backfill-space/datafile 2020-09-08T16:11:49.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:49.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj298 td/osd-backfill-space/datafile 2020-09-08T16:11:49.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:49.971 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:49.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:49.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj299 td/osd-backfill-space/datafile 2020-09-08T16:11:50.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:50.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj299 td/osd-backfill-space/datafile 2020-09-08T16:11:50.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:50.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj299 td/osd-backfill-space/datafile 2020-09-08T16:11:50.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:50.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj299 td/osd-backfill-space/datafile 2020-09-08T16:11:50.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:50.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj299 td/osd-backfill-space/datafile 2020-09-08T16:11:50.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:50.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj299 td/osd-backfill-space/datafile 2020-09-08T16:11:50.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:50.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj299 td/osd-backfill-space/datafile 2020-09-08T16:11:50.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:50.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj299 td/osd-backfill-space/datafile 2020-09-08T16:11:50.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:50.666 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:50.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:50.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj300 td/osd-backfill-space/datafile 2020-09-08T16:11:50.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:50.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj300 td/osd-backfill-space/datafile 2020-09-08T16:11:50.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:50.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj300 td/osd-backfill-space/datafile 2020-09-08T16:11:50.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:50.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj300 td/osd-backfill-space/datafile 2020-09-08T16:11:51.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:51.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj300 td/osd-backfill-space/datafile 2020-09-08T16:11:51.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:51.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj300 td/osd-backfill-space/datafile 2020-09-08T16:11:51.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:51.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj300 td/osd-backfill-space/datafile 2020-09-08T16:11:51.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:51.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj300 td/osd-backfill-space/datafile 2020-09-08T16:11:51.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:51.428 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:51.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:51.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj301 td/osd-backfill-space/datafile 2020-09-08T16:11:51.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:51.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj301 td/osd-backfill-space/datafile 2020-09-08T16:11:51.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:51.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj301 td/osd-backfill-space/datafile 2020-09-08T16:11:51.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:51.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj301 td/osd-backfill-space/datafile 2020-09-08T16:11:51.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:51.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj301 td/osd-backfill-space/datafile 2020-09-08T16:11:51.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:51.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj301 td/osd-backfill-space/datafile 2020-09-08T16:11:51.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:51.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj301 td/osd-backfill-space/datafile 2020-09-08T16:11:51.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:51.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj301 td/osd-backfill-space/datafile 2020-09-08T16:11:52.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:52.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:52.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:52.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj302 td/osd-backfill-space/datafile 2020-09-08T16:11:52.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:52.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj302 td/osd-backfill-space/datafile 2020-09-08T16:11:52.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:52.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj302 td/osd-backfill-space/datafile 2020-09-08T16:11:52.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:52.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj302 td/osd-backfill-space/datafile 2020-09-08T16:11:52.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:52.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj302 td/osd-backfill-space/datafile 2020-09-08T16:11:52.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:52.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj302 td/osd-backfill-space/datafile 2020-09-08T16:11:52.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:52.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj302 td/osd-backfill-space/datafile 2020-09-08T16:11:52.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:52.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj302 td/osd-backfill-space/datafile 2020-09-08T16:11:52.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:52.753 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:52.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:52.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj303 td/osd-backfill-space/datafile 2020-09-08T16:11:52.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:52.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj303 td/osd-backfill-space/datafile 2020-09-08T16:11:52.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:52.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj303 td/osd-backfill-space/datafile 2020-09-08T16:11:52.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:52.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj303 td/osd-backfill-space/datafile 2020-09-08T16:11:53.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:53.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj303 td/osd-backfill-space/datafile 2020-09-08T16:11:53.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:53.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj303 td/osd-backfill-space/datafile 2020-09-08T16:11:53.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:53.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj303 td/osd-backfill-space/datafile 2020-09-08T16:11:53.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:53.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj303 td/osd-backfill-space/datafile 2020-09-08T16:11:53.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:53.364 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:53.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:53.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj304 td/osd-backfill-space/datafile 2020-09-08T16:11:53.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:53.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj304 td/osd-backfill-space/datafile 2020-09-08T16:11:53.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:53.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj304 td/osd-backfill-space/datafile 2020-09-08T16:11:53.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:53.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj304 td/osd-backfill-space/datafile 2020-09-08T16:11:53.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:53.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj304 td/osd-backfill-space/datafile 2020-09-08T16:11:53.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:53.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj304 td/osd-backfill-space/datafile 2020-09-08T16:11:53.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:53.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj304 td/osd-backfill-space/datafile 2020-09-08T16:11:53.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:53.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj304 td/osd-backfill-space/datafile 2020-09-08T16:11:53.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:53.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:53.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:53.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj305 td/osd-backfill-space/datafile 2020-09-08T16:11:54.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:54.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj305 td/osd-backfill-space/datafile 2020-09-08T16:11:54.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:54.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj305 td/osd-backfill-space/datafile 2020-09-08T16:11:54.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:54.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj305 td/osd-backfill-space/datafile 2020-09-08T16:11:54.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:54.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj305 td/osd-backfill-space/datafile 2020-09-08T16:11:54.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:54.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj305 td/osd-backfill-space/datafile 2020-09-08T16:11:54.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:54.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj305 td/osd-backfill-space/datafile 2020-09-08T16:11:54.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:54.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj305 td/osd-backfill-space/datafile 2020-09-08T16:11:54.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:54.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:54.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:54.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj306 td/osd-backfill-space/datafile 2020-09-08T16:11:54.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:54.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj306 td/osd-backfill-space/datafile 2020-09-08T16:11:54.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:54.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj306 td/osd-backfill-space/datafile 2020-09-08T16:11:54.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:54.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj306 td/osd-backfill-space/datafile 2020-09-08T16:11:54.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:54.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj306 td/osd-backfill-space/datafile 2020-09-08T16:11:55.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:55.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj306 td/osd-backfill-space/datafile 2020-09-08T16:11:55.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:55.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj306 td/osd-backfill-space/datafile 2020-09-08T16:11:55.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:55.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj306 td/osd-backfill-space/datafile 2020-09-08T16:11:55.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:55.300 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:55.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:55.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj307 td/osd-backfill-space/datafile 2020-09-08T16:11:55.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:55.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj307 td/osd-backfill-space/datafile 2020-09-08T16:11:55.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:55.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj307 td/osd-backfill-space/datafile 2020-09-08T16:11:55.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:55.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj307 td/osd-backfill-space/datafile 2020-09-08T16:11:55.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:55.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj307 td/osd-backfill-space/datafile 2020-09-08T16:11:55.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:55.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj307 td/osd-backfill-space/datafile 2020-09-08T16:11:55.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:55.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj307 td/osd-backfill-space/datafile 2020-09-08T16:11:55.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:55.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj307 td/osd-backfill-space/datafile 2020-09-08T16:11:55.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:55.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:55.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:55.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj308 td/osd-backfill-space/datafile 2020-09-08T16:11:56.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:56.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj308 td/osd-backfill-space/datafile 2020-09-08T16:11:56.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:56.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj308 td/osd-backfill-space/datafile 2020-09-08T16:11:56.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:56.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj308 td/osd-backfill-space/datafile 2020-09-08T16:11:56.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:56.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj308 td/osd-backfill-space/datafile 2020-09-08T16:11:56.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:56.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj308 td/osd-backfill-space/datafile 2020-09-08T16:11:56.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:56.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj308 td/osd-backfill-space/datafile 2020-09-08T16:11:56.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:56.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj308 td/osd-backfill-space/datafile 2020-09-08T16:11:56.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:56.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:56.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:56.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj309 td/osd-backfill-space/datafile 2020-09-08T16:11:56.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:56.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj309 td/osd-backfill-space/datafile 2020-09-08T16:11:56.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:56.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj309 td/osd-backfill-space/datafile 2020-09-08T16:11:56.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:56.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj309 td/osd-backfill-space/datafile 2020-09-08T16:11:57.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:57.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj309 td/osd-backfill-space/datafile 2020-09-08T16:11:57.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:57.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj309 td/osd-backfill-space/datafile 2020-09-08T16:11:57.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:57.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj309 td/osd-backfill-space/datafile 2020-09-08T16:11:57.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:57.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj309 td/osd-backfill-space/datafile 2020-09-08T16:11:57.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:57.336 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:57.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:57.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj310 td/osd-backfill-space/datafile 2020-09-08T16:11:57.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:57.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj310 td/osd-backfill-space/datafile 2020-09-08T16:11:57.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:57.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj310 td/osd-backfill-space/datafile 2020-09-08T16:11:57.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:57.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj310 td/osd-backfill-space/datafile 2020-09-08T16:11:57.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:57.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj310 td/osd-backfill-space/datafile 2020-09-08T16:11:57.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:57.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj310 td/osd-backfill-space/datafile 2020-09-08T16:11:57.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:57.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj310 td/osd-backfill-space/datafile 2020-09-08T16:11:57.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:57.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj310 td/osd-backfill-space/datafile 2020-09-08T16:11:57.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:57.947 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:57.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:57.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj311 td/osd-backfill-space/datafile 2020-09-08T16:11:58.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:58.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj311 td/osd-backfill-space/datafile 2020-09-08T16:11:58.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:58.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj311 td/osd-backfill-space/datafile 2020-09-08T16:11:58.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:58.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj311 td/osd-backfill-space/datafile 2020-09-08T16:11:58.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:58.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj311 td/osd-backfill-space/datafile 2020-09-08T16:11:58.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:58.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj311 td/osd-backfill-space/datafile 2020-09-08T16:11:58.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:58.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj311 td/osd-backfill-space/datafile 2020-09-08T16:11:58.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:58.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj311 td/osd-backfill-space/datafile 2020-09-08T16:11:58.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:58.643 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:58.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:58.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj312 td/osd-backfill-space/datafile 2020-09-08T16:11:58.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:58.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj312 td/osd-backfill-space/datafile 2020-09-08T16:11:58.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:58.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj312 td/osd-backfill-space/datafile 2020-09-08T16:11:58.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:58.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj312 td/osd-backfill-space/datafile 2020-09-08T16:11:58.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:58.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj312 td/osd-backfill-space/datafile 2020-09-08T16:11:59.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:59.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj312 td/osd-backfill-space/datafile 2020-09-08T16:11:59.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:59.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj312 td/osd-backfill-space/datafile 2020-09-08T16:11:59.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:59.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj312 td/osd-backfill-space/datafile 2020-09-08T16:11:59.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:59.285 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:59.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:59.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj313 td/osd-backfill-space/datafile 2020-09-08T16:11:59.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:59.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj313 td/osd-backfill-space/datafile 2020-09-08T16:11:59.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:59.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj313 td/osd-backfill-space/datafile 2020-09-08T16:11:59.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:59.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj313 td/osd-backfill-space/datafile 2020-09-08T16:11:59.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:59.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj313 td/osd-backfill-space/datafile 2020-09-08T16:11:59.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:59.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj313 td/osd-backfill-space/datafile 2020-09-08T16:11:59.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:59.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj313 td/osd-backfill-space/datafile 2020-09-08T16:11:59.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:59.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj313 td/osd-backfill-space/datafile 2020-09-08T16:11:59.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:11:59.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:11:59.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:59.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj314 td/osd-backfill-space/datafile 2020-09-08T16:11:59.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:11:59.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj314 td/osd-backfill-space/datafile 2020-09-08T16:12:00.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:00.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj314 td/osd-backfill-space/datafile 2020-09-08T16:12:00.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:00.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj314 td/osd-backfill-space/datafile 2020-09-08T16:12:00.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:00.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj314 td/osd-backfill-space/datafile 2020-09-08T16:12:00.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:00.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj314 td/osd-backfill-space/datafile 2020-09-08T16:12:00.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:00.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj314 td/osd-backfill-space/datafile 2020-09-08T16:12:00.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:00.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj314 td/osd-backfill-space/datafile 2020-09-08T16:12:00.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:00.595 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:00.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:00.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj315 td/osd-backfill-space/datafile 2020-09-08T16:12:00.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:00.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj315 td/osd-backfill-space/datafile 2020-09-08T16:12:00.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:00.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj315 td/osd-backfill-space/datafile 2020-09-08T16:12:00.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:00.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj315 td/osd-backfill-space/datafile 2020-09-08T16:12:00.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:00.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj315 td/osd-backfill-space/datafile 2020-09-08T16:12:00.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:00.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj315 td/osd-backfill-space/datafile 2020-09-08T16:12:01.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:01.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj315 td/osd-backfill-space/datafile 2020-09-08T16:12:01.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:01.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj315 td/osd-backfill-space/datafile 2020-09-08T16:12:01.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:01.248 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:01.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:01.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj316 td/osd-backfill-space/datafile 2020-09-08T16:12:01.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:01.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj316 td/osd-backfill-space/datafile 2020-09-08T16:12:01.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:01.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj316 td/osd-backfill-space/datafile 2020-09-08T16:12:01.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:01.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj316 td/osd-backfill-space/datafile 2020-09-08T16:12:01.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:01.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj316 td/osd-backfill-space/datafile 2020-09-08T16:12:01.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:01.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj316 td/osd-backfill-space/datafile 2020-09-08T16:12:01.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:01.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj316 td/osd-backfill-space/datafile 2020-09-08T16:12:01.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:01.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj316 td/osd-backfill-space/datafile 2020-09-08T16:12:01.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:01.869 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:01.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:01.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj317 td/osd-backfill-space/datafile 2020-09-08T16:12:01.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:01.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj317 td/osd-backfill-space/datafile 2020-09-08T16:12:02.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:02.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj317 td/osd-backfill-space/datafile 2020-09-08T16:12:02.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:02.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj317 td/osd-backfill-space/datafile 2020-09-08T16:12:02.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:02.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj317 td/osd-backfill-space/datafile 2020-09-08T16:12:02.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:02.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj317 td/osd-backfill-space/datafile 2020-09-08T16:12:02.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:02.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj317 td/osd-backfill-space/datafile 2020-09-08T16:12:02.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:02.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj317 td/osd-backfill-space/datafile 2020-09-08T16:12:02.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:02.547 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:02.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:02.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj318 td/osd-backfill-space/datafile 2020-09-08T16:12:02.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:02.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj318 td/osd-backfill-space/datafile 2020-09-08T16:12:02.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:02.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj318 td/osd-backfill-space/datafile 2020-09-08T16:12:02.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:02.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj318 td/osd-backfill-space/datafile 2020-09-08T16:12:02.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:02.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj318 td/osd-backfill-space/datafile 2020-09-08T16:12:02.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:02.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj318 td/osd-backfill-space/datafile 2020-09-08T16:12:03.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:03.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj318 td/osd-backfill-space/datafile 2020-09-08T16:12:03.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:03.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj318 td/osd-backfill-space/datafile 2020-09-08T16:12:03.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:03.160 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:03.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:03.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj319 td/osd-backfill-space/datafile 2020-09-08T16:12:03.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:03.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj319 td/osd-backfill-space/datafile 2020-09-08T16:12:03.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:03.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj319 td/osd-backfill-space/datafile 2020-09-08T16:12:03.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:03.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj319 td/osd-backfill-space/datafile 2020-09-08T16:12:03.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:03.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj319 td/osd-backfill-space/datafile 2020-09-08T16:12:03.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:03.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj319 td/osd-backfill-space/datafile 2020-09-08T16:12:03.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:03.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj319 td/osd-backfill-space/datafile 2020-09-08T16:12:03.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:03.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj319 td/osd-backfill-space/datafile 2020-09-08T16:12:03.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:03.770 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:03.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:03.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj320 td/osd-backfill-space/datafile 2020-09-08T16:12:03.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:03.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj320 td/osd-backfill-space/datafile 2020-09-08T16:12:03.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:03.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj320 td/osd-backfill-space/datafile 2020-09-08T16:12:04.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:04.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj320 td/osd-backfill-space/datafile 2020-09-08T16:12:04.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:04.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj320 td/osd-backfill-space/datafile 2020-09-08T16:12:04.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:04.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj320 td/osd-backfill-space/datafile 2020-09-08T16:12:04.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:04.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj320 td/osd-backfill-space/datafile 2020-09-08T16:12:04.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:04.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj320 td/osd-backfill-space/datafile 2020-09-08T16:12:04.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:04.432 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:04.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:04.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj321 td/osd-backfill-space/datafile 2020-09-08T16:12:04.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:04.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj321 td/osd-backfill-space/datafile 2020-09-08T16:12:04.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:04.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj321 td/osd-backfill-space/datafile 2020-09-08T16:12:04.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:04.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj321 td/osd-backfill-space/datafile 2020-09-08T16:12:04.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:04.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj321 td/osd-backfill-space/datafile 2020-09-08T16:12:04.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:04.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj321 td/osd-backfill-space/datafile 2020-09-08T16:12:04.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:04.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj321 td/osd-backfill-space/datafile 2020-09-08T16:12:05.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:05.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj321 td/osd-backfill-space/datafile 2020-09-08T16:12:05.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:05.077 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:05.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:05.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj322 td/osd-backfill-space/datafile 2020-09-08T16:12:05.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:05.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj322 td/osd-backfill-space/datafile 2020-09-08T16:12:05.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:05.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj322 td/osd-backfill-space/datafile 2020-09-08T16:12:05.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:05.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj322 td/osd-backfill-space/datafile 2020-09-08T16:12:05.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:05.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj322 td/osd-backfill-space/datafile 2020-09-08T16:12:05.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:05.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj322 td/osd-backfill-space/datafile 2020-09-08T16:12:05.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:05.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj322 td/osd-backfill-space/datafile 2020-09-08T16:12:05.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:05.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj322 td/osd-backfill-space/datafile 2020-09-08T16:12:05.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:05.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:05.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:05.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj323 td/osd-backfill-space/datafile 2020-09-08T16:12:05.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:05.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj323 td/osd-backfill-space/datafile 2020-09-08T16:12:05.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:05.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj323 td/osd-backfill-space/datafile 2020-09-08T16:12:05.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:05.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj323 td/osd-backfill-space/datafile 2020-09-08T16:12:06.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:06.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj323 td/osd-backfill-space/datafile 2020-09-08T16:12:06.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:06.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj323 td/osd-backfill-space/datafile 2020-09-08T16:12:06.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:06.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj323 td/osd-backfill-space/datafile 2020-09-08T16:12:06.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:06.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj323 td/osd-backfill-space/datafile 2020-09-08T16:12:06.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:06.379 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:06.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:06.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj324 td/osd-backfill-space/datafile 2020-09-08T16:12:06.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:06.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj324 td/osd-backfill-space/datafile 2020-09-08T16:12:06.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:06.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj324 td/osd-backfill-space/datafile 2020-09-08T16:12:06.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:06.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj324 td/osd-backfill-space/datafile 2020-09-08T16:12:06.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:06.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj324 td/osd-backfill-space/datafile 2020-09-08T16:12:06.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:06.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj324 td/osd-backfill-space/datafile 2020-09-08T16:12:06.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:06.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj324 td/osd-backfill-space/datafile 2020-09-08T16:12:07.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:07.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj324 td/osd-backfill-space/datafile 2020-09-08T16:12:07.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:07.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:07.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:07.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj325 td/osd-backfill-space/datafile 2020-09-08T16:12:07.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:07.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj325 td/osd-backfill-space/datafile 2020-09-08T16:12:07.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:07.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj325 td/osd-backfill-space/datafile 2020-09-08T16:12:07.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:07.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj325 td/osd-backfill-space/datafile 2020-09-08T16:12:07.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:07.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj325 td/osd-backfill-space/datafile 2020-09-08T16:12:07.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:07.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj325 td/osd-backfill-space/datafile 2020-09-08T16:12:07.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:07.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj325 td/osd-backfill-space/datafile 2020-09-08T16:12:07.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:07.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj325 td/osd-backfill-space/datafile 2020-09-08T16:12:07.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:07.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:07.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:07.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj326 td/osd-backfill-space/datafile 2020-09-08T16:12:07.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:07.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj326 td/osd-backfill-space/datafile 2020-09-08T16:12:07.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:07.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj326 td/osd-backfill-space/datafile 2020-09-08T16:12:07.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:07.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj326 td/osd-backfill-space/datafile 2020-09-08T16:12:08.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:08.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj326 td/osd-backfill-space/datafile 2020-09-08T16:12:08.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:08.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj326 td/osd-backfill-space/datafile 2020-09-08T16:12:08.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:08.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj326 td/osd-backfill-space/datafile 2020-09-08T16:12:08.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:08.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj326 td/osd-backfill-space/datafile 2020-09-08T16:12:08.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:08.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:08.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:08.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj327 td/osd-backfill-space/datafile 2020-09-08T16:12:08.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:08.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj327 td/osd-backfill-space/datafile 2020-09-08T16:12:08.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:08.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj327 td/osd-backfill-space/datafile 2020-09-08T16:12:08.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:08.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj327 td/osd-backfill-space/datafile 2020-09-08T16:12:08.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:08.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj327 td/osd-backfill-space/datafile 2020-09-08T16:12:08.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:08.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj327 td/osd-backfill-space/datafile 2020-09-08T16:12:08.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:08.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj327 td/osd-backfill-space/datafile 2020-09-08T16:12:08.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:08.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj327 td/osd-backfill-space/datafile 2020-09-08T16:12:09.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:09.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:09.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:09.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj328 td/osd-backfill-space/datafile 2020-09-08T16:12:09.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:09.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj328 td/osd-backfill-space/datafile 2020-09-08T16:12:09.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:09.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj328 td/osd-backfill-space/datafile 2020-09-08T16:12:09.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:09.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj328 td/osd-backfill-space/datafile 2020-09-08T16:12:09.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:09.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj328 td/osd-backfill-space/datafile 2020-09-08T16:12:09.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:09.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj328 td/osd-backfill-space/datafile 2020-09-08T16:12:09.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:09.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj328 td/osd-backfill-space/datafile 2020-09-08T16:12:09.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:09.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj328 td/osd-backfill-space/datafile 2020-09-08T16:12:09.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:09.651 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:09.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:09.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj329 td/osd-backfill-space/datafile 2020-09-08T16:12:09.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:09.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj329 td/osd-backfill-space/datafile 2020-09-08T16:12:09.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:09.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj329 td/osd-backfill-space/datafile 2020-09-08T16:12:09.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:09.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj329 td/osd-backfill-space/datafile 2020-09-08T16:12:09.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:09.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj329 td/osd-backfill-space/datafile 2020-09-08T16:12:10.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:10.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj329 td/osd-backfill-space/datafile 2020-09-08T16:12:10.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:10.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj329 td/osd-backfill-space/datafile 2020-09-08T16:12:10.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:10.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj329 td/osd-backfill-space/datafile 2020-09-08T16:12:10.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:10.279 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:10.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:10.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj330 td/osd-backfill-space/datafile 2020-09-08T16:12:10.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:10.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj330 td/osd-backfill-space/datafile 2020-09-08T16:12:10.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:10.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj330 td/osd-backfill-space/datafile 2020-09-08T16:12:10.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:10.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj330 td/osd-backfill-space/datafile 2020-09-08T16:12:10.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:10.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj330 td/osd-backfill-space/datafile 2020-09-08T16:12:10.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:10.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj330 td/osd-backfill-space/datafile 2020-09-08T16:12:10.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:10.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj330 td/osd-backfill-space/datafile 2020-09-08T16:12:10.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:10.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj330 td/osd-backfill-space/datafile 2020-09-08T16:12:10.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:10.951 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:10.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:10.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj331 td/osd-backfill-space/datafile 2020-09-08T16:12:11.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:11.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj331 td/osd-backfill-space/datafile 2020-09-08T16:12:11.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:11.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj331 td/osd-backfill-space/datafile 2020-09-08T16:12:11.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:11.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj331 td/osd-backfill-space/datafile 2020-09-08T16:12:11.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:11.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj331 td/osd-backfill-space/datafile 2020-09-08T16:12:11.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:11.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj331 td/osd-backfill-space/datafile 2020-09-08T16:12:11.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:11.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj331 td/osd-backfill-space/datafile 2020-09-08T16:12:11.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:11.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj331 td/osd-backfill-space/datafile 2020-09-08T16:12:11.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:11.621 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:11.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:11.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj332 td/osd-backfill-space/datafile 2020-09-08T16:12:11.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:11.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj332 td/osd-backfill-space/datafile 2020-09-08T16:12:11.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:11.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj332 td/osd-backfill-space/datafile 2020-09-08T16:12:11.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:11.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj332 td/osd-backfill-space/datafile 2020-09-08T16:12:11.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:11.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj332 td/osd-backfill-space/datafile 2020-09-08T16:12:12.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:12.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj332 td/osd-backfill-space/datafile 2020-09-08T16:12:12.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:12.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj332 td/osd-backfill-space/datafile 2020-09-08T16:12:12.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:12.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj332 td/osd-backfill-space/datafile 2020-09-08T16:12:12.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:12.273 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:12.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:12.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj333 td/osd-backfill-space/datafile 2020-09-08T16:12:12.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:12.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj333 td/osd-backfill-space/datafile 2020-09-08T16:12:12.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:12.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj333 td/osd-backfill-space/datafile 2020-09-08T16:12:12.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:12.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj333 td/osd-backfill-space/datafile 2020-09-08T16:12:12.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:12.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj333 td/osd-backfill-space/datafile 2020-09-08T16:12:12.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:12.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj333 td/osd-backfill-space/datafile 2020-09-08T16:12:12.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:12.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj333 td/osd-backfill-space/datafile 2020-09-08T16:12:12.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:12.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj333 td/osd-backfill-space/datafile 2020-09-08T16:12:12.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:12.935 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:12.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:12.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj334 td/osd-backfill-space/datafile 2020-09-08T16:12:13.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:13.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj334 td/osd-backfill-space/datafile 2020-09-08T16:12:13.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:13.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj334 td/osd-backfill-space/datafile 2020-09-08T16:12:13.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:13.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj334 td/osd-backfill-space/datafile 2020-09-08T16:12:13.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:13.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj334 td/osd-backfill-space/datafile 2020-09-08T16:12:13.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:13.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj334 td/osd-backfill-space/datafile 2020-09-08T16:12:13.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:13.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj334 td/osd-backfill-space/datafile 2020-09-08T16:12:13.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:13.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj334 td/osd-backfill-space/datafile 2020-09-08T16:12:13.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:13.598 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:13.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:13.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj335 td/osd-backfill-space/datafile 2020-09-08T16:12:13.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:13.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj335 td/osd-backfill-space/datafile 2020-09-08T16:12:13.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:13.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj335 td/osd-backfill-space/datafile 2020-09-08T16:12:13.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:13.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj335 td/osd-backfill-space/datafile 2020-09-08T16:12:13.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:13.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj335 td/osd-backfill-space/datafile 2020-09-08T16:12:13.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:13.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj335 td/osd-backfill-space/datafile 2020-09-08T16:12:14.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:14.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj335 td/osd-backfill-space/datafile 2020-09-08T16:12:14.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:14.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj335 td/osd-backfill-space/datafile 2020-09-08T16:12:14.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:14.213 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:14.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:14.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj336 td/osd-backfill-space/datafile 2020-09-08T16:12:14.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:14.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj336 td/osd-backfill-space/datafile 2020-09-08T16:12:14.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:14.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj336 td/osd-backfill-space/datafile 2020-09-08T16:12:14.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:14.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj336 td/osd-backfill-space/datafile 2020-09-08T16:12:14.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:14.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj336 td/osd-backfill-space/datafile 2020-09-08T16:12:14.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:14.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj336 td/osd-backfill-space/datafile 2020-09-08T16:12:14.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:14.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj336 td/osd-backfill-space/datafile 2020-09-08T16:12:14.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:14.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj336 td/osd-backfill-space/datafile 2020-09-08T16:12:14.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:14.871 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:14.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:14.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj337 td/osd-backfill-space/datafile 2020-09-08T16:12:14.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:14.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj337 td/osd-backfill-space/datafile 2020-09-08T16:12:15.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:15.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj337 td/osd-backfill-space/datafile 2020-09-08T16:12:15.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:15.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj337 td/osd-backfill-space/datafile 2020-09-08T16:12:15.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:15.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj337 td/osd-backfill-space/datafile 2020-09-08T16:12:15.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:15.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj337 td/osd-backfill-space/datafile 2020-09-08T16:12:15.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:15.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj337 td/osd-backfill-space/datafile 2020-09-08T16:12:15.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:15.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj337 td/osd-backfill-space/datafile 2020-09-08T16:12:15.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:15.483 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:15.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:15.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj338 td/osd-backfill-space/datafile 2020-09-08T16:12:15.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:15.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj338 td/osd-backfill-space/datafile 2020-09-08T16:12:15.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:15.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj338 td/osd-backfill-space/datafile 2020-09-08T16:12:15.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:15.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj338 td/osd-backfill-space/datafile 2020-09-08T16:12:15.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:15.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj338 td/osd-backfill-space/datafile 2020-09-08T16:12:15.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:15.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj338 td/osd-backfill-space/datafile 2020-09-08T16:12:15.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:15.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj338 td/osd-backfill-space/datafile 2020-09-08T16:12:16.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:16.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj338 td/osd-backfill-space/datafile 2020-09-08T16:12:16.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:16.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:16.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:16.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj339 td/osd-backfill-space/datafile 2020-09-08T16:12:16.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:16.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj339 td/osd-backfill-space/datafile 2020-09-08T16:12:16.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:16.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj339 td/osd-backfill-space/datafile 2020-09-08T16:12:16.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:16.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj339 td/osd-backfill-space/datafile 2020-09-08T16:12:16.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:16.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj339 td/osd-backfill-space/datafile 2020-09-08T16:12:16.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:16.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj339 td/osd-backfill-space/datafile 2020-09-08T16:12:16.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:16.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj339 td/osd-backfill-space/datafile 2020-09-08T16:12:16.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:16.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj339 td/osd-backfill-space/datafile 2020-09-08T16:12:17.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:17.164 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:17.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:17.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj340 td/osd-backfill-space/datafile 2020-09-08T16:12:17.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:17.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj340 td/osd-backfill-space/datafile 2020-09-08T16:12:17.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:17.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj340 td/osd-backfill-space/datafile 2020-09-08T16:12:17.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:17.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj340 td/osd-backfill-space/datafile 2020-09-08T16:12:17.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:17.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj340 td/osd-backfill-space/datafile 2020-09-08T16:12:17.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:17.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj340 td/osd-backfill-space/datafile 2020-09-08T16:12:17.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:17.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj340 td/osd-backfill-space/datafile 2020-09-08T16:12:17.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:17.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj340 td/osd-backfill-space/datafile 2020-09-08T16:12:17.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:17.778 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:17.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:17.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj341 td/osd-backfill-space/datafile 2020-09-08T16:12:17.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:17.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj341 td/osd-backfill-space/datafile 2020-09-08T16:12:17.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:17.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj341 td/osd-backfill-space/datafile 2020-09-08T16:12:18.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:18.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj341 td/osd-backfill-space/datafile 2020-09-08T16:12:18.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:18.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj341 td/osd-backfill-space/datafile 2020-09-08T16:12:18.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:18.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj341 td/osd-backfill-space/datafile 2020-09-08T16:12:18.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:18.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj341 td/osd-backfill-space/datafile 2020-09-08T16:12:18.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:18.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj341 td/osd-backfill-space/datafile 2020-09-08T16:12:18.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:18.567 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:18.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:18.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj342 td/osd-backfill-space/datafile 2020-09-08T16:12:18.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:18.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj342 td/osd-backfill-space/datafile 2020-09-08T16:12:18.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:18.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj342 td/osd-backfill-space/datafile 2020-09-08T16:12:18.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:18.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj342 td/osd-backfill-space/datafile 2020-09-08T16:12:19.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:19.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj342 td/osd-backfill-space/datafile 2020-09-08T16:12:19.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:19.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj342 td/osd-backfill-space/datafile 2020-09-08T16:12:19.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:19.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj342 td/osd-backfill-space/datafile 2020-09-08T16:12:19.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:19.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj342 td/osd-backfill-space/datafile 2020-09-08T16:12:19.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:19.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:19.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:19.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj343 td/osd-backfill-space/datafile 2020-09-08T16:12:19.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:19.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj343 td/osd-backfill-space/datafile 2020-09-08T16:12:19.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:19.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj343 td/osd-backfill-space/datafile 2020-09-08T16:12:19.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:19.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj343 td/osd-backfill-space/datafile 2020-09-08T16:12:19.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:19.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj343 td/osd-backfill-space/datafile 2020-09-08T16:12:19.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:19.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj343 td/osd-backfill-space/datafile 2020-09-08T16:12:19.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:19.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj343 td/osd-backfill-space/datafile 2020-09-08T16:12:19.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:19.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj343 td/osd-backfill-space/datafile 2020-09-08T16:12:19.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:19.989 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:19.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:19.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj344 td/osd-backfill-space/datafile 2020-09-08T16:12:20.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:20.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj344 td/osd-backfill-space/datafile 2020-09-08T16:12:20.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:20.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj344 td/osd-backfill-space/datafile 2020-09-08T16:12:20.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:20.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj344 td/osd-backfill-space/datafile 2020-09-08T16:12:20.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:20.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj344 td/osd-backfill-space/datafile 2020-09-08T16:12:20.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:20.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj344 td/osd-backfill-space/datafile 2020-09-08T16:12:20.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:20.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj344 td/osd-backfill-space/datafile 2020-09-08T16:12:20.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:20.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj344 td/osd-backfill-space/datafile 2020-09-08T16:12:20.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:20.685 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:20.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:20.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj345 td/osd-backfill-space/datafile 2020-09-08T16:12:20.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:20.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj345 td/osd-backfill-space/datafile 2020-09-08T16:12:20.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:20.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj345 td/osd-backfill-space/datafile 2020-09-08T16:12:20.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:20.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj345 td/osd-backfill-space/datafile 2020-09-08T16:12:20.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:20.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj345 td/osd-backfill-space/datafile 2020-09-08T16:12:21.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:21.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj345 td/osd-backfill-space/datafile 2020-09-08T16:12:21.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:21.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj345 td/osd-backfill-space/datafile 2020-09-08T16:12:21.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:21.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj345 td/osd-backfill-space/datafile 2020-09-08T16:12:21.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:21.355 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:21.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:21.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj346 td/osd-backfill-space/datafile 2020-09-08T16:12:21.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:21.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj346 td/osd-backfill-space/datafile 2020-09-08T16:12:21.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:21.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj346 td/osd-backfill-space/datafile 2020-09-08T16:12:21.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:21.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj346 td/osd-backfill-space/datafile 2020-09-08T16:12:21.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:21.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj346 td/osd-backfill-space/datafile 2020-09-08T16:12:21.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:21.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj346 td/osd-backfill-space/datafile 2020-09-08T16:12:21.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:21.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj346 td/osd-backfill-space/datafile 2020-09-08T16:12:21.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:21.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj346 td/osd-backfill-space/datafile 2020-09-08T16:12:21.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:21.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:21.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:21.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj347 td/osd-backfill-space/datafile 2020-09-08T16:12:22.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:22.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj347 td/osd-backfill-space/datafile 2020-09-08T16:12:22.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:22.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj347 td/osd-backfill-space/datafile 2020-09-08T16:12:22.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:22.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj347 td/osd-backfill-space/datafile 2020-09-08T16:12:22.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:22.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj347 td/osd-backfill-space/datafile 2020-09-08T16:12:22.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:22.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj347 td/osd-backfill-space/datafile 2020-09-08T16:12:22.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:22.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj347 td/osd-backfill-space/datafile 2020-09-08T16:12:22.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:22.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj347 td/osd-backfill-space/datafile 2020-09-08T16:12:22.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:22.762 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:22.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:22.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj348 td/osd-backfill-space/datafile 2020-09-08T16:12:22.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:22.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj348 td/osd-backfill-space/datafile 2020-09-08T16:12:22.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:22.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj348 td/osd-backfill-space/datafile 2020-09-08T16:12:22.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:22.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj348 td/osd-backfill-space/datafile 2020-09-08T16:12:23.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:23.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj348 td/osd-backfill-space/datafile 2020-09-08T16:12:23.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:23.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj348 td/osd-backfill-space/datafile 2020-09-08T16:12:23.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:23.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj348 td/osd-backfill-space/datafile 2020-09-08T16:12:23.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:23.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj348 td/osd-backfill-space/datafile 2020-09-08T16:12:23.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:23.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:23.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:23.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj349 td/osd-backfill-space/datafile 2020-09-08T16:12:23.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:23.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj349 td/osd-backfill-space/datafile 2020-09-08T16:12:23.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:23.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj349 td/osd-backfill-space/datafile 2020-09-08T16:12:23.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:23.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj349 td/osd-backfill-space/datafile 2020-09-08T16:12:23.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:23.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj349 td/osd-backfill-space/datafile 2020-09-08T16:12:23.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:23.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj349 td/osd-backfill-space/datafile 2020-09-08T16:12:23.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:23.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj349 td/osd-backfill-space/datafile 2020-09-08T16:12:23.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:23.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj349 td/osd-backfill-space/datafile 2020-09-08T16:12:23.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:23.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:23.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:23.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj350 td/osd-backfill-space/datafile 2020-09-08T16:12:24.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:24.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj350 td/osd-backfill-space/datafile 2020-09-08T16:12:24.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:24.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj350 td/osd-backfill-space/datafile 2020-09-08T16:12:24.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:24.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj350 td/osd-backfill-space/datafile 2020-09-08T16:12:24.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:24.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj350 td/osd-backfill-space/datafile 2020-09-08T16:12:24.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:24.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj350 td/osd-backfill-space/datafile 2020-09-08T16:12:24.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:24.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj350 td/osd-backfill-space/datafile 2020-09-08T16:12:24.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:24.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj350 td/osd-backfill-space/datafile 2020-09-08T16:12:24.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:24.711 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:24.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:24.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj351 td/osd-backfill-space/datafile 2020-09-08T16:12:24.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:24.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj351 td/osd-backfill-space/datafile 2020-09-08T16:12:24.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:24.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj351 td/osd-backfill-space/datafile 2020-09-08T16:12:24.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:24.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj351 td/osd-backfill-space/datafile 2020-09-08T16:12:25.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:25.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj351 td/osd-backfill-space/datafile 2020-09-08T16:12:25.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:25.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj351 td/osd-backfill-space/datafile 2020-09-08T16:12:25.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:25.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj351 td/osd-backfill-space/datafile 2020-09-08T16:12:25.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:25.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj351 td/osd-backfill-space/datafile 2020-09-08T16:12:25.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:25.334 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:25.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:25.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj352 td/osd-backfill-space/datafile 2020-09-08T16:12:25.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:25.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj352 td/osd-backfill-space/datafile 2020-09-08T16:12:25.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:25.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj352 td/osd-backfill-space/datafile 2020-09-08T16:12:25.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:25.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj352 td/osd-backfill-space/datafile 2020-09-08T16:12:25.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:25.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj352 td/osd-backfill-space/datafile 2020-09-08T16:12:25.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:25.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj352 td/osd-backfill-space/datafile 2020-09-08T16:12:25.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:25.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj352 td/osd-backfill-space/datafile 2020-09-08T16:12:25.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:25.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj352 td/osd-backfill-space/datafile 2020-09-08T16:12:25.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:25.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:25.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:25.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj353 td/osd-backfill-space/datafile 2020-09-08T16:12:26.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:26.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj353 td/osd-backfill-space/datafile 2020-09-08T16:12:26.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:26.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj353 td/osd-backfill-space/datafile 2020-09-08T16:12:26.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:26.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj353 td/osd-backfill-space/datafile 2020-09-08T16:12:26.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:26.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj353 td/osd-backfill-space/datafile 2020-09-08T16:12:26.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:26.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj353 td/osd-backfill-space/datafile 2020-09-08T16:12:26.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:26.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj353 td/osd-backfill-space/datafile 2020-09-08T16:12:26.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:26.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj353 td/osd-backfill-space/datafile 2020-09-08T16:12:26.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:26.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:26.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:26.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj354 td/osd-backfill-space/datafile 2020-09-08T16:12:26.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:26.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj354 td/osd-backfill-space/datafile 2020-09-08T16:12:26.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:26.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj354 td/osd-backfill-space/datafile 2020-09-08T16:12:26.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:26.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj354 td/osd-backfill-space/datafile 2020-09-08T16:12:26.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:26.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj354 td/osd-backfill-space/datafile 2020-09-08T16:12:27.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:27.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj354 td/osd-backfill-space/datafile 2020-09-08T16:12:27.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:27.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj354 td/osd-backfill-space/datafile 2020-09-08T16:12:27.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:27.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj354 td/osd-backfill-space/datafile 2020-09-08T16:12:27.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:27.288 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:27.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:27.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj355 td/osd-backfill-space/datafile 2020-09-08T16:12:27.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:27.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj355 td/osd-backfill-space/datafile 2020-09-08T16:12:27.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:27.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj355 td/osd-backfill-space/datafile 2020-09-08T16:12:27.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:27.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj355 td/osd-backfill-space/datafile 2020-09-08T16:12:27.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:27.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj355 td/osd-backfill-space/datafile 2020-09-08T16:12:27.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:27.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj355 td/osd-backfill-space/datafile 2020-09-08T16:12:27.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:27.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj355 td/osd-backfill-space/datafile 2020-09-08T16:12:27.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:27.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj355 td/osd-backfill-space/datafile 2020-09-08T16:12:27.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:27.994 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:27.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:27.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj356 td/osd-backfill-space/datafile 2020-09-08T16:12:28.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:28.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj356 td/osd-backfill-space/datafile 2020-09-08T16:12:28.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:28.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj356 td/osd-backfill-space/datafile 2020-09-08T16:12:28.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:28.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj356 td/osd-backfill-space/datafile 2020-09-08T16:12:28.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:28.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj356 td/osd-backfill-space/datafile 2020-09-08T16:12:28.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:28.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj356 td/osd-backfill-space/datafile 2020-09-08T16:12:28.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:28.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj356 td/osd-backfill-space/datafile 2020-09-08T16:12:28.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:28.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj356 td/osd-backfill-space/datafile 2020-09-08T16:12:28.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:28.710 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:28.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:28.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj357 td/osd-backfill-space/datafile 2020-09-08T16:12:28.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:28.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj357 td/osd-backfill-space/datafile 2020-09-08T16:12:28.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:28.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj357 td/osd-backfill-space/datafile 2020-09-08T16:12:28.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:28.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj357 td/osd-backfill-space/datafile 2020-09-08T16:12:29.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:29.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj357 td/osd-backfill-space/datafile 2020-09-08T16:12:29.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:29.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj357 td/osd-backfill-space/datafile 2020-09-08T16:12:29.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:29.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj357 td/osd-backfill-space/datafile 2020-09-08T16:12:29.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:29.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj357 td/osd-backfill-space/datafile 2020-09-08T16:12:29.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:29.313 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:29.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:29.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj358 td/osd-backfill-space/datafile 2020-09-08T16:12:29.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:29.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj358 td/osd-backfill-space/datafile 2020-09-08T16:12:29.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:29.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj358 td/osd-backfill-space/datafile 2020-09-08T16:12:29.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:29.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj358 td/osd-backfill-space/datafile 2020-09-08T16:12:29.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:29.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj358 td/osd-backfill-space/datafile 2020-09-08T16:12:29.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:29.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj358 td/osd-backfill-space/datafile 2020-09-08T16:12:29.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:29.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj358 td/osd-backfill-space/datafile 2020-09-08T16:12:29.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:29.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj358 td/osd-backfill-space/datafile 2020-09-08T16:12:29.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:29.933 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:29.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:29.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj359 td/osd-backfill-space/datafile 2020-09-08T16:12:30.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:30.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj359 td/osd-backfill-space/datafile 2020-09-08T16:12:30.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:30.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj359 td/osd-backfill-space/datafile 2020-09-08T16:12:30.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:30.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj359 td/osd-backfill-space/datafile 2020-09-08T16:12:30.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:30.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj359 td/osd-backfill-space/datafile 2020-09-08T16:12:30.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:30.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj359 td/osd-backfill-space/datafile 2020-09-08T16:12:30.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:30.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj359 td/osd-backfill-space/datafile 2020-09-08T16:12:30.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:30.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj359 td/osd-backfill-space/datafile 2020-09-08T16:12:30.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:30.621 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:30.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:30.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj360 td/osd-backfill-space/datafile 2020-09-08T16:12:30.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:30.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj360 td/osd-backfill-space/datafile 2020-09-08T16:12:30.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:30.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj360 td/osd-backfill-space/datafile 2020-09-08T16:12:30.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:30.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj360 td/osd-backfill-space/datafile 2020-09-08T16:12:30.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:30.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj360 td/osd-backfill-space/datafile 2020-09-08T16:12:31.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:31.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj360 td/osd-backfill-space/datafile 2020-09-08T16:12:31.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:31.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj360 td/osd-backfill-space/datafile 2020-09-08T16:12:31.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:31.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj360 td/osd-backfill-space/datafile 2020-09-08T16:12:31.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:31.282 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:31.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:31.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj361 td/osd-backfill-space/datafile 2020-09-08T16:12:31.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:31.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj361 td/osd-backfill-space/datafile 2020-09-08T16:12:31.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:31.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj361 td/osd-backfill-space/datafile 2020-09-08T16:12:31.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:31.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj361 td/osd-backfill-space/datafile 2020-09-08T16:12:31.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:31.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj361 td/osd-backfill-space/datafile 2020-09-08T16:12:31.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:31.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj361 td/osd-backfill-space/datafile 2020-09-08T16:12:31.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:31.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj361 td/osd-backfill-space/datafile 2020-09-08T16:12:31.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:31.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj361 td/osd-backfill-space/datafile 2020-09-08T16:12:31.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:31.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:31.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:31.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj362 td/osd-backfill-space/datafile 2020-09-08T16:12:31.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:31.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj362 td/osd-backfill-space/datafile 2020-09-08T16:12:32.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:32.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj362 td/osd-backfill-space/datafile 2020-09-08T16:12:32.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:32.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj362 td/osd-backfill-space/datafile 2020-09-08T16:12:32.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:32.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj362 td/osd-backfill-space/datafile 2020-09-08T16:12:32.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:32.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj362 td/osd-backfill-space/datafile 2020-09-08T16:12:32.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:32.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj362 td/osd-backfill-space/datafile 2020-09-08T16:12:32.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:32.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj362 td/osd-backfill-space/datafile 2020-09-08T16:12:32.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:32.590 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:32.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:32.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj363 td/osd-backfill-space/datafile 2020-09-08T16:12:32.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:32.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj363 td/osd-backfill-space/datafile 2020-09-08T16:12:32.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:32.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj363 td/osd-backfill-space/datafile 2020-09-08T16:12:32.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:32.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj363 td/osd-backfill-space/datafile 2020-09-08T16:12:32.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:32.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj363 td/osd-backfill-space/datafile 2020-09-08T16:12:32.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:32.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj363 td/osd-backfill-space/datafile 2020-09-08T16:12:33.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:33.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj363 td/osd-backfill-space/datafile 2020-09-08T16:12:33.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:33.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj363 td/osd-backfill-space/datafile 2020-09-08T16:12:33.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:33.293 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:33.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:33.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj364 td/osd-backfill-space/datafile 2020-09-08T16:12:33.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:33.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj364 td/osd-backfill-space/datafile 2020-09-08T16:12:33.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:33.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj364 td/osd-backfill-space/datafile 2020-09-08T16:12:33.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:33.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj364 td/osd-backfill-space/datafile 2020-09-08T16:12:33.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:33.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj364 td/osd-backfill-space/datafile 2020-09-08T16:12:33.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:33.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj364 td/osd-backfill-space/datafile 2020-09-08T16:12:33.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:33.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj364 td/osd-backfill-space/datafile 2020-09-08T16:12:33.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:33.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj364 td/osd-backfill-space/datafile 2020-09-08T16:12:33.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:33.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:33.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:33.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj365 td/osd-backfill-space/datafile 2020-09-08T16:12:33.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:33.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj365 td/osd-backfill-space/datafile 2020-09-08T16:12:33.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:33.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj365 td/osd-backfill-space/datafile 2020-09-08T16:12:34.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:34.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj365 td/osd-backfill-space/datafile 2020-09-08T16:12:34.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:34.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj365 td/osd-backfill-space/datafile 2020-09-08T16:12:34.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:34.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj365 td/osd-backfill-space/datafile 2020-09-08T16:12:34.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:34.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj365 td/osd-backfill-space/datafile 2020-09-08T16:12:34.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:34.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj365 td/osd-backfill-space/datafile 2020-09-08T16:12:34.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:34.575 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:34.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:34.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj366 td/osd-backfill-space/datafile 2020-09-08T16:12:34.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:34.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj366 td/osd-backfill-space/datafile 2020-09-08T16:12:34.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:34.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj366 td/osd-backfill-space/datafile 2020-09-08T16:12:34.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:34.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj366 td/osd-backfill-space/datafile 2020-09-08T16:12:34.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:34.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj366 td/osd-backfill-space/datafile 2020-09-08T16:12:34.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:34.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj366 td/osd-backfill-space/datafile 2020-09-08T16:12:35.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:35.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj366 td/osd-backfill-space/datafile 2020-09-08T16:12:35.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:35.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj366 td/osd-backfill-space/datafile 2020-09-08T16:12:35.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:35.187 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:35.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:35.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj367 td/osd-backfill-space/datafile 2020-09-08T16:12:35.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:35.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj367 td/osd-backfill-space/datafile 2020-09-08T16:12:35.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:35.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj367 td/osd-backfill-space/datafile 2020-09-08T16:12:35.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:35.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj367 td/osd-backfill-space/datafile 2020-09-08T16:12:35.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:35.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj367 td/osd-backfill-space/datafile 2020-09-08T16:12:35.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:35.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj367 td/osd-backfill-space/datafile 2020-09-08T16:12:35.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:35.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj367 td/osd-backfill-space/datafile 2020-09-08T16:12:35.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:35.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj367 td/osd-backfill-space/datafile 2020-09-08T16:12:35.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:35.812 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:35.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:35.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj368 td/osd-backfill-space/datafile 2020-09-08T16:12:35.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:35.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj368 td/osd-backfill-space/datafile 2020-09-08T16:12:35.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:35.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj368 td/osd-backfill-space/datafile 2020-09-08T16:12:36.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:36.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj368 td/osd-backfill-space/datafile 2020-09-08T16:12:36.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:36.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj368 td/osd-backfill-space/datafile 2020-09-08T16:12:36.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:36.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj368 td/osd-backfill-space/datafile 2020-09-08T16:12:36.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:36.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj368 td/osd-backfill-space/datafile 2020-09-08T16:12:36.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:36.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj368 td/osd-backfill-space/datafile 2020-09-08T16:12:36.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:36.505 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:36.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:36.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj369 td/osd-backfill-space/datafile 2020-09-08T16:12:36.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:36.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj369 td/osd-backfill-space/datafile 2020-09-08T16:12:36.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:36.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj369 td/osd-backfill-space/datafile 2020-09-08T16:12:36.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:36.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj369 td/osd-backfill-space/datafile 2020-09-08T16:12:36.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:36.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj369 td/osd-backfill-space/datafile 2020-09-08T16:12:36.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:36.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj369 td/osd-backfill-space/datafile 2020-09-08T16:12:36.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:36.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj369 td/osd-backfill-space/datafile 2020-09-08T16:12:37.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:37.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj369 td/osd-backfill-space/datafile 2020-09-08T16:12:37.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:37.147 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:37.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:37.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj370 td/osd-backfill-space/datafile 2020-09-08T16:12:37.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:37.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj370 td/osd-backfill-space/datafile 2020-09-08T16:12:37.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:37.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj370 td/osd-backfill-space/datafile 2020-09-08T16:12:37.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:37.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj370 td/osd-backfill-space/datafile 2020-09-08T16:12:37.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:37.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj370 td/osd-backfill-space/datafile 2020-09-08T16:12:37.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:37.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj370 td/osd-backfill-space/datafile 2020-09-08T16:12:37.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:37.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj370 td/osd-backfill-space/datafile 2020-09-08T16:12:37.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:37.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj370 td/osd-backfill-space/datafile 2020-09-08T16:12:37.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:37.802 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:37.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:37.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj371 td/osd-backfill-space/datafile 2020-09-08T16:12:37.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:37.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj371 td/osd-backfill-space/datafile 2020-09-08T16:12:37.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:37.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj371 td/osd-backfill-space/datafile 2020-09-08T16:12:38.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:38.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj371 td/osd-backfill-space/datafile 2020-09-08T16:12:38.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:38.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj371 td/osd-backfill-space/datafile 2020-09-08T16:12:38.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:38.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj371 td/osd-backfill-space/datafile 2020-09-08T16:12:38.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:38.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj371 td/osd-backfill-space/datafile 2020-09-08T16:12:38.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:38.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj371 td/osd-backfill-space/datafile 2020-09-08T16:12:38.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:38.512 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:38.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:38.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj372 td/osd-backfill-space/datafile 2020-09-08T16:12:38.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:38.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj372 td/osd-backfill-space/datafile 2020-09-08T16:12:38.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:38.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj372 td/osd-backfill-space/datafile 2020-09-08T16:12:38.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:38.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj372 td/osd-backfill-space/datafile 2020-09-08T16:12:38.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:38.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj372 td/osd-backfill-space/datafile 2020-09-08T16:12:38.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:38.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj372 td/osd-backfill-space/datafile 2020-09-08T16:12:38.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:38.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj372 td/osd-backfill-space/datafile 2020-09-08T16:12:39.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:39.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj372 td/osd-backfill-space/datafile 2020-09-08T16:12:39.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:39.115 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:39.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:39.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj373 td/osd-backfill-space/datafile 2020-09-08T16:12:39.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:39.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj373 td/osd-backfill-space/datafile 2020-09-08T16:12:39.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:39.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj373 td/osd-backfill-space/datafile 2020-09-08T16:12:39.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:39.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj373 td/osd-backfill-space/datafile 2020-09-08T16:12:39.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:39.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj373 td/osd-backfill-space/datafile 2020-09-08T16:12:39.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:39.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj373 td/osd-backfill-space/datafile 2020-09-08T16:12:39.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:39.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj373 td/osd-backfill-space/datafile 2020-09-08T16:12:39.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:39.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj373 td/osd-backfill-space/datafile 2020-09-08T16:12:39.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:39.735 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:39.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:39.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj374 td/osd-backfill-space/datafile 2020-09-08T16:12:39.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:39.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj374 td/osd-backfill-space/datafile 2020-09-08T16:12:39.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:39.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj374 td/osd-backfill-space/datafile 2020-09-08T16:12:39.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:39.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj374 td/osd-backfill-space/datafile 2020-09-08T16:12:40.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:40.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj374 td/osd-backfill-space/datafile 2020-09-08T16:12:40.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:40.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj374 td/osd-backfill-space/datafile 2020-09-08T16:12:40.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:40.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj374 td/osd-backfill-space/datafile 2020-09-08T16:12:40.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:40.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj374 td/osd-backfill-space/datafile 2020-09-08T16:12:40.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:40.406 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:40.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:40.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj375 td/osd-backfill-space/datafile 2020-09-08T16:12:40.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:40.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj375 td/osd-backfill-space/datafile 2020-09-08T16:12:40.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:40.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj375 td/osd-backfill-space/datafile 2020-09-08T16:12:40.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:40.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj375 td/osd-backfill-space/datafile 2020-09-08T16:12:40.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:40.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj375 td/osd-backfill-space/datafile 2020-09-08T16:12:40.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:40.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj375 td/osd-backfill-space/datafile 2020-09-08T16:12:40.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:40.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj375 td/osd-backfill-space/datafile 2020-09-08T16:12:41.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:41.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj375 td/osd-backfill-space/datafile 2020-09-08T16:12:41.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:41.076 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:41.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:41.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj376 td/osd-backfill-space/datafile 2020-09-08T16:12:41.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:41.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj376 td/osd-backfill-space/datafile 2020-09-08T16:12:41.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:41.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj376 td/osd-backfill-space/datafile 2020-09-08T16:12:41.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:41.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj376 td/osd-backfill-space/datafile 2020-09-08T16:12:41.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:41.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj376 td/osd-backfill-space/datafile 2020-09-08T16:12:41.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:41.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj376 td/osd-backfill-space/datafile 2020-09-08T16:12:41.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:41.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj376 td/osd-backfill-space/datafile 2020-09-08T16:12:41.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:41.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj376 td/osd-backfill-space/datafile 2020-09-08T16:12:41.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:41.714 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:41.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:41.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj377 td/osd-backfill-space/datafile 2020-09-08T16:12:41.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:41.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj377 td/osd-backfill-space/datafile 2020-09-08T16:12:41.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:41.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj377 td/osd-backfill-space/datafile 2020-09-08T16:12:41.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:41.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj377 td/osd-backfill-space/datafile 2020-09-08T16:12:42.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:42.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj377 td/osd-backfill-space/datafile 2020-09-08T16:12:42.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:42.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj377 td/osd-backfill-space/datafile 2020-09-08T16:12:42.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:42.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj377 td/osd-backfill-space/datafile 2020-09-08T16:12:42.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:42.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj377 td/osd-backfill-space/datafile 2020-09-08T16:12:42.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:42.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:42.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:42.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj378 td/osd-backfill-space/datafile 2020-09-08T16:12:42.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:42.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj378 td/osd-backfill-space/datafile 2020-09-08T16:12:42.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:42.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj378 td/osd-backfill-space/datafile 2020-09-08T16:12:42.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:42.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj378 td/osd-backfill-space/datafile 2020-09-08T16:12:42.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:42.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj378 td/osd-backfill-space/datafile 2020-09-08T16:12:42.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:42.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj378 td/osd-backfill-space/datafile 2020-09-08T16:12:42.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:42.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj378 td/osd-backfill-space/datafile 2020-09-08T16:12:42.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:42.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj378 td/osd-backfill-space/datafile 2020-09-08T16:12:43.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:43.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:43.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:43.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj379 td/osd-backfill-space/datafile 2020-09-08T16:12:43.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:43.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj379 td/osd-backfill-space/datafile 2020-09-08T16:12:43.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:43.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj379 td/osd-backfill-space/datafile 2020-09-08T16:12:43.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:43.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj379 td/osd-backfill-space/datafile 2020-09-08T16:12:43.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:43.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj379 td/osd-backfill-space/datafile 2020-09-08T16:12:43.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:43.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj379 td/osd-backfill-space/datafile 2020-09-08T16:12:43.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:43.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj379 td/osd-backfill-space/datafile 2020-09-08T16:12:43.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:43.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj379 td/osd-backfill-space/datafile 2020-09-08T16:12:43.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:43.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:43.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:43.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj380 td/osd-backfill-space/datafile 2020-09-08T16:12:43.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:43.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj380 td/osd-backfill-space/datafile 2020-09-08T16:12:43.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:43.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj380 td/osd-backfill-space/datafile 2020-09-08T16:12:43.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:43.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj380 td/osd-backfill-space/datafile 2020-09-08T16:12:44.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:44.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj380 td/osd-backfill-space/datafile 2020-09-08T16:12:44.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:44.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj380 td/osd-backfill-space/datafile 2020-09-08T16:12:44.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:44.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj380 td/osd-backfill-space/datafile 2020-09-08T16:12:44.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:44.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj380 td/osd-backfill-space/datafile 2020-09-08T16:12:44.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:44.387 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:44.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:44.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj381 td/osd-backfill-space/datafile 2020-09-08T16:12:44.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:44.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj381 td/osd-backfill-space/datafile 2020-09-08T16:12:44.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:44.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj381 td/osd-backfill-space/datafile 2020-09-08T16:12:44.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:44.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj381 td/osd-backfill-space/datafile 2020-09-08T16:12:44.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:44.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj381 td/osd-backfill-space/datafile 2020-09-08T16:12:44.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:44.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj381 td/osd-backfill-space/datafile 2020-09-08T16:12:44.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:44.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj381 td/osd-backfill-space/datafile 2020-09-08T16:12:44.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:44.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj381 td/osd-backfill-space/datafile 2020-09-08T16:12:45.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:45.015 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:45.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:45.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj382 td/osd-backfill-space/datafile 2020-09-08T16:12:45.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:45.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj382 td/osd-backfill-space/datafile 2020-09-08T16:12:45.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:45.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj382 td/osd-backfill-space/datafile 2020-09-08T16:12:45.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:45.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj382 td/osd-backfill-space/datafile 2020-09-08T16:12:45.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:45.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj382 td/osd-backfill-space/datafile 2020-09-08T16:12:45.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:45.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj382 td/osd-backfill-space/datafile 2020-09-08T16:12:45.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:45.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj382 td/osd-backfill-space/datafile 2020-09-08T16:12:45.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:45.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj382 td/osd-backfill-space/datafile 2020-09-08T16:12:45.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:45.652 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:45.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:45.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj383 td/osd-backfill-space/datafile 2020-09-08T16:12:45.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:45.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj383 td/osd-backfill-space/datafile 2020-09-08T16:12:45.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:45.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj383 td/osd-backfill-space/datafile 2020-09-08T16:12:45.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:45.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj383 td/osd-backfill-space/datafile 2020-09-08T16:12:45.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:45.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj383 td/osd-backfill-space/datafile 2020-09-08T16:12:46.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:46.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj383 td/osd-backfill-space/datafile 2020-09-08T16:12:46.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:46.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj383 td/osd-backfill-space/datafile 2020-09-08T16:12:46.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:46.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj383 td/osd-backfill-space/datafile 2020-09-08T16:12:46.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:46.277 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:46.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:46.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj384 td/osd-backfill-space/datafile 2020-09-08T16:12:46.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:46.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj384 td/osd-backfill-space/datafile 2020-09-08T16:12:46.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:46.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj384 td/osd-backfill-space/datafile 2020-09-08T16:12:46.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:46.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj384 td/osd-backfill-space/datafile 2020-09-08T16:12:46.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:46.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj384 td/osd-backfill-space/datafile 2020-09-08T16:12:46.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:46.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj384 td/osd-backfill-space/datafile 2020-09-08T16:12:46.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:46.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj384 td/osd-backfill-space/datafile 2020-09-08T16:12:46.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:46.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj384 td/osd-backfill-space/datafile 2020-09-08T16:12:46.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:46.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:46.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:46.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj385 td/osd-backfill-space/datafile 2020-09-08T16:12:47.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:47.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj385 td/osd-backfill-space/datafile 2020-09-08T16:12:47.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:47.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj385 td/osd-backfill-space/datafile 2020-09-08T16:12:47.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:47.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj385 td/osd-backfill-space/datafile 2020-09-08T16:12:47.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:47.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj385 td/osd-backfill-space/datafile 2020-09-08T16:12:47.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:47.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj385 td/osd-backfill-space/datafile 2020-09-08T16:12:47.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:47.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj385 td/osd-backfill-space/datafile 2020-09-08T16:12:47.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:47.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj385 td/osd-backfill-space/datafile 2020-09-08T16:12:47.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:47.587 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:47.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:47.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj386 td/osd-backfill-space/datafile 2020-09-08T16:12:47.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:47.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj386 td/osd-backfill-space/datafile 2020-09-08T16:12:47.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:47.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj386 td/osd-backfill-space/datafile 2020-09-08T16:12:47.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:47.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj386 td/osd-backfill-space/datafile 2020-09-08T16:12:47.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:47.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj386 td/osd-backfill-space/datafile 2020-09-08T16:12:47.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:47.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj386 td/osd-backfill-space/datafile 2020-09-08T16:12:48.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:48.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj386 td/osd-backfill-space/datafile 2020-09-08T16:12:48.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:48.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj386 td/osd-backfill-space/datafile 2020-09-08T16:12:48.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:48.600 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:48.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:48.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj387 td/osd-backfill-space/datafile 2020-09-08T16:12:48.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:48.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj387 td/osd-backfill-space/datafile 2020-09-08T16:12:48.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:48.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj387 td/osd-backfill-space/datafile 2020-09-08T16:12:48.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:48.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj387 td/osd-backfill-space/datafile 2020-09-08T16:12:48.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:48.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj387 td/osd-backfill-space/datafile 2020-09-08T16:12:49.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:49.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj387 td/osd-backfill-space/datafile 2020-09-08T16:12:49.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:49.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj387 td/osd-backfill-space/datafile 2020-09-08T16:12:49.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:49.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj387 td/osd-backfill-space/datafile 2020-09-08T16:12:49.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:49.238 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:49.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:49.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj388 td/osd-backfill-space/datafile 2020-09-08T16:12:49.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:49.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj388 td/osd-backfill-space/datafile 2020-09-08T16:12:49.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:49.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj388 td/osd-backfill-space/datafile 2020-09-08T16:12:49.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:49.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj388 td/osd-backfill-space/datafile 2020-09-08T16:12:49.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:49.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj388 td/osd-backfill-space/datafile 2020-09-08T16:12:49.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:49.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj388 td/osd-backfill-space/datafile 2020-09-08T16:12:49.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:49.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj388 td/osd-backfill-space/datafile 2020-09-08T16:12:49.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:49.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj388 td/osd-backfill-space/datafile 2020-09-08T16:12:49.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:49.890 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:49.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:49.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj389 td/osd-backfill-space/datafile 2020-09-08T16:12:49.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:49.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj389 td/osd-backfill-space/datafile 2020-09-08T16:12:50.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:50.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj389 td/osd-backfill-space/datafile 2020-09-08T16:12:50.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:50.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj389 td/osd-backfill-space/datafile 2020-09-08T16:12:50.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:50.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj389 td/osd-backfill-space/datafile 2020-09-08T16:12:50.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:50.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj389 td/osd-backfill-space/datafile 2020-09-08T16:12:50.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:50.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj389 td/osd-backfill-space/datafile 2020-09-08T16:12:50.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:50.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj389 td/osd-backfill-space/datafile 2020-09-08T16:12:50.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:50.553 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:50.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:50.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj390 td/osd-backfill-space/datafile 2020-09-08T16:12:50.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:50.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj390 td/osd-backfill-space/datafile 2020-09-08T16:12:50.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:50.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj390 td/osd-backfill-space/datafile 2020-09-08T16:12:50.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:50.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj390 td/osd-backfill-space/datafile 2020-09-08T16:12:50.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:50.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj390 td/osd-backfill-space/datafile 2020-09-08T16:12:50.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:50.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj390 td/osd-backfill-space/datafile 2020-09-08T16:12:51.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:51.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj390 td/osd-backfill-space/datafile 2020-09-08T16:12:51.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:51.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj390 td/osd-backfill-space/datafile 2020-09-08T16:12:51.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:51.172 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:51.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:51.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj391 td/osd-backfill-space/datafile 2020-09-08T16:12:51.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:51.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj391 td/osd-backfill-space/datafile 2020-09-08T16:12:51.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:51.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj391 td/osd-backfill-space/datafile 2020-09-08T16:12:51.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:51.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj391 td/osd-backfill-space/datafile 2020-09-08T16:12:51.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:51.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj391 td/osd-backfill-space/datafile 2020-09-08T16:12:51.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:51.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj391 td/osd-backfill-space/datafile 2020-09-08T16:12:51.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:51.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj391 td/osd-backfill-space/datafile 2020-09-08T16:12:51.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:51.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj391 td/osd-backfill-space/datafile 2020-09-08T16:12:51.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:51.825 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:51.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:51.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj392 td/osd-backfill-space/datafile 2020-09-08T16:12:51.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:51.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj392 td/osd-backfill-space/datafile 2020-09-08T16:12:51.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:51.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj392 td/osd-backfill-space/datafile 2020-09-08T16:12:52.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:52.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj392 td/osd-backfill-space/datafile 2020-09-08T16:12:52.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:52.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj392 td/osd-backfill-space/datafile 2020-09-08T16:12:52.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:52.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj392 td/osd-backfill-space/datafile 2020-09-08T16:12:52.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:52.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj392 td/osd-backfill-space/datafile 2020-09-08T16:12:52.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:52.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj392 td/osd-backfill-space/datafile 2020-09-08T16:12:52.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:52.521 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:52.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:52.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj393 td/osd-backfill-space/datafile 2020-09-08T16:12:52.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:52.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj393 td/osd-backfill-space/datafile 2020-09-08T16:12:52.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:52.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj393 td/osd-backfill-space/datafile 2020-09-08T16:12:52.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:52.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj393 td/osd-backfill-space/datafile 2020-09-08T16:12:52.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:52.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj393 td/osd-backfill-space/datafile 2020-09-08T16:12:52.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:52.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj393 td/osd-backfill-space/datafile 2020-09-08T16:12:52.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:52.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj393 td/osd-backfill-space/datafile 2020-09-08T16:12:53.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:53.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj393 td/osd-backfill-space/datafile 2020-09-08T16:12:53.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:53.124 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:53.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:53.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj394 td/osd-backfill-space/datafile 2020-09-08T16:12:53.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:53.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj394 td/osd-backfill-space/datafile 2020-09-08T16:12:53.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:53.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj394 td/osd-backfill-space/datafile 2020-09-08T16:12:53.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:53.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj394 td/osd-backfill-space/datafile 2020-09-08T16:12:53.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:53.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj394 td/osd-backfill-space/datafile 2020-09-08T16:12:53.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:53.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj394 td/osd-backfill-space/datafile 2020-09-08T16:12:53.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:53.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj394 td/osd-backfill-space/datafile 2020-09-08T16:12:53.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:53.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj394 td/osd-backfill-space/datafile 2020-09-08T16:12:53.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:53.852 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:53.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:53.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj395 td/osd-backfill-space/datafile 2020-09-08T16:12:53.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:53.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj395 td/osd-backfill-space/datafile 2020-09-08T16:12:54.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:54.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj395 td/osd-backfill-space/datafile 2020-09-08T16:12:54.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:54.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj395 td/osd-backfill-space/datafile 2020-09-08T16:12:54.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:54.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj395 td/osd-backfill-space/datafile 2020-09-08T16:12:54.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:54.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj395 td/osd-backfill-space/datafile 2020-09-08T16:12:54.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:54.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj395 td/osd-backfill-space/datafile 2020-09-08T16:12:54.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:54.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj395 td/osd-backfill-space/datafile 2020-09-08T16:12:54.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:54.584 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:54.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:54.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj396 td/osd-backfill-space/datafile 2020-09-08T16:12:54.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:54.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj396 td/osd-backfill-space/datafile 2020-09-08T16:12:54.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:54.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj396 td/osd-backfill-space/datafile 2020-09-08T16:12:54.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:54.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj396 td/osd-backfill-space/datafile 2020-09-08T16:12:54.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:54.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj396 td/osd-backfill-space/datafile 2020-09-08T16:12:54.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:54.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj396 td/osd-backfill-space/datafile 2020-09-08T16:12:55.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:55.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj396 td/osd-backfill-space/datafile 2020-09-08T16:12:55.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:55.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj396 td/osd-backfill-space/datafile 2020-09-08T16:12:55.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:55.218 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:55.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:55.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj397 td/osd-backfill-space/datafile 2020-09-08T16:12:55.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:55.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj397 td/osd-backfill-space/datafile 2020-09-08T16:12:55.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:55.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj397 td/osd-backfill-space/datafile 2020-09-08T16:12:55.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:55.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj397 td/osd-backfill-space/datafile 2020-09-08T16:12:55.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:55.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj397 td/osd-backfill-space/datafile 2020-09-08T16:12:55.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:55.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj397 td/osd-backfill-space/datafile 2020-09-08T16:12:55.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:55.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj397 td/osd-backfill-space/datafile 2020-09-08T16:12:55.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:55.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj397 td/osd-backfill-space/datafile 2020-09-08T16:12:55.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:55.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:55.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:55.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj398 td/osd-backfill-space/datafile 2020-09-08T16:12:55.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:55.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj398 td/osd-backfill-space/datafile 2020-09-08T16:12:55.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:55.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj398 td/osd-backfill-space/datafile 2020-09-08T16:12:56.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:56.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj398 td/osd-backfill-space/datafile 2020-09-08T16:12:56.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:56.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj398 td/osd-backfill-space/datafile 2020-09-08T16:12:56.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:56.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj398 td/osd-backfill-space/datafile 2020-09-08T16:12:56.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:56.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj398 td/osd-backfill-space/datafile 2020-09-08T16:12:56.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:56.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj398 td/osd-backfill-space/datafile 2020-09-08T16:12:56.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:56.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:56.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:56.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj399 td/osd-backfill-space/datafile 2020-09-08T16:12:56.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:56.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj399 td/osd-backfill-space/datafile 2020-09-08T16:12:56.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:56.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj399 td/osd-backfill-space/datafile 2020-09-08T16:12:56.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:56.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj399 td/osd-backfill-space/datafile 2020-09-08T16:12:56.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:56.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj399 td/osd-backfill-space/datafile 2020-09-08T16:12:56.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:56.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj399 td/osd-backfill-space/datafile 2020-09-08T16:12:57.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:57.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj399 td/osd-backfill-space/datafile 2020-09-08T16:12:57.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:57.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj399 td/osd-backfill-space/datafile 2020-09-08T16:12:57.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:57.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:57.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:57.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj400 td/osd-backfill-space/datafile 2020-09-08T16:12:57.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:57.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj400 td/osd-backfill-space/datafile 2020-09-08T16:12:57.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:57.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj400 td/osd-backfill-space/datafile 2020-09-08T16:12:57.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:57.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj400 td/osd-backfill-space/datafile 2020-09-08T16:12:57.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:57.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj400 td/osd-backfill-space/datafile 2020-09-08T16:12:57.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:57.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj400 td/osd-backfill-space/datafile 2020-09-08T16:12:57.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:57.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj400 td/osd-backfill-space/datafile 2020-09-08T16:12:57.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:57.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj400 td/osd-backfill-space/datafile 2020-09-08T16:12:57.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:57.790 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:57.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:57.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj401 td/osd-backfill-space/datafile 2020-09-08T16:12:57.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:57.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj401 td/osd-backfill-space/datafile 2020-09-08T16:12:57.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:57.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj401 td/osd-backfill-space/datafile 2020-09-08T16:12:58.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:58.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj401 td/osd-backfill-space/datafile 2020-09-08T16:12:58.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:58.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj401 td/osd-backfill-space/datafile 2020-09-08T16:12:58.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:58.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj401 td/osd-backfill-space/datafile 2020-09-08T16:12:58.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:58.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj401 td/osd-backfill-space/datafile 2020-09-08T16:12:58.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:58.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj401 td/osd-backfill-space/datafile 2020-09-08T16:12:58.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:58.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:58.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:58.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj402 td/osd-backfill-space/datafile 2020-09-08T16:12:58.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:58.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj402 td/osd-backfill-space/datafile 2020-09-08T16:12:58.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:58.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj402 td/osd-backfill-space/datafile 2020-09-08T16:12:58.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:58.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj402 td/osd-backfill-space/datafile 2020-09-08T16:12:58.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:58.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj402 td/osd-backfill-space/datafile 2020-09-08T16:12:58.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:58.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj402 td/osd-backfill-space/datafile 2020-09-08T16:12:59.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:59.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj402 td/osd-backfill-space/datafile 2020-09-08T16:12:59.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:59.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj402 td/osd-backfill-space/datafile 2020-09-08T16:12:59.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:59.197 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:59.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:59.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj403 td/osd-backfill-space/datafile 2020-09-08T16:12:59.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:59.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj403 td/osd-backfill-space/datafile 2020-09-08T16:12:59.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:59.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj403 td/osd-backfill-space/datafile 2020-09-08T16:12:59.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:59.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj403 td/osd-backfill-space/datafile 2020-09-08T16:12:59.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:59.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj403 td/osd-backfill-space/datafile 2020-09-08T16:12:59.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:59.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj403 td/osd-backfill-space/datafile 2020-09-08T16:12:59.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:59.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj403 td/osd-backfill-space/datafile 2020-09-08T16:12:59.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:59.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj403 td/osd-backfill-space/datafile 2020-09-08T16:12:59.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:12:59.792 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:12:59.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:59.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj404 td/osd-backfill-space/datafile 2020-09-08T16:12:59.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:59.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj404 td/osd-backfill-space/datafile 2020-09-08T16:12:59.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:12:59.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj404 td/osd-backfill-space/datafile 2020-09-08T16:13:00.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:00.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj404 td/osd-backfill-space/datafile 2020-09-08T16:13:00.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:00.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj404 td/osd-backfill-space/datafile 2020-09-08T16:13:00.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:00.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj404 td/osd-backfill-space/datafile 2020-09-08T16:13:00.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:00.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj404 td/osd-backfill-space/datafile 2020-09-08T16:13:00.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:00.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj404 td/osd-backfill-space/datafile 2020-09-08T16:13:00.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:00.454 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:00.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:00.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj405 td/osd-backfill-space/datafile 2020-09-08T16:13:00.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:00.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj405 td/osd-backfill-space/datafile 2020-09-08T16:13:00.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:00.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj405 td/osd-backfill-space/datafile 2020-09-08T16:13:00.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:00.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj405 td/osd-backfill-space/datafile 2020-09-08T16:13:00.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:00.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj405 td/osd-backfill-space/datafile 2020-09-08T16:13:00.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:00.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj405 td/osd-backfill-space/datafile 2020-09-08T16:13:00.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:00.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj405 td/osd-backfill-space/datafile 2020-09-08T16:13:01.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:01.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj405 td/osd-backfill-space/datafile 2020-09-08T16:13:01.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:01.131 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:01.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:01.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj406 td/osd-backfill-space/datafile 2020-09-08T16:13:01.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:01.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj406 td/osd-backfill-space/datafile 2020-09-08T16:13:01.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:01.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj406 td/osd-backfill-space/datafile 2020-09-08T16:13:01.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:01.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj406 td/osd-backfill-space/datafile 2020-09-08T16:13:01.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:01.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj406 td/osd-backfill-space/datafile 2020-09-08T16:13:01.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:01.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj406 td/osd-backfill-space/datafile 2020-09-08T16:13:01.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:01.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj406 td/osd-backfill-space/datafile 2020-09-08T16:13:01.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:01.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj406 td/osd-backfill-space/datafile 2020-09-08T16:13:01.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:01.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:01.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:01.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj407 td/osd-backfill-space/datafile 2020-09-08T16:13:01.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:01.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj407 td/osd-backfill-space/datafile 2020-09-08T16:13:01.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:01.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj407 td/osd-backfill-space/datafile 2020-09-08T16:13:02.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:02.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj407 td/osd-backfill-space/datafile 2020-09-08T16:13:02.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:02.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj407 td/osd-backfill-space/datafile 2020-09-08T16:13:02.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:02.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj407 td/osd-backfill-space/datafile 2020-09-08T16:13:02.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:02.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj407 td/osd-backfill-space/datafile 2020-09-08T16:13:02.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:02.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj407 td/osd-backfill-space/datafile 2020-09-08T16:13:02.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:02.406 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:02.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:02.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj408 td/osd-backfill-space/datafile 2020-09-08T16:13:02.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:02.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj408 td/osd-backfill-space/datafile 2020-09-08T16:13:02.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:02.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj408 td/osd-backfill-space/datafile 2020-09-08T16:13:02.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:02.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj408 td/osd-backfill-space/datafile 2020-09-08T16:13:02.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:02.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj408 td/osd-backfill-space/datafile 2020-09-08T16:13:02.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:02.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj408 td/osd-backfill-space/datafile 2020-09-08T16:13:02.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:02.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj408 td/osd-backfill-space/datafile 2020-09-08T16:13:02.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:02.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj408 td/osd-backfill-space/datafile 2020-09-08T16:13:03.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:03.068 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:03.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:03.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj409 td/osd-backfill-space/datafile 2020-09-08T16:13:03.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:03.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj409 td/osd-backfill-space/datafile 2020-09-08T16:13:03.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:03.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj409 td/osd-backfill-space/datafile 2020-09-08T16:13:03.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:03.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj409 td/osd-backfill-space/datafile 2020-09-08T16:13:03.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:03.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj409 td/osd-backfill-space/datafile 2020-09-08T16:13:03.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:03.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj409 td/osd-backfill-space/datafile 2020-09-08T16:13:03.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:03.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj409 td/osd-backfill-space/datafile 2020-09-08T16:13:03.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:03.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj409 td/osd-backfill-space/datafile 2020-09-08T16:13:03.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:03.705 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:03.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:03.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj410 td/osd-backfill-space/datafile 2020-09-08T16:13:03.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:03.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj410 td/osd-backfill-space/datafile 2020-09-08T16:13:03.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:03.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj410 td/osd-backfill-space/datafile 2020-09-08T16:13:03.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:03.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj410 td/osd-backfill-space/datafile 2020-09-08T16:13:04.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:04.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj410 td/osd-backfill-space/datafile 2020-09-08T16:13:04.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:04.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj410 td/osd-backfill-space/datafile 2020-09-08T16:13:04.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:04.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj410 td/osd-backfill-space/datafile 2020-09-08T16:13:04.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:04.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj410 td/osd-backfill-space/datafile 2020-09-08T16:13:04.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:04.383 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:04.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:04.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj411 td/osd-backfill-space/datafile 2020-09-08T16:13:04.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:04.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj411 td/osd-backfill-space/datafile 2020-09-08T16:13:04.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:04.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj411 td/osd-backfill-space/datafile 2020-09-08T16:13:04.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:04.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj411 td/osd-backfill-space/datafile 2020-09-08T16:13:04.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:04.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj411 td/osd-backfill-space/datafile 2020-09-08T16:13:04.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:04.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj411 td/osd-backfill-space/datafile 2020-09-08T16:13:04.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:04.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj411 td/osd-backfill-space/datafile 2020-09-08T16:13:04.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:04.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj411 td/osd-backfill-space/datafile 2020-09-08T16:13:05.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:05.037 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:05.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:05.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj412 td/osd-backfill-space/datafile 2020-09-08T16:13:05.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:05.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj412 td/osd-backfill-space/datafile 2020-09-08T16:13:05.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:05.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj412 td/osd-backfill-space/datafile 2020-09-08T16:13:05.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:05.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj412 td/osd-backfill-space/datafile 2020-09-08T16:13:05.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:05.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj412 td/osd-backfill-space/datafile 2020-09-08T16:13:05.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:05.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj412 td/osd-backfill-space/datafile 2020-09-08T16:13:05.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:05.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj412 td/osd-backfill-space/datafile 2020-09-08T16:13:05.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:05.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj412 td/osd-backfill-space/datafile 2020-09-08T16:13:05.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:05.674 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:05.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:05.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj413 td/osd-backfill-space/datafile 2020-09-08T16:13:05.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:05.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj413 td/osd-backfill-space/datafile 2020-09-08T16:13:05.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:05.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj413 td/osd-backfill-space/datafile 2020-09-08T16:13:05.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:05.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj413 td/osd-backfill-space/datafile 2020-09-08T16:13:05.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:05.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj413 td/osd-backfill-space/datafile 2020-09-08T16:13:06.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:06.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj413 td/osd-backfill-space/datafile 2020-09-08T16:13:06.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:06.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj413 td/osd-backfill-space/datafile 2020-09-08T16:13:06.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:06.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj413 td/osd-backfill-space/datafile 2020-09-08T16:13:06.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:06.328 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:06.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:06.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj414 td/osd-backfill-space/datafile 2020-09-08T16:13:06.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:06.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj414 td/osd-backfill-space/datafile 2020-09-08T16:13:06.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:06.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj414 td/osd-backfill-space/datafile 2020-09-08T16:13:06.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:06.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj414 td/osd-backfill-space/datafile 2020-09-08T16:13:06.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:06.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj414 td/osd-backfill-space/datafile 2020-09-08T16:13:06.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:06.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj414 td/osd-backfill-space/datafile 2020-09-08T16:13:06.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:06.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj414 td/osd-backfill-space/datafile 2020-09-08T16:13:06.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:06.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj414 td/osd-backfill-space/datafile 2020-09-08T16:13:07.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:07.022 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:07.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:07.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj415 td/osd-backfill-space/datafile 2020-09-08T16:13:07.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:07.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj415 td/osd-backfill-space/datafile 2020-09-08T16:13:07.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:07.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj415 td/osd-backfill-space/datafile 2020-09-08T16:13:07.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:07.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj415 td/osd-backfill-space/datafile 2020-09-08T16:13:07.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:07.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj415 td/osd-backfill-space/datafile 2020-09-08T16:13:07.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:07.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj415 td/osd-backfill-space/datafile 2020-09-08T16:13:07.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:07.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj415 td/osd-backfill-space/datafile 2020-09-08T16:13:07.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:07.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj415 td/osd-backfill-space/datafile 2020-09-08T16:13:07.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:07.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:07.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:07.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj416 td/osd-backfill-space/datafile 2020-09-08T16:13:07.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:07.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj416 td/osd-backfill-space/datafile 2020-09-08T16:13:07.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:07.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj416 td/osd-backfill-space/datafile 2020-09-08T16:13:07.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:07.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj416 td/osd-backfill-space/datafile 2020-09-08T16:13:07.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:07.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj416 td/osd-backfill-space/datafile 2020-09-08T16:13:08.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:08.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj416 td/osd-backfill-space/datafile 2020-09-08T16:13:08.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:08.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj416 td/osd-backfill-space/datafile 2020-09-08T16:13:08.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:08.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj416 td/osd-backfill-space/datafile 2020-09-08T16:13:08.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:08.421 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:08.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:08.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj417 td/osd-backfill-space/datafile 2020-09-08T16:13:08.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:08.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj417 td/osd-backfill-space/datafile 2020-09-08T16:13:08.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:08.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj417 td/osd-backfill-space/datafile 2020-09-08T16:13:08.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:08.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj417 td/osd-backfill-space/datafile 2020-09-08T16:13:08.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:08.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj417 td/osd-backfill-space/datafile 2020-09-08T16:13:08.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:08.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj417 td/osd-backfill-space/datafile 2020-09-08T16:13:08.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:08.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj417 td/osd-backfill-space/datafile 2020-09-08T16:13:09.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:09.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj417 td/osd-backfill-space/datafile 2020-09-08T16:13:09.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:09.117 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:09.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:09.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj418 td/osd-backfill-space/datafile 2020-09-08T16:13:09.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:09.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj418 td/osd-backfill-space/datafile 2020-09-08T16:13:09.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:09.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj418 td/osd-backfill-space/datafile 2020-09-08T16:13:09.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:09.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj418 td/osd-backfill-space/datafile 2020-09-08T16:13:09.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:09.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj418 td/osd-backfill-space/datafile 2020-09-08T16:13:09.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:09.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj418 td/osd-backfill-space/datafile 2020-09-08T16:13:09.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:09.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj418 td/osd-backfill-space/datafile 2020-09-08T16:13:09.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:09.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj418 td/osd-backfill-space/datafile 2020-09-08T16:13:09.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:09.753 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:09.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:09.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj419 td/osd-backfill-space/datafile 2020-09-08T16:13:09.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:09.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj419 td/osd-backfill-space/datafile 2020-09-08T16:13:09.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:09.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj419 td/osd-backfill-space/datafile 2020-09-08T16:13:09.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:09.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj419 td/osd-backfill-space/datafile 2020-09-08T16:13:10.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:10.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj419 td/osd-backfill-space/datafile 2020-09-08T16:13:10.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:10.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj419 td/osd-backfill-space/datafile 2020-09-08T16:13:10.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:10.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj419 td/osd-backfill-space/datafile 2020-09-08T16:13:10.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:10.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj419 td/osd-backfill-space/datafile 2020-09-08T16:13:10.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:10.415 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:10.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:10.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj420 td/osd-backfill-space/datafile 2020-09-08T16:13:10.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:10.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj420 td/osd-backfill-space/datafile 2020-09-08T16:13:10.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:10.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj420 td/osd-backfill-space/datafile 2020-09-08T16:13:10.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:10.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj420 td/osd-backfill-space/datafile 2020-09-08T16:13:10.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:10.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj420 td/osd-backfill-space/datafile 2020-09-08T16:13:10.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:10.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj420 td/osd-backfill-space/datafile 2020-09-08T16:13:10.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:10.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj420 td/osd-backfill-space/datafile 2020-09-08T16:13:10.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:10.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj420 td/osd-backfill-space/datafile 2020-09-08T16:13:11.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:11.052 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:11.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:11.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj421 td/osd-backfill-space/datafile 2020-09-08T16:13:11.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:11.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj421 td/osd-backfill-space/datafile 2020-09-08T16:13:11.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:11.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj421 td/osd-backfill-space/datafile 2020-09-08T16:13:11.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:11.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj421 td/osd-backfill-space/datafile 2020-09-08T16:13:11.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:11.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj421 td/osd-backfill-space/datafile 2020-09-08T16:13:11.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:11.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj421 td/osd-backfill-space/datafile 2020-09-08T16:13:11.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:11.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj421 td/osd-backfill-space/datafile 2020-09-08T16:13:11.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:11.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj421 td/osd-backfill-space/datafile 2020-09-08T16:13:11.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:11.707 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:11.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:11.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj422 td/osd-backfill-space/datafile 2020-09-08T16:13:11.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:11.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj422 td/osd-backfill-space/datafile 2020-09-08T16:13:11.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:11.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj422 td/osd-backfill-space/datafile 2020-09-08T16:13:11.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:11.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj422 td/osd-backfill-space/datafile 2020-09-08T16:13:12.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:12.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj422 td/osd-backfill-space/datafile 2020-09-08T16:13:12.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:12.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj422 td/osd-backfill-space/datafile 2020-09-08T16:13:12.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:12.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj422 td/osd-backfill-space/datafile 2020-09-08T16:13:12.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:12.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj422 td/osd-backfill-space/datafile 2020-09-08T16:13:12.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:12.326 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:12.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:12.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj423 td/osd-backfill-space/datafile 2020-09-08T16:13:12.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:12.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj423 td/osd-backfill-space/datafile 2020-09-08T16:13:12.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:12.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj423 td/osd-backfill-space/datafile 2020-09-08T16:13:12.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:12.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj423 td/osd-backfill-space/datafile 2020-09-08T16:13:12.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:12.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj423 td/osd-backfill-space/datafile 2020-09-08T16:13:12.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:12.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj423 td/osd-backfill-space/datafile 2020-09-08T16:13:12.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:12.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj423 td/osd-backfill-space/datafile 2020-09-08T16:13:12.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:12.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj423 td/osd-backfill-space/datafile 2020-09-08T16:13:12.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:12.972 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:12.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:12.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj424 td/osd-backfill-space/datafile 2020-09-08T16:13:13.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:13.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj424 td/osd-backfill-space/datafile 2020-09-08T16:13:13.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:13.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj424 td/osd-backfill-space/datafile 2020-09-08T16:13:13.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:13.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj424 td/osd-backfill-space/datafile 2020-09-08T16:13:13.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:13.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj424 td/osd-backfill-space/datafile 2020-09-08T16:13:13.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:13.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj424 td/osd-backfill-space/datafile 2020-09-08T16:13:13.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:13.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj424 td/osd-backfill-space/datafile 2020-09-08T16:13:13.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:13.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj424 td/osd-backfill-space/datafile 2020-09-08T16:13:13.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:13.598 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:13.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:13.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj425 td/osd-backfill-space/datafile 2020-09-08T16:13:13.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:13.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj425 td/osd-backfill-space/datafile 2020-09-08T16:13:13.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:13.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj425 td/osd-backfill-space/datafile 2020-09-08T16:13:13.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:13.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj425 td/osd-backfill-space/datafile 2020-09-08T16:13:13.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:13.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj425 td/osd-backfill-space/datafile 2020-09-08T16:13:13.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:13.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj425 td/osd-backfill-space/datafile 2020-09-08T16:13:14.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:14.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj425 td/osd-backfill-space/datafile 2020-09-08T16:13:14.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:14.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj425 td/osd-backfill-space/datafile 2020-09-08T16:13:14.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:14.269 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:14.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:14.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj426 td/osd-backfill-space/datafile 2020-09-08T16:13:14.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:14.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj426 td/osd-backfill-space/datafile 2020-09-08T16:13:14.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:14.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj426 td/osd-backfill-space/datafile 2020-09-08T16:13:14.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:14.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj426 td/osd-backfill-space/datafile 2020-09-08T16:13:14.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:14.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj426 td/osd-backfill-space/datafile 2020-09-08T16:13:14.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:14.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj426 td/osd-backfill-space/datafile 2020-09-08T16:13:14.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:14.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj426 td/osd-backfill-space/datafile 2020-09-08T16:13:14.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:14.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj426 td/osd-backfill-space/datafile 2020-09-08T16:13:14.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:14.956 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:14.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:14.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj427 td/osd-backfill-space/datafile 2020-09-08T16:13:15.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:15.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj427 td/osd-backfill-space/datafile 2020-09-08T16:13:15.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:15.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj427 td/osd-backfill-space/datafile 2020-09-08T16:13:15.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:15.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj427 td/osd-backfill-space/datafile 2020-09-08T16:13:15.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:15.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj427 td/osd-backfill-space/datafile 2020-09-08T16:13:15.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:15.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj427 td/osd-backfill-space/datafile 2020-09-08T16:13:15.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:15.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj427 td/osd-backfill-space/datafile 2020-09-08T16:13:15.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:15.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj427 td/osd-backfill-space/datafile 2020-09-08T16:13:15.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:15.576 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:15.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:15.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj428 td/osd-backfill-space/datafile 2020-09-08T16:13:15.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:15.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj428 td/osd-backfill-space/datafile 2020-09-08T16:13:15.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:15.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj428 td/osd-backfill-space/datafile 2020-09-08T16:13:15.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:15.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj428 td/osd-backfill-space/datafile 2020-09-08T16:13:15.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:15.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj428 td/osd-backfill-space/datafile 2020-09-08T16:13:15.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:15.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj428 td/osd-backfill-space/datafile 2020-09-08T16:13:16.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:16.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj428 td/osd-backfill-space/datafile 2020-09-08T16:13:16.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:16.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj428 td/osd-backfill-space/datafile 2020-09-08T16:13:16.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:16.189 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:16.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:16.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj429 td/osd-backfill-space/datafile 2020-09-08T16:13:16.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:16.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj429 td/osd-backfill-space/datafile 2020-09-08T16:13:16.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:16.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj429 td/osd-backfill-space/datafile 2020-09-08T16:13:16.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:16.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj429 td/osd-backfill-space/datafile 2020-09-08T16:13:16.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:16.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj429 td/osd-backfill-space/datafile 2020-09-08T16:13:16.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:16.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj429 td/osd-backfill-space/datafile 2020-09-08T16:13:16.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:16.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj429 td/osd-backfill-space/datafile 2020-09-08T16:13:16.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:16.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj429 td/osd-backfill-space/datafile 2020-09-08T16:13:16.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:16.898 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:16.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:16.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj430 td/osd-backfill-space/datafile 2020-09-08T16:13:16.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:16.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj430 td/osd-backfill-space/datafile 2020-09-08T16:13:17.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:17.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj430 td/osd-backfill-space/datafile 2020-09-08T16:13:17.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:17.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj430 td/osd-backfill-space/datafile 2020-09-08T16:13:17.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:17.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj430 td/osd-backfill-space/datafile 2020-09-08T16:13:17.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:17.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj430 td/osd-backfill-space/datafile 2020-09-08T16:13:17.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:17.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj430 td/osd-backfill-space/datafile 2020-09-08T16:13:17.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:17.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj430 td/osd-backfill-space/datafile 2020-09-08T16:13:17.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:17.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:17.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:17.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj431 td/osd-backfill-space/datafile 2020-09-08T16:13:17.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:17.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj431 td/osd-backfill-space/datafile 2020-09-08T16:13:17.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:17.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj431 td/osd-backfill-space/datafile 2020-09-08T16:13:17.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:17.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj431 td/osd-backfill-space/datafile 2020-09-08T16:13:17.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:17.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj431 td/osd-backfill-space/datafile 2020-09-08T16:13:17.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:17.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj431 td/osd-backfill-space/datafile 2020-09-08T16:13:17.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:17.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj431 td/osd-backfill-space/datafile 2020-09-08T16:13:18.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:18.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj431 td/osd-backfill-space/datafile 2020-09-08T16:13:18.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:18.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:18.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:18.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj432 td/osd-backfill-space/datafile 2020-09-08T16:13:18.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:18.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj432 td/osd-backfill-space/datafile 2020-09-08T16:13:18.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:18.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj432 td/osd-backfill-space/datafile 2020-09-08T16:13:18.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:18.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj432 td/osd-backfill-space/datafile 2020-09-08T16:13:18.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:18.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj432 td/osd-backfill-space/datafile 2020-09-08T16:13:18.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:18.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj432 td/osd-backfill-space/datafile 2020-09-08T16:13:18.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:18.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj432 td/osd-backfill-space/datafile 2020-09-08T16:13:18.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:18.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj432 td/osd-backfill-space/datafile 2020-09-08T16:13:18.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:18.795 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:18.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:18.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj433 td/osd-backfill-space/datafile 2020-09-08T16:13:18.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:18.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj433 td/osd-backfill-space/datafile 2020-09-08T16:13:18.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:18.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj433 td/osd-backfill-space/datafile 2020-09-08T16:13:19.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:19.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj433 td/osd-backfill-space/datafile 2020-09-08T16:13:19.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:19.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj433 td/osd-backfill-space/datafile 2020-09-08T16:13:19.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:19.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj433 td/osd-backfill-space/datafile 2020-09-08T16:13:19.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:19.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj433 td/osd-backfill-space/datafile 2020-09-08T16:13:19.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:19.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj433 td/osd-backfill-space/datafile 2020-09-08T16:13:19.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:19.731 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:19.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:19.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj434 td/osd-backfill-space/datafile 2020-09-08T16:13:19.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:19.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj434 td/osd-backfill-space/datafile 2020-09-08T16:13:19.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:19.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj434 td/osd-backfill-space/datafile 2020-09-08T16:13:19.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:19.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj434 td/osd-backfill-space/datafile 2020-09-08T16:13:20.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:20.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj434 td/osd-backfill-space/datafile 2020-09-08T16:13:20.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:20.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj434 td/osd-backfill-space/datafile 2020-09-08T16:13:20.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:20.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj434 td/osd-backfill-space/datafile 2020-09-08T16:13:20.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:20.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj434 td/osd-backfill-space/datafile 2020-09-08T16:13:20.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:20.376 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:20.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:20.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj435 td/osd-backfill-space/datafile 2020-09-08T16:13:20.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:20.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj435 td/osd-backfill-space/datafile 2020-09-08T16:13:20.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:20.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj435 td/osd-backfill-space/datafile 2020-09-08T16:13:20.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:20.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj435 td/osd-backfill-space/datafile 2020-09-08T16:13:20.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:20.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj435 td/osd-backfill-space/datafile 2020-09-08T16:13:20.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:20.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj435 td/osd-backfill-space/datafile 2020-09-08T16:13:20.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:20.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj435 td/osd-backfill-space/datafile 2020-09-08T16:13:20.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:20.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj435 td/osd-backfill-space/datafile 2020-09-08T16:13:20.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:20.996 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:20.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:20.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj436 td/osd-backfill-space/datafile 2020-09-08T16:13:21.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:21.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj436 td/osd-backfill-space/datafile 2020-09-08T16:13:21.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:21.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj436 td/osd-backfill-space/datafile 2020-09-08T16:13:21.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:21.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj436 td/osd-backfill-space/datafile 2020-09-08T16:13:21.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:21.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj436 td/osd-backfill-space/datafile 2020-09-08T16:13:21.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:21.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj436 td/osd-backfill-space/datafile 2020-09-08T16:13:21.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:21.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj436 td/osd-backfill-space/datafile 2020-09-08T16:13:21.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:21.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj436 td/osd-backfill-space/datafile 2020-09-08T16:13:21.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:21.666 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:21.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:21.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj437 td/osd-backfill-space/datafile 2020-09-08T16:13:21.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:21.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj437 td/osd-backfill-space/datafile 2020-09-08T16:13:21.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:21.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj437 td/osd-backfill-space/datafile 2020-09-08T16:13:21.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:21.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj437 td/osd-backfill-space/datafile 2020-09-08T16:13:21.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:21.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj437 td/osd-backfill-space/datafile 2020-09-08T16:13:22.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:22.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj437 td/osd-backfill-space/datafile 2020-09-08T16:13:22.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:22.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj437 td/osd-backfill-space/datafile 2020-09-08T16:13:22.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:22.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj437 td/osd-backfill-space/datafile 2020-09-08T16:13:22.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:22.336 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:22.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:22.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj438 td/osd-backfill-space/datafile 2020-09-08T16:13:22.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:22.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj438 td/osd-backfill-space/datafile 2020-09-08T16:13:22.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:22.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj438 td/osd-backfill-space/datafile 2020-09-08T16:13:22.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:22.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj438 td/osd-backfill-space/datafile 2020-09-08T16:13:22.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:22.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj438 td/osd-backfill-space/datafile 2020-09-08T16:13:22.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:22.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj438 td/osd-backfill-space/datafile 2020-09-08T16:13:22.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:22.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj438 td/osd-backfill-space/datafile 2020-09-08T16:13:22.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:22.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj438 td/osd-backfill-space/datafile 2020-09-08T16:13:22.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:22.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:22.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:22.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj439 td/osd-backfill-space/datafile 2020-09-08T16:13:23.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:23.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj439 td/osd-backfill-space/datafile 2020-09-08T16:13:23.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:23.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj439 td/osd-backfill-space/datafile 2020-09-08T16:13:23.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:23.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj439 td/osd-backfill-space/datafile 2020-09-08T16:13:23.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:23.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj439 td/osd-backfill-space/datafile 2020-09-08T16:13:23.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:23.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj439 td/osd-backfill-space/datafile 2020-09-08T16:13:23.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:23.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj439 td/osd-backfill-space/datafile 2020-09-08T16:13:23.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:23.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj439 td/osd-backfill-space/datafile 2020-09-08T16:13:23.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:23.603 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:23.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:23.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj440 td/osd-backfill-space/datafile 2020-09-08T16:13:23.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:23.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj440 td/osd-backfill-space/datafile 2020-09-08T16:13:23.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:23.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj440 td/osd-backfill-space/datafile 2020-09-08T16:13:23.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:23.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj440 td/osd-backfill-space/datafile 2020-09-08T16:13:23.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:23.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj440 td/osd-backfill-space/datafile 2020-09-08T16:13:24.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:24.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj440 td/osd-backfill-space/datafile 2020-09-08T16:13:24.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:24.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj440 td/osd-backfill-space/datafile 2020-09-08T16:13:24.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:24.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj440 td/osd-backfill-space/datafile 2020-09-08T16:13:24.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:24.220 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:24.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:24.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj441 td/osd-backfill-space/datafile 2020-09-08T16:13:24.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:24.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj441 td/osd-backfill-space/datafile 2020-09-08T16:13:24.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:24.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj441 td/osd-backfill-space/datafile 2020-09-08T16:13:24.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:24.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj441 td/osd-backfill-space/datafile 2020-09-08T16:13:24.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:24.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj441 td/osd-backfill-space/datafile 2020-09-08T16:13:24.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:24.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj441 td/osd-backfill-space/datafile 2020-09-08T16:13:24.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:24.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj441 td/osd-backfill-space/datafile 2020-09-08T16:13:24.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:24.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj441 td/osd-backfill-space/datafile 2020-09-08T16:13:25.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:25.040 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:25.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:25.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj442 td/osd-backfill-space/datafile 2020-09-08T16:13:25.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:25.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj442 td/osd-backfill-space/datafile 2020-09-08T16:13:25.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:25.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj442 td/osd-backfill-space/datafile 2020-09-08T16:13:25.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:25.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj442 td/osd-backfill-space/datafile 2020-09-08T16:13:25.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:25.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj442 td/osd-backfill-space/datafile 2020-09-08T16:13:25.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:25.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj442 td/osd-backfill-space/datafile 2020-09-08T16:13:25.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:25.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj442 td/osd-backfill-space/datafile 2020-09-08T16:13:25.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:25.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj442 td/osd-backfill-space/datafile 2020-09-08T16:13:25.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:25.662 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:25.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:25.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj443 td/osd-backfill-space/datafile 2020-09-08T16:13:25.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:25.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj443 td/osd-backfill-space/datafile 2020-09-08T16:13:25.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:25.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj443 td/osd-backfill-space/datafile 2020-09-08T16:13:25.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:25.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj443 td/osd-backfill-space/datafile 2020-09-08T16:13:25.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:25.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj443 td/osd-backfill-space/datafile 2020-09-08T16:13:26.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:26.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj443 td/osd-backfill-space/datafile 2020-09-08T16:13:26.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:26.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj443 td/osd-backfill-space/datafile 2020-09-08T16:13:26.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:26.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj443 td/osd-backfill-space/datafile 2020-09-08T16:13:26.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:26.274 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:26.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:26.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj444 td/osd-backfill-space/datafile 2020-09-08T16:13:26.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:26.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj444 td/osd-backfill-space/datafile 2020-09-08T16:13:26.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:26.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj444 td/osd-backfill-space/datafile 2020-09-08T16:13:26.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:26.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj444 td/osd-backfill-space/datafile 2020-09-08T16:13:26.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:26.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj444 td/osd-backfill-space/datafile 2020-09-08T16:13:26.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:26.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj444 td/osd-backfill-space/datafile 2020-09-08T16:13:26.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:26.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj444 td/osd-backfill-space/datafile 2020-09-08T16:13:26.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:26.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj444 td/osd-backfill-space/datafile 2020-09-08T16:13:26.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:26.960 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:26.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:26.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj445 td/osd-backfill-space/datafile 2020-09-08T16:13:27.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:27.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj445 td/osd-backfill-space/datafile 2020-09-08T16:13:27.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:27.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj445 td/osd-backfill-space/datafile 2020-09-08T16:13:27.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:27.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj445 td/osd-backfill-space/datafile 2020-09-08T16:13:27.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:27.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj445 td/osd-backfill-space/datafile 2020-09-08T16:13:27.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:27.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj445 td/osd-backfill-space/datafile 2020-09-08T16:13:27.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:27.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj445 td/osd-backfill-space/datafile 2020-09-08T16:13:27.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:27.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj445 td/osd-backfill-space/datafile 2020-09-08T16:13:27.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:27.594 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:27.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:27.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj446 td/osd-backfill-space/datafile 2020-09-08T16:13:27.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:27.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj446 td/osd-backfill-space/datafile 2020-09-08T16:13:27.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:27.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj446 td/osd-backfill-space/datafile 2020-09-08T16:13:27.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:27.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj446 td/osd-backfill-space/datafile 2020-09-08T16:13:27.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:27.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj446 td/osd-backfill-space/datafile 2020-09-08T16:13:27.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:27.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj446 td/osd-backfill-space/datafile 2020-09-08T16:13:28.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:28.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj446 td/osd-backfill-space/datafile 2020-09-08T16:13:28.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:28.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj446 td/osd-backfill-space/datafile 2020-09-08T16:13:28.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:28.218 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:28.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:28.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj447 td/osd-backfill-space/datafile 2020-09-08T16:13:28.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:28.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj447 td/osd-backfill-space/datafile 2020-09-08T16:13:28.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:28.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj447 td/osd-backfill-space/datafile 2020-09-08T16:13:28.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:28.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj447 td/osd-backfill-space/datafile 2020-09-08T16:13:28.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:28.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj447 td/osd-backfill-space/datafile 2020-09-08T16:13:28.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:28.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj447 td/osd-backfill-space/datafile 2020-09-08T16:13:28.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:28.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj447 td/osd-backfill-space/datafile 2020-09-08T16:13:28.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:28.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj447 td/osd-backfill-space/datafile 2020-09-08T16:13:28.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:28.895 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:28.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:28.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj448 td/osd-backfill-space/datafile 2020-09-08T16:13:28.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:28.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj448 td/osd-backfill-space/datafile 2020-09-08T16:13:29.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:29.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj448 td/osd-backfill-space/datafile 2020-09-08T16:13:29.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:29.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj448 td/osd-backfill-space/datafile 2020-09-08T16:13:29.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:29.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj448 td/osd-backfill-space/datafile 2020-09-08T16:13:29.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:29.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj448 td/osd-backfill-space/datafile 2020-09-08T16:13:29.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:29.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj448 td/osd-backfill-space/datafile 2020-09-08T16:13:29.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:29.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj448 td/osd-backfill-space/datafile 2020-09-08T16:13:29.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:29.508 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:29.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:29.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj449 td/osd-backfill-space/datafile 2020-09-08T16:13:29.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:29.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj449 td/osd-backfill-space/datafile 2020-09-08T16:13:29.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:29.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj449 td/osd-backfill-space/datafile 2020-09-08T16:13:29.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:29.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj449 td/osd-backfill-space/datafile 2020-09-08T16:13:29.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:29.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj449 td/osd-backfill-space/datafile 2020-09-08T16:13:29.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:29.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj449 td/osd-backfill-space/datafile 2020-09-08T16:13:29.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:29.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj449 td/osd-backfill-space/datafile 2020-09-08T16:13:30.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:30.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj449 td/osd-backfill-space/datafile 2020-09-08T16:13:30.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:30.152 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:30.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:30.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj450 td/osd-backfill-space/datafile 2020-09-08T16:13:30.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:30.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj450 td/osd-backfill-space/datafile 2020-09-08T16:13:30.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:30.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj450 td/osd-backfill-space/datafile 2020-09-08T16:13:30.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:30.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj450 td/osd-backfill-space/datafile 2020-09-08T16:13:30.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:30.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj450 td/osd-backfill-space/datafile 2020-09-08T16:13:30.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:30.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj450 td/osd-backfill-space/datafile 2020-09-08T16:13:30.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:30.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj450 td/osd-backfill-space/datafile 2020-09-08T16:13:30.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:30.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj450 td/osd-backfill-space/datafile 2020-09-08T16:13:30.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:30.841 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:30.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:30.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj451 td/osd-backfill-space/datafile 2020-09-08T16:13:30.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:30.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj451 td/osd-backfill-space/datafile 2020-09-08T16:13:30.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:30.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj451 td/osd-backfill-space/datafile 2020-09-08T16:13:31.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:31.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj451 td/osd-backfill-space/datafile 2020-09-08T16:13:31.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:31.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj451 td/osd-backfill-space/datafile 2020-09-08T16:13:31.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:31.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj451 td/osd-backfill-space/datafile 2020-09-08T16:13:31.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:31.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj451 td/osd-backfill-space/datafile 2020-09-08T16:13:31.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:31.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj451 td/osd-backfill-space/datafile 2020-09-08T16:13:31.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:31.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:31.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:31.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj452 td/osd-backfill-space/datafile 2020-09-08T16:13:31.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:31.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj452 td/osd-backfill-space/datafile 2020-09-08T16:13:31.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:31.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj452 td/osd-backfill-space/datafile 2020-09-08T16:13:31.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:31.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj452 td/osd-backfill-space/datafile 2020-09-08T16:13:31.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:31.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj452 td/osd-backfill-space/datafile 2020-09-08T16:13:31.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:31.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj452 td/osd-backfill-space/datafile 2020-09-08T16:13:31.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:31.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj452 td/osd-backfill-space/datafile 2020-09-08T16:13:32.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:32.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj452 td/osd-backfill-space/datafile 2020-09-08T16:13:32.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:32.106 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:32.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:32.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj453 td/osd-backfill-space/datafile 2020-09-08T16:13:32.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:32.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj453 td/osd-backfill-space/datafile 2020-09-08T16:13:32.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:32.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj453 td/osd-backfill-space/datafile 2020-09-08T16:13:32.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:32.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj453 td/osd-backfill-space/datafile 2020-09-08T16:13:32.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:32.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj453 td/osd-backfill-space/datafile 2020-09-08T16:13:32.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:32.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj453 td/osd-backfill-space/datafile 2020-09-08T16:13:32.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:32.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj453 td/osd-backfill-space/datafile 2020-09-08T16:13:32.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:32.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj453 td/osd-backfill-space/datafile 2020-09-08T16:13:32.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:32.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:32.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:32.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj454 td/osd-backfill-space/datafile 2020-09-08T16:13:32.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:32.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj454 td/osd-backfill-space/datafile 2020-09-08T16:13:32.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:32.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj454 td/osd-backfill-space/datafile 2020-09-08T16:13:32.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:32.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj454 td/osd-backfill-space/datafile 2020-09-08T16:13:33.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:33.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj454 td/osd-backfill-space/datafile 2020-09-08T16:13:33.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:33.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj454 td/osd-backfill-space/datafile 2020-09-08T16:13:33.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:33.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj454 td/osd-backfill-space/datafile 2020-09-08T16:13:33.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:33.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj454 td/osd-backfill-space/datafile 2020-09-08T16:13:33.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:33.379 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:33.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:33.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj455 td/osd-backfill-space/datafile 2020-09-08T16:13:33.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:33.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj455 td/osd-backfill-space/datafile 2020-09-08T16:13:33.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:33.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj455 td/osd-backfill-space/datafile 2020-09-08T16:13:33.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:33.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj455 td/osd-backfill-space/datafile 2020-09-08T16:13:33.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:33.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj455 td/osd-backfill-space/datafile 2020-09-08T16:13:33.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:33.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj455 td/osd-backfill-space/datafile 2020-09-08T16:13:33.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:33.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj455 td/osd-backfill-space/datafile 2020-09-08T16:13:33.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:33.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj455 td/osd-backfill-space/datafile 2020-09-08T16:13:33.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:33.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:33.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:33.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj456 td/osd-backfill-space/datafile 2020-09-08T16:13:34.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:34.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj456 td/osd-backfill-space/datafile 2020-09-08T16:13:34.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:34.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj456 td/osd-backfill-space/datafile 2020-09-08T16:13:34.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:34.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj456 td/osd-backfill-space/datafile 2020-09-08T16:13:34.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:34.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj456 td/osd-backfill-space/datafile 2020-09-08T16:13:34.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:34.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj456 td/osd-backfill-space/datafile 2020-09-08T16:13:34.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:34.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj456 td/osd-backfill-space/datafile 2020-09-08T16:13:34.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:34.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj456 td/osd-backfill-space/datafile 2020-09-08T16:13:34.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:34.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:34.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:34.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj457 td/osd-backfill-space/datafile 2020-09-08T16:13:34.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:34.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj457 td/osd-backfill-space/datafile 2020-09-08T16:13:34.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:34.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj457 td/osd-backfill-space/datafile 2020-09-08T16:13:34.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:34.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj457 td/osd-backfill-space/datafile 2020-09-08T16:13:34.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:34.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj457 td/osd-backfill-space/datafile 2020-09-08T16:13:35.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:35.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj457 td/osd-backfill-space/datafile 2020-09-08T16:13:35.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:35.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj457 td/osd-backfill-space/datafile 2020-09-08T16:13:35.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:35.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj457 td/osd-backfill-space/datafile 2020-09-08T16:13:35.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:35.297 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:35.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:35.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj458 td/osd-backfill-space/datafile 2020-09-08T16:13:35.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:35.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj458 td/osd-backfill-space/datafile 2020-09-08T16:13:35.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:35.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj458 td/osd-backfill-space/datafile 2020-09-08T16:13:35.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:35.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj458 td/osd-backfill-space/datafile 2020-09-08T16:13:35.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:35.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj458 td/osd-backfill-space/datafile 2020-09-08T16:13:35.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:35.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj458 td/osd-backfill-space/datafile 2020-09-08T16:13:35.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:35.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj458 td/osd-backfill-space/datafile 2020-09-08T16:13:35.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:35.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj458 td/osd-backfill-space/datafile 2020-09-08T16:13:35.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:35.917 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:35.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:35.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj459 td/osd-backfill-space/datafile 2020-09-08T16:13:35.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:35.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj459 td/osd-backfill-space/datafile 2020-09-08T16:13:36.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:36.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj459 td/osd-backfill-space/datafile 2020-09-08T16:13:36.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:36.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj459 td/osd-backfill-space/datafile 2020-09-08T16:13:36.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:36.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj459 td/osd-backfill-space/datafile 2020-09-08T16:13:36.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:36.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj459 td/osd-backfill-space/datafile 2020-09-08T16:13:36.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:36.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj459 td/osd-backfill-space/datafile 2020-09-08T16:13:36.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:36.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj459 td/osd-backfill-space/datafile 2020-09-08T16:13:36.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:36.654 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:36.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:36.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj460 td/osd-backfill-space/datafile 2020-09-08T16:13:36.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:36.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj460 td/osd-backfill-space/datafile 2020-09-08T16:13:36.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:36.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj460 td/osd-backfill-space/datafile 2020-09-08T16:13:36.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:36.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj460 td/osd-backfill-space/datafile 2020-09-08T16:13:36.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:36.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj460 td/osd-backfill-space/datafile 2020-09-08T16:13:37.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:37.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj460 td/osd-backfill-space/datafile 2020-09-08T16:13:37.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:37.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj460 td/osd-backfill-space/datafile 2020-09-08T16:13:37.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:37.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj460 td/osd-backfill-space/datafile 2020-09-08T16:13:37.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:37.266 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:37.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:37.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj461 td/osd-backfill-space/datafile 2020-09-08T16:13:37.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:37.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj461 td/osd-backfill-space/datafile 2020-09-08T16:13:37.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:37.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj461 td/osd-backfill-space/datafile 2020-09-08T16:13:37.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:37.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj461 td/osd-backfill-space/datafile 2020-09-08T16:13:37.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:37.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj461 td/osd-backfill-space/datafile 2020-09-08T16:13:37.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:37.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj461 td/osd-backfill-space/datafile 2020-09-08T16:13:37.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:37.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj461 td/osd-backfill-space/datafile 2020-09-08T16:13:37.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:37.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj461 td/osd-backfill-space/datafile 2020-09-08T16:13:37.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:37.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:37.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:37.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj462 td/osd-backfill-space/datafile 2020-09-08T16:13:37.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:37.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj462 td/osd-backfill-space/datafile 2020-09-08T16:13:38.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:38.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj462 td/osd-backfill-space/datafile 2020-09-08T16:13:38.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:38.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj462 td/osd-backfill-space/datafile 2020-09-08T16:13:38.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:38.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj462 td/osd-backfill-space/datafile 2020-09-08T16:13:38.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:38.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj462 td/osd-backfill-space/datafile 2020-09-08T16:13:38.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:38.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj462 td/osd-backfill-space/datafile 2020-09-08T16:13:38.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:38.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj462 td/osd-backfill-space/datafile 2020-09-08T16:13:38.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:38.565 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:38.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:38.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj463 td/osd-backfill-space/datafile 2020-09-08T16:13:38.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:38.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj463 td/osd-backfill-space/datafile 2020-09-08T16:13:38.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:38.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj463 td/osd-backfill-space/datafile 2020-09-08T16:13:38.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:38.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj463 td/osd-backfill-space/datafile 2020-09-08T16:13:38.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:38.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj463 td/osd-backfill-space/datafile 2020-09-08T16:13:38.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:38.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj463 td/osd-backfill-space/datafile 2020-09-08T16:13:39.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:39.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj463 td/osd-backfill-space/datafile 2020-09-08T16:13:39.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:39.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj463 td/osd-backfill-space/datafile 2020-09-08T16:13:39.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:39.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:39.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:39.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj464 td/osd-backfill-space/datafile 2020-09-08T16:13:39.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:39.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj464 td/osd-backfill-space/datafile 2020-09-08T16:13:39.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:39.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj464 td/osd-backfill-space/datafile 2020-09-08T16:13:39.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:39.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj464 td/osd-backfill-space/datafile 2020-09-08T16:13:39.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:39.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj464 td/osd-backfill-space/datafile 2020-09-08T16:13:39.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:39.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj464 td/osd-backfill-space/datafile 2020-09-08T16:13:39.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:39.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj464 td/osd-backfill-space/datafile 2020-09-08T16:13:39.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:39.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj464 td/osd-backfill-space/datafile 2020-09-08T16:13:39.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:39.794 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:39.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:39.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj465 td/osd-backfill-space/datafile 2020-09-08T16:13:39.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:39.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj465 td/osd-backfill-space/datafile 2020-09-08T16:13:39.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:39.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj465 td/osd-backfill-space/datafile 2020-09-08T16:13:40.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:40.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj465 td/osd-backfill-space/datafile 2020-09-08T16:13:40.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:40.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj465 td/osd-backfill-space/datafile 2020-09-08T16:13:40.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:40.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj465 td/osd-backfill-space/datafile 2020-09-08T16:13:40.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:40.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj465 td/osd-backfill-space/datafile 2020-09-08T16:13:40.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:40.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj465 td/osd-backfill-space/datafile 2020-09-08T16:13:40.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:40.569 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:40.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:40.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj466 td/osd-backfill-space/datafile 2020-09-08T16:13:40.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:40.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj466 td/osd-backfill-space/datafile 2020-09-08T16:13:40.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:40.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj466 td/osd-backfill-space/datafile 2020-09-08T16:13:40.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:40.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj466 td/osd-backfill-space/datafile 2020-09-08T16:13:40.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:40.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj466 td/osd-backfill-space/datafile 2020-09-08T16:13:40.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:40.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj466 td/osd-backfill-space/datafile 2020-09-08T16:13:41.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:41.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj466 td/osd-backfill-space/datafile 2020-09-08T16:13:41.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:41.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj466 td/osd-backfill-space/datafile 2020-09-08T16:13:41.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:41.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:41.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:41.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj467 td/osd-backfill-space/datafile 2020-09-08T16:13:41.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:41.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj467 td/osd-backfill-space/datafile 2020-09-08T16:13:41.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:41.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj467 td/osd-backfill-space/datafile 2020-09-08T16:13:41.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:41.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj467 td/osd-backfill-space/datafile 2020-09-08T16:13:41.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:41.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj467 td/osd-backfill-space/datafile 2020-09-08T16:13:41.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:41.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj467 td/osd-backfill-space/datafile 2020-09-08T16:13:41.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:41.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj467 td/osd-backfill-space/datafile 2020-09-08T16:13:41.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:41.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj467 td/osd-backfill-space/datafile 2020-09-08T16:13:42.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:42.064 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:42.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:42.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj468 td/osd-backfill-space/datafile 2020-09-08T16:13:42.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:42.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj468 td/osd-backfill-space/datafile 2020-09-08T16:13:42.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:42.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj468 td/osd-backfill-space/datafile 2020-09-08T16:13:42.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:42.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj468 td/osd-backfill-space/datafile 2020-09-08T16:13:42.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:42.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj468 td/osd-backfill-space/datafile 2020-09-08T16:13:42.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:42.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj468 td/osd-backfill-space/datafile 2020-09-08T16:13:42.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:42.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj468 td/osd-backfill-space/datafile 2020-09-08T16:13:42.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:42.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj468 td/osd-backfill-space/datafile 2020-09-08T16:13:42.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:42.726 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:42.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:42.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj469 td/osd-backfill-space/datafile 2020-09-08T16:13:42.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:42.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj469 td/osd-backfill-space/datafile 2020-09-08T16:13:42.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:42.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj469 td/osd-backfill-space/datafile 2020-09-08T16:13:42.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:42.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj469 td/osd-backfill-space/datafile 2020-09-08T16:13:43.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:43.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj469 td/osd-backfill-space/datafile 2020-09-08T16:13:43.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:43.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj469 td/osd-backfill-space/datafile 2020-09-08T16:13:43.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:43.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj469 td/osd-backfill-space/datafile 2020-09-08T16:13:43.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:43.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj469 td/osd-backfill-space/datafile 2020-09-08T16:13:43.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:43.346 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:43.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:43.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj470 td/osd-backfill-space/datafile 2020-09-08T16:13:43.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:43.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj470 td/osd-backfill-space/datafile 2020-09-08T16:13:43.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:43.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj470 td/osd-backfill-space/datafile 2020-09-08T16:13:43.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:43.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj470 td/osd-backfill-space/datafile 2020-09-08T16:13:43.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:43.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj470 td/osd-backfill-space/datafile 2020-09-08T16:13:43.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:43.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj470 td/osd-backfill-space/datafile 2020-09-08T16:13:43.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:43.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj470 td/osd-backfill-space/datafile 2020-09-08T16:13:43.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:43.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj470 td/osd-backfill-space/datafile 2020-09-08T16:13:43.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:43.957 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:43.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:43.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj471 td/osd-backfill-space/datafile 2020-09-08T16:13:44.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:44.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj471 td/osd-backfill-space/datafile 2020-09-08T16:13:44.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:44.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj471 td/osd-backfill-space/datafile 2020-09-08T16:13:44.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:44.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj471 td/osd-backfill-space/datafile 2020-09-08T16:13:44.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:44.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj471 td/osd-backfill-space/datafile 2020-09-08T16:13:44.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:44.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj471 td/osd-backfill-space/datafile 2020-09-08T16:13:44.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:44.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj471 td/osd-backfill-space/datafile 2020-09-08T16:13:44.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:44.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj471 td/osd-backfill-space/datafile 2020-09-08T16:13:44.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:44.637 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:44.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:44.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj472 td/osd-backfill-space/datafile 2020-09-08T16:13:44.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:44.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj472 td/osd-backfill-space/datafile 2020-09-08T16:13:44.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:44.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj472 td/osd-backfill-space/datafile 2020-09-08T16:13:44.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:44.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj472 td/osd-backfill-space/datafile 2020-09-08T16:13:44.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:44.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj472 td/osd-backfill-space/datafile 2020-09-08T16:13:45.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:45.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj472 td/osd-backfill-space/datafile 2020-09-08T16:13:45.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:45.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj472 td/osd-backfill-space/datafile 2020-09-08T16:13:45.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:45.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj472 td/osd-backfill-space/datafile 2020-09-08T16:13:45.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:45.239 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:45.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:45.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj473 td/osd-backfill-space/datafile 2020-09-08T16:13:45.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:45.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj473 td/osd-backfill-space/datafile 2020-09-08T16:13:45.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:45.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj473 td/osd-backfill-space/datafile 2020-09-08T16:13:45.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:45.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj473 td/osd-backfill-space/datafile 2020-09-08T16:13:45.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:45.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj473 td/osd-backfill-space/datafile 2020-09-08T16:13:45.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:45.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj473 td/osd-backfill-space/datafile 2020-09-08T16:13:45.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:45.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj473 td/osd-backfill-space/datafile 2020-09-08T16:13:45.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:45.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj473 td/osd-backfill-space/datafile 2020-09-08T16:13:45.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:45.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:45.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:45.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj474 td/osd-backfill-space/datafile 2020-09-08T16:13:46.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:46.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj474 td/osd-backfill-space/datafile 2020-09-08T16:13:46.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:46.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj474 td/osd-backfill-space/datafile 2020-09-08T16:13:46.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:46.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj474 td/osd-backfill-space/datafile 2020-09-08T16:13:46.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:46.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj474 td/osd-backfill-space/datafile 2020-09-08T16:13:46.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:46.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj474 td/osd-backfill-space/datafile 2020-09-08T16:13:46.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:46.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj474 td/osd-backfill-space/datafile 2020-09-08T16:13:46.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:46.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj474 td/osd-backfill-space/datafile 2020-09-08T16:13:46.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:46.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:46.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:46.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj475 td/osd-backfill-space/datafile 2020-09-08T16:13:46.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:46.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj475 td/osd-backfill-space/datafile 2020-09-08T16:13:46.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:46.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj475 td/osd-backfill-space/datafile 2020-09-08T16:13:46.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:46.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj475 td/osd-backfill-space/datafile 2020-09-08T16:13:46.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:46.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj475 td/osd-backfill-space/datafile 2020-09-08T16:13:47.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:47.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj475 td/osd-backfill-space/datafile 2020-09-08T16:13:47.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:47.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj475 td/osd-backfill-space/datafile 2020-09-08T16:13:47.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:47.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj475 td/osd-backfill-space/datafile 2020-09-08T16:13:47.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:47.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:47.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:47.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj476 td/osd-backfill-space/datafile 2020-09-08T16:13:47.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:47.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj476 td/osd-backfill-space/datafile 2020-09-08T16:13:47.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:47.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj476 td/osd-backfill-space/datafile 2020-09-08T16:13:47.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:47.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj476 td/osd-backfill-space/datafile 2020-09-08T16:13:47.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:47.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj476 td/osd-backfill-space/datafile 2020-09-08T16:13:47.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:47.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj476 td/osd-backfill-space/datafile 2020-09-08T16:13:47.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:47.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj476 td/osd-backfill-space/datafile 2020-09-08T16:13:47.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:47.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj476 td/osd-backfill-space/datafile 2020-09-08T16:13:47.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:47.918 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:47.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:47.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj477 td/osd-backfill-space/datafile 2020-09-08T16:13:47.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:47.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj477 td/osd-backfill-space/datafile 2020-09-08T16:13:48.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:48.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj477 td/osd-backfill-space/datafile 2020-09-08T16:13:48.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:48.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj477 td/osd-backfill-space/datafile 2020-09-08T16:13:48.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:48.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj477 td/osd-backfill-space/datafile 2020-09-08T16:13:48.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:48.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj477 td/osd-backfill-space/datafile 2020-09-08T16:13:48.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:48.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj477 td/osd-backfill-space/datafile 2020-09-08T16:13:48.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:48.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj477 td/osd-backfill-space/datafile 2020-09-08T16:13:48.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:48.605 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:48.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:48.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj478 td/osd-backfill-space/datafile 2020-09-08T16:13:48.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:48.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj478 td/osd-backfill-space/datafile 2020-09-08T16:13:48.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:48.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj478 td/osd-backfill-space/datafile 2020-09-08T16:13:48.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:48.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj478 td/osd-backfill-space/datafile 2020-09-08T16:13:48.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:48.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj478 td/osd-backfill-space/datafile 2020-09-08T16:13:49.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:49.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj478 td/osd-backfill-space/datafile 2020-09-08T16:13:49.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:49.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj478 td/osd-backfill-space/datafile 2020-09-08T16:13:49.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:49.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj478 td/osd-backfill-space/datafile 2020-09-08T16:13:49.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:49.250 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:49.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:49.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj479 td/osd-backfill-space/datafile 2020-09-08T16:13:49.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:49.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj479 td/osd-backfill-space/datafile 2020-09-08T16:13:49.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:49.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj479 td/osd-backfill-space/datafile 2020-09-08T16:13:49.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:49.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj479 td/osd-backfill-space/datafile 2020-09-08T16:13:49.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:49.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj479 td/osd-backfill-space/datafile 2020-09-08T16:13:49.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:49.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj479 td/osd-backfill-space/datafile 2020-09-08T16:13:49.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:49.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj479 td/osd-backfill-space/datafile 2020-09-08T16:13:49.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:49.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj479 td/osd-backfill-space/datafile 2020-09-08T16:13:49.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:49.920 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:49.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:49.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj480 td/osd-backfill-space/datafile 2020-09-08T16:13:49.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:49.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj480 td/osd-backfill-space/datafile 2020-09-08T16:13:50.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:50.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj480 td/osd-backfill-space/datafile 2020-09-08T16:13:50.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:50.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj480 td/osd-backfill-space/datafile 2020-09-08T16:13:50.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:50.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj480 td/osd-backfill-space/datafile 2020-09-08T16:13:50.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:50.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj480 td/osd-backfill-space/datafile 2020-09-08T16:13:50.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:50.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj480 td/osd-backfill-space/datafile 2020-09-08T16:13:50.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:50.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj480 td/osd-backfill-space/datafile 2020-09-08T16:13:50.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:50.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:50.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:50.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj481 td/osd-backfill-space/datafile 2020-09-08T16:13:51.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:51.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj481 td/osd-backfill-space/datafile 2020-09-08T16:13:51.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:51.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj481 td/osd-backfill-space/datafile 2020-09-08T16:13:51.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:51.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj481 td/osd-backfill-space/datafile 2020-09-08T16:13:51.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:51.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj481 td/osd-backfill-space/datafile 2020-09-08T16:13:51.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:51.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj481 td/osd-backfill-space/datafile 2020-09-08T16:13:51.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:51.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj481 td/osd-backfill-space/datafile 2020-09-08T16:13:51.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:51.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj481 td/osd-backfill-space/datafile 2020-09-08T16:13:51.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:51.595 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:51.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:51.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj482 td/osd-backfill-space/datafile 2020-09-08T16:13:51.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:51.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj482 td/osd-backfill-space/datafile 2020-09-08T16:13:51.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:51.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj482 td/osd-backfill-space/datafile 2020-09-08T16:13:51.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:51.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj482 td/osd-backfill-space/datafile 2020-09-08T16:13:51.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:51.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj482 td/osd-backfill-space/datafile 2020-09-08T16:13:52.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:52.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj482 td/osd-backfill-space/datafile 2020-09-08T16:13:52.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:52.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj482 td/osd-backfill-space/datafile 2020-09-08T16:13:52.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:52.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj482 td/osd-backfill-space/datafile 2020-09-08T16:13:52.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:52.238 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:52.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:52.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj483 td/osd-backfill-space/datafile 2020-09-08T16:13:52.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:52.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj483 td/osd-backfill-space/datafile 2020-09-08T16:13:52.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:52.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj483 td/osd-backfill-space/datafile 2020-09-08T16:13:52.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:52.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj483 td/osd-backfill-space/datafile 2020-09-08T16:13:52.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:52.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj483 td/osd-backfill-space/datafile 2020-09-08T16:13:52.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:52.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj483 td/osd-backfill-space/datafile 2020-09-08T16:13:52.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:52.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj483 td/osd-backfill-space/datafile 2020-09-08T16:13:52.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:52.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj483 td/osd-backfill-space/datafile 2020-09-08T16:13:52.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:52.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:52.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:52.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj484 td/osd-backfill-space/datafile 2020-09-08T16:13:53.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:53.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj484 td/osd-backfill-space/datafile 2020-09-08T16:13:53.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:53.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj484 td/osd-backfill-space/datafile 2020-09-08T16:13:53.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:53.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj484 td/osd-backfill-space/datafile 2020-09-08T16:13:53.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:53.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj484 td/osd-backfill-space/datafile 2020-09-08T16:13:53.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:53.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj484 td/osd-backfill-space/datafile 2020-09-08T16:13:53.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:53.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj484 td/osd-backfill-space/datafile 2020-09-08T16:13:53.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:53.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj484 td/osd-backfill-space/datafile 2020-09-08T16:13:53.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:53.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:53.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:53.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj485 td/osd-backfill-space/datafile 2020-09-08T16:13:53.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:53.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj485 td/osd-backfill-space/datafile 2020-09-08T16:13:53.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:53.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj485 td/osd-backfill-space/datafile 2020-09-08T16:13:53.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:53.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj485 td/osd-backfill-space/datafile 2020-09-08T16:13:53.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:53.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj485 td/osd-backfill-space/datafile 2020-09-08T16:13:53.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:53.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj485 td/osd-backfill-space/datafile 2020-09-08T16:13:53.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:53.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj485 td/osd-backfill-space/datafile 2020-09-08T16:13:54.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:54.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj485 td/osd-backfill-space/datafile 2020-09-08T16:13:54.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:54.139 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:54.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:54.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj486 td/osd-backfill-space/datafile 2020-09-08T16:13:54.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:54.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj486 td/osd-backfill-space/datafile 2020-09-08T16:13:54.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:54.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj486 td/osd-backfill-space/datafile 2020-09-08T16:13:54.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:54.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj486 td/osd-backfill-space/datafile 2020-09-08T16:13:54.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:54.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj486 td/osd-backfill-space/datafile 2020-09-08T16:13:54.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:54.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj486 td/osd-backfill-space/datafile 2020-09-08T16:13:54.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:54.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj486 td/osd-backfill-space/datafile 2020-09-08T16:13:54.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:54.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj486 td/osd-backfill-space/datafile 2020-09-08T16:13:54.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:54.802 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:54.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:54.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj487 td/osd-backfill-space/datafile 2020-09-08T16:13:54.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:54.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj487 td/osd-backfill-space/datafile 2020-09-08T16:13:54.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:54.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj487 td/osd-backfill-space/datafile 2020-09-08T16:13:55.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:55.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj487 td/osd-backfill-space/datafile 2020-09-08T16:13:55.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:55.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj487 td/osd-backfill-space/datafile 2020-09-08T16:13:55.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:55.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj487 td/osd-backfill-space/datafile 2020-09-08T16:13:55.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:55.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj487 td/osd-backfill-space/datafile 2020-09-08T16:13:55.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:55.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj487 td/osd-backfill-space/datafile 2020-09-08T16:13:55.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:55.421 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:55.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:55.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj488 td/osd-backfill-space/datafile 2020-09-08T16:13:55.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:55.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj488 td/osd-backfill-space/datafile 2020-09-08T16:13:55.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:55.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj488 td/osd-backfill-space/datafile 2020-09-08T16:13:55.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:55.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj488 td/osd-backfill-space/datafile 2020-09-08T16:13:55.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:55.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj488 td/osd-backfill-space/datafile 2020-09-08T16:13:55.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:55.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj488 td/osd-backfill-space/datafile 2020-09-08T16:13:55.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:55.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj488 td/osd-backfill-space/datafile 2020-09-08T16:13:55.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:55.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj488 td/osd-backfill-space/datafile 2020-09-08T16:13:56.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:56.024 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:56.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:56.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj489 td/osd-backfill-space/datafile 2020-09-08T16:13:56.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:56.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj489 td/osd-backfill-space/datafile 2020-09-08T16:13:56.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:56.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj489 td/osd-backfill-space/datafile 2020-09-08T16:13:56.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:56.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj489 td/osd-backfill-space/datafile 2020-09-08T16:13:56.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:56.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj489 td/osd-backfill-space/datafile 2020-09-08T16:13:56.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:56.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj489 td/osd-backfill-space/datafile 2020-09-08T16:13:56.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:56.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj489 td/osd-backfill-space/datafile 2020-09-08T16:13:56.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:56.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj489 td/osd-backfill-space/datafile 2020-09-08T16:13:56.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:56.894 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:56.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:56.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj490 td/osd-backfill-space/datafile 2020-09-08T16:13:56.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:56.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj490 td/osd-backfill-space/datafile 2020-09-08T16:13:57.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:57.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj490 td/osd-backfill-space/datafile 2020-09-08T16:13:57.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:57.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj490 td/osd-backfill-space/datafile 2020-09-08T16:13:57.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:57.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj490 td/osd-backfill-space/datafile 2020-09-08T16:13:57.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:57.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj490 td/osd-backfill-space/datafile 2020-09-08T16:13:57.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:57.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj490 td/osd-backfill-space/datafile 2020-09-08T16:13:57.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:57.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj490 td/osd-backfill-space/datafile 2020-09-08T16:13:57.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:57.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:57.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:57.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj491 td/osd-backfill-space/datafile 2020-09-08T16:13:57.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:57.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj491 td/osd-backfill-space/datafile 2020-09-08T16:13:57.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:57.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj491 td/osd-backfill-space/datafile 2020-09-08T16:13:57.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:57.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj491 td/osd-backfill-space/datafile 2020-09-08T16:13:57.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:57.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj491 td/osd-backfill-space/datafile 2020-09-08T16:13:57.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:57.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj491 td/osd-backfill-space/datafile 2020-09-08T16:13:57.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:57.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj491 td/osd-backfill-space/datafile 2020-09-08T16:13:58.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:58.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj491 td/osd-backfill-space/datafile 2020-09-08T16:13:58.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:58.126 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:58.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:58.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj492 td/osd-backfill-space/datafile 2020-09-08T16:13:58.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:58.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj492 td/osd-backfill-space/datafile 2020-09-08T16:13:58.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:58.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj492 td/osd-backfill-space/datafile 2020-09-08T16:13:58.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:58.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj492 td/osd-backfill-space/datafile 2020-09-08T16:13:58.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:58.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj492 td/osd-backfill-space/datafile 2020-09-08T16:13:58.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:58.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj492 td/osd-backfill-space/datafile 2020-09-08T16:13:58.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:58.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj492 td/osd-backfill-space/datafile 2020-09-08T16:13:58.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:58.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj492 td/osd-backfill-space/datafile 2020-09-08T16:13:58.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:58.805 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:58.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:58.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj493 td/osd-backfill-space/datafile 2020-09-08T16:13:58.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:58.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj493 td/osd-backfill-space/datafile 2020-09-08T16:13:58.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:58.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj493 td/osd-backfill-space/datafile 2020-09-08T16:13:59.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:59.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj493 td/osd-backfill-space/datafile 2020-09-08T16:13:59.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:59.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj493 td/osd-backfill-space/datafile 2020-09-08T16:13:59.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:59.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj493 td/osd-backfill-space/datafile 2020-09-08T16:13:59.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:59.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj493 td/osd-backfill-space/datafile 2020-09-08T16:13:59.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:59.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj493 td/osd-backfill-space/datafile 2020-09-08T16:13:59.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:13:59.444 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:13:59.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:59.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj494 td/osd-backfill-space/datafile 2020-09-08T16:13:59.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:59.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj494 td/osd-backfill-space/datafile 2020-09-08T16:13:59.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:59.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj494 td/osd-backfill-space/datafile 2020-09-08T16:13:59.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:59.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj494 td/osd-backfill-space/datafile 2020-09-08T16:13:59.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:59.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj494 td/osd-backfill-space/datafile 2020-09-08T16:13:59.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:59.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj494 td/osd-backfill-space/datafile 2020-09-08T16:13:59.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:59.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj494 td/osd-backfill-space/datafile 2020-09-08T16:13:59.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:13:59.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj494 td/osd-backfill-space/datafile 2020-09-08T16:14:00.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:00.053 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:00.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:00.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj495 td/osd-backfill-space/datafile 2020-09-08T16:14:00.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:00.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj495 td/osd-backfill-space/datafile 2020-09-08T16:14:00.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:00.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj495 td/osd-backfill-space/datafile 2020-09-08T16:14:00.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:00.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj495 td/osd-backfill-space/datafile 2020-09-08T16:14:00.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:00.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj495 td/osd-backfill-space/datafile 2020-09-08T16:14:00.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:00.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj495 td/osd-backfill-space/datafile 2020-09-08T16:14:00.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:00.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj495 td/osd-backfill-space/datafile 2020-09-08T16:14:00.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:00.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj495 td/osd-backfill-space/datafile 2020-09-08T16:14:00.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:00.747 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:00.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:00.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj496 td/osd-backfill-space/datafile 2020-09-08T16:14:00.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:00.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj496 td/osd-backfill-space/datafile 2020-09-08T16:14:00.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:00.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj496 td/osd-backfill-space/datafile 2020-09-08T16:14:00.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:00.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj496 td/osd-backfill-space/datafile 2020-09-08T16:14:01.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:01.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj496 td/osd-backfill-space/datafile 2020-09-08T16:14:01.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:01.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj496 td/osd-backfill-space/datafile 2020-09-08T16:14:01.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:01.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj496 td/osd-backfill-space/datafile 2020-09-08T16:14:01.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:01.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj496 td/osd-backfill-space/datafile 2020-09-08T16:14:01.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:01.434 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:01.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:01.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj497 td/osd-backfill-space/datafile 2020-09-08T16:14:01.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:01.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj497 td/osd-backfill-space/datafile 2020-09-08T16:14:01.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:01.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj497 td/osd-backfill-space/datafile 2020-09-08T16:14:01.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:01.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj497 td/osd-backfill-space/datafile 2020-09-08T16:14:01.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:01.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj497 td/osd-backfill-space/datafile 2020-09-08T16:14:01.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:01.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj497 td/osd-backfill-space/datafile 2020-09-08T16:14:01.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:01.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj497 td/osd-backfill-space/datafile 2020-09-08T16:14:02.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:02.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj497 td/osd-backfill-space/datafile 2020-09-08T16:14:02.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:02.083 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:02.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:02.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj498 td/osd-backfill-space/datafile 2020-09-08T16:14:02.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:02.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj498 td/osd-backfill-space/datafile 2020-09-08T16:14:02.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:02.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj498 td/osd-backfill-space/datafile 2020-09-08T16:14:02.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:02.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj498 td/osd-backfill-space/datafile 2020-09-08T16:14:02.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:02.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj498 td/osd-backfill-space/datafile 2020-09-08T16:14:02.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:02.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj498 td/osd-backfill-space/datafile 2020-09-08T16:14:02.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:02.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj498 td/osd-backfill-space/datafile 2020-09-08T16:14:02.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:02.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj498 td/osd-backfill-space/datafile 2020-09-08T16:14:02.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:02.800 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:02.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:02.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj499 td/osd-backfill-space/datafile 2020-09-08T16:14:02.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:02.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj499 td/osd-backfill-space/datafile 2020-09-08T16:14:02.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:02.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj499 td/osd-backfill-space/datafile 2020-09-08T16:14:03.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:03.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj499 td/osd-backfill-space/datafile 2020-09-08T16:14:03.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:03.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj499 td/osd-backfill-space/datafile 2020-09-08T16:14:03.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:03.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj499 td/osd-backfill-space/datafile 2020-09-08T16:14:03.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:03.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj499 td/osd-backfill-space/datafile 2020-09-08T16:14:03.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:03.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj499 td/osd-backfill-space/datafile 2020-09-08T16:14:03.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:03.410 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:03.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:03.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj500 td/osd-backfill-space/datafile 2020-09-08T16:14:03.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:03.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj500 td/osd-backfill-space/datafile 2020-09-08T16:14:03.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:03.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj500 td/osd-backfill-space/datafile 2020-09-08T16:14:03.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:03.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj500 td/osd-backfill-space/datafile 2020-09-08T16:14:03.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:03.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj500 td/osd-backfill-space/datafile 2020-09-08T16:14:03.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:03.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj500 td/osd-backfill-space/datafile 2020-09-08T16:14:03.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:03.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj500 td/osd-backfill-space/datafile 2020-09-08T16:14:03.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:03.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj500 td/osd-backfill-space/datafile 2020-09-08T16:14:04.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:04.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:04.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:04.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj501 td/osd-backfill-space/datafile 2020-09-08T16:14:04.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:04.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj501 td/osd-backfill-space/datafile 2020-09-08T16:14:04.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:04.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj501 td/osd-backfill-space/datafile 2020-09-08T16:14:04.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:04.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj501 td/osd-backfill-space/datafile 2020-09-08T16:14:04.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:04.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj501 td/osd-backfill-space/datafile 2020-09-08T16:14:04.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:04.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj501 td/osd-backfill-space/datafile 2020-09-08T16:14:04.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:04.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj501 td/osd-backfill-space/datafile 2020-09-08T16:14:04.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:04.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj501 td/osd-backfill-space/datafile 2020-09-08T16:14:04.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:04.725 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:04.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:04.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj502 td/osd-backfill-space/datafile 2020-09-08T16:14:04.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:04.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj502 td/osd-backfill-space/datafile 2020-09-08T16:14:04.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:04.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj502 td/osd-backfill-space/datafile 2020-09-08T16:14:04.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:04.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj502 td/osd-backfill-space/datafile 2020-09-08T16:14:05.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:05.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj502 td/osd-backfill-space/datafile 2020-09-08T16:14:05.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:05.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj502 td/osd-backfill-space/datafile 2020-09-08T16:14:05.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:05.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj502 td/osd-backfill-space/datafile 2020-09-08T16:14:05.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:05.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj502 td/osd-backfill-space/datafile 2020-09-08T16:14:05.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:05.329 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:05.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:05.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj503 td/osd-backfill-space/datafile 2020-09-08T16:14:05.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:05.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj503 td/osd-backfill-space/datafile 2020-09-08T16:14:05.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:05.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj503 td/osd-backfill-space/datafile 2020-09-08T16:14:05.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:05.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj503 td/osd-backfill-space/datafile 2020-09-08T16:14:05.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:05.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj503 td/osd-backfill-space/datafile 2020-09-08T16:14:05.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:05.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj503 td/osd-backfill-space/datafile 2020-09-08T16:14:05.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:05.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj503 td/osd-backfill-space/datafile 2020-09-08T16:14:05.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:05.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj503 td/osd-backfill-space/datafile 2020-09-08T16:14:05.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:05.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:05.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:05.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj504 td/osd-backfill-space/datafile 2020-09-08T16:14:06.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:06.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj504 td/osd-backfill-space/datafile 2020-09-08T16:14:06.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:06.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj504 td/osd-backfill-space/datafile 2020-09-08T16:14:06.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:06.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj504 td/osd-backfill-space/datafile 2020-09-08T16:14:06.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:06.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj504 td/osd-backfill-space/datafile 2020-09-08T16:14:06.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:06.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj504 td/osd-backfill-space/datafile 2020-09-08T16:14:06.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:06.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj504 td/osd-backfill-space/datafile 2020-09-08T16:14:06.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:06.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj504 td/osd-backfill-space/datafile 2020-09-08T16:14:06.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:06.618 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:06.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:06.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj505 td/osd-backfill-space/datafile 2020-09-08T16:14:06.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:06.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj505 td/osd-backfill-space/datafile 2020-09-08T16:14:06.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:06.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj505 td/osd-backfill-space/datafile 2020-09-08T16:14:06.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:06.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj505 td/osd-backfill-space/datafile 2020-09-08T16:14:06.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:06.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj505 td/osd-backfill-space/datafile 2020-09-08T16:14:07.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:07.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj505 td/osd-backfill-space/datafile 2020-09-08T16:14:07.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:07.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj505 td/osd-backfill-space/datafile 2020-09-08T16:14:07.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:07.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj505 td/osd-backfill-space/datafile 2020-09-08T16:14:07.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:07.263 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:07.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:07.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj506 td/osd-backfill-space/datafile 2020-09-08T16:14:07.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:07.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj506 td/osd-backfill-space/datafile 2020-09-08T16:14:07.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:07.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj506 td/osd-backfill-space/datafile 2020-09-08T16:14:07.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:07.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj506 td/osd-backfill-space/datafile 2020-09-08T16:14:07.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:07.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj506 td/osd-backfill-space/datafile 2020-09-08T16:14:07.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:07.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj506 td/osd-backfill-space/datafile 2020-09-08T16:14:07.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:07.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj506 td/osd-backfill-space/datafile 2020-09-08T16:14:07.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:07.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj506 td/osd-backfill-space/datafile 2020-09-08T16:14:07.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:07.892 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:07.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:07.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj507 td/osd-backfill-space/datafile 2020-09-08T16:14:07.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:07.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj507 td/osd-backfill-space/datafile 2020-09-08T16:14:08.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:08.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj507 td/osd-backfill-space/datafile 2020-09-08T16:14:08.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:08.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj507 td/osd-backfill-space/datafile 2020-09-08T16:14:08.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:08.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj507 td/osd-backfill-space/datafile 2020-09-08T16:14:08.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:08.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj507 td/osd-backfill-space/datafile 2020-09-08T16:14:08.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:08.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj507 td/osd-backfill-space/datafile 2020-09-08T16:14:08.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:08.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj507 td/osd-backfill-space/datafile 2020-09-08T16:14:08.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:08.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:08.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:08.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj508 td/osd-backfill-space/datafile 2020-09-08T16:14:08.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:08.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj508 td/osd-backfill-space/datafile 2020-09-08T16:14:08.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:08.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj508 td/osd-backfill-space/datafile 2020-09-08T16:14:08.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:08.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj508 td/osd-backfill-space/datafile 2020-09-08T16:14:08.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:08.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj508 td/osd-backfill-space/datafile 2020-09-08T16:14:08.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:08.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj508 td/osd-backfill-space/datafile 2020-09-08T16:14:09.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:09.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj508 td/osd-backfill-space/datafile 2020-09-08T16:14:09.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:09.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj508 td/osd-backfill-space/datafile 2020-09-08T16:14:09.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:09.197 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:09.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:09.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj509 td/osd-backfill-space/datafile 2020-09-08T16:14:09.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:09.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj509 td/osd-backfill-space/datafile 2020-09-08T16:14:09.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:09.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj509 td/osd-backfill-space/datafile 2020-09-08T16:14:09.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:09.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj509 td/osd-backfill-space/datafile 2020-09-08T16:14:09.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:09.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj509 td/osd-backfill-space/datafile 2020-09-08T16:14:09.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:09.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj509 td/osd-backfill-space/datafile 2020-09-08T16:14:09.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:09.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj509 td/osd-backfill-space/datafile 2020-09-08T16:14:09.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:09.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj509 td/osd-backfill-space/datafile 2020-09-08T16:14:09.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:09.826 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:09.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:09.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj510 td/osd-backfill-space/datafile 2020-09-08T16:14:09.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:09.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj510 td/osd-backfill-space/datafile 2020-09-08T16:14:09.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:09.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj510 td/osd-backfill-space/datafile 2020-09-08T16:14:10.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:10.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj510 td/osd-backfill-space/datafile 2020-09-08T16:14:10.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:10.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj510 td/osd-backfill-space/datafile 2020-09-08T16:14:10.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:10.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj510 td/osd-backfill-space/datafile 2020-09-08T16:14:10.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:10.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj510 td/osd-backfill-space/datafile 2020-09-08T16:14:10.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:10.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj510 td/osd-backfill-space/datafile 2020-09-08T16:14:10.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:10.472 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:10.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:10.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj511 td/osd-backfill-space/datafile 2020-09-08T16:14:10.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:10.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj511 td/osd-backfill-space/datafile 2020-09-08T16:14:10.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:10.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj511 td/osd-backfill-space/datafile 2020-09-08T16:14:10.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:10.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj511 td/osd-backfill-space/datafile 2020-09-08T16:14:10.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:10.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj511 td/osd-backfill-space/datafile 2020-09-08T16:14:10.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:10.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj511 td/osd-backfill-space/datafile 2020-09-08T16:14:10.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:10.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj511 td/osd-backfill-space/datafile 2020-09-08T16:14:11.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:11.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj511 td/osd-backfill-space/datafile 2020-09-08T16:14:11.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:11.116 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:11.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:11.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj512 td/osd-backfill-space/datafile 2020-09-08T16:14:11.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:11.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj512 td/osd-backfill-space/datafile 2020-09-08T16:14:11.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:11.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj512 td/osd-backfill-space/datafile 2020-09-08T16:14:11.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:11.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj512 td/osd-backfill-space/datafile 2020-09-08T16:14:11.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:11.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj512 td/osd-backfill-space/datafile 2020-09-08T16:14:11.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:11.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj512 td/osd-backfill-space/datafile 2020-09-08T16:14:11.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:11.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj512 td/osd-backfill-space/datafile 2020-09-08T16:14:11.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:11.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj512 td/osd-backfill-space/datafile 2020-09-08T16:14:11.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:11.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:11.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:11.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj513 td/osd-backfill-space/datafile 2020-09-08T16:14:11.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:11.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj513 td/osd-backfill-space/datafile 2020-09-08T16:14:11.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:11.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj513 td/osd-backfill-space/datafile 2020-09-08T16:14:12.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:12.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj513 td/osd-backfill-space/datafile 2020-09-08T16:14:12.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:12.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj513 td/osd-backfill-space/datafile 2020-09-08T16:14:12.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:12.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj513 td/osd-backfill-space/datafile 2020-09-08T16:14:12.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:12.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj513 td/osd-backfill-space/datafile 2020-09-08T16:14:12.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:12.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj513 td/osd-backfill-space/datafile 2020-09-08T16:14:12.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:12.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:12.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:12.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj514 td/osd-backfill-space/datafile 2020-09-08T16:14:12.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:12.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj514 td/osd-backfill-space/datafile 2020-09-08T16:14:12.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:12.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj514 td/osd-backfill-space/datafile 2020-09-08T16:14:12.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:12.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj514 td/osd-backfill-space/datafile 2020-09-08T16:14:12.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:12.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj514 td/osd-backfill-space/datafile 2020-09-08T16:14:12.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:12.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj514 td/osd-backfill-space/datafile 2020-09-08T16:14:13.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:13.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj514 td/osd-backfill-space/datafile 2020-09-08T16:14:13.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:13.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj514 td/osd-backfill-space/datafile 2020-09-08T16:14:13.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:13.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:13.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:13.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj515 td/osd-backfill-space/datafile 2020-09-08T16:14:13.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:13.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj515 td/osd-backfill-space/datafile 2020-09-08T16:14:13.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:13.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj515 td/osd-backfill-space/datafile 2020-09-08T16:14:13.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:13.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj515 td/osd-backfill-space/datafile 2020-09-08T16:14:13.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:13.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj515 td/osd-backfill-space/datafile 2020-09-08T16:14:13.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:13.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj515 td/osd-backfill-space/datafile 2020-09-08T16:14:13.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:13.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj515 td/osd-backfill-space/datafile 2020-09-08T16:14:13.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:13.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj515 td/osd-backfill-space/datafile 2020-09-08T16:14:13.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:13.795 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:13.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:13.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj516 td/osd-backfill-space/datafile 2020-09-08T16:14:13.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:13.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj516 td/osd-backfill-space/datafile 2020-09-08T16:14:13.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:13.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj516 td/osd-backfill-space/datafile 2020-09-08T16:14:14.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:14.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj516 td/osd-backfill-space/datafile 2020-09-08T16:14:14.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:14.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj516 td/osd-backfill-space/datafile 2020-09-08T16:14:14.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:14.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj516 td/osd-backfill-space/datafile 2020-09-08T16:14:14.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:14.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj516 td/osd-backfill-space/datafile 2020-09-08T16:14:14.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:14.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj516 td/osd-backfill-space/datafile 2020-09-08T16:14:14.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:14.457 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:14.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:14.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj517 td/osd-backfill-space/datafile 2020-09-08T16:14:14.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:14.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj517 td/osd-backfill-space/datafile 2020-09-08T16:14:14.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:14.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj517 td/osd-backfill-space/datafile 2020-09-08T16:14:14.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:14.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj517 td/osd-backfill-space/datafile 2020-09-08T16:14:14.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:14.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj517 td/osd-backfill-space/datafile 2020-09-08T16:14:14.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:14.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj517 td/osd-backfill-space/datafile 2020-09-08T16:14:14.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:14.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj517 td/osd-backfill-space/datafile 2020-09-08T16:14:15.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:15.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj517 td/osd-backfill-space/datafile 2020-09-08T16:14:15.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:15.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:15.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:15.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj518 td/osd-backfill-space/datafile 2020-09-08T16:14:15.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:15.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj518 td/osd-backfill-space/datafile 2020-09-08T16:14:15.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:15.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj518 td/osd-backfill-space/datafile 2020-09-08T16:14:15.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:15.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj518 td/osd-backfill-space/datafile 2020-09-08T16:14:15.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:15.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj518 td/osd-backfill-space/datafile 2020-09-08T16:14:15.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:15.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj518 td/osd-backfill-space/datafile 2020-09-08T16:14:15.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:15.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj518 td/osd-backfill-space/datafile 2020-09-08T16:14:15.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:15.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj518 td/osd-backfill-space/datafile 2020-09-08T16:14:15.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:15.705 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:15.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:15.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj519 td/osd-backfill-space/datafile 2020-09-08T16:14:15.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:15.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj519 td/osd-backfill-space/datafile 2020-09-08T16:14:15.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:15.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj519 td/osd-backfill-space/datafile 2020-09-08T16:14:15.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:15.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj519 td/osd-backfill-space/datafile 2020-09-08T16:14:16.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:16.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj519 td/osd-backfill-space/datafile 2020-09-08T16:14:16.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:16.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj519 td/osd-backfill-space/datafile 2020-09-08T16:14:16.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:16.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj519 td/osd-backfill-space/datafile 2020-09-08T16:14:16.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:16.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj519 td/osd-backfill-space/datafile 2020-09-08T16:14:16.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:16.384 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:16.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:16.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj520 td/osd-backfill-space/datafile 2020-09-08T16:14:16.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:16.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj520 td/osd-backfill-space/datafile 2020-09-08T16:14:16.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:16.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj520 td/osd-backfill-space/datafile 2020-09-08T16:14:16.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:16.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj520 td/osd-backfill-space/datafile 2020-09-08T16:14:16.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:16.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj520 td/osd-backfill-space/datafile 2020-09-08T16:14:16.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:16.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj520 td/osd-backfill-space/datafile 2020-09-08T16:14:16.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:16.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj520 td/osd-backfill-space/datafile 2020-09-08T16:14:17.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:17.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj520 td/osd-backfill-space/datafile 2020-09-08T16:14:17.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:17.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:17.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:17.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj521 td/osd-backfill-space/datafile 2020-09-08T16:14:17.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:17.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj521 td/osd-backfill-space/datafile 2020-09-08T16:14:17.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:17.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj521 td/osd-backfill-space/datafile 2020-09-08T16:14:17.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:17.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj521 td/osd-backfill-space/datafile 2020-09-08T16:14:17.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:17.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj521 td/osd-backfill-space/datafile 2020-09-08T16:14:17.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:17.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj521 td/osd-backfill-space/datafile 2020-09-08T16:14:17.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:17.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj521 td/osd-backfill-space/datafile 2020-09-08T16:14:17.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:17.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj521 td/osd-backfill-space/datafile 2020-09-08T16:14:17.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:17.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:17.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:17.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj522 td/osd-backfill-space/datafile 2020-09-08T16:14:17.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:17.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj522 td/osd-backfill-space/datafile 2020-09-08T16:14:17.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:17.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj522 td/osd-backfill-space/datafile 2020-09-08T16:14:17.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:17.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj522 td/osd-backfill-space/datafile 2020-09-08T16:14:18.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:18.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj522 td/osd-backfill-space/datafile 2020-09-08T16:14:18.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:18.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj522 td/osd-backfill-space/datafile 2020-09-08T16:14:18.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:18.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj522 td/osd-backfill-space/datafile 2020-09-08T16:14:18.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:18.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj522 td/osd-backfill-space/datafile 2020-09-08T16:14:18.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:18.396 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:18.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:18.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj523 td/osd-backfill-space/datafile 2020-09-08T16:14:18.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:18.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj523 td/osd-backfill-space/datafile 2020-09-08T16:14:18.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:18.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj523 td/osd-backfill-space/datafile 2020-09-08T16:14:18.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:18.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj523 td/osd-backfill-space/datafile 2020-09-08T16:14:18.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:18.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj523 td/osd-backfill-space/datafile 2020-09-08T16:14:18.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:18.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj523 td/osd-backfill-space/datafile 2020-09-08T16:14:18.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:18.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj523 td/osd-backfill-space/datafile 2020-09-08T16:14:18.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:18.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj523 td/osd-backfill-space/datafile 2020-09-08T16:14:19.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:19.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:19.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:19.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj524 td/osd-backfill-space/datafile 2020-09-08T16:14:19.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:19.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj524 td/osd-backfill-space/datafile 2020-09-08T16:14:19.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:19.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj524 td/osd-backfill-space/datafile 2020-09-08T16:14:19.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:19.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj524 td/osd-backfill-space/datafile 2020-09-08T16:14:19.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:19.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj524 td/osd-backfill-space/datafile 2020-09-08T16:14:19.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:19.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj524 td/osd-backfill-space/datafile 2020-09-08T16:14:19.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:19.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj524 td/osd-backfill-space/datafile 2020-09-08T16:14:19.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:19.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj524 td/osd-backfill-space/datafile 2020-09-08T16:14:19.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:19.685 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:19.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:19.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj525 td/osd-backfill-space/datafile 2020-09-08T16:14:19.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:19.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj525 td/osd-backfill-space/datafile 2020-09-08T16:14:19.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:19.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj525 td/osd-backfill-space/datafile 2020-09-08T16:14:19.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:19.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj525 td/osd-backfill-space/datafile 2020-09-08T16:14:19.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:19.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj525 td/osd-backfill-space/datafile 2020-09-08T16:14:20.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:20.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj525 td/osd-backfill-space/datafile 2020-09-08T16:14:20.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:20.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj525 td/osd-backfill-space/datafile 2020-09-08T16:14:20.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:20.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj525 td/osd-backfill-space/datafile 2020-09-08T16:14:20.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:20.297 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:20.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:20.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj526 td/osd-backfill-space/datafile 2020-09-08T16:14:20.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:20.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj526 td/osd-backfill-space/datafile 2020-09-08T16:14:20.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:20.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj526 td/osd-backfill-space/datafile 2020-09-08T16:14:20.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:20.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj526 td/osd-backfill-space/datafile 2020-09-08T16:14:20.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:20.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj526 td/osd-backfill-space/datafile 2020-09-08T16:14:20.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:20.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj526 td/osd-backfill-space/datafile 2020-09-08T16:14:20.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:20.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj526 td/osd-backfill-space/datafile 2020-09-08T16:14:20.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:20.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj526 td/osd-backfill-space/datafile 2020-09-08T16:14:20.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:20.958 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:20.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:20.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj527 td/osd-backfill-space/datafile 2020-09-08T16:14:21.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:21.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj527 td/osd-backfill-space/datafile 2020-09-08T16:14:21.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:21.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj527 td/osd-backfill-space/datafile 2020-09-08T16:14:21.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:21.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj527 td/osd-backfill-space/datafile 2020-09-08T16:14:21.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:21.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj527 td/osd-backfill-space/datafile 2020-09-08T16:14:21.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:21.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj527 td/osd-backfill-space/datafile 2020-09-08T16:14:21.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:21.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj527 td/osd-backfill-space/datafile 2020-09-08T16:14:21.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:21.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj527 td/osd-backfill-space/datafile 2020-09-08T16:14:21.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:21.570 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:21.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:21.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj528 td/osd-backfill-space/datafile 2020-09-08T16:14:21.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:21.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj528 td/osd-backfill-space/datafile 2020-09-08T16:14:22.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:22.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj528 td/osd-backfill-space/datafile 2020-09-08T16:14:22.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:22.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj528 td/osd-backfill-space/datafile 2020-09-08T16:14:22.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:22.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj528 td/osd-backfill-space/datafile 2020-09-08T16:14:22.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:22.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj528 td/osd-backfill-space/datafile 2020-09-08T16:14:22.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:22.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj528 td/osd-backfill-space/datafile 2020-09-08T16:14:22.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:22.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj528 td/osd-backfill-space/datafile 2020-09-08T16:14:22.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:22.675 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:22.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:22.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj529 td/osd-backfill-space/datafile 2020-09-08T16:14:22.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:22.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj529 td/osd-backfill-space/datafile 2020-09-08T16:14:22.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:22.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj529 td/osd-backfill-space/datafile 2020-09-08T16:14:22.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:22.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj529 td/osd-backfill-space/datafile 2020-09-08T16:14:23.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:23.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj529 td/osd-backfill-space/datafile 2020-09-08T16:14:23.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:23.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj529 td/osd-backfill-space/datafile 2020-09-08T16:14:23.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:23.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj529 td/osd-backfill-space/datafile 2020-09-08T16:14:23.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:23.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj529 td/osd-backfill-space/datafile 2020-09-08T16:14:23.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:23.327 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:23.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:23.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj530 td/osd-backfill-space/datafile 2020-09-08T16:14:23.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:23.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj530 td/osd-backfill-space/datafile 2020-09-08T16:14:23.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:23.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj530 td/osd-backfill-space/datafile 2020-09-08T16:14:23.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:23.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj530 td/osd-backfill-space/datafile 2020-09-08T16:14:23.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:23.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj530 td/osd-backfill-space/datafile 2020-09-08T16:14:23.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:23.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj530 td/osd-backfill-space/datafile 2020-09-08T16:14:23.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:23.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj530 td/osd-backfill-space/datafile 2020-09-08T16:14:23.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:23.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj530 td/osd-backfill-space/datafile 2020-09-08T16:14:23.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:23.939 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:23.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:23.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj531 td/osd-backfill-space/datafile 2020-09-08T16:14:24.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:24.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj531 td/osd-backfill-space/datafile 2020-09-08T16:14:24.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:24.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj531 td/osd-backfill-space/datafile 2020-09-08T16:14:24.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:24.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj531 td/osd-backfill-space/datafile 2020-09-08T16:14:24.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:24.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj531 td/osd-backfill-space/datafile 2020-09-08T16:14:24.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:24.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj531 td/osd-backfill-space/datafile 2020-09-08T16:14:24.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:24.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj531 td/osd-backfill-space/datafile 2020-09-08T16:14:24.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:24.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj531 td/osd-backfill-space/datafile 2020-09-08T16:14:24.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:24.626 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:24.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:24.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj532 td/osd-backfill-space/datafile 2020-09-08T16:14:24.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:24.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj532 td/osd-backfill-space/datafile 2020-09-08T16:14:24.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:24.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj532 td/osd-backfill-space/datafile 2020-09-08T16:14:24.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:24.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj532 td/osd-backfill-space/datafile 2020-09-08T16:14:24.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:24.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj532 td/osd-backfill-space/datafile 2020-09-08T16:14:25.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:25.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj532 td/osd-backfill-space/datafile 2020-09-08T16:14:25.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:25.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj532 td/osd-backfill-space/datafile 2020-09-08T16:14:25.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:25.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj532 td/osd-backfill-space/datafile 2020-09-08T16:14:25.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:25.241 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:25.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:25.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj533 td/osd-backfill-space/datafile 2020-09-08T16:14:25.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:25.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj533 td/osd-backfill-space/datafile 2020-09-08T16:14:25.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:25.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj533 td/osd-backfill-space/datafile 2020-09-08T16:14:25.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:25.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj533 td/osd-backfill-space/datafile 2020-09-08T16:14:25.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:25.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj533 td/osd-backfill-space/datafile 2020-09-08T16:14:25.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:25.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj533 td/osd-backfill-space/datafile 2020-09-08T16:14:25.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:25.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj533 td/osd-backfill-space/datafile 2020-09-08T16:14:25.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:25.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj533 td/osd-backfill-space/datafile 2020-09-08T16:14:25.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:25.874 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:25.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:25.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj534 td/osd-backfill-space/datafile 2020-09-08T16:14:25.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:25.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj534 td/osd-backfill-space/datafile 2020-09-08T16:14:26.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:26.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj534 td/osd-backfill-space/datafile 2020-09-08T16:14:26.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:26.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj534 td/osd-backfill-space/datafile 2020-09-08T16:14:26.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:26.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj534 td/osd-backfill-space/datafile 2020-09-08T16:14:26.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:26.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj534 td/osd-backfill-space/datafile 2020-09-08T16:14:26.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:26.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj534 td/osd-backfill-space/datafile 2020-09-08T16:14:26.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:26.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj534 td/osd-backfill-space/datafile 2020-09-08T16:14:26.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:26.578 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:26.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:26.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj535 td/osd-backfill-space/datafile 2020-09-08T16:14:26.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:26.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj535 td/osd-backfill-space/datafile 2020-09-08T16:14:26.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:26.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj535 td/osd-backfill-space/datafile 2020-09-08T16:14:26.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:26.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj535 td/osd-backfill-space/datafile 2020-09-08T16:14:26.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:26.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj535 td/osd-backfill-space/datafile 2020-09-08T16:14:26.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:26.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj535 td/osd-backfill-space/datafile 2020-09-08T16:14:27.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:27.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj535 td/osd-backfill-space/datafile 2020-09-08T16:14:27.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:27.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj535 td/osd-backfill-space/datafile 2020-09-08T16:14:27.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:27.206 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:27.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:27.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj536 td/osd-backfill-space/datafile 2020-09-08T16:14:27.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:27.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj536 td/osd-backfill-space/datafile 2020-09-08T16:14:27.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:27.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj536 td/osd-backfill-space/datafile 2020-09-08T16:14:27.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:27.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj536 td/osd-backfill-space/datafile 2020-09-08T16:14:27.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:27.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj536 td/osd-backfill-space/datafile 2020-09-08T16:14:27.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:27.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj536 td/osd-backfill-space/datafile 2020-09-08T16:14:27.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:27.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj536 td/osd-backfill-space/datafile 2020-09-08T16:14:27.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:27.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj536 td/osd-backfill-space/datafile 2020-09-08T16:14:27.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:27.934 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:27.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:27.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj537 td/osd-backfill-space/datafile 2020-09-08T16:14:28.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:28.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj537 td/osd-backfill-space/datafile 2020-09-08T16:14:28.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:28.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj537 td/osd-backfill-space/datafile 2020-09-08T16:14:28.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:28.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj537 td/osd-backfill-space/datafile 2020-09-08T16:14:28.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:28.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj537 td/osd-backfill-space/datafile 2020-09-08T16:14:28.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:28.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj537 td/osd-backfill-space/datafile 2020-09-08T16:14:28.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:28.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj537 td/osd-backfill-space/datafile 2020-09-08T16:14:28.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:28.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj537 td/osd-backfill-space/datafile 2020-09-08T16:14:28.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:28.654 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:28.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:28.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj538 td/osd-backfill-space/datafile 2020-09-08T16:14:28.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:28.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj538 td/osd-backfill-space/datafile 2020-09-08T16:14:28.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:28.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj538 td/osd-backfill-space/datafile 2020-09-08T16:14:28.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:28.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj538 td/osd-backfill-space/datafile 2020-09-08T16:14:28.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:28.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj538 td/osd-backfill-space/datafile 2020-09-08T16:14:29.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:29.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj538 td/osd-backfill-space/datafile 2020-09-08T16:14:29.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:29.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj538 td/osd-backfill-space/datafile 2020-09-08T16:14:29.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:29.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj538 td/osd-backfill-space/datafile 2020-09-08T16:14:29.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:29.274 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:29.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:29.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj539 td/osd-backfill-space/datafile 2020-09-08T16:14:29.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:29.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj539 td/osd-backfill-space/datafile 2020-09-08T16:14:29.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:29.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj539 td/osd-backfill-space/datafile 2020-09-08T16:14:29.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:29.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj539 td/osd-backfill-space/datafile 2020-09-08T16:14:29.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:29.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj539 td/osd-backfill-space/datafile 2020-09-08T16:14:29.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:29.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj539 td/osd-backfill-space/datafile 2020-09-08T16:14:29.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:29.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj539 td/osd-backfill-space/datafile 2020-09-08T16:14:29.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:29.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj539 td/osd-backfill-space/datafile 2020-09-08T16:14:29.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:29.927 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:29.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:29.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj540 td/osd-backfill-space/datafile 2020-09-08T16:14:30.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:30.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj540 td/osd-backfill-space/datafile 2020-09-08T16:14:30.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:30.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj540 td/osd-backfill-space/datafile 2020-09-08T16:14:30.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:30.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj540 td/osd-backfill-space/datafile 2020-09-08T16:14:30.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:30.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj540 td/osd-backfill-space/datafile 2020-09-08T16:14:30.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:30.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj540 td/osd-backfill-space/datafile 2020-09-08T16:14:30.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:30.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj540 td/osd-backfill-space/datafile 2020-09-08T16:14:30.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:30.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj540 td/osd-backfill-space/datafile 2020-09-08T16:14:30.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:30.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:30.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:30.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj541 td/osd-backfill-space/datafile 2020-09-08T16:14:30.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:30.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj541 td/osd-backfill-space/datafile 2020-09-08T16:14:30.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:30.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj541 td/osd-backfill-space/datafile 2020-09-08T16:14:30.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:30.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj541 td/osd-backfill-space/datafile 2020-09-08T16:14:30.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:30.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj541 td/osd-backfill-space/datafile 2020-09-08T16:14:31.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:31.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj541 td/osd-backfill-space/datafile 2020-09-08T16:14:31.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:31.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj541 td/osd-backfill-space/datafile 2020-09-08T16:14:31.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:31.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj541 td/osd-backfill-space/datafile 2020-09-08T16:14:31.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:31.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:31.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:31.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj542 td/osd-backfill-space/datafile 2020-09-08T16:14:31.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:31.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj542 td/osd-backfill-space/datafile 2020-09-08T16:14:31.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:31.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj542 td/osd-backfill-space/datafile 2020-09-08T16:14:31.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:31.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj542 td/osd-backfill-space/datafile 2020-09-08T16:14:31.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:31.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj542 td/osd-backfill-space/datafile 2020-09-08T16:14:31.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:31.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj542 td/osd-backfill-space/datafile 2020-09-08T16:14:31.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:31.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj542 td/osd-backfill-space/datafile 2020-09-08T16:14:31.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:31.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj542 td/osd-backfill-space/datafile 2020-09-08T16:14:31.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:31.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:31.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:31.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj543 td/osd-backfill-space/datafile 2020-09-08T16:14:31.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:31.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj543 td/osd-backfill-space/datafile 2020-09-08T16:14:32.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:32.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj543 td/osd-backfill-space/datafile 2020-09-08T16:14:32.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:32.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj543 td/osd-backfill-space/datafile 2020-09-08T16:14:32.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:32.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj543 td/osd-backfill-space/datafile 2020-09-08T16:14:32.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:32.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj543 td/osd-backfill-space/datafile 2020-09-08T16:14:32.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:32.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj543 td/osd-backfill-space/datafile 2020-09-08T16:14:32.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:32.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj543 td/osd-backfill-space/datafile 2020-09-08T16:14:32.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:32.675 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:32.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:32.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj544 td/osd-backfill-space/datafile 2020-09-08T16:14:32.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:32.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj544 td/osd-backfill-space/datafile 2020-09-08T16:14:32.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:32.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj544 td/osd-backfill-space/datafile 2020-09-08T16:14:32.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:32.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj544 td/osd-backfill-space/datafile 2020-09-08T16:14:32.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:32.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj544 td/osd-backfill-space/datafile 2020-09-08T16:14:33.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:33.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj544 td/osd-backfill-space/datafile 2020-09-08T16:14:33.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:33.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj544 td/osd-backfill-space/datafile 2020-09-08T16:14:33.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:33.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj544 td/osd-backfill-space/datafile 2020-09-08T16:14:33.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:33.284 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:33.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:33.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj545 td/osd-backfill-space/datafile 2020-09-08T16:14:33.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:33.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj545 td/osd-backfill-space/datafile 2020-09-08T16:14:33.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:33.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj545 td/osd-backfill-space/datafile 2020-09-08T16:14:33.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:33.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj545 td/osd-backfill-space/datafile 2020-09-08T16:14:33.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:33.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj545 td/osd-backfill-space/datafile 2020-09-08T16:14:33.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:33.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj545 td/osd-backfill-space/datafile 2020-09-08T16:14:33.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:33.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj545 td/osd-backfill-space/datafile 2020-09-08T16:14:33.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:33.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj545 td/osd-backfill-space/datafile 2020-09-08T16:14:33.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:33.920 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:33.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:33.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj546 td/osd-backfill-space/datafile 2020-09-08T16:14:33.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:33.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj546 td/osd-backfill-space/datafile 2020-09-08T16:14:34.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:34.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj546 td/osd-backfill-space/datafile 2020-09-08T16:14:34.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:34.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj546 td/osd-backfill-space/datafile 2020-09-08T16:14:34.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:34.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj546 td/osd-backfill-space/datafile 2020-09-08T16:14:34.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:34.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj546 td/osd-backfill-space/datafile 2020-09-08T16:14:34.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:34.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj546 td/osd-backfill-space/datafile 2020-09-08T16:14:34.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:34.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj546 td/osd-backfill-space/datafile 2020-09-08T16:14:34.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:34.607 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:34.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:34.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj547 td/osd-backfill-space/datafile 2020-09-08T16:14:34.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:34.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj547 td/osd-backfill-space/datafile 2020-09-08T16:14:34.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:34.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj547 td/osd-backfill-space/datafile 2020-09-08T16:14:34.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:34.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj547 td/osd-backfill-space/datafile 2020-09-08T16:14:34.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:34.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj547 td/osd-backfill-space/datafile 2020-09-08T16:14:35.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:35.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj547 td/osd-backfill-space/datafile 2020-09-08T16:14:35.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:35.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj547 td/osd-backfill-space/datafile 2020-09-08T16:14:35.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:35.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj547 td/osd-backfill-space/datafile 2020-09-08T16:14:35.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:35.252 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:35.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:35.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj548 td/osd-backfill-space/datafile 2020-09-08T16:14:35.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:35.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj548 td/osd-backfill-space/datafile 2020-09-08T16:14:35.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:35.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj548 td/osd-backfill-space/datafile 2020-09-08T16:14:35.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:35.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj548 td/osd-backfill-space/datafile 2020-09-08T16:14:35.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:35.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj548 td/osd-backfill-space/datafile 2020-09-08T16:14:35.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:35.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj548 td/osd-backfill-space/datafile 2020-09-08T16:14:35.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:35.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj548 td/osd-backfill-space/datafile 2020-09-08T16:14:35.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:35.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj548 td/osd-backfill-space/datafile 2020-09-08T16:14:35.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:35.872 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:35.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:35.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj549 td/osd-backfill-space/datafile 2020-09-08T16:14:35.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:35.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj549 td/osd-backfill-space/datafile 2020-09-08T16:14:36.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:36.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj549 td/osd-backfill-space/datafile 2020-09-08T16:14:36.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:36.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj549 td/osd-backfill-space/datafile 2020-09-08T16:14:36.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:36.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj549 td/osd-backfill-space/datafile 2020-09-08T16:14:36.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:36.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj549 td/osd-backfill-space/datafile 2020-09-08T16:14:36.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:36.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj549 td/osd-backfill-space/datafile 2020-09-08T16:14:36.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:36.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj549 td/osd-backfill-space/datafile 2020-09-08T16:14:36.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:36.567 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:36.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:36.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj550 td/osd-backfill-space/datafile 2020-09-08T16:14:36.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:36.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj550 td/osd-backfill-space/datafile 2020-09-08T16:14:36.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:36.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj550 td/osd-backfill-space/datafile 2020-09-08T16:14:36.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:36.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj550 td/osd-backfill-space/datafile 2020-09-08T16:14:36.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:36.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj550 td/osd-backfill-space/datafile 2020-09-08T16:14:36.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:36.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj550 td/osd-backfill-space/datafile 2020-09-08T16:14:37.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:37.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj550 td/osd-backfill-space/datafile 2020-09-08T16:14:37.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:37.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj550 td/osd-backfill-space/datafile 2020-09-08T16:14:37.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:37.220 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:37.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:37.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj551 td/osd-backfill-space/datafile 2020-09-08T16:14:37.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:37.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj551 td/osd-backfill-space/datafile 2020-09-08T16:14:37.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:37.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj551 td/osd-backfill-space/datafile 2020-09-08T16:14:37.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:37.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj551 td/osd-backfill-space/datafile 2020-09-08T16:14:37.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:37.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj551 td/osd-backfill-space/datafile 2020-09-08T16:14:37.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:37.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj551 td/osd-backfill-space/datafile 2020-09-08T16:14:37.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:37.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj551 td/osd-backfill-space/datafile 2020-09-08T16:14:37.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:37.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj551 td/osd-backfill-space/datafile 2020-09-08T16:14:37.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:37.865 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:37.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:37.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj552 td/osd-backfill-space/datafile 2020-09-08T16:14:37.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:37.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj552 td/osd-backfill-space/datafile 2020-09-08T16:14:38.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:38.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj552 td/osd-backfill-space/datafile 2020-09-08T16:14:38.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:38.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj552 td/osd-backfill-space/datafile 2020-09-08T16:14:38.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:38.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj552 td/osd-backfill-space/datafile 2020-09-08T16:14:38.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:38.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj552 td/osd-backfill-space/datafile 2020-09-08T16:14:38.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:38.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj552 td/osd-backfill-space/datafile 2020-09-08T16:14:38.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:38.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj552 td/osd-backfill-space/datafile 2020-09-08T16:14:38.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:38.575 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:38.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:38.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj553 td/osd-backfill-space/datafile 2020-09-08T16:14:38.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:38.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj553 td/osd-backfill-space/datafile 2020-09-08T16:14:38.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:38.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj553 td/osd-backfill-space/datafile 2020-09-08T16:14:38.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:38.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj553 td/osd-backfill-space/datafile 2020-09-08T16:14:38.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:38.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj553 td/osd-backfill-space/datafile 2020-09-08T16:14:38.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:38.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj553 td/osd-backfill-space/datafile 2020-09-08T16:14:39.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:39.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj553 td/osd-backfill-space/datafile 2020-09-08T16:14:39.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:39.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj553 td/osd-backfill-space/datafile 2020-09-08T16:14:39.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:39.180 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:39.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:39.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj554 td/osd-backfill-space/datafile 2020-09-08T16:14:39.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:39.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj554 td/osd-backfill-space/datafile 2020-09-08T16:14:39.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:39.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj554 td/osd-backfill-space/datafile 2020-09-08T16:14:39.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:39.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj554 td/osd-backfill-space/datafile 2020-09-08T16:14:39.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:39.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj554 td/osd-backfill-space/datafile 2020-09-08T16:14:39.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:39.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj554 td/osd-backfill-space/datafile 2020-09-08T16:14:39.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:39.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj554 td/osd-backfill-space/datafile 2020-09-08T16:14:39.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:39.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj554 td/osd-backfill-space/datafile 2020-09-08T16:14:39.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:39.816 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:39.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:39.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj555 td/osd-backfill-space/datafile 2020-09-08T16:14:39.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:39.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj555 td/osd-backfill-space/datafile 2020-09-08T16:14:39.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:39.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj555 td/osd-backfill-space/datafile 2020-09-08T16:14:40.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:40.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj555 td/osd-backfill-space/datafile 2020-09-08T16:14:40.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:40.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj555 td/osd-backfill-space/datafile 2020-09-08T16:14:40.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:40.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj555 td/osd-backfill-space/datafile 2020-09-08T16:14:40.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:40.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj555 td/osd-backfill-space/datafile 2020-09-08T16:14:40.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:40.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj555 td/osd-backfill-space/datafile 2020-09-08T16:14:40.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:40.461 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:40.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:40.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj556 td/osd-backfill-space/datafile 2020-09-08T16:14:40.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:40.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj556 td/osd-backfill-space/datafile 2020-09-08T16:14:40.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:40.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj556 td/osd-backfill-space/datafile 2020-09-08T16:14:40.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:40.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj556 td/osd-backfill-space/datafile 2020-09-08T16:14:40.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:40.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj556 td/osd-backfill-space/datafile 2020-09-08T16:14:40.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:40.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj556 td/osd-backfill-space/datafile 2020-09-08T16:14:40.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:40.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj556 td/osd-backfill-space/datafile 2020-09-08T16:14:41.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:41.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj556 td/osd-backfill-space/datafile 2020-09-08T16:14:41.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:41.107 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:41.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:41.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj557 td/osd-backfill-space/datafile 2020-09-08T16:14:41.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:41.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj557 td/osd-backfill-space/datafile 2020-09-08T16:14:41.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:41.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj557 td/osd-backfill-space/datafile 2020-09-08T16:14:41.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:41.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj557 td/osd-backfill-space/datafile 2020-09-08T16:14:41.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:41.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj557 td/osd-backfill-space/datafile 2020-09-08T16:14:41.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:41.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj557 td/osd-backfill-space/datafile 2020-09-08T16:14:41.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:41.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj557 td/osd-backfill-space/datafile 2020-09-08T16:14:41.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:41.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj557 td/osd-backfill-space/datafile 2020-09-08T16:14:41.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:41.734 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:41.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:41.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj558 td/osd-backfill-space/datafile 2020-09-08T16:14:41.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:41.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj558 td/osd-backfill-space/datafile 2020-09-08T16:14:41.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:41.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj558 td/osd-backfill-space/datafile 2020-09-08T16:14:41.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:41.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj558 td/osd-backfill-space/datafile 2020-09-08T16:14:42.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:42.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj558 td/osd-backfill-space/datafile 2020-09-08T16:14:42.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:42.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj558 td/osd-backfill-space/datafile 2020-09-08T16:14:42.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:42.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj558 td/osd-backfill-space/datafile 2020-09-08T16:14:42.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:42.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj558 td/osd-backfill-space/datafile 2020-09-08T16:14:42.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:42.411 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:42.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:42.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj559 td/osd-backfill-space/datafile 2020-09-08T16:14:42.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:42.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj559 td/osd-backfill-space/datafile 2020-09-08T16:14:42.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:42.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj559 td/osd-backfill-space/datafile 2020-09-08T16:14:42.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:42.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj559 td/osd-backfill-space/datafile 2020-09-08T16:14:42.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:42.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj559 td/osd-backfill-space/datafile 2020-09-08T16:14:42.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:42.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj559 td/osd-backfill-space/datafile 2020-09-08T16:14:42.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:42.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj559 td/osd-backfill-space/datafile 2020-09-08T16:14:43.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:43.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj559 td/osd-backfill-space/datafile 2020-09-08T16:14:43.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:43.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:43.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:43.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj560 td/osd-backfill-space/datafile 2020-09-08T16:14:43.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:43.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj560 td/osd-backfill-space/datafile 2020-09-08T16:14:43.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:43.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj560 td/osd-backfill-space/datafile 2020-09-08T16:14:43.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:43.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj560 td/osd-backfill-space/datafile 2020-09-08T16:14:43.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:43.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj560 td/osd-backfill-space/datafile 2020-09-08T16:14:43.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:43.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj560 td/osd-backfill-space/datafile 2020-09-08T16:14:43.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:43.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj560 td/osd-backfill-space/datafile 2020-09-08T16:14:43.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:43.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj560 td/osd-backfill-space/datafile 2020-09-08T16:14:43.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:43.803 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:43.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:43.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj561 td/osd-backfill-space/datafile 2020-09-08T16:14:43.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:43.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj561 td/osd-backfill-space/datafile 2020-09-08T16:14:43.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:43.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj561 td/osd-backfill-space/datafile 2020-09-08T16:14:44.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:44.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj561 td/osd-backfill-space/datafile 2020-09-08T16:14:44.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:44.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj561 td/osd-backfill-space/datafile 2020-09-08T16:14:44.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:44.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj561 td/osd-backfill-space/datafile 2020-09-08T16:14:44.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:44.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj561 td/osd-backfill-space/datafile 2020-09-08T16:14:44.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:44.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj561 td/osd-backfill-space/datafile 2020-09-08T16:14:44.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:44.467 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:44.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:44.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj562 td/osd-backfill-space/datafile 2020-09-08T16:14:44.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:44.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj562 td/osd-backfill-space/datafile 2020-09-08T16:14:44.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:44.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj562 td/osd-backfill-space/datafile 2020-09-08T16:14:44.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:44.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj562 td/osd-backfill-space/datafile 2020-09-08T16:14:44.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:44.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj562 td/osd-backfill-space/datafile 2020-09-08T16:14:44.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:44.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj562 td/osd-backfill-space/datafile 2020-09-08T16:14:44.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:44.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj562 td/osd-backfill-space/datafile 2020-09-08T16:14:45.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:45.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj562 td/osd-backfill-space/datafile 2020-09-08T16:14:45.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:45.120 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:45.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:45.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj563 td/osd-backfill-space/datafile 2020-09-08T16:14:45.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:45.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj563 td/osd-backfill-space/datafile 2020-09-08T16:14:45.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:45.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj563 td/osd-backfill-space/datafile 2020-09-08T16:14:45.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:45.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj563 td/osd-backfill-space/datafile 2020-09-08T16:14:45.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:45.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj563 td/osd-backfill-space/datafile 2020-09-08T16:14:45.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:45.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj563 td/osd-backfill-space/datafile 2020-09-08T16:14:45.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:45.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj563 td/osd-backfill-space/datafile 2020-09-08T16:14:45.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:45.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj563 td/osd-backfill-space/datafile 2020-09-08T16:14:45.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:45.731 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:45.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:45.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj564 td/osd-backfill-space/datafile 2020-09-08T16:14:45.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:45.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj564 td/osd-backfill-space/datafile 2020-09-08T16:14:45.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:45.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj564 td/osd-backfill-space/datafile 2020-09-08T16:14:45.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:45.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj564 td/osd-backfill-space/datafile 2020-09-08T16:14:46.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:46.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj564 td/osd-backfill-space/datafile 2020-09-08T16:14:46.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:46.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj564 td/osd-backfill-space/datafile 2020-09-08T16:14:46.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:46.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj564 td/osd-backfill-space/datafile 2020-09-08T16:14:46.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:46.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj564 td/osd-backfill-space/datafile 2020-09-08T16:14:46.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:46.402 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:46.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:46.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj565 td/osd-backfill-space/datafile 2020-09-08T16:14:46.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:46.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj565 td/osd-backfill-space/datafile 2020-09-08T16:14:46.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:46.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj565 td/osd-backfill-space/datafile 2020-09-08T16:14:46.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:46.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj565 td/osd-backfill-space/datafile 2020-09-08T16:14:46.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:46.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj565 td/osd-backfill-space/datafile 2020-09-08T16:14:46.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:46.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj565 td/osd-backfill-space/datafile 2020-09-08T16:14:46.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:46.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj565 td/osd-backfill-space/datafile 2020-09-08T16:14:46.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:46.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj565 td/osd-backfill-space/datafile 2020-09-08T16:14:47.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:47.046 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:47.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:47.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj566 td/osd-backfill-space/datafile 2020-09-08T16:14:47.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:47.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj566 td/osd-backfill-space/datafile 2020-09-08T16:14:47.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:47.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj566 td/osd-backfill-space/datafile 2020-09-08T16:14:47.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:47.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj566 td/osd-backfill-space/datafile 2020-09-08T16:14:47.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:47.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj566 td/osd-backfill-space/datafile 2020-09-08T16:14:47.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:47.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj566 td/osd-backfill-space/datafile 2020-09-08T16:14:47.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:47.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj566 td/osd-backfill-space/datafile 2020-09-08T16:14:47.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:47.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj566 td/osd-backfill-space/datafile 2020-09-08T16:14:47.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:47.725 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:47.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:47.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj567 td/osd-backfill-space/datafile 2020-09-08T16:14:47.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:47.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj567 td/osd-backfill-space/datafile 2020-09-08T16:14:47.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:47.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj567 td/osd-backfill-space/datafile 2020-09-08T16:14:48.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:48.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj567 td/osd-backfill-space/datafile 2020-09-08T16:14:48.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:48.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj567 td/osd-backfill-space/datafile 2020-09-08T16:14:48.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:48.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj567 td/osd-backfill-space/datafile 2020-09-08T16:14:48.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:48.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj567 td/osd-backfill-space/datafile 2020-09-08T16:14:48.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:48.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj567 td/osd-backfill-space/datafile 2020-09-08T16:14:48.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:48.444 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:48.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:48.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj568 td/osd-backfill-space/datafile 2020-09-08T16:14:48.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:48.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj568 td/osd-backfill-space/datafile 2020-09-08T16:14:48.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:48.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj568 td/osd-backfill-space/datafile 2020-09-08T16:14:48.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:48.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj568 td/osd-backfill-space/datafile 2020-09-08T16:14:48.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:48.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj568 td/osd-backfill-space/datafile 2020-09-08T16:14:48.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:48.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj568 td/osd-backfill-space/datafile 2020-09-08T16:14:48.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:48.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj568 td/osd-backfill-space/datafile 2020-09-08T16:14:49.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:49.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj568 td/osd-backfill-space/datafile 2020-09-08T16:14:49.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:49.097 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:49.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:49.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj569 td/osd-backfill-space/datafile 2020-09-08T16:14:49.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:49.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj569 td/osd-backfill-space/datafile 2020-09-08T16:14:49.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:49.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj569 td/osd-backfill-space/datafile 2020-09-08T16:14:49.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:49.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj569 td/osd-backfill-space/datafile 2020-09-08T16:14:49.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:49.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj569 td/osd-backfill-space/datafile 2020-09-08T16:14:49.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:49.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj569 td/osd-backfill-space/datafile 2020-09-08T16:14:49.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:49.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj569 td/osd-backfill-space/datafile 2020-09-08T16:14:49.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:49.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj569 td/osd-backfill-space/datafile 2020-09-08T16:14:49.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:49.767 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:49.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:49.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj570 td/osd-backfill-space/datafile 2020-09-08T16:14:49.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:49.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj570 td/osd-backfill-space/datafile 2020-09-08T16:14:49.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:49.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj570 td/osd-backfill-space/datafile 2020-09-08T16:14:49.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:49.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj570 td/osd-backfill-space/datafile 2020-09-08T16:14:50.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:50.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj570 td/osd-backfill-space/datafile 2020-09-08T16:14:50.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:50.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj570 td/osd-backfill-space/datafile 2020-09-08T16:14:50.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:50.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj570 td/osd-backfill-space/datafile 2020-09-08T16:14:50.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:50.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj570 td/osd-backfill-space/datafile 2020-09-08T16:14:50.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:50.395 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:50.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:50.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj571 td/osd-backfill-space/datafile 2020-09-08T16:14:50.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:50.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj571 td/osd-backfill-space/datafile 2020-09-08T16:14:50.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:50.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj571 td/osd-backfill-space/datafile 2020-09-08T16:14:50.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:50.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj571 td/osd-backfill-space/datafile 2020-09-08T16:14:50.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:50.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj571 td/osd-backfill-space/datafile 2020-09-08T16:14:50.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:50.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj571 td/osd-backfill-space/datafile 2020-09-08T16:14:50.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:50.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj571 td/osd-backfill-space/datafile 2020-09-08T16:14:50.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:50.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj571 td/osd-backfill-space/datafile 2020-09-08T16:14:51.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:51.048 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:51.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:51.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj572 td/osd-backfill-space/datafile 2020-09-08T16:14:51.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:51.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj572 td/osd-backfill-space/datafile 2020-09-08T16:14:51.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:51.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj572 td/osd-backfill-space/datafile 2020-09-08T16:14:51.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:51.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj572 td/osd-backfill-space/datafile 2020-09-08T16:14:51.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:51.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj572 td/osd-backfill-space/datafile 2020-09-08T16:14:51.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:51.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj572 td/osd-backfill-space/datafile 2020-09-08T16:14:51.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:51.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj572 td/osd-backfill-space/datafile 2020-09-08T16:14:51.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:51.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj572 td/osd-backfill-space/datafile 2020-09-08T16:14:51.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:51.685 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:51.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:51.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj573 td/osd-backfill-space/datafile 2020-09-08T16:14:51.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:51.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj573 td/osd-backfill-space/datafile 2020-09-08T16:14:51.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:51.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj573 td/osd-backfill-space/datafile 2020-09-08T16:14:51.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:51.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj573 td/osd-backfill-space/datafile 2020-09-08T16:14:51.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:51.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj573 td/osd-backfill-space/datafile 2020-09-08T16:14:52.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:52.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj573 td/osd-backfill-space/datafile 2020-09-08T16:14:52.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:52.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj573 td/osd-backfill-space/datafile 2020-09-08T16:14:52.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:52.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj573 td/osd-backfill-space/datafile 2020-09-08T16:14:52.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:52.389 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:52.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:52.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj574 td/osd-backfill-space/datafile 2020-09-08T16:14:52.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:52.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj574 td/osd-backfill-space/datafile 2020-09-08T16:14:52.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:52.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj574 td/osd-backfill-space/datafile 2020-09-08T16:14:52.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:52.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj574 td/osd-backfill-space/datafile 2020-09-08T16:14:52.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:52.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj574 td/osd-backfill-space/datafile 2020-09-08T16:14:52.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:52.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj574 td/osd-backfill-space/datafile 2020-09-08T16:14:52.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:52.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj574 td/osd-backfill-space/datafile 2020-09-08T16:14:53.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:53.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj574 td/osd-backfill-space/datafile 2020-09-08T16:14:53.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:53.359 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:53.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:53.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj575 td/osd-backfill-space/datafile 2020-09-08T16:14:53.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:53.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj575 td/osd-backfill-space/datafile 2020-09-08T16:14:53.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:53.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj575 td/osd-backfill-space/datafile 2020-09-08T16:14:53.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:53.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj575 td/osd-backfill-space/datafile 2020-09-08T16:14:53.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:53.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj575 td/osd-backfill-space/datafile 2020-09-08T16:14:53.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:53.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj575 td/osd-backfill-space/datafile 2020-09-08T16:14:53.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:53.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj575 td/osd-backfill-space/datafile 2020-09-08T16:14:53.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:53.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj575 td/osd-backfill-space/datafile 2020-09-08T16:14:54.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:54.012 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:54.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:54.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj576 td/osd-backfill-space/datafile 2020-09-08T16:14:54.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:54.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj576 td/osd-backfill-space/datafile 2020-09-08T16:14:54.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:54.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj576 td/osd-backfill-space/datafile 2020-09-08T16:14:54.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:54.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj576 td/osd-backfill-space/datafile 2020-09-08T16:14:54.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:54.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj576 td/osd-backfill-space/datafile 2020-09-08T16:14:54.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:54.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj576 td/osd-backfill-space/datafile 2020-09-08T16:14:54.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:54.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj576 td/osd-backfill-space/datafile 2020-09-08T16:14:54.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:54.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj576 td/osd-backfill-space/datafile 2020-09-08T16:14:54.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:54.673 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:54.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:54.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj577 td/osd-backfill-space/datafile 2020-09-08T16:14:54.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:54.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj577 td/osd-backfill-space/datafile 2020-09-08T16:14:54.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:54.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj577 td/osd-backfill-space/datafile 2020-09-08T16:14:54.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:54.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj577 td/osd-backfill-space/datafile 2020-09-08T16:14:54.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:54.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj577 td/osd-backfill-space/datafile 2020-09-08T16:14:55.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:55.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj577 td/osd-backfill-space/datafile 2020-09-08T16:14:55.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:55.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj577 td/osd-backfill-space/datafile 2020-09-08T16:14:55.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:55.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj577 td/osd-backfill-space/datafile 2020-09-08T16:14:55.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:55.285 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:55.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:55.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj578 td/osd-backfill-space/datafile 2020-09-08T16:14:55.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:55.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj578 td/osd-backfill-space/datafile 2020-09-08T16:14:55.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:55.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj578 td/osd-backfill-space/datafile 2020-09-08T16:14:55.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:55.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj578 td/osd-backfill-space/datafile 2020-09-08T16:14:55.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:55.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj578 td/osd-backfill-space/datafile 2020-09-08T16:14:55.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:55.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj578 td/osd-backfill-space/datafile 2020-09-08T16:14:55.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:55.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj578 td/osd-backfill-space/datafile 2020-09-08T16:14:55.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:55.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj578 td/osd-backfill-space/datafile 2020-09-08T16:14:55.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:55.946 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:55.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:55.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj579 td/osd-backfill-space/datafile 2020-09-08T16:14:56.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:56.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj579 td/osd-backfill-space/datafile 2020-09-08T16:14:56.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:56.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj579 td/osd-backfill-space/datafile 2020-09-08T16:14:56.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:56.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj579 td/osd-backfill-space/datafile 2020-09-08T16:14:56.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:56.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj579 td/osd-backfill-space/datafile 2020-09-08T16:14:56.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:56.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj579 td/osd-backfill-space/datafile 2020-09-08T16:14:56.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:56.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj579 td/osd-backfill-space/datafile 2020-09-08T16:14:56.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:56.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj579 td/osd-backfill-space/datafile 2020-09-08T16:14:56.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:56.624 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:56.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:56.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj580 td/osd-backfill-space/datafile 2020-09-08T16:14:56.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:56.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj580 td/osd-backfill-space/datafile 2020-09-08T16:14:56.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:56.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj580 td/osd-backfill-space/datafile 2020-09-08T16:14:56.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:56.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj580 td/osd-backfill-space/datafile 2020-09-08T16:14:56.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:56.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj580 td/osd-backfill-space/datafile 2020-09-08T16:14:57.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:57.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj580 td/osd-backfill-space/datafile 2020-09-08T16:14:57.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:57.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj580 td/osd-backfill-space/datafile 2020-09-08T16:14:57.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:57.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj580 td/osd-backfill-space/datafile 2020-09-08T16:14:57.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:57.227 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:57.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:57.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj581 td/osd-backfill-space/datafile 2020-09-08T16:14:57.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:57.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj581 td/osd-backfill-space/datafile 2020-09-08T16:14:57.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:57.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj581 td/osd-backfill-space/datafile 2020-09-08T16:14:57.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:57.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj581 td/osd-backfill-space/datafile 2020-09-08T16:14:57.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:57.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj581 td/osd-backfill-space/datafile 2020-09-08T16:14:57.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:57.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj581 td/osd-backfill-space/datafile 2020-09-08T16:14:57.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:57.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj581 td/osd-backfill-space/datafile 2020-09-08T16:14:57.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:57.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj581 td/osd-backfill-space/datafile 2020-09-08T16:14:57.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:57.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:57.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:57.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj582 td/osd-backfill-space/datafile 2020-09-08T16:14:57.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:57.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj582 td/osd-backfill-space/datafile 2020-09-08T16:14:58.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:58.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj582 td/osd-backfill-space/datafile 2020-09-08T16:14:58.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:58.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj582 td/osd-backfill-space/datafile 2020-09-08T16:14:58.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:58.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj582 td/osd-backfill-space/datafile 2020-09-08T16:14:58.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:58.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj582 td/osd-backfill-space/datafile 2020-09-08T16:14:58.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:58.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj582 td/osd-backfill-space/datafile 2020-09-08T16:14:58.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:58.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj582 td/osd-backfill-space/datafile 2020-09-08T16:14:58.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:58.702 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:58.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:58.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj583 td/osd-backfill-space/datafile 2020-09-08T16:14:58.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:58.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj583 td/osd-backfill-space/datafile 2020-09-08T16:14:58.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:58.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj583 td/osd-backfill-space/datafile 2020-09-08T16:14:58.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:58.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj583 td/osd-backfill-space/datafile 2020-09-08T16:14:59.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:59.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj583 td/osd-backfill-space/datafile 2020-09-08T16:14:59.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:59.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj583 td/osd-backfill-space/datafile 2020-09-08T16:14:59.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:59.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj583 td/osd-backfill-space/datafile 2020-09-08T16:14:59.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:59.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj583 td/osd-backfill-space/datafile 2020-09-08T16:14:59.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:59.313 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:59.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:59.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj584 td/osd-backfill-space/datafile 2020-09-08T16:14:59.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:59.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj584 td/osd-backfill-space/datafile 2020-09-08T16:14:59.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:59.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj584 td/osd-backfill-space/datafile 2020-09-08T16:14:59.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:59.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj584 td/osd-backfill-space/datafile 2020-09-08T16:14:59.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:59.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj584 td/osd-backfill-space/datafile 2020-09-08T16:14:59.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:59.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj584 td/osd-backfill-space/datafile 2020-09-08T16:14:59.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:59.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj584 td/osd-backfill-space/datafile 2020-09-08T16:14:59.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:59.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj584 td/osd-backfill-space/datafile 2020-09-08T16:14:59.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:14:59.923 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:14:59.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:14:59.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj585 td/osd-backfill-space/datafile 2020-09-08T16:15:00.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:00.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj585 td/osd-backfill-space/datafile 2020-09-08T16:15:00.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:00.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj585 td/osd-backfill-space/datafile 2020-09-08T16:15:00.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:00.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj585 td/osd-backfill-space/datafile 2020-09-08T16:15:00.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:00.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj585 td/osd-backfill-space/datafile 2020-09-08T16:15:00.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:00.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj585 td/osd-backfill-space/datafile 2020-09-08T16:15:00.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:00.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj585 td/osd-backfill-space/datafile 2020-09-08T16:15:00.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:00.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj585 td/osd-backfill-space/datafile 2020-09-08T16:15:00.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:15:00.577 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:15:00.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:00.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj586 td/osd-backfill-space/datafile 2020-09-08T16:15:00.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:00.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj586 td/osd-backfill-space/datafile 2020-09-08T16:15:00.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:00.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj586 td/osd-backfill-space/datafile 2020-09-08T16:15:00.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:00.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj586 td/osd-backfill-space/datafile 2020-09-08T16:15:00.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:00.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj586 td/osd-backfill-space/datafile 2020-09-08T16:15:00.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:00.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj586 td/osd-backfill-space/datafile 2020-09-08T16:15:01.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:01.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj586 td/osd-backfill-space/datafile 2020-09-08T16:15:01.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:01.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj586 td/osd-backfill-space/datafile 2020-09-08T16:15:01.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:15:01.196 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:15:01.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:01.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj587 td/osd-backfill-space/datafile 2020-09-08T16:15:01.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:01.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj587 td/osd-backfill-space/datafile 2020-09-08T16:15:01.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:01.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj587 td/osd-backfill-space/datafile 2020-09-08T16:15:01.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:01.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj587 td/osd-backfill-space/datafile 2020-09-08T16:15:01.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:01.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj587 td/osd-backfill-space/datafile 2020-09-08T16:15:01.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:01.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj587 td/osd-backfill-space/datafile 2020-09-08T16:15:01.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:01.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj587 td/osd-backfill-space/datafile 2020-09-08T16:15:01.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:01.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj587 td/osd-backfill-space/datafile 2020-09-08T16:15:01.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:15:01.833 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:15:01.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:01.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj588 td/osd-backfill-space/datafile 2020-09-08T16:15:01.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:01.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj588 td/osd-backfill-space/datafile 2020-09-08T16:15:01.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:01.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj588 td/osd-backfill-space/datafile 2020-09-08T16:15:02.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:02.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj588 td/osd-backfill-space/datafile 2020-09-08T16:15:02.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:02.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj588 td/osd-backfill-space/datafile 2020-09-08T16:15:02.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:02.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj588 td/osd-backfill-space/datafile 2020-09-08T16:15:02.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:02.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj588 td/osd-backfill-space/datafile 2020-09-08T16:15:02.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:02.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj588 td/osd-backfill-space/datafile 2020-09-08T16:15:02.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:15:02.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:15:02.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:02.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj589 td/osd-backfill-space/datafile 2020-09-08T16:15:02.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:02.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj589 td/osd-backfill-space/datafile 2020-09-08T16:15:02.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:02.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj589 td/osd-backfill-space/datafile 2020-09-08T16:15:02.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:02.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj589 td/osd-backfill-space/datafile 2020-09-08T16:15:02.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:02.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj589 td/osd-backfill-space/datafile 2020-09-08T16:15:02.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:02.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj589 td/osd-backfill-space/datafile 2020-09-08T16:15:02.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:02.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj589 td/osd-backfill-space/datafile 2020-09-08T16:15:03.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:03.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj589 td/osd-backfill-space/datafile 2020-09-08T16:15:03.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:15:03.139 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:15:03.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:03.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj590 td/osd-backfill-space/datafile 2020-09-08T16:15:03.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:03.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj590 td/osd-backfill-space/datafile 2020-09-08T16:15:03.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:03.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj590 td/osd-backfill-space/datafile 2020-09-08T16:15:03.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:03.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj590 td/osd-backfill-space/datafile 2020-09-08T16:15:03.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:03.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj590 td/osd-backfill-space/datafile 2020-09-08T16:15:03.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:03.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj590 td/osd-backfill-space/datafile 2020-09-08T16:15:03.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:03.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj590 td/osd-backfill-space/datafile 2020-09-08T16:15:03.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:03.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj590 td/osd-backfill-space/datafile 2020-09-08T16:15:03.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:15:03.868 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:15:03.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:03.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj591 td/osd-backfill-space/datafile 2020-09-08T16:15:03.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:03.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj591 td/osd-backfill-space/datafile 2020-09-08T16:15:04.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:04.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj591 td/osd-backfill-space/datafile 2020-09-08T16:15:04.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:04.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj591 td/osd-backfill-space/datafile 2020-09-08T16:15:04.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:04.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj591 td/osd-backfill-space/datafile 2020-09-08T16:15:04.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:04.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj591 td/osd-backfill-space/datafile 2020-09-08T16:15:04.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:04.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj591 td/osd-backfill-space/datafile 2020-09-08T16:15:04.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:04.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj591 td/osd-backfill-space/datafile 2020-09-08T16:15:04.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:15:04.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:15:04.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:04.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj592 td/osd-backfill-space/datafile 2020-09-08T16:15:04.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:04.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj592 td/osd-backfill-space/datafile 2020-09-08T16:15:04.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:04.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj592 td/osd-backfill-space/datafile 2020-09-08T16:15:04.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:04.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj592 td/osd-backfill-space/datafile 2020-09-08T16:15:04.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:04.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj592 td/osd-backfill-space/datafile 2020-09-08T16:15:04.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:04.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj592 td/osd-backfill-space/datafile 2020-09-08T16:15:05.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:05.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj592 td/osd-backfill-space/datafile 2020-09-08T16:15:05.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:05.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj592 td/osd-backfill-space/datafile 2020-09-08T16:15:05.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:15:05.165 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:15:05.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:05.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj593 td/osd-backfill-space/datafile 2020-09-08T16:15:05.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:05.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj593 td/osd-backfill-space/datafile 2020-09-08T16:15:05.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:05.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj593 td/osd-backfill-space/datafile 2020-09-08T16:15:05.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:05.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj593 td/osd-backfill-space/datafile 2020-09-08T16:15:05.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:05.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj593 td/osd-backfill-space/datafile 2020-09-08T16:15:05.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:05.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj593 td/osd-backfill-space/datafile 2020-09-08T16:15:05.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:05.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj593 td/osd-backfill-space/datafile 2020-09-08T16:15:05.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:05.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj593 td/osd-backfill-space/datafile 2020-09-08T16:15:05.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:15:05.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:15:05.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:05.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj594 td/osd-backfill-space/datafile 2020-09-08T16:15:05.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:05.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj594 td/osd-backfill-space/datafile 2020-09-08T16:15:05.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:05.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj594 td/osd-backfill-space/datafile 2020-09-08T16:15:06.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:06.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj594 td/osd-backfill-space/datafile 2020-09-08T16:15:06.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:06.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj594 td/osd-backfill-space/datafile 2020-09-08T16:15:06.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:06.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj594 td/osd-backfill-space/datafile 2020-09-08T16:15:06.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:06.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj594 td/osd-backfill-space/datafile 2020-09-08T16:15:06.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:06.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj594 td/osd-backfill-space/datafile 2020-09-08T16:15:06.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:15:06.446 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:15:06.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:06.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj595 td/osd-backfill-space/datafile 2020-09-08T16:15:06.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:06.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj595 td/osd-backfill-space/datafile 2020-09-08T16:15:06.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:06.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj595 td/osd-backfill-space/datafile 2020-09-08T16:15:06.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:06.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj595 td/osd-backfill-space/datafile 2020-09-08T16:15:06.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:06.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj595 td/osd-backfill-space/datafile 2020-09-08T16:15:06.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:06.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj595 td/osd-backfill-space/datafile 2020-09-08T16:15:06.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:06.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj595 td/osd-backfill-space/datafile 2020-09-08T16:15:07.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:07.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj595 td/osd-backfill-space/datafile 2020-09-08T16:15:07.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:15:07.083 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:15:07.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:07.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj596 td/osd-backfill-space/datafile 2020-09-08T16:15:07.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:07.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj596 td/osd-backfill-space/datafile 2020-09-08T16:15:07.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:07.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj596 td/osd-backfill-space/datafile 2020-09-08T16:15:07.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:07.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj596 td/osd-backfill-space/datafile 2020-09-08T16:15:07.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:07.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj596 td/osd-backfill-space/datafile 2020-09-08T16:15:07.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:07.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj596 td/osd-backfill-space/datafile 2020-09-08T16:15:07.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:07.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj596 td/osd-backfill-space/datafile 2020-09-08T16:15:07.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:07.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj596 td/osd-backfill-space/datafile 2020-09-08T16:15:07.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:15:07.757 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:15:07.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:07.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj597 td/osd-backfill-space/datafile 2020-09-08T16:15:07.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:07.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj597 td/osd-backfill-space/datafile 2020-09-08T16:15:07.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:07.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj597 td/osd-backfill-space/datafile 2020-09-08T16:15:07.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:07.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj597 td/osd-backfill-space/datafile 2020-09-08T16:15:08.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:08.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj597 td/osd-backfill-space/datafile 2020-09-08T16:15:08.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:08.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj597 td/osd-backfill-space/datafile 2020-09-08T16:15:08.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:08.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj597 td/osd-backfill-space/datafile 2020-09-08T16:15:08.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:08.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj597 td/osd-backfill-space/datafile 2020-09-08T16:15:08.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:15:08.406 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:15:08.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:08.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj598 td/osd-backfill-space/datafile 2020-09-08T16:15:08.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:08.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj598 td/osd-backfill-space/datafile 2020-09-08T16:15:08.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:08.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj598 td/osd-backfill-space/datafile 2020-09-08T16:15:08.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:08.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj598 td/osd-backfill-space/datafile 2020-09-08T16:15:08.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:08.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj598 td/osd-backfill-space/datafile 2020-09-08T16:15:08.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:08.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj598 td/osd-backfill-space/datafile 2020-09-08T16:15:08.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:08.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj598 td/osd-backfill-space/datafile 2020-09-08T16:15:09.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:09.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj598 td/osd-backfill-space/datafile 2020-09-08T16:15:09.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:15:09.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:15:09.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:09.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj599 td/osd-backfill-space/datafile 2020-09-08T16:15:09.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:09.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj599 td/osd-backfill-space/datafile 2020-09-08T16:15:09.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:09.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj599 td/osd-backfill-space/datafile 2020-09-08T16:15:09.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:09.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj599 td/osd-backfill-space/datafile 2020-09-08T16:15:09.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:09.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj599 td/osd-backfill-space/datafile 2020-09-08T16:15:09.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:09.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj599 td/osd-backfill-space/datafile 2020-09-08T16:15:09.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:09.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj599 td/osd-backfill-space/datafile 2020-09-08T16:15:09.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:09.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj599 td/osd-backfill-space/datafile 2020-09-08T16:15:09.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:215: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2020-09-08T16:15:09.956 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:15:09.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:09.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test1 put obj600 td/osd-backfill-space/datafile 2020-09-08T16:15:09.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:09.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test2 put obj600 td/osd-backfill-space/datafile 2020-09-08T16:15:09.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:09.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test3 put obj600 td/osd-backfill-space/datafile 2020-09-08T16:15:09.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:09.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test4 put obj600 td/osd-backfill-space/datafile 2020-09-08T16:15:10.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:10.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test5 put obj600 td/osd-backfill-space/datafile 2020-09-08T16:15:10.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:10.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test6 put obj600 td/osd-backfill-space/datafile 2020-09-08T16:15:10.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:10.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test7 put obj600 td/osd-backfill-space/datafile 2020-09-08T16:15:10.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:217: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:10.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:219: TEST_backfill_test_multi: rados -p test8 put obj600 td/osd-backfill-space/datafile 2020-09-08T16:15:10.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:223: TEST_backfill_test_multi: ceph pg dump pgs 2020-09-08T16:15:10.753 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T16:15:10.754 INFO:tasks.workunit.client.0.smithi065.stdout:8.0 599 0 0 0 0 2453504 0 0 99 99 active+clean 2020-09-08T16:08:18.752970+0000 144'599 144:613 [3] 3 [3] 3 0'0 2020-09-08T16:08:15.966624+0000 0'0 2020-09-08T16:08:15.966624+0000 0 2020-09-08T16:15:10.754 INFO:tasks.workunit.client.0.smithi065.stdout:7.0 593 0 0 0 0 2428928 0 0 93 93 active+clean 2020-09-08T16:08:16.336597+0000 144'593 144:610 [5] 5 [5] 5 0'0 2020-09-08T16:08:13.308019+0000 0'0 2020-09-08T16:08:13.308019+0000 0 2020-09-08T16:15:10.754 INFO:tasks.workunit.client.0.smithi065.stdout:2.0 599 0 0 0 0 2453504 0 0 99 99 active+clean 2020-09-08T16:08:01.619879+0000 144'599 144:635 [17] 17 [17] 17 0'0 2020-09-08T16:07:58.537978+0000 0'0 2020-09-08T16:07:58.537978+0000 0 2020-09-08T16:15:10.754 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 600 0 0 0 0 2457600 0 0 100 100 active+clean 2020-09-08T16:07:58.902843+0000 144'600 144:645 [8] 8 [8] 8 0'0 2020-09-08T16:07:55.473534+0000 0'0 2020-09-08T16:07:55.473534+0000 0 2020-09-08T16:15:10.755 INFO:tasks.workunit.client.0.smithi065.stdout:3.0 599 0 0 0 0 2453504 0 0 99 99 active+clean 2020-09-08T16:08:04.416594+0000 144'599 144:637 [1] 1 [1] 1 0'0 2020-09-08T16:08:01.477330+0000 0'0 2020-09-08T16:08:01.477330+0000 0 2020-09-08T16:15:10.755 INFO:tasks.workunit.client.0.smithi065.stdout:4.0 596 0 0 0 0 2441216 0 0 96 96 active+clean 2020-09-08T16:08:07.354237+0000 144'596 144:624 [4] 4 [4] 4 0'0 2020-09-08T16:08:04.265489+0000 0'0 2020-09-08T16:08:04.265489+0000 0 2020-09-08T16:15:10.755 INFO:tasks.workunit.client.0.smithi065.stdout:5.0 599 0 0 0 0 2453504 0 0 99 99 active+clean 2020-09-08T16:08:11.702760+0000 144'599 144:621 [12] 12 [12] 12 0'0 2020-09-08T16:08:07.227383+0000 0'0 2020-09-08T16:08:07.227383+0000 0 2020-09-08T16:15:10.755 INFO:tasks.workunit.client.0.smithi065.stdout:6.0 594 0 0 0 0 2433024 0 0 94 94 active+clean 2020-09-08T16:08:13.841766+0000 144'594 144:621 [7] 7 [7] 7 0'0 2020-09-08T16:08:09.963307+0000 0'0 2020-09-08T16:08:09.963307+0000 0 2020-09-08T16:15:10.755 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T16:15:10.756 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T16:15:10.756 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:15:10.763 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:225: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:15:10.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:225: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:10.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:227: TEST_backfill_test_multi: ceph osd pool set test1 size 2 2020-09-08T16:15:11.495 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 2 2020-09-08T16:15:11.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:225: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:11.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:227: TEST_backfill_test_multi: ceph osd pool set test2 size 2 2020-09-08T16:15:12.468 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 2 size to 2 2020-09-08T16:15:12.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:225: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:12.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:227: TEST_backfill_test_multi: ceph osd pool set test3 size 2 2020-09-08T16:15:13.557 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 3 size to 2 2020-09-08T16:15:13.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:225: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:13.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:227: TEST_backfill_test_multi: ceph osd pool set test4 size 2 2020-09-08T16:15:15.615 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 4 size to 2 2020-09-08T16:15:15.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:225: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:15.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:227: TEST_backfill_test_multi: ceph osd pool set test5 size 2 2020-09-08T16:15:16.948 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 5 size to 2 2020-09-08T16:15:16.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:225: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:16.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:227: TEST_backfill_test_multi: ceph osd pool set test6 size 2 2020-09-08T16:15:18.765 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 6 size to 2 2020-09-08T16:15:18.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:225: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:18.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:227: TEST_backfill_test_multi: ceph osd pool set test7 size 2 2020-09-08T16:15:20.432 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 7 size to 2 2020-09-08T16:15:20.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:225: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2020-09-08T16:15:20.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:227: TEST_backfill_test_multi: ceph osd pool set test8 size 2 2020-09-08T16:15:21.598 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 8 size to 2 2020-09-08T16:15:21.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:229: TEST_backfill_test_multi: sleep 30 2020-09-08T16:15:51.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:231: TEST_backfill_test_multi: wait_for_not_backfilling 240 2020-09-08T16:15:51.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:82: wait_for_not_backfilling: local timeout=240 2020-09-08T16:15:51.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:83: wait_for_not_backfilling: wait_for_not_state backfilling 240 2020-09-08T16:15:51.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:53: wait_for_not_state: local state=backfilling 2020-09-08T16:15:51.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:54: wait_for_not_state: local num_in_state=-1 2020-09-08T16:15:51.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:55: wait_for_not_state: local cur_in_state 2020-09-08T16:15:51.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: delays=($(get_timeout_delays $2 5)) 2020-09-08T16:15:51.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: get_timeout_delays 240 5 2020-09-08T16:15:51.614 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:15:51.614 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:15:51.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:15:51.615 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:15:51.615 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:15:51.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: local -a delays 2020-09-08T16:15:51.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:57: wait_for_not_state: local -i loop=0 2020-09-08T16:15:51.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:59: wait_for_not_state: flush_pg_stats 2020-09-08T16:15:51.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:15:51.756 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:15:52.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:15:52.160 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:15:52.160 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:15:52.161 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:15:52.161 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T16:15:52.161 INFO:tasks.workunit.client.0.smithi065.stderr:5 2020-09-08T16:15:52.161 INFO:tasks.workunit.client.0.smithi065.stderr:6 2020-09-08T16:15:52.161 INFO:tasks.workunit.client.0.smithi065.stderr:7 2020-09-08T16:15:52.162 INFO:tasks.workunit.client.0.smithi065.stderr:8 2020-09-08T16:15:52.162 INFO:tasks.workunit.client.0.smithi065.stderr:9 2020-09-08T16:15:52.162 INFO:tasks.workunit.client.0.smithi065.stderr:10 2020-09-08T16:15:52.162 INFO:tasks.workunit.client.0.smithi065.stderr:11 2020-09-08T16:15:52.162 INFO:tasks.workunit.client.0.smithi065.stderr:12 2020-09-08T16:15:52.163 INFO:tasks.workunit.client.0.smithi065.stderr:13 2020-09-08T16:15:52.163 INFO:tasks.workunit.client.0.smithi065.stderr:14 2020-09-08T16:15:52.163 INFO:tasks.workunit.client.0.smithi065.stderr:15 2020-09-08T16:15:52.163 INFO:tasks.workunit.client.0.smithi065.stderr:16 2020-09-08T16:15:52.163 INFO:tasks.workunit.client.0.smithi065.stderr:17 2020-09-08T16:15:52.164 INFO:tasks.workunit.client.0.smithi065.stderr:18 2020-09-08T16:15:52.164 INFO:tasks.workunit.client.0.smithi065.stderr:19' 2020-09-08T16:15:52.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:15:52.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:15:52.164 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:15:52.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836614 2020-09-08T16:15:52.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836614 2020-09-08T16:15:52.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836614' 2020-09-08T16:15:52.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:15:52.296 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:15:52.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949673091 2020-09-08T16:15:52.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949673091 2020-09-08T16:15:52.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836614 1-42949673091' 2020-09-08T16:15:52.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:15:52.430 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:15:52.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509570 2020-09-08T16:15:52.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509570 2020-09-08T16:15:52.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836614 1-42949673091 2-64424509570' 2020-09-08T16:15:52.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:15:52.563 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:15:52.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899346048 2020-09-08T16:15:52.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899346048 2020-09-08T16:15:52.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836614 1-42949673091 2-64424509570 3-85899346048' 2020-09-08T16:15:52.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:15:52.777 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:15:52.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182528 2020-09-08T16:15:52.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182528 2020-09-08T16:15:52.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836614 1-42949673091 2-64424509570 3-85899346048 4-107374182528' 2020-09-08T16:15:52.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:15:52.912 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T16:15:53.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849019005 2020-09-08T16:15:53.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849019005 2020-09-08T16:15:53.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836614 1-42949673091 2-64424509570 3-85899346048 4-107374182528 5-128849019005' 2020-09-08T16:15:53.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:15:53.046 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2020-09-08T16:15:53.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=150323855483 2020-09-08T16:15:53.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 150323855483 2020-09-08T16:15:53.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836614 1-42949673091 2-64424509570 3-85899346048 4-107374182528 5-128849019005 6-150323855483' 2020-09-08T16:15:53.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:15:53.181 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2020-09-08T16:15:53.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=171798691962 2020-09-08T16:15:53.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 171798691962 2020-09-08T16:15:53.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836614 1-42949673091 2-64424509570 3-85899346048 4-107374182528 5-128849019005 6-150323855483 7-171798691962' 2020-09-08T16:15:53.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:15:53.315 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2020-09-08T16:15:53.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=193273528440 2020-09-08T16:15:53.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 193273528440 2020-09-08T16:15:53.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836614 1-42949673091 2-64424509570 3-85899346048 4-107374182528 5-128849019005 6-150323855483 7-171798691962 8-193273528440' 2020-09-08T16:15:53.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:15:53.449 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2020-09-08T16:15:53.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=214748364919 2020-09-08T16:15:53.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 214748364919 2020-09-08T16:15:53.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836614 1-42949673091 2-64424509570 3-85899346048 4-107374182528 5-128849019005 6-150323855483 7-171798691962 8-193273528440 9-214748364919' 2020-09-08T16:15:53.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:15:53.583 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2020-09-08T16:15:53.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=236223201398 2020-09-08T16:15:53.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 236223201398 2020-09-08T16:15:53.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836614 1-42949673091 2-64424509570 3-85899346048 4-107374182528 5-128849019005 6-150323855483 7-171798691962 8-193273528440 9-214748364919 10-236223201398' 2020-09-08T16:15:53.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:15:53.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.11 flush_pg_stats 2020-09-08T16:15:53.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=257698037875 2020-09-08T16:15:53.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 257698037875 2020-09-08T16:15:53.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836614 1-42949673091 2-64424509570 3-85899346048 4-107374182528 5-128849019005 6-150323855483 7-171798691962 8-193273528440 9-214748364919 10-236223201398 11-257698037875' 2020-09-08T16:15:53.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:15:53.852 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.12 flush_pg_stats 2020-09-08T16:15:53.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=279172874354 2020-09-08T16:15:53.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 279172874354 2020-09-08T16:15:53.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836614 1-42949673091 2-64424509570 3-85899346048 4-107374182528 5-128849019005 6-150323855483 7-171798691962 8-193273528440 9-214748364919 10-236223201398 11-257698037875 12-279172874354' 2020-09-08T16:15:53.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:15:53.986 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.13 flush_pg_stats 2020-09-08T16:15:54.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=300647710831 2020-09-08T16:15:54.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 300647710831 2020-09-08T16:15:54.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836614 1-42949673091 2-64424509570 3-85899346048 4-107374182528 5-128849019005 6-150323855483 7-171798691962 8-193273528440 9-214748364919 10-236223201398 11-257698037875 12-279172874354 13-300647710831' 2020-09-08T16:15:54.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:15:54.120 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.14 flush_pg_stats 2020-09-08T16:15:54.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=322122547310 2020-09-08T16:15:54.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 322122547310 2020-09-08T16:15:54.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836614 1-42949673091 2-64424509570 3-85899346048 4-107374182528 5-128849019005 6-150323855483 7-171798691962 8-193273528440 9-214748364919 10-236223201398 11-257698037875 12-279172874354 13-300647710831 14-322122547310' 2020-09-08T16:15:54.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:15:54.254 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.15 flush_pg_stats 2020-09-08T16:15:54.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=343597383789 2020-09-08T16:15:54.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 343597383789 2020-09-08T16:15:54.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836614 1-42949673091 2-64424509570 3-85899346048 4-107374182528 5-128849019005 6-150323855483 7-171798691962 8-193273528440 9-214748364919 10-236223201398 11-257698037875 12-279172874354 13-300647710831 14-322122547310 15-343597383789' 2020-09-08T16:15:54.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:15:54.400 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.16 flush_pg_stats 2020-09-08T16:15:54.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=365072220266 2020-09-08T16:15:54.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 365072220266 2020-09-08T16:15:54.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836614 1-42949673091 2-64424509570 3-85899346048 4-107374182528 5-128849019005 6-150323855483 7-171798691962 8-193273528440 9-214748364919 10-236223201398 11-257698037875 12-279172874354 13-300647710831 14-322122547310 15-343597383789 16-365072220266' 2020-09-08T16:15:54.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:15:54.533 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.17 flush_pg_stats 2020-09-08T16:15:54.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=386547056744 2020-09-08T16:15:54.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 386547056744 2020-09-08T16:15:54.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836614 1-42949673091 2-64424509570 3-85899346048 4-107374182528 5-128849019005 6-150323855483 7-171798691962 8-193273528440 9-214748364919 10-236223201398 11-257698037875 12-279172874354 13-300647710831 14-322122547310 15-343597383789 16-365072220266 17-386547056744' 2020-09-08T16:15:54.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:15:54.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.18 flush_pg_stats 2020-09-08T16:15:54.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=408021893224 2020-09-08T16:15:54.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 408021893224 2020-09-08T16:15:54.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836614 1-42949673091 2-64424509570 3-85899346048 4-107374182528 5-128849019005 6-150323855483 7-171798691962 8-193273528440 9-214748364919 10-236223201398 11-257698037875 12-279172874354 13-300647710831 14-322122547310 15-343597383789 16-365072220266 17-386547056744 18-408021893224' 2020-09-08T16:15:54.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:15:54.801 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.19 flush_pg_stats 2020-09-08T16:15:54.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=429496729701 2020-09-08T16:15:54.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 429496729701 2020-09-08T16:15:54.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836614 1-42949673091 2-64424509570 3-85899346048 4-107374182528 5-128849019005 6-150323855483 7-171798691962 8-193273528440 9-214748364919 10-236223201398 11-257698037875 12-279172874354 13-300647710831 14-322122547310 15-343597383789 16-365072220266 17-386547056744 18-408021893224 19-429496729701' 2020-09-08T16:15:54.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:15:54.936 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836614 2020-09-08T16:15:54.936 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:15:54.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:15:54.937 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836614 2020-09-08T16:15:54.937 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:15:54.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836614 2020-09-08T16:15:54.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836614' 2020-09-08T16:15:54.939 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:15:54.939 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836614 2020-09-08T16:15:55.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836614 -lt 21474836614 2020-09-08T16:15:55.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:15:55.351 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949673091 2020-09-08T16:15:55.351 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:15:55.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:15:55.352 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949673091 2020-09-08T16:15:55.352 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:15:55.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949673091 2020-09-08T16:15:55.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949673091' 2020-09-08T16:15:55.353 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:15:55.354 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949673091 2020-09-08T16:15:55.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949673091 -lt 42949673091 2020-09-08T16:15:55.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:15:55.787 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509570 2020-09-08T16:15:55.788 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:15:55.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:15:55.789 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509570 2020-09-08T16:15:55.789 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:15:55.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509570 2020-09-08T16:15:55.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509570' 2020-09-08T16:15:55.790 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:15:55.790 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509570 2020-09-08T16:15:56.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509570 -lt 64424509570 2020-09-08T16:15:56.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:15:56.188 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899346048 2020-09-08T16:15:56.189 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:15:56.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:15:56.190 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899346048 2020-09-08T16:15:56.190 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:15:56.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899346048 2020-09-08T16:15:56.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899346048' 2020-09-08T16:15:56.191 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:15:56.191 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899346048 2020-09-08T16:15:56.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899346049 -lt 85899346048 2020-09-08T16:15:56.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:15:56.589 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182528 2020-09-08T16:15:56.590 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:15:56.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:15:56.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182528 2020-09-08T16:15:56.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:15:56.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182528 2020-09-08T16:15:56.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182528' 2020-09-08T16:15:56.592 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182528 2020-09-08T16:15:56.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:15:56.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182528 -lt 107374182528 2020-09-08T16:15:56.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:15:56.989 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849019005 2020-09-08T16:15:56.989 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:15:56.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T16:15:56.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849019005 2020-09-08T16:15:56.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:15:56.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849019005 2020-09-08T16:15:56.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849019005' 2020-09-08T16:15:56.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T16:15:56.991 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849019005 2020-09-08T16:15:57.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849019006 -lt 128849019005 2020-09-08T16:15:57.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:15:57.389 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 6-150323855483 2020-09-08T16:15:57.389 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:15:57.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=6 2020-09-08T16:15:57.390 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 6-150323855483 2020-09-08T16:15:57.390 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:15:57.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=150323855483 2020-09-08T16:15:57.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.6 seq 150323855483' 2020-09-08T16:15:57.392 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 6 2020-09-08T16:15:57.392 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.6 seq 150323855483 2020-09-08T16:15:57.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 150323855484 -lt 150323855483 2020-09-08T16:15:57.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:15:57.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 7-171798691962 2020-09-08T16:15:57.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:15:57.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=7 2020-09-08T16:15:57.797 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 7-171798691962 2020-09-08T16:15:57.797 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:15:57.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=171798691962 2020-09-08T16:15:57.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.7 seq 171798691962' 2020-09-08T16:15:57.799 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 7 2020-09-08T16:15:57.799 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.7 seq 171798691962 2020-09-08T16:15:58.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 171798691962 -lt 171798691962 2020-09-08T16:15:58.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:15:58.295 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 8-193273528440 2020-09-08T16:15:58.295 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:15:58.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=8 2020-09-08T16:15:58.296 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 8-193273528440 2020-09-08T16:15:58.296 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:15:58.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=193273528440 2020-09-08T16:15:58.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.8 seq 193273528440' 2020-09-08T16:15:58.297 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 8 2020-09-08T16:15:58.298 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.8 seq 193273528440 2020-09-08T16:15:58.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 193273528441 -lt 193273528440 2020-09-08T16:15:58.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:15:58.737 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 9-214748364919 2020-09-08T16:15:58.737 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:15:58.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=9 2020-09-08T16:15:58.738 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 9-214748364919 2020-09-08T16:15:58.738 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:15:58.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=214748364919 2020-09-08T16:15:58.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.9 seq 214748364919' 2020-09-08T16:15:58.740 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 9 2020-09-08T16:15:58.740 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.9 seq 214748364919 2020-09-08T16:15:59.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 214748364920 -lt 214748364919 2020-09-08T16:15:59.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:15:59.136 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 10-236223201398 2020-09-08T16:15:59.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:15:59.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=10 2020-09-08T16:15:59.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 10-236223201398 2020-09-08T16:15:59.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:15:59.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=236223201398 2020-09-08T16:15:59.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.10 seq 236223201398' 2020-09-08T16:15:59.139 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 10 2020-09-08T16:15:59.139 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.10 seq 236223201398 2020-09-08T16:15:59.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 236223201399 -lt 236223201398 2020-09-08T16:15:59.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:15:59.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 11-257698037875 2020-09-08T16:15:59.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:15:59.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=11 2020-09-08T16:15:59.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 11-257698037875 2020-09-08T16:15:59.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:15:59.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=257698037875 2020-09-08T16:15:59.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.11 seq 257698037875' 2020-09-08T16:15:59.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 11 2020-09-08T16:15:59.539 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.11 seq 257698037875 2020-09-08T16:15:59.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 257698037876 -lt 257698037875 2020-09-08T16:15:59.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:15:59.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 12-279172874354 2020-09-08T16:15:59.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:15:59.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=12 2020-09-08T16:15:59.993 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 12-279172874354 2020-09-08T16:15:59.993 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:15:59.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=279172874354 2020-09-08T16:15:59.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.12 seq 279172874354' 2020-09-08T16:15:59.995 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 12 2020-09-08T16:15:59.995 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.12 seq 279172874354 2020-09-08T16:16:00.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 279172874355 -lt 279172874354 2020-09-08T16:16:00.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:16:00.394 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 13-300647710831 2020-09-08T16:16:00.394 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:16:00.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=13 2020-09-08T16:16:00.395 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 13-300647710831 2020-09-08T16:16:00.395 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:16:00.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=300647710831 2020-09-08T16:16:00.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.13 seq 300647710831' 2020-09-08T16:16:00.396 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 13 2020-09-08T16:16:00.397 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.13 seq 300647710831 2020-09-08T16:16:00.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 300647710833 -lt 300647710831 2020-09-08T16:16:00.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:16:00.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 14-322122547310 2020-09-08T16:16:00.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:16:00.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=14 2020-09-08T16:16:00.828 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 14-322122547310 2020-09-08T16:16:00.828 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:16:00.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=322122547310 2020-09-08T16:16:00.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.14 seq 322122547310' 2020-09-08T16:16:00.830 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 14 2020-09-08T16:16:00.830 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.14 seq 322122547310 2020-09-08T16:16:01.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 322122547311 -lt 322122547310 2020-09-08T16:16:01.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:16:01.312 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 15-343597383789 2020-09-08T16:16:01.313 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:16:01.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=15 2020-09-08T16:16:01.314 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 15-343597383789 2020-09-08T16:16:01.314 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:16:01.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=343597383789 2020-09-08T16:16:01.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.15 seq 343597383789' 2020-09-08T16:16:01.315 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 15 2020-09-08T16:16:01.315 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.15 seq 343597383789 2020-09-08T16:16:01.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 343597383790 -lt 343597383789 2020-09-08T16:16:01.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:16:01.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 16-365072220266 2020-09-08T16:16:01.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:16:01.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=16 2020-09-08T16:16:01.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 16-365072220266 2020-09-08T16:16:01.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:16:01.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=365072220266 2020-09-08T16:16:01.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.16 seq 365072220266' 2020-09-08T16:16:01.752 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 16 2020-09-08T16:16:01.752 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.16 seq 365072220266 2020-09-08T16:16:02.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 365072220268 -lt 365072220266 2020-09-08T16:16:02.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:16:02.152 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 17-386547056744 2020-09-08T16:16:02.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:16:02.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=17 2020-09-08T16:16:02.154 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 17-386547056744 2020-09-08T16:16:02.154 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:16:02.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=386547056744 2020-09-08T16:16:02.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.17 seq 386547056744' 2020-09-08T16:16:02.155 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 17 2020-09-08T16:16:02.155 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.17 seq 386547056744 2020-09-08T16:16:02.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 386547056746 -lt 386547056744 2020-09-08T16:16:02.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:16:02.625 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 18-408021893224 2020-09-08T16:16:02.625 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:16:02.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=18 2020-09-08T16:16:02.626 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 18-408021893224 2020-09-08T16:16:02.626 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:16:02.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=408021893224 2020-09-08T16:16:02.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.18 seq 408021893224' 2020-09-08T16:16:02.627 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 18 2020-09-08T16:16:02.627 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.18 seq 408021893224 2020-09-08T16:16:03.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 408021893225 -lt 408021893224 2020-09-08T16:16:03.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:16:03.059 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 19-429496729701 2020-09-08T16:16:03.060 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:16:03.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=19 2020-09-08T16:16:03.061 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 19-429496729701 2020-09-08T16:16:03.061 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:16:03.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=429496729701 2020-09-08T16:16:03.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.19 seq 429496729701' 2020-09-08T16:16:03.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 19 2020-09-08T16:16:03.062 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.19 seq 429496729701 2020-09-08T16:16:03.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 429496729702 -lt 429496729701 2020-09-08T16:16:03.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: get_num_pgs 2020-09-08T16:16:03.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:16:03.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:16:04.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: test 8 == 0 2020-09-08T16:16:04.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:16:04.022 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:16:04.022 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:16:04.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:16:04.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:16:04.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:16:04.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:16:04.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=4 2020-09-08T16:16:04.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 4 = 0 2020-09-08T16:16:04.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 4 '!=' -1 2020-09-08T16:16:04.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:68: wait_for_not_state: loop=0 2020-09-08T16:16:04.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:69: wait_for_not_state: num_in_state=4 2020-09-08T16:16:04.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 5 2020-09-08T16:16:09.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:16:24.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:16:24.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:16:24.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:16:24.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:16:24.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:16:24.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:16:24.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:16:24.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=4 2020-09-08T16:16:24.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 4 = 0 2020-09-08T16:16:24.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 4 '!=' 4 2020-09-08T16:16:24.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 1 >= 17 )) 2020-09-08T16:16:24.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 10 2020-09-08T16:16:24.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:16:24.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:16:24.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:16:24.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:16:24.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:16:24.141 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:16:24.141 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:16:24.141 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:16:24.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=4 2020-09-08T16:16:24.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 4 = 0 2020-09-08T16:16:24.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 4 '!=' 4 2020-09-08T16:16:24.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 2 >= 17 )) 2020-09-08T16:16:24.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 15 2020-09-08T16:16:35.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:16:35.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:16:35.221 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:16:35.221 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:16:35.221 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:16:35.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:16:35.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:16:35.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:16:35.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=4 2020-09-08T16:16:35.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 4 = 0 2020-09-08T16:16:35.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 4 '!=' 4 2020-09-08T16:16:35.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 3 >= 17 )) 2020-09-08T16:16:35.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 15 2020-09-08T16:16:50.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:16:50.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:16:50.621 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:16:50.621 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:16:50.621 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:16:50.621 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:16:50.622 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:16:50.622 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:16:51.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=4 2020-09-08T16:16:51.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 4 = 0 2020-09-08T16:16:51.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 4 '!=' 4 2020-09-08T16:16:51.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 4 >= 17 )) 2020-09-08T16:16:51.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 15 2020-09-08T16:17:06.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:17:06.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:17:06.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:17:06.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:17:06.024 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:17:06.024 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:17:06.024 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:17:06.024 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:17:06.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=4 2020-09-08T16:17:06.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 4 = 0 2020-09-08T16:17:06.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 4 '!=' 4 2020-09-08T16:17:06.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 5 >= 17 )) 2020-09-08T16:17:06.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 15 2020-09-08T16:17:21.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:17:21.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:17:21.424 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:17:21.424 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:17:21.425 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:17:21.425 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:17:21.425 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:17:21.425 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:17:21.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=4 2020-09-08T16:17:21.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 4 = 0 2020-09-08T16:17:21.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 4 '!=' 4 2020-09-08T16:17:21.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 6 >= 17 )) 2020-09-08T16:17:21.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 15 2020-09-08T16:17:36.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:17:36.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:17:36.826 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:17:36.826 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:17:36.826 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:17:36.826 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:17:36.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:17:36.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:17:37.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=4 2020-09-08T16:17:37.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 4 = 0 2020-09-08T16:17:37.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 4 '!=' 4 2020-09-08T16:17:37.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 7 >= 17 )) 2020-09-08T16:17:37.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 15 2020-09-08T16:17:52.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:17:52.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:17:52.227 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:17:52.228 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:17:52.228 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:17:52.228 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:17:52.228 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:17:52.228 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:17:52.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=4 2020-09-08T16:17:52.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 4 = 0 2020-09-08T16:17:52.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 4 '!=' 4 2020-09-08T16:17:52.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 8 >= 17 )) 2020-09-08T16:17:52.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 15 2020-09-08T16:18:07.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:18:07.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:18:07.633 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:18:07.633 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:18:07.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:18:07.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:18:07.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:18:07.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:18:08.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=0 2020-09-08T16:18:08.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 0 = 0 2020-09-08T16:18:08.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: break 2020-09-08T16:18:08.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:77: wait_for_not_state: return 0 2020-09-08T16:18:08.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:232: TEST_backfill_test_multi: wait_for_not_activating 60 2020-09-08T16:18:08.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:88: wait_for_not_activating: local timeout=60 2020-09-08T16:18:08.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:89: wait_for_not_activating: wait_for_not_state activating 60 2020-09-08T16:18:08.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:53: wait_for_not_state: local state=activating 2020-09-08T16:18:08.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:54: wait_for_not_state: local num_in_state=-1 2020-09-08T16:18:08.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:55: wait_for_not_state: local cur_in_state 2020-09-08T16:18:08.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: delays=($(get_timeout_delays $2 5)) 2020-09-08T16:18:08.034 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: get_timeout_delays 60 5 2020-09-08T16:18:08.035 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:18:08.035 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:18:08.035 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:18:08.035 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:18:08.035 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:18:08.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: local -a delays 2020-09-08T16:18:08.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:57: wait_for_not_state: local -i loop=0 2020-09-08T16:18:08.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:59: wait_for_not_state: flush_pg_stats 2020-09-08T16:18:08.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:18:08.075 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:18:08.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:18:08.498 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:18:08.498 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:18:08.498 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:18:08.499 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T16:18:08.499 INFO:tasks.workunit.client.0.smithi065.stderr:5 2020-09-08T16:18:08.499 INFO:tasks.workunit.client.0.smithi065.stderr:6 2020-09-08T16:18:08.499 INFO:tasks.workunit.client.0.smithi065.stderr:7 2020-09-08T16:18:08.499 INFO:tasks.workunit.client.0.smithi065.stderr:8 2020-09-08T16:18:08.500 INFO:tasks.workunit.client.0.smithi065.stderr:9 2020-09-08T16:18:08.500 INFO:tasks.workunit.client.0.smithi065.stderr:10 2020-09-08T16:18:08.500 INFO:tasks.workunit.client.0.smithi065.stderr:11 2020-09-08T16:18:08.500 INFO:tasks.workunit.client.0.smithi065.stderr:12 2020-09-08T16:18:08.500 INFO:tasks.workunit.client.0.smithi065.stderr:13 2020-09-08T16:18:08.501 INFO:tasks.workunit.client.0.smithi065.stderr:14 2020-09-08T16:18:08.501 INFO:tasks.workunit.client.0.smithi065.stderr:15 2020-09-08T16:18:08.501 INFO:tasks.workunit.client.0.smithi065.stderr:16 2020-09-08T16:18:08.501 INFO:tasks.workunit.client.0.smithi065.stderr:17 2020-09-08T16:18:08.501 INFO:tasks.workunit.client.0.smithi065.stderr:18 2020-09-08T16:18:08.502 INFO:tasks.workunit.client.0.smithi065.stderr:19' 2020-09-08T16:18:08.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:18:08.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:18:08.502 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:18:08.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836643 2020-09-08T16:18:08.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836643 2020-09-08T16:18:08.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836643' 2020-09-08T16:18:08.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:18:08.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:18:08.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949673120 2020-09-08T16:18:08.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949673120 2020-09-08T16:18:08.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836643 1-42949673120' 2020-09-08T16:18:08.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:18:08.798 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:18:08.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509599 2020-09-08T16:18:08.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509599 2020-09-08T16:18:08.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836643 1-42949673120 2-64424509599' 2020-09-08T16:18:08.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:18:08.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:18:09.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899346077 2020-09-08T16:18:09.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899346077 2020-09-08T16:18:09.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836643 1-42949673120 2-64424509599 3-85899346077' 2020-09-08T16:18:09.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:18:09.065 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:18:09.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182557 2020-09-08T16:18:09.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182557 2020-09-08T16:18:09.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836643 1-42949673120 2-64424509599 3-85899346077 4-107374182557' 2020-09-08T16:18:09.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:18:09.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T16:18:09.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849019034 2020-09-08T16:18:09.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849019034 2020-09-08T16:18:09.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836643 1-42949673120 2-64424509599 3-85899346077 4-107374182557 5-128849019034' 2020-09-08T16:18:09.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:18:09.355 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2020-09-08T16:18:09.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=150323855513 2020-09-08T16:18:09.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 150323855513 2020-09-08T16:18:09.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836643 1-42949673120 2-64424509599 3-85899346077 4-107374182557 5-128849019034 6-150323855513' 2020-09-08T16:18:09.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:18:09.489 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2020-09-08T16:18:09.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=171798691991 2020-09-08T16:18:09.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 171798691991 2020-09-08T16:18:09.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836643 1-42949673120 2-64424509599 3-85899346077 4-107374182557 5-128849019034 6-150323855513 7-171798691991' 2020-09-08T16:18:09.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:18:09.623 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2020-09-08T16:18:09.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=193273528469 2020-09-08T16:18:09.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 193273528469 2020-09-08T16:18:09.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836643 1-42949673120 2-64424509599 3-85899346077 4-107374182557 5-128849019034 6-150323855513 7-171798691991 8-193273528469' 2020-09-08T16:18:09.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:18:09.756 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2020-09-08T16:18:09.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=214748364948 2020-09-08T16:18:09.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 214748364948 2020-09-08T16:18:09.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836643 1-42949673120 2-64424509599 3-85899346077 4-107374182557 5-128849019034 6-150323855513 7-171798691991 8-193273528469 9-214748364948' 2020-09-08T16:18:09.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:18:09.890 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2020-09-08T16:18:10.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=236223201427 2020-09-08T16:18:10.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 236223201427 2020-09-08T16:18:10.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836643 1-42949673120 2-64424509599 3-85899346077 4-107374182557 5-128849019034 6-150323855513 7-171798691991 8-193273528469 9-214748364948 10-236223201427' 2020-09-08T16:18:10.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:18:10.022 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.11 flush_pg_stats 2020-09-08T16:18:10.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=257698037904 2020-09-08T16:18:10.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 257698037904 2020-09-08T16:18:10.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836643 1-42949673120 2-64424509599 3-85899346077 4-107374182557 5-128849019034 6-150323855513 7-171798691991 8-193273528469 9-214748364948 10-236223201427 11-257698037904' 2020-09-08T16:18:10.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:18:10.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.12 flush_pg_stats 2020-09-08T16:18:10.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=279172874384 2020-09-08T16:18:10.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 279172874384 2020-09-08T16:18:10.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836643 1-42949673120 2-64424509599 3-85899346077 4-107374182557 5-128849019034 6-150323855513 7-171798691991 8-193273528469 9-214748364948 10-236223201427 11-257698037904 12-279172874384' 2020-09-08T16:18:10.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:18:10.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.13 flush_pg_stats 2020-09-08T16:18:10.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=300647710861 2020-09-08T16:18:10.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 300647710861 2020-09-08T16:18:10.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836643 1-42949673120 2-64424509599 3-85899346077 4-107374182557 5-128849019034 6-150323855513 7-171798691991 8-193273528469 9-214748364948 10-236223201427 11-257698037904 12-279172874384 13-300647710861' 2020-09-08T16:18:10.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:18:10.423 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.14 flush_pg_stats 2020-09-08T16:18:10.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=322122547339 2020-09-08T16:18:10.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 322122547339 2020-09-08T16:18:10.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836643 1-42949673120 2-64424509599 3-85899346077 4-107374182557 5-128849019034 6-150323855513 7-171798691991 8-193273528469 9-214748364948 10-236223201427 11-257698037904 12-279172874384 13-300647710861 14-322122547339' 2020-09-08T16:18:10.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:18:10.565 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.15 flush_pg_stats 2020-09-08T16:18:10.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=343597383818 2020-09-08T16:18:10.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 343597383818 2020-09-08T16:18:10.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836643 1-42949673120 2-64424509599 3-85899346077 4-107374182557 5-128849019034 6-150323855513 7-171798691991 8-193273528469 9-214748364948 10-236223201427 11-257698037904 12-279172874384 13-300647710861 14-322122547339 15-343597383818' 2020-09-08T16:18:10.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:18:10.698 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.16 flush_pg_stats 2020-09-08T16:18:10.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=365072220296 2020-09-08T16:18:10.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 365072220296 2020-09-08T16:18:10.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836643 1-42949673120 2-64424509599 3-85899346077 4-107374182557 5-128849019034 6-150323855513 7-171798691991 8-193273528469 9-214748364948 10-236223201427 11-257698037904 12-279172874384 13-300647710861 14-322122547339 15-343597383818 16-365072220296' 2020-09-08T16:18:10.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:18:10.830 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.17 flush_pg_stats 2020-09-08T16:18:10.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=386547056774 2020-09-08T16:18:10.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 386547056774 2020-09-08T16:18:10.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836643 1-42949673120 2-64424509599 3-85899346077 4-107374182557 5-128849019034 6-150323855513 7-171798691991 8-193273528469 9-214748364948 10-236223201427 11-257698037904 12-279172874384 13-300647710861 14-322122547339 15-343597383818 16-365072220296 17-386547056774' 2020-09-08T16:18:10.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:18:10.964 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.18 flush_pg_stats 2020-09-08T16:18:11.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=408021893253 2020-09-08T16:18:11.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 408021893253 2020-09-08T16:18:11.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836643 1-42949673120 2-64424509599 3-85899346077 4-107374182557 5-128849019034 6-150323855513 7-171798691991 8-193273528469 9-214748364948 10-236223201427 11-257698037904 12-279172874384 13-300647710861 14-322122547339 15-343597383818 16-365072220296 17-386547056774 18-408021893253' 2020-09-08T16:18:11.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:18:11.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.19 flush_pg_stats 2020-09-08T16:18:11.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=429496729730 2020-09-08T16:18:11.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 429496729730 2020-09-08T16:18:11.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836643 1-42949673120 2-64424509599 3-85899346077 4-107374182557 5-128849019034 6-150323855513 7-171798691991 8-193273528469 9-214748364948 10-236223201427 11-257698037904 12-279172874384 13-300647710861 14-322122547339 15-343597383818 16-365072220296 17-386547056774 18-408021893253 19-429496729730' 2020-09-08T16:18:11.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:18:11.233 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836643 2020-09-08T16:18:11.233 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:18:11.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:18:11.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836643 2020-09-08T16:18:11.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:18:11.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836643 2020-09-08T16:18:11.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836643' 2020-09-08T16:18:11.235 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836643 2020-09-08T16:18:11.235 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:18:11.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836643 -lt 21474836643 2020-09-08T16:18:11.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:18:11.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949673120 2020-09-08T16:18:11.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:18:11.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:18:11.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949673120 2020-09-08T16:18:11.630 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:18:11.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949673120 2020-09-08T16:18:11.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949673120' 2020-09-08T16:18:11.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:18:11.631 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949673120 2020-09-08T16:18:12.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949673121 -lt 42949673120 2020-09-08T16:18:12.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:18:12.045 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509599 2020-09-08T16:18:12.045 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:18:12.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:18:12.046 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509599 2020-09-08T16:18:12.046 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:18:12.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509599 2020-09-08T16:18:12.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509599' 2020-09-08T16:18:12.048 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:18:12.048 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509599 2020-09-08T16:18:12.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509600 -lt 64424509599 2020-09-08T16:18:12.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:18:12.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899346077 2020-09-08T16:18:12.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:18:12.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:18:12.454 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899346077 2020-09-08T16:18:12.454 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:18:12.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899346077 2020-09-08T16:18:12.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899346077' 2020-09-08T16:18:12.456 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:18:12.456 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899346077 2020-09-08T16:18:12.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899346078 -lt 85899346077 2020-09-08T16:18:12.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:18:12.884 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182557 2020-09-08T16:18:12.884 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:18:12.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:18:12.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182557 2020-09-08T16:18:12.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:18:12.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182557 2020-09-08T16:18:12.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182557' 2020-09-08T16:18:12.886 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:18:12.887 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182557 2020-09-08T16:18:13.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182557 -lt 107374182557 2020-09-08T16:18:13.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:18:13.282 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849019034 2020-09-08T16:18:13.282 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:18:13.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T16:18:13.283 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849019034 2020-09-08T16:18:13.283 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:18:13.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849019034 2020-09-08T16:18:13.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849019034' 2020-09-08T16:18:13.285 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T16:18:13.285 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849019034 2020-09-08T16:18:13.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849019035 -lt 128849019034 2020-09-08T16:18:13.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:18:13.712 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 6-150323855513 2020-09-08T16:18:13.712 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:18:13.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=6 2020-09-08T16:18:13.713 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 6-150323855513 2020-09-08T16:18:13.713 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:18:13.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=150323855513 2020-09-08T16:18:13.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.6 seq 150323855513' 2020-09-08T16:18:13.714 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 6 2020-09-08T16:18:13.715 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.6 seq 150323855513 2020-09-08T16:18:14.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 150323855513 -lt 150323855513 2020-09-08T16:18:14.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:18:14.144 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 7-171798691991 2020-09-08T16:18:14.144 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:18:14.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=7 2020-09-08T16:18:14.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 7-171798691991 2020-09-08T16:18:14.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:18:14.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=171798691991 2020-09-08T16:18:14.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.7 seq 171798691991' 2020-09-08T16:18:14.147 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 7 2020-09-08T16:18:14.147 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.7 seq 171798691991 2020-09-08T16:18:14.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 171798691992 -lt 171798691991 2020-09-08T16:18:14.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:18:14.548 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 8-193273528469 2020-09-08T16:18:14.548 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:18:14.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=8 2020-09-08T16:18:14.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 8-193273528469 2020-09-08T16:18:14.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:18:14.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=193273528469 2020-09-08T16:18:14.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.8 seq 193273528469' 2020-09-08T16:18:14.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 8 2020-09-08T16:18:14.551 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.8 seq 193273528469 2020-09-08T16:18:14.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 193273528470 -lt 193273528469 2020-09-08T16:18:14.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:18:14.950 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 9-214748364948 2020-09-08T16:18:14.950 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:18:14.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=9 2020-09-08T16:18:14.951 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 9-214748364948 2020-09-08T16:18:14.951 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:18:14.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=214748364948 2020-09-08T16:18:14.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.9 seq 214748364948' 2020-09-08T16:18:14.952 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 9 2020-09-08T16:18:14.952 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.9 seq 214748364948 2020-09-08T16:18:15.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 214748364949 -lt 214748364948 2020-09-08T16:18:15.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:18:15.350 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 10-236223201427 2020-09-08T16:18:15.350 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:18:15.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=10 2020-09-08T16:18:15.351 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 10-236223201427 2020-09-08T16:18:15.351 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:18:15.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=236223201427 2020-09-08T16:18:15.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.10 seq 236223201427' 2020-09-08T16:18:15.353 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 10 2020-09-08T16:18:15.353 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.10 seq 236223201427 2020-09-08T16:18:15.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 236223201428 -lt 236223201427 2020-09-08T16:18:15.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:18:15.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 11-257698037904 2020-09-08T16:18:15.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:18:15.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=11 2020-09-08T16:18:15.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 11-257698037904 2020-09-08T16:18:15.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:18:15.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=257698037904 2020-09-08T16:18:15.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.11 seq 257698037904' 2020-09-08T16:18:15.751 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 11 2020-09-08T16:18:15.752 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.11 seq 257698037904 2020-09-08T16:18:16.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 257698037905 -lt 257698037904 2020-09-08T16:18:16.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:18:16.161 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 12-279172874384 2020-09-08T16:18:16.161 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:18:16.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=12 2020-09-08T16:18:16.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 12-279172874384 2020-09-08T16:18:16.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:18:16.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=279172874384 2020-09-08T16:18:16.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.12 seq 279172874384' 2020-09-08T16:18:16.163 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 12 2020-09-08T16:18:16.164 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.12 seq 279172874384 2020-09-08T16:18:16.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 279172874385 -lt 279172874384 2020-09-08T16:18:16.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:18:16.575 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 13-300647710861 2020-09-08T16:18:16.575 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:18:16.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=13 2020-09-08T16:18:16.576 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 13-300647710861 2020-09-08T16:18:16.577 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:18:16.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=300647710861 2020-09-08T16:18:16.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.13 seq 300647710861' 2020-09-08T16:18:16.578 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 13 2020-09-08T16:18:16.578 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.13 seq 300647710861 2020-09-08T16:18:16.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 300647710862 -lt 300647710861 2020-09-08T16:18:16.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:18:16.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 14-322122547339 2020-09-08T16:18:16.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:18:16.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=14 2020-09-08T16:18:16.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 14-322122547339 2020-09-08T16:18:16.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:18:16.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=322122547339 2020-09-08T16:18:16.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.14 seq 322122547339' 2020-09-08T16:18:16.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 14 2020-09-08T16:18:16.985 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.14 seq 322122547339 2020-09-08T16:18:17.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 322122547340 -lt 322122547339 2020-09-08T16:18:17.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:18:17.390 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 15-343597383818 2020-09-08T16:18:17.391 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:18:17.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=15 2020-09-08T16:18:17.392 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 15-343597383818 2020-09-08T16:18:17.392 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:18:17.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=343597383818 2020-09-08T16:18:17.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.15 seq 343597383818' 2020-09-08T16:18:17.393 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 15 2020-09-08T16:18:17.393 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.15 seq 343597383818 2020-09-08T16:18:17.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 343597383820 -lt 343597383818 2020-09-08T16:18:17.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:18:17.794 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 16-365072220296 2020-09-08T16:18:17.794 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:18:17.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=16 2020-09-08T16:18:17.795 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 16-365072220296 2020-09-08T16:18:17.795 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:18:17.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=365072220296 2020-09-08T16:18:17.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.16 seq 365072220296' 2020-09-08T16:18:17.796 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.16 seq 365072220296 2020-09-08T16:18:17.797 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 16 2020-09-08T16:18:18.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 365072220297 -lt 365072220296 2020-09-08T16:18:18.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:18:18.196 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 17-386547056774 2020-09-08T16:18:18.197 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:18:18.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=17 2020-09-08T16:18:18.198 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 17-386547056774 2020-09-08T16:18:18.198 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:18:18.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=386547056774 2020-09-08T16:18:18.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.17 seq 386547056774' 2020-09-08T16:18:18.199 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 17 2020-09-08T16:18:18.200 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.17 seq 386547056774 2020-09-08T16:18:18.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 386547056775 -lt 386547056774 2020-09-08T16:18:18.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:18:18.605 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 18-408021893253 2020-09-08T16:18:18.605 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:18:18.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=18 2020-09-08T16:18:18.606 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 18-408021893253 2020-09-08T16:18:18.606 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:18:18.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=408021893253 2020-09-08T16:18:18.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.18 seq 408021893253' 2020-09-08T16:18:18.607 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 18 2020-09-08T16:18:18.608 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.18 seq 408021893253 2020-09-08T16:18:19.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 408021893254 -lt 408021893253 2020-09-08T16:18:19.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:18:19.002 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 19-429496729730 2020-09-08T16:18:19.002 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:18:19.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=19 2020-09-08T16:18:19.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 19-429496729730 2020-09-08T16:18:19.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:18:19.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=429496729730 2020-09-08T16:18:19.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.19 seq 429496729730' 2020-09-08T16:18:19.005 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.19 seq 429496729730 2020-09-08T16:18:19.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 19 2020-09-08T16:18:19.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 429496729731 -lt 429496729730 2020-09-08T16:18:19.412 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: get_num_pgs 2020-09-08T16:18:19.412 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:18:19.412 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:18:19.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: test 8 == 0 2020-09-08T16:18:19.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:18:19.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state activating 2020-09-08T16:18:19.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=activating 2020-09-08T16:18:19.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:18:19.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("activating"))' 2020-09-08T16:18:19.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:18:19.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("activating"))] | length' 2020-09-08T16:18:20.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=0 2020-09-08T16:18:20.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 0 = 0 2020-09-08T16:18:20.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: break 2020-09-08T16:18:20.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:77: wait_for_not_state: return 0 2020-09-08T16:18:20.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:234: TEST_backfill_test_multi: ERRORS=0 2020-09-08T16:18:20.358 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:235: TEST_backfill_test_multi: ceph pg dump pgs 2020-09-08T16:18:20.359 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:235: TEST_backfill_test_multi: grep +backfill_toofull 2020-09-08T16:18:20.359 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:235: TEST_backfill_test_multi: wc -l 2020-09-08T16:18:20.740 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:18:20.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:235: TEST_backfill_test_multi: full=4 2020-09-08T16:18:20.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:236: TEST_backfill_test_multi: '[' 4 -lt 1 ']' 2020-09-08T16:18:20.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:242: TEST_backfill_test_multi: expr 8 - 4 2020-09-08T16:18:20.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:242: TEST_backfill_test_multi: expected=4 2020-09-08T16:18:20.751 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:243: TEST_backfill_test_multi: ceph pg dump pgs 2020-09-08T16:18:20.751 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:243: TEST_backfill_test_multi: grep active+clean 2020-09-08T16:18:20.751 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:243: TEST_backfill_test_multi: wc -l 2020-09-08T16:18:21.124 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:18:21.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:243: TEST_backfill_test_multi: '[' 4 '!=' 4 ']' 2020-09-08T16:18:21.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:249: TEST_backfill_test_multi: ceph pg dump pgs 2020-09-08T16:18:21.507 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T16:18:21.507 INFO:tasks.workunit.client.0.smithi065.stdout:8.0 600 0 0 0 0 2457600 0 0 100 100 active+clean 2020-09-08T16:18:00.708632+0000 144'600 181:1857 [3,15] 3 [3,15] 3 0'0 2020-09-08T16:08:15.966624+0000 0'0 2020-09-08T16:08:15.966624+0000 0 2020-09-08T16:18:21.507 INFO:tasks.workunit.client.0.smithi065.stdout:7.0 600 0 600 0 0 2457600 0 0 100 100 active+undersized+degraded+remapped+backfill_toofull 2020-09-08T16:17:53.260472+0000 144'600 179:669 [5,1] 5 [5] 5 0'0 2020-09-08T16:08:13.308019+0000 0'0 2020-09-08T16:08:13.308019+0000 0 2020-09-08T16:18:21.508 INFO:tasks.workunit.client.0.smithi065.stdout:2.0 600 0 600 0 0 2457600 0 0 100 100 active+undersized+degraded+remapped+backfill_toofull 2020-09-08T16:18:16.382525+0000 144'600 181:690 [17,5] 17 [17] 17 0'0 2020-09-08T16:07:58.537978+0000 0'0 2020-09-08T16:07:58.537978+0000 0 2020-09-08T16:18:21.508 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 600 0 0 0 0 2457600 0 0 100 100 active+clean 2020-09-08T16:17:52.149609+0000 144'600 180:1893 [8,0] 8 [8,0] 8 0'0 2020-09-08T16:07:55.473534+0000 0'0 2020-09-08T16:07:55.473534+0000 0 2020-09-08T16:18:21.508 INFO:tasks.workunit.client.0.smithi065.stdout:3.0 600 0 600 0 0 2457600 0 0 100 100 active+undersized+degraded+remapped+backfill_toofull 2020-09-08T16:18:17.233955+0000 144'600 181:696 [1,7] 1 [1] 1 0'0 2020-09-08T16:08:01.477330+0000 0'0 2020-09-08T16:08:01.477330+0000 0 2020-09-08T16:18:21.508 INFO:tasks.workunit.client.0.smithi065.stdout:4.0 600 0 0 0 0 2457600 0 0 100 100 active+clean 2020-09-08T16:17:56.111862+0000 144'600 179:1870 [4,10] 4 [4,10] 4 0'0 2020-09-08T16:08:04.265489+0000 0'0 2020-09-08T16:08:04.265489+0000 0 2020-09-08T16:18:21.508 INFO:tasks.workunit.client.0.smithi065.stdout:5.0 600 0 0 0 0 2457600 0 0 100 100 active+clean 2020-09-08T16:17:59.442723+0000 144'600 180:1862 [12,19] 12 [12,19] 12 0'0 2020-09-08T16:08:07.227383+0000 0'0 2020-09-08T16:08:07.227383+0000 0 2020-09-08T16:18:21.509 INFO:tasks.workunit.client.0.smithi065.stdout:6.0 600 0 600 0 0 2457600 0 0 100 100 active+undersized+degraded+remapped+backfill_toofull 2020-09-08T16:17:51.303698+0000 144'600 179:679 [7,4] 7 [7] 7 0'0 2020-09-08T16:08:09.963307+0000 0'0 2020-09-08T16:08:09.963307+0000 0 2020-09-08T16:18:21.509 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T16:18:21.509 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T16:18:21.510 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:18:21.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:250: TEST_backfill_test_multi: ceph status 2020-09-08T16:18:22.026 INFO:tasks.workunit.client.0.smithi065.stdout: cluster: 2020-09-08T16:18:22.027 INFO:tasks.workunit.client.0.smithi065.stdout: id: 60fa903b-8e8c-449c-894a-3b5c18b39374 2020-09-08T16:18:22.027 INFO:tasks.workunit.client.0.smithi065.stdout: health: HEALTH_WARN 2020-09-08T16:18:22.027 INFO:tasks.workunit.client.0.smithi065.stdout: Low space hindering backfill (add storage if this doesn't resolve itself): 4 pgs backfill_toofull 2020-09-08T16:18:22.027 INFO:tasks.workunit.client.0.smithi065.stdout: Degraded data redundancy: 2400/9600 objects degraded (25.000%), 4 pgs degraded, 4 pgs undersized 2020-09-08T16:18:22.028 INFO:tasks.workunit.client.0.smithi065.stdout: 8 pool(s) do not have an application enabled 2020-09-08T16:18:22.028 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T16:18:22.028 INFO:tasks.workunit.client.0.smithi065.stdout: services: 2020-09-08T16:18:22.028 INFO:tasks.workunit.client.0.smithi065.stdout: mon: 1 daemons, quorum a (age 13m) 2020-09-08T16:18:22.028 INFO:tasks.workunit.client.0.smithi065.stdout: mgr: x(active, since 13m) 2020-09-08T16:18:22.028 INFO:tasks.workunit.client.0.smithi065.stdout: osd: 20 osds: 20 up (since 10m), 20 in (since 10m); 4 remapped pgs 2020-09-08T16:18:22.029 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T16:18:22.029 INFO:tasks.workunit.client.0.smithi065.stdout: data: 2020-09-08T16:18:22.029 INFO:tasks.workunit.client.0.smithi065.stdout: pools: 8 pools, 8 pgs 2020-09-08T16:18:22.029 INFO:tasks.workunit.client.0.smithi065.stdout: objects: 4.80k objects, 19 MiB 2020-09-08T16:18:22.029 INFO:tasks.workunit.client.0.smithi065.stdout: usage: 28 MiB used, 42 MiB / 70 MiB avail 2020-09-08T16:18:22.030 INFO:tasks.workunit.client.0.smithi065.stdout: pgs: 2400/9600 objects degraded (25.000%) 2020-09-08T16:18:22.030 INFO:tasks.workunit.client.0.smithi065.stdout: 4 active+clean 2020-09-08T16:18:22.030 INFO:tasks.workunit.client.0.smithi065.stdout: 4 active+undersized+degraded+remapped+backfill_toofull 2020-09-08T16:18:22.030 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T16:18:22.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:252: TEST_backfill_test_multi: ceph status --format=json-pretty 2020-09-08T16:18:22.566 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:254: TEST_backfill_test_multi: jq .health.checks.PG_BACKFILL_FULL.severity td/osd-backfill-space/stat.json 2020-09-08T16:18:22.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:254: TEST_backfill_test_multi: eval 'SEV="HEALTH_WARN"' 2020-09-08T16:18:22.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:254: TEST_backfill_test_multi: SEV=HEALTH_WARN 2020-09-08T16:18:22.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:255: TEST_backfill_test_multi: '[' HEALTH_WARN '!=' HEALTH_WARN ']' 2020-09-08T16:18:22.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:259: TEST_backfill_test_multi: jq .health.checks.PG_BACKFILL_FULL.summary.message td/osd-backfill-space/stat.json 2020-09-08T16:18:22.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:259: TEST_backfill_test_multi: eval 'MSG="Low' space hindering backfill '(add' storage if this 'doesn'\''t' resolve 'itself):' 4 pgs 'backfill_toofull"' 2020-09-08T16:18:22.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:259: TEST_backfill_test_multi: MSG='Low space hindering backfill (add storage if this doesn'\''t resolve itself): 4 pgs backfill_toofull' 2020-09-08T16:18:22.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:260: TEST_backfill_test_multi: '[' 'Low space hindering backfill (add storage if this doesn'\''t resolve itself): 4 pgs backfill_toofull' '!=' 'Low space hindering backfill (add storage if this doesn'\''t resolve itself): 4 pgs backfill_toofull' ']' 2020-09-08T16:18:22.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:264: TEST_backfill_test_multi: rm -f td/osd-backfill-space/stat.json 2020-09-08T16:18:22.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:266: TEST_backfill_test_multi: '[' 0 '!=' 0 ']' 2020-09-08T16:18:22.572 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:271: TEST_backfill_test_multi: seq 1 8 2020-09-08T16:18:22.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:271: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2020-09-08T16:18:22.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:273: TEST_backfill_test_multi: delete_pool test1 2020-09-08T16:18:22.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test1 2020-09-08T16:18:22.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2020-09-08T16:18:23.095 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test1' does not exist 2020-09-08T16:18:23.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:271: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2020-09-08T16:18:23.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:273: TEST_backfill_test_multi: delete_pool test2 2020-09-08T16:18:23.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test2 2020-09-08T16:18:23.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test2 test2 --yes-i-really-really-mean-it 2020-09-08T16:18:23.625 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test2' does not exist 2020-09-08T16:18:23.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:271: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2020-09-08T16:18:23.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:273: TEST_backfill_test_multi: delete_pool test3 2020-09-08T16:18:23.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test3 2020-09-08T16:18:23.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test3 test3 --yes-i-really-really-mean-it 2020-09-08T16:18:24.564 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test3' does not exist 2020-09-08T16:18:24.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:271: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2020-09-08T16:18:24.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:273: TEST_backfill_test_multi: delete_pool test4 2020-09-08T16:18:24.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test4 2020-09-08T16:18:24.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test4 test4 --yes-i-really-really-mean-it 2020-09-08T16:18:25.091 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test4' does not exist 2020-09-08T16:18:25.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:271: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2020-09-08T16:18:25.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:273: TEST_backfill_test_multi: delete_pool test5 2020-09-08T16:18:25.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test5 2020-09-08T16:18:25.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test5 test5 --yes-i-really-really-mean-it 2020-09-08T16:18:25.716 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test5' does not exist 2020-09-08T16:18:25.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:271: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2020-09-08T16:18:25.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:273: TEST_backfill_test_multi: delete_pool test6 2020-09-08T16:18:25.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test6 2020-09-08T16:18:25.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test6 test6 --yes-i-really-really-mean-it 2020-09-08T16:18:26.345 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test6' does not exist 2020-09-08T16:18:26.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:271: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2020-09-08T16:18:26.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:273: TEST_backfill_test_multi: delete_pool test7 2020-09-08T16:18:26.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test7 2020-09-08T16:18:26.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test7 test7 --yes-i-really-really-mean-it 2020-09-08T16:18:27.213 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test7' does not exist 2020-09-08T16:18:27.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:271: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2020-09-08T16:18:27.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:273: TEST_backfill_test_multi: delete_pool test8 2020-09-08T16:18:27.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test8 2020-09-08T16:18:27.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test8 test8 --yes-i-really-really-mean-it 2020-09-08T16:18:27.866 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test8' does not exist 2020-09-08T16:18:27.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:276: TEST_backfill_test_multi: kill_daemons td/osd-backfill-space 2020-09-08T16:18:27.874 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:18:27.875 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:18:27.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:18:27.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:18:27.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:18:28.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:18:28.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:277: TEST_backfill_test_multi: grep -q 'num_bytes mismatch' td/osd-backfill-space/osd.0.log td/osd-backfill-space/osd.10.log td/osd-backfill-space/osd.11.log td/osd-backfill-space/osd.12.log td/osd-backfill-space/osd.13.log td/osd-backfill-space/osd.14.log td/osd-backfill-space/osd.15.log td/osd-backfill-space/osd.16.log td/osd-backfill-space/osd.17.log td/osd-backfill-space/osd.18.log td/osd-backfill-space/osd.19.log td/osd-backfill-space/osd.1.log td/osd-backfill-space/osd.2.log td/osd-backfill-space/osd.3.log td/osd-backfill-space/osd.4.log td/osd-backfill-space/osd.5.log td/osd-backfill-space/osd.6.log td/osd-backfill-space/osd.7.log td/osd-backfill-space/osd.8.log td/osd-backfill-space/osd.9.log 2020-09-08T16:18:28.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:38: run: teardown td/osd-backfill-space 2020-09-08T16:18:28.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2020-09-08T16:18:28.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:18:28.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2020-09-08T16:18:28.361 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:18:28.361 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:18:28.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:18:28.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:18:28.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:18:28.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:18:28.376 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:18:28.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:18:28.377 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:18:28.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:18:28.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:18:28.378 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:18:28.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:18:28.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:18:28.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:18:28.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:18:28.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:18:28.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:18:28.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2020-09-08T16:18:28.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:18:28.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:18:28.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:18:28.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.154687 2020-09-08T16:18:28.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:18:28.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:18:28.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:35: run: for func in $funcs 2020-09-08T16:18:28.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:36: run: setup td/osd-backfill-space 2020-09-08T16:18:28.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-space 2020-09-08T16:18:28.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-space 2020-09-08T16:18:28.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2020-09-08T16:18:28.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:18:28.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2020-09-08T16:18:28.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:18:28.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:18:28.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:18:28.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:18:28.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:18:28.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:18:28.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:18:28.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:18:28.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:18:28.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:18:28.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:18:28.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:18:28.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:18:28.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:18:28.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:18:28.541 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:18:28.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:18:28.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:18:28.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2020-09-08T16:18:28.543 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:18:28.543 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:18:28.544 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:18:28.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.154687 2020-09-08T16:18:28.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:18:28.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:18:28.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-space 2020-09-08T16:18:28.546 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T16:18:28.546 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:18:28.546 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:18:28.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.154687 2020-09-08T16:18:28.548 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T16:18:28.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T16:18:28.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T16:18:28.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2020-09-08T16:18:28.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:37: run: TEST_backfill_test_sametarget td/osd-backfill-space 2020-09-08T16:18:28.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:294: TEST_backfill_test_sametarget: local dir=td/osd-backfill-space 2020-09-08T16:18:28.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:295: TEST_backfill_test_sametarget: local pools=10 2020-09-08T16:18:28.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:296: TEST_backfill_test_sametarget: local OSDS=5 2020-09-08T16:18:28.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:298: TEST_backfill_test_sametarget: run_mon td/osd-backfill-space a 2020-09-08T16:18:28.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-space 2020-09-08T16:18:28.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T16:18:28.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T16:18:28.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T16:18:28.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-space/a 2020-09-08T16:18:28.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2020-09-08T16:18:28.846 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T16:18:28.846 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:18:28.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:18:28.847 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:18:28.847 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:18:28.847 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:18:28.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:18:28.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T16:18:29.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T16:18:29.031 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T16:18:29.031 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:18:29.032 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:18:29.032 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T16:18:29.033 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T16:18:29.033 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:18:29.033 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:18:29.034 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:18:29.034 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:18:29.034 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:18:29.034 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:18:29.034 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.154687/ceph-mon.a.asok 2020-09-08T16:18:29.035 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:18:29.035 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.154687/ceph-mon.a.asok config get fsid 2020-09-08T16:18:29.124 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T16:18:29.124 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:18:29.125 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:18:29.125 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T16:18:29.125 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T16:18:29.126 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:18:29.126 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:18:29.127 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:18:29.127 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:18:29.127 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:18:29.127 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:18:29.127 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.154687/ceph-mon.a.asok 2020-09-08T16:18:29.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:18:29.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.154687/ceph-mon.a.asok config get mon_host 2020-09-08T16:18:29.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:299: TEST_backfill_test_sametarget: run_mgr td/osd-backfill-space x 2020-09-08T16:18:29.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-space 2020-09-08T16:18:29.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T16:18:29.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T16:18:29.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T16:18:29.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-space/x 2020-09-08T16:18:29.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T16:18:30.110 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T16:18:30.110 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:18:30.110 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:18:30.111 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:18:30.111 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:18:30.111 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:18:30.111 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:18:30.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:18:30.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:18:30.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:300: TEST_backfill_test_sametarget: export CEPH_ARGS 2020-09-08T16:18:30.136 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:302: TEST_backfill_test_sametarget: expr 5 - 1 2020-09-08T16:18:30.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:302: TEST_backfill_test_sametarget: seq 0 4 2020-09-08T16:18:30.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:302: TEST_backfill_test_sametarget: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:18:30.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:304: TEST_backfill_test_sametarget: run_osd td/osd-backfill-space 0 2020-09-08T16:18:30.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:18:30.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:18:30.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T16:18:30.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:18:30.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/0 2020-09-08T16:18:30.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:18:30.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:18:30.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:18:30.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:18:30.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2020-09-08T16:18:30.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2020-09-08T16:18:30.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:18:30.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:18:30.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:18:30.144 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:18:30.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:18:30.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:18:30.145 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:18:30.145 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:18:30.145 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:18:30.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:18:30.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:18:30.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:18:30.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:18:30.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:18:30.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:18:30.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:18:30.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:18:30.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:18:30.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:18:30.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:18:30.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:18:30.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/0 2020-09-08T16:18:30.149 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:18:30.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=520a19e5-952f-41d9-a613-443eb54071a3 2020-09-08T16:18:30.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 520a19e5-952f-41d9-a613-443eb54071a3' 2020-09-08T16:18:30.149 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:18:30.150 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 520a19e5-952f-41d9-a613-443eb54071a3 2020-09-08T16:18:30.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDWrldfFgLYCRAAXTkWI3FogGn8OQyOkvQQqA== 2020-09-08T16:18:30.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDWrldfFgLYCRAAXTkWI3FogGn8OQyOkvQQqA=="}' 2020-09-08T16:18:30.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 520a19e5-952f-41d9-a613-443eb54071a3 -i td/osd-backfill-space/0/new.json 2020-09-08T16:18:30.516 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:18:30.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/0/new.json 2020-09-08T16:18:30.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDWrldfFgLYCRAAXTkWI3FogGn8OQyOkvQQqA== --osd-uuid 520a19e5-952f-41d9-a613-443eb54071a3 2020-09-08T16:18:30.554 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:30.560+0000 7fc511445ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:30.556 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:30.562+0000 7fc511445ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:30.558 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:30.563+0000 7fc511445ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:30.559 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:30.564+0000 7fc511445ec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T16:18:30.559 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:30.564+0000 7fc511445ec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T16:18:30.559 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:30.564+0000 7fc511445ec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T16:18:30.596 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:30.601+0000 7fc511445ec0 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2020-09-08T16:18:34.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2020-09-08T16:18:34.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:18:34.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T16:18:34.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:18:34.677 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T16:18:35.208 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T16:18:35.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T16:18:35.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:18:35.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:18:35.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:18:35.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:18:35.234 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:35.239+0000 7f18e7228ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:35.251 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:35.256+0000 7f18e7228ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:35.252 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:35.257+0000 7f18e7228ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:35.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T16:18:35.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:18:35.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T16:18:35.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:18:35.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:18:35.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:18:35.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:18:35.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:18:35.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:18:35.603 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:18:35.770 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:35.775+0000 7f18e7228ec0 -1 Falling back to public interface 2020-09-08T16:18:36.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:18:36.560 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:36.565+0000 7f18e7228ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T16:18:37.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:18:37.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:18:37.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:18:37.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:18:37.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:18:37.024 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:18:37.427 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/366897,v1:127.0.0.1:6803/366897] [v2:127.0.0.1:6804/366897,v1:127.0.0.1:6805/366897] exists,up 520a19e5-952f-41d9-a613-443eb54071a3 2020-09-08T16:18:37.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:18:37.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:18:37.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:18:37.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:302: TEST_backfill_test_sametarget: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:18:37.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:304: TEST_backfill_test_sametarget: run_osd td/osd-backfill-space 1 2020-09-08T16:18:37.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:18:37.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:18:37.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T16:18:37.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:18:37.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/1 2020-09-08T16:18:37.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:18:37.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:18:37.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:18:37.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:18:37.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2020-09-08T16:18:37.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2020-09-08T16:18:37.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:18:37.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:18:37.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:18:37.432 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:18:37.432 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:18:37.432 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:18:37.432 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:18:37.432 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:18:37.433 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:18:37.433 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:18:37.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:18:37.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:18:37.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:18:37.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:18:37.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:18:37.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:18:37.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:18:37.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:18:37.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:18:37.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:18:37.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:18:37.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/1 2020-09-08T16:18:37.435 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:18:37.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=c53609c4-864a-47d0-b758-cbdaeb19476a 2020-09-08T16:18:37.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 c53609c4-864a-47d0-b758-cbdaeb19476a' 2020-09-08T16:18:37.437 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:18:37.437 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 c53609c4-864a-47d0-b758-cbdaeb19476a 2020-09-08T16:18:37.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDdrldfJ8zmGhAANuw/hkj3IOYElrGuSuI0hg== 2020-09-08T16:18:37.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDdrldfJ8zmGhAANuw/hkj3IOYElrGuSuI0hg=="}' 2020-09-08T16:18:37.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new c53609c4-864a-47d0-b758-cbdaeb19476a -i td/osd-backfill-space/1/new.json 2020-09-08T16:18:37.964 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:18:37.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/1/new.json 2020-09-08T16:18:37.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDdrldfJ8zmGhAANuw/hkj3IOYElrGuSuI0hg== --osd-uuid c53609c4-864a-47d0-b758-cbdaeb19476a 2020-09-08T16:18:38.003 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:38.008+0000 7f73aeb04ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:38.004 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:38.010+0000 7f73aeb04ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:38.006 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:38.011+0000 7f73aeb04ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:38.007 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:38.012+0000 7f73aeb04ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T16:18:38.007 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:38.012+0000 7f73aeb04ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T16:18:38.007 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:38.012+0000 7f73aeb04ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T16:18:38.049 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:38.055+0000 7f73aeb04ec0 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2020-09-08T16:18:42.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2020-09-08T16:18:42.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:18:42.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T16:18:42.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:18:42.250 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T16:18:42.786 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T16:18:42.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T16:18:42.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:18:42.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:18:42.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:18:42.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:18:42.811 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:42.816+0000 7f5192522ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:42.829 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:42.834+0000 7f5192522ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:42.831 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:42.836+0000 7f5192522ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:43.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T16:18:43.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:18:43.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T16:18:43.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:18:43.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:18:43.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:18:43.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:18:43.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:18:43.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:18:43.184 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:18:43.347 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:43.352+0000 7f5192522ec0 -1 Falling back to public interface 2020-09-08T16:18:43.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:18:44.228 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:44.232+0000 7f5192522ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T16:18:44.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:18:44.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:18:44.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:18:44.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:18:44.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:18:44.590 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:18:44.994 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/367891,v1:127.0.0.1:6811/367891] [v2:127.0.0.1:6812/367891,v1:127.0.0.1:6813/367891] exists,up c53609c4-864a-47d0-b758-cbdaeb19476a 2020-09-08T16:18:44.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:18:44.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:18:44.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:18:44.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:302: TEST_backfill_test_sametarget: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:18:44.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:304: TEST_backfill_test_sametarget: run_osd td/osd-backfill-space 2 2020-09-08T16:18:44.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:18:44.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:18:44.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T16:18:44.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:18:44.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/2 2020-09-08T16:18:44.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:18:44.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:18:44.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:18:44.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:18:44.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2020-09-08T16:18:45.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2020-09-08T16:18:45.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:18:45.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:18:45.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:18:45.000 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:18:45.001 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:18:45.001 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:18:45.001 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:18:45.001 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:18:45.001 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:18:45.002 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:18:45.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:18:45.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:18:45.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:18:45.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:18:45.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:18:45.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:18:45.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:18:45.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:18:45.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:18:45.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:18:45.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:18:45.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/2 2020-09-08T16:18:45.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:18:45.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=120838c2-82cf-4604-9221-0828c21f50e2 2020-09-08T16:18:45.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 120838c2-82cf-4604-9221-0828c21f50e2' 2020-09-08T16:18:45.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:18:45.006 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 120838c2-82cf-4604-9221-0828c21f50e2 2020-09-08T16:18:45.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDlrldfLKMUARAAgoJ/kOQBIGwCFmPmvGNaJQ== 2020-09-08T16:18:45.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDlrldfLKMUARAAgoJ/kOQBIGwCFmPmvGNaJQ=="}' 2020-09-08T16:18:45.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 120838c2-82cf-4604-9221-0828c21f50e2 -i td/osd-backfill-space/2/new.json 2020-09-08T16:18:45.610 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:18:45.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/2/new.json 2020-09-08T16:18:45.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDlrldfLKMUARAAgoJ/kOQBIGwCFmPmvGNaJQ== --osd-uuid 120838c2-82cf-4604-9221-0828c21f50e2 2020-09-08T16:18:45.650 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:45.654+0000 7f6ccc565ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:45.651 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:45.656+0000 7f6ccc565ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:45.653 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:45.657+0000 7f6ccc565ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:45.654 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:45.658+0000 7f6ccc565ec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T16:18:45.654 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:45.658+0000 7f6ccc565ec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T16:18:45.654 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:45.658+0000 7f6ccc565ec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T16:18:45.736 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:45.741+0000 7f6ccc565ec0 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2020-09-08T16:18:49.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2020-09-08T16:18:49.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:18:49.989 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T16:18:49.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T16:18:49.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:18:50.529 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T16:18:50.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T16:18:50.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:18:50.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:18:50.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:18:50.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:18:50.555 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:50.560+0000 7f9f281dcec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:50.557 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:50.562+0000 7f9f281dcec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:50.558 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:50.563+0000 7f9f281dcec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:50.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T16:18:50.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:18:50.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T16:18:50.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:18:50.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:18:50.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:18:50.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:18:50.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:18:50.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:18:50.925 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:18:51.077 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:51.082+0000 7f9f281dcec0 -1 Falling back to public interface 2020-09-08T16:18:51.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:18:51.867 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:51.872+0000 7f9f281dcec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T16:18:52.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:18:52.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:18:52.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:18:52.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:18:52.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:18:52.333 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:18:52.754 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/368893,v1:127.0.0.1:6819/368893] [v2:127.0.0.1:6820/368893,v1:127.0.0.1:6821/368893] exists,up 120838c2-82cf-4604-9221-0828c21f50e2 2020-09-08T16:18:52.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:18:52.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:18:52.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:18:52.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:302: TEST_backfill_test_sametarget: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:18:52.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:304: TEST_backfill_test_sametarget: run_osd td/osd-backfill-space 3 2020-09-08T16:18:52.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:18:52.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:18:52.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T16:18:52.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:18:52.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/3 2020-09-08T16:18:52.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:18:52.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:18:52.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:18:52.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:18:52.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/3' 2020-09-08T16:18:52.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/3/journal' 2020-09-08T16:18:52.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:18:52.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:18:52.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:18:52.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:18:52.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:18:52.759 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:18:52.759 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:18:52.759 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:18:52.759 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:18:52.759 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:18:52.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:18:52.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:18:52.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:18:52.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:18:52.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:18:52.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:18:52.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:18:52.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:18:52.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:18:52.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:18:52.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:18:52.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/3 2020-09-08T16:18:52.762 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:18:52.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=8e774c82-ab82-43ce-8f57-98970e1ca92a 2020-09-08T16:18:52.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 8e774c82-ab82-43ce-8f57-98970e1ca92a' 2020-09-08T16:18:52.763 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:18:52.763 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 8e774c82-ab82-43ce-8f57-98970e1ca92a 2020-09-08T16:18:52.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDsrldfM3pWLhAA4W3zUZbpai90x/95k9GNkg== 2020-09-08T16:18:52.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDsrldfM3pWLhAA4W3zUZbpai90x/95k9GNkg=="}' 2020-09-08T16:18:52.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 8e774c82-ab82-43ce-8f57-98970e1ca92a -i td/osd-backfill-space/3/new.json 2020-09-08T16:18:53.304 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T16:18:53.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/3/new.json 2020-09-08T16:18:53.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDsrldfM3pWLhAA4W3zUZbpai90x/95k9GNkg== --osd-uuid 8e774c82-ab82-43ce-8f57-98970e1ca92a 2020-09-08T16:18:53.344 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:53.349+0000 7fcc7c09cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:53.346 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:53.351+0000 7fcc7c09cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:53.346 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:53.352+0000 7fcc7c09cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:53.347 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:53.352+0000 7fcc7c09cec0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2020-09-08T16:18:53.347 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:53.352+0000 7fcc7c09cec0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2020-09-08T16:18:53.348 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:53.352+0000 7fcc7c09cec0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2020-09-08T16:18:53.399 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:53.404+0000 7fcc7c09cec0 -1 bluestore(td/osd-backfill-space/3) _read_fsid unparsable uuid 2020-09-08T16:18:57.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/3/keyring 2020-09-08T16:18:57.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:18:57.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T16:18:57.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:18:57.650 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T16:18:58.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T16:18:58.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:18:58.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:18:58.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:18:58.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:18:58.198 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T16:18:58.222 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:58.227+0000 7f9fc4577ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:58.230 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:58.235+0000 7f9fc4577ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:58.232 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:58.237+0000 7f9fc4577ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:18:58.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T16:18:58.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:18:58.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T16:18:58.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:18:58.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:18:58.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:18:58.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:18:58.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:18:58.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:18:58.596 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:18:58.747 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:58.752+0000 7f9fc4577ec0 -1 Falling back to public interface 2020-09-08T16:18:59.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:18:59.555 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:18:59.560+0000 7f9fc4577ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T16:19:00.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:19:00.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:19:00.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:19:00.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:19:00.012 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:19:00.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:19:00.457 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/369887,v1:127.0.0.1:6827/369887] [v2:127.0.0.1:6828/369887,v1:127.0.0.1:6829/369887] exists,up 8e774c82-ab82-43ce-8f57-98970e1ca92a 2020-09-08T16:19:00.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:19:00.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:19:00.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:19:00.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:302: TEST_backfill_test_sametarget: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:19:00.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:304: TEST_backfill_test_sametarget: run_osd td/osd-backfill-space 4 2020-09-08T16:19:00.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:19:00.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:19:00.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=4 2020-09-08T16:19:00.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:19:00.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/4 2020-09-08T16:19:00.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:19:00.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:19:00.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:19:00.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:19:00.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/4' 2020-09-08T16:19:00.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/4/journal' 2020-09-08T16:19:00.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:19:00.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:19:00.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:19:00.461 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:19:00.462 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:19:00.462 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:19:00.462 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:19:00.462 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:19:00.462 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:19:00.462 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:19:00.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:19:00.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:19:00.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:19:00.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:19:00.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:19:00.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:19:00.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:19:00.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:19:00.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:19:00.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:19:00.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:19:00.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/4 2020-09-08T16:19:00.465 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:19:00.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=b14b8223-65ce-4e7d-94c9-8c9e17d0aa31 2020-09-08T16:19:00.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd4 b14b8223-65ce-4e7d-94c9-8c9e17d0aa31' 2020-09-08T16:19:00.466 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:19:00.466 INFO:tasks.workunit.client.0.smithi065.stdout:add osd4 b14b8223-65ce-4e7d-94c9-8c9e17d0aa31 2020-09-08T16:19:00.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQD0rldfgRiuHBAAtn2o4jJc6u8XrJBFGSxVww== 2020-09-08T16:19:00.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQD0rldfgRiuHBAAtn2o4jJc6u8XrJBFGSxVww=="}' 2020-09-08T16:19:00.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new b14b8223-65ce-4e7d-94c9-8c9e17d0aa31 -i td/osd-backfill-space/4/new.json 2020-09-08T16:19:01.011 INFO:tasks.workunit.client.0.smithi065.stdout:4 2020-09-08T16:19:01.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/4/new.json 2020-09-08T16:19:01.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 4 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQD0rldfgRiuHBAAtn2o4jJc6u8XrJBFGSxVww== --osd-uuid b14b8223-65ce-4e7d-94c9-8c9e17d0aa31 2020-09-08T16:19:01.050 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:19:01.056+0000 7fc30d0d2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:19:01.052 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:19:01.057+0000 7fc30d0d2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:19:01.053 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:19:01.058+0000 7fc30d0d2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:19:01.053 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:19:01.059+0000 7fc30d0d2ec0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2020-09-08T16:19:01.054 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:19:01.059+0000 7fc30d0d2ec0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2020-09-08T16:19:01.054 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:19:01.059+0000 7fc30d0d2ec0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2020-09-08T16:19:01.087 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:19:01.093+0000 7fc30d0d2ec0 -1 bluestore(td/osd-backfill-space/4) _read_fsid unparsable uuid 2020-09-08T16:19:05.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/4/keyring 2020-09-08T16:19:05.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:19:05.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd4 key to auth repository 2020-09-08T16:19:05.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:19:05.517 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd4 key to auth repository 2020-09-08T16:19:06.052 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.4 2020-09-08T16:19:06.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.4 2020-09-08T16:19:06.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:19:06.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:19:06.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:19:06.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 4 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:19:06.078 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:19:06.084+0000 7fb8b36c2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:19:06.080 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:19:06.086+0000 7fb8b36c2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:19:06.081 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:19:06.087+0000 7fb8b36c2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:19:06.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 4 2020-09-08T16:19:06.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:19:06.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=4 2020-09-08T16:19:06.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:19:06.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:19:06.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:19:06.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:19:06.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:19:06.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:19:06.478 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:19:06.606 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:19:06.612+0000 7fb8b36c2ec0 -1 Falling back to public interface 2020-09-08T16:19:06.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:19:07.466 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:19:07.471+0000 7fb8b36c2ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-09-08T16:19:07.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:19:07.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:19:07.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:19:07.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:19:07.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:19:07.876 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:19:08.301 INFO:tasks.workunit.client.0.smithi065.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/370881,v1:127.0.0.1:6835/370881] [v2:127.0.0.1:6836/370881,v1:127.0.0.1:6837/370881] exists,up b14b8223-65ce-4e7d-94c9-8c9e17d0aa31 2020-09-08T16:19:08.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:19:08.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:19:08.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:19:08.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:307: TEST_backfill_test_sametarget: ceph osd set-backfillfull-ratio .85 2020-09-08T16:19:09.227 INFO:tasks.workunit.client.0.smithi065.stderr:osd set-backfillfull-ratio 0.85 2020-09-08T16:19:09.236 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:309: TEST_backfill_test_sametarget: seq 1 10 2020-09-08T16:19:09.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:309: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:09.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:311: TEST_backfill_test_sametarget: create_pool test1 1 1 2020-09-08T16:19:09.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test1 1 1 2020-09-08T16:19:09.725 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test1' already exists 2020-09-08T16:19:09.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:19:10.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: ceph osd pool set test1 size 2 2020-09-08T16:19:11.759 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 2 2020-09-08T16:19:11.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:309: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:11.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:311: TEST_backfill_test_sametarget: create_pool test2 1 1 2020-09-08T16:19:11.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test2 1 1 2020-09-08T16:19:12.491 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test2' already exists 2020-09-08T16:19:12.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:19:13.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: ceph osd pool set test2 size 2 2020-09-08T16:19:14.510 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 2 size to 2 2020-09-08T16:19:14.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:309: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:14.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:311: TEST_backfill_test_sametarget: create_pool test3 1 1 2020-09-08T16:19:14.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test3 1 1 2020-09-08T16:19:15.118 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test3' already exists 2020-09-08T16:19:15.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:19:16.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: ceph osd pool set test3 size 2 2020-09-08T16:19:16.829 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 3 size to 2 2020-09-08T16:19:16.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:309: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:16.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:311: TEST_backfill_test_sametarget: create_pool test4 1 1 2020-09-08T16:19:16.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test4 1 1 2020-09-08T16:19:17.447 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test4' already exists 2020-09-08T16:19:17.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:19:18.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: ceph osd pool set test4 size 2 2020-09-08T16:19:19.342 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 4 size to 2 2020-09-08T16:19:19.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:309: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:19.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:311: TEST_backfill_test_sametarget: create_pool test5 1 1 2020-09-08T16:19:19.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test5 1 1 2020-09-08T16:19:19.992 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test5' already exists 2020-09-08T16:19:20.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:19:21.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: ceph osd pool set test5 size 2 2020-09-08T16:19:21.785 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 5 size to 2 2020-09-08T16:19:21.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:309: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:21.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:311: TEST_backfill_test_sametarget: create_pool test6 1 1 2020-09-08T16:19:21.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test6 1 1 2020-09-08T16:19:22.420 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test6' already exists 2020-09-08T16:19:22.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:19:23.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: ceph osd pool set test6 size 2 2020-09-08T16:19:24.230 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 6 size to 2 2020-09-08T16:19:24.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:309: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:24.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:311: TEST_backfill_test_sametarget: create_pool test7 1 1 2020-09-08T16:19:24.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test7 1 1 2020-09-08T16:19:24.842 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test7' already exists 2020-09-08T16:19:24.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:19:25.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: ceph osd pool set test7 size 2 2020-09-08T16:19:26.692 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 7 size to 2 2020-09-08T16:19:26.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:309: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:26.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:311: TEST_backfill_test_sametarget: create_pool test8 1 1 2020-09-08T16:19:26.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test8 1 1 2020-09-08T16:19:27.300 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test8' already exists 2020-09-08T16:19:27.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:19:28.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: ceph osd pool set test8 size 2 2020-09-08T16:19:29.076 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 8 size to 2 2020-09-08T16:19:29.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:309: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:29.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:311: TEST_backfill_test_sametarget: create_pool test9 1 1 2020-09-08T16:19:29.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test9 1 1 2020-09-08T16:19:29.820 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test9' already exists 2020-09-08T16:19:29.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:19:30.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: ceph osd pool set test9 size 2 2020-09-08T16:19:31.715 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 9 size to 2 2020-09-08T16:19:31.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:309: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:31.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:311: TEST_backfill_test_sametarget: create_pool test10 1 1 2020-09-08T16:19:31.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test10 1 1 2020-09-08T16:19:32.636 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test10' already exists 2020-09-08T16:19:32.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:19:33.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: ceph osd pool set test10 size 2 2020-09-08T16:19:34.409 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 10 size to 2 2020-09-08T16:19:34.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:314: TEST_backfill_test_sametarget: sleep 5 2020-09-08T16:19:39.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:316: TEST_backfill_test_sametarget: wait_for_clean 2020-09-08T16:19:39.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:19:39.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:19:39.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:19:39.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:19:39.420 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:19:39.421 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:19:39.421 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:19:39.422 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:19:39.422 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:19:39.422 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:19:39.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:19:39.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:19:39.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:19:39.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:19:39.531 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:19:39.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:19:39.934 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:19:39.934 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:19:39.935 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:19:39.935 INFO:tasks.workunit.client.0.smithi065.stderr:4' 2020-09-08T16:19:39.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:19:39.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:19:39.935 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:19:40.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836495 2020-09-08T16:19:40.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836495 2020-09-08T16:19:40.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495' 2020-09-08T16:19:40.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:19:40.076 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:19:40.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672973 2020-09-08T16:19:40.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672973 2020-09-08T16:19:40.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495 1-42949672973' 2020-09-08T16:19:40.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:19:40.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:19:40.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509453 2020-09-08T16:19:40.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509453 2020-09-08T16:19:40.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495 1-42949672973 2-64424509453' 2020-09-08T16:19:40.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:19:40.343 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:19:40.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345930 2020-09-08T16:19:40.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345930 2020-09-08T16:19:40.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495 1-42949672973 2-64424509453 3-85899345930' 2020-09-08T16:19:40.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:19:40.476 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:19:40.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182409 2020-09-08T16:19:40.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182409 2020-09-08T16:19:40.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495 1-42949672973 2-64424509453 3-85899345930 4-107374182409' 2020-09-08T16:19:40.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:19:40.610 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836495 2020-09-08T16:19:40.611 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:19:40.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:19:40.611 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836495 2020-09-08T16:19:40.612 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:19:40.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836495 2020-09-08T16:19:40.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836495' 2020-09-08T16:19:40.613 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:19:40.613 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836495 2020-09-08T16:19:41.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836493 -lt 21474836495 2020-09-08T16:19:41.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:19:42.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:19:42.010 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:19:42.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836495 -lt 21474836495 2020-09-08T16:19:42.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:19:42.422 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672973 2020-09-08T16:19:42.422 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:19:42.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:19:42.423 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672973 2020-09-08T16:19:42.423 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:19:42.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672973 2020-09-08T16:19:42.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672973' 2020-09-08T16:19:42.424 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:19:42.424 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672973 2020-09-08T16:19:42.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672974 -lt 42949672973 2020-09-08T16:19:42.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:19:42.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509453 2020-09-08T16:19:42.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:19:42.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:19:42.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509453 2020-09-08T16:19:42.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:19:42.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509453 2020-09-08T16:19:42.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509453' 2020-09-08T16:19:42.834 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509453 2020-09-08T16:19:42.834 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:19:43.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509453 -lt 64424509453 2020-09-08T16:19:43.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:19:43.231 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345930 2020-09-08T16:19:43.231 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:19:43.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:19:43.232 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345930 2020-09-08T16:19:43.232 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:19:43.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345930 2020-09-08T16:19:43.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345930' 2020-09-08T16:19:43.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:19:43.234 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345930 2020-09-08T16:19:43.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345931 -lt 85899345930 2020-09-08T16:19:43.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:19:43.630 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182409 2020-09-08T16:19:43.630 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:19:43.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:19:43.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182409 2020-09-08T16:19:43.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:19:43.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182409 2020-09-08T16:19:43.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182409' 2020-09-08T16:19:43.632 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:19:43.633 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182409 2020-09-08T16:19:44.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182409 -lt 107374182409 2020-09-08T16:19:44.038 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:19:44.038 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:19:44.039 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:19:44.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 10 == 0 2020-09-08T16:19:44.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:19:44.569 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:19:44.569 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:19:44.569 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:19:44.570 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:19:44.570 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:19:44.570 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:19:44.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=10 2020-09-08T16:19:44.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:19:44.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:19:44.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:19:45.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 10 = 10 2020-09-08T16:19:45.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:19:45.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:19:45.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:318: TEST_backfill_test_sametarget: ceph pg dump pgs 2020-09-08T16:19:45.872 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T16:19:45.872 INFO:tasks.workunit.client.0.smithi065.stdout:10.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T16:19:37.117587+0000 0'0 80:14 [2,1] 2 [2,1] 2 0'0 2020-09-08T16:19:32.300142+0000 0'0 2020-09-08T16:19:32.300142+0000 0 2020-09-08T16:19:45.872 INFO:tasks.workunit.client.0.smithi065.stdout:9.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T16:19:33.383424+0000 0'0 80:24 [1,2] 1 [1,2] 1 0'0 2020-09-08T16:19:29.505956+0000 0'0 2020-09-08T16:19:29.505956+0000 0 2020-09-08T16:19:45.873 INFO:tasks.workunit.client.0.smithi065.stdout:8.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T16:19:29.805376+0000 0'0 80:29 [3,4] 3 [3,4] 3 0'0 2020-09-08T16:19:27.086875+0000 0'0 2020-09-08T16:19:27.086875+0000 0 2020-09-08T16:19:45.873 INFO:tasks.workunit.client.0.smithi065.stdout:7.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T16:19:27.772840+0000 0'0 80:33 [1,4] 1 [1,4] 1 0'0 2020-09-08T16:19:24.617447+0000 0'0 2020-09-08T16:19:24.617447+0000 0 2020-09-08T16:19:45.873 INFO:tasks.workunit.client.0.smithi065.stdout:2.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T16:19:14.731052+0000 0'0 80:48 [3,1] 3 [3,1] 3 0'0 2020-09-08T16:19:12.151024+0000 0'0 2020-09-08T16:19:12.151024+0000 0 2020-09-08T16:19:45.873 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T16:19:12.176543+0000 0'0 80:58 [1,0] 1 [1,0] 1 0'0 2020-09-08T16:19:09.539157+0000 0'0 2020-09-08T16:19:09.539157+0000 0 2020-09-08T16:19:45.874 INFO:tasks.workunit.client.0.smithi065.stdout:3.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T16:19:17.134651+0000 0'0 80:48 [1,2] 1 [1,2] 1 0'0 2020-09-08T16:19:14.862085+0000 0'0 2020-09-08T16:19:14.862085+0000 0 2020-09-08T16:19:45.874 INFO:tasks.workunit.client.0.smithi065.stdout:4.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T16:19:19.647651+0000 0'0 80:44 [4,0] 4 [4,0] 4 0'0 2020-09-08T16:19:17.184627+0000 0'0 2020-09-08T16:19:17.184627+0000 0 2020-09-08T16:19:45.874 INFO:tasks.workunit.client.0.smithi065.stdout:5.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T16:19:22.850970+0000 0'0 80:31 [3,4] 3 [3,4] 3 0'0 2020-09-08T16:19:19.713997+0000 0'0 2020-09-08T16:19:19.713997+0000 0 2020-09-08T16:19:45.874 INFO:tasks.workunit.client.0.smithi065.stdout:6.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T16:19:24.500608+0000 0'0 80:30 [4,2] 4 [4,2] 4 0'0 2020-09-08T16:19:22.173644+0000 0'0 2020-09-08T16:19:22.173644+0000 0 2020-09-08T16:19:45.874 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T16:19:45.875 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T16:19:45.875 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:19:45.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:322: TEST_backfill_test_sametarget: local PG1 2020-09-08T16:19:45.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:323: TEST_backfill_test_sametarget: local POOLNUM1 2020-09-08T16:19:45.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:324: TEST_backfill_test_sametarget: local pool1 2020-09-08T16:19:45.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:325: TEST_backfill_test_sametarget: local chk_osd1 2020-09-08T16:19:45.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:326: TEST_backfill_test_sametarget: local chk_osd2 2020-09-08T16:19:45.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:328: TEST_backfill_test_sametarget: local PG2 2020-09-08T16:19:45.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:329: TEST_backfill_test_sametarget: local POOLNUM2 2020-09-08T16:19:45.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:330: TEST_backfill_test_sametarget: local pool2 2020-09-08T16:19:45.884 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:331: TEST_backfill_test_sametarget: seq 1 10 2020-09-08T16:19:45.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:331: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:45.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:333: TEST_backfill_test_sametarget: ceph pg map 1.0 --format=json 2020-09-08T16:19:45.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:333: TEST_backfill_test_sametarget: jq '.acting[]' 2020-09-08T16:19:46.294 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: head -1 td/osd-backfill-space/acting 2020-09-08T16:19:46.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: local test_osd1=1 2020-09-08T16:19:46.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: tail -1 td/osd-backfill-space/acting 2020-09-08T16:19:46.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: local test_osd2=0 2020-09-08T16:19:46.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:336: TEST_backfill_test_sametarget: '[' 1 = 1 ']' 2020-09-08T16:19:46.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:338: TEST_backfill_test_sametarget: PG1=1.0 2020-09-08T16:19:46.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:339: TEST_backfill_test_sametarget: POOLNUM1=1 2020-09-08T16:19:46.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:340: TEST_backfill_test_sametarget: pool1=test1 2020-09-08T16:19:46.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:341: TEST_backfill_test_sametarget: chk_osd1=1 2020-09-08T16:19:46.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:342: TEST_backfill_test_sametarget: chk_osd2=0 2020-09-08T16:19:46.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:331: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:46.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:333: TEST_backfill_test_sametarget: ceph pg map 2.0 --format=json 2020-09-08T16:19:46.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:333: TEST_backfill_test_sametarget: jq '.acting[]' 2020-09-08T16:19:46.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: head -1 td/osd-backfill-space/acting 2020-09-08T16:19:46.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: local test_osd1=3 2020-09-08T16:19:46.689 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: tail -1 td/osd-backfill-space/acting 2020-09-08T16:19:46.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: local test_osd2=1 2020-09-08T16:19:46.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:336: TEST_backfill_test_sametarget: '[' 2 = 1 ']' 2020-09-08T16:19:46.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:343: TEST_backfill_test_sametarget: '[' 1 '!=' 3 -a 0 = 1 ']' 2020-09-08T16:19:46.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:331: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:46.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:333: TEST_backfill_test_sametarget: ceph pg map 3.0 --format=json 2020-09-08T16:19:46.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:333: TEST_backfill_test_sametarget: jq '.acting[]' 2020-09-08T16:19:47.096 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: head -1 td/osd-backfill-space/acting 2020-09-08T16:19:47.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: local test_osd1=1 2020-09-08T16:19:47.097 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: tail -1 td/osd-backfill-space/acting 2020-09-08T16:19:47.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: local test_osd2=2 2020-09-08T16:19:47.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:336: TEST_backfill_test_sametarget: '[' 3 = 1 ']' 2020-09-08T16:19:47.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:343: TEST_backfill_test_sametarget: '[' 1 '!=' 1 -a 0 = 2 ']' 2020-09-08T16:19:47.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:331: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:47.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:333: TEST_backfill_test_sametarget: ceph pg map 4.0 --format=json 2020-09-08T16:19:47.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:333: TEST_backfill_test_sametarget: jq '.acting[]' 2020-09-08T16:19:47.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: head -1 td/osd-backfill-space/acting 2020-09-08T16:19:47.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: local test_osd1=4 2020-09-08T16:19:47.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: tail -1 td/osd-backfill-space/acting 2020-09-08T16:19:47.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: local test_osd2=0 2020-09-08T16:19:47.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:336: TEST_backfill_test_sametarget: '[' 4 = 1 ']' 2020-09-08T16:19:47.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:343: TEST_backfill_test_sametarget: '[' 1 '!=' 4 -a 0 = 0 ']' 2020-09-08T16:19:47.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:345: TEST_backfill_test_sametarget: PG2=4.0 2020-09-08T16:19:47.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:346: TEST_backfill_test_sametarget: POOLNUM2=4 2020-09-08T16:19:47.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:347: TEST_backfill_test_sametarget: pool2=test4 2020-09-08T16:19:47.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:348: TEST_backfill_test_sametarget: break 2020-09-08T16:19:47.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:351: TEST_backfill_test_sametarget: rm -f td/osd-backfill-space/acting 2020-09-08T16:19:47.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:353: TEST_backfill_test_sametarget: '[' test4 = '' ']' 2020-09-08T16:19:47.495 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:359: TEST_backfill_test_sametarget: seq 1 10 2020-09-08T16:19:47.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:359: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:47.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:361: TEST_backfill_test_sametarget: '[' 1 '!=' 1 -a 1 '!=' 4 ']' 2020-09-08T16:19:47.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:359: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:47.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:361: TEST_backfill_test_sametarget: '[' 2 '!=' 1 -a 2 '!=' 4 ']' 2020-09-08T16:19:47.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:363: TEST_backfill_test_sametarget: delete_pool test2 2020-09-08T16:19:47.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test2 2020-09-08T16:19:47.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test2 test2 --yes-i-really-really-mean-it 2020-09-08T16:19:48.014 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test2' does not exist 2020-09-08T16:19:48.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:359: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:48.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:361: TEST_backfill_test_sametarget: '[' 3 '!=' 1 -a 3 '!=' 4 ']' 2020-09-08T16:19:48.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:363: TEST_backfill_test_sametarget: delete_pool test3 2020-09-08T16:19:48.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test3 2020-09-08T16:19:48.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test3 test3 --yes-i-really-really-mean-it 2020-09-08T16:19:48.607 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test3' does not exist 2020-09-08T16:19:48.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:359: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:48.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:361: TEST_backfill_test_sametarget: '[' 4 '!=' 1 -a 4 '!=' 4 ']' 2020-09-08T16:19:48.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:359: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:48.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:361: TEST_backfill_test_sametarget: '[' 5 '!=' 1 -a 5 '!=' 4 ']' 2020-09-08T16:19:48.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:363: TEST_backfill_test_sametarget: delete_pool test5 2020-09-08T16:19:48.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test5 2020-09-08T16:19:48.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test5 test5 --yes-i-really-really-mean-it 2020-09-08T16:19:49.154 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test5' does not exist 2020-09-08T16:19:49.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:359: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:49.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:361: TEST_backfill_test_sametarget: '[' 6 '!=' 1 -a 6 '!=' 4 ']' 2020-09-08T16:19:49.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:363: TEST_backfill_test_sametarget: delete_pool test6 2020-09-08T16:19:49.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test6 2020-09-08T16:19:49.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test6 test6 --yes-i-really-really-mean-it 2020-09-08T16:19:49.762 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test6' does not exist 2020-09-08T16:19:49.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:359: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:49.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:361: TEST_backfill_test_sametarget: '[' 7 '!=' 1 -a 7 '!=' 4 ']' 2020-09-08T16:19:49.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:363: TEST_backfill_test_sametarget: delete_pool test7 2020-09-08T16:19:49.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test7 2020-09-08T16:19:49.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test7 test7 --yes-i-really-really-mean-it 2020-09-08T16:19:50.309 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test7' does not exist 2020-09-08T16:19:50.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:359: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:50.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:361: TEST_backfill_test_sametarget: '[' 8 '!=' 1 -a 8 '!=' 4 ']' 2020-09-08T16:19:50.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:363: TEST_backfill_test_sametarget: delete_pool test8 2020-09-08T16:19:50.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test8 2020-09-08T16:19:50.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test8 test8 --yes-i-really-really-mean-it 2020-09-08T16:19:50.870 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test8' does not exist 2020-09-08T16:19:50.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:359: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:50.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:361: TEST_backfill_test_sametarget: '[' 9 '!=' 1 -a 9 '!=' 4 ']' 2020-09-08T16:19:50.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:363: TEST_backfill_test_sametarget: delete_pool test9 2020-09-08T16:19:50.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test9 2020-09-08T16:19:50.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test9 test9 --yes-i-really-really-mean-it 2020-09-08T16:19:51.422 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test9' does not exist 2020-09-08T16:19:51.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:359: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2020-09-08T16:19:51.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:361: TEST_backfill_test_sametarget: '[' 10 '!=' 1 -a 10 '!=' 4 ']' 2020-09-08T16:19:51.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:363: TEST_backfill_test_sametarget: delete_pool test10 2020-09-08T16:19:51.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test10 2020-09-08T16:19:51.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test10 test10 --yes-i-really-really-mean-it 2020-09-08T16:19:51.947 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test10' does not exist 2020-09-08T16:19:51.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:367: TEST_backfill_test_sametarget: ceph osd pool set test1 size 1 --yes-i-really-mean-it 2020-09-08T16:19:52.878 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 1 2020-09-08T16:19:52.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:368: TEST_backfill_test_sametarget: ceph osd pool set test4 size 1 --yes-i-really-mean-it 2020-09-08T16:19:53.698 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 4 size to 1 2020-09-08T16:19:53.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:370: TEST_backfill_test_sametarget: wait_for_clean 2020-09-08T16:19:53.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:19:53.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:19:53.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:19:53.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:19:53.708 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:19:53.709 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:19:53.709 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:19:53.710 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:19:53.710 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:19:53.710 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:19:53.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:19:53.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:19:53.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:19:53.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:19:53.807 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:19:54.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:19:54.222 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:19:54.223 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:19:54.223 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:19:54.223 INFO:tasks.workunit.client.0.smithi065.stderr:4' 2020-09-08T16:19:54.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:19:54.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:19:54.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:19:54.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836500 2020-09-08T16:19:54.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836500 2020-09-08T16:19:54.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836500' 2020-09-08T16:19:54.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:19:54.371 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:19:54.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672978 2020-09-08T16:19:54.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672978 2020-09-08T16:19:54.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836500 1-42949672978' 2020-09-08T16:19:54.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:19:54.505 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:19:54.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509458 2020-09-08T16:19:54.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509458 2020-09-08T16:19:54.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836500 1-42949672978 2-64424509458' 2020-09-08T16:19:54.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:19:54.639 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:19:54.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345935 2020-09-08T16:19:54.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345935 2020-09-08T16:19:54.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836500 1-42949672978 2-64424509458 3-85899345935' 2020-09-08T16:19:54.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:19:54.773 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:19:54.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182414 2020-09-08T16:19:54.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182414 2020-09-08T16:19:54.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836500 1-42949672978 2-64424509458 3-85899345935 4-107374182414' 2020-09-08T16:19:54.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:19:54.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836500 2020-09-08T16:19:54.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:19:54.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:19:54.908 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836500 2020-09-08T16:19:54.908 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:19:54.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836500 2020-09-08T16:19:54.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836500' 2020-09-08T16:19:54.909 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836500 2020-09-08T16:19:54.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:19:55.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836498 -lt 21474836500 2020-09-08T16:19:55.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:19:56.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:19:56.304 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:19:56.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836500 -lt 21474836500 2020-09-08T16:19:56.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:19:56.715 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672978 2020-09-08T16:19:56.715 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:19:56.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:19:56.718 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672978 2020-09-08T16:19:56.718 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:19:56.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672978 2020-09-08T16:19:56.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672978' 2020-09-08T16:19:56.719 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:19:56.719 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672978 2020-09-08T16:19:57.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672979 -lt 42949672978 2020-09-08T16:19:57.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:19:57.129 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509458 2020-09-08T16:19:57.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:19:57.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:19:57.131 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509458 2020-09-08T16:19:57.131 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:19:57.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509458 2020-09-08T16:19:57.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509458' 2020-09-08T16:19:57.132 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:19:57.132 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509458 2020-09-08T16:19:57.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509458 -lt 64424509458 2020-09-08T16:19:57.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:19:57.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345935 2020-09-08T16:19:57.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:19:57.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:19:57.530 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345935 2020-09-08T16:19:57.530 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:19:57.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345935 2020-09-08T16:19:57.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345935' 2020-09-08T16:19:57.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:19:57.532 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345935 2020-09-08T16:19:57.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345936 -lt 85899345935 2020-09-08T16:19:57.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:19:57.933 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182414 2020-09-08T16:19:57.934 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:19:57.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:19:57.935 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182414 2020-09-08T16:19:57.935 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:19:57.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182414 2020-09-08T16:19:57.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182414' 2020-09-08T16:19:57.936 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:19:57.936 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182414 2020-09-08T16:19:58.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182414 -lt 107374182414 2020-09-08T16:19:58.362 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:19:58.363 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:19:58.363 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:19:58.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 2 == 0 2020-09-08T16:19:58.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:19:58.878 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:19:58.878 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:19:58.878 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:19:58.878 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:19:58.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:19:58.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:19:59.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=2 2020-09-08T16:19:59.260 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:19:59.260 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:19:59.260 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:19:59.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 2 = 2 2020-09-08T16:19:59.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:19:59.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:19:59.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:372: TEST_backfill_test_sametarget: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=4 2020-09-08T16:19:59.791 INFO:tasks.workunit.client.0.smithi065.stderr:4+0 records in 2020-09-08T16:19:59.792 INFO:tasks.workunit.client.0.smithi065.stderr:4+0 records out 2020-09-08T16:19:59.792 INFO:tasks.workunit.client.0.smithi065.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 7.0765e-05 s, 57.9 MB/s 2020-09-08T16:19:59.792 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: seq 1 600 2020-09-08T16:19:59.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:19:59.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj1 td/osd-backfill-space/datafile 2020-09-08T16:19:59.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj1 td/osd-backfill-space/datafile 2020-09-08T16:19:59.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:19:59.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj2 td/osd-backfill-space/datafile 2020-09-08T16:20:00.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj2 td/osd-backfill-space/datafile 2020-09-08T16:20:00.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:00.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj3 td/osd-backfill-space/datafile 2020-09-08T16:20:00.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj3 td/osd-backfill-space/datafile 2020-09-08T16:20:00.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:00.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj4 td/osd-backfill-space/datafile 2020-09-08T16:20:00.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj4 td/osd-backfill-space/datafile 2020-09-08T16:20:00.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:00.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj5 td/osd-backfill-space/datafile 2020-09-08T16:20:00.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj5 td/osd-backfill-space/datafile 2020-09-08T16:20:00.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:00.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj6 td/osd-backfill-space/datafile 2020-09-08T16:20:00.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj6 td/osd-backfill-space/datafile 2020-09-08T16:20:00.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:00.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj7 td/osd-backfill-space/datafile 2020-09-08T16:20:00.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj7 td/osd-backfill-space/datafile 2020-09-08T16:20:00.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:00.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj8 td/osd-backfill-space/datafile 2020-09-08T16:20:01.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj8 td/osd-backfill-space/datafile 2020-09-08T16:20:01.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:01.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj9 td/osd-backfill-space/datafile 2020-09-08T16:20:01.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj9 td/osd-backfill-space/datafile 2020-09-08T16:20:01.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:01.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj10 td/osd-backfill-space/datafile 2020-09-08T16:20:01.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj10 td/osd-backfill-space/datafile 2020-09-08T16:20:01.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:01.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj11 td/osd-backfill-space/datafile 2020-09-08T16:20:01.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj11 td/osd-backfill-space/datafile 2020-09-08T16:20:01.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:01.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj12 td/osd-backfill-space/datafile 2020-09-08T16:20:01.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj12 td/osd-backfill-space/datafile 2020-09-08T16:20:01.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:01.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj13 td/osd-backfill-space/datafile 2020-09-08T16:20:01.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj13 td/osd-backfill-space/datafile 2020-09-08T16:20:01.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:01.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj14 td/osd-backfill-space/datafile 2020-09-08T16:20:01.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj14 td/osd-backfill-space/datafile 2020-09-08T16:20:02.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:02.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj15 td/osd-backfill-space/datafile 2020-09-08T16:20:02.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj15 td/osd-backfill-space/datafile 2020-09-08T16:20:02.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:02.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj16 td/osd-backfill-space/datafile 2020-09-08T16:20:02.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj16 td/osd-backfill-space/datafile 2020-09-08T16:20:02.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:02.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj17 td/osd-backfill-space/datafile 2020-09-08T16:20:02.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj17 td/osd-backfill-space/datafile 2020-09-08T16:20:02.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:02.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj18 td/osd-backfill-space/datafile 2020-09-08T16:20:02.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj18 td/osd-backfill-space/datafile 2020-09-08T16:20:02.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:02.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj19 td/osd-backfill-space/datafile 2020-09-08T16:20:02.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj19 td/osd-backfill-space/datafile 2020-09-08T16:20:02.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:02.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj20 td/osd-backfill-space/datafile 2020-09-08T16:20:02.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj20 td/osd-backfill-space/datafile 2020-09-08T16:20:03.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:03.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj21 td/osd-backfill-space/datafile 2020-09-08T16:20:03.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj21 td/osd-backfill-space/datafile 2020-09-08T16:20:03.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:03.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj22 td/osd-backfill-space/datafile 2020-09-08T16:20:03.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj22 td/osd-backfill-space/datafile 2020-09-08T16:20:03.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:03.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj23 td/osd-backfill-space/datafile 2020-09-08T16:20:03.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj23 td/osd-backfill-space/datafile 2020-09-08T16:20:03.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:03.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj24 td/osd-backfill-space/datafile 2020-09-08T16:20:03.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj24 td/osd-backfill-space/datafile 2020-09-08T16:20:03.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:03.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj25 td/osd-backfill-space/datafile 2020-09-08T16:20:03.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj25 td/osd-backfill-space/datafile 2020-09-08T16:20:03.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:03.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj26 td/osd-backfill-space/datafile 2020-09-08T16:20:04.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj26 td/osd-backfill-space/datafile 2020-09-08T16:20:04.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:04.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj27 td/osd-backfill-space/datafile 2020-09-08T16:20:04.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj27 td/osd-backfill-space/datafile 2020-09-08T16:20:04.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:04.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj28 td/osd-backfill-space/datafile 2020-09-08T16:20:04.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj28 td/osd-backfill-space/datafile 2020-09-08T16:20:04.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:04.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj29 td/osd-backfill-space/datafile 2020-09-08T16:20:04.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj29 td/osd-backfill-space/datafile 2020-09-08T16:20:04.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:04.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj30 td/osd-backfill-space/datafile 2020-09-08T16:20:04.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj30 td/osd-backfill-space/datafile 2020-09-08T16:20:04.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:04.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj31 td/osd-backfill-space/datafile 2020-09-08T16:20:04.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj31 td/osd-backfill-space/datafile 2020-09-08T16:20:04.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:04.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj32 td/osd-backfill-space/datafile 2020-09-08T16:20:05.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj32 td/osd-backfill-space/datafile 2020-09-08T16:20:05.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:05.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj33 td/osd-backfill-space/datafile 2020-09-08T16:20:05.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj33 td/osd-backfill-space/datafile 2020-09-08T16:20:05.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:05.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj34 td/osd-backfill-space/datafile 2020-09-08T16:20:05.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj34 td/osd-backfill-space/datafile 2020-09-08T16:20:05.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:05.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj35 td/osd-backfill-space/datafile 2020-09-08T16:20:05.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj35 td/osd-backfill-space/datafile 2020-09-08T16:20:05.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:05.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj36 td/osd-backfill-space/datafile 2020-09-08T16:20:05.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj36 td/osd-backfill-space/datafile 2020-09-08T16:20:05.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:05.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj37 td/osd-backfill-space/datafile 2020-09-08T16:20:05.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj37 td/osd-backfill-space/datafile 2020-09-08T16:20:05.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:05.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj38 td/osd-backfill-space/datafile 2020-09-08T16:20:05.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj38 td/osd-backfill-space/datafile 2020-09-08T16:20:06.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:06.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj39 td/osd-backfill-space/datafile 2020-09-08T16:20:06.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj39 td/osd-backfill-space/datafile 2020-09-08T16:20:06.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:06.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj40 td/osd-backfill-space/datafile 2020-09-08T16:20:06.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj40 td/osd-backfill-space/datafile 2020-09-08T16:20:06.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:06.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj41 td/osd-backfill-space/datafile 2020-09-08T16:20:06.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj41 td/osd-backfill-space/datafile 2020-09-08T16:20:06.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:06.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj42 td/osd-backfill-space/datafile 2020-09-08T16:20:06.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj42 td/osd-backfill-space/datafile 2020-09-08T16:20:06.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:06.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj43 td/osd-backfill-space/datafile 2020-09-08T16:20:06.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj43 td/osd-backfill-space/datafile 2020-09-08T16:20:06.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:06.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj44 td/osd-backfill-space/datafile 2020-09-08T16:20:06.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj44 td/osd-backfill-space/datafile 2020-09-08T16:20:07.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:07.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj45 td/osd-backfill-space/datafile 2020-09-08T16:20:07.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj45 td/osd-backfill-space/datafile 2020-09-08T16:20:07.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:07.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj46 td/osd-backfill-space/datafile 2020-09-08T16:20:07.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj46 td/osd-backfill-space/datafile 2020-09-08T16:20:07.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:07.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj47 td/osd-backfill-space/datafile 2020-09-08T16:20:07.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj47 td/osd-backfill-space/datafile 2020-09-08T16:20:07.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:07.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj48 td/osd-backfill-space/datafile 2020-09-08T16:20:07.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj48 td/osd-backfill-space/datafile 2020-09-08T16:20:07.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:07.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj49 td/osd-backfill-space/datafile 2020-09-08T16:20:07.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj49 td/osd-backfill-space/datafile 2020-09-08T16:20:07.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:07.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj50 td/osd-backfill-space/datafile 2020-09-08T16:20:07.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj50 td/osd-backfill-space/datafile 2020-09-08T16:20:07.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:07.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj51 td/osd-backfill-space/datafile 2020-09-08T16:20:08.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj51 td/osd-backfill-space/datafile 2020-09-08T16:20:08.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:08.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj52 td/osd-backfill-space/datafile 2020-09-08T16:20:08.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj52 td/osd-backfill-space/datafile 2020-09-08T16:20:08.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:08.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj53 td/osd-backfill-space/datafile 2020-09-08T16:20:08.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj53 td/osd-backfill-space/datafile 2020-09-08T16:20:08.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:08.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj54 td/osd-backfill-space/datafile 2020-09-08T16:20:08.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj54 td/osd-backfill-space/datafile 2020-09-08T16:20:08.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:08.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj55 td/osd-backfill-space/datafile 2020-09-08T16:20:08.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj55 td/osd-backfill-space/datafile 2020-09-08T16:20:08.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:08.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj56 td/osd-backfill-space/datafile 2020-09-08T16:20:08.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj56 td/osd-backfill-space/datafile 2020-09-08T16:20:08.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:08.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj57 td/osd-backfill-space/datafile 2020-09-08T16:20:09.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj57 td/osd-backfill-space/datafile 2020-09-08T16:20:09.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:09.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj58 td/osd-backfill-space/datafile 2020-09-08T16:20:09.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj58 td/osd-backfill-space/datafile 2020-09-08T16:20:09.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:09.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj59 td/osd-backfill-space/datafile 2020-09-08T16:20:09.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj59 td/osd-backfill-space/datafile 2020-09-08T16:20:09.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:09.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj60 td/osd-backfill-space/datafile 2020-09-08T16:20:09.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj60 td/osd-backfill-space/datafile 2020-09-08T16:20:09.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:09.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj61 td/osd-backfill-space/datafile 2020-09-08T16:20:09.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj61 td/osd-backfill-space/datafile 2020-09-08T16:20:09.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:09.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj62 td/osd-backfill-space/datafile 2020-09-08T16:20:09.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj62 td/osd-backfill-space/datafile 2020-09-08T16:20:09.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:09.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj63 td/osd-backfill-space/datafile 2020-09-08T16:20:09.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj63 td/osd-backfill-space/datafile 2020-09-08T16:20:10.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:10.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj64 td/osd-backfill-space/datafile 2020-09-08T16:20:10.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj64 td/osd-backfill-space/datafile 2020-09-08T16:20:10.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:10.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj65 td/osd-backfill-space/datafile 2020-09-08T16:20:10.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj65 td/osd-backfill-space/datafile 2020-09-08T16:20:10.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:10.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj66 td/osd-backfill-space/datafile 2020-09-08T16:20:10.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj66 td/osd-backfill-space/datafile 2020-09-08T16:20:10.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:10.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj67 td/osd-backfill-space/datafile 2020-09-08T16:20:10.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj67 td/osd-backfill-space/datafile 2020-09-08T16:20:10.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:10.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj68 td/osd-backfill-space/datafile 2020-09-08T16:20:10.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj68 td/osd-backfill-space/datafile 2020-09-08T16:20:10.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:10.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj69 td/osd-backfill-space/datafile 2020-09-08T16:20:10.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj69 td/osd-backfill-space/datafile 2020-09-08T16:20:11.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:11.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj70 td/osd-backfill-space/datafile 2020-09-08T16:20:11.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj70 td/osd-backfill-space/datafile 2020-09-08T16:20:11.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:11.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj71 td/osd-backfill-space/datafile 2020-09-08T16:20:11.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj71 td/osd-backfill-space/datafile 2020-09-08T16:20:11.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:11.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj72 td/osd-backfill-space/datafile 2020-09-08T16:20:11.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj72 td/osd-backfill-space/datafile 2020-09-08T16:20:11.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:11.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj73 td/osd-backfill-space/datafile 2020-09-08T16:20:11.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj73 td/osd-backfill-space/datafile 2020-09-08T16:20:11.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:11.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj74 td/osd-backfill-space/datafile 2020-09-08T16:20:11.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj74 td/osd-backfill-space/datafile 2020-09-08T16:20:11.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:11.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj75 td/osd-backfill-space/datafile 2020-09-08T16:20:11.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj75 td/osd-backfill-space/datafile 2020-09-08T16:20:11.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:11.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj76 td/osd-backfill-space/datafile 2020-09-08T16:20:12.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj76 td/osd-backfill-space/datafile 2020-09-08T16:20:12.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:12.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj77 td/osd-backfill-space/datafile 2020-09-08T16:20:12.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj77 td/osd-backfill-space/datafile 2020-09-08T16:20:12.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:12.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj78 td/osd-backfill-space/datafile 2020-09-08T16:20:12.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj78 td/osd-backfill-space/datafile 2020-09-08T16:20:12.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:12.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj79 td/osd-backfill-space/datafile 2020-09-08T16:20:12.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj79 td/osd-backfill-space/datafile 2020-09-08T16:20:12.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:12.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj80 td/osd-backfill-space/datafile 2020-09-08T16:20:12.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj80 td/osd-backfill-space/datafile 2020-09-08T16:20:12.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:12.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj81 td/osd-backfill-space/datafile 2020-09-08T16:20:12.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj81 td/osd-backfill-space/datafile 2020-09-08T16:20:12.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:12.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj82 td/osd-backfill-space/datafile 2020-09-08T16:20:13.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj82 td/osd-backfill-space/datafile 2020-09-08T16:20:13.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:13.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj83 td/osd-backfill-space/datafile 2020-09-08T16:20:13.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj83 td/osd-backfill-space/datafile 2020-09-08T16:20:13.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:13.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj84 td/osd-backfill-space/datafile 2020-09-08T16:20:13.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj84 td/osd-backfill-space/datafile 2020-09-08T16:20:13.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:13.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj85 td/osd-backfill-space/datafile 2020-09-08T16:20:13.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj85 td/osd-backfill-space/datafile 2020-09-08T16:20:13.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:13.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj86 td/osd-backfill-space/datafile 2020-09-08T16:20:13.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj86 td/osd-backfill-space/datafile 2020-09-08T16:20:13.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:13.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj87 td/osd-backfill-space/datafile 2020-09-08T16:20:13.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj87 td/osd-backfill-space/datafile 2020-09-08T16:20:13.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:13.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj88 td/osd-backfill-space/datafile 2020-09-08T16:20:13.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj88 td/osd-backfill-space/datafile 2020-09-08T16:20:14.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:14.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj89 td/osd-backfill-space/datafile 2020-09-08T16:20:14.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj89 td/osd-backfill-space/datafile 2020-09-08T16:20:14.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:14.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj90 td/osd-backfill-space/datafile 2020-09-08T16:20:14.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj90 td/osd-backfill-space/datafile 2020-09-08T16:20:14.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:14.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj91 td/osd-backfill-space/datafile 2020-09-08T16:20:14.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj91 td/osd-backfill-space/datafile 2020-09-08T16:20:14.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:14.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj92 td/osd-backfill-space/datafile 2020-09-08T16:20:14.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj92 td/osd-backfill-space/datafile 2020-09-08T16:20:14.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:14.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj93 td/osd-backfill-space/datafile 2020-09-08T16:20:14.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj93 td/osd-backfill-space/datafile 2020-09-08T16:20:14.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:14.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj94 td/osd-backfill-space/datafile 2020-09-08T16:20:14.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj94 td/osd-backfill-space/datafile 2020-09-08T16:20:15.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:15.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj95 td/osd-backfill-space/datafile 2020-09-08T16:20:15.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj95 td/osd-backfill-space/datafile 2020-09-08T16:20:15.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:15.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj96 td/osd-backfill-space/datafile 2020-09-08T16:20:15.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj96 td/osd-backfill-space/datafile 2020-09-08T16:20:15.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:15.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj97 td/osd-backfill-space/datafile 2020-09-08T16:20:15.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj97 td/osd-backfill-space/datafile 2020-09-08T16:20:15.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:15.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj98 td/osd-backfill-space/datafile 2020-09-08T16:20:15.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj98 td/osd-backfill-space/datafile 2020-09-08T16:20:15.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:15.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj99 td/osd-backfill-space/datafile 2020-09-08T16:20:15.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj99 td/osd-backfill-space/datafile 2020-09-08T16:20:15.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:15.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj100 td/osd-backfill-space/datafile 2020-09-08T16:20:15.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj100 td/osd-backfill-space/datafile 2020-09-08T16:20:15.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:15.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj101 td/osd-backfill-space/datafile 2020-09-08T16:20:16.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj101 td/osd-backfill-space/datafile 2020-09-08T16:20:16.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:16.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj102 td/osd-backfill-space/datafile 2020-09-08T16:20:16.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj102 td/osd-backfill-space/datafile 2020-09-08T16:20:16.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:16.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj103 td/osd-backfill-space/datafile 2020-09-08T16:20:16.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj103 td/osd-backfill-space/datafile 2020-09-08T16:20:16.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:16.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj104 td/osd-backfill-space/datafile 2020-09-08T16:20:16.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj104 td/osd-backfill-space/datafile 2020-09-08T16:20:16.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:16.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj105 td/osd-backfill-space/datafile 2020-09-08T16:20:16.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj105 td/osd-backfill-space/datafile 2020-09-08T16:20:16.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:16.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj106 td/osd-backfill-space/datafile 2020-09-08T16:20:16.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj106 td/osd-backfill-space/datafile 2020-09-08T16:20:16.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:16.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj107 td/osd-backfill-space/datafile 2020-09-08T16:20:17.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj107 td/osd-backfill-space/datafile 2020-09-08T16:20:17.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:17.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj108 td/osd-backfill-space/datafile 2020-09-08T16:20:17.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj108 td/osd-backfill-space/datafile 2020-09-08T16:20:17.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:17.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj109 td/osd-backfill-space/datafile 2020-09-08T16:20:17.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj109 td/osd-backfill-space/datafile 2020-09-08T16:20:17.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:17.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj110 td/osd-backfill-space/datafile 2020-09-08T16:20:17.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj110 td/osd-backfill-space/datafile 2020-09-08T16:20:17.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:17.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj111 td/osd-backfill-space/datafile 2020-09-08T16:20:17.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj111 td/osd-backfill-space/datafile 2020-09-08T16:20:17.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:17.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj112 td/osd-backfill-space/datafile 2020-09-08T16:20:17.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj112 td/osd-backfill-space/datafile 2020-09-08T16:20:17.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:17.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj113 td/osd-backfill-space/datafile 2020-09-08T16:20:17.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj113 td/osd-backfill-space/datafile 2020-09-08T16:20:18.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:18.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj114 td/osd-backfill-space/datafile 2020-09-08T16:20:18.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj114 td/osd-backfill-space/datafile 2020-09-08T16:20:18.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:18.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj115 td/osd-backfill-space/datafile 2020-09-08T16:20:18.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj115 td/osd-backfill-space/datafile 2020-09-08T16:20:18.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:18.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj116 td/osd-backfill-space/datafile 2020-09-08T16:20:18.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj116 td/osd-backfill-space/datafile 2020-09-08T16:20:18.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:18.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj117 td/osd-backfill-space/datafile 2020-09-08T16:20:18.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj117 td/osd-backfill-space/datafile 2020-09-08T16:20:18.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:18.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj118 td/osd-backfill-space/datafile 2020-09-08T16:20:18.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj118 td/osd-backfill-space/datafile 2020-09-08T16:20:18.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:18.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj119 td/osd-backfill-space/datafile 2020-09-08T16:20:18.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj119 td/osd-backfill-space/datafile 2020-09-08T16:20:19.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:19.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj120 td/osd-backfill-space/datafile 2020-09-08T16:20:19.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj120 td/osd-backfill-space/datafile 2020-09-08T16:20:19.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:19.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj121 td/osd-backfill-space/datafile 2020-09-08T16:20:19.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj121 td/osd-backfill-space/datafile 2020-09-08T16:20:19.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:19.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj122 td/osd-backfill-space/datafile 2020-09-08T16:20:19.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj122 td/osd-backfill-space/datafile 2020-09-08T16:20:19.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:19.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj123 td/osd-backfill-space/datafile 2020-09-08T16:20:19.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj123 td/osd-backfill-space/datafile 2020-09-08T16:20:19.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:19.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj124 td/osd-backfill-space/datafile 2020-09-08T16:20:19.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj124 td/osd-backfill-space/datafile 2020-09-08T16:20:19.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:19.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj125 td/osd-backfill-space/datafile 2020-09-08T16:20:19.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj125 td/osd-backfill-space/datafile 2020-09-08T16:20:19.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:19.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj126 td/osd-backfill-space/datafile 2020-09-08T16:20:20.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj126 td/osd-backfill-space/datafile 2020-09-08T16:20:20.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:20.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj127 td/osd-backfill-space/datafile 2020-09-08T16:20:20.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj127 td/osd-backfill-space/datafile 2020-09-08T16:20:20.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:20.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj128 td/osd-backfill-space/datafile 2020-09-08T16:20:20.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj128 td/osd-backfill-space/datafile 2020-09-08T16:20:20.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:20.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj129 td/osd-backfill-space/datafile 2020-09-08T16:20:20.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj129 td/osd-backfill-space/datafile 2020-09-08T16:20:20.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:20.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj130 td/osd-backfill-space/datafile 2020-09-08T16:20:20.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj130 td/osd-backfill-space/datafile 2020-09-08T16:20:20.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:20.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj131 td/osd-backfill-space/datafile 2020-09-08T16:20:20.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj131 td/osd-backfill-space/datafile 2020-09-08T16:20:20.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:20.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj132 td/osd-backfill-space/datafile 2020-09-08T16:20:21.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj132 td/osd-backfill-space/datafile 2020-09-08T16:20:21.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:21.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj133 td/osd-backfill-space/datafile 2020-09-08T16:20:21.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj133 td/osd-backfill-space/datafile 2020-09-08T16:20:21.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:21.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj134 td/osd-backfill-space/datafile 2020-09-08T16:20:21.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj134 td/osd-backfill-space/datafile 2020-09-08T16:20:21.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:21.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj135 td/osd-backfill-space/datafile 2020-09-08T16:20:21.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj135 td/osd-backfill-space/datafile 2020-09-08T16:20:21.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:21.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj136 td/osd-backfill-space/datafile 2020-09-08T16:20:21.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj136 td/osd-backfill-space/datafile 2020-09-08T16:20:21.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:21.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj137 td/osd-backfill-space/datafile 2020-09-08T16:20:21.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj137 td/osd-backfill-space/datafile 2020-09-08T16:20:21.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:21.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj138 td/osd-backfill-space/datafile 2020-09-08T16:20:21.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj138 td/osd-backfill-space/datafile 2020-09-08T16:20:22.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:22.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj139 td/osd-backfill-space/datafile 2020-09-08T16:20:22.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj139 td/osd-backfill-space/datafile 2020-09-08T16:20:22.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:22.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj140 td/osd-backfill-space/datafile 2020-09-08T16:20:22.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj140 td/osd-backfill-space/datafile 2020-09-08T16:20:22.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:22.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj141 td/osd-backfill-space/datafile 2020-09-08T16:20:22.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj141 td/osd-backfill-space/datafile 2020-09-08T16:20:22.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:22.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj142 td/osd-backfill-space/datafile 2020-09-08T16:20:22.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj142 td/osd-backfill-space/datafile 2020-09-08T16:20:22.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:22.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj143 td/osd-backfill-space/datafile 2020-09-08T16:20:22.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj143 td/osd-backfill-space/datafile 2020-09-08T16:20:22.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:22.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj144 td/osd-backfill-space/datafile 2020-09-08T16:20:22.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj144 td/osd-backfill-space/datafile 2020-09-08T16:20:22.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:22.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj145 td/osd-backfill-space/datafile 2020-09-08T16:20:23.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj145 td/osd-backfill-space/datafile 2020-09-08T16:20:23.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:23.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj146 td/osd-backfill-space/datafile 2020-09-08T16:20:23.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj146 td/osd-backfill-space/datafile 2020-09-08T16:20:23.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:23.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj147 td/osd-backfill-space/datafile 2020-09-08T16:20:23.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj147 td/osd-backfill-space/datafile 2020-09-08T16:20:23.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:23.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj148 td/osd-backfill-space/datafile 2020-09-08T16:20:23.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj148 td/osd-backfill-space/datafile 2020-09-08T16:20:23.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:23.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj149 td/osd-backfill-space/datafile 2020-09-08T16:20:23.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj149 td/osd-backfill-space/datafile 2020-09-08T16:20:23.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:23.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj150 td/osd-backfill-space/datafile 2020-09-08T16:20:23.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj150 td/osd-backfill-space/datafile 2020-09-08T16:20:23.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:23.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj151 td/osd-backfill-space/datafile 2020-09-08T16:20:23.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj151 td/osd-backfill-space/datafile 2020-09-08T16:20:24.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:24.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj152 td/osd-backfill-space/datafile 2020-09-08T16:20:24.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj152 td/osd-backfill-space/datafile 2020-09-08T16:20:24.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:24.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj153 td/osd-backfill-space/datafile 2020-09-08T16:20:24.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj153 td/osd-backfill-space/datafile 2020-09-08T16:20:24.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:24.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj154 td/osd-backfill-space/datafile 2020-09-08T16:20:24.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj154 td/osd-backfill-space/datafile 2020-09-08T16:20:24.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:24.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj155 td/osd-backfill-space/datafile 2020-09-08T16:20:24.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj155 td/osd-backfill-space/datafile 2020-09-08T16:20:24.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:24.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj156 td/osd-backfill-space/datafile 2020-09-08T16:20:24.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj156 td/osd-backfill-space/datafile 2020-09-08T16:20:24.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:24.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj157 td/osd-backfill-space/datafile 2020-09-08T16:20:25.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj157 td/osd-backfill-space/datafile 2020-09-08T16:20:25.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:25.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj158 td/osd-backfill-space/datafile 2020-09-08T16:20:25.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj158 td/osd-backfill-space/datafile 2020-09-08T16:20:25.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:25.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj159 td/osd-backfill-space/datafile 2020-09-08T16:20:25.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj159 td/osd-backfill-space/datafile 2020-09-08T16:20:25.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:25.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj160 td/osd-backfill-space/datafile 2020-09-08T16:20:25.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj160 td/osd-backfill-space/datafile 2020-09-08T16:20:25.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:25.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj161 td/osd-backfill-space/datafile 2020-09-08T16:20:25.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj161 td/osd-backfill-space/datafile 2020-09-08T16:20:25.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:25.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj162 td/osd-backfill-space/datafile 2020-09-08T16:20:25.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj162 td/osd-backfill-space/datafile 2020-09-08T16:20:25.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:25.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj163 td/osd-backfill-space/datafile 2020-09-08T16:20:25.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj163 td/osd-backfill-space/datafile 2020-09-08T16:20:26.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:26.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj164 td/osd-backfill-space/datafile 2020-09-08T16:20:26.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj164 td/osd-backfill-space/datafile 2020-09-08T16:20:26.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:26.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj165 td/osd-backfill-space/datafile 2020-09-08T16:20:26.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj165 td/osd-backfill-space/datafile 2020-09-08T16:20:26.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:26.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj166 td/osd-backfill-space/datafile 2020-09-08T16:20:26.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj166 td/osd-backfill-space/datafile 2020-09-08T16:20:26.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:26.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj167 td/osd-backfill-space/datafile 2020-09-08T16:20:26.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj167 td/osd-backfill-space/datafile 2020-09-08T16:20:26.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:26.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj168 td/osd-backfill-space/datafile 2020-09-08T16:20:26.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj168 td/osd-backfill-space/datafile 2020-09-08T16:20:26.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:26.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj169 td/osd-backfill-space/datafile 2020-09-08T16:20:26.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj169 td/osd-backfill-space/datafile 2020-09-08T16:20:26.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:26.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj170 td/osd-backfill-space/datafile 2020-09-08T16:20:27.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj170 td/osd-backfill-space/datafile 2020-09-08T16:20:27.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:27.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj171 td/osd-backfill-space/datafile 2020-09-08T16:20:27.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj171 td/osd-backfill-space/datafile 2020-09-08T16:20:27.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:27.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj172 td/osd-backfill-space/datafile 2020-09-08T16:20:27.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj172 td/osd-backfill-space/datafile 2020-09-08T16:20:27.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:27.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj173 td/osd-backfill-space/datafile 2020-09-08T16:20:27.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj173 td/osd-backfill-space/datafile 2020-09-08T16:20:27.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:27.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj174 td/osd-backfill-space/datafile 2020-09-08T16:20:27.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj174 td/osd-backfill-space/datafile 2020-09-08T16:20:27.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:27.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj175 td/osd-backfill-space/datafile 2020-09-08T16:20:27.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj175 td/osd-backfill-space/datafile 2020-09-08T16:20:27.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:27.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj176 td/osd-backfill-space/datafile 2020-09-08T16:20:27.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj176 td/osd-backfill-space/datafile 2020-09-08T16:20:28.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:28.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj177 td/osd-backfill-space/datafile 2020-09-08T16:20:28.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj177 td/osd-backfill-space/datafile 2020-09-08T16:20:28.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:28.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj178 td/osd-backfill-space/datafile 2020-09-08T16:20:28.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj178 td/osd-backfill-space/datafile 2020-09-08T16:20:28.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:28.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj179 td/osd-backfill-space/datafile 2020-09-08T16:20:28.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj179 td/osd-backfill-space/datafile 2020-09-08T16:20:28.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:28.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj180 td/osd-backfill-space/datafile 2020-09-08T16:20:28.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj180 td/osd-backfill-space/datafile 2020-09-08T16:20:28.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:28.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj181 td/osd-backfill-space/datafile 2020-09-08T16:20:28.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj181 td/osd-backfill-space/datafile 2020-09-08T16:20:28.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:28.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj182 td/osd-backfill-space/datafile 2020-09-08T16:20:28.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj182 td/osd-backfill-space/datafile 2020-09-08T16:20:29.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:29.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj183 td/osd-backfill-space/datafile 2020-09-08T16:20:29.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj183 td/osd-backfill-space/datafile 2020-09-08T16:20:29.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:29.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj184 td/osd-backfill-space/datafile 2020-09-08T16:20:29.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj184 td/osd-backfill-space/datafile 2020-09-08T16:20:29.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:29.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj185 td/osd-backfill-space/datafile 2020-09-08T16:20:29.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj185 td/osd-backfill-space/datafile 2020-09-08T16:20:29.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:29.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj186 td/osd-backfill-space/datafile 2020-09-08T16:20:29.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj186 td/osd-backfill-space/datafile 2020-09-08T16:20:29.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:29.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj187 td/osd-backfill-space/datafile 2020-09-08T16:20:29.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj187 td/osd-backfill-space/datafile 2020-09-08T16:20:29.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:29.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj188 td/osd-backfill-space/datafile 2020-09-08T16:20:29.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj188 td/osd-backfill-space/datafile 2020-09-08T16:20:29.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:29.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj189 td/osd-backfill-space/datafile 2020-09-08T16:20:30.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj189 td/osd-backfill-space/datafile 2020-09-08T16:20:30.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:30.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj190 td/osd-backfill-space/datafile 2020-09-08T16:20:30.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj190 td/osd-backfill-space/datafile 2020-09-08T16:20:30.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:30.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj191 td/osd-backfill-space/datafile 2020-09-08T16:20:30.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj191 td/osd-backfill-space/datafile 2020-09-08T16:20:30.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:30.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj192 td/osd-backfill-space/datafile 2020-09-08T16:20:30.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj192 td/osd-backfill-space/datafile 2020-09-08T16:20:30.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:30.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj193 td/osd-backfill-space/datafile 2020-09-08T16:20:30.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj193 td/osd-backfill-space/datafile 2020-09-08T16:20:30.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:30.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj194 td/osd-backfill-space/datafile 2020-09-08T16:20:30.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj194 td/osd-backfill-space/datafile 2020-09-08T16:20:30.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:30.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj195 td/osd-backfill-space/datafile 2020-09-08T16:20:31.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj195 td/osd-backfill-space/datafile 2020-09-08T16:20:31.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:31.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj196 td/osd-backfill-space/datafile 2020-09-08T16:20:31.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj196 td/osd-backfill-space/datafile 2020-09-08T16:20:31.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:31.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj197 td/osd-backfill-space/datafile 2020-09-08T16:20:31.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj197 td/osd-backfill-space/datafile 2020-09-08T16:20:31.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:31.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj198 td/osd-backfill-space/datafile 2020-09-08T16:20:31.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj198 td/osd-backfill-space/datafile 2020-09-08T16:20:31.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:31.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj199 td/osd-backfill-space/datafile 2020-09-08T16:20:31.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj199 td/osd-backfill-space/datafile 2020-09-08T16:20:31.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:31.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj200 td/osd-backfill-space/datafile 2020-09-08T16:20:31.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj200 td/osd-backfill-space/datafile 2020-09-08T16:20:31.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:31.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj201 td/osd-backfill-space/datafile 2020-09-08T16:20:31.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj201 td/osd-backfill-space/datafile 2020-09-08T16:20:32.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:32.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj202 td/osd-backfill-space/datafile 2020-09-08T16:20:32.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj202 td/osd-backfill-space/datafile 2020-09-08T16:20:32.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:32.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj203 td/osd-backfill-space/datafile 2020-09-08T16:20:32.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj203 td/osd-backfill-space/datafile 2020-09-08T16:20:32.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:32.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj204 td/osd-backfill-space/datafile 2020-09-08T16:20:32.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj204 td/osd-backfill-space/datafile 2020-09-08T16:20:32.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:32.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj205 td/osd-backfill-space/datafile 2020-09-08T16:20:32.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj205 td/osd-backfill-space/datafile 2020-09-08T16:20:32.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:32.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj206 td/osd-backfill-space/datafile 2020-09-08T16:20:32.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj206 td/osd-backfill-space/datafile 2020-09-08T16:20:32.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:32.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj207 td/osd-backfill-space/datafile 2020-09-08T16:20:32.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj207 td/osd-backfill-space/datafile 2020-09-08T16:20:32.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:32.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj208 td/osd-backfill-space/datafile 2020-09-08T16:20:33.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj208 td/osd-backfill-space/datafile 2020-09-08T16:20:33.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:33.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj209 td/osd-backfill-space/datafile 2020-09-08T16:20:33.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj209 td/osd-backfill-space/datafile 2020-09-08T16:20:33.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:33.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj210 td/osd-backfill-space/datafile 2020-09-08T16:20:33.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj210 td/osd-backfill-space/datafile 2020-09-08T16:20:33.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:33.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj211 td/osd-backfill-space/datafile 2020-09-08T16:20:33.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj211 td/osd-backfill-space/datafile 2020-09-08T16:20:33.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:33.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj212 td/osd-backfill-space/datafile 2020-09-08T16:20:33.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj212 td/osd-backfill-space/datafile 2020-09-08T16:20:33.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:33.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj213 td/osd-backfill-space/datafile 2020-09-08T16:20:33.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj213 td/osd-backfill-space/datafile 2020-09-08T16:20:33.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:33.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj214 td/osd-backfill-space/datafile 2020-09-08T16:20:33.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj214 td/osd-backfill-space/datafile 2020-09-08T16:20:34.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:34.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj215 td/osd-backfill-space/datafile 2020-09-08T16:20:34.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj215 td/osd-backfill-space/datafile 2020-09-08T16:20:34.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:34.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj216 td/osd-backfill-space/datafile 2020-09-08T16:20:34.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj216 td/osd-backfill-space/datafile 2020-09-08T16:20:34.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:34.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj217 td/osd-backfill-space/datafile 2020-09-08T16:20:34.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj217 td/osd-backfill-space/datafile 2020-09-08T16:20:35.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:35.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj218 td/osd-backfill-space/datafile 2020-09-08T16:20:35.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj218 td/osd-backfill-space/datafile 2020-09-08T16:20:35.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:35.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj219 td/osd-backfill-space/datafile 2020-09-08T16:20:35.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj219 td/osd-backfill-space/datafile 2020-09-08T16:20:35.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:35.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj220 td/osd-backfill-space/datafile 2020-09-08T16:20:35.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj220 td/osd-backfill-space/datafile 2020-09-08T16:20:35.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:35.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj221 td/osd-backfill-space/datafile 2020-09-08T16:20:35.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj221 td/osd-backfill-space/datafile 2020-09-08T16:20:35.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:35.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj222 td/osd-backfill-space/datafile 2020-09-08T16:20:35.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj222 td/osd-backfill-space/datafile 2020-09-08T16:20:35.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:35.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj223 td/osd-backfill-space/datafile 2020-09-08T16:20:35.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj223 td/osd-backfill-space/datafile 2020-09-08T16:20:36.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:36.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj224 td/osd-backfill-space/datafile 2020-09-08T16:20:36.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj224 td/osd-backfill-space/datafile 2020-09-08T16:20:36.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:36.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj225 td/osd-backfill-space/datafile 2020-09-08T16:20:36.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj225 td/osd-backfill-space/datafile 2020-09-08T16:20:36.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:36.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj226 td/osd-backfill-space/datafile 2020-09-08T16:20:36.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj226 td/osd-backfill-space/datafile 2020-09-08T16:20:36.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:36.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj227 td/osd-backfill-space/datafile 2020-09-08T16:20:36.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj227 td/osd-backfill-space/datafile 2020-09-08T16:20:36.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:36.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj228 td/osd-backfill-space/datafile 2020-09-08T16:20:36.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj228 td/osd-backfill-space/datafile 2020-09-08T16:20:36.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:36.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj229 td/osd-backfill-space/datafile 2020-09-08T16:20:36.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj229 td/osd-backfill-space/datafile 2020-09-08T16:20:37.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:37.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj230 td/osd-backfill-space/datafile 2020-09-08T16:20:37.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj230 td/osd-backfill-space/datafile 2020-09-08T16:20:37.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:37.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj231 td/osd-backfill-space/datafile 2020-09-08T16:20:37.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj231 td/osd-backfill-space/datafile 2020-09-08T16:20:37.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:37.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj232 td/osd-backfill-space/datafile 2020-09-08T16:20:37.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj232 td/osd-backfill-space/datafile 2020-09-08T16:20:37.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:37.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj233 td/osd-backfill-space/datafile 2020-09-08T16:20:37.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj233 td/osd-backfill-space/datafile 2020-09-08T16:20:37.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:37.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj234 td/osd-backfill-space/datafile 2020-09-08T16:20:37.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj234 td/osd-backfill-space/datafile 2020-09-08T16:20:37.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:37.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj235 td/osd-backfill-space/datafile 2020-09-08T16:20:37.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj235 td/osd-backfill-space/datafile 2020-09-08T16:20:37.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:37.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj236 td/osd-backfill-space/datafile 2020-09-08T16:20:38.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj236 td/osd-backfill-space/datafile 2020-09-08T16:20:38.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:38.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj237 td/osd-backfill-space/datafile 2020-09-08T16:20:38.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj237 td/osd-backfill-space/datafile 2020-09-08T16:20:38.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:38.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj238 td/osd-backfill-space/datafile 2020-09-08T16:20:38.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj238 td/osd-backfill-space/datafile 2020-09-08T16:20:38.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:38.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj239 td/osd-backfill-space/datafile 2020-09-08T16:20:38.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj239 td/osd-backfill-space/datafile 2020-09-08T16:20:38.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:38.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj240 td/osd-backfill-space/datafile 2020-09-08T16:20:38.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj240 td/osd-backfill-space/datafile 2020-09-08T16:20:38.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:38.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj241 td/osd-backfill-space/datafile 2020-09-08T16:20:38.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj241 td/osd-backfill-space/datafile 2020-09-08T16:20:38.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:38.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj242 td/osd-backfill-space/datafile 2020-09-08T16:20:39.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj242 td/osd-backfill-space/datafile 2020-09-08T16:20:39.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:39.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj243 td/osd-backfill-space/datafile 2020-09-08T16:20:39.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj243 td/osd-backfill-space/datafile 2020-09-08T16:20:39.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:39.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj244 td/osd-backfill-space/datafile 2020-09-08T16:20:39.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj244 td/osd-backfill-space/datafile 2020-09-08T16:20:39.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:39.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj245 td/osd-backfill-space/datafile 2020-09-08T16:20:39.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj245 td/osd-backfill-space/datafile 2020-09-08T16:20:39.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:39.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj246 td/osd-backfill-space/datafile 2020-09-08T16:20:39.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj246 td/osd-backfill-space/datafile 2020-09-08T16:20:39.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:39.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj247 td/osd-backfill-space/datafile 2020-09-08T16:20:39.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj247 td/osd-backfill-space/datafile 2020-09-08T16:20:39.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:39.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj248 td/osd-backfill-space/datafile 2020-09-08T16:20:39.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj248 td/osd-backfill-space/datafile 2020-09-08T16:20:40.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:40.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj249 td/osd-backfill-space/datafile 2020-09-08T16:20:40.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj249 td/osd-backfill-space/datafile 2020-09-08T16:20:40.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:40.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj250 td/osd-backfill-space/datafile 2020-09-08T16:20:40.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj250 td/osd-backfill-space/datafile 2020-09-08T16:20:40.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:40.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj251 td/osd-backfill-space/datafile 2020-09-08T16:20:40.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj251 td/osd-backfill-space/datafile 2020-09-08T16:20:40.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:40.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj252 td/osd-backfill-space/datafile 2020-09-08T16:20:40.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj252 td/osd-backfill-space/datafile 2020-09-08T16:20:40.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:40.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj253 td/osd-backfill-space/datafile 2020-09-08T16:20:40.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj253 td/osd-backfill-space/datafile 2020-09-08T16:20:40.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:40.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj254 td/osd-backfill-space/datafile 2020-09-08T16:20:40.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj254 td/osd-backfill-space/datafile 2020-09-08T16:20:41.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:41.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj255 td/osd-backfill-space/datafile 2020-09-08T16:20:41.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj255 td/osd-backfill-space/datafile 2020-09-08T16:20:41.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:41.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj256 td/osd-backfill-space/datafile 2020-09-08T16:20:41.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj256 td/osd-backfill-space/datafile 2020-09-08T16:20:41.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:41.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj257 td/osd-backfill-space/datafile 2020-09-08T16:20:41.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj257 td/osd-backfill-space/datafile 2020-09-08T16:20:41.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:41.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj258 td/osd-backfill-space/datafile 2020-09-08T16:20:41.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj258 td/osd-backfill-space/datafile 2020-09-08T16:20:41.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:41.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj259 td/osd-backfill-space/datafile 2020-09-08T16:20:41.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj259 td/osd-backfill-space/datafile 2020-09-08T16:20:41.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:41.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj260 td/osd-backfill-space/datafile 2020-09-08T16:20:41.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj260 td/osd-backfill-space/datafile 2020-09-08T16:20:41.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:41.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj261 td/osd-backfill-space/datafile 2020-09-08T16:20:42.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj261 td/osd-backfill-space/datafile 2020-09-08T16:20:42.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:42.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj262 td/osd-backfill-space/datafile 2020-09-08T16:20:42.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj262 td/osd-backfill-space/datafile 2020-09-08T16:20:42.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:42.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj263 td/osd-backfill-space/datafile 2020-09-08T16:20:42.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj263 td/osd-backfill-space/datafile 2020-09-08T16:20:42.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:42.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj264 td/osd-backfill-space/datafile 2020-09-08T16:20:42.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj264 td/osd-backfill-space/datafile 2020-09-08T16:20:42.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:42.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj265 td/osd-backfill-space/datafile 2020-09-08T16:20:42.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj265 td/osd-backfill-space/datafile 2020-09-08T16:20:42.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:42.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj266 td/osd-backfill-space/datafile 2020-09-08T16:20:42.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj266 td/osd-backfill-space/datafile 2020-09-08T16:20:42.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:42.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj267 td/osd-backfill-space/datafile 2020-09-08T16:20:43.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj267 td/osd-backfill-space/datafile 2020-09-08T16:20:43.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:43.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj268 td/osd-backfill-space/datafile 2020-09-08T16:20:43.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj268 td/osd-backfill-space/datafile 2020-09-08T16:20:43.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:43.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj269 td/osd-backfill-space/datafile 2020-09-08T16:20:43.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj269 td/osd-backfill-space/datafile 2020-09-08T16:20:43.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:43.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj270 td/osd-backfill-space/datafile 2020-09-08T16:20:43.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj270 td/osd-backfill-space/datafile 2020-09-08T16:20:43.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:43.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj271 td/osd-backfill-space/datafile 2020-09-08T16:20:43.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj271 td/osd-backfill-space/datafile 2020-09-08T16:20:43.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:43.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj272 td/osd-backfill-space/datafile 2020-09-08T16:20:43.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj272 td/osd-backfill-space/datafile 2020-09-08T16:20:43.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:43.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj273 td/osd-backfill-space/datafile 2020-09-08T16:20:43.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj273 td/osd-backfill-space/datafile 2020-09-08T16:20:44.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:44.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj274 td/osd-backfill-space/datafile 2020-09-08T16:20:44.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj274 td/osd-backfill-space/datafile 2020-09-08T16:20:44.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:44.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj275 td/osd-backfill-space/datafile 2020-09-08T16:20:44.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj275 td/osd-backfill-space/datafile 2020-09-08T16:20:44.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:44.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj276 td/osd-backfill-space/datafile 2020-09-08T16:20:44.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj276 td/osd-backfill-space/datafile 2020-09-08T16:20:44.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:44.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj277 td/osd-backfill-space/datafile 2020-09-08T16:20:44.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj277 td/osd-backfill-space/datafile 2020-09-08T16:20:44.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:44.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj278 td/osd-backfill-space/datafile 2020-09-08T16:20:44.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj278 td/osd-backfill-space/datafile 2020-09-08T16:20:44.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:44.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj279 td/osd-backfill-space/datafile 2020-09-08T16:20:44.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj279 td/osd-backfill-space/datafile 2020-09-08T16:20:45.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:45.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj280 td/osd-backfill-space/datafile 2020-09-08T16:20:45.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj280 td/osd-backfill-space/datafile 2020-09-08T16:20:45.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:45.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj281 td/osd-backfill-space/datafile 2020-09-08T16:20:45.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj281 td/osd-backfill-space/datafile 2020-09-08T16:20:45.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:45.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj282 td/osd-backfill-space/datafile 2020-09-08T16:20:45.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj282 td/osd-backfill-space/datafile 2020-09-08T16:20:45.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:45.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj283 td/osd-backfill-space/datafile 2020-09-08T16:20:45.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj283 td/osd-backfill-space/datafile 2020-09-08T16:20:45.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:45.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj284 td/osd-backfill-space/datafile 2020-09-08T16:20:45.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj284 td/osd-backfill-space/datafile 2020-09-08T16:20:45.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:45.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj285 td/osd-backfill-space/datafile 2020-09-08T16:20:45.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj285 td/osd-backfill-space/datafile 2020-09-08T16:20:46.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:46.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj286 td/osd-backfill-space/datafile 2020-09-08T16:20:46.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj286 td/osd-backfill-space/datafile 2020-09-08T16:20:46.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:46.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj287 td/osd-backfill-space/datafile 2020-09-08T16:20:46.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj287 td/osd-backfill-space/datafile 2020-09-08T16:20:46.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:46.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj288 td/osd-backfill-space/datafile 2020-09-08T16:20:46.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj288 td/osd-backfill-space/datafile 2020-09-08T16:20:46.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:46.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj289 td/osd-backfill-space/datafile 2020-09-08T16:20:46.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj289 td/osd-backfill-space/datafile 2020-09-08T16:20:46.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:46.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj290 td/osd-backfill-space/datafile 2020-09-08T16:20:46.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj290 td/osd-backfill-space/datafile 2020-09-08T16:20:46.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:46.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj291 td/osd-backfill-space/datafile 2020-09-08T16:20:46.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj291 td/osd-backfill-space/datafile 2020-09-08T16:20:47.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:47.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj292 td/osd-backfill-space/datafile 2020-09-08T16:20:47.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj292 td/osd-backfill-space/datafile 2020-09-08T16:20:47.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:47.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj293 td/osd-backfill-space/datafile 2020-09-08T16:20:47.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj293 td/osd-backfill-space/datafile 2020-09-08T16:20:47.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:47.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj294 td/osd-backfill-space/datafile 2020-09-08T16:20:47.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj294 td/osd-backfill-space/datafile 2020-09-08T16:20:47.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:47.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj295 td/osd-backfill-space/datafile 2020-09-08T16:20:47.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj295 td/osd-backfill-space/datafile 2020-09-08T16:20:47.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:47.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj296 td/osd-backfill-space/datafile 2020-09-08T16:20:47.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj296 td/osd-backfill-space/datafile 2020-09-08T16:20:47.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:47.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj297 td/osd-backfill-space/datafile 2020-09-08T16:20:47.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj297 td/osd-backfill-space/datafile 2020-09-08T16:20:47.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:47.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj298 td/osd-backfill-space/datafile 2020-09-08T16:20:47.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj298 td/osd-backfill-space/datafile 2020-09-08T16:20:48.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:48.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj299 td/osd-backfill-space/datafile 2020-09-08T16:20:48.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj299 td/osd-backfill-space/datafile 2020-09-08T16:20:48.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:48.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj300 td/osd-backfill-space/datafile 2020-09-08T16:20:48.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj300 td/osd-backfill-space/datafile 2020-09-08T16:20:48.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:48.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj301 td/osd-backfill-space/datafile 2020-09-08T16:20:48.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj301 td/osd-backfill-space/datafile 2020-09-08T16:20:48.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:48.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj302 td/osd-backfill-space/datafile 2020-09-08T16:20:48.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj302 td/osd-backfill-space/datafile 2020-09-08T16:20:48.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:48.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj303 td/osd-backfill-space/datafile 2020-09-08T16:20:48.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj303 td/osd-backfill-space/datafile 2020-09-08T16:20:48.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:48.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj304 td/osd-backfill-space/datafile 2020-09-08T16:20:48.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj304 td/osd-backfill-space/datafile 2020-09-08T16:20:49.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:49.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj305 td/osd-backfill-space/datafile 2020-09-08T16:20:49.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj305 td/osd-backfill-space/datafile 2020-09-08T16:20:49.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:49.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj306 td/osd-backfill-space/datafile 2020-09-08T16:20:49.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj306 td/osd-backfill-space/datafile 2020-09-08T16:20:49.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:49.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj307 td/osd-backfill-space/datafile 2020-09-08T16:20:49.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj307 td/osd-backfill-space/datafile 2020-09-08T16:20:49.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:49.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj308 td/osd-backfill-space/datafile 2020-09-08T16:20:49.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj308 td/osd-backfill-space/datafile 2020-09-08T16:20:49.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:49.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj309 td/osd-backfill-space/datafile 2020-09-08T16:20:49.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj309 td/osd-backfill-space/datafile 2020-09-08T16:20:49.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:49.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj310 td/osd-backfill-space/datafile 2020-09-08T16:20:49.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj310 td/osd-backfill-space/datafile 2020-09-08T16:20:49.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:49.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj311 td/osd-backfill-space/datafile 2020-09-08T16:20:50.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj311 td/osd-backfill-space/datafile 2020-09-08T16:20:50.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:50.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj312 td/osd-backfill-space/datafile 2020-09-08T16:20:50.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj312 td/osd-backfill-space/datafile 2020-09-08T16:20:50.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:50.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj313 td/osd-backfill-space/datafile 2020-09-08T16:20:50.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj313 td/osd-backfill-space/datafile 2020-09-08T16:20:50.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:50.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj314 td/osd-backfill-space/datafile 2020-09-08T16:20:50.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj314 td/osd-backfill-space/datafile 2020-09-08T16:20:50.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:50.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj315 td/osd-backfill-space/datafile 2020-09-08T16:20:50.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj315 td/osd-backfill-space/datafile 2020-09-08T16:20:50.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:50.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj316 td/osd-backfill-space/datafile 2020-09-08T16:20:50.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj316 td/osd-backfill-space/datafile 2020-09-08T16:20:51.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:51.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj317 td/osd-backfill-space/datafile 2020-09-08T16:20:51.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj317 td/osd-backfill-space/datafile 2020-09-08T16:20:51.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:51.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj318 td/osd-backfill-space/datafile 2020-09-08T16:20:51.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj318 td/osd-backfill-space/datafile 2020-09-08T16:20:51.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:51.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj319 td/osd-backfill-space/datafile 2020-09-08T16:20:51.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj319 td/osd-backfill-space/datafile 2020-09-08T16:20:51.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:51.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj320 td/osd-backfill-space/datafile 2020-09-08T16:20:51.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj320 td/osd-backfill-space/datafile 2020-09-08T16:20:51.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:51.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj321 td/osd-backfill-space/datafile 2020-09-08T16:20:51.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj321 td/osd-backfill-space/datafile 2020-09-08T16:20:51.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:51.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj322 td/osd-backfill-space/datafile 2020-09-08T16:20:51.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj322 td/osd-backfill-space/datafile 2020-09-08T16:20:51.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:51.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj323 td/osd-backfill-space/datafile 2020-09-08T16:20:52.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj323 td/osd-backfill-space/datafile 2020-09-08T16:20:52.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:52.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj324 td/osd-backfill-space/datafile 2020-09-08T16:20:52.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj324 td/osd-backfill-space/datafile 2020-09-08T16:20:52.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:52.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj325 td/osd-backfill-space/datafile 2020-09-08T16:20:52.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj325 td/osd-backfill-space/datafile 2020-09-08T16:20:52.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:52.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj326 td/osd-backfill-space/datafile 2020-09-08T16:20:52.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj326 td/osd-backfill-space/datafile 2020-09-08T16:20:52.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:52.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj327 td/osd-backfill-space/datafile 2020-09-08T16:20:52.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj327 td/osd-backfill-space/datafile 2020-09-08T16:20:52.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:52.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj328 td/osd-backfill-space/datafile 2020-09-08T16:20:52.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj328 td/osd-backfill-space/datafile 2020-09-08T16:20:52.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:52.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj329 td/osd-backfill-space/datafile 2020-09-08T16:20:53.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj329 td/osd-backfill-space/datafile 2020-09-08T16:20:53.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:53.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj330 td/osd-backfill-space/datafile 2020-09-08T16:20:53.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj330 td/osd-backfill-space/datafile 2020-09-08T16:20:53.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:53.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj331 td/osd-backfill-space/datafile 2020-09-08T16:20:53.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj331 td/osd-backfill-space/datafile 2020-09-08T16:20:53.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:53.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj332 td/osd-backfill-space/datafile 2020-09-08T16:20:53.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj332 td/osd-backfill-space/datafile 2020-09-08T16:20:53.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:53.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj333 td/osd-backfill-space/datafile 2020-09-08T16:20:53.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj333 td/osd-backfill-space/datafile 2020-09-08T16:20:53.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:53.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj334 td/osd-backfill-space/datafile 2020-09-08T16:20:53.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj334 td/osd-backfill-space/datafile 2020-09-08T16:20:53.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:53.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj335 td/osd-backfill-space/datafile 2020-09-08T16:20:53.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj335 td/osd-backfill-space/datafile 2020-09-08T16:20:53.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:53.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj336 td/osd-backfill-space/datafile 2020-09-08T16:20:54.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj336 td/osd-backfill-space/datafile 2020-09-08T16:20:54.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:54.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj337 td/osd-backfill-space/datafile 2020-09-08T16:20:54.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj337 td/osd-backfill-space/datafile 2020-09-08T16:20:54.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:54.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj338 td/osd-backfill-space/datafile 2020-09-08T16:20:54.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj338 td/osd-backfill-space/datafile 2020-09-08T16:20:54.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:54.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj339 td/osd-backfill-space/datafile 2020-09-08T16:20:54.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj339 td/osd-backfill-space/datafile 2020-09-08T16:20:54.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:54.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj340 td/osd-backfill-space/datafile 2020-09-08T16:20:54.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj340 td/osd-backfill-space/datafile 2020-09-08T16:20:54.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:54.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj341 td/osd-backfill-space/datafile 2020-09-08T16:20:54.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj341 td/osd-backfill-space/datafile 2020-09-08T16:20:54.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:54.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj342 td/osd-backfill-space/datafile 2020-09-08T16:20:55.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj342 td/osd-backfill-space/datafile 2020-09-08T16:20:55.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:55.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj343 td/osd-backfill-space/datafile 2020-09-08T16:20:55.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj343 td/osd-backfill-space/datafile 2020-09-08T16:20:55.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:55.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj344 td/osd-backfill-space/datafile 2020-09-08T16:20:55.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj344 td/osd-backfill-space/datafile 2020-09-08T16:20:55.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:55.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj345 td/osd-backfill-space/datafile 2020-09-08T16:20:55.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj345 td/osd-backfill-space/datafile 2020-09-08T16:20:55.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:55.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj346 td/osd-backfill-space/datafile 2020-09-08T16:20:55.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj346 td/osd-backfill-space/datafile 2020-09-08T16:20:55.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:55.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj347 td/osd-backfill-space/datafile 2020-09-08T16:20:55.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj347 td/osd-backfill-space/datafile 2020-09-08T16:20:55.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:55.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj348 td/osd-backfill-space/datafile 2020-09-08T16:20:56.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj348 td/osd-backfill-space/datafile 2020-09-08T16:20:56.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:56.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj349 td/osd-backfill-space/datafile 2020-09-08T16:20:56.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj349 td/osd-backfill-space/datafile 2020-09-08T16:20:56.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:56.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj350 td/osd-backfill-space/datafile 2020-09-08T16:20:56.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj350 td/osd-backfill-space/datafile 2020-09-08T16:20:56.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:56.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj351 td/osd-backfill-space/datafile 2020-09-08T16:20:56.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj351 td/osd-backfill-space/datafile 2020-09-08T16:20:56.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:56.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj352 td/osd-backfill-space/datafile 2020-09-08T16:20:56.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj352 td/osd-backfill-space/datafile 2020-09-08T16:20:56.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:56.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj353 td/osd-backfill-space/datafile 2020-09-08T16:20:56.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj353 td/osd-backfill-space/datafile 2020-09-08T16:20:56.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:56.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj354 td/osd-backfill-space/datafile 2020-09-08T16:20:57.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj354 td/osd-backfill-space/datafile 2020-09-08T16:20:57.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:57.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj355 td/osd-backfill-space/datafile 2020-09-08T16:20:57.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj355 td/osd-backfill-space/datafile 2020-09-08T16:20:57.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:57.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj356 td/osd-backfill-space/datafile 2020-09-08T16:20:57.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj356 td/osd-backfill-space/datafile 2020-09-08T16:20:57.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:57.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj357 td/osd-backfill-space/datafile 2020-09-08T16:20:57.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj357 td/osd-backfill-space/datafile 2020-09-08T16:20:57.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:57.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj358 td/osd-backfill-space/datafile 2020-09-08T16:20:57.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj358 td/osd-backfill-space/datafile 2020-09-08T16:20:57.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:57.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj359 td/osd-backfill-space/datafile 2020-09-08T16:20:57.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj359 td/osd-backfill-space/datafile 2020-09-08T16:20:57.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:57.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj360 td/osd-backfill-space/datafile 2020-09-08T16:20:57.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj360 td/osd-backfill-space/datafile 2020-09-08T16:20:58.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:58.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj361 td/osd-backfill-space/datafile 2020-09-08T16:20:58.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj361 td/osd-backfill-space/datafile 2020-09-08T16:20:58.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:58.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj362 td/osd-backfill-space/datafile 2020-09-08T16:20:58.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj362 td/osd-backfill-space/datafile 2020-09-08T16:20:58.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:58.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj363 td/osd-backfill-space/datafile 2020-09-08T16:20:58.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj363 td/osd-backfill-space/datafile 2020-09-08T16:20:58.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:58.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj364 td/osd-backfill-space/datafile 2020-09-08T16:20:58.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj364 td/osd-backfill-space/datafile 2020-09-08T16:20:58.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:58.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj365 td/osd-backfill-space/datafile 2020-09-08T16:20:58.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj365 td/osd-backfill-space/datafile 2020-09-08T16:20:58.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:58.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj366 td/osd-backfill-space/datafile 2020-09-08T16:20:58.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj366 td/osd-backfill-space/datafile 2020-09-08T16:20:58.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:58.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj367 td/osd-backfill-space/datafile 2020-09-08T16:20:59.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj367 td/osd-backfill-space/datafile 2020-09-08T16:20:59.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:59.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj368 td/osd-backfill-space/datafile 2020-09-08T16:20:59.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj368 td/osd-backfill-space/datafile 2020-09-08T16:20:59.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:59.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj369 td/osd-backfill-space/datafile 2020-09-08T16:20:59.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj369 td/osd-backfill-space/datafile 2020-09-08T16:20:59.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:59.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj370 td/osd-backfill-space/datafile 2020-09-08T16:20:59.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj370 td/osd-backfill-space/datafile 2020-09-08T16:20:59.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:59.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj371 td/osd-backfill-space/datafile 2020-09-08T16:20:59.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj371 td/osd-backfill-space/datafile 2020-09-08T16:20:59.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:59.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj372 td/osd-backfill-space/datafile 2020-09-08T16:20:59.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj372 td/osd-backfill-space/datafile 2020-09-08T16:20:59.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:20:59.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj373 td/osd-backfill-space/datafile 2020-09-08T16:21:00.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj373 td/osd-backfill-space/datafile 2020-09-08T16:21:00.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:00.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj374 td/osd-backfill-space/datafile 2020-09-08T16:21:00.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj374 td/osd-backfill-space/datafile 2020-09-08T16:21:00.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:00.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj375 td/osd-backfill-space/datafile 2020-09-08T16:21:00.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj375 td/osd-backfill-space/datafile 2020-09-08T16:21:00.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:00.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj376 td/osd-backfill-space/datafile 2020-09-08T16:21:00.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj376 td/osd-backfill-space/datafile 2020-09-08T16:21:00.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:00.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj377 td/osd-backfill-space/datafile 2020-09-08T16:21:00.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj377 td/osd-backfill-space/datafile 2020-09-08T16:21:00.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:00.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj378 td/osd-backfill-space/datafile 2020-09-08T16:21:00.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj378 td/osd-backfill-space/datafile 2020-09-08T16:21:00.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:00.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj379 td/osd-backfill-space/datafile 2020-09-08T16:21:00.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj379 td/osd-backfill-space/datafile 2020-09-08T16:21:01.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:01.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj380 td/osd-backfill-space/datafile 2020-09-08T16:21:01.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj380 td/osd-backfill-space/datafile 2020-09-08T16:21:01.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:01.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj381 td/osd-backfill-space/datafile 2020-09-08T16:21:01.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj381 td/osd-backfill-space/datafile 2020-09-08T16:21:01.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:01.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj382 td/osd-backfill-space/datafile 2020-09-08T16:21:01.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj382 td/osd-backfill-space/datafile 2020-09-08T16:21:01.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:01.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj383 td/osd-backfill-space/datafile 2020-09-08T16:21:01.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj383 td/osd-backfill-space/datafile 2020-09-08T16:21:01.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:01.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj384 td/osd-backfill-space/datafile 2020-09-08T16:21:01.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj384 td/osd-backfill-space/datafile 2020-09-08T16:21:01.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:01.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj385 td/osd-backfill-space/datafile 2020-09-08T16:21:01.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj385 td/osd-backfill-space/datafile 2020-09-08T16:21:01.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:01.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj386 td/osd-backfill-space/datafile 2020-09-08T16:21:02.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj386 td/osd-backfill-space/datafile 2020-09-08T16:21:02.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:02.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj387 td/osd-backfill-space/datafile 2020-09-08T16:21:02.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj387 td/osd-backfill-space/datafile 2020-09-08T16:21:02.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:02.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj388 td/osd-backfill-space/datafile 2020-09-08T16:21:02.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj388 td/osd-backfill-space/datafile 2020-09-08T16:21:02.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:02.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj389 td/osd-backfill-space/datafile 2020-09-08T16:21:02.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj389 td/osd-backfill-space/datafile 2020-09-08T16:21:02.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:02.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj390 td/osd-backfill-space/datafile 2020-09-08T16:21:02.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj390 td/osd-backfill-space/datafile 2020-09-08T16:21:02.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:02.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj391 td/osd-backfill-space/datafile 2020-09-08T16:21:02.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj391 td/osd-backfill-space/datafile 2020-09-08T16:21:02.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:02.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj392 td/osd-backfill-space/datafile 2020-09-08T16:21:03.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj392 td/osd-backfill-space/datafile 2020-09-08T16:21:03.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:03.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj393 td/osd-backfill-space/datafile 2020-09-08T16:21:03.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj393 td/osd-backfill-space/datafile 2020-09-08T16:21:03.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:03.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj394 td/osd-backfill-space/datafile 2020-09-08T16:21:03.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj394 td/osd-backfill-space/datafile 2020-09-08T16:21:03.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:03.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj395 td/osd-backfill-space/datafile 2020-09-08T16:21:03.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj395 td/osd-backfill-space/datafile 2020-09-08T16:21:03.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:03.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj396 td/osd-backfill-space/datafile 2020-09-08T16:21:03.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj396 td/osd-backfill-space/datafile 2020-09-08T16:21:03.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:03.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj397 td/osd-backfill-space/datafile 2020-09-08T16:21:03.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj397 td/osd-backfill-space/datafile 2020-09-08T16:21:03.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:03.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj398 td/osd-backfill-space/datafile 2020-09-08T16:21:03.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj398 td/osd-backfill-space/datafile 2020-09-08T16:21:04.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:04.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj399 td/osd-backfill-space/datafile 2020-09-08T16:21:04.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj399 td/osd-backfill-space/datafile 2020-09-08T16:21:04.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:04.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj400 td/osd-backfill-space/datafile 2020-09-08T16:21:04.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj400 td/osd-backfill-space/datafile 2020-09-08T16:21:04.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:04.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj401 td/osd-backfill-space/datafile 2020-09-08T16:21:04.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj401 td/osd-backfill-space/datafile 2020-09-08T16:21:04.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:04.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj402 td/osd-backfill-space/datafile 2020-09-08T16:21:04.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj402 td/osd-backfill-space/datafile 2020-09-08T16:21:04.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:04.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj403 td/osd-backfill-space/datafile 2020-09-08T16:21:04.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj403 td/osd-backfill-space/datafile 2020-09-08T16:21:04.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:04.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj404 td/osd-backfill-space/datafile 2020-09-08T16:21:04.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj404 td/osd-backfill-space/datafile 2020-09-08T16:21:04.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:04.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj405 td/osd-backfill-space/datafile 2020-09-08T16:21:05.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj405 td/osd-backfill-space/datafile 2020-09-08T16:21:05.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:05.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj406 td/osd-backfill-space/datafile 2020-09-08T16:21:05.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj406 td/osd-backfill-space/datafile 2020-09-08T16:21:05.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:05.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj407 td/osd-backfill-space/datafile 2020-09-08T16:21:05.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj407 td/osd-backfill-space/datafile 2020-09-08T16:21:05.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:05.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj408 td/osd-backfill-space/datafile 2020-09-08T16:21:05.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj408 td/osd-backfill-space/datafile 2020-09-08T16:21:05.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:05.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj409 td/osd-backfill-space/datafile 2020-09-08T16:21:05.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj409 td/osd-backfill-space/datafile 2020-09-08T16:21:06.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:06.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj410 td/osd-backfill-space/datafile 2020-09-08T16:21:06.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj410 td/osd-backfill-space/datafile 2020-09-08T16:21:06.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:06.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj411 td/osd-backfill-space/datafile 2020-09-08T16:21:06.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj411 td/osd-backfill-space/datafile 2020-09-08T16:21:06.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:06.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj412 td/osd-backfill-space/datafile 2020-09-08T16:21:06.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj412 td/osd-backfill-space/datafile 2020-09-08T16:21:06.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:06.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj413 td/osd-backfill-space/datafile 2020-09-08T16:21:06.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj413 td/osd-backfill-space/datafile 2020-09-08T16:21:06.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:06.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj414 td/osd-backfill-space/datafile 2020-09-08T16:21:06.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj414 td/osd-backfill-space/datafile 2020-09-08T16:21:07.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:07.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj415 td/osd-backfill-space/datafile 2020-09-08T16:21:07.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj415 td/osd-backfill-space/datafile 2020-09-08T16:21:07.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:07.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj416 td/osd-backfill-space/datafile 2020-09-08T16:21:07.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj416 td/osd-backfill-space/datafile 2020-09-08T16:21:07.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:07.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj417 td/osd-backfill-space/datafile 2020-09-08T16:21:07.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj417 td/osd-backfill-space/datafile 2020-09-08T16:21:07.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:07.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj418 td/osd-backfill-space/datafile 2020-09-08T16:21:07.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj418 td/osd-backfill-space/datafile 2020-09-08T16:21:07.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:07.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj419 td/osd-backfill-space/datafile 2020-09-08T16:21:07.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj419 td/osd-backfill-space/datafile 2020-09-08T16:21:07.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:07.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj420 td/osd-backfill-space/datafile 2020-09-08T16:21:07.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj420 td/osd-backfill-space/datafile 2020-09-08T16:21:07.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:07.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj421 td/osd-backfill-space/datafile 2020-09-08T16:21:08.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj421 td/osd-backfill-space/datafile 2020-09-08T16:21:08.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:08.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj422 td/osd-backfill-space/datafile 2020-09-08T16:21:08.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj422 td/osd-backfill-space/datafile 2020-09-08T16:21:08.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:08.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj423 td/osd-backfill-space/datafile 2020-09-08T16:21:08.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj423 td/osd-backfill-space/datafile 2020-09-08T16:21:08.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:08.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj424 td/osd-backfill-space/datafile 2020-09-08T16:21:08.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj424 td/osd-backfill-space/datafile 2020-09-08T16:21:08.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:08.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj425 td/osd-backfill-space/datafile 2020-09-08T16:21:08.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj425 td/osd-backfill-space/datafile 2020-09-08T16:21:08.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:08.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj426 td/osd-backfill-space/datafile 2020-09-08T16:21:08.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj426 td/osd-backfill-space/datafile 2020-09-08T16:21:08.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:08.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj427 td/osd-backfill-space/datafile 2020-09-08T16:21:09.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj427 td/osd-backfill-space/datafile 2020-09-08T16:21:09.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:09.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj428 td/osd-backfill-space/datafile 2020-09-08T16:21:09.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj428 td/osd-backfill-space/datafile 2020-09-08T16:21:09.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:09.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj429 td/osd-backfill-space/datafile 2020-09-08T16:21:09.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj429 td/osd-backfill-space/datafile 2020-09-08T16:21:09.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:09.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj430 td/osd-backfill-space/datafile 2020-09-08T16:21:09.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj430 td/osd-backfill-space/datafile 2020-09-08T16:21:09.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:09.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj431 td/osd-backfill-space/datafile 2020-09-08T16:21:09.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj431 td/osd-backfill-space/datafile 2020-09-08T16:21:09.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:09.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj432 td/osd-backfill-space/datafile 2020-09-08T16:21:09.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj432 td/osd-backfill-space/datafile 2020-09-08T16:21:09.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:09.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj433 td/osd-backfill-space/datafile 2020-09-08T16:21:09.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj433 td/osd-backfill-space/datafile 2020-09-08T16:21:09.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:09.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj434 td/osd-backfill-space/datafile 2020-09-08T16:21:10.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj434 td/osd-backfill-space/datafile 2020-09-08T16:21:10.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:10.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj435 td/osd-backfill-space/datafile 2020-09-08T16:21:10.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj435 td/osd-backfill-space/datafile 2020-09-08T16:21:10.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:10.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj436 td/osd-backfill-space/datafile 2020-09-08T16:21:10.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj436 td/osd-backfill-space/datafile 2020-09-08T16:21:10.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:10.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj437 td/osd-backfill-space/datafile 2020-09-08T16:21:10.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj437 td/osd-backfill-space/datafile 2020-09-08T16:21:10.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:10.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj438 td/osd-backfill-space/datafile 2020-09-08T16:21:10.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj438 td/osd-backfill-space/datafile 2020-09-08T16:21:10.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:10.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj439 td/osd-backfill-space/datafile 2020-09-08T16:21:10.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj439 td/osd-backfill-space/datafile 2020-09-08T16:21:10.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:10.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj440 td/osd-backfill-space/datafile 2020-09-08T16:21:11.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj440 td/osd-backfill-space/datafile 2020-09-08T16:21:11.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:11.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj441 td/osd-backfill-space/datafile 2020-09-08T16:21:11.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj441 td/osd-backfill-space/datafile 2020-09-08T16:21:11.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:11.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj442 td/osd-backfill-space/datafile 2020-09-08T16:21:11.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj442 td/osd-backfill-space/datafile 2020-09-08T16:21:11.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:11.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj443 td/osd-backfill-space/datafile 2020-09-08T16:21:11.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj443 td/osd-backfill-space/datafile 2020-09-08T16:21:11.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:11.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj444 td/osd-backfill-space/datafile 2020-09-08T16:21:11.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj444 td/osd-backfill-space/datafile 2020-09-08T16:21:11.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:11.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj445 td/osd-backfill-space/datafile 2020-09-08T16:21:11.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj445 td/osd-backfill-space/datafile 2020-09-08T16:21:11.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:11.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj446 td/osd-backfill-space/datafile 2020-09-08T16:21:12.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj446 td/osd-backfill-space/datafile 2020-09-08T16:21:12.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:12.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj447 td/osd-backfill-space/datafile 2020-09-08T16:21:12.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj447 td/osd-backfill-space/datafile 2020-09-08T16:21:12.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:12.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj448 td/osd-backfill-space/datafile 2020-09-08T16:21:12.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj448 td/osd-backfill-space/datafile 2020-09-08T16:21:12.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:12.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj449 td/osd-backfill-space/datafile 2020-09-08T16:21:12.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj449 td/osd-backfill-space/datafile 2020-09-08T16:21:12.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:12.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj450 td/osd-backfill-space/datafile 2020-09-08T16:21:12.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj450 td/osd-backfill-space/datafile 2020-09-08T16:21:12.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:12.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj451 td/osd-backfill-space/datafile 2020-09-08T16:21:12.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj451 td/osd-backfill-space/datafile 2020-09-08T16:21:12.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:12.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj452 td/osd-backfill-space/datafile 2020-09-08T16:21:12.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj452 td/osd-backfill-space/datafile 2020-09-08T16:21:13.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:13.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj453 td/osd-backfill-space/datafile 2020-09-08T16:21:13.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj453 td/osd-backfill-space/datafile 2020-09-08T16:21:13.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:13.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj454 td/osd-backfill-space/datafile 2020-09-08T16:21:13.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj454 td/osd-backfill-space/datafile 2020-09-08T16:21:13.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:13.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj455 td/osd-backfill-space/datafile 2020-09-08T16:21:13.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj455 td/osd-backfill-space/datafile 2020-09-08T16:21:13.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:13.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj456 td/osd-backfill-space/datafile 2020-09-08T16:21:13.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj456 td/osd-backfill-space/datafile 2020-09-08T16:21:13.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:13.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj457 td/osd-backfill-space/datafile 2020-09-08T16:21:13.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj457 td/osd-backfill-space/datafile 2020-09-08T16:21:13.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:13.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj458 td/osd-backfill-space/datafile 2020-09-08T16:21:13.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj458 td/osd-backfill-space/datafile 2020-09-08T16:21:13.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:13.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj459 td/osd-backfill-space/datafile 2020-09-08T16:21:14.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj459 td/osd-backfill-space/datafile 2020-09-08T16:21:14.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:14.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj460 td/osd-backfill-space/datafile 2020-09-08T16:21:14.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj460 td/osd-backfill-space/datafile 2020-09-08T16:21:14.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:14.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj461 td/osd-backfill-space/datafile 2020-09-08T16:21:14.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj461 td/osd-backfill-space/datafile 2020-09-08T16:21:14.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:14.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj462 td/osd-backfill-space/datafile 2020-09-08T16:21:14.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj462 td/osd-backfill-space/datafile 2020-09-08T16:21:14.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:14.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj463 td/osd-backfill-space/datafile 2020-09-08T16:21:14.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj463 td/osd-backfill-space/datafile 2020-09-08T16:21:14.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:14.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj464 td/osd-backfill-space/datafile 2020-09-08T16:21:14.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj464 td/osd-backfill-space/datafile 2020-09-08T16:21:14.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:14.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj465 td/osd-backfill-space/datafile 2020-09-08T16:21:15.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj465 td/osd-backfill-space/datafile 2020-09-08T16:21:15.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:15.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj466 td/osd-backfill-space/datafile 2020-09-08T16:21:15.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj466 td/osd-backfill-space/datafile 2020-09-08T16:21:15.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:15.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj467 td/osd-backfill-space/datafile 2020-09-08T16:21:15.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj467 td/osd-backfill-space/datafile 2020-09-08T16:21:15.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:15.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj468 td/osd-backfill-space/datafile 2020-09-08T16:21:15.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj468 td/osd-backfill-space/datafile 2020-09-08T16:21:15.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:15.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj469 td/osd-backfill-space/datafile 2020-09-08T16:21:15.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj469 td/osd-backfill-space/datafile 2020-09-08T16:21:15.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:15.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj470 td/osd-backfill-space/datafile 2020-09-08T16:21:15.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj470 td/osd-backfill-space/datafile 2020-09-08T16:21:15.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:15.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj471 td/osd-backfill-space/datafile 2020-09-08T16:21:15.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj471 td/osd-backfill-space/datafile 2020-09-08T16:21:16.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:16.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj472 td/osd-backfill-space/datafile 2020-09-08T16:21:16.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj472 td/osd-backfill-space/datafile 2020-09-08T16:21:16.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:16.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj473 td/osd-backfill-space/datafile 2020-09-08T16:21:16.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj473 td/osd-backfill-space/datafile 2020-09-08T16:21:16.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:16.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj474 td/osd-backfill-space/datafile 2020-09-08T16:21:16.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj474 td/osd-backfill-space/datafile 2020-09-08T16:21:16.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:16.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj475 td/osd-backfill-space/datafile 2020-09-08T16:21:16.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj475 td/osd-backfill-space/datafile 2020-09-08T16:21:16.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:16.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj476 td/osd-backfill-space/datafile 2020-09-08T16:21:16.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj476 td/osd-backfill-space/datafile 2020-09-08T16:21:16.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:16.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj477 td/osd-backfill-space/datafile 2020-09-08T16:21:16.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj477 td/osd-backfill-space/datafile 2020-09-08T16:21:17.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:17.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj478 td/osd-backfill-space/datafile 2020-09-08T16:21:17.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj478 td/osd-backfill-space/datafile 2020-09-08T16:21:17.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:17.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj479 td/osd-backfill-space/datafile 2020-09-08T16:21:17.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj479 td/osd-backfill-space/datafile 2020-09-08T16:21:17.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:17.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj480 td/osd-backfill-space/datafile 2020-09-08T16:21:17.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj480 td/osd-backfill-space/datafile 2020-09-08T16:21:17.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:17.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj481 td/osd-backfill-space/datafile 2020-09-08T16:21:17.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj481 td/osd-backfill-space/datafile 2020-09-08T16:21:17.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:17.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj482 td/osd-backfill-space/datafile 2020-09-08T16:21:17.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj482 td/osd-backfill-space/datafile 2020-09-08T16:21:17.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:17.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj483 td/osd-backfill-space/datafile 2020-09-08T16:21:17.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj483 td/osd-backfill-space/datafile 2020-09-08T16:21:17.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:17.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj484 td/osd-backfill-space/datafile 2020-09-08T16:21:18.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj484 td/osd-backfill-space/datafile 2020-09-08T16:21:18.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:18.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj485 td/osd-backfill-space/datafile 2020-09-08T16:21:18.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj485 td/osd-backfill-space/datafile 2020-09-08T16:21:18.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:18.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj486 td/osd-backfill-space/datafile 2020-09-08T16:21:18.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj486 td/osd-backfill-space/datafile 2020-09-08T16:21:18.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:18.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj487 td/osd-backfill-space/datafile 2020-09-08T16:21:18.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj487 td/osd-backfill-space/datafile 2020-09-08T16:21:18.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:18.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj488 td/osd-backfill-space/datafile 2020-09-08T16:21:18.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj488 td/osd-backfill-space/datafile 2020-09-08T16:21:18.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:18.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj489 td/osd-backfill-space/datafile 2020-09-08T16:21:18.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj489 td/osd-backfill-space/datafile 2020-09-08T16:21:18.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:18.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj490 td/osd-backfill-space/datafile 2020-09-08T16:21:19.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj490 td/osd-backfill-space/datafile 2020-09-08T16:21:19.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:19.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj491 td/osd-backfill-space/datafile 2020-09-08T16:21:19.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj491 td/osd-backfill-space/datafile 2020-09-08T16:21:19.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:19.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj492 td/osd-backfill-space/datafile 2020-09-08T16:21:19.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj492 td/osd-backfill-space/datafile 2020-09-08T16:21:19.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:19.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj493 td/osd-backfill-space/datafile 2020-09-08T16:21:19.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj493 td/osd-backfill-space/datafile 2020-09-08T16:21:19.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:19.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj494 td/osd-backfill-space/datafile 2020-09-08T16:21:19.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj494 td/osd-backfill-space/datafile 2020-09-08T16:21:19.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:19.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj495 td/osd-backfill-space/datafile 2020-09-08T16:21:19.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj495 td/osd-backfill-space/datafile 2020-09-08T16:21:19.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:19.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj496 td/osd-backfill-space/datafile 2020-09-08T16:21:19.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj496 td/osd-backfill-space/datafile 2020-09-08T16:21:20.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:20.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj497 td/osd-backfill-space/datafile 2020-09-08T16:21:20.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj497 td/osd-backfill-space/datafile 2020-09-08T16:21:20.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:20.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj498 td/osd-backfill-space/datafile 2020-09-08T16:21:20.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj498 td/osd-backfill-space/datafile 2020-09-08T16:21:20.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:20.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj499 td/osd-backfill-space/datafile 2020-09-08T16:21:20.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj499 td/osd-backfill-space/datafile 2020-09-08T16:21:20.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:20.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj500 td/osd-backfill-space/datafile 2020-09-08T16:21:20.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj500 td/osd-backfill-space/datafile 2020-09-08T16:21:20.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:20.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj501 td/osd-backfill-space/datafile 2020-09-08T16:21:20.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj501 td/osd-backfill-space/datafile 2020-09-08T16:21:20.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:20.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj502 td/osd-backfill-space/datafile 2020-09-08T16:21:20.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj502 td/osd-backfill-space/datafile 2020-09-08T16:21:21.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:21.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj503 td/osd-backfill-space/datafile 2020-09-08T16:21:21.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj503 td/osd-backfill-space/datafile 2020-09-08T16:21:21.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:21.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj504 td/osd-backfill-space/datafile 2020-09-08T16:21:21.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj504 td/osd-backfill-space/datafile 2020-09-08T16:21:21.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:21.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj505 td/osd-backfill-space/datafile 2020-09-08T16:21:21.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj505 td/osd-backfill-space/datafile 2020-09-08T16:21:21.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:21.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj506 td/osd-backfill-space/datafile 2020-09-08T16:21:21.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj506 td/osd-backfill-space/datafile 2020-09-08T16:21:21.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:21.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj507 td/osd-backfill-space/datafile 2020-09-08T16:21:21.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj507 td/osd-backfill-space/datafile 2020-09-08T16:21:21.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:21.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj508 td/osd-backfill-space/datafile 2020-09-08T16:21:21.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj508 td/osd-backfill-space/datafile 2020-09-08T16:21:21.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:21.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj509 td/osd-backfill-space/datafile 2020-09-08T16:21:22.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj509 td/osd-backfill-space/datafile 2020-09-08T16:21:22.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:22.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj510 td/osd-backfill-space/datafile 2020-09-08T16:21:22.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj510 td/osd-backfill-space/datafile 2020-09-08T16:21:22.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:22.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj511 td/osd-backfill-space/datafile 2020-09-08T16:21:22.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj511 td/osd-backfill-space/datafile 2020-09-08T16:21:22.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:22.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj512 td/osd-backfill-space/datafile 2020-09-08T16:21:22.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj512 td/osd-backfill-space/datafile 2020-09-08T16:21:22.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:22.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj513 td/osd-backfill-space/datafile 2020-09-08T16:21:22.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj513 td/osd-backfill-space/datafile 2020-09-08T16:21:22.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:22.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj514 td/osd-backfill-space/datafile 2020-09-08T16:21:22.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj514 td/osd-backfill-space/datafile 2020-09-08T16:21:22.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:22.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj515 td/osd-backfill-space/datafile 2020-09-08T16:21:23.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj515 td/osd-backfill-space/datafile 2020-09-08T16:21:23.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:23.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj516 td/osd-backfill-space/datafile 2020-09-08T16:21:23.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj516 td/osd-backfill-space/datafile 2020-09-08T16:21:23.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:23.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj517 td/osd-backfill-space/datafile 2020-09-08T16:21:23.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj517 td/osd-backfill-space/datafile 2020-09-08T16:21:23.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:23.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj518 td/osd-backfill-space/datafile 2020-09-08T16:21:23.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj518 td/osd-backfill-space/datafile 2020-09-08T16:21:23.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:23.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj519 td/osd-backfill-space/datafile 2020-09-08T16:21:23.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj519 td/osd-backfill-space/datafile 2020-09-08T16:21:23.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:23.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj520 td/osd-backfill-space/datafile 2020-09-08T16:21:23.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj520 td/osd-backfill-space/datafile 2020-09-08T16:21:23.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:23.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj521 td/osd-backfill-space/datafile 2020-09-08T16:21:23.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj521 td/osd-backfill-space/datafile 2020-09-08T16:21:24.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:24.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj522 td/osd-backfill-space/datafile 2020-09-08T16:21:24.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj522 td/osd-backfill-space/datafile 2020-09-08T16:21:24.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:24.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj523 td/osd-backfill-space/datafile 2020-09-08T16:21:24.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj523 td/osd-backfill-space/datafile 2020-09-08T16:21:24.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:24.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj524 td/osd-backfill-space/datafile 2020-09-08T16:21:24.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj524 td/osd-backfill-space/datafile 2020-09-08T16:21:24.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:24.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj525 td/osd-backfill-space/datafile 2020-09-08T16:21:24.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj525 td/osd-backfill-space/datafile 2020-09-08T16:21:24.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:24.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj526 td/osd-backfill-space/datafile 2020-09-08T16:21:24.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj526 td/osd-backfill-space/datafile 2020-09-08T16:21:24.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:24.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj527 td/osd-backfill-space/datafile 2020-09-08T16:21:24.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj527 td/osd-backfill-space/datafile 2020-09-08T16:21:24.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:24.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj528 td/osd-backfill-space/datafile 2020-09-08T16:21:25.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj528 td/osd-backfill-space/datafile 2020-09-08T16:21:25.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:25.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj529 td/osd-backfill-space/datafile 2020-09-08T16:21:25.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj529 td/osd-backfill-space/datafile 2020-09-08T16:21:25.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:25.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj530 td/osd-backfill-space/datafile 2020-09-08T16:21:25.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj530 td/osd-backfill-space/datafile 2020-09-08T16:21:25.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:25.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj531 td/osd-backfill-space/datafile 2020-09-08T16:21:25.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj531 td/osd-backfill-space/datafile 2020-09-08T16:21:25.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:25.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj532 td/osd-backfill-space/datafile 2020-09-08T16:21:25.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj532 td/osd-backfill-space/datafile 2020-09-08T16:21:25.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:25.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj533 td/osd-backfill-space/datafile 2020-09-08T16:21:25.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj533 td/osd-backfill-space/datafile 2020-09-08T16:21:25.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:25.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj534 td/osd-backfill-space/datafile 2020-09-08T16:21:26.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj534 td/osd-backfill-space/datafile 2020-09-08T16:21:26.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:26.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj535 td/osd-backfill-space/datafile 2020-09-08T16:21:26.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj535 td/osd-backfill-space/datafile 2020-09-08T16:21:26.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:26.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj536 td/osd-backfill-space/datafile 2020-09-08T16:21:26.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj536 td/osd-backfill-space/datafile 2020-09-08T16:21:26.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:26.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj537 td/osd-backfill-space/datafile 2020-09-08T16:21:26.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj537 td/osd-backfill-space/datafile 2020-09-08T16:21:26.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:26.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj538 td/osd-backfill-space/datafile 2020-09-08T16:21:26.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj538 td/osd-backfill-space/datafile 2020-09-08T16:21:26.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:26.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj539 td/osd-backfill-space/datafile 2020-09-08T16:21:26.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj539 td/osd-backfill-space/datafile 2020-09-08T16:21:26.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:26.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj540 td/osd-backfill-space/datafile 2020-09-08T16:21:27.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj540 td/osd-backfill-space/datafile 2020-09-08T16:21:27.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:27.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj541 td/osd-backfill-space/datafile 2020-09-08T16:21:27.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj541 td/osd-backfill-space/datafile 2020-09-08T16:21:27.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:27.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj542 td/osd-backfill-space/datafile 2020-09-08T16:21:27.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj542 td/osd-backfill-space/datafile 2020-09-08T16:21:27.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:27.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj543 td/osd-backfill-space/datafile 2020-09-08T16:21:27.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj543 td/osd-backfill-space/datafile 2020-09-08T16:21:27.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:27.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj544 td/osd-backfill-space/datafile 2020-09-08T16:21:27.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj544 td/osd-backfill-space/datafile 2020-09-08T16:21:27.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:27.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj545 td/osd-backfill-space/datafile 2020-09-08T16:21:27.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj545 td/osd-backfill-space/datafile 2020-09-08T16:21:27.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:27.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj546 td/osd-backfill-space/datafile 2020-09-08T16:21:27.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj546 td/osd-backfill-space/datafile 2020-09-08T16:21:28.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:28.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj547 td/osd-backfill-space/datafile 2020-09-08T16:21:28.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj547 td/osd-backfill-space/datafile 2020-09-08T16:21:28.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:28.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj548 td/osd-backfill-space/datafile 2020-09-08T16:21:28.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj548 td/osd-backfill-space/datafile 2020-09-08T16:21:28.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:28.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj549 td/osd-backfill-space/datafile 2020-09-08T16:21:28.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj549 td/osd-backfill-space/datafile 2020-09-08T16:21:28.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:28.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj550 td/osd-backfill-space/datafile 2020-09-08T16:21:28.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj550 td/osd-backfill-space/datafile 2020-09-08T16:21:28.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:28.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj551 td/osd-backfill-space/datafile 2020-09-08T16:21:28.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj551 td/osd-backfill-space/datafile 2020-09-08T16:21:28.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:28.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj552 td/osd-backfill-space/datafile 2020-09-08T16:21:28.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj552 td/osd-backfill-space/datafile 2020-09-08T16:21:29.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:29.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj553 td/osd-backfill-space/datafile 2020-09-08T16:21:29.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj553 td/osd-backfill-space/datafile 2020-09-08T16:21:29.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:29.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj554 td/osd-backfill-space/datafile 2020-09-08T16:21:29.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj554 td/osd-backfill-space/datafile 2020-09-08T16:21:29.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:29.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj555 td/osd-backfill-space/datafile 2020-09-08T16:21:29.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj555 td/osd-backfill-space/datafile 2020-09-08T16:21:29.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:29.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj556 td/osd-backfill-space/datafile 2020-09-08T16:21:29.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj556 td/osd-backfill-space/datafile 2020-09-08T16:21:29.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:29.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj557 td/osd-backfill-space/datafile 2020-09-08T16:21:29.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj557 td/osd-backfill-space/datafile 2020-09-08T16:21:29.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:29.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj558 td/osd-backfill-space/datafile 2020-09-08T16:21:29.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj558 td/osd-backfill-space/datafile 2020-09-08T16:21:29.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:29.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj559 td/osd-backfill-space/datafile 2020-09-08T16:21:30.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj559 td/osd-backfill-space/datafile 2020-09-08T16:21:30.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:30.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj560 td/osd-backfill-space/datafile 2020-09-08T16:21:30.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj560 td/osd-backfill-space/datafile 2020-09-08T16:21:30.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:30.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj561 td/osd-backfill-space/datafile 2020-09-08T16:21:30.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj561 td/osd-backfill-space/datafile 2020-09-08T16:21:30.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:30.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj562 td/osd-backfill-space/datafile 2020-09-08T16:21:30.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj562 td/osd-backfill-space/datafile 2020-09-08T16:21:30.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:30.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj563 td/osd-backfill-space/datafile 2020-09-08T16:21:30.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj563 td/osd-backfill-space/datafile 2020-09-08T16:21:30.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:30.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj564 td/osd-backfill-space/datafile 2020-09-08T16:21:30.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj564 td/osd-backfill-space/datafile 2020-09-08T16:21:30.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:30.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj565 td/osd-backfill-space/datafile 2020-09-08T16:21:31.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj565 td/osd-backfill-space/datafile 2020-09-08T16:21:31.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:31.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj566 td/osd-backfill-space/datafile 2020-09-08T16:21:31.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj566 td/osd-backfill-space/datafile 2020-09-08T16:21:31.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:31.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj567 td/osd-backfill-space/datafile 2020-09-08T16:21:31.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj567 td/osd-backfill-space/datafile 2020-09-08T16:21:31.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:31.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj568 td/osd-backfill-space/datafile 2020-09-08T16:21:31.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj568 td/osd-backfill-space/datafile 2020-09-08T16:21:31.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:31.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj569 td/osd-backfill-space/datafile 2020-09-08T16:21:31.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj569 td/osd-backfill-space/datafile 2020-09-08T16:21:31.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:31.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj570 td/osd-backfill-space/datafile 2020-09-08T16:21:31.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj570 td/osd-backfill-space/datafile 2020-09-08T16:21:31.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:31.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj571 td/osd-backfill-space/datafile 2020-09-08T16:21:31.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj571 td/osd-backfill-space/datafile 2020-09-08T16:21:32.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:32.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj572 td/osd-backfill-space/datafile 2020-09-08T16:21:32.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj572 td/osd-backfill-space/datafile 2020-09-08T16:21:32.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:32.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj573 td/osd-backfill-space/datafile 2020-09-08T16:21:32.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj573 td/osd-backfill-space/datafile 2020-09-08T16:21:32.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:32.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj574 td/osd-backfill-space/datafile 2020-09-08T16:21:32.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj574 td/osd-backfill-space/datafile 2020-09-08T16:21:32.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:32.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj575 td/osd-backfill-space/datafile 2020-09-08T16:21:32.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj575 td/osd-backfill-space/datafile 2020-09-08T16:21:32.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:32.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj576 td/osd-backfill-space/datafile 2020-09-08T16:21:32.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj576 td/osd-backfill-space/datafile 2020-09-08T16:21:32.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:32.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj577 td/osd-backfill-space/datafile 2020-09-08T16:21:32.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj577 td/osd-backfill-space/datafile 2020-09-08T16:21:32.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:32.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj578 td/osd-backfill-space/datafile 2020-09-08T16:21:33.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj578 td/osd-backfill-space/datafile 2020-09-08T16:21:33.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:33.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj579 td/osd-backfill-space/datafile 2020-09-08T16:21:33.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj579 td/osd-backfill-space/datafile 2020-09-08T16:21:33.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:33.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj580 td/osd-backfill-space/datafile 2020-09-08T16:21:33.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj580 td/osd-backfill-space/datafile 2020-09-08T16:21:33.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:33.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj581 td/osd-backfill-space/datafile 2020-09-08T16:21:33.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj581 td/osd-backfill-space/datafile 2020-09-08T16:21:33.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:33.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj582 td/osd-backfill-space/datafile 2020-09-08T16:21:33.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj582 td/osd-backfill-space/datafile 2020-09-08T16:21:33.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:33.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj583 td/osd-backfill-space/datafile 2020-09-08T16:21:33.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj583 td/osd-backfill-space/datafile 2020-09-08T16:21:33.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:33.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj584 td/osd-backfill-space/datafile 2020-09-08T16:21:33.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj584 td/osd-backfill-space/datafile 2020-09-08T16:21:34.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:34.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj585 td/osd-backfill-space/datafile 2020-09-08T16:21:34.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj585 td/osd-backfill-space/datafile 2020-09-08T16:21:34.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:34.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj586 td/osd-backfill-space/datafile 2020-09-08T16:21:34.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj586 td/osd-backfill-space/datafile 2020-09-08T16:21:34.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:34.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj587 td/osd-backfill-space/datafile 2020-09-08T16:21:34.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj587 td/osd-backfill-space/datafile 2020-09-08T16:21:34.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:34.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj588 td/osd-backfill-space/datafile 2020-09-08T16:21:34.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj588 td/osd-backfill-space/datafile 2020-09-08T16:21:34.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:34.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj589 td/osd-backfill-space/datafile 2020-09-08T16:21:34.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj589 td/osd-backfill-space/datafile 2020-09-08T16:21:34.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:34.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj590 td/osd-backfill-space/datafile 2020-09-08T16:21:34.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj590 td/osd-backfill-space/datafile 2020-09-08T16:21:35.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:35.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj591 td/osd-backfill-space/datafile 2020-09-08T16:21:35.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj591 td/osd-backfill-space/datafile 2020-09-08T16:21:35.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:35.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj592 td/osd-backfill-space/datafile 2020-09-08T16:21:35.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj592 td/osd-backfill-space/datafile 2020-09-08T16:21:35.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:35.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj593 td/osd-backfill-space/datafile 2020-09-08T16:21:35.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj593 td/osd-backfill-space/datafile 2020-09-08T16:21:35.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:35.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj594 td/osd-backfill-space/datafile 2020-09-08T16:21:35.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj594 td/osd-backfill-space/datafile 2020-09-08T16:21:35.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:35.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj595 td/osd-backfill-space/datafile 2020-09-08T16:21:35.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj595 td/osd-backfill-space/datafile 2020-09-08T16:21:35.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:35.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj596 td/osd-backfill-space/datafile 2020-09-08T16:21:35.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj596 td/osd-backfill-space/datafile 2020-09-08T16:21:36.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:36.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj597 td/osd-backfill-space/datafile 2020-09-08T16:21:36.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj597 td/osd-backfill-space/datafile 2020-09-08T16:21:36.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:36.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj598 td/osd-backfill-space/datafile 2020-09-08T16:21:36.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj598 td/osd-backfill-space/datafile 2020-09-08T16:21:36.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:36.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj599 td/osd-backfill-space/datafile 2020-09-08T16:21:36.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj599 td/osd-backfill-space/datafile 2020-09-08T16:21:36.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2020-09-08T16:21:36.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:375: TEST_backfill_test_sametarget: rados -p test1 put obj600 td/osd-backfill-space/datafile 2020-09-08T16:21:36.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test4 put obj600 td/osd-backfill-space/datafile 2020-09-08T16:21:36.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:379: TEST_backfill_test_sametarget: ceph osd pool set test1 size 2 2020-09-08T16:21:37.608 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 2 2020-09-08T16:21:37.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:380: TEST_backfill_test_sametarget: ceph osd pool set test4 size 2 2020-09-08T16:21:38.455 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 4 size to 2 2020-09-08T16:21:38.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:381: TEST_backfill_test_sametarget: sleep 30 2020-09-08T16:22:08.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:383: TEST_backfill_test_sametarget: wait_for_not_backfilling 240 2020-09-08T16:22:08.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:82: wait_for_not_backfilling: local timeout=240 2020-09-08T16:22:08.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:83: wait_for_not_backfilling: wait_for_not_state backfilling 240 2020-09-08T16:22:08.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:53: wait_for_not_state: local state=backfilling 2020-09-08T16:22:08.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:54: wait_for_not_state: local num_in_state=-1 2020-09-08T16:22:08.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:55: wait_for_not_state: local cur_in_state 2020-09-08T16:22:08.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: delays=($(get_timeout_delays $2 5)) 2020-09-08T16:22:08.467 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: get_timeout_delays 240 5 2020-09-08T16:22:08.468 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:22:08.468 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:22:08.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:22:08.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:22:08.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:22:08.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: local -a delays 2020-09-08T16:22:08.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:57: wait_for_not_state: local -i loop=0 2020-09-08T16:22:08.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:59: wait_for_not_state: flush_pg_stats 2020-09-08T16:22:08.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:22:08.613 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:22:09.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:22:09.009 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:22:09.009 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:22:09.010 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:22:09.010 INFO:tasks.workunit.client.0.smithi065.stderr:4' 2020-09-08T16:22:09.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:22:09.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:22:09.010 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:22:09.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836529 2020-09-08T16:22:09.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836529 2020-09-08T16:22:09.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836529' 2020-09-08T16:22:09.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:22:09.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:22:09.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949673007 2020-09-08T16:22:09.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949673007 2020-09-08T16:22:09.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836529 1-42949673007' 2020-09-08T16:22:09.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:22:09.276 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:22:09.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509487 2020-09-08T16:22:09.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509487 2020-09-08T16:22:09.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836529 1-42949673007 2-64424509487' 2020-09-08T16:22:09.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:22:09.409 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:22:09.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345964 2020-09-08T16:22:09.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345964 2020-09-08T16:22:09.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836529 1-42949673007 2-64424509487 3-85899345964' 2020-09-08T16:22:09.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:22:09.542 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:22:09.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182443 2020-09-08T16:22:09.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182443 2020-09-08T16:22:09.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836529 1-42949673007 2-64424509487 3-85899345964 4-107374182443' 2020-09-08T16:22:09.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:22:09.676 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836529 2020-09-08T16:22:09.676 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:22:09.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:22:09.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836529 2020-09-08T16:22:09.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:22:09.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836529 2020-09-08T16:22:09.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836529' 2020-09-08T16:22:09.678 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:22:09.679 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836529 2020-09-08T16:22:10.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836527 -lt 21474836529 2020-09-08T16:22:10.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:22:11.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:22:11.075 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:22:11.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836529 -lt 21474836529 2020-09-08T16:22:11.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:22:11.476 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949673007 2020-09-08T16:22:11.477 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:22:11.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:22:11.478 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949673007 2020-09-08T16:22:11.478 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:22:11.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949673007 2020-09-08T16:22:11.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949673007' 2020-09-08T16:22:11.479 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:22:11.479 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949673007 2020-09-08T16:22:11.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949673007 -lt 42949673007 2020-09-08T16:22:11.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:22:11.876 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509487 2020-09-08T16:22:11.876 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:22:11.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:22:11.877 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509487 2020-09-08T16:22:11.878 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:22:11.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509487 2020-09-08T16:22:11.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509487' 2020-09-08T16:22:11.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:22:11.879 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509487 2020-09-08T16:22:12.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509487 -lt 64424509487 2020-09-08T16:22:12.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:22:12.293 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345964 2020-09-08T16:22:12.293 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:22:12.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:22:12.295 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345964 2020-09-08T16:22:12.295 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:22:12.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345964 2020-09-08T16:22:12.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345964' 2020-09-08T16:22:12.296 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:22:12.296 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345964 2020-09-08T16:22:12.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345965 -lt 85899345964 2020-09-08T16:22:12.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:22:12.695 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182443 2020-09-08T16:22:12.695 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:22:12.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:22:12.696 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182443 2020-09-08T16:22:12.696 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:22:12.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182443 2020-09-08T16:22:12.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182443' 2020-09-08T16:22:12.697 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:22:12.698 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182443 2020-09-08T16:22:13.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182443 -lt 107374182443 2020-09-08T16:22:13.126 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: get_num_pgs 2020-09-08T16:22:13.126 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:22:13.126 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:22:13.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: test 2 == 0 2020-09-08T16:22:13.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:22:13.647 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:22:13.647 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:22:13.647 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:22:13.648 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:22:13.648 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:22:13.648 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:22:14.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=1 2020-09-08T16:22:14.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 1 = 0 2020-09-08T16:22:14.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 1 '!=' -1 2020-09-08T16:22:14.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:68: wait_for_not_state: loop=0 2020-09-08T16:22:14.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:69: wait_for_not_state: num_in_state=1 2020-09-08T16:22:14.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 5 2020-09-08T16:22:19.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:22:19.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:22:19.032 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:22:19.033 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:22:19.033 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:22:19.033 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:22:19.034 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:22:19.034 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:22:19.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=1 2020-09-08T16:22:19.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 1 = 0 2020-09-08T16:22:19.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 1 '!=' 1 2020-09-08T16:22:19.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 1 >= 17 )) 2020-09-08T16:22:19.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 10 2020-09-08T16:22:29.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:22:29.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:22:29.433 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:22:29.433 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:22:29.433 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:22:29.434 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:22:29.434 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:22:29.434 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:22:29.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=1 2020-09-08T16:22:29.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 1 = 0 2020-09-08T16:22:29.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 1 '!=' 1 2020-09-08T16:22:29.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 2 >= 17 )) 2020-09-08T16:22:29.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 15 2020-09-08T16:22:44.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:22:44.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:22:44.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:22:44.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:22:44.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:22:44.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:22:44.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:22:44.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:22:45.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=1 2020-09-08T16:22:45.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 1 = 0 2020-09-08T16:22:45.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 1 '!=' 1 2020-09-08T16:22:45.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 3 >= 17 )) 2020-09-08T16:22:45.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 15 2020-09-08T16:23:00.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:23:00.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:23:00.231 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:23:00.232 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:23:00.232 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:23:00.232 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:23:00.233 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:23:00.233 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:23:00.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=1 2020-09-08T16:23:00.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 1 = 0 2020-09-08T16:23:00.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 1 '!=' 1 2020-09-08T16:23:00.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 4 >= 17 )) 2020-09-08T16:23:00.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 15 2020-09-08T16:23:15.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:23:15.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:23:15.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:23:15.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:23:15.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:23:15.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:23:15.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:23:15.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:23:16.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=0 2020-09-08T16:23:16.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 0 = 0 2020-09-08T16:23:16.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: break 2020-09-08T16:23:16.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:77: wait_for_not_state: return 0 2020-09-08T16:23:16.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:384: TEST_backfill_test_sametarget: wait_for_not_activating 60 2020-09-08T16:23:16.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:88: wait_for_not_activating: local timeout=60 2020-09-08T16:23:16.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:89: wait_for_not_activating: wait_for_not_state activating 60 2020-09-08T16:23:16.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:53: wait_for_not_state: local state=activating 2020-09-08T16:23:16.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:54: wait_for_not_state: local num_in_state=-1 2020-09-08T16:23:16.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:55: wait_for_not_state: local cur_in_state 2020-09-08T16:23:16.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: delays=($(get_timeout_delays $2 5)) 2020-09-08T16:23:16.026 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: get_timeout_delays 60 5 2020-09-08T16:23:16.026 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:23:16.026 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:23:16.026 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:23:16.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:23:16.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:23:16.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: local -a delays 2020-09-08T16:23:16.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:57: wait_for_not_state: local -i loop=0 2020-09-08T16:23:16.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:59: wait_for_not_state: flush_pg_stats 2020-09-08T16:23:16.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:23:16.066 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:23:16.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:23:16.467 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:23:16.467 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:23:16.468 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:23:16.468 INFO:tasks.workunit.client.0.smithi065.stderr:4' 2020-09-08T16:23:16.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:23:16.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:23:16.468 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:23:16.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836544 2020-09-08T16:23:16.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836544 2020-09-08T16:23:16.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836544' 2020-09-08T16:23:16.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:23:16.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:23:16.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949673023 2020-09-08T16:23:16.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949673023 2020-09-08T16:23:16.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836544 1-42949673023' 2020-09-08T16:23:16.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:23:16.736 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:23:16.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509502 2020-09-08T16:23:16.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509502 2020-09-08T16:23:16.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836544 1-42949673023 2-64424509502' 2020-09-08T16:23:16.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:23:16.868 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:23:17.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345980 2020-09-08T16:23:17.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345980 2020-09-08T16:23:17.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836544 1-42949673023 2-64424509502 3-85899345980' 2020-09-08T16:23:17.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:23:17.001 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:23:17.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182458 2020-09-08T16:23:17.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182458 2020-09-08T16:23:17.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836544 1-42949673023 2-64424509502 3-85899345980 4-107374182458' 2020-09-08T16:23:17.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:23:17.134 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836544 2020-09-08T16:23:17.134 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:23:17.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:23:17.135 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836544 2020-09-08T16:23:17.135 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:23:17.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836544 2020-09-08T16:23:17.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836544' 2020-09-08T16:23:17.136 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836544 2020-09-08T16:23:17.136 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:23:17.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836542 -lt 21474836544 2020-09-08T16:23:17.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:23:18.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:23:18.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:23:18.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836545 -lt 21474836544 2020-09-08T16:23:18.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:23:18.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949673023 2020-09-08T16:23:18.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:23:18.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:23:18.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949673023 2020-09-08T16:23:18.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:23:18.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949673023 2020-09-08T16:23:18.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949673023' 2020-09-08T16:23:18.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:23:18.931 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949673023 2020-09-08T16:23:19.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949673023 -lt 42949673023 2020-09-08T16:23:19.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:23:19.324 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509502 2020-09-08T16:23:19.325 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:23:19.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:23:19.325 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509502 2020-09-08T16:23:19.326 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:23:19.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509502 2020-09-08T16:23:19.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509502' 2020-09-08T16:23:19.327 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:23:19.327 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509502 2020-09-08T16:23:19.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509502 -lt 64424509502 2020-09-08T16:23:19.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:23:19.748 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345980 2020-09-08T16:23:19.748 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:23:19.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:23:19.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345980 2020-09-08T16:23:19.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:23:19.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345980 2020-09-08T16:23:19.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345980' 2020-09-08T16:23:19.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:23:19.750 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345980 2020-09-08T16:23:20.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345980 -lt 85899345980 2020-09-08T16:23:20.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:23:20.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182458 2020-09-08T16:23:20.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:23:20.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:23:20.169 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182458 2020-09-08T16:23:20.169 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:23:20.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182458 2020-09-08T16:23:20.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182458' 2020-09-08T16:23:20.170 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:23:20.171 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182458 2020-09-08T16:23:20.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182459 -lt 107374182458 2020-09-08T16:23:20.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: get_num_pgs 2020-09-08T16:23:20.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:23:20.575 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:23:21.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: test 2 == 0 2020-09-08T16:23:21.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:23:21.111 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state activating 2020-09-08T16:23:21.111 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=activating 2020-09-08T16:23:21.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:23:21.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("activating"))' 2020-09-08T16:23:21.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:23:21.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("activating"))] | length' 2020-09-08T16:23:21.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=0 2020-09-08T16:23:21.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 0 = 0 2020-09-08T16:23:21.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: break 2020-09-08T16:23:21.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:77: wait_for_not_state: return 0 2020-09-08T16:23:21.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:386: TEST_backfill_test_sametarget: ERRORS=0 2020-09-08T16:23:21.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:387: TEST_backfill_test_sametarget: ceph pg dump pgs 2020-09-08T16:23:21.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:387: TEST_backfill_test_sametarget: grep +backfill_toofull 2020-09-08T16:23:21.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:387: TEST_backfill_test_sametarget: wc -l 2020-09-08T16:23:21.864 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:23:21.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:387: TEST_backfill_test_sametarget: '[' 1 '!=' 1 ']' 2020-09-08T16:23:21.873 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:393: TEST_backfill_test_sametarget: ceph pg dump pgs 2020-09-08T16:23:21.874 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:393: TEST_backfill_test_sametarget: grep active+clean 2020-09-08T16:23:21.874 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:393: TEST_backfill_test_sametarget: wc -l 2020-09-08T16:23:22.247 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:23:22.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:393: TEST_backfill_test_sametarget: '[' 1 '!=' 1 ']' 2020-09-08T16:23:22.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:399: TEST_backfill_test_sametarget: ceph pg dump pgs 2020-09-08T16:23:22.630 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T16:23:22.631 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 600 0 0 0 0 2457600 0 0 100 100 active+clean 2020-09-08T16:23:15.755553+0000 95'600 104:1898 [1,0] 1 [1,0] 1 0'0 2020-09-08T16:19:09.539157+0000 0'0 2020-09-08T16:19:09.539157+0000 0 2020-09-08T16:23:22.631 INFO:tasks.workunit.client.0.smithi065.stdout:4.0 600 0 600 0 0 2457600 0 0 100 100 active+undersized+degraded+remapped+backfill_toofull 2020-09-08T16:23:09.576373+0000 95'600 103:688 [4,0] 4 [4] 4 0'0 2020-09-08T16:19:17.184627+0000 0'0 2020-09-08T16:19:17.184627+0000 0 2020-09-08T16:23:22.631 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T16:23:22.631 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T16:23:22.632 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:23:22.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:401: TEST_backfill_test_sametarget: '[' 0 '!=' 0 ']' 2020-09-08T16:23:22.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:406: TEST_backfill_test_sametarget: delete_pool test1 2020-09-08T16:23:22.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test1 2020-09-08T16:23:22.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2020-09-08T16:23:23.163 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test1' does not exist 2020-09-08T16:23:23.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:407: TEST_backfill_test_sametarget: delete_pool test4 2020-09-08T16:23:23.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test4 2020-09-08T16:23:23.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test4 test4 --yes-i-really-really-mean-it 2020-09-08T16:23:23.730 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test4' does not exist 2020-09-08T16:23:23.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:408: TEST_backfill_test_sametarget: kill_daemons td/osd-backfill-space 2020-09-08T16:23:23.739 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:23:23.739 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:23:23.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:23:23.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:23:23.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:23:23.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:23:23.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:409: TEST_backfill_test_sametarget: grep -q 'num_bytes mismatch' td/osd-backfill-space/osd.0.log td/osd-backfill-space/osd.1.log td/osd-backfill-space/osd.2.log td/osd-backfill-space/osd.3.log td/osd-backfill-space/osd.4.log 2020-09-08T16:23:23.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:38: run: teardown td/osd-backfill-space 2020-09-08T16:23:23.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2020-09-08T16:23:23.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:23:23.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2020-09-08T16:23:23.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:23:23.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:23:23.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:23:23.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:23:23.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:23:23.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:23:23.899 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:23:23.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:23:23.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:23:23.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:23:23.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:23:23.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:23:23.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:23:23.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:23:23.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:23:23.901 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:23:23.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:23:23.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:23:23.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2020-09-08T16:23:23.928 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:23:23.928 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:23:23.928 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:23:23.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.154687 2020-09-08T16:23:23.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:23:23.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:23:23.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:35: run: for func in $funcs 2020-09-08T16:23:23.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:36: run: setup td/osd-backfill-space 2020-09-08T16:23:23.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-space 2020-09-08T16:23:23.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-space 2020-09-08T16:23:23.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2020-09-08T16:23:23.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:23:23.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2020-09-08T16:23:23.937 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:23:23.938 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:23:23.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:23:23.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:23:23.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:23:23.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:23:23.941 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:23:23.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:23:23.941 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:23:23.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:23:23.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:23:23.942 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:23:23.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:23:23.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:23:23.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:23:23.943 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:23:23.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:23:23.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:23:23.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2020-09-08T16:23:23.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:23:23.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:23:23.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:23:23.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.154687 2020-09-08T16:23:23.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:23:23.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:23:23.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-space 2020-09-08T16:23:23.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T16:23:23.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:23:23.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:23:23.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.154687 2020-09-08T16:23:23.947 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T16:23:23.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T16:23:23.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T16:23:23.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2020-09-08T16:23:23.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:37: run: TEST_backfill_test_simple td/osd-backfill-space 2020-09-08T16:23:23.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:109: TEST_backfill_test_simple: local dir=td/osd-backfill-space 2020-09-08T16:23:23.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:110: TEST_backfill_test_simple: local pools=2 2020-09-08T16:23:23.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:111: TEST_backfill_test_simple: local OSDS=3 2020-09-08T16:23:23.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:113: TEST_backfill_test_simple: run_mon td/osd-backfill-space a 2020-09-08T16:23:23.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-space 2020-09-08T16:23:23.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T16:23:23.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T16:23:23.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T16:23:23.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-space/a 2020-09-08T16:23:23.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2020-09-08T16:23:24.236 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T16:23:24.236 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:23:24.237 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:23:24.237 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:23:24.237 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:23:24.237 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:23:24.238 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:23:24.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T16:23:24.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T16:23:24.413 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T16:23:24.414 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:23:24.414 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:23:24.414 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T16:23:24.414 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T16:23:24.414 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:23:24.415 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:23:24.415 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:23:24.416 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:23:24.416 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:23:24.416 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:23:24.416 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.154687/ceph-mon.a.asok 2020-09-08T16:23:24.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:23:24.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.154687/ceph-mon.a.asok config get fsid 2020-09-08T16:23:24.508 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T16:23:24.508 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:23:24.508 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:23:24.508 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T16:23:24.509 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T16:23:24.509 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:23:24.509 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:23:24.509 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:23:24.510 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:23:24.510 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:23:24.511 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:23:24.511 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.154687/ceph-mon.a.asok 2020-09-08T16:23:24.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:23:24.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.154687/ceph-mon.a.asok config get mon_host 2020-09-08T16:23:24.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:114: TEST_backfill_test_simple: run_mgr td/osd-backfill-space x 2020-09-08T16:23:24.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-space 2020-09-08T16:23:24.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T16:23:24.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T16:23:24.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T16:23:24.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-space/x 2020-09-08T16:23:24.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T16:23:25.129 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T16:23:25.129 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:23:25.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:23:25.130 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:23:25.130 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:23:25.130 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:23:25.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:23:25.131 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:23:25.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:23:25.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:115: TEST_backfill_test_simple: export CEPH_ARGS 2020-09-08T16:23:25.156 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:117: TEST_backfill_test_simple: expr 3 - 1 2020-09-08T16:23:25.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:117: TEST_backfill_test_simple: seq 0 2 2020-09-08T16:23:25.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:117: TEST_backfill_test_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:23:25.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:119: TEST_backfill_test_simple: run_osd td/osd-backfill-space 0 2020-09-08T16:23:25.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:23:25.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:23:25.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T16:23:25.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:23:25.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/0 2020-09-08T16:23:25.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:23:25.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:23:25.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:23:25.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:23:25.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2020-09-08T16:23:25.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2020-09-08T16:23:25.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:23:25.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:23:25.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:23:25.164 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:23:25.164 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:23:25.165 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:23:25.165 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:23:25.165 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:23:25.165 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:23:25.165 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:23:25.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:23:25.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:23:25.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:23:25.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:23:25.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:23:25.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:23:25.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:23:25.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:23:25.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:23:25.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:23:25.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:23:25.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/0 2020-09-08T16:23:25.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:23:25.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=4af56ac8-0518-4335-a340-454a8680d557 2020-09-08T16:23:25.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 4af56ac8-0518-4335-a340-454a8680d557' 2020-09-08T16:23:25.169 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:23:25.169 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 4af56ac8-0518-4335-a340-454a8680d557 2020-09-08T16:23:25.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQD9r1dfdlUQCxAADPX9GPFV+q/89W8VYpHHeg== 2020-09-08T16:23:25.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQD9r1dfdlUQCxAADPX9GPFV+q/89W8VYpHHeg=="}' 2020-09-08T16:23:25.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 4af56ac8-0518-4335-a340-454a8680d557 -i td/osd-backfill-space/0/new.json 2020-09-08T16:23:25.523 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:23:25.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/0/new.json 2020-09-08T16:23:25.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQD9r1dfdlUQCxAADPX9GPFV+q/89W8VYpHHeg== --osd-uuid 4af56ac8-0518-4335-a340-454a8680d557 2020-09-08T16:23:25.562 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:25.567+0000 7f32d9544ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:23:25.568 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:25.569+0000 7f32d9544ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:23:25.568 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:25.570+0000 7f32d9544ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:23:25.569 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:25.571+0000 7f32d9544ec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T16:23:25.569 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:25.571+0000 7f32d9544ec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T16:23:25.569 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:25.571+0000 7f32d9544ec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T16:23:25.628 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:25.633+0000 7f32d9544ec0 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2020-09-08T16:23:29.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2020-09-08T16:23:29.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:23:29.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T16:23:29.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:23:29.837 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T16:23:30.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T16:23:30.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:23:30.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:23:30.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:23:30.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:23:30.364 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T16:23:30.388 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:30.394+0000 7f742b587ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:23:30.409 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:30.414+0000 7f742b587ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:23:30.410 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:30.416+0000 7f742b587ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:23:30.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T16:23:30.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:23:30.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T16:23:30.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:23:30.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:23:30.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:23:30.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:23:30.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:23:30.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:23:30.756 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:23:30.926 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:30.932+0000 7f742b587ec0 -1 Falling back to public interface 2020-09-08T16:23:31.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:23:31.743 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:31.748+0000 7f742b587ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T16:23:32.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:23:32.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:23:32.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:23:32.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:23:32.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:23:32.165 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:23:32.585 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/399383,v1:127.0.0.1:6803/399383] [v2:127.0.0.1:6804/399383,v1:127.0.0.1:6805/399383] exists,up 4af56ac8-0518-4335-a340-454a8680d557 2020-09-08T16:23:32.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:23:32.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:23:32.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:23:32.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:117: TEST_backfill_test_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:23:32.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:119: TEST_backfill_test_simple: run_osd td/osd-backfill-space 1 2020-09-08T16:23:32.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:23:32.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:23:32.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T16:23:32.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:23:32.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/1 2020-09-08T16:23:32.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:23:32.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:23:32.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:23:32.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:23:32.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2020-09-08T16:23:32.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2020-09-08T16:23:32.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:23:32.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:23:32.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:23:32.590 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:23:32.590 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:23:32.590 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:23:32.590 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:23:32.590 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:23:32.591 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:23:32.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:23:32.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:23:32.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:23:32.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:23:32.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:23:32.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:23:32.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:23:32.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:23:32.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:23:32.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:23:32.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:23:32.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:23:32.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/1 2020-09-08T16:23:32.594 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:23:32.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=aa2bca1f-0db6-4037-9802-54bdac3eba1e 2020-09-08T16:23:32.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 aa2bca1f-0db6-4037-9802-54bdac3eba1e' 2020-09-08T16:23:32.595 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:23:32.595 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 aa2bca1f-0db6-4037-9802-54bdac3eba1e 2020-09-08T16:23:32.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAEsFdfgPlYJBAApk4d+TEINaIpuNhabHprRQ== 2020-09-08T16:23:32.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAEsFdfgPlYJBAApk4d+TEINaIpuNhabHprRQ=="}' 2020-09-08T16:23:32.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new aa2bca1f-0db6-4037-9802-54bdac3eba1e -i td/osd-backfill-space/1/new.json 2020-09-08T16:23:33.108 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:23:33.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/1/new.json 2020-09-08T16:23:33.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAEsFdfgPlYJBAApk4d+TEINaIpuNhabHprRQ== --osd-uuid aa2bca1f-0db6-4037-9802-54bdac3eba1e 2020-09-08T16:23:33.147 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:33.153+0000 7fb978361ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:23:33.149 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:33.154+0000 7fb978361ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:23:33.150 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:33.156+0000 7fb978361ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:23:33.151 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:33.157+0000 7fb978361ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T16:23:33.152 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:33.157+0000 7fb978361ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T16:23:33.152 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:33.157+0000 7fb978361ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T16:23:33.233 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:33.238+0000 7fb978361ec0 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2020-09-08T16:23:37.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2020-09-08T16:23:37.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:23:37.436 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T16:23:37.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T16:23:37.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:23:37.974 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T16:23:37.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T16:23:37.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:23:37.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:23:37.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:23:37.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:23:38.000 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:38.003+0000 7f77a5d64ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:23:38.012 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:38.016+0000 7f77a5d64ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:23:38.013 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:38.019+0000 7f77a5d64ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:23:38.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T16:23:38.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:23:38.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T16:23:38.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:23:38.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:23:38.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:23:38.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:23:38.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:23:38.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:23:38.375 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:23:38.533 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:38.538+0000 7f77a5d64ec0 -1 Falling back to public interface 2020-09-08T16:23:38.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:23:39.360 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:39.364+0000 7f77a5d64ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T16:23:39.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:23:39.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:23:39.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:23:39.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:23:39.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:23:39.783 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:23:40.202 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/400377,v1:127.0.0.1:6811/400377] [v2:127.0.0.1:6812/400377,v1:127.0.0.1:6813/400377] exists,up aa2bca1f-0db6-4037-9802-54bdac3eba1e 2020-09-08T16:23:40.202 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 3e0d5c30-c9cd-4fc6-b3f0-2387fa9fdc0f 2020-09-08T16:23:40.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:23:40.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:23:40.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:23:40.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:117: TEST_backfill_test_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:23:40.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:119: TEST_backfill_test_simple: run_osd td/osd-backfill-space 2 2020-09-08T16:23:40.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:23:40.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:23:40.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T16:23:40.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:23:40.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/2 2020-09-08T16:23:40.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:23:40.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:23:40.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:23:40.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:23:40.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2020-09-08T16:23:40.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2020-09-08T16:23:40.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:23:40.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:23:40.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:23:40.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:23:40.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:23:40.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:23:40.207 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:23:40.207 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:23:40.208 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:23:40.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:23:40.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:23:40.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:23:40.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:23:40.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:23:40.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:23:40.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:23:40.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:23:40.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:23:40.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:23:40.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:23:40.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:23:40.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/2 2020-09-08T16:23:40.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:23:40.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=3e0d5c30-c9cd-4fc6-b3f0-2387fa9fdc0f 2020-09-08T16:23:40.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 3e0d5c30-c9cd-4fc6-b3f0-2387fa9fdc0f' 2020-09-08T16:23:40.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:23:40.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAMsFdf5R1dDRAAz7kmCz44LPSyNZ5GXIyVCQ== 2020-09-08T16:23:40.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAMsFdf5R1dDRAAz7kmCz44LPSyNZ5GXIyVCQ=="}' 2020-09-08T16:23:40.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 3e0d5c30-c9cd-4fc6-b3f0-2387fa9fdc0f -i td/osd-backfill-space/2/new.json 2020-09-08T16:23:40.725 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:23:40.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/2/new.json 2020-09-08T16:23:40.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAMsFdf5R1dDRAAz7kmCz44LPSyNZ5GXIyVCQ== --osd-uuid 3e0d5c30-c9cd-4fc6-b3f0-2387fa9fdc0f 2020-09-08T16:23:40.764 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:40.768+0000 7fa78f64aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:23:40.765 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:40.769+0000 7fa78f64aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:23:40.767 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:40.771+0000 7fa78f64aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:23:40.767 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:40.772+0000 7fa78f64aec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T16:23:40.768 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:40.772+0000 7fa78f64aec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T16:23:40.768 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:40.772+0000 7fa78f64aec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T16:23:40.825 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:40.830+0000 7fa78f64aec0 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2020-09-08T16:23:45.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2020-09-08T16:23:45.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:23:45.053 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T16:23:45.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T16:23:45.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:23:45.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T16:23:45.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:23:45.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:23:45.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:23:45.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:23:45.588 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T16:23:45.612 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:45.617+0000 7f953c25bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:23:45.631 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:45.636+0000 7f953c25bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:23:45.633 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:45.638+0000 7f953c25bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:23:45.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T16:23:45.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:23:45.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T16:23:45.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:23:45.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:23:45.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:23:45.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:23:45.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:23:45.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:23:45.986 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:23:46.152 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:46.157+0000 7f953c25bec0 -1 Falling back to public interface 2020-09-08T16:23:46.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:23:46.945 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:23:46.945+0000 7f953c25bec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T16:23:47.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:23:47.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:23:47.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:23:47.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:23:47.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:23:47.399 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:23:47.816 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/401371,v1:127.0.0.1:6819/401371] [v2:127.0.0.1:6820/401371,v1:127.0.0.1:6821/401371] exists,up 3e0d5c30-c9cd-4fc6-b3f0-2387fa9fdc0f 2020-09-08T16:23:47.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:23:47.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:23:47.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:23:47.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:122: TEST_backfill_test_simple: ceph osd set-backfillfull-ratio .85 2020-09-08T16:23:48.525 INFO:tasks.workunit.client.0.smithi065.stderr:osd set-backfillfull-ratio 0.85 2020-09-08T16:23:48.534 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:124: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:23:48.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:124: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:48.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:126: TEST_backfill_test_simple: create_pool test1 1 1 2020-09-08T16:23:48.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test1 1 1 2020-09-08T16:23:49.110 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test1' already exists 2020-09-08T16:23:49.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:23:50.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:127: TEST_backfill_test_simple: ceph osd pool set test1 size 1 --yes-i-really-mean-it 2020-09-08T16:23:50.909 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 1 2020-09-08T16:23:50.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:124: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:50.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:126: TEST_backfill_test_simple: create_pool test2 1 1 2020-09-08T16:23:50.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test2 1 1 2020-09-08T16:23:51.555 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test2' already exists 2020-09-08T16:23:51.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:23:52.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:127: TEST_backfill_test_simple: ceph osd pool set test2 size 1 --yes-i-really-mean-it 2020-09-08T16:23:53.326 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 2 size to 1 2020-09-08T16:23:53.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:130: TEST_backfill_test_simple: wait_for_clean 2020-09-08T16:23:53.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:23:53.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:23:53.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:23:53.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:23:53.337 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:23:53.337 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:23:53.338 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:23:53.338 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:23:53.338 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:23:53.338 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:23:53.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:23:53.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:23:53.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:23:53.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:23:53.435 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:23:53.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:23:53.839 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:23:53.839 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T16:23:53.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:23:53.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:23:53.840 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:23:53.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836487 2020-09-08T16:23:53.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836487 2020-09-08T16:23:53.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836487' 2020-09-08T16:23:53.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:23:53.973 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:23:54.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672965 2020-09-08T16:23:54.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672965 2020-09-08T16:23:54.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836487 1-42949672965' 2020-09-08T16:23:54.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:23:54.106 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:23:54.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509444 2020-09-08T16:23:54.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509444 2020-09-08T16:23:54.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836487 1-42949672965 2-64424509444' 2020-09-08T16:23:54.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:23:54.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836487 2020-09-08T16:23:54.241 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:23:54.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:23:54.241 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836487 2020-09-08T16:23:54.241 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:23:54.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836487 2020-09-08T16:23:54.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2020-09-08T16:23:54.243 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:23:54.243 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836487 2020-09-08T16:23:54.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836484 -lt 21474836487 2020-09-08T16:23:54.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:23:55.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:23:55.651 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:23:56.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836487 -lt 21474836487 2020-09-08T16:23:56.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:23:56.049 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672965 2020-09-08T16:23:56.050 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:23:56.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:23:56.051 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672965 2020-09-08T16:23:56.051 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:23:56.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672965 2020-09-08T16:23:56.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672965' 2020-09-08T16:23:56.052 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:23:56.052 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672965 2020-09-08T16:23:56.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672965 -lt 42949672965 2020-09-08T16:23:56.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:23:56.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509444 2020-09-08T16:23:56.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:23:56.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:23:56.456 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509444 2020-09-08T16:23:56.456 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:23:56.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509444 2020-09-08T16:23:56.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509444' 2020-09-08T16:23:56.457 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:23:56.458 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509444 2020-09-08T16:23:56.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509444 -lt 64424509444 2020-09-08T16:23:56.867 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:23:56.868 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:23:56.868 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:23:57.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 2 == 0 2020-09-08T16:23:57.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:23:57.439 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:23:57.439 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:23:57.440 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:23:57.440 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:23:57.440 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:23:57.440 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:23:57.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=2 2020-09-08T16:23:57.833 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:23:57.834 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:23:57.834 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:23:58.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 2 = 2 2020-09-08T16:23:58.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:23:58.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:23:58.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:135: TEST_backfill_test_simple: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=4 2020-09-08T16:23:58.357 INFO:tasks.workunit.client.0.smithi065.stderr:4+0 records in 2020-09-08T16:23:58.357 INFO:tasks.workunit.client.0.smithi065.stderr:4+0 records out 2020-09-08T16:23:58.357 INFO:tasks.workunit.client.0.smithi065.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 7.0285e-05 s, 58.3 MB/s 2020-09-08T16:23:58.357 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: seq 1 600 2020-09-08T16:23:58.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:23:58.358 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:23:58.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:58.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj1 td/osd-backfill-space/datafile 2020-09-08T16:23:58.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:58.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj1 td/osd-backfill-space/datafile 2020-09-08T16:23:58.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:23:58.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:23:58.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:58.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj2 td/osd-backfill-space/datafile 2020-09-08T16:23:58.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:58.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj2 td/osd-backfill-space/datafile 2020-09-08T16:23:58.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:23:58.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:23:58.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:58.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj3 td/osd-backfill-space/datafile 2020-09-08T16:23:58.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:58.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj3 td/osd-backfill-space/datafile 2020-09-08T16:23:58.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:23:58.850 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:23:58.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:58.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj4 td/osd-backfill-space/datafile 2020-09-08T16:23:58.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:58.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj4 td/osd-backfill-space/datafile 2020-09-08T16:23:59.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:23:59.009 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:23:59.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:59.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj5 td/osd-backfill-space/datafile 2020-09-08T16:23:59.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:59.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj5 td/osd-backfill-space/datafile 2020-09-08T16:23:59.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:23:59.183 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:23:59.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:59.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj6 td/osd-backfill-space/datafile 2020-09-08T16:23:59.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:59.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj6 td/osd-backfill-space/datafile 2020-09-08T16:23:59.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:23:59.360 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:23:59.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:59.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj7 td/osd-backfill-space/datafile 2020-09-08T16:23:59.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:59.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj7 td/osd-backfill-space/datafile 2020-09-08T16:23:59.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:23:59.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:23:59.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:59.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj8 td/osd-backfill-space/datafile 2020-09-08T16:23:59.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:59.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj8 td/osd-backfill-space/datafile 2020-09-08T16:23:59.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:23:59.697 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:23:59.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:59.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj9 td/osd-backfill-space/datafile 2020-09-08T16:23:59.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:59.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj9 td/osd-backfill-space/datafile 2020-09-08T16:23:59.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:23:59.846 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:23:59.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:59.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj10 td/osd-backfill-space/datafile 2020-09-08T16:23:59.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:59.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj10 td/osd-backfill-space/datafile 2020-09-08T16:23:59.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:23:59.996 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:23:59.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:23:59.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj11 td/osd-backfill-space/datafile 2020-09-08T16:24:00.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:00.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj11 td/osd-backfill-space/datafile 2020-09-08T16:24:00.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:00.147 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:00.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:00.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj12 td/osd-backfill-space/datafile 2020-09-08T16:24:00.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:00.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj12 td/osd-backfill-space/datafile 2020-09-08T16:24:00.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:00.306 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:00.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:00.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj13 td/osd-backfill-space/datafile 2020-09-08T16:24:00.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:00.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj13 td/osd-backfill-space/datafile 2020-09-08T16:24:00.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:00.465 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:00.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:00.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj14 td/osd-backfill-space/datafile 2020-09-08T16:24:00.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:00.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj14 td/osd-backfill-space/datafile 2020-09-08T16:24:00.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:00.615 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:00.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:00.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj15 td/osd-backfill-space/datafile 2020-09-08T16:24:00.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:00.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj15 td/osd-backfill-space/datafile 2020-09-08T16:24:00.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:00.850 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:00.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:00.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj16 td/osd-backfill-space/datafile 2020-09-08T16:24:00.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:00.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj16 td/osd-backfill-space/datafile 2020-09-08T16:24:01.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:01.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:01.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:01.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj17 td/osd-backfill-space/datafile 2020-09-08T16:24:01.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:01.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj17 td/osd-backfill-space/datafile 2020-09-08T16:24:01.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:01.202 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:01.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:01.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj18 td/osd-backfill-space/datafile 2020-09-08T16:24:01.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:01.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj18 td/osd-backfill-space/datafile 2020-09-08T16:24:01.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:01.380 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:01.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:01.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj19 td/osd-backfill-space/datafile 2020-09-08T16:24:01.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:01.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj19 td/osd-backfill-space/datafile 2020-09-08T16:24:01.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:01.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:01.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:01.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj20 td/osd-backfill-space/datafile 2020-09-08T16:24:01.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:01.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj20 td/osd-backfill-space/datafile 2020-09-08T16:24:01.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:01.679 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:01.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:01.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj21 td/osd-backfill-space/datafile 2020-09-08T16:24:01.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:01.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj21 td/osd-backfill-space/datafile 2020-09-08T16:24:01.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:01.829 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:01.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:01.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj22 td/osd-backfill-space/datafile 2020-09-08T16:24:01.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:01.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj22 td/osd-backfill-space/datafile 2020-09-08T16:24:01.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:01.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:01.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:01.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj23 td/osd-backfill-space/datafile 2020-09-08T16:24:02.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:02.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj23 td/osd-backfill-space/datafile 2020-09-08T16:24:02.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:02.147 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:02.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:02.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj24 td/osd-backfill-space/datafile 2020-09-08T16:24:02.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:02.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj24 td/osd-backfill-space/datafile 2020-09-08T16:24:02.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:02.305 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:02.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:02.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj25 td/osd-backfill-space/datafile 2020-09-08T16:24:02.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:02.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj25 td/osd-backfill-space/datafile 2020-09-08T16:24:02.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:02.472 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:02.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:02.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj26 td/osd-backfill-space/datafile 2020-09-08T16:24:02.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:02.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj26 td/osd-backfill-space/datafile 2020-09-08T16:24:02.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:02.623 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:02.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:02.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj27 td/osd-backfill-space/datafile 2020-09-08T16:24:02.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:02.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj27 td/osd-backfill-space/datafile 2020-09-08T16:24:02.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:02.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:02.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:02.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj28 td/osd-backfill-space/datafile 2020-09-08T16:24:02.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:02.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj28 td/osd-backfill-space/datafile 2020-09-08T16:24:02.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:02.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:02.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:02.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj29 td/osd-backfill-space/datafile 2020-09-08T16:24:03.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:03.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj29 td/osd-backfill-space/datafile 2020-09-08T16:24:03.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:03.109 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:03.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:03.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj30 td/osd-backfill-space/datafile 2020-09-08T16:24:03.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:03.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj30 td/osd-backfill-space/datafile 2020-09-08T16:24:03.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:03.293 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:03.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:03.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj31 td/osd-backfill-space/datafile 2020-09-08T16:24:03.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:03.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj31 td/osd-backfill-space/datafile 2020-09-08T16:24:03.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:03.443 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:03.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:03.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj32 td/osd-backfill-space/datafile 2020-09-08T16:24:03.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:03.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj32 td/osd-backfill-space/datafile 2020-09-08T16:24:03.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:03.593 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:03.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:03.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj33 td/osd-backfill-space/datafile 2020-09-08T16:24:03.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:03.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj33 td/osd-backfill-space/datafile 2020-09-08T16:24:03.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:03.752 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:03.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:03.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj34 td/osd-backfill-space/datafile 2020-09-08T16:24:03.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:03.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj34 td/osd-backfill-space/datafile 2020-09-08T16:24:03.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:03.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:03.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:03.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj35 td/osd-backfill-space/datafile 2020-09-08T16:24:03.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:03.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj35 td/osd-backfill-space/datafile 2020-09-08T16:24:04.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:04.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:04.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:04.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj36 td/osd-backfill-space/datafile 2020-09-08T16:24:04.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:04.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj36 td/osd-backfill-space/datafile 2020-09-08T16:24:04.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:04.220 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:04.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:04.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj37 td/osd-backfill-space/datafile 2020-09-08T16:24:04.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:04.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj37 td/osd-backfill-space/datafile 2020-09-08T16:24:04.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:04.370 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:04.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:04.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj38 td/osd-backfill-space/datafile 2020-09-08T16:24:04.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:04.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj38 td/osd-backfill-space/datafile 2020-09-08T16:24:04.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:04.521 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:04.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:04.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj39 td/osd-backfill-space/datafile 2020-09-08T16:24:04.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:04.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj39 td/osd-backfill-space/datafile 2020-09-08T16:24:04.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:04.714 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:04.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:04.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj40 td/osd-backfill-space/datafile 2020-09-08T16:24:04.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:04.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj40 td/osd-backfill-space/datafile 2020-09-08T16:24:04.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:04.865 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:04.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:04.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj41 td/osd-backfill-space/datafile 2020-09-08T16:24:04.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:04.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj41 td/osd-backfill-space/datafile 2020-09-08T16:24:05.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:05.056 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:05.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:05.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj42 td/osd-backfill-space/datafile 2020-09-08T16:24:05.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:05.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj42 td/osd-backfill-space/datafile 2020-09-08T16:24:05.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:05.241 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:05.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:05.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj43 td/osd-backfill-space/datafile 2020-09-08T16:24:05.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:05.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj43 td/osd-backfill-space/datafile 2020-09-08T16:24:05.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:05.391 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:05.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:05.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj44 td/osd-backfill-space/datafile 2020-09-08T16:24:05.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:05.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj44 td/osd-backfill-space/datafile 2020-09-08T16:24:05.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:05.543 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:05.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:05.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj45 td/osd-backfill-space/datafile 2020-09-08T16:24:05.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:05.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj45 td/osd-backfill-space/datafile 2020-09-08T16:24:05.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:05.700 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:05.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:05.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj46 td/osd-backfill-space/datafile 2020-09-08T16:24:05.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:05.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj46 td/osd-backfill-space/datafile 2020-09-08T16:24:05.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:05.867 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:05.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:05.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj47 td/osd-backfill-space/datafile 2020-09-08T16:24:05.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:05.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj47 td/osd-backfill-space/datafile 2020-09-08T16:24:06.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:06.010 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:06.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:06.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj48 td/osd-backfill-space/datafile 2020-09-08T16:24:06.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:06.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj48 td/osd-backfill-space/datafile 2020-09-08T16:24:06.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:06.160 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:06.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:06.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj49 td/osd-backfill-space/datafile 2020-09-08T16:24:06.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:06.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj49 td/osd-backfill-space/datafile 2020-09-08T16:24:06.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:06.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:06.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:06.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj50 td/osd-backfill-space/datafile 2020-09-08T16:24:06.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:06.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj50 td/osd-backfill-space/datafile 2020-09-08T16:24:06.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:06.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:06.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:06.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj51 td/osd-backfill-space/datafile 2020-09-08T16:24:06.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:06.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj51 td/osd-backfill-space/datafile 2020-09-08T16:24:06.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:06.619 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:06.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:06.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj52 td/osd-backfill-space/datafile 2020-09-08T16:24:06.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:06.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj52 td/osd-backfill-space/datafile 2020-09-08T16:24:06.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:06.770 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:06.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:06.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj53 td/osd-backfill-space/datafile 2020-09-08T16:24:06.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:06.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj53 td/osd-backfill-space/datafile 2020-09-08T16:24:06.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:06.920 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:06.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:06.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj54 td/osd-backfill-space/datafile 2020-09-08T16:24:07.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:07.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj54 td/osd-backfill-space/datafile 2020-09-08T16:24:07.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:07.105 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:07.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:07.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj55 td/osd-backfill-space/datafile 2020-09-08T16:24:07.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:07.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj55 td/osd-backfill-space/datafile 2020-09-08T16:24:07.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:07.314 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:07.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:07.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj56 td/osd-backfill-space/datafile 2020-09-08T16:24:07.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:07.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj56 td/osd-backfill-space/datafile 2020-09-08T16:24:07.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:07.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:07.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:07.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj57 td/osd-backfill-space/datafile 2020-09-08T16:24:07.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:07.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj57 td/osd-backfill-space/datafile 2020-09-08T16:24:07.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:07.615 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:07.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:07.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj58 td/osd-backfill-space/datafile 2020-09-08T16:24:07.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:07.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj58 td/osd-backfill-space/datafile 2020-09-08T16:24:07.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:07.765 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:07.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:07.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj59 td/osd-backfill-space/datafile 2020-09-08T16:24:07.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:07.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj59 td/osd-backfill-space/datafile 2020-09-08T16:24:07.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:07.916 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:07.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:07.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj60 td/osd-backfill-space/datafile 2020-09-08T16:24:07.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:07.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj60 td/osd-backfill-space/datafile 2020-09-08T16:24:08.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:08.075 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:08.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:08.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj61 td/osd-backfill-space/datafile 2020-09-08T16:24:08.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:08.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj61 td/osd-backfill-space/datafile 2020-09-08T16:24:08.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:08.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:08.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:08.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj62 td/osd-backfill-space/datafile 2020-09-08T16:24:08.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:08.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj62 td/osd-backfill-space/datafile 2020-09-08T16:24:08.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:08.403 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:08.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:08.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj63 td/osd-backfill-space/datafile 2020-09-08T16:24:08.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:08.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj63 td/osd-backfill-space/datafile 2020-09-08T16:24:08.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:08.560 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:08.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:08.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj64 td/osd-backfill-space/datafile 2020-09-08T16:24:08.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:08.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj64 td/osd-backfill-space/datafile 2020-09-08T16:24:08.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:08.710 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:08.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:08.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj65 td/osd-backfill-space/datafile 2020-09-08T16:24:08.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:08.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj65 td/osd-backfill-space/datafile 2020-09-08T16:24:08.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:08.861 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:08.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:08.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj66 td/osd-backfill-space/datafile 2020-09-08T16:24:08.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:08.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj66 td/osd-backfill-space/datafile 2020-09-08T16:24:09.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:09.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:09.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:09.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj67 td/osd-backfill-space/datafile 2020-09-08T16:24:09.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:09.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj67 td/osd-backfill-space/datafile 2020-09-08T16:24:09.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:09.246 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:09.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:09.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj68 td/osd-backfill-space/datafile 2020-09-08T16:24:09.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:09.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj68 td/osd-backfill-space/datafile 2020-09-08T16:24:09.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:09.396 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:09.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:09.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj69 td/osd-backfill-space/datafile 2020-09-08T16:24:09.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:09.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj69 td/osd-backfill-space/datafile 2020-09-08T16:24:09.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:09.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:09.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:09.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj70 td/osd-backfill-space/datafile 2020-09-08T16:24:09.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:09.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj70 td/osd-backfill-space/datafile 2020-09-08T16:24:09.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:09.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:09.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:09.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj71 td/osd-backfill-space/datafile 2020-09-08T16:24:09.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:09.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj71 td/osd-backfill-space/datafile 2020-09-08T16:24:09.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:09.915 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:09.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:09.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj72 td/osd-backfill-space/datafile 2020-09-08T16:24:09.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:09.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj72 td/osd-backfill-space/datafile 2020-09-08T16:24:10.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:10.066 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:10.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:10.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj73 td/osd-backfill-space/datafile 2020-09-08T16:24:10.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:10.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj73 td/osd-backfill-space/datafile 2020-09-08T16:24:10.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:10.216 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:10.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:10.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj74 td/osd-backfill-space/datafile 2020-09-08T16:24:10.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:10.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj74 td/osd-backfill-space/datafile 2020-09-08T16:24:10.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:10.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:10.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:10.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj75 td/osd-backfill-space/datafile 2020-09-08T16:24:10.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:10.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj75 td/osd-backfill-space/datafile 2020-09-08T16:24:10.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:10.526 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:10.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:10.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj76 td/osd-backfill-space/datafile 2020-09-08T16:24:10.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:10.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj76 td/osd-backfill-space/datafile 2020-09-08T16:24:10.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:10.693 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:10.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:10.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj77 td/osd-backfill-space/datafile 2020-09-08T16:24:10.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:10.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj77 td/osd-backfill-space/datafile 2020-09-08T16:24:10.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:10.844 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:10.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:10.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj78 td/osd-backfill-space/datafile 2020-09-08T16:24:10.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:10.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj78 td/osd-backfill-space/datafile 2020-09-08T16:24:11.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:11.032 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:11.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:11.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj79 td/osd-backfill-space/datafile 2020-09-08T16:24:11.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:11.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj79 td/osd-backfill-space/datafile 2020-09-08T16:24:11.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:11.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:11.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:11.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj80 td/osd-backfill-space/datafile 2020-09-08T16:24:11.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:11.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj80 td/osd-backfill-space/datafile 2020-09-08T16:24:11.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:11.380 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:11.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:11.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj81 td/osd-backfill-space/datafile 2020-09-08T16:24:11.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:11.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj81 td/osd-backfill-space/datafile 2020-09-08T16:24:11.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:11.530 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:11.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:11.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj82 td/osd-backfill-space/datafile 2020-09-08T16:24:11.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:11.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj82 td/osd-backfill-space/datafile 2020-09-08T16:24:11.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:11.689 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:11.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:11.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj83 td/osd-backfill-space/datafile 2020-09-08T16:24:11.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:11.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj83 td/osd-backfill-space/datafile 2020-09-08T16:24:11.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:11.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:11.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:11.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj84 td/osd-backfill-space/datafile 2020-09-08T16:24:11.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:11.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj84 td/osd-backfill-space/datafile 2020-09-08T16:24:11.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:11.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:11.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:11.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj85 td/osd-backfill-space/datafile 2020-09-08T16:24:12.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:12.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj85 td/osd-backfill-space/datafile 2020-09-08T16:24:12.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:12.141 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:12.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:12.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj86 td/osd-backfill-space/datafile 2020-09-08T16:24:12.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:12.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj86 td/osd-backfill-space/datafile 2020-09-08T16:24:12.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:12.292 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:12.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:12.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj87 td/osd-backfill-space/datafile 2020-09-08T16:24:12.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:12.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj87 td/osd-backfill-space/datafile 2020-09-08T16:24:12.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:12.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:12.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:12.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj88 td/osd-backfill-space/datafile 2020-09-08T16:24:12.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:12.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj88 td/osd-backfill-space/datafile 2020-09-08T16:24:12.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:12.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:12.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:12.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj89 td/osd-backfill-space/datafile 2020-09-08T16:24:12.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:12.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj89 td/osd-backfill-space/datafile 2020-09-08T16:24:12.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:12.760 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:12.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:12.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj90 td/osd-backfill-space/datafile 2020-09-08T16:24:12.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:12.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj90 td/osd-backfill-space/datafile 2020-09-08T16:24:12.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:12.919 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:12.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:12.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj91 td/osd-backfill-space/datafile 2020-09-08T16:24:13.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:13.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj91 td/osd-backfill-space/datafile 2020-09-08T16:24:13.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:13.098 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:13.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:13.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj92 td/osd-backfill-space/datafile 2020-09-08T16:24:13.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:13.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj92 td/osd-backfill-space/datafile 2020-09-08T16:24:13.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:13.283 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:13.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:13.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj93 td/osd-backfill-space/datafile 2020-09-08T16:24:13.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:13.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj93 td/osd-backfill-space/datafile 2020-09-08T16:24:13.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:13.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:13.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:13.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj94 td/osd-backfill-space/datafile 2020-09-08T16:24:13.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:13.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj94 td/osd-backfill-space/datafile 2020-09-08T16:24:13.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:13.594 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:13.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:13.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj95 td/osd-backfill-space/datafile 2020-09-08T16:24:13.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:13.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj95 td/osd-backfill-space/datafile 2020-09-08T16:24:13.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:13.751 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:13.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:13.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj96 td/osd-backfill-space/datafile 2020-09-08T16:24:13.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:13.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj96 td/osd-backfill-space/datafile 2020-09-08T16:24:13.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:13.926 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:13.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:13.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj97 td/osd-backfill-space/datafile 2020-09-08T16:24:13.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:13.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj97 td/osd-backfill-space/datafile 2020-09-08T16:24:14.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:14.077 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:14.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:14.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj98 td/osd-backfill-space/datafile 2020-09-08T16:24:14.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:14.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj98 td/osd-backfill-space/datafile 2020-09-08T16:24:14.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:14.228 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:14.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:14.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj99 td/osd-backfill-space/datafile 2020-09-08T16:24:14.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:14.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj99 td/osd-backfill-space/datafile 2020-09-08T16:24:14.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:14.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:14.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:14.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj100 td/osd-backfill-space/datafile 2020-09-08T16:24:14.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:14.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj100 td/osd-backfill-space/datafile 2020-09-08T16:24:14.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:14.546 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:14.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:14.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj101 td/osd-backfill-space/datafile 2020-09-08T16:24:14.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:14.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj101 td/osd-backfill-space/datafile 2020-09-08T16:24:14.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:14.729 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:14.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:14.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj102 td/osd-backfill-space/datafile 2020-09-08T16:24:14.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:14.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj102 td/osd-backfill-space/datafile 2020-09-08T16:24:14.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:14.888 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:14.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:14.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj103 td/osd-backfill-space/datafile 2020-09-08T16:24:14.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:14.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj103 td/osd-backfill-space/datafile 2020-09-08T16:24:15.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:15.081 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:15.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:15.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj104 td/osd-backfill-space/datafile 2020-09-08T16:24:15.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:15.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj104 td/osd-backfill-space/datafile 2020-09-08T16:24:15.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:15.241 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:15.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:15.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj105 td/osd-backfill-space/datafile 2020-09-08T16:24:15.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:15.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj105 td/osd-backfill-space/datafile 2020-09-08T16:24:15.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:15.416 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:15.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:15.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj106 td/osd-backfill-space/datafile 2020-09-08T16:24:15.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:15.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj106 td/osd-backfill-space/datafile 2020-09-08T16:24:15.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:15.583 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:15.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:15.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj107 td/osd-backfill-space/datafile 2020-09-08T16:24:15.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:15.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj107 td/osd-backfill-space/datafile 2020-09-08T16:24:15.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:15.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:15.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:15.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj108 td/osd-backfill-space/datafile 2020-09-08T16:24:15.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:15.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj108 td/osd-backfill-space/datafile 2020-09-08T16:24:15.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:15.904 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:15.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:15.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj109 td/osd-backfill-space/datafile 2020-09-08T16:24:15.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:15.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj109 td/osd-backfill-space/datafile 2020-09-08T16:24:16.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:16.060 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:16.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:16.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj110 td/osd-backfill-space/datafile 2020-09-08T16:24:16.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:16.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj110 td/osd-backfill-space/datafile 2020-09-08T16:24:16.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:16.227 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:16.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:16.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj111 td/osd-backfill-space/datafile 2020-09-08T16:24:16.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:16.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj111 td/osd-backfill-space/datafile 2020-09-08T16:24:16.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:16.403 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:16.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:16.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj112 td/osd-backfill-space/datafile 2020-09-08T16:24:16.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:16.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj112 td/osd-backfill-space/datafile 2020-09-08T16:24:16.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:16.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:16.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:16.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj113 td/osd-backfill-space/datafile 2020-09-08T16:24:16.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:16.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj113 td/osd-backfill-space/datafile 2020-09-08T16:24:16.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:16.712 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:16.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:16.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj114 td/osd-backfill-space/datafile 2020-09-08T16:24:16.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:16.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj114 td/osd-backfill-space/datafile 2020-09-08T16:24:16.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:16.873 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:16.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:16.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj115 td/osd-backfill-space/datafile 2020-09-08T16:24:16.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:16.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj115 td/osd-backfill-space/datafile 2020-09-08T16:24:17.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:17.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:17.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:17.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj116 td/osd-backfill-space/datafile 2020-09-08T16:24:17.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:17.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj116 td/osd-backfill-space/datafile 2020-09-08T16:24:17.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:17.266 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:17.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:17.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj117 td/osd-backfill-space/datafile 2020-09-08T16:24:17.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:17.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj117 td/osd-backfill-space/datafile 2020-09-08T16:24:17.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:17.399 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:17.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:17.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj118 td/osd-backfill-space/datafile 2020-09-08T16:24:17.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:17.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj118 td/osd-backfill-space/datafile 2020-09-08T16:24:17.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:17.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:17.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:17.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj119 td/osd-backfill-space/datafile 2020-09-08T16:24:17.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:17.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj119 td/osd-backfill-space/datafile 2020-09-08T16:24:17.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:17.700 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:17.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:17.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj120 td/osd-backfill-space/datafile 2020-09-08T16:24:17.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:17.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj120 td/osd-backfill-space/datafile 2020-09-08T16:24:17.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:17.850 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:17.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:17.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj121 td/osd-backfill-space/datafile 2020-09-08T16:24:17.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:17.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj121 td/osd-backfill-space/datafile 2020-09-08T16:24:18.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:18.001 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:18.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:18.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj122 td/osd-backfill-space/datafile 2020-09-08T16:24:18.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:18.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj122 td/osd-backfill-space/datafile 2020-09-08T16:24:18.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:18.154 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:18.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:18.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj123 td/osd-backfill-space/datafile 2020-09-08T16:24:18.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:18.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj123 td/osd-backfill-space/datafile 2020-09-08T16:24:18.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:18.310 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:18.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:18.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj124 td/osd-backfill-space/datafile 2020-09-08T16:24:18.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:18.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj124 td/osd-backfill-space/datafile 2020-09-08T16:24:18.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:18.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:18.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:18.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj125 td/osd-backfill-space/datafile 2020-09-08T16:24:18.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:18.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj125 td/osd-backfill-space/datafile 2020-09-08T16:24:18.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:18.620 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:18.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:18.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj126 td/osd-backfill-space/datafile 2020-09-08T16:24:18.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:18.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj126 td/osd-backfill-space/datafile 2020-09-08T16:24:18.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:18.779 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:18.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:18.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj127 td/osd-backfill-space/datafile 2020-09-08T16:24:18.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:18.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj127 td/osd-backfill-space/datafile 2020-09-08T16:24:18.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:18.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:18.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:18.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj128 td/osd-backfill-space/datafile 2020-09-08T16:24:19.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:19.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj128 td/osd-backfill-space/datafile 2020-09-08T16:24:19.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:19.097 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:19.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:19.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj129 td/osd-backfill-space/datafile 2020-09-08T16:24:19.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:19.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj129 td/osd-backfill-space/datafile 2020-09-08T16:24:19.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:19.281 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:19.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:19.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj130 td/osd-backfill-space/datafile 2020-09-08T16:24:19.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:19.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj130 td/osd-backfill-space/datafile 2020-09-08T16:24:19.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:19.432 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:19.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:19.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj131 td/osd-backfill-space/datafile 2020-09-08T16:24:19.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:19.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj131 td/osd-backfill-space/datafile 2020-09-08T16:24:19.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:19.583 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:19.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:19.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj132 td/osd-backfill-space/datafile 2020-09-08T16:24:19.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:19.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj132 td/osd-backfill-space/datafile 2020-09-08T16:24:19.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:19.766 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:19.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:19.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj133 td/osd-backfill-space/datafile 2020-09-08T16:24:19.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:19.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj133 td/osd-backfill-space/datafile 2020-09-08T16:24:19.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:19.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:19.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:19.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj134 td/osd-backfill-space/datafile 2020-09-08T16:24:19.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:20.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj134 td/osd-backfill-space/datafile 2020-09-08T16:24:20.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:20.075 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:20.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:20.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj135 td/osd-backfill-space/datafile 2020-09-08T16:24:20.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:20.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj135 td/osd-backfill-space/datafile 2020-09-08T16:24:20.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:20.235 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:20.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:20.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj136 td/osd-backfill-space/datafile 2020-09-08T16:24:20.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:20.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj136 td/osd-backfill-space/datafile 2020-09-08T16:24:20.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:20.379 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:20.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:20.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj137 td/osd-backfill-space/datafile 2020-09-08T16:24:20.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:20.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj137 td/osd-backfill-space/datafile 2020-09-08T16:24:20.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:20.531 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:20.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:20.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj138 td/osd-backfill-space/datafile 2020-09-08T16:24:20.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:20.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj138 td/osd-backfill-space/datafile 2020-09-08T16:24:20.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:20.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:20.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:20.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj139 td/osd-backfill-space/datafile 2020-09-08T16:24:20.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:20.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj139 td/osd-backfill-space/datafile 2020-09-08T16:24:20.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:20.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:20.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:20.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj140 td/osd-backfill-space/datafile 2020-09-08T16:24:20.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:20.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj140 td/osd-backfill-space/datafile 2020-09-08T16:24:21.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:21.014 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:21.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:21.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj141 td/osd-backfill-space/datafile 2020-09-08T16:24:21.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:21.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj141 td/osd-backfill-space/datafile 2020-09-08T16:24:21.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:21.180 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:21.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:21.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj142 td/osd-backfill-space/datafile 2020-09-08T16:24:21.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:21.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj142 td/osd-backfill-space/datafile 2020-09-08T16:24:21.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:21.360 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:21.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:21.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj143 td/osd-backfill-space/datafile 2020-09-08T16:24:21.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:21.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj143 td/osd-backfill-space/datafile 2020-09-08T16:24:21.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:21.506 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:21.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:21.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj144 td/osd-backfill-space/datafile 2020-09-08T16:24:21.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:21.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj144 td/osd-backfill-space/datafile 2020-09-08T16:24:21.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:21.657 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:21.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:21.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj145 td/osd-backfill-space/datafile 2020-09-08T16:24:21.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:21.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj145 td/osd-backfill-space/datafile 2020-09-08T16:24:21.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:21.807 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:21.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:21.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj146 td/osd-backfill-space/datafile 2020-09-08T16:24:21.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:21.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj146 td/osd-backfill-space/datafile 2020-09-08T16:24:21.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:21.958 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:21.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:21.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj147 td/osd-backfill-space/datafile 2020-09-08T16:24:22.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:22.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj147 td/osd-backfill-space/datafile 2020-09-08T16:24:22.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:22.109 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:22.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:22.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj148 td/osd-backfill-space/datafile 2020-09-08T16:24:22.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:22.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj148 td/osd-backfill-space/datafile 2020-09-08T16:24:22.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:22.259 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:22.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:22.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj149 td/osd-backfill-space/datafile 2020-09-08T16:24:22.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:22.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj149 td/osd-backfill-space/datafile 2020-09-08T16:24:22.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:22.418 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:22.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:22.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj150 td/osd-backfill-space/datafile 2020-09-08T16:24:22.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:22.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj150 td/osd-backfill-space/datafile 2020-09-08T16:24:22.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:22.569 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:22.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:22.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj151 td/osd-backfill-space/datafile 2020-09-08T16:24:22.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:22.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj151 td/osd-backfill-space/datafile 2020-09-08T16:24:22.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:22.719 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:22.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:22.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj152 td/osd-backfill-space/datafile 2020-09-08T16:24:22.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:22.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj152 td/osd-backfill-space/datafile 2020-09-08T16:24:22.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:22.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:22.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:22.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj153 td/osd-backfill-space/datafile 2020-09-08T16:24:22.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:22.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj153 td/osd-backfill-space/datafile 2020-09-08T16:24:23.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:23.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:23.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:23.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj154 td/osd-backfill-space/datafile 2020-09-08T16:24:23.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:23.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj154 td/osd-backfill-space/datafile 2020-09-08T16:24:23.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:23.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:23.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:23.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj155 td/osd-backfill-space/datafile 2020-09-08T16:24:23.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:23.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj155 td/osd-backfill-space/datafile 2020-09-08T16:24:23.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:23.405 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:23.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:23.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj156 td/osd-backfill-space/datafile 2020-09-08T16:24:23.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:23.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj156 td/osd-backfill-space/datafile 2020-09-08T16:24:23.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:23.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:23.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:23.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj157 td/osd-backfill-space/datafile 2020-09-08T16:24:23.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:23.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj157 td/osd-backfill-space/datafile 2020-09-08T16:24:23.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:23.706 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:23.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:23.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj158 td/osd-backfill-space/datafile 2020-09-08T16:24:23.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:23.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj158 td/osd-backfill-space/datafile 2020-09-08T16:24:23.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:23.857 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:23.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:23.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj159 td/osd-backfill-space/datafile 2020-09-08T16:24:23.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:23.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj159 td/osd-backfill-space/datafile 2020-09-08T16:24:24.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:24.008 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:24.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:24.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj160 td/osd-backfill-space/datafile 2020-09-08T16:24:24.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:24.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj160 td/osd-backfill-space/datafile 2020-09-08T16:24:24.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:24.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:24.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:24.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj161 td/osd-backfill-space/datafile 2020-09-08T16:24:24.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:24.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj161 td/osd-backfill-space/datafile 2020-09-08T16:24:24.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:24.309 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:24.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:24.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj162 td/osd-backfill-space/datafile 2020-09-08T16:24:24.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:24.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj162 td/osd-backfill-space/datafile 2020-09-08T16:24:24.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:24.473 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:24.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:24.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj163 td/osd-backfill-space/datafile 2020-09-08T16:24:24.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:24.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj163 td/osd-backfill-space/datafile 2020-09-08T16:24:24.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:24.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:24.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:24.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj164 td/osd-backfill-space/datafile 2020-09-08T16:24:24.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:24.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj164 td/osd-backfill-space/datafile 2020-09-08T16:24:24.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:24.811 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:24.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:24.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj165 td/osd-backfill-space/datafile 2020-09-08T16:24:24.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:24.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj165 td/osd-backfill-space/datafile 2020-09-08T16:24:24.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:24.961 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:24.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:24.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj166 td/osd-backfill-space/datafile 2020-09-08T16:24:25.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:25.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj166 td/osd-backfill-space/datafile 2020-09-08T16:24:25.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:25.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:25.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:25.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj167 td/osd-backfill-space/datafile 2020-09-08T16:24:25.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:25.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj167 td/osd-backfill-space/datafile 2020-09-08T16:24:25.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:25.349 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:25.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:25.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj168 td/osd-backfill-space/datafile 2020-09-08T16:24:25.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:25.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj168 td/osd-backfill-space/datafile 2020-09-08T16:24:25.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:25.497 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:25.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:25.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj169 td/osd-backfill-space/datafile 2020-09-08T16:24:25.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:25.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj169 td/osd-backfill-space/datafile 2020-09-08T16:24:25.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:25.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:25.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:25.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj170 td/osd-backfill-space/datafile 2020-09-08T16:24:25.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:25.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj170 td/osd-backfill-space/datafile 2020-09-08T16:24:25.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:25.815 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:25.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:25.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj171 td/osd-backfill-space/datafile 2020-09-08T16:24:25.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:25.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj171 td/osd-backfill-space/datafile 2020-09-08T16:24:25.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:25.965 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:25.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:25.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj172 td/osd-backfill-space/datafile 2020-09-08T16:24:26.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:26.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj172 td/osd-backfill-space/datafile 2020-09-08T16:24:26.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:26.133 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:26.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:26.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj173 td/osd-backfill-space/datafile 2020-09-08T16:24:26.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:26.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj173 td/osd-backfill-space/datafile 2020-09-08T16:24:26.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:26.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:26.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:26.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj174 td/osd-backfill-space/datafile 2020-09-08T16:24:26.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:26.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj174 td/osd-backfill-space/datafile 2020-09-08T16:24:26.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:26.817 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:26.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:26.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj175 td/osd-backfill-space/datafile 2020-09-08T16:24:26.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:26.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj175 td/osd-backfill-space/datafile 2020-09-08T16:24:26.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:26.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:26.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:26.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj176 td/osd-backfill-space/datafile 2020-09-08T16:24:27.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:27.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj176 td/osd-backfill-space/datafile 2020-09-08T16:24:27.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:27.177 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:27.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:27.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj177 td/osd-backfill-space/datafile 2020-09-08T16:24:27.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:27.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj177 td/osd-backfill-space/datafile 2020-09-08T16:24:27.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:27.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:27.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:27.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj178 td/osd-backfill-space/datafile 2020-09-08T16:24:27.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:27.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj178 td/osd-backfill-space/datafile 2020-09-08T16:24:27.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:27.512 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:27.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:27.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj179 td/osd-backfill-space/datafile 2020-09-08T16:24:27.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:27.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj179 td/osd-backfill-space/datafile 2020-09-08T16:24:27.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:27.670 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:27.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:27.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj180 td/osd-backfill-space/datafile 2020-09-08T16:24:27.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:27.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj180 td/osd-backfill-space/datafile 2020-09-08T16:24:27.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:27.821 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:27.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:27.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj181 td/osd-backfill-space/datafile 2020-09-08T16:24:27.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:27.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj181 td/osd-backfill-space/datafile 2020-09-08T16:24:27.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:27.972 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:27.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:27.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj182 td/osd-backfill-space/datafile 2020-09-08T16:24:28.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:28.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj182 td/osd-backfill-space/datafile 2020-09-08T16:24:28.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:28.139 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:28.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:28.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj183 td/osd-backfill-space/datafile 2020-09-08T16:24:28.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:28.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj183 td/osd-backfill-space/datafile 2020-09-08T16:24:28.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:28.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:28.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:28.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj184 td/osd-backfill-space/datafile 2020-09-08T16:24:28.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:28.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj184 td/osd-backfill-space/datafile 2020-09-08T16:24:28.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:28.448 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:28.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:28.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj185 td/osd-backfill-space/datafile 2020-09-08T16:24:28.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:28.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj185 td/osd-backfill-space/datafile 2020-09-08T16:24:28.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:28.615 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:28.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:28.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj186 td/osd-backfill-space/datafile 2020-09-08T16:24:28.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:28.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj186 td/osd-backfill-space/datafile 2020-09-08T16:24:28.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:28.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:28.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:28.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj187 td/osd-backfill-space/datafile 2020-09-08T16:24:28.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:28.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj187 td/osd-backfill-space/datafile 2020-09-08T16:24:28.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:28.909 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:28.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:28.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj188 td/osd-backfill-space/datafile 2020-09-08T16:24:28.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:28.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj188 td/osd-backfill-space/datafile 2020-09-08T16:24:29.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:29.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:29.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:29.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj189 td/osd-backfill-space/datafile 2020-09-08T16:24:29.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:29.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj189 td/osd-backfill-space/datafile 2020-09-08T16:24:29.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:29.243 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:29.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:29.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj190 td/osd-backfill-space/datafile 2020-09-08T16:24:29.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:29.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj190 td/osd-backfill-space/datafile 2020-09-08T16:24:29.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:29.411 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:29.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:29.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj191 td/osd-backfill-space/datafile 2020-09-08T16:24:29.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:29.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj191 td/osd-backfill-space/datafile 2020-09-08T16:24:29.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:29.561 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:29.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:29.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj192 td/osd-backfill-space/datafile 2020-09-08T16:24:29.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:29.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj192 td/osd-backfill-space/datafile 2020-09-08T16:24:29.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:29.729 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:29.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:29.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj193 td/osd-backfill-space/datafile 2020-09-08T16:24:29.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:29.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj193 td/osd-backfill-space/datafile 2020-09-08T16:24:29.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:29.896 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:29.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:29.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj194 td/osd-backfill-space/datafile 2020-09-08T16:24:29.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:29.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj194 td/osd-backfill-space/datafile 2020-09-08T16:24:30.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:30.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:30.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:30.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj195 td/osd-backfill-space/datafile 2020-09-08T16:24:30.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:30.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj195 td/osd-backfill-space/datafile 2020-09-08T16:24:30.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:30.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:30.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:30.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj196 td/osd-backfill-space/datafile 2020-09-08T16:24:30.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:30.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj196 td/osd-backfill-space/datafile 2020-09-08T16:24:30.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:30.374 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:30.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:30.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj197 td/osd-backfill-space/datafile 2020-09-08T16:24:30.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:30.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj197 td/osd-backfill-space/datafile 2020-09-08T16:24:30.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:30.548 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:30.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:30.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj198 td/osd-backfill-space/datafile 2020-09-08T16:24:30.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:30.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj198 td/osd-backfill-space/datafile 2020-09-08T16:24:30.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:30.700 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:30.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:30.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj199 td/osd-backfill-space/datafile 2020-09-08T16:24:30.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:30.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj199 td/osd-backfill-space/datafile 2020-09-08T16:24:30.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:30.849 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:30.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:30.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj200 td/osd-backfill-space/datafile 2020-09-08T16:24:30.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:30.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj200 td/osd-backfill-space/datafile 2020-09-08T16:24:31.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:31.016 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:31.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:31.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj201 td/osd-backfill-space/datafile 2020-09-08T16:24:31.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:31.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj201 td/osd-backfill-space/datafile 2020-09-08T16:24:31.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:31.184 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:31.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:31.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj202 td/osd-backfill-space/datafile 2020-09-08T16:24:31.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:31.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj202 td/osd-backfill-space/datafile 2020-09-08T16:24:31.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:31.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:31.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:31.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj203 td/osd-backfill-space/datafile 2020-09-08T16:24:31.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:31.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj203 td/osd-backfill-space/datafile 2020-09-08T16:24:31.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:31.527 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:31.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:31.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj204 td/osd-backfill-space/datafile 2020-09-08T16:24:31.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:31.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj204 td/osd-backfill-space/datafile 2020-09-08T16:24:31.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:31.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:31.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:31.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj205 td/osd-backfill-space/datafile 2020-09-08T16:24:31.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:31.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj205 td/osd-backfill-space/datafile 2020-09-08T16:24:31.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:31.836 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:31.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:31.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj206 td/osd-backfill-space/datafile 2020-09-08T16:24:31.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:31.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj206 td/osd-backfill-space/datafile 2020-09-08T16:24:32.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:32.045 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:32.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:32.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj207 td/osd-backfill-space/datafile 2020-09-08T16:24:32.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:32.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj207 td/osd-backfill-space/datafile 2020-09-08T16:24:32.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:32.213 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:32.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:32.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj208 td/osd-backfill-space/datafile 2020-09-08T16:24:32.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:32.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj208 td/osd-backfill-space/datafile 2020-09-08T16:24:32.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:32.372 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:32.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:32.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj209 td/osd-backfill-space/datafile 2020-09-08T16:24:32.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:32.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj209 td/osd-backfill-space/datafile 2020-09-08T16:24:32.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:32.522 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:32.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:32.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj210 td/osd-backfill-space/datafile 2020-09-08T16:24:32.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:32.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj210 td/osd-backfill-space/datafile 2020-09-08T16:24:32.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:32.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:32.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:32.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj211 td/osd-backfill-space/datafile 2020-09-08T16:24:32.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:32.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj211 td/osd-backfill-space/datafile 2020-09-08T16:24:32.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:32.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:32.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:32.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj212 td/osd-backfill-space/datafile 2020-09-08T16:24:32.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:32.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj212 td/osd-backfill-space/datafile 2020-09-08T16:24:32.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:32.999 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:33.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:33.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj213 td/osd-backfill-space/datafile 2020-09-08T16:24:33.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:33.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj213 td/osd-backfill-space/datafile 2020-09-08T16:24:33.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:33.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:33.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:33.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj214 td/osd-backfill-space/datafile 2020-09-08T16:24:33.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:33.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj214 td/osd-backfill-space/datafile 2020-09-08T16:24:33.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:33.351 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:33.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:33.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj215 td/osd-backfill-space/datafile 2020-09-08T16:24:33.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:33.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj215 td/osd-backfill-space/datafile 2020-09-08T16:24:33.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:33.518 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:33.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:33.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj216 td/osd-backfill-space/datafile 2020-09-08T16:24:33.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:33.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj216 td/osd-backfill-space/datafile 2020-09-08T16:24:33.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:33.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:33.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:33.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj217 td/osd-backfill-space/datafile 2020-09-08T16:24:33.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:33.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj217 td/osd-backfill-space/datafile 2020-09-08T16:24:33.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:33.819 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:33.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:33.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj218 td/osd-backfill-space/datafile 2020-09-08T16:24:33.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:33.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj218 td/osd-backfill-space/datafile 2020-09-08T16:24:33.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:33.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:33.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:33.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj219 td/osd-backfill-space/datafile 2020-09-08T16:24:34.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:34.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj219 td/osd-backfill-space/datafile 2020-09-08T16:24:34.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:34.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:34.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:34.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj220 td/osd-backfill-space/datafile 2020-09-08T16:24:34.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:34.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj220 td/osd-backfill-space/datafile 2020-09-08T16:24:34.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:34.281 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:34.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:34.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj221 td/osd-backfill-space/datafile 2020-09-08T16:24:34.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:34.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj221 td/osd-backfill-space/datafile 2020-09-08T16:24:34.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:34.431 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:34.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:34.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj222 td/osd-backfill-space/datafile 2020-09-08T16:24:34.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:34.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj222 td/osd-backfill-space/datafile 2020-09-08T16:24:34.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:34.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:34.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:34.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj223 td/osd-backfill-space/datafile 2020-09-08T16:24:34.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:34.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj223 td/osd-backfill-space/datafile 2020-09-08T16:24:34.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:34.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:34.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:34.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj224 td/osd-backfill-space/datafile 2020-09-08T16:24:34.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:34.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj224 td/osd-backfill-space/datafile 2020-09-08T16:24:34.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:34.909 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:34.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:34.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj225 td/osd-backfill-space/datafile 2020-09-08T16:24:34.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:34.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj225 td/osd-backfill-space/datafile 2020-09-08T16:24:35.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:35.103 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:35.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:35.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj226 td/osd-backfill-space/datafile 2020-09-08T16:24:35.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:35.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj226 td/osd-backfill-space/datafile 2020-09-08T16:24:35.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:35.277 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:35.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:35.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj227 td/osd-backfill-space/datafile 2020-09-08T16:24:35.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:35.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj227 td/osd-backfill-space/datafile 2020-09-08T16:24:35.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:35.427 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:35.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:35.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj228 td/osd-backfill-space/datafile 2020-09-08T16:24:35.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:35.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj228 td/osd-backfill-space/datafile 2020-09-08T16:24:35.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:35.578 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:35.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:35.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj229 td/osd-backfill-space/datafile 2020-09-08T16:24:35.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:35.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj229 td/osd-backfill-space/datafile 2020-09-08T16:24:35.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:35.729 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:35.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:35.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj230 td/osd-backfill-space/datafile 2020-09-08T16:24:35.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:35.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj230 td/osd-backfill-space/datafile 2020-09-08T16:24:35.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:35.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:35.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:35.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj231 td/osd-backfill-space/datafile 2020-09-08T16:24:35.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:35.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj231 td/osd-backfill-space/datafile 2020-09-08T16:24:36.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:36.029 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:36.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:36.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj232 td/osd-backfill-space/datafile 2020-09-08T16:24:36.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:36.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj232 td/osd-backfill-space/datafile 2020-09-08T16:24:36.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:36.180 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:36.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:36.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj233 td/osd-backfill-space/datafile 2020-09-08T16:24:36.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:36.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj233 td/osd-backfill-space/datafile 2020-09-08T16:24:36.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:36.339 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:36.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:36.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj234 td/osd-backfill-space/datafile 2020-09-08T16:24:36.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:36.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj234 td/osd-backfill-space/datafile 2020-09-08T16:24:36.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:36.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:36.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:36.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj235 td/osd-backfill-space/datafile 2020-09-08T16:24:36.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:36.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj235 td/osd-backfill-space/datafile 2020-09-08T16:24:36.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:36.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:36.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:36.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj236 td/osd-backfill-space/datafile 2020-09-08T16:24:36.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:36.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj236 td/osd-backfill-space/datafile 2020-09-08T16:24:36.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:36.799 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:36.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:36.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj237 td/osd-backfill-space/datafile 2020-09-08T16:24:36.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:36.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj237 td/osd-backfill-space/datafile 2020-09-08T16:24:36.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:36.958 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:36.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:36.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj238 td/osd-backfill-space/datafile 2020-09-08T16:24:37.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:37.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj238 td/osd-backfill-space/datafile 2020-09-08T16:24:37.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:37.197 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:37.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:37.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj239 td/osd-backfill-space/datafile 2020-09-08T16:24:37.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:37.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj239 td/osd-backfill-space/datafile 2020-09-08T16:24:37.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:37.376 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:37.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:37.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj240 td/osd-backfill-space/datafile 2020-09-08T16:24:37.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:37.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj240 td/osd-backfill-space/datafile 2020-09-08T16:24:37.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:37.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:37.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:37.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj241 td/osd-backfill-space/datafile 2020-09-08T16:24:37.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:37.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj241 td/osd-backfill-space/datafile 2020-09-08T16:24:37.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:37.686 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:37.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:37.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj242 td/osd-backfill-space/datafile 2020-09-08T16:24:37.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:37.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj242 td/osd-backfill-space/datafile 2020-09-08T16:24:37.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:37.836 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:37.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:37.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj243 td/osd-backfill-space/datafile 2020-09-08T16:24:37.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:37.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj243 td/osd-backfill-space/datafile 2020-09-08T16:24:37.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:37.987 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:37.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:37.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj244 td/osd-backfill-space/datafile 2020-09-08T16:24:38.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:38.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj244 td/osd-backfill-space/datafile 2020-09-08T16:24:38.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:38.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:38.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:38.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj245 td/osd-backfill-space/datafile 2020-09-08T16:24:38.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:38.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj245 td/osd-backfill-space/datafile 2020-09-08T16:24:38.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:38.296 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:38.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:38.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj246 td/osd-backfill-space/datafile 2020-09-08T16:24:38.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:38.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj246 td/osd-backfill-space/datafile 2020-09-08T16:24:38.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:38.446 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:38.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:38.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj247 td/osd-backfill-space/datafile 2020-09-08T16:24:38.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:38.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj247 td/osd-backfill-space/datafile 2020-09-08T16:24:38.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:38.606 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:38.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:38.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj248 td/osd-backfill-space/datafile 2020-09-08T16:24:38.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:38.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj248 td/osd-backfill-space/datafile 2020-09-08T16:24:38.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:38.756 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:38.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:38.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj249 td/osd-backfill-space/datafile 2020-09-08T16:24:38.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:38.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj249 td/osd-backfill-space/datafile 2020-09-08T16:24:38.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:38.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:38.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:38.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj250 td/osd-backfill-space/datafile 2020-09-08T16:24:38.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:38.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj250 td/osd-backfill-space/datafile 2020-09-08T16:24:39.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:39.091 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:39.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:39.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj251 td/osd-backfill-space/datafile 2020-09-08T16:24:39.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:39.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj251 td/osd-backfill-space/datafile 2020-09-08T16:24:39.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:39.250 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:39.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:39.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj252 td/osd-backfill-space/datafile 2020-09-08T16:24:39.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:39.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj252 td/osd-backfill-space/datafile 2020-09-08T16:24:39.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:39.409 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:39.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:39.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj253 td/osd-backfill-space/datafile 2020-09-08T16:24:39.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:39.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj253 td/osd-backfill-space/datafile 2020-09-08T16:24:39.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:39.559 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:39.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:39.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj254 td/osd-backfill-space/datafile 2020-09-08T16:24:39.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:39.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj254 td/osd-backfill-space/datafile 2020-09-08T16:24:39.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:39.710 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:39.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:39.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj255 td/osd-backfill-space/datafile 2020-09-08T16:24:39.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:39.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj255 td/osd-backfill-space/datafile 2020-09-08T16:24:39.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:39.869 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:39.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:39.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj256 td/osd-backfill-space/datafile 2020-09-08T16:24:39.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:39.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj256 td/osd-backfill-space/datafile 2020-09-08T16:24:40.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:40.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:40.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:40.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj257 td/osd-backfill-space/datafile 2020-09-08T16:24:40.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:40.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj257 td/osd-backfill-space/datafile 2020-09-08T16:24:40.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:40.187 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:40.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:40.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj258 td/osd-backfill-space/datafile 2020-09-08T16:24:40.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:40.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj258 td/osd-backfill-space/datafile 2020-09-08T16:24:40.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:40.338 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:40.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:40.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj259 td/osd-backfill-space/datafile 2020-09-08T16:24:40.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:40.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj259 td/osd-backfill-space/datafile 2020-09-08T16:24:40.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:40.488 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:40.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:40.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj260 td/osd-backfill-space/datafile 2020-09-08T16:24:40.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:40.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj260 td/osd-backfill-space/datafile 2020-09-08T16:24:40.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:40.647 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:40.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:40.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj261 td/osd-backfill-space/datafile 2020-09-08T16:24:40.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:40.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj261 td/osd-backfill-space/datafile 2020-09-08T16:24:40.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:40.798 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:40.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:40.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj262 td/osd-backfill-space/datafile 2020-09-08T16:24:40.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:40.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj262 td/osd-backfill-space/datafile 2020-09-08T16:24:40.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:40.948 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:40.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:40.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj263 td/osd-backfill-space/datafile 2020-09-08T16:24:41.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:41.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj263 td/osd-backfill-space/datafile 2020-09-08T16:24:41.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:41.132 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:41.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:41.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj264 td/osd-backfill-space/datafile 2020-09-08T16:24:41.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:41.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj264 td/osd-backfill-space/datafile 2020-09-08T16:24:41.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:41.333 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:41.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:41.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj265 td/osd-backfill-space/datafile 2020-09-08T16:24:41.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:41.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj265 td/osd-backfill-space/datafile 2020-09-08T16:24:41.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:41.485 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:41.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:41.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj266 td/osd-backfill-space/datafile 2020-09-08T16:24:41.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:41.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj266 td/osd-backfill-space/datafile 2020-09-08T16:24:41.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:41.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:41.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:41.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj267 td/osd-backfill-space/datafile 2020-09-08T16:24:41.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:41.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj267 td/osd-backfill-space/datafile 2020-09-08T16:24:41.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:41.785 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:41.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:41.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj268 td/osd-backfill-space/datafile 2020-09-08T16:24:41.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:41.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj268 td/osd-backfill-space/datafile 2020-09-08T16:24:41.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:41.935 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:41.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:41.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj269 td/osd-backfill-space/datafile 2020-09-08T16:24:42.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:42.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj269 td/osd-backfill-space/datafile 2020-09-08T16:24:42.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:42.087 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:42.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:42.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj270 td/osd-backfill-space/datafile 2020-09-08T16:24:42.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:42.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj270 td/osd-backfill-space/datafile 2020-09-08T16:24:42.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:42.278 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:42.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:42.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj271 td/osd-backfill-space/datafile 2020-09-08T16:24:42.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:42.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj271 td/osd-backfill-space/datafile 2020-09-08T16:24:42.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:42.429 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:42.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:42.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj272 td/osd-backfill-space/datafile 2020-09-08T16:24:42.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:42.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj272 td/osd-backfill-space/datafile 2020-09-08T16:24:42.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:42.588 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:42.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:42.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj273 td/osd-backfill-space/datafile 2020-09-08T16:24:42.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:42.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj273 td/osd-backfill-space/datafile 2020-09-08T16:24:42.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:42.738 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:42.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:42.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj274 td/osd-backfill-space/datafile 2020-09-08T16:24:42.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:42.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj274 td/osd-backfill-space/datafile 2020-09-08T16:24:42.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:42.905 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:42.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:42.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj275 td/osd-backfill-space/datafile 2020-09-08T16:24:42.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:42.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj275 td/osd-backfill-space/datafile 2020-09-08T16:24:43.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:43.098 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:43.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:43.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj276 td/osd-backfill-space/datafile 2020-09-08T16:24:43.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:43.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj276 td/osd-backfill-space/datafile 2020-09-08T16:24:43.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:43.291 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:43.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:43.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj277 td/osd-backfill-space/datafile 2020-09-08T16:24:43.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:43.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj277 td/osd-backfill-space/datafile 2020-09-08T16:24:43.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:43.441 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:43.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:43.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj278 td/osd-backfill-space/datafile 2020-09-08T16:24:43.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:43.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj278 td/osd-backfill-space/datafile 2020-09-08T16:24:43.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:43.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:43.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:43.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj279 td/osd-backfill-space/datafile 2020-09-08T16:24:43.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:43.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj279 td/osd-backfill-space/datafile 2020-09-08T16:24:43.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:43.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:43.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:43.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj280 td/osd-backfill-space/datafile 2020-09-08T16:24:43.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:43.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj280 td/osd-backfill-space/datafile 2020-09-08T16:24:43.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:43.909 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:43.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:43.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj281 td/osd-backfill-space/datafile 2020-09-08T16:24:43.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:43.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj281 td/osd-backfill-space/datafile 2020-09-08T16:24:44.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:44.068 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:44.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:44.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj282 td/osd-backfill-space/datafile 2020-09-08T16:24:44.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:44.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj282 td/osd-backfill-space/datafile 2020-09-08T16:24:44.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:44.219 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:44.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:44.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj283 td/osd-backfill-space/datafile 2020-09-08T16:24:44.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:44.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj283 td/osd-backfill-space/datafile 2020-09-08T16:24:44.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:44.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:44.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:44.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj284 td/osd-backfill-space/datafile 2020-09-08T16:24:44.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:44.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj284 td/osd-backfill-space/datafile 2020-09-08T16:24:44.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:44.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:44.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:44.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj285 td/osd-backfill-space/datafile 2020-09-08T16:24:44.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:44.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj285 td/osd-backfill-space/datafile 2020-09-08T16:24:44.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:44.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:44.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:44.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj286 td/osd-backfill-space/datafile 2020-09-08T16:24:44.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:44.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj286 td/osd-backfill-space/datafile 2020-09-08T16:24:44.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:44.837 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:44.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:44.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj287 td/osd-backfill-space/datafile 2020-09-08T16:24:44.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:44.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj287 td/osd-backfill-space/datafile 2020-09-08T16:24:45.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:45.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:45.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:45.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj288 td/osd-backfill-space/datafile 2020-09-08T16:24:45.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:45.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj288 td/osd-backfill-space/datafile 2020-09-08T16:24:45.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:45.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:45.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:45.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj289 td/osd-backfill-space/datafile 2020-09-08T16:24:45.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:45.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj289 td/osd-backfill-space/datafile 2020-09-08T16:24:45.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:45.382 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:45.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:45.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj290 td/osd-backfill-space/datafile 2020-09-08T16:24:45.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:45.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj290 td/osd-backfill-space/datafile 2020-09-08T16:24:45.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:45.541 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:45.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:45.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj291 td/osd-backfill-space/datafile 2020-09-08T16:24:45.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:45.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj291 td/osd-backfill-space/datafile 2020-09-08T16:24:45.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:45.693 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:45.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:45.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj292 td/osd-backfill-space/datafile 2020-09-08T16:24:45.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:45.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj292 td/osd-backfill-space/datafile 2020-09-08T16:24:45.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:45.844 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:45.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:45.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj293 td/osd-backfill-space/datafile 2020-09-08T16:24:45.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:45.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj293 td/osd-backfill-space/datafile 2020-09-08T16:24:46.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:46.000 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:46.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:46.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj294 td/osd-backfill-space/datafile 2020-09-08T16:24:46.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:46.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj294 td/osd-backfill-space/datafile 2020-09-08T16:24:46.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:46.159 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:46.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:46.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj295 td/osd-backfill-space/datafile 2020-09-08T16:24:46.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:46.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj295 td/osd-backfill-space/datafile 2020-09-08T16:24:46.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:46.310 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:46.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:46.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj296 td/osd-backfill-space/datafile 2020-09-08T16:24:46.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:46.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj296 td/osd-backfill-space/datafile 2020-09-08T16:24:46.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:46.463 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:46.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:46.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj297 td/osd-backfill-space/datafile 2020-09-08T16:24:46.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:46.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj297 td/osd-backfill-space/datafile 2020-09-08T16:24:46.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:46.611 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:46.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:46.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj298 td/osd-backfill-space/datafile 2020-09-08T16:24:46.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:46.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj298 td/osd-backfill-space/datafile 2020-09-08T16:24:46.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:46.762 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:46.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:46.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj299 td/osd-backfill-space/datafile 2020-09-08T16:24:46.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:46.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj299 td/osd-backfill-space/datafile 2020-09-08T16:24:46.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:46.912 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:46.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:46.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj300 td/osd-backfill-space/datafile 2020-09-08T16:24:46.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:46.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj300 td/osd-backfill-space/datafile 2020-09-08T16:24:47.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:47.105 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:47.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:47.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj301 td/osd-backfill-space/datafile 2020-09-08T16:24:47.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:47.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj301 td/osd-backfill-space/datafile 2020-09-08T16:24:47.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:47.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:47.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:47.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj302 td/osd-backfill-space/datafile 2020-09-08T16:24:47.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:47.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj302 td/osd-backfill-space/datafile 2020-09-08T16:24:47.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:47.447 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:47.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:47.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj303 td/osd-backfill-space/datafile 2020-09-08T16:24:47.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:47.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj303 td/osd-backfill-space/datafile 2020-09-08T16:24:47.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:47.590 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:47.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:47.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj304 td/osd-backfill-space/datafile 2020-09-08T16:24:47.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:47.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj304 td/osd-backfill-space/datafile 2020-09-08T16:24:47.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:47.740 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:47.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:47.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj305 td/osd-backfill-space/datafile 2020-09-08T16:24:47.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:47.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj305 td/osd-backfill-space/datafile 2020-09-08T16:24:47.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:47.899 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:47.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:47.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj306 td/osd-backfill-space/datafile 2020-09-08T16:24:47.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:47.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj306 td/osd-backfill-space/datafile 2020-09-08T16:24:48.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:48.050 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:48.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:48.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj307 td/osd-backfill-space/datafile 2020-09-08T16:24:48.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:48.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj307 td/osd-backfill-space/datafile 2020-09-08T16:24:48.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:48.421 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:48.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:48.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj308 td/osd-backfill-space/datafile 2020-09-08T16:24:48.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:48.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj308 td/osd-backfill-space/datafile 2020-09-08T16:24:48.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:48.423 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:48.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:48.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj309 td/osd-backfill-space/datafile 2020-09-08T16:24:48.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:48.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj309 td/osd-backfill-space/datafile 2020-09-08T16:24:48.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:48.519 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:48.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:48.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj310 td/osd-backfill-space/datafile 2020-09-08T16:24:48.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:48.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj310 td/osd-backfill-space/datafile 2020-09-08T16:24:48.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:48.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:48.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:48.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj311 td/osd-backfill-space/datafile 2020-09-08T16:24:48.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:48.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj311 td/osd-backfill-space/datafile 2020-09-08T16:24:48.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:48.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:48.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:48.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj312 td/osd-backfill-space/datafile 2020-09-08T16:24:48.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:48.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj312 td/osd-backfill-space/datafile 2020-09-08T16:24:48.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:48.983 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:48.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:48.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj313 td/osd-backfill-space/datafile 2020-09-08T16:24:49.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:49.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj313 td/osd-backfill-space/datafile 2020-09-08T16:24:49.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:49.171 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:49.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:49.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj314 td/osd-backfill-space/datafile 2020-09-08T16:24:49.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:49.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj314 td/osd-backfill-space/datafile 2020-09-08T16:24:49.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:49.338 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:49.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:49.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj315 td/osd-backfill-space/datafile 2020-09-08T16:24:49.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:49.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj315 td/osd-backfill-space/datafile 2020-09-08T16:24:49.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:49.505 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:49.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:49.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj316 td/osd-backfill-space/datafile 2020-09-08T16:24:49.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:49.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj316 td/osd-backfill-space/datafile 2020-09-08T16:24:49.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:49.659 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:49.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:49.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj317 td/osd-backfill-space/datafile 2020-09-08T16:24:49.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:49.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj317 td/osd-backfill-space/datafile 2020-09-08T16:24:49.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:49.807 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:49.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:49.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj318 td/osd-backfill-space/datafile 2020-09-08T16:24:49.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:49.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj318 td/osd-backfill-space/datafile 2020-09-08T16:24:49.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:49.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:49.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:49.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj319 td/osd-backfill-space/datafile 2020-09-08T16:24:50.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:50.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj319 td/osd-backfill-space/datafile 2020-09-08T16:24:50.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:50.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:50.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:50.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj320 td/osd-backfill-space/datafile 2020-09-08T16:24:50.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:50.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj320 td/osd-backfill-space/datafile 2020-09-08T16:24:50.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:50.333 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:50.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:50.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj321 td/osd-backfill-space/datafile 2020-09-08T16:24:50.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:50.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj321 td/osd-backfill-space/datafile 2020-09-08T16:24:50.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:50.484 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:50.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:50.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj322 td/osd-backfill-space/datafile 2020-09-08T16:24:50.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:50.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj322 td/osd-backfill-space/datafile 2020-09-08T16:24:50.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:50.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:50.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:50.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj323 td/osd-backfill-space/datafile 2020-09-08T16:24:50.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:50.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj323 td/osd-backfill-space/datafile 2020-09-08T16:24:50.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:50.785 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:50.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:50.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj324 td/osd-backfill-space/datafile 2020-09-08T16:24:50.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:50.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj324 td/osd-backfill-space/datafile 2020-09-08T16:24:50.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:50.936 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:50.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:50.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj325 td/osd-backfill-space/datafile 2020-09-08T16:24:51.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:51.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj325 td/osd-backfill-space/datafile 2020-09-08T16:24:51.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:51.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:51.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:51.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj326 td/osd-backfill-space/datafile 2020-09-08T16:24:51.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:51.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj326 td/osd-backfill-space/datafile 2020-09-08T16:24:51.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:51.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:51.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:51.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj327 td/osd-backfill-space/datafile 2020-09-08T16:24:51.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:51.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj327 td/osd-backfill-space/datafile 2020-09-08T16:24:51.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:51.471 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:51.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:51.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj328 td/osd-backfill-space/datafile 2020-09-08T16:24:51.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:51.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj328 td/osd-backfill-space/datafile 2020-09-08T16:24:51.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:51.621 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:51.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:51.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj329 td/osd-backfill-space/datafile 2020-09-08T16:24:51.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:51.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj329 td/osd-backfill-space/datafile 2020-09-08T16:24:51.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:51.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:51.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:51.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj330 td/osd-backfill-space/datafile 2020-09-08T16:24:51.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:51.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj330 td/osd-backfill-space/datafile 2020-09-08T16:24:51.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:51.939 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:51.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:51.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj331 td/osd-backfill-space/datafile 2020-09-08T16:24:52.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:52.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj331 td/osd-backfill-space/datafile 2020-09-08T16:24:52.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:52.090 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:52.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:52.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj332 td/osd-backfill-space/datafile 2020-09-08T16:24:52.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:52.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj332 td/osd-backfill-space/datafile 2020-09-08T16:24:52.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:52.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:52.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:52.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj333 td/osd-backfill-space/datafile 2020-09-08T16:24:52.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:52.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj333 td/osd-backfill-space/datafile 2020-09-08T16:24:52.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:52.400 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:52.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:52.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj334 td/osd-backfill-space/datafile 2020-09-08T16:24:52.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:52.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj334 td/osd-backfill-space/datafile 2020-09-08T16:24:52.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:52.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:52.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:52.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj335 td/osd-backfill-space/datafile 2020-09-08T16:24:52.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:52.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj335 td/osd-backfill-space/datafile 2020-09-08T16:24:52.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:52.701 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:52.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:52.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj336 td/osd-backfill-space/datafile 2020-09-08T16:24:52.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:52.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj336 td/osd-backfill-space/datafile 2020-09-08T16:24:52.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:52.851 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:52.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:52.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj337 td/osd-backfill-space/datafile 2020-09-08T16:24:52.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:52.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj337 td/osd-backfill-space/datafile 2020-09-08T16:24:53.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:53.002 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:53.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:53.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj338 td/osd-backfill-space/datafile 2020-09-08T16:24:53.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:53.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj338 td/osd-backfill-space/datafile 2020-09-08T16:24:53.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:53.194 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:53.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:53.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj339 td/osd-backfill-space/datafile 2020-09-08T16:24:53.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:53.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj339 td/osd-backfill-space/datafile 2020-09-08T16:24:53.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:53.395 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:53.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:53.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj340 td/osd-backfill-space/datafile 2020-09-08T16:24:53.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:53.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj340 td/osd-backfill-space/datafile 2020-09-08T16:24:53.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:53.546 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:53.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:53.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj341 td/osd-backfill-space/datafile 2020-09-08T16:24:53.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:53.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj341 td/osd-backfill-space/datafile 2020-09-08T16:24:53.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:53.696 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:53.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:53.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj342 td/osd-backfill-space/datafile 2020-09-08T16:24:53.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:53.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj342 td/osd-backfill-space/datafile 2020-09-08T16:24:53.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:53.855 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:53.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:53.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj343 td/osd-backfill-space/datafile 2020-09-08T16:24:53.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:53.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj343 td/osd-backfill-space/datafile 2020-09-08T16:24:54.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:54.031 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:54.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:54.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj344 td/osd-backfill-space/datafile 2020-09-08T16:24:54.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:54.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj344 td/osd-backfill-space/datafile 2020-09-08T16:24:54.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:54.181 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:54.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:54.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj345 td/osd-backfill-space/datafile 2020-09-08T16:24:54.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:54.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj345 td/osd-backfill-space/datafile 2020-09-08T16:24:54.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:54.332 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:54.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:54.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj346 td/osd-backfill-space/datafile 2020-09-08T16:24:54.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:54.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj346 td/osd-backfill-space/datafile 2020-09-08T16:24:54.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:54.482 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:54.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:54.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj347 td/osd-backfill-space/datafile 2020-09-08T16:24:54.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:54.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj347 td/osd-backfill-space/datafile 2020-09-08T16:24:54.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:54.633 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:54.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:54.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj348 td/osd-backfill-space/datafile 2020-09-08T16:24:54.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:54.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj348 td/osd-backfill-space/datafile 2020-09-08T16:24:54.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:54.793 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:54.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:54.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj349 td/osd-backfill-space/datafile 2020-09-08T16:24:54.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:54.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj349 td/osd-backfill-space/datafile 2020-09-08T16:24:54.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:54.942 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:54.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:54.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj350 td/osd-backfill-space/datafile 2020-09-08T16:24:55.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:55.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj350 td/osd-backfill-space/datafile 2020-09-08T16:24:55.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:55.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:55.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:55.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj351 td/osd-backfill-space/datafile 2020-09-08T16:24:55.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:55.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj351 td/osd-backfill-space/datafile 2020-09-08T16:24:55.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:55.360 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:55.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:55.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj352 td/osd-backfill-space/datafile 2020-09-08T16:24:55.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:55.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj352 td/osd-backfill-space/datafile 2020-09-08T16:24:55.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:55.520 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:55.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:55.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj353 td/osd-backfill-space/datafile 2020-09-08T16:24:55.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:55.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj353 td/osd-backfill-space/datafile 2020-09-08T16:24:55.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:55.678 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:55.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:55.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj354 td/osd-backfill-space/datafile 2020-09-08T16:24:55.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:55.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj354 td/osd-backfill-space/datafile 2020-09-08T16:24:55.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:55.829 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:55.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:55.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj355 td/osd-backfill-space/datafile 2020-09-08T16:24:55.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:55.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj355 td/osd-backfill-space/datafile 2020-09-08T16:24:55.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:55.989 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:55.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:55.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj356 td/osd-backfill-space/datafile 2020-09-08T16:24:56.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:56.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj356 td/osd-backfill-space/datafile 2020-09-08T16:24:56.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:56.155 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:56.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:56.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj357 td/osd-backfill-space/datafile 2020-09-08T16:24:56.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:56.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj357 td/osd-backfill-space/datafile 2020-09-08T16:24:56.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:56.331 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:56.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:56.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj358 td/osd-backfill-space/datafile 2020-09-08T16:24:56.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:56.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj358 td/osd-backfill-space/datafile 2020-09-08T16:24:56.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:56.487 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:56.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:56.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj359 td/osd-backfill-space/datafile 2020-09-08T16:24:56.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:56.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj359 td/osd-backfill-space/datafile 2020-09-08T16:24:56.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:56.632 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:56.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:56.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj360 td/osd-backfill-space/datafile 2020-09-08T16:24:56.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:56.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj360 td/osd-backfill-space/datafile 2020-09-08T16:24:56.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:56.806 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:56.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:56.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj361 td/osd-backfill-space/datafile 2020-09-08T16:24:56.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:56.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj361 td/osd-backfill-space/datafile 2020-09-08T16:24:56.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:56.949 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:56.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:56.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj362 td/osd-backfill-space/datafile 2020-09-08T16:24:57.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:57.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj362 td/osd-backfill-space/datafile 2020-09-08T16:24:57.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:57.125 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:57.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:57.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj363 td/osd-backfill-space/datafile 2020-09-08T16:24:57.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:57.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj363 td/osd-backfill-space/datafile 2020-09-08T16:24:57.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:57.318 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:57.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:57.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj364 td/osd-backfill-space/datafile 2020-09-08T16:24:57.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:57.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj364 td/osd-backfill-space/datafile 2020-09-08T16:24:57.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:57.468 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:57.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:57.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj365 td/osd-backfill-space/datafile 2020-09-08T16:24:57.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:57.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj365 td/osd-backfill-space/datafile 2020-09-08T16:24:58.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:58.028 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:58.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:58.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj366 td/osd-backfill-space/datafile 2020-09-08T16:24:58.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:58.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj366 td/osd-backfill-space/datafile 2020-09-08T16:24:58.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:58.195 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:58.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:58.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj367 td/osd-backfill-space/datafile 2020-09-08T16:24:58.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:58.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj367 td/osd-backfill-space/datafile 2020-09-08T16:24:58.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:58.353 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:58.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:58.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj368 td/osd-backfill-space/datafile 2020-09-08T16:24:58.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:58.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj368 td/osd-backfill-space/datafile 2020-09-08T16:24:58.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:58.521 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:58.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:58.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj369 td/osd-backfill-space/datafile 2020-09-08T16:24:58.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:58.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj369 td/osd-backfill-space/datafile 2020-09-08T16:24:58.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:58.671 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:58.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:58.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj370 td/osd-backfill-space/datafile 2020-09-08T16:24:58.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:58.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj370 td/osd-backfill-space/datafile 2020-09-08T16:24:58.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:58.830 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:58.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:58.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj371 td/osd-backfill-space/datafile 2020-09-08T16:24:58.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:58.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj371 td/osd-backfill-space/datafile 2020-09-08T16:24:58.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:58.981 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:58.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:58.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj372 td/osd-backfill-space/datafile 2020-09-08T16:24:59.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:59.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj372 td/osd-backfill-space/datafile 2020-09-08T16:24:59.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:59.190 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:59.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:59.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj373 td/osd-backfill-space/datafile 2020-09-08T16:24:59.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:59.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj373 td/osd-backfill-space/datafile 2020-09-08T16:24:59.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:59.374 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:59.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:59.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj374 td/osd-backfill-space/datafile 2020-09-08T16:24:59.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:59.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj374 td/osd-backfill-space/datafile 2020-09-08T16:24:59.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:59.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:59.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:59.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj375 td/osd-backfill-space/datafile 2020-09-08T16:24:59.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:59.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj375 td/osd-backfill-space/datafile 2020-09-08T16:24:59.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:59.675 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:59.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:59.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj376 td/osd-backfill-space/datafile 2020-09-08T16:24:59.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:59.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj376 td/osd-backfill-space/datafile 2020-09-08T16:24:59.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:59.835 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:59.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:59.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj377 td/osd-backfill-space/datafile 2020-09-08T16:24:59.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:59.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj377 td/osd-backfill-space/datafile 2020-09-08T16:24:59.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:24:59.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:24:59.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:24:59.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj378 td/osd-backfill-space/datafile 2020-09-08T16:25:00.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:00.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj378 td/osd-backfill-space/datafile 2020-09-08T16:25:00.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:00.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:00.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:00.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj379 td/osd-backfill-space/datafile 2020-09-08T16:25:00.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:00.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj379 td/osd-backfill-space/datafile 2020-09-08T16:25:00.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:00.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:00.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:00.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj380 td/osd-backfill-space/datafile 2020-09-08T16:25:00.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:00.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj380 td/osd-backfill-space/datafile 2020-09-08T16:25:00.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:00.470 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:00.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:00.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj381 td/osd-backfill-space/datafile 2020-09-08T16:25:00.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:00.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj381 td/osd-backfill-space/datafile 2020-09-08T16:25:00.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:00.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:00.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:00.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj382 td/osd-backfill-space/datafile 2020-09-08T16:25:00.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:00.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj382 td/osd-backfill-space/datafile 2020-09-08T16:25:00.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:00.779 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:00.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:00.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj383 td/osd-backfill-space/datafile 2020-09-08T16:25:00.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:00.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj383 td/osd-backfill-space/datafile 2020-09-08T16:25:00.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:00.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:00.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:00.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj384 td/osd-backfill-space/datafile 2020-09-08T16:25:01.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:01.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj384 td/osd-backfill-space/datafile 2020-09-08T16:25:01.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:01.115 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:01.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:01.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj385 td/osd-backfill-space/datafile 2020-09-08T16:25:01.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:01.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj385 td/osd-backfill-space/datafile 2020-09-08T16:25:01.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:01.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:01.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:01.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj386 td/osd-backfill-space/datafile 2020-09-08T16:25:01.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:01.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj386 td/osd-backfill-space/datafile 2020-09-08T16:25:01.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:01.448 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:01.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:01.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj387 td/osd-backfill-space/datafile 2020-09-08T16:25:01.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:01.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj387 td/osd-backfill-space/datafile 2020-09-08T16:25:01.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:01.607 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:01.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:01.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj388 td/osd-backfill-space/datafile 2020-09-08T16:25:01.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:01.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj388 td/osd-backfill-space/datafile 2020-09-08T16:25:01.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:01.766 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:01.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:01.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj389 td/osd-backfill-space/datafile 2020-09-08T16:25:01.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:01.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj389 td/osd-backfill-space/datafile 2020-09-08T16:25:01.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:01.920 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:01.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:01.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj390 td/osd-backfill-space/datafile 2020-09-08T16:25:01.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:01.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj390 td/osd-backfill-space/datafile 2020-09-08T16:25:02.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:02.067 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:02.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:02.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj391 td/osd-backfill-space/datafile 2020-09-08T16:25:02.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:02.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj391 td/osd-backfill-space/datafile 2020-09-08T16:25:02.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:02.218 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:02.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:02.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj392 td/osd-backfill-space/datafile 2020-09-08T16:25:02.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:02.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj392 td/osd-backfill-space/datafile 2020-09-08T16:25:02.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:02.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:02.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:02.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj393 td/osd-backfill-space/datafile 2020-09-08T16:25:02.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:02.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj393 td/osd-backfill-space/datafile 2020-09-08T16:25:02.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:02.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:02.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:02.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj394 td/osd-backfill-space/datafile 2020-09-08T16:25:02.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:02.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj394 td/osd-backfill-space/datafile 2020-09-08T16:25:02.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:02.686 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:02.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:02.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj395 td/osd-backfill-space/datafile 2020-09-08T16:25:02.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:02.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj395 td/osd-backfill-space/datafile 2020-09-08T16:25:02.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:02.842 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:02.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:02.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj396 td/osd-backfill-space/datafile 2020-09-08T16:25:02.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:02.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj396 td/osd-backfill-space/datafile 2020-09-08T16:25:02.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:02.987 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:02.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:02.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj397 td/osd-backfill-space/datafile 2020-09-08T16:25:03.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:03.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj397 td/osd-backfill-space/datafile 2020-09-08T16:25:03.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:03.180 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:03.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:03.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj398 td/osd-backfill-space/datafile 2020-09-08T16:25:03.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:03.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj398 td/osd-backfill-space/datafile 2020-09-08T16:25:03.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:03.415 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:03.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:03.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj399 td/osd-backfill-space/datafile 2020-09-08T16:25:03.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:03.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj399 td/osd-backfill-space/datafile 2020-09-08T16:25:03.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:03.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:03.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:03.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj400 td/osd-backfill-space/datafile 2020-09-08T16:25:03.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:03.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj400 td/osd-backfill-space/datafile 2020-09-08T16:25:03.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:03.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:03.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:03.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj401 td/osd-backfill-space/datafile 2020-09-08T16:25:03.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:03.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj401 td/osd-backfill-space/datafile 2020-09-08T16:25:03.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:03.866 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:03.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:03.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj402 td/osd-backfill-space/datafile 2020-09-08T16:25:03.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:03.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj402 td/osd-backfill-space/datafile 2020-09-08T16:25:04.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:04.016 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:04.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:04.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj403 td/osd-backfill-space/datafile 2020-09-08T16:25:04.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:04.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj403 td/osd-backfill-space/datafile 2020-09-08T16:25:04.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:04.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:04.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:04.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj404 td/osd-backfill-space/datafile 2020-09-08T16:25:04.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:04.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj404 td/osd-backfill-space/datafile 2020-09-08T16:25:04.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:04.342 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:04.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:04.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj405 td/osd-backfill-space/datafile 2020-09-08T16:25:04.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:04.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj405 td/osd-backfill-space/datafile 2020-09-08T16:25:04.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:04.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:04.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:04.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj406 td/osd-backfill-space/datafile 2020-09-08T16:25:04.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:04.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj406 td/osd-backfill-space/datafile 2020-09-08T16:25:04.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:04.644 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:04.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:04.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj407 td/osd-backfill-space/datafile 2020-09-08T16:25:04.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:04.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj407 td/osd-backfill-space/datafile 2020-09-08T16:25:04.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:04.794 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:04.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:04.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj408 td/osd-backfill-space/datafile 2020-09-08T16:25:04.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:04.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj408 td/osd-backfill-space/datafile 2020-09-08T16:25:04.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:04.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:04.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:04.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj409 td/osd-backfill-space/datafile 2020-09-08T16:25:05.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:05.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj409 td/osd-backfill-space/datafile 2020-09-08T16:25:05.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:05.154 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:05.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:05.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj410 td/osd-backfill-space/datafile 2020-09-08T16:25:05.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:05.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj410 td/osd-backfill-space/datafile 2020-09-08T16:25:05.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:05.338 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:05.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:05.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj411 td/osd-backfill-space/datafile 2020-09-08T16:25:05.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:05.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj411 td/osd-backfill-space/datafile 2020-09-08T16:25:05.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:05.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:05.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:05.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj412 td/osd-backfill-space/datafile 2020-09-08T16:25:05.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:05.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj412 td/osd-backfill-space/datafile 2020-09-08T16:25:05.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:05.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:05.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:05.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj413 td/osd-backfill-space/datafile 2020-09-08T16:25:05.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:05.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj413 td/osd-backfill-space/datafile 2020-09-08T16:25:05.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:05.815 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:05.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:05.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj414 td/osd-backfill-space/datafile 2020-09-08T16:25:05.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:05.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj414 td/osd-backfill-space/datafile 2020-09-08T16:25:05.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:05.974 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:05.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:05.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj415 td/osd-backfill-space/datafile 2020-09-08T16:25:06.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:06.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj415 td/osd-backfill-space/datafile 2020-09-08T16:25:06.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:06.124 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:06.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:06.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj416 td/osd-backfill-space/datafile 2020-09-08T16:25:06.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:06.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj416 td/osd-backfill-space/datafile 2020-09-08T16:25:06.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:06.275 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:06.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:06.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj417 td/osd-backfill-space/datafile 2020-09-08T16:25:06.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:06.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj417 td/osd-backfill-space/datafile 2020-09-08T16:25:06.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:06.425 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:06.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:06.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj418 td/osd-backfill-space/datafile 2020-09-08T16:25:06.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:06.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj418 td/osd-backfill-space/datafile 2020-09-08T16:25:06.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:06.576 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:06.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:06.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj419 td/osd-backfill-space/datafile 2020-09-08T16:25:06.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:06.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj419 td/osd-backfill-space/datafile 2020-09-08T16:25:06.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:06.726 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:06.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:06.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj420 td/osd-backfill-space/datafile 2020-09-08T16:25:06.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:06.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj420 td/osd-backfill-space/datafile 2020-09-08T16:25:06.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:06.888 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:06.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:06.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj421 td/osd-backfill-space/datafile 2020-09-08T16:25:06.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:06.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj421 td/osd-backfill-space/datafile 2020-09-08T16:25:07.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:07.069 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:07.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:07.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj422 td/osd-backfill-space/datafile 2020-09-08T16:25:07.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:07.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj422 td/osd-backfill-space/datafile 2020-09-08T16:25:07.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:07.253 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:07.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:07.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj423 td/osd-backfill-space/datafile 2020-09-08T16:25:07.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:07.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj423 td/osd-backfill-space/datafile 2020-09-08T16:25:07.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:07.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:07.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:07.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj424 td/osd-backfill-space/datafile 2020-09-08T16:25:07.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:07.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj424 td/osd-backfill-space/datafile 2020-09-08T16:25:07.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:07.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:07.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:07.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj425 td/osd-backfill-space/datafile 2020-09-08T16:25:07.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:07.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj425 td/osd-backfill-space/datafile 2020-09-08T16:25:07.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:07.739 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:07.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:07.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj426 td/osd-backfill-space/datafile 2020-09-08T16:25:07.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:07.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj426 td/osd-backfill-space/datafile 2020-09-08T16:25:07.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:07.889 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:07.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:07.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj427 td/osd-backfill-space/datafile 2020-09-08T16:25:07.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:07.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj427 td/osd-backfill-space/datafile 2020-09-08T16:25:08.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:08.048 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:08.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:08.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj428 td/osd-backfill-space/datafile 2020-09-08T16:25:08.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:08.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj428 td/osd-backfill-space/datafile 2020-09-08T16:25:08.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:08.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:08.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:08.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj429 td/osd-backfill-space/datafile 2020-09-08T16:25:08.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:08.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj429 td/osd-backfill-space/datafile 2020-09-08T16:25:08.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:08.400 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:08.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:08.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj430 td/osd-backfill-space/datafile 2020-09-08T16:25:08.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:08.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj430 td/osd-backfill-space/datafile 2020-09-08T16:25:08.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:08.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:08.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:08.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj431 td/osd-backfill-space/datafile 2020-09-08T16:25:08.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:08.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj431 td/osd-backfill-space/datafile 2020-09-08T16:25:08.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:08.703 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:08.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:08.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj432 td/osd-backfill-space/datafile 2020-09-08T16:25:08.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:08.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj432 td/osd-backfill-space/datafile 2020-09-08T16:25:08.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:08.859 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:08.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:08.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj433 td/osd-backfill-space/datafile 2020-09-08T16:25:08.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:08.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj433 td/osd-backfill-space/datafile 2020-09-08T16:25:09.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:09.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:09.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:09.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj434 td/osd-backfill-space/datafile 2020-09-08T16:25:09.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:09.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj434 td/osd-backfill-space/datafile 2020-09-08T16:25:09.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:09.185 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:09.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:09.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj435 td/osd-backfill-space/datafile 2020-09-08T16:25:09.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:09.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj435 td/osd-backfill-space/datafile 2020-09-08T16:25:09.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:09.378 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:09.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:09.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj436 td/osd-backfill-space/datafile 2020-09-08T16:25:09.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:09.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj436 td/osd-backfill-space/datafile 2020-09-08T16:25:09.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:09.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:09.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:09.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj437 td/osd-backfill-space/datafile 2020-09-08T16:25:09.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:09.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj437 td/osd-backfill-space/datafile 2020-09-08T16:25:09.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:09.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:09.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:09.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj438 td/osd-backfill-space/datafile 2020-09-08T16:25:09.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:09.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj438 td/osd-backfill-space/datafile 2020-09-08T16:25:09.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:09.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:09.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:09.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj439 td/osd-backfill-space/datafile 2020-09-08T16:25:09.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:09.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj439 td/osd-backfill-space/datafile 2020-09-08T16:25:09.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:09.998 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:09.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:09.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj440 td/osd-backfill-space/datafile 2020-09-08T16:25:10.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:10.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj440 td/osd-backfill-space/datafile 2020-09-08T16:25:10.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:10.181 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:10.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:10.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj441 td/osd-backfill-space/datafile 2020-09-08T16:25:10.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:10.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj441 td/osd-backfill-space/datafile 2020-09-08T16:25:10.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:10.340 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:10.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:10.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj442 td/osd-backfill-space/datafile 2020-09-08T16:25:10.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:10.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj442 td/osd-backfill-space/datafile 2020-09-08T16:25:10.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:10.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:10.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:10.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj443 td/osd-backfill-space/datafile 2020-09-08T16:25:10.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:10.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj443 td/osd-backfill-space/datafile 2020-09-08T16:25:10.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:10.641 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:10.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:10.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj444 td/osd-backfill-space/datafile 2020-09-08T16:25:10.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:10.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj444 td/osd-backfill-space/datafile 2020-09-08T16:25:10.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:10.791 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:10.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:10.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj445 td/osd-backfill-space/datafile 2020-09-08T16:25:10.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:10.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj445 td/osd-backfill-space/datafile 2020-09-08T16:25:10.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:10.942 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:10.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:10.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj446 td/osd-backfill-space/datafile 2020-09-08T16:25:11.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:11.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj446 td/osd-backfill-space/datafile 2020-09-08T16:25:11.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:11.139 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:11.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:11.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj447 td/osd-backfill-space/datafile 2020-09-08T16:25:11.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:11.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj447 td/osd-backfill-space/datafile 2020-09-08T16:25:11.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:11.318 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:11.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:11.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj448 td/osd-backfill-space/datafile 2020-09-08T16:25:11.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:11.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj448 td/osd-backfill-space/datafile 2020-09-08T16:25:11.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:11.483 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:11.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:11.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj449 td/osd-backfill-space/datafile 2020-09-08T16:25:11.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:11.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj449 td/osd-backfill-space/datafile 2020-09-08T16:25:11.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:11.619 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:11.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:11.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj450 td/osd-backfill-space/datafile 2020-09-08T16:25:11.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:11.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj450 td/osd-backfill-space/datafile 2020-09-08T16:25:11.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:11.778 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:11.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:11.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj451 td/osd-backfill-space/datafile 2020-09-08T16:25:11.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:11.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj451 td/osd-backfill-space/datafile 2020-09-08T16:25:11.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:11.937 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:11.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:11.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj452 td/osd-backfill-space/datafile 2020-09-08T16:25:12.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:12.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj452 td/osd-backfill-space/datafile 2020-09-08T16:25:12.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:12.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:12.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:12.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj453 td/osd-backfill-space/datafile 2020-09-08T16:25:12.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:12.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj453 td/osd-backfill-space/datafile 2020-09-08T16:25:12.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:12.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:12.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:12.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj454 td/osd-backfill-space/datafile 2020-09-08T16:25:12.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:12.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj454 td/osd-backfill-space/datafile 2020-09-08T16:25:12.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:12.422 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:12.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:12.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj455 td/osd-backfill-space/datafile 2020-09-08T16:25:12.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:12.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj455 td/osd-backfill-space/datafile 2020-09-08T16:25:12.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:12.573 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:12.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:12.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj456 td/osd-backfill-space/datafile 2020-09-08T16:25:12.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:12.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj456 td/osd-backfill-space/datafile 2020-09-08T16:25:12.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:12.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:12.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:12.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj457 td/osd-backfill-space/datafile 2020-09-08T16:25:12.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:12.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj457 td/osd-backfill-space/datafile 2020-09-08T16:25:12.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:12.874 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:12.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:12.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj458 td/osd-backfill-space/datafile 2020-09-08T16:25:12.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:12.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj458 td/osd-backfill-space/datafile 2020-09-08T16:25:13.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:13.066 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:13.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:13.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj459 td/osd-backfill-space/datafile 2020-09-08T16:25:13.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:13.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj459 td/osd-backfill-space/datafile 2020-09-08T16:25:13.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:13.251 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:13.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:13.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj460 td/osd-backfill-space/datafile 2020-09-08T16:25:13.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:13.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj460 td/osd-backfill-space/datafile 2020-09-08T16:25:13.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:13.409 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:13.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:13.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj461 td/osd-backfill-space/datafile 2020-09-08T16:25:13.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:13.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj461 td/osd-backfill-space/datafile 2020-09-08T16:25:13.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:13.610 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:13.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:13.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj462 td/osd-backfill-space/datafile 2020-09-08T16:25:13.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:13.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj462 td/osd-backfill-space/datafile 2020-09-08T16:25:13.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:13.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:13.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:13.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj463 td/osd-backfill-space/datafile 2020-09-08T16:25:13.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:13.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj463 td/osd-backfill-space/datafile 2020-09-08T16:25:13.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:13.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:13.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:13.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj464 td/osd-backfill-space/datafile 2020-09-08T16:25:13.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:13.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj464 td/osd-backfill-space/datafile 2020-09-08T16:25:14.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:14.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:14.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:14.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj465 td/osd-backfill-space/datafile 2020-09-08T16:25:14.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:14.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj465 td/osd-backfill-space/datafile 2020-09-08T16:25:14.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:14.213 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:14.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:14.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj466 td/osd-backfill-space/datafile 2020-09-08T16:25:14.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:14.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj466 td/osd-backfill-space/datafile 2020-09-08T16:25:14.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:14.363 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:14.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:14.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj467 td/osd-backfill-space/datafile 2020-09-08T16:25:14.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:14.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj467 td/osd-backfill-space/datafile 2020-09-08T16:25:14.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:14.522 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:14.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:14.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj468 td/osd-backfill-space/datafile 2020-09-08T16:25:14.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:14.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj468 td/osd-backfill-space/datafile 2020-09-08T16:25:14.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:14.672 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:14.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:14.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj469 td/osd-backfill-space/datafile 2020-09-08T16:25:14.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:14.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj469 td/osd-backfill-space/datafile 2020-09-08T16:25:14.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:14.823 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:14.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:14.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj470 td/osd-backfill-space/datafile 2020-09-08T16:25:14.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:14.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj470 td/osd-backfill-space/datafile 2020-09-08T16:25:14.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:14.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:14.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:14.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj471 td/osd-backfill-space/datafile 2020-09-08T16:25:15.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:15.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj471 td/osd-backfill-space/datafile 2020-09-08T16:25:15.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:15.200 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:15.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:15.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj472 td/osd-backfill-space/datafile 2020-09-08T16:25:15.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:15.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj472 td/osd-backfill-space/datafile 2020-09-08T16:25:15.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:15.375 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:15.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:15.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj473 td/osd-backfill-space/datafile 2020-09-08T16:25:15.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:15.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj473 td/osd-backfill-space/datafile 2020-09-08T16:25:15.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:15.542 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:15.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:15.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj474 td/osd-backfill-space/datafile 2020-09-08T16:25:15.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:15.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj474 td/osd-backfill-space/datafile 2020-09-08T16:25:15.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:15.693 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:15.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:15.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj475 td/osd-backfill-space/datafile 2020-09-08T16:25:15.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:15.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj475 td/osd-backfill-space/datafile 2020-09-08T16:25:15.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:15.844 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:15.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:15.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj476 td/osd-backfill-space/datafile 2020-09-08T16:25:15.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:15.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj476 td/osd-backfill-space/datafile 2020-09-08T16:25:15.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:15.994 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:15.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:15.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj477 td/osd-backfill-space/datafile 2020-09-08T16:25:16.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:16.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj477 td/osd-backfill-space/datafile 2020-09-08T16:25:16.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:16.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:16.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:16.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj478 td/osd-backfill-space/datafile 2020-09-08T16:25:16.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:16.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj478 td/osd-backfill-space/datafile 2020-09-08T16:25:16.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:16.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:16.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:16.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj479 td/osd-backfill-space/datafile 2020-09-08T16:25:16.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:16.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj479 td/osd-backfill-space/datafile 2020-09-08T16:25:16.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:16.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:16.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:16.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj480 td/osd-backfill-space/datafile 2020-09-08T16:25:16.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:16.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj480 td/osd-backfill-space/datafile 2020-09-08T16:25:16.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:16.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:16.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:16.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj481 td/osd-backfill-space/datafile 2020-09-08T16:25:16.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:16.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj481 td/osd-backfill-space/datafile 2020-09-08T16:25:16.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:16.764 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:16.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:16.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj482 td/osd-backfill-space/datafile 2020-09-08T16:25:16.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:16.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj482 td/osd-backfill-space/datafile 2020-09-08T16:25:16.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:16.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:16.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:16.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj483 td/osd-backfill-space/datafile 2020-09-08T16:25:16.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:16.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj483 td/osd-backfill-space/datafile 2020-09-08T16:25:17.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:17.109 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:17.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:17.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj484 td/osd-backfill-space/datafile 2020-09-08T16:25:17.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:17.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj484 td/osd-backfill-space/datafile 2020-09-08T16:25:17.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:17.295 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:17.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:17.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj485 td/osd-backfill-space/datafile 2020-09-08T16:25:17.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:17.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj485 td/osd-backfill-space/datafile 2020-09-08T16:25:17.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:17.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:17.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:17.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj486 td/osd-backfill-space/datafile 2020-09-08T16:25:17.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:17.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj486 td/osd-backfill-space/datafile 2020-09-08T16:25:17.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:17.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:17.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:17.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj487 td/osd-backfill-space/datafile 2020-09-08T16:25:17.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:17.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj487 td/osd-backfill-space/datafile 2020-09-08T16:25:17.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:17.751 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:17.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:17.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj488 td/osd-backfill-space/datafile 2020-09-08T16:25:17.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:17.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj488 td/osd-backfill-space/datafile 2020-09-08T16:25:17.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:17.918 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:17.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:17.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj489 td/osd-backfill-space/datafile 2020-09-08T16:25:17.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:17.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj489 td/osd-backfill-space/datafile 2020-09-08T16:25:18.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:18.077 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:18.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:18.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj490 td/osd-backfill-space/datafile 2020-09-08T16:25:18.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:18.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj490 td/osd-backfill-space/datafile 2020-09-08T16:25:18.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:18.239 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:18.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:18.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj491 td/osd-backfill-space/datafile 2020-09-08T16:25:18.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:18.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj491 td/osd-backfill-space/datafile 2020-09-08T16:25:18.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:18.387 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:18.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:18.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj492 td/osd-backfill-space/datafile 2020-09-08T16:25:18.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:18.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj492 td/osd-backfill-space/datafile 2020-09-08T16:25:18.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:18.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:18.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:18.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj493 td/osd-backfill-space/datafile 2020-09-08T16:25:18.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:18.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj493 td/osd-backfill-space/datafile 2020-09-08T16:25:18.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:18.696 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:18.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:18.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj494 td/osd-backfill-space/datafile 2020-09-08T16:25:18.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:18.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj494 td/osd-backfill-space/datafile 2020-09-08T16:25:18.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:18.855 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:18.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:18.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj495 td/osd-backfill-space/datafile 2020-09-08T16:25:18.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:18.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj495 td/osd-backfill-space/datafile 2020-09-08T16:25:19.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:19.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:19.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:19.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj496 td/osd-backfill-space/datafile 2020-09-08T16:25:19.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:19.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj496 td/osd-backfill-space/datafile 2020-09-08T16:25:19.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:19.181 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:19.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:19.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj497 td/osd-backfill-space/datafile 2020-09-08T16:25:19.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:19.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj497 td/osd-backfill-space/datafile 2020-09-08T16:25:19.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:19.357 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:19.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:19.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj498 td/osd-backfill-space/datafile 2020-09-08T16:25:19.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:19.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj498 td/osd-backfill-space/datafile 2020-09-08T16:25:19.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:19.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:19.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:19.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj499 td/osd-backfill-space/datafile 2020-09-08T16:25:19.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:19.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj499 td/osd-backfill-space/datafile 2020-09-08T16:25:19.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:19.675 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:19.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:19.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj500 td/osd-backfill-space/datafile 2020-09-08T16:25:19.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:19.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj500 td/osd-backfill-space/datafile 2020-09-08T16:25:19.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:19.825 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:19.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:19.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj501 td/osd-backfill-space/datafile 2020-09-08T16:25:19.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:19.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj501 td/osd-backfill-space/datafile 2020-09-08T16:25:19.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:19.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:19.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:19.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj502 td/osd-backfill-space/datafile 2020-09-08T16:25:20.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:20.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj502 td/osd-backfill-space/datafile 2020-09-08T16:25:20.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:20.152 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:20.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:20.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj503 td/osd-backfill-space/datafile 2020-09-08T16:25:20.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:20.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj503 td/osd-backfill-space/datafile 2020-09-08T16:25:20.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:20.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:20.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:20.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj504 td/osd-backfill-space/datafile 2020-09-08T16:25:20.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:20.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj504 td/osd-backfill-space/datafile 2020-09-08T16:25:20.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:20.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:20.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:20.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj505 td/osd-backfill-space/datafile 2020-09-08T16:25:20.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:20.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj505 td/osd-backfill-space/datafile 2020-09-08T16:25:20.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:20.645 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:20.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:20.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj506 td/osd-backfill-space/datafile 2020-09-08T16:25:20.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:20.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj506 td/osd-backfill-space/datafile 2020-09-08T16:25:20.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:20.795 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:20.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:20.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj507 td/osd-backfill-space/datafile 2020-09-08T16:25:20.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:20.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj507 td/osd-backfill-space/datafile 2020-09-08T16:25:20.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:20.946 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:20.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:20.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj508 td/osd-backfill-space/datafile 2020-09-08T16:25:21.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:21.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj508 td/osd-backfill-space/datafile 2020-09-08T16:25:21.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:21.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:21.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:21.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj509 td/osd-backfill-space/datafile 2020-09-08T16:25:21.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:21.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj509 td/osd-backfill-space/datafile 2020-09-08T16:25:21.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:21.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:21.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:21.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj510 td/osd-backfill-space/datafile 2020-09-08T16:25:21.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:21.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj510 td/osd-backfill-space/datafile 2020-09-08T16:25:21.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:21.448 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:21.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:21.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj511 td/osd-backfill-space/datafile 2020-09-08T16:25:21.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:21.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj511 td/osd-backfill-space/datafile 2020-09-08T16:25:21.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:21.599 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:21.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:21.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj512 td/osd-backfill-space/datafile 2020-09-08T16:25:21.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:21.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj512 td/osd-backfill-space/datafile 2020-09-08T16:25:21.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:21.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:21.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:21.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj513 td/osd-backfill-space/datafile 2020-09-08T16:25:21.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:21.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj513 td/osd-backfill-space/datafile 2020-09-08T16:25:21.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:21.908 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:21.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:21.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj514 td/osd-backfill-space/datafile 2020-09-08T16:25:21.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:21.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj514 td/osd-backfill-space/datafile 2020-09-08T16:25:22.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:22.059 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:22.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:22.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj515 td/osd-backfill-space/datafile 2020-09-08T16:25:22.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:22.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj515 td/osd-backfill-space/datafile 2020-09-08T16:25:22.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:22.218 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:22.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:22.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj516 td/osd-backfill-space/datafile 2020-09-08T16:25:22.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:22.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj516 td/osd-backfill-space/datafile 2020-09-08T16:25:22.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:22.377 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:22.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:22.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj517 td/osd-backfill-space/datafile 2020-09-08T16:25:22.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:22.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj517 td/osd-backfill-space/datafile 2020-09-08T16:25:22.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:22.527 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:22.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:22.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj518 td/osd-backfill-space/datafile 2020-09-08T16:25:22.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:22.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj518 td/osd-backfill-space/datafile 2020-09-08T16:25:22.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:22.686 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:22.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:22.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj519 td/osd-backfill-space/datafile 2020-09-08T16:25:22.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:22.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj519 td/osd-backfill-space/datafile 2020-09-08T16:25:22.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:22.837 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:22.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:22.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj520 td/osd-backfill-space/datafile 2020-09-08T16:25:22.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:22.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj520 td/osd-backfill-space/datafile 2020-09-08T16:25:22.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:22.987 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:22.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:22.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj521 td/osd-backfill-space/datafile 2020-09-08T16:25:23.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:23.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj521 td/osd-backfill-space/datafile 2020-09-08T16:25:23.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:23.188 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:23.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:23.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj522 td/osd-backfill-space/datafile 2020-09-08T16:25:23.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:23.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj522 td/osd-backfill-space/datafile 2020-09-08T16:25:23.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:23.364 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:23.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:23.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj523 td/osd-backfill-space/datafile 2020-09-08T16:25:23.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:23.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj523 td/osd-backfill-space/datafile 2020-09-08T16:25:23.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:23.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:23.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:23.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj524 td/osd-backfill-space/datafile 2020-09-08T16:25:23.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:23.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj524 td/osd-backfill-space/datafile 2020-09-08T16:25:23.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:23.666 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:23.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:23.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj525 td/osd-backfill-space/datafile 2020-09-08T16:25:23.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:23.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj525 td/osd-backfill-space/datafile 2020-09-08T16:25:23.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:23.815 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:23.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:23.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj526 td/osd-backfill-space/datafile 2020-09-08T16:25:23.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:23.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj526 td/osd-backfill-space/datafile 2020-09-08T16:25:23.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:23.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:23.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:23.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj527 td/osd-backfill-space/datafile 2020-09-08T16:25:24.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:24.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj527 td/osd-backfill-space/datafile 2020-09-08T16:25:24.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:24.117 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:24.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:24.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj528 td/osd-backfill-space/datafile 2020-09-08T16:25:24.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:24.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj528 td/osd-backfill-space/datafile 2020-09-08T16:25:24.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:24.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:24.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:24.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj529 td/osd-backfill-space/datafile 2020-09-08T16:25:24.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:24.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj529 td/osd-backfill-space/datafile 2020-09-08T16:25:24.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:24.434 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:24.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:24.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj530 td/osd-backfill-space/datafile 2020-09-08T16:25:24.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:24.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj530 td/osd-backfill-space/datafile 2020-09-08T16:25:24.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:24.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:24.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:24.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj531 td/osd-backfill-space/datafile 2020-09-08T16:25:24.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:24.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj531 td/osd-backfill-space/datafile 2020-09-08T16:25:24.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:24.760 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:24.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:24.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj532 td/osd-backfill-space/datafile 2020-09-08T16:25:24.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:24.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj532 td/osd-backfill-space/datafile 2020-09-08T16:25:24.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:24.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:24.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:24.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj533 td/osd-backfill-space/datafile 2020-09-08T16:25:24.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:24.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj533 td/osd-backfill-space/datafile 2020-09-08T16:25:25.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:25.104 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:25.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:25.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj534 td/osd-backfill-space/datafile 2020-09-08T16:25:25.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:25.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj534 td/osd-backfill-space/datafile 2020-09-08T16:25:25.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:25.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:25.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:25.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj535 td/osd-backfill-space/datafile 2020-09-08T16:25:25.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:25.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj535 td/osd-backfill-space/datafile 2020-09-08T16:25:25.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:25.480 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:25.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:25.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj536 td/osd-backfill-space/datafile 2020-09-08T16:25:25.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:25.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj536 td/osd-backfill-space/datafile 2020-09-08T16:25:25.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:25.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:25.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:25.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj537 td/osd-backfill-space/datafile 2020-09-08T16:25:25.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:25.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj537 td/osd-backfill-space/datafile 2020-09-08T16:25:25.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:25.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:25.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:25.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj538 td/osd-backfill-space/datafile 2020-09-08T16:25:25.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:25.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj538 td/osd-backfill-space/datafile 2020-09-08T16:25:25.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:25.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:25.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:25.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj539 td/osd-backfill-space/datafile 2020-09-08T16:25:26.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:26.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj539 td/osd-backfill-space/datafile 2020-09-08T16:25:26.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:26.083 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:26.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:26.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj540 td/osd-backfill-space/datafile 2020-09-08T16:25:26.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:26.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj540 td/osd-backfill-space/datafile 2020-09-08T16:25:26.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:26.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:26.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:26.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj541 td/osd-backfill-space/datafile 2020-09-08T16:25:26.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:26.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj541 td/osd-backfill-space/datafile 2020-09-08T16:25:26.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:26.408 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:26.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:26.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj542 td/osd-backfill-space/datafile 2020-09-08T16:25:26.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:26.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj542 td/osd-backfill-space/datafile 2020-09-08T16:25:26.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:26.559 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:26.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:26.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj543 td/osd-backfill-space/datafile 2020-09-08T16:25:26.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:26.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj543 td/osd-backfill-space/datafile 2020-09-08T16:25:26.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:26.709 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:26.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:26.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj544 td/osd-backfill-space/datafile 2020-09-08T16:25:26.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:26.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj544 td/osd-backfill-space/datafile 2020-09-08T16:25:26.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:26.860 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:26.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:26.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj545 td/osd-backfill-space/datafile 2020-09-08T16:25:26.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:26.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj545 td/osd-backfill-space/datafile 2020-09-08T16:25:27.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:27.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:27.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:27.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj546 td/osd-backfill-space/datafile 2020-09-08T16:25:27.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:27.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj546 td/osd-backfill-space/datafile 2020-09-08T16:25:27.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:27.186 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:27.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:27.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj547 td/osd-backfill-space/datafile 2020-09-08T16:25:27.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:27.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj547 td/osd-backfill-space/datafile 2020-09-08T16:25:27.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:27.647 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:27.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:27.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj548 td/osd-backfill-space/datafile 2020-09-08T16:25:27.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:27.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj548 td/osd-backfill-space/datafile 2020-09-08T16:25:27.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:27.651 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:27.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:27.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj549 td/osd-backfill-space/datafile 2020-09-08T16:25:27.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:27.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj549 td/osd-backfill-space/datafile 2020-09-08T16:25:27.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:27.689 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:27.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:27.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj550 td/osd-backfill-space/datafile 2020-09-08T16:25:27.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:27.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj550 td/osd-backfill-space/datafile 2020-09-08T16:25:27.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:27.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:27.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:27.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj551 td/osd-backfill-space/datafile 2020-09-08T16:25:27.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:27.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj551 td/osd-backfill-space/datafile 2020-09-08T16:25:27.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:27.998 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:27.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:27.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj552 td/osd-backfill-space/datafile 2020-09-08T16:25:28.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:28.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj552 td/osd-backfill-space/datafile 2020-09-08T16:25:28.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:28.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:28.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:28.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj553 td/osd-backfill-space/datafile 2020-09-08T16:25:28.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:28.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj553 td/osd-backfill-space/datafile 2020-09-08T16:25:28.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:28.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:28.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:28.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj554 td/osd-backfill-space/datafile 2020-09-08T16:25:28.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:28.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj554 td/osd-backfill-space/datafile 2020-09-08T16:25:28.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:28.457 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:28.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:28.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj555 td/osd-backfill-space/datafile 2020-09-08T16:25:28.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:28.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj555 td/osd-backfill-space/datafile 2020-09-08T16:25:28.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:28.608 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:28.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:28.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj556 td/osd-backfill-space/datafile 2020-09-08T16:25:28.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:28.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj556 td/osd-backfill-space/datafile 2020-09-08T16:25:28.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:28.762 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:28.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:28.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj557 td/osd-backfill-space/datafile 2020-09-08T16:25:29.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:29.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj557 td/osd-backfill-space/datafile 2020-09-08T16:25:29.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:29.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:29.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:29.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj558 td/osd-backfill-space/datafile 2020-09-08T16:25:29.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:29.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj558 td/osd-backfill-space/datafile 2020-09-08T16:25:29.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:29.544 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:29.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:29.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj559 td/osd-backfill-space/datafile 2020-09-08T16:25:29.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:29.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj559 td/osd-backfill-space/datafile 2020-09-08T16:25:29.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:29.706 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:29.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:29.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj560 td/osd-backfill-space/datafile 2020-09-08T16:25:29.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:29.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj560 td/osd-backfill-space/datafile 2020-09-08T16:25:29.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:29.870 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:29.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:29.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj561 td/osd-backfill-space/datafile 2020-09-08T16:25:29.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:29.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj561 td/osd-backfill-space/datafile 2020-09-08T16:25:30.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:30.020 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:30.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:30.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj562 td/osd-backfill-space/datafile 2020-09-08T16:25:30.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:30.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj562 td/osd-backfill-space/datafile 2020-09-08T16:25:30.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:30.194 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:30.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:30.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj563 td/osd-backfill-space/datafile 2020-09-08T16:25:30.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:30.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj563 td/osd-backfill-space/datafile 2020-09-08T16:25:30.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:30.380 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:30.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:30.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj564 td/osd-backfill-space/datafile 2020-09-08T16:25:30.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:30.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj564 td/osd-backfill-space/datafile 2020-09-08T16:25:30.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:30.531 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:30.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:30.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj565 td/osd-backfill-space/datafile 2020-09-08T16:25:30.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:30.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj565 td/osd-backfill-space/datafile 2020-09-08T16:25:30.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:30.683 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:30.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:30.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj566 td/osd-backfill-space/datafile 2020-09-08T16:25:30.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:30.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj566 td/osd-backfill-space/datafile 2020-09-08T16:25:30.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:30.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:30.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:30.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj567 td/osd-backfill-space/datafile 2020-09-08T16:25:30.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:30.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj567 td/osd-backfill-space/datafile 2020-09-08T16:25:30.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:30.983 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:30.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:30.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj568 td/osd-backfill-space/datafile 2020-09-08T16:25:31.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:31.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj568 td/osd-backfill-space/datafile 2020-09-08T16:25:31.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:31.191 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:31.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:31.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj569 td/osd-backfill-space/datafile 2020-09-08T16:25:31.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:31.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj569 td/osd-backfill-space/datafile 2020-09-08T16:25:31.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:31.375 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:31.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:31.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj570 td/osd-backfill-space/datafile 2020-09-08T16:25:31.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:31.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj570 td/osd-backfill-space/datafile 2020-09-08T16:25:31.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:31.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:31.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:31.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj571 td/osd-backfill-space/datafile 2020-09-08T16:25:31.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:31.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj571 td/osd-backfill-space/datafile 2020-09-08T16:25:31.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:31.693 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:31.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:31.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj572 td/osd-backfill-space/datafile 2020-09-08T16:25:31.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:31.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj572 td/osd-backfill-space/datafile 2020-09-08T16:25:31.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:31.844 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:31.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:31.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj573 td/osd-backfill-space/datafile 2020-09-08T16:25:31.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:31.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj573 td/osd-backfill-space/datafile 2020-09-08T16:25:31.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:31.994 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:31.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:31.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj574 td/osd-backfill-space/datafile 2020-09-08T16:25:32.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:32.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj574 td/osd-backfill-space/datafile 2020-09-08T16:25:32.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:32.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:32.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:32.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj575 td/osd-backfill-space/datafile 2020-09-08T16:25:32.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:32.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj575 td/osd-backfill-space/datafile 2020-09-08T16:25:32.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:32.306 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:32.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:32.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj576 td/osd-backfill-space/datafile 2020-09-08T16:25:32.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:32.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj576 td/osd-backfill-space/datafile 2020-09-08T16:25:32.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:32.471 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:32.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:32.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj577 td/osd-backfill-space/datafile 2020-09-08T16:25:32.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:32.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj577 td/osd-backfill-space/datafile 2020-09-08T16:25:32.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:32.622 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:32.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:32.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj578 td/osd-backfill-space/datafile 2020-09-08T16:25:32.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:32.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj578 td/osd-backfill-space/datafile 2020-09-08T16:25:32.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:32.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:32.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:32.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj579 td/osd-backfill-space/datafile 2020-09-08T16:25:32.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:32.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj579 td/osd-backfill-space/datafile 2020-09-08T16:25:32.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:32.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:32.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:32.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj580 td/osd-backfill-space/datafile 2020-09-08T16:25:33.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:33.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj580 td/osd-backfill-space/datafile 2020-09-08T16:25:33.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:33.132 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:33.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:33.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj581 td/osd-backfill-space/datafile 2020-09-08T16:25:33.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:33.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj581 td/osd-backfill-space/datafile 2020-09-08T16:25:33.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:33.308 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:33.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:33.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj582 td/osd-backfill-space/datafile 2020-09-08T16:25:33.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:33.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj582 td/osd-backfill-space/datafile 2020-09-08T16:25:33.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:33.473 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:33.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:33.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj583 td/osd-backfill-space/datafile 2020-09-08T16:25:33.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:33.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj583 td/osd-backfill-space/datafile 2020-09-08T16:25:33.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:33.625 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:33.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:33.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj584 td/osd-backfill-space/datafile 2020-09-08T16:25:33.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:33.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj584 td/osd-backfill-space/datafile 2020-09-08T16:25:33.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:33.776 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:33.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:33.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj585 td/osd-backfill-space/datafile 2020-09-08T16:25:33.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:33.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj585 td/osd-backfill-space/datafile 2020-09-08T16:25:33.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:33.927 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:33.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:33.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj586 td/osd-backfill-space/datafile 2020-09-08T16:25:34.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:34.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj586 td/osd-backfill-space/datafile 2020-09-08T16:25:34.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:34.077 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:34.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:34.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj587 td/osd-backfill-space/datafile 2020-09-08T16:25:34.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:34.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj587 td/osd-backfill-space/datafile 2020-09-08T16:25:34.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:34.228 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:34.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:34.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj588 td/osd-backfill-space/datafile 2020-09-08T16:25:34.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:34.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj588 td/osd-backfill-space/datafile 2020-09-08T16:25:34.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:34.378 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:34.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:34.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj589 td/osd-backfill-space/datafile 2020-09-08T16:25:34.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:34.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj589 td/osd-backfill-space/datafile 2020-09-08T16:25:34.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:34.562 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:34.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:34.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj590 td/osd-backfill-space/datafile 2020-09-08T16:25:34.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:34.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj590 td/osd-backfill-space/datafile 2020-09-08T16:25:34.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:34.730 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:34.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:34.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj591 td/osd-backfill-space/datafile 2020-09-08T16:25:34.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:34.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj591 td/osd-backfill-space/datafile 2020-09-08T16:25:34.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:34.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:34.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:34.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj592 td/osd-backfill-space/datafile 2020-09-08T16:25:34.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:34.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj592 td/osd-backfill-space/datafile 2020-09-08T16:25:35.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:35.039 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:35.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:35.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj593 td/osd-backfill-space/datafile 2020-09-08T16:25:35.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:35.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj593 td/osd-backfill-space/datafile 2020-09-08T16:25:35.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:35.198 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:35.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:35.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj594 td/osd-backfill-space/datafile 2020-09-08T16:25:35.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:35.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj594 td/osd-backfill-space/datafile 2020-09-08T16:25:35.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:35.390 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:35.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:35.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj595 td/osd-backfill-space/datafile 2020-09-08T16:25:35.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:35.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj595 td/osd-backfill-space/datafile 2020-09-08T16:25:35.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:35.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:35.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:35.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj596 td/osd-backfill-space/datafile 2020-09-08T16:25:35.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:35.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj596 td/osd-backfill-space/datafile 2020-09-08T16:25:35.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:35.708 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:35.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:35.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj597 td/osd-backfill-space/datafile 2020-09-08T16:25:35.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:35.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj597 td/osd-backfill-space/datafile 2020-09-08T16:25:35.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:35.859 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:35.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:35.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj598 td/osd-backfill-space/datafile 2020-09-08T16:25:35.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:35.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj598 td/osd-backfill-space/datafile 2020-09-08T16:25:36.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:36.009 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:36.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:36.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj599 td/osd-backfill-space/datafile 2020-09-08T16:25:36.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:36.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj599 td/osd-backfill-space/datafile 2020-09-08T16:25:36.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:136: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2020-09-08T16:25:36.161 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:36.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:36.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test1 put obj600 td/osd-backfill-space/datafile 2020-09-08T16:25:36.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:138: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:36.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:140: TEST_backfill_test_simple: rados -p test2 put obj600 td/osd-backfill-space/datafile 2020-09-08T16:25:36.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:144: TEST_backfill_test_simple: ceph pg dump pgs 2020-09-08T16:25:36.702 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T16:25:36.702 INFO:tasks.workunit.client.0.smithi065.stdout:2.0 581 0 0 0 0 2379776 0 0 81 81 active+clean 2020-09-08T16:23:53.497010+0000 28'581 28:593 [2] 2 [2] 2 0'0 2020-09-08T16:23:51.317904+0000 0'0 2020-09-08T16:23:51.317904+0000 0 2020-09-08T16:25:36.702 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 565 0 0 0 0 2314240 0 0 65 65 active+clean 2020-09-08T16:23:51.121167+0000 28'565 28:587 [1] 1 [1] 1 0'0 2020-09-08T16:23:48.895024+0000 0'0 2020-09-08T16:23:48.895024+0000 0 2020-09-08T16:25:36.703 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T16:25:36.703 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T16:25:36.703 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:25:36.710 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:146: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:25:36.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:146: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:36.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:148: TEST_backfill_test_simple: ceph osd pool set test1 size 2 2020-09-08T16:25:37.430 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 2 2020-09-08T16:25:37.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:146: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2020-09-08T16:25:37.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:148: TEST_backfill_test_simple: ceph osd pool set test2 size 2 2020-09-08T16:25:38.136 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 2 size to 2 2020-09-08T16:25:38.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:150: TEST_backfill_test_simple: sleep 30 2020-09-08T16:26:08.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:152: TEST_backfill_test_simple: wait_for_not_backfilling 240 2020-09-08T16:26:08.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:82: wait_for_not_backfilling: local timeout=240 2020-09-08T16:26:08.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:83: wait_for_not_backfilling: wait_for_not_state backfilling 240 2020-09-08T16:26:08.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:53: wait_for_not_state: local state=backfilling 2020-09-08T16:26:08.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:54: wait_for_not_state: local num_in_state=-1 2020-09-08T16:26:08.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:55: wait_for_not_state: local cur_in_state 2020-09-08T16:26:08.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: delays=($(get_timeout_delays $2 5)) 2020-09-08T16:26:08.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: get_timeout_delays 240 5 2020-09-08T16:26:08.151 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:26:08.151 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:26:08.152 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:26:08.152 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:26:08.152 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:26:08.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: local -a delays 2020-09-08T16:26:08.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:57: wait_for_not_state: local -i loop=0 2020-09-08T16:26:08.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:59: wait_for_not_state: flush_pg_stats 2020-09-08T16:26:08.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:26:08.295 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:26:08.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:26:08.696 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:26:08.697 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T16:26:08.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:26:08.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:26:08.697 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:26:08.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836516 2020-09-08T16:26:08.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836516 2020-09-08T16:26:08.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836516' 2020-09-08T16:26:08.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:26:08.835 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:26:08.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672994 2020-09-08T16:26:08.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672994 2020-09-08T16:26:08.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836516 1-42949672994' 2020-09-08T16:26:08.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:26:08.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:26:09.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509473 2020-09-08T16:26:09.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509473 2020-09-08T16:26:09.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836516 1-42949672994 2-64424509473' 2020-09-08T16:26:09.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:26:09.106 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836516 2020-09-08T16:26:09.106 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:26:09.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:26:09.107 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836516 2020-09-08T16:26:09.107 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:26:09.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836516 2020-09-08T16:26:09.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836516' 2020-09-08T16:26:09.108 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:26:09.109 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836516 2020-09-08T16:26:09.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836516 -lt 21474836516 2020-09-08T16:26:09.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:26:09.498 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672994 2020-09-08T16:26:09.498 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:26:09.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:26:09.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672994 2020-09-08T16:26:09.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:26:09.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672994 2020-09-08T16:26:09.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672994' 2020-09-08T16:26:09.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:26:09.501 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672994 2020-09-08T16:26:09.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672994 -lt 42949672994 2020-09-08T16:26:09.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:26:09.894 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509473 2020-09-08T16:26:09.894 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:26:09.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:26:09.896 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509473 2020-09-08T16:26:09.896 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:26:09.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509473 2020-09-08T16:26:09.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509473' 2020-09-08T16:26:09.897 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:26:09.897 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509473 2020-09-08T16:26:10.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509471 -lt 64424509473 2020-09-08T16:26:10.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:26:11.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:26:11.325 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:26:11.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509473 -lt 64424509473 2020-09-08T16:26:11.733 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: get_num_pgs 2020-09-08T16:26:11.733 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:26:11.734 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:26:12.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: test 2 == 0 2020-09-08T16:26:12.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:26:12.260 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:26:12.260 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:26:12.260 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:26:12.260 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:26:12.260 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:26:12.261 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:26:12.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=1 2020-09-08T16:26:12.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 1 = 0 2020-09-08T16:26:12.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 1 '!=' -1 2020-09-08T16:26:12.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:68: wait_for_not_state: loop=0 2020-09-08T16:26:12.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:69: wait_for_not_state: num_in_state=1 2020-09-08T16:26:12.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 5 2020-09-08T16:26:17.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:26:17.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:26:17.653 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:26:17.653 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:26:17.653 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:26:17.654 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:26:17.654 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:26:17.654 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:26:18.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=1 2020-09-08T16:26:18.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 1 = 0 2020-09-08T16:26:18.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 1 '!=' 1 2020-09-08T16:26:18.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 1 >= 17 )) 2020-09-08T16:26:18.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 10 2020-09-08T16:26:28.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:26:28.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:26:28.056 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:26:28.056 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:26:28.057 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:26:28.057 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:26:28.057 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:26:28.057 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:26:28.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=1 2020-09-08T16:26:28.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 1 = 0 2020-09-08T16:26:28.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 1 '!=' 1 2020-09-08T16:26:28.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 2 >= 17 )) 2020-09-08T16:26:28.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 15 2020-09-08T16:26:43.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:26:43.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:26:43.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:26:43.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:26:43.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:26:43.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:26:43.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:26:43.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:26:43.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=1 2020-09-08T16:26:43.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 1 = 0 2020-09-08T16:26:43.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 1 '!=' 1 2020-09-08T16:26:43.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 3 >= 17 )) 2020-09-08T16:26:43.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 15 2020-09-08T16:26:58.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:26:58.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:26:58.851 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:26:58.852 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:26:58.852 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:26:58.852 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:26:58.852 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:26:58.852 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:26:59.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=1 2020-09-08T16:26:59.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 1 = 0 2020-09-08T16:26:59.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 1 '!=' 1 2020-09-08T16:26:59.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 4 >= 17 )) 2020-09-08T16:26:59.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 15 2020-09-08T16:27:14.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:27:14.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:27:14.257 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:27:14.257 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:27:14.257 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:27:14.258 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:27:14.258 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:27:14.258 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:27:14.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=1 2020-09-08T16:27:14.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 1 = 0 2020-09-08T16:27:14.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 1 '!=' 1 2020-09-08T16:27:14.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 5 >= 17 )) 2020-09-08T16:27:14.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 15 2020-09-08T16:27:29.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:27:29.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:27:29.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:27:29.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:27:29.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:27:29.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:27:29.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:27:29.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:27:30.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=0 2020-09-08T16:27:30.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 0 = 0 2020-09-08T16:27:30.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: break 2020-09-08T16:27:30.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:77: wait_for_not_state: return 0 2020-09-08T16:27:30.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:153: TEST_backfill_test_simple: wait_for_not_activating 60 2020-09-08T16:27:30.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:88: wait_for_not_activating: local timeout=60 2020-09-08T16:27:30.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:89: wait_for_not_activating: wait_for_not_state activating 60 2020-09-08T16:27:30.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:53: wait_for_not_state: local state=activating 2020-09-08T16:27:30.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:54: wait_for_not_state: local num_in_state=-1 2020-09-08T16:27:30.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:55: wait_for_not_state: local cur_in_state 2020-09-08T16:27:30.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: delays=($(get_timeout_delays $2 5)) 2020-09-08T16:27:30.069 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: get_timeout_delays 60 5 2020-09-08T16:27:30.069 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:27:30.069 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:27:30.069 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:27:30.070 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:27:30.070 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:27:30.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: local -a delays 2020-09-08T16:27:30.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:57: wait_for_not_state: local -i loop=0 2020-09-08T16:27:30.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:59: wait_for_not_state: flush_pg_stats 2020-09-08T16:27:30.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:27:30.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:27:30.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:27:30.484 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:27:30.485 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T16:27:30.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:27:30.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:27:30.485 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:27:30.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836534 2020-09-08T16:27:30.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836534 2020-09-08T16:27:30.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836534' 2020-09-08T16:27:30.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:27:30.624 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:27:30.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949673013 2020-09-08T16:27:30.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949673013 2020-09-08T16:27:30.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836534 1-42949673013' 2020-09-08T16:27:30.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:27:30.756 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:27:30.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509491 2020-09-08T16:27:30.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509491 2020-09-08T16:27:30.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836534 1-42949673013 2-64424509491' 2020-09-08T16:27:30.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:27:30.889 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836534 2020-09-08T16:27:30.889 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:27:30.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:27:30.890 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836534 2020-09-08T16:27:30.890 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:27:30.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836534 2020-09-08T16:27:30.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836534' 2020-09-08T16:27:30.892 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:27:30.892 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836534 2020-09-08T16:27:31.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836534 -lt 21474836534 2020-09-08T16:27:31.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:27:31.288 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949673013 2020-09-08T16:27:31.288 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:27:31.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:27:31.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949673013 2020-09-08T16:27:31.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:27:31.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949673013 2020-09-08T16:27:31.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949673013' 2020-09-08T16:27:31.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:27:31.290 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949673013 2020-09-08T16:27:31.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949673013 -lt 42949673013 2020-09-08T16:27:31.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:27:31.711 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509491 2020-09-08T16:27:31.712 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:27:31.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:27:31.712 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509491 2020-09-08T16:27:31.713 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:27:31.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509491 2020-09-08T16:27:31.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509491' 2020-09-08T16:27:31.714 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:27:31.714 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509491 2020-09-08T16:27:32.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509491 -lt 64424509491 2020-09-08T16:27:32.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: get_num_pgs 2020-09-08T16:27:32.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:27:32.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:27:32.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: test 2 == 0 2020-09-08T16:27:32.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:27:32.702 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state activating 2020-09-08T16:27:32.702 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=activating 2020-09-08T16:27:32.702 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:27:32.702 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("activating"))' 2020-09-08T16:27:32.703 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:27:32.703 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("activating"))] | length' 2020-09-08T16:27:33.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=0 2020-09-08T16:27:33.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 0 = 0 2020-09-08T16:27:33.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: break 2020-09-08T16:27:33.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:77: wait_for_not_state: return 0 2020-09-08T16:27:33.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:155: TEST_backfill_test_simple: ERRORS=0 2020-09-08T16:27:33.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:156: TEST_backfill_test_simple: ceph pg dump pgs 2020-09-08T16:27:33.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:156: TEST_backfill_test_simple: grep +backfill_toofull 2020-09-08T16:27:33.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:156: TEST_backfill_test_simple: wc -l 2020-09-08T16:27:33.457 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:27:33.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:156: TEST_backfill_test_simple: '[' 1 '!=' 1 ']' 2020-09-08T16:27:33.467 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:162: TEST_backfill_test_simple: expr 2 - 1 2020-09-08T16:27:33.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:162: TEST_backfill_test_simple: expected=1 2020-09-08T16:27:33.468 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:163: TEST_backfill_test_simple: ceph pg dump pgs 2020-09-08T16:27:33.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:163: TEST_backfill_test_simple: grep active+clean 2020-09-08T16:27:33.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:163: TEST_backfill_test_simple: wc -l 2020-09-08T16:27:33.852 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:27:33.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:163: TEST_backfill_test_simple: '[' 1 '!=' 1 ']' 2020-09-08T16:27:33.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:169: TEST_backfill_test_simple: ceph pg dump pgs 2020-09-08T16:27:34.241 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T16:27:34.242 INFO:tasks.workunit.client.0.smithi065.stdout:2.0 600 0 600 0 0 2457600 0 0 100 100 active+undersized+degraded+remapped+backfill_toofull 2020-09-08T16:27:11.475677+0000 28'600 36:642 [2,1] 2 [2] 2 0'0 2020-09-08T16:23:51.317904+0000 0'0 2020-09-08T16:23:51.317904+0000 0 2020-09-08T16:27:34.242 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 600 0 0 0 0 2457600 0 0 100 100 active+clean 2020-09-08T16:27:17.149797+0000 28'600 37:1849 [1,0] 1 [1,0] 1 0'0 2020-09-08T16:23:48.895024+0000 0'0 2020-09-08T16:23:48.895024+0000 0 2020-09-08T16:27:34.242 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T16:27:34.243 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T16:27:34.243 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:27:34.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:171: TEST_backfill_test_simple: '[' 0 '!=' 0 ']' 2020-09-08T16:27:34.252 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:176: TEST_backfill_test_simple: seq 1 2 2020-09-08T16:27:34.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:176: TEST_backfill_test_simple: for i in $(seq 1 $pools) 2020-09-08T16:27:34.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:178: TEST_backfill_test_simple: delete_pool test1 2020-09-08T16:27:34.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test1 2020-09-08T16:27:34.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2020-09-08T16:27:34.766 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test1' does not exist 2020-09-08T16:27:34.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:176: TEST_backfill_test_simple: for i in $(seq 1 $pools) 2020-09-08T16:27:34.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:178: TEST_backfill_test_simple: delete_pool test2 2020-09-08T16:27:34.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test2 2020-09-08T16:27:34.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test2 test2 --yes-i-really-really-mean-it 2020-09-08T16:27:35.373 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test2' does not exist 2020-09-08T16:27:35.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:180: TEST_backfill_test_simple: kill_daemons td/osd-backfill-space 2020-09-08T16:27:35.382 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:27:35.383 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:27:35.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:27:35.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:27:35.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:27:35.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:27:35.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:181: TEST_backfill_test_simple: grep -q 'num_bytes mismatch' td/osd-backfill-space/osd.0.log td/osd-backfill-space/osd.1.log td/osd-backfill-space/osd.2.log 2020-09-08T16:27:35.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:38: run: teardown td/osd-backfill-space 2020-09-08T16:27:35.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2020-09-08T16:27:35.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:27:35.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2020-09-08T16:27:35.718 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:27:35.719 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:27:35.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:27:35.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:27:35.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:27:35.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:27:35.722 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:27:35.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:27:35.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:27:35.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:27:35.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:27:35.725 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:27:35.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:27:35.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:27:35.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:27:35.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:27:35.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:27:35.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:27:35.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2020-09-08T16:27:35.760 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:27:35.760 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:27:35.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:27:35.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.154687 2020-09-08T16:27:35.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:27:35.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:27:35.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:35: run: for func in $funcs 2020-09-08T16:27:35.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:36: run: setup td/osd-backfill-space 2020-09-08T16:27:35.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-space 2020-09-08T16:27:35.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-space 2020-09-08T16:27:35.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2020-09-08T16:27:35.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:27:35.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2020-09-08T16:27:35.765 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:27:35.765 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:27:35.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:27:35.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:27:35.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:27:35.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:27:35.794 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:27:35.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:27:35.795 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:27:35.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:27:35.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:27:35.797 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:27:35.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:27:35.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:27:35.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:27:35.803 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:27:35.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:27:35.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:27:35.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2020-09-08T16:27:35.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:27:35.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:27:35.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:27:35.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.154687 2020-09-08T16:27:35.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:27:35.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:27:35.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-space 2020-09-08T16:27:35.806 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T16:27:35.806 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:27:35.806 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:27:35.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.154687 2020-09-08T16:27:35.806 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T16:27:35.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T16:27:35.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T16:27:35.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2020-09-08T16:27:35.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:37: run: TEST_ec_backfill_grow td/osd-backfill-space 2020-09-08T16:27:35.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1110: TEST_ec_backfill_grow: local dir=td/osd-backfill-space 2020-09-08T16:27:35.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1111: TEST_ec_backfill_grow: local poolname=test 2020-09-08T16:27:35.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1112: TEST_ec_backfill_grow: local OSDS=6 2020-09-08T16:27:35.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1113: TEST_ec_backfill_grow: local k=3 2020-09-08T16:27:35.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1114: TEST_ec_backfill_grow: local m=2 2020-09-08T16:27:35.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1115: TEST_ec_backfill_grow: expr 600 / 3 2020-09-08T16:27:35.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1115: TEST_ec_backfill_grow: local ecobjects=200 2020-09-08T16:27:35.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1117: TEST_ec_backfill_grow: run_mon td/osd-backfill-space a 2020-09-08T16:27:35.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-space 2020-09-08T16:27:35.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T16:27:35.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T16:27:35.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T16:27:35.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-space/a 2020-09-08T16:27:35.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2020-09-08T16:27:36.076 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T16:27:36.076 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:27:36.077 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:27:36.077 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:27:36.077 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:27:36.077 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:27:36.077 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:27:36.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T16:27:36.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T16:27:36.253 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T16:27:36.253 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:27:36.254 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:27:36.254 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T16:27:36.254 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T16:27:36.254 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:27:36.254 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:27:36.255 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:27:36.255 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:27:36.255 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:27:36.255 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:27:36.255 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.154687/ceph-mon.a.asok 2020-09-08T16:27:36.256 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:27:36.256 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.154687/ceph-mon.a.asok config get fsid 2020-09-08T16:27:36.346 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T16:27:36.346 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:27:36.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:27:36.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T16:27:36.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T16:27:36.347 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:27:36.348 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:27:36.348 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:27:36.348 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:27:36.348 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:27:36.348 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:27:36.349 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.154687/ceph-mon.a.asok 2020-09-08T16:27:36.349 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:27:36.362 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.154687/ceph-mon.a.asok config get mon_host 2020-09-08T16:27:36.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1118: TEST_ec_backfill_grow: run_mgr td/osd-backfill-space x 2020-09-08T16:27:36.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-space 2020-09-08T16:27:36.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T16:27:36.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T16:27:36.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T16:27:36.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-space/x 2020-09-08T16:27:36.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T16:27:37.402 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T16:27:37.403 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:27:37.403 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:27:37.403 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:27:37.403 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:27:37.403 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:27:37.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:27:37.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:27:37.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:27:37.429 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1120: TEST_ec_backfill_grow: expr 6 - 1 2020-09-08T16:27:37.430 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1120: TEST_ec_backfill_grow: seq 0 5 2020-09-08T16:27:37.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1120: TEST_ec_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:27:37.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1122: TEST_ec_backfill_grow: run_osd td/osd-backfill-space 0 2020-09-08T16:27:37.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:27:37.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:27:37.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T16:27:37.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:27:37.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/0 2020-09-08T16:27:37.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:27:37.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:27:37.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:27:37.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:27:37.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2020-09-08T16:27:37.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2020-09-08T16:27:37.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:27:37.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:27:37.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:27:37.437 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:27:37.437 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:27:37.437 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:27:37.437 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:27:37.437 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:27:37.438 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:27:37.438 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:27:37.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:27:37.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:27:37.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:27:37.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:27:37.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:27:37.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:27:37.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:27:37.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:27:37.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:27:37.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:27:37.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:27:37.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/0 2020-09-08T16:27:37.440 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:27:37.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=07416d68-aa9b-498d-ae58-af1c150dc7a5 2020-09-08T16:27:37.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 07416d68-aa9b-498d-ae58-af1c150dc7a5' 2020-09-08T16:27:37.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:27:37.442 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 07416d68-aa9b-498d-ae58-af1c150dc7a5 2020-09-08T16:27:37.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQD5sFdfyDNEGxAAxqC/bRBZ+2Fdx5/kRcYpqA== 2020-09-08T16:27:37.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQD5sFdfyDNEGxAAxqC/bRBZ+2Fdx5/kRcYpqA=="}' 2020-09-08T16:27:37.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 07416d68-aa9b-498d-ae58-af1c150dc7a5 -i td/osd-backfill-space/0/new.json 2020-09-08T16:27:37.807 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:27:37.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/0/new.json 2020-09-08T16:27:37.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQD5sFdfyDNEGxAAxqC/bRBZ+2Fdx5/kRcYpqA== --osd-uuid 07416d68-aa9b-498d-ae58-af1c150dc7a5 2020-09-08T16:27:37.846 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:37.850+0000 7f0018b9dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:27:37.847 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:37.852+0000 7f0018b9dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:27:37.849 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:37.854+0000 7f0018b9dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:27:37.850 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:37.855+0000 7f0018b9dec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T16:27:37.850 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:37.855+0000 7f0018b9dec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T16:27:37.850 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:37.855+0000 7f0018b9dec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T16:27:37.893 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:37.898+0000 7f0018b9dec0 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2020-09-08T16:27:42.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2020-09-08T16:27:42.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:27:42.135 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T16:27:42.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T16:27:42.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:27:42.674 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T16:27:42.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T16:27:42.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:27:42.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:27:42.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:27:42.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:27:42.701 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:42.706+0000 7f4f1f86cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:27:42.718 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:42.721+0000 7f4f1f86cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:27:42.719 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:42.722+0000 7f4f1f86cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:27:43.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T16:27:43.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:27:43.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T16:27:43.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:27:43.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:27:43.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:27:43.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:27:43.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:27:43.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:27:43.073 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:27:43.232 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:43.238+0000 7f4f1f86cec0 -1 Falling back to public interface 2020-09-08T16:27:43.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:27:44.050 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:44.054+0000 7f4f1f86cec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T16:27:44.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:27:44.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:27:44.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:27:44.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:27:44.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:27:44.506 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:27:44.909 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/428875,v1:127.0.0.1:6803/428875] [v2:127.0.0.1:6804/428875,v1:127.0.0.1:6805/428875] exists,up 07416d68-aa9b-498d-ae58-af1c150dc7a5 2020-09-08T16:27:44.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:27:44.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:27:44.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:27:44.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1120: TEST_ec_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:27:44.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1122: TEST_ec_backfill_grow: run_osd td/osd-backfill-space 1 2020-09-08T16:27:44.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:27:44.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:27:44.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T16:27:44.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:27:44.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/1 2020-09-08T16:27:44.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:27:44.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:27:44.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:27:44.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:27:44.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2020-09-08T16:27:44.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2020-09-08T16:27:44.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:27:44.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:27:44.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:27:44.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:27:44.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:27:44.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:27:44.931 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:27:44.934 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:27:44.934 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:27:44.934 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:27:44.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:27:44.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:27:44.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:27:44.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:27:44.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:27:44.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:27:44.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:27:44.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:27:44.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:27:44.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:27:44.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:27:44.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/1 2020-09-08T16:27:44.937 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:27:44.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=a90895f3-7c52-49b2-bfac-69186d884343 2020-09-08T16:27:44.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 a90895f3-7c52-49b2-bfac-69186d884343' 2020-09-08T16:27:44.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:27:44.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAAsVdfW1ieNxAA6p1YilAK1/w2mU9D+JMkSQ== 2020-09-08T16:27:44.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAAsVdfW1ieNxAA6p1YilAK1/w2mU9D+JMkSQ=="}' 2020-09-08T16:27:44.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new a90895f3-7c52-49b2-bfac-69186d884343 -i td/osd-backfill-space/1/new.json 2020-09-08T16:27:44.946 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 a90895f3-7c52-49b2-bfac-69186d884343 2020-09-08T16:27:45.422 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:27:45.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/1/new.json 2020-09-08T16:27:45.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAAsVdfW1ieNxAA6p1YilAK1/w2mU9D+JMkSQ== --osd-uuid a90895f3-7c52-49b2-bfac-69186d884343 2020-09-08T16:27:45.462 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:45.465+0000 7f799bcf5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:27:45.463 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:45.467+0000 7f799bcf5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:27:45.464 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:45.468+0000 7f799bcf5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:27:45.466 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:45.469+0000 7f799bcf5ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T16:27:45.467 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:45.469+0000 7f799bcf5ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T16:27:45.467 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:45.469+0000 7f799bcf5ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T16:27:45.518 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:45.519+0000 7f799bcf5ec0 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2020-09-08T16:27:49.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2020-09-08T16:27:50.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:27:50.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T16:27:50.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:27:50.138 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T16:27:50.232 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T16:27:50.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T16:27:50.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:27:50.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:27:50.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:27:50.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:27:50.258 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:50.263+0000 7fb126673ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:27:50.280 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:50.284+0000 7fb126673ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:27:50.281 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:50.286+0000 7fb126673ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:27:50.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T16:27:50.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:27:50.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T16:27:50.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:27:50.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:27:50.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:27:50.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:27:50.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:27:50.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:27:50.629 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:27:50.796 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:50.802+0000 7fb126673ec0 -1 Falling back to public interface 2020-09-08T16:27:51.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:27:51.656 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:51.661+0000 7fb126673ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T16:27:52.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:27:52.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:27:52.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:27:52.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:27:52.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:27:52.036 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:27:52.439 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/429877,v1:127.0.0.1:6811/429877] [v2:127.0.0.1:6812/429877,v1:127.0.0.1:6813/429877] exists,up a90895f3-7c52-49b2-bfac-69186d884343 2020-09-08T16:27:52.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:27:52.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:27:52.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:27:52.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1120: TEST_ec_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:27:52.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1122: TEST_ec_backfill_grow: run_osd td/osd-backfill-space 2 2020-09-08T16:27:52.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:27:52.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:27:52.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T16:27:52.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:27:52.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/2 2020-09-08T16:27:52.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:27:52.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:27:52.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:27:52.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:27:52.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2020-09-08T16:27:52.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2020-09-08T16:27:52.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:27:52.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:27:52.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:27:52.444 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:27:52.444 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:27:52.444 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:27:52.444 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:27:52.444 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:27:52.445 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:27:52.445 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:27:52.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:27:52.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:27:52.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:27:52.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:27:52.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:27:52.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:27:52.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:27:52.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:27:52.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:27:52.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:27:52.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:27:52.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/2 2020-09-08T16:27:52.448 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:27:52.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=8bb39225-021a-4d18-bfaf-9085f4212ac4 2020-09-08T16:27:52.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 8bb39225-021a-4d18-bfaf-9085f4212ac4' 2020-09-08T16:27:52.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:27:52.450 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 8bb39225-021a-4d18-bfaf-9085f4212ac4 2020-09-08T16:27:52.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAIsVdfJqaQGxAAJBUG0zvDlgy5wAblwRrzkQ== 2020-09-08T16:27:52.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAIsVdfJqaQGxAAJBUG0zvDlgy5wAblwRrzkQ=="}' 2020-09-08T16:27:52.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 8bb39225-021a-4d18-bfaf-9085f4212ac4 -i td/osd-backfill-space/2/new.json 2020-09-08T16:27:53.068 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:27:53.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/2/new.json 2020-09-08T16:27:53.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAIsVdfJqaQGxAAJBUG0zvDlgy5wAblwRrzkQ== --osd-uuid 8bb39225-021a-4d18-bfaf-9085f4212ac4 2020-09-08T16:27:53.107 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:53.112+0000 7f41857b1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:27:53.108 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:53.114+0000 7f41857b1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:27:53.110 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:53.115+0000 7f41857b1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:27:53.110 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:53.116+0000 7f41857b1ec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T16:27:53.111 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:53.116+0000 7f41857b1ec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T16:27:53.111 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:53.116+0000 7f41857b1ec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T16:27:53.189 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:53.192+0000 7f41857b1ec0 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2020-09-08T16:27:57.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2020-09-08T16:27:57.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:27:57.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T16:27:57.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:27:57.455 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T16:27:57.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T16:27:57.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:27:57.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:27:57.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:27:57.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:27:57.988 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T16:27:58.013 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:58.018+0000 7f6f1feeaec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:27:58.028 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:58.033+0000 7f6f1feeaec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:27:58.028 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:58.034+0000 7f6f1feeaec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:27:58.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T16:27:58.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:27:58.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T16:27:58.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:27:58.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:27:58.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:27:58.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:27:58.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:27:58.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:27:58.381 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:27:58.544 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:58.550+0000 7f6f1feeaec0 -1 Falling back to public interface 2020-09-08T16:27:58.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:27:59.386 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:27:59.392+0000 7f6f1feeaec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T16:27:59.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:27:59.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:27:59.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:27:59.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:27:59.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:27:59.783 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:28:00.203 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/430871,v1:127.0.0.1:6819/430871] [v2:127.0.0.1:6820/430871,v1:127.0.0.1:6821/430871] exists,up 8bb39225-021a-4d18-bfaf-9085f4212ac4 2020-09-08T16:28:00.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:28:00.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:28:00.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:28:00.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1120: TEST_ec_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:28:00.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1122: TEST_ec_backfill_grow: run_osd td/osd-backfill-space 3 2020-09-08T16:28:00.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:28:00.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:28:00.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T16:28:00.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:28:00.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/3 2020-09-08T16:28:00.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:28:00.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:28:00.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:28:00.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:28:00.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/3' 2020-09-08T16:28:00.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/3/journal' 2020-09-08T16:28:00.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:28:00.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:28:00.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:28:00.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:28:00.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:28:00.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:28:00.208 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:28:00.208 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:28:00.208 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:28:00.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:28:00.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:28:00.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:28:00.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:28:00.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:28:00.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:28:00.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:28:00.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:28:00.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:28:00.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:28:00.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:28:00.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:28:00.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/3 2020-09-08T16:28:00.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:28:00.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=b6bacd38-b220-4520-aa4e-e9526ac3347a 2020-09-08T16:28:00.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 b6bacd38-b220-4520-aa4e-e9526ac3347a' 2020-09-08T16:28:00.212 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:28:00.213 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 b6bacd38-b220-4520-aa4e-e9526ac3347a 2020-09-08T16:28:00.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAQsVdfEsp+DRAAJM92hyRZKQeRjDpn7huDzQ== 2020-09-08T16:28:00.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAQsVdfEsp+DRAAJM92hyRZKQeRjDpn7huDzQ=="}' 2020-09-08T16:28:00.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new b6bacd38-b220-4520-aa4e-e9526ac3347a -i td/osd-backfill-space/3/new.json 2020-09-08T16:28:00.792 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T16:28:00.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/3/new.json 2020-09-08T16:28:00.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAQsVdfEsp+DRAAJM92hyRZKQeRjDpn7huDzQ== --osd-uuid b6bacd38-b220-4520-aa4e-e9526ac3347a 2020-09-08T16:28:00.832 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:00.837+0000 7f997e689ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:28:00.833 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:00.838+0000 7f997e689ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:28:00.835 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:00.839+0000 7f997e689ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:28:00.835 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:00.840+0000 7f997e689ec0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2020-09-08T16:28:00.835 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:00.840+0000 7f997e689ec0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2020-09-08T16:28:00.836 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:00.840+0000 7f997e689ec0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2020-09-08T16:28:00.869 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:00.874+0000 7f997e689ec0 -1 bluestore(td/osd-backfill-space/3) _read_fsid unparsable uuid 2020-09-08T16:28:05.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/3/keyring 2020-09-08T16:28:05.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:28:05.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T16:28:05.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:28:05.162 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T16:28:05.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T16:28:05.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:28:05.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:28:05.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:28:05.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:28:05.716 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T16:28:05.741 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:05.746+0000 7fc37c6aeec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:28:05.746 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:05.747+0000 7fc37c6aeec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:28:05.746 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:05.749+0000 7fc37c6aeec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:28:06.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T16:28:06.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:28:06.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T16:28:06.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:28:06.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:28:06.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:28:06.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:28:06.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:28:06.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:28:06.130 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:28:06.261 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:06.266+0000 7fc37c6aeec0 -1 Falling back to public interface 2020-09-08T16:28:06.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:28:07.045 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:07.050+0000 7fc37c6aeec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T16:28:07.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:28:07.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:28:07.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:28:07.528 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:28:07.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:28:07.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:28:08.046 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/431865,v1:127.0.0.1:6827/431865] [v2:127.0.0.1:6828/431865,v1:127.0.0.1:6829/431865] exists,up b6bacd38-b220-4520-aa4e-e9526ac3347a 2020-09-08T16:28:08.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:28:08.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:28:08.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:28:08.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1120: TEST_ec_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:28:08.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1122: TEST_ec_backfill_grow: run_osd td/osd-backfill-space 4 2020-09-08T16:28:08.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:28:08.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:28:08.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=4 2020-09-08T16:28:08.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:28:08.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/4 2020-09-08T16:28:08.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:28:08.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:28:08.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:28:08.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:28:08.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/4' 2020-09-08T16:28:08.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/4/journal' 2020-09-08T16:28:08.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:28:08.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:28:08.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:28:08.051 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:28:08.051 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:28:08.051 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:28:08.051 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:28:08.052 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:28:08.052 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:28:08.052 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:28:08.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:28:08.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:28:08.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:28:08.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:28:08.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:28:08.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:28:08.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:28:08.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:28:08.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:28:08.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:28:08.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:28:08.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/4 2020-09-08T16:28:08.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:28:08.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=65f46d46-bc78-43c1-bd11-e18c52e0b968 2020-09-08T16:28:08.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd4 65f46d46-bc78-43c1-bd11-e18c52e0b968' 2020-09-08T16:28:08.057 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:28:08.057 INFO:tasks.workunit.client.0.smithi065.stdout:add osd4 65f46d46-bc78-43c1-bd11-e18c52e0b968 2020-09-08T16:28:08.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAYsVdfv5IvBBAA49354sneiN6n0hKz29O0aA== 2020-09-08T16:28:08.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAYsVdfv5IvBBAA49354sneiN6n0hKz29O0aA=="}' 2020-09-08T16:28:08.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 65f46d46-bc78-43c1-bd11-e18c52e0b968 -i td/osd-backfill-space/4/new.json 2020-09-08T16:28:08.661 INFO:tasks.workunit.client.0.smithi065.stdout:4 2020-09-08T16:28:08.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/4/new.json 2020-09-08T16:28:08.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 4 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAYsVdfv5IvBBAA49354sneiN6n0hKz29O0aA== --osd-uuid 65f46d46-bc78-43c1-bd11-e18c52e0b968 2020-09-08T16:28:08.700 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:08.705+0000 7fbb6cb60ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:28:08.704 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:08.706+0000 7fbb6cb60ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:28:08.705 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:08.708+0000 7fbb6cb60ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:28:08.705 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:08.708+0000 7fbb6cb60ec0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2020-09-08T16:28:08.705 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:08.708+0000 7fbb6cb60ec0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2020-09-08T16:28:08.706 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:08.708+0000 7fbb6cb60ec0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2020-09-08T16:28:08.744 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:08.749+0000 7fbb6cb60ec0 -1 bluestore(td/osd-backfill-space/4) _read_fsid unparsable uuid 2020-09-08T16:28:13.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/4/keyring 2020-09-08T16:28:13.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:28:13.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd4 key to auth repository 2020-09-08T16:28:13.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:28:13.205 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd4 key to auth repository 2020-09-08T16:28:13.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.4 2020-09-08T16:28:13.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 4 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:28:13.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:28:13.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:28:13.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:28:13.751 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.4 2020-09-08T16:28:13.768 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:13.773+0000 7f51eb6a6ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:28:13.769 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:13.775+0000 7f51eb6a6ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:28:13.771 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:13.776+0000 7f51eb6a6ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:28:14.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 4 2020-09-08T16:28:14.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:28:14.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=4 2020-09-08T16:28:14.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:28:14.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:28:14.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:28:14.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:28:14.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:28:14.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:28:14.144 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:28:14.295 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:14.300+0000 7f51eb6a6ec0 -1 Falling back to public interface 2020-09-08T16:28:14.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:28:15.111 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:15.116+0000 7f51eb6a6ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-09-08T16:28:15.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:28:15.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:28:15.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:28:15.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:28:15.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:28:15.556 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:28:15.998 INFO:tasks.workunit.client.0.smithi065.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/432859,v1:127.0.0.1:6835/432859] [v2:127.0.0.1:6836/432859,v1:127.0.0.1:6837/432859] exists,up 65f46d46-bc78-43c1-bd11-e18c52e0b968 2020-09-08T16:28:15.999 INFO:tasks.workunit.client.0.smithi065.stdout:add osd5 6e9a555f-ca5c-4cff-bb7d-279ce08e625b 2020-09-08T16:28:15.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:28:15.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:28:16.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:28:16.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1120: TEST_ec_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:28:16.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1122: TEST_ec_backfill_grow: run_osd td/osd-backfill-space 5 2020-09-08T16:28:16.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:28:16.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:28:16.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=5 2020-09-08T16:28:16.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:28:16.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/5 2020-09-08T16:28:16.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:28:16.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:28:16.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:28:16.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:28:16.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/5' 2020-09-08T16:28:16.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/5/journal' 2020-09-08T16:28:16.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:28:16.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:28:16.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:28:16.012 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:28:16.012 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:28:16.013 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:28:16.013 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:28:16.013 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:28:16.014 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:28:16.014 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:28:16.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:28:16.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:28:16.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:28:16.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:28:16.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:28:16.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:28:16.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:28:16.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:28:16.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:28:16.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:28:16.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:28:16.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/5 2020-09-08T16:28:16.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:28:16.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=6e9a555f-ca5c-4cff-bb7d-279ce08e625b 2020-09-08T16:28:16.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd5 6e9a555f-ca5c-4cff-bb7d-279ce08e625b' 2020-09-08T16:28:16.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:28:16.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAgsVdfpV1BARAALQA1y8Z+fmfysXODK1O3Tg== 2020-09-08T16:28:16.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAgsVdfpV1BARAALQA1y8Z+fmfysXODK1O3Tg=="}' 2020-09-08T16:28:16.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 6e9a555f-ca5c-4cff-bb7d-279ce08e625b -i td/osd-backfill-space/5/new.json 2020-09-08T16:28:16.535 INFO:tasks.workunit.client.0.smithi065.stdout:5 2020-09-08T16:28:16.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/5/new.json 2020-09-08T16:28:16.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 5 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAgsVdfpV1BARAALQA1y8Z+fmfysXODK1O3Tg== --osd-uuid 6e9a555f-ca5c-4cff-bb7d-279ce08e625b 2020-09-08T16:28:16.576 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:16.580+0000 7fe6190c4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:28:16.586 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:16.591+0000 7fe6190c4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:28:16.588 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:16.593+0000 7fe6190c4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:28:16.588 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:16.593+0000 7fe6190c4ec0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2020-09-08T16:28:16.589 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:16.593+0000 7fe6190c4ec0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2020-09-08T16:28:16.589 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:16.593+0000 7fe6190c4ec0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2020-09-08T16:28:16.653 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:16.658+0000 7fe6190c4ec0 -1 bluestore(td/osd-backfill-space/5) _read_fsid unparsable uuid 2020-09-08T16:28:21.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/5/keyring 2020-09-08T16:28:21.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:28:21.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd5 key to auth repository 2020-09-08T16:28:21.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:28:21.203 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd5 key to auth repository 2020-09-08T16:28:21.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.5 2020-09-08T16:28:21.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 5 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:28:21.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:28:21.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:28:21.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:28:21.737 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.5 2020-09-08T16:28:21.761 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:21.766+0000 7f2daf1b1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:28:21.763 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:21.768+0000 7f2daf1b1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:28:21.764 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:21.769+0000 7f2daf1b1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:28:22.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 5 2020-09-08T16:28:22.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:28:22.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=5 2020-09-08T16:28:22.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:28:22.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:28:22.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:28:22.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:28:22.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:28:22.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T16:28:22.152 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:28:22.288 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:22.293+0000 7f2daf1b1ec0 -1 Falling back to public interface 2020-09-08T16:28:22.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:28:23.095 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:28:23.100+0000 7f2daf1b1ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-09-08T16:28:23.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:28:23.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:28:23.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:28:23.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T16:28:23.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:28:23.560 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:28:24.006 INFO:tasks.workunit.client.0.smithi065.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/433853,v1:127.0.0.1:6843/433853] [v2:127.0.0.1:6844/433853,v1:127.0.0.1:6845/433853] exists,up 6e9a555f-ca5c-4cff-bb7d-279ce08e625b 2020-09-08T16:28:24.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:28:24.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:28:24.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:28:24.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1125: TEST_ec_backfill_grow: ceph osd set-backfillfull-ratio .85 2020-09-08T16:28:24.699 INFO:tasks.workunit.client.0.smithi065.stderr:osd set-backfillfull-ratio 0.85 2020-09-08T16:28:24.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1127: TEST_ec_backfill_grow: ceph osd set-require-min-compat-client luminous 2020-09-08T16:28:25.514 INFO:tasks.workunit.client.0.smithi065.stderr:set require_min_compat_client to luminous 2020-09-08T16:28:25.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1128: TEST_ec_backfill_grow: ceph osd erasure-code-profile set ec-profile k=3 m=2 crush-failure-domain=osd technique=reed_sol_van plugin=jerasure 2020-09-08T16:28:26.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1129: TEST_ec_backfill_grow: ceph osd pool create test 1 1 erasure ec-profile 2020-09-08T16:28:26.865 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' already exists 2020-09-08T16:28:26.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1131: TEST_ec_backfill_grow: wait_for_clean 2020-09-08T16:28:26.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:28:26.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:28:26.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:28:26.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:28:26.876 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:28:26.876 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:28:26.876 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:28:26.877 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:28:26.877 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:28:26.877 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:28:26.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:28:26.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:28:26.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:28:26.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:28:26.973 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:28:27.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:28:27.402 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:28:27.403 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:28:27.403 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:28:27.403 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T16:28:27.404 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T16:28:27.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:28:27.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:28:27.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:28:27.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836491 2020-09-08T16:28:27.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836491 2020-09-08T16:28:27.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491' 2020-09-08T16:28:27.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:28:27.543 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:28:27.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672969 2020-09-08T16:28:27.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672969 2020-09-08T16:28:27.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969' 2020-09-08T16:28:27.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:28:27.674 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:28:27.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509448 2020-09-08T16:28:27.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509448 2020-09-08T16:28:27.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969 2-64424509448' 2020-09-08T16:28:27.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:28:27.835 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:28:27.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345926 2020-09-08T16:28:27.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345926 2020-09-08T16:28:27.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969 2-64424509448 3-85899345926' 2020-09-08T16:28:27.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:28:27.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:28:28.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182405 2020-09-08T16:28:28.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182405 2020-09-08T16:28:28.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969 2-64424509448 3-85899345926 4-107374182405' 2020-09-08T16:28:28.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:28:28.101 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T16:28:28.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018883 2020-09-08T16:28:28.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018883 2020-09-08T16:28:28.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969 2-64424509448 3-85899345926 4-107374182405 5-128849018883' 2020-09-08T16:28:28.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:28:28.244 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836491 2020-09-08T16:28:28.245 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:28:28.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:28:28.245 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836491 2020-09-08T16:28:28.245 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:28:28.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836491 2020-09-08T16:28:28.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2020-09-08T16:28:28.246 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:28:28.246 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836491 2020-09-08T16:28:28.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836489 -lt 21474836491 2020-09-08T16:28:28.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:28:29.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:28:29.633 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:28:30.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836491 -lt 21474836491 2020-09-08T16:28:30.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:28:30.043 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672969 2020-09-08T16:28:30.043 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:28:30.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:28:30.044 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672969 2020-09-08T16:28:30.044 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:28:30.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672969 2020-09-08T16:28:30.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672969' 2020-09-08T16:28:30.045 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:28:30.046 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672969 2020-09-08T16:28:30.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672970 -lt 42949672969 2020-09-08T16:28:30.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:28:30.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509448 2020-09-08T16:28:30.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:28:30.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:28:30.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509448 2020-09-08T16:28:30.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:28:30.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509448 2020-09-08T16:28:30.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509448' 2020-09-08T16:28:30.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:28:30.453 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509448 2020-09-08T16:28:30.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509448 -lt 64424509448 2020-09-08T16:28:30.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:28:30.859 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345926 2020-09-08T16:28:30.859 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:28:30.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:28:30.860 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345926 2020-09-08T16:28:30.861 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:28:30.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345926 2020-09-08T16:28:30.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345926' 2020-09-08T16:28:30.861 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345926 2020-09-08T16:28:30.862 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:28:31.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345927 -lt 85899345926 2020-09-08T16:28:31.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:28:31.265 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182405 2020-09-08T16:28:31.265 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:28:31.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:28:31.266 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182405 2020-09-08T16:28:31.266 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:28:31.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182405 2020-09-08T16:28:31.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182405' 2020-09-08T16:28:31.268 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:28:31.268 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182405 2020-09-08T16:28:31.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182405 -lt 107374182405 2020-09-08T16:28:31.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:28:31.679 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018883 2020-09-08T16:28:31.679 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:28:31.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T16:28:31.680 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018883 2020-09-08T16:28:31.680 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:28:31.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018883 2020-09-08T16:28:31.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018883' 2020-09-08T16:28:31.681 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T16:28:31.682 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018883 2020-09-08T16:28:32.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018884 -lt 128849018883 2020-09-08T16:28:32.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:28:32.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:28:32.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:28:32.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T16:28:32.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:28:32.600 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:28:32.600 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:28:32.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:28:32.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:28:32.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:28:32.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:28:32.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:28:32.981 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:28:32.982 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:28:32.982 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:28:33.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:28:33.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T16:28:33.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T16:28:33.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T16:28:33.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:28:33.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:28:33.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:28:33.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:28:33.612 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:28:33.612 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:28:33.612 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:28:33.613 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:28:33.613 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:28:33.613 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:28:33.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T16:28:33.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:28:33.993 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:28:33.993 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:28:34.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T16:28:34.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:28:34.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:28:34.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1133: TEST_ec_backfill_grow: dd if=/dev/urandom of=td/osd-backfill-space/12kdata bs=1k count=12 2020-09-08T16:28:34.518 INFO:tasks.workunit.client.0.smithi065.stderr:12+0 records in 2020-09-08T16:28:34.518 INFO:tasks.workunit.client.0.smithi065.stderr:12+0 records out 2020-09-08T16:28:34.518 INFO:tasks.workunit.client.0.smithi065.stderr:12288 bytes (12 kB, 12 KiB) copied, 0.000123902 s, 99.2 MB/s 2020-09-08T16:28:34.520 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: seq 1 200 2020-09-08T16:28:34.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:34.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj1 td/osd-backfill-space/12kdata 2020-09-08T16:28:34.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:34.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj2 td/osd-backfill-space/12kdata 2020-09-08T16:28:34.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:34.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj3 td/osd-backfill-space/12kdata 2020-09-08T16:28:35.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:35.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj4 td/osd-backfill-space/12kdata 2020-09-08T16:28:35.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:35.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj5 td/osd-backfill-space/12kdata 2020-09-08T16:28:35.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:35.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj6 td/osd-backfill-space/12kdata 2020-09-08T16:28:35.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:35.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj7 td/osd-backfill-space/12kdata 2020-09-08T16:28:36.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:36.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj8 td/osd-backfill-space/12kdata 2020-09-08T16:28:36.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:36.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj9 td/osd-backfill-space/12kdata 2020-09-08T16:28:36.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:36.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj10 td/osd-backfill-space/12kdata 2020-09-08T16:28:36.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:36.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj11 td/osd-backfill-space/12kdata 2020-09-08T16:28:37.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:37.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj12 td/osd-backfill-space/12kdata 2020-09-08T16:28:37.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:37.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj13 td/osd-backfill-space/12kdata 2020-09-08T16:28:37.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:37.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj14 td/osd-backfill-space/12kdata 2020-09-08T16:28:37.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:37.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj15 td/osd-backfill-space/12kdata 2020-09-08T16:28:38.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:38.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj16 td/osd-backfill-space/12kdata 2020-09-08T16:28:38.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:38.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj17 td/osd-backfill-space/12kdata 2020-09-08T16:28:38.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:38.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj18 td/osd-backfill-space/12kdata 2020-09-08T16:28:39.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:39.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj19 td/osd-backfill-space/12kdata 2020-09-08T16:28:39.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:39.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj20 td/osd-backfill-space/12kdata 2020-09-08T16:28:39.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:39.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj21 td/osd-backfill-space/12kdata 2020-09-08T16:28:39.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:39.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj22 td/osd-backfill-space/12kdata 2020-09-08T16:28:40.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:40.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj23 td/osd-backfill-space/12kdata 2020-09-08T16:28:40.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:40.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj24 td/osd-backfill-space/12kdata 2020-09-08T16:28:40.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:40.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj25 td/osd-backfill-space/12kdata 2020-09-08T16:28:40.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:40.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj26 td/osd-backfill-space/12kdata 2020-09-08T16:28:41.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:41.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj27 td/osd-backfill-space/12kdata 2020-09-08T16:28:41.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:41.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj28 td/osd-backfill-space/12kdata 2020-09-08T16:28:41.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:41.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj29 td/osd-backfill-space/12kdata 2020-09-08T16:28:41.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:41.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj30 td/osd-backfill-space/12kdata 2020-09-08T16:28:42.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:42.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj31 td/osd-backfill-space/12kdata 2020-09-08T16:28:42.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:42.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj32 td/osd-backfill-space/12kdata 2020-09-08T16:28:42.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:42.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj33 td/osd-backfill-space/12kdata 2020-09-08T16:28:42.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:42.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj34 td/osd-backfill-space/12kdata 2020-09-08T16:28:43.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:43.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj35 td/osd-backfill-space/12kdata 2020-09-08T16:28:43.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:43.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj36 td/osd-backfill-space/12kdata 2020-09-08T16:28:43.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:43.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj37 td/osd-backfill-space/12kdata 2020-09-08T16:28:43.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:43.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj38 td/osd-backfill-space/12kdata 2020-09-08T16:28:44.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:44.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj39 td/osd-backfill-space/12kdata 2020-09-08T16:28:44.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:44.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj40 td/osd-backfill-space/12kdata 2020-09-08T16:28:44.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:44.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj41 td/osd-backfill-space/12kdata 2020-09-08T16:28:44.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:44.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj42 td/osd-backfill-space/12kdata 2020-09-08T16:28:45.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:45.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj43 td/osd-backfill-space/12kdata 2020-09-08T16:28:45.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:45.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj44 td/osd-backfill-space/12kdata 2020-09-08T16:28:45.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:45.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj45 td/osd-backfill-space/12kdata 2020-09-08T16:28:45.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:45.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj46 td/osd-backfill-space/12kdata 2020-09-08T16:28:46.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:46.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj47 td/osd-backfill-space/12kdata 2020-09-08T16:28:46.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:46.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj48 td/osd-backfill-space/12kdata 2020-09-08T16:28:46.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:46.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj49 td/osd-backfill-space/12kdata 2020-09-08T16:28:46.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:46.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj50 td/osd-backfill-space/12kdata 2020-09-08T16:28:47.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:47.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj51 td/osd-backfill-space/12kdata 2020-09-08T16:28:47.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:47.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj52 td/osd-backfill-space/12kdata 2020-09-08T16:28:47.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:47.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj53 td/osd-backfill-space/12kdata 2020-09-08T16:28:47.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:47.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj54 td/osd-backfill-space/12kdata 2020-09-08T16:28:48.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:48.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj55 td/osd-backfill-space/12kdata 2020-09-08T16:28:48.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:48.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj56 td/osd-backfill-space/12kdata 2020-09-08T16:28:48.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:48.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj57 td/osd-backfill-space/12kdata 2020-09-08T16:28:48.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:48.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj58 td/osd-backfill-space/12kdata 2020-09-08T16:28:49.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:49.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj59 td/osd-backfill-space/12kdata 2020-09-08T16:28:49.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:49.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj60 td/osd-backfill-space/12kdata 2020-09-08T16:28:49.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:49.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj61 td/osd-backfill-space/12kdata 2020-09-08T16:28:49.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:49.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj62 td/osd-backfill-space/12kdata 2020-09-08T16:28:50.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:50.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj63 td/osd-backfill-space/12kdata 2020-09-08T16:28:50.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:50.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj64 td/osd-backfill-space/12kdata 2020-09-08T16:28:50.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:50.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj65 td/osd-backfill-space/12kdata 2020-09-08T16:28:50.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:50.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj66 td/osd-backfill-space/12kdata 2020-09-08T16:28:51.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:51.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj67 td/osd-backfill-space/12kdata 2020-09-08T16:28:51.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:51.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj68 td/osd-backfill-space/12kdata 2020-09-08T16:28:51.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:28:51.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj69 td/osd-backfill-space/12kdata 2020-09-08T16:28:51.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj70 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj71 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj72 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj73 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj74 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj75 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj76 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj77 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj78 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj79 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj80 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj81 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj82 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj83 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj84 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj85 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj86 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj87 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj88 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj89 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj90 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj91 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj92 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj93 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj94 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj95 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj96 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj97 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj98 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj99 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj100 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj101 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj102 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj103 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj104 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj105 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj106 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj107 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj108 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj109 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj110 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj111 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj112 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj113 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj114 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj115 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj116 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj117 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj118 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj119 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj120 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj121 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj122 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj123 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj124 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj125 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj126 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj127 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj128 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj129 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj130 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj131 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj132 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj133 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj134 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj135 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj136 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj137 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj138 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj139 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj140 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj141 td/osd-backfill-space/12kdata 2020-09-08T16:29:09.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:09.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj142 td/osd-backfill-space/12kdata 2020-09-08T16:29:10.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:10.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj143 td/osd-backfill-space/12kdata 2020-09-08T16:29:10.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:10.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj144 td/osd-backfill-space/12kdata 2020-09-08T16:29:10.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:10.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj145 td/osd-backfill-space/12kdata 2020-09-08T16:29:11.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:11.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj146 td/osd-backfill-space/12kdata 2020-09-08T16:29:11.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:11.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj147 td/osd-backfill-space/12kdata 2020-09-08T16:29:11.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:11.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj148 td/osd-backfill-space/12kdata 2020-09-08T16:29:11.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:11.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj149 td/osd-backfill-space/12kdata 2020-09-08T16:29:12.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:12.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj150 td/osd-backfill-space/12kdata 2020-09-08T16:29:12.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:12.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj151 td/osd-backfill-space/12kdata 2020-09-08T16:29:12.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:12.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj152 td/osd-backfill-space/12kdata 2020-09-08T16:29:12.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:12.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj153 td/osd-backfill-space/12kdata 2020-09-08T16:29:13.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:13.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj154 td/osd-backfill-space/12kdata 2020-09-08T16:29:13.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:13.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj155 td/osd-backfill-space/12kdata 2020-09-08T16:29:13.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:13.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj156 td/osd-backfill-space/12kdata 2020-09-08T16:29:13.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:13.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj157 td/osd-backfill-space/12kdata 2020-09-08T16:29:14.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:14.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj158 td/osd-backfill-space/12kdata 2020-09-08T16:29:14.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:14.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj159 td/osd-backfill-space/12kdata 2020-09-08T16:29:14.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:14.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj160 td/osd-backfill-space/12kdata 2020-09-08T16:29:14.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:14.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj161 td/osd-backfill-space/12kdata 2020-09-08T16:29:15.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:15.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj162 td/osd-backfill-space/12kdata 2020-09-08T16:29:15.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:15.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj163 td/osd-backfill-space/12kdata 2020-09-08T16:29:15.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:15.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj164 td/osd-backfill-space/12kdata 2020-09-08T16:29:15.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:15.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj165 td/osd-backfill-space/12kdata 2020-09-08T16:29:16.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:16.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj166 td/osd-backfill-space/12kdata 2020-09-08T16:29:16.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:16.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj167 td/osd-backfill-space/12kdata 2020-09-08T16:29:16.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:16.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj168 td/osd-backfill-space/12kdata 2020-09-08T16:29:16.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:16.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj169 td/osd-backfill-space/12kdata 2020-09-08T16:29:17.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:17.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj170 td/osd-backfill-space/12kdata 2020-09-08T16:29:17.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:17.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj171 td/osd-backfill-space/12kdata 2020-09-08T16:29:17.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:17.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj172 td/osd-backfill-space/12kdata 2020-09-08T16:29:17.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:17.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj173 td/osd-backfill-space/12kdata 2020-09-08T16:29:18.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:18.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj174 td/osd-backfill-space/12kdata 2020-09-08T16:29:18.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:18.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj175 td/osd-backfill-space/12kdata 2020-09-08T16:29:18.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:18.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj176 td/osd-backfill-space/12kdata 2020-09-08T16:29:18.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:18.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj177 td/osd-backfill-space/12kdata 2020-09-08T16:29:18.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:18.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj178 td/osd-backfill-space/12kdata 2020-09-08T16:29:19.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:19.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj179 td/osd-backfill-space/12kdata 2020-09-08T16:29:19.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:19.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj180 td/osd-backfill-space/12kdata 2020-09-08T16:29:19.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:19.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj181 td/osd-backfill-space/12kdata 2020-09-08T16:29:20.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:20.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj182 td/osd-backfill-space/12kdata 2020-09-08T16:29:20.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:20.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj183 td/osd-backfill-space/12kdata 2020-09-08T16:29:20.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:20.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj184 td/osd-backfill-space/12kdata 2020-09-08T16:29:20.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:20.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj185 td/osd-backfill-space/12kdata 2020-09-08T16:29:21.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:21.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj186 td/osd-backfill-space/12kdata 2020-09-08T16:29:21.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:21.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj187 td/osd-backfill-space/12kdata 2020-09-08T16:29:21.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:21.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj188 td/osd-backfill-space/12kdata 2020-09-08T16:29:21.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:21.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj189 td/osd-backfill-space/12kdata 2020-09-08T16:29:22.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:22.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj190 td/osd-backfill-space/12kdata 2020-09-08T16:29:22.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:22.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj191 td/osd-backfill-space/12kdata 2020-09-08T16:29:22.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:22.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj192 td/osd-backfill-space/12kdata 2020-09-08T16:29:22.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:22.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj193 td/osd-backfill-space/12kdata 2020-09-08T16:29:23.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:23.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj194 td/osd-backfill-space/12kdata 2020-09-08T16:29:23.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:23.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj195 td/osd-backfill-space/12kdata 2020-09-08T16:29:23.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:23.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj196 td/osd-backfill-space/12kdata 2020-09-08T16:29:23.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:23.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj197 td/osd-backfill-space/12kdata 2020-09-08T16:29:24.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:24.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj198 td/osd-backfill-space/12kdata 2020-09-08T16:29:24.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:24.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj199 td/osd-backfill-space/12kdata 2020-09-08T16:29:24.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2020-09-08T16:29:24.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1136: TEST_ec_backfill_grow: rados -p test put obj200 td/osd-backfill-space/12kdata 2020-09-08T16:29:24.834 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1139: TEST_ec_backfill_grow: get_pg test obj1 2020-09-08T16:29:24.834 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1031: get_pg: local poolname=test 2020-09-08T16:29:24.834 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: local objectname=obj1 2020-09-08T16:29:24.835 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: ceph --format json osd map test obj1 2020-09-08T16:29:24.835 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: jq -r .pgid 2020-09-08T16:29:25.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1139: TEST_ec_backfill_grow: local PG=1.0 2020-09-08T16:29:25.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1141: TEST_ec_backfill_grow: get_primary test obj1 2020-09-08T16:29:25.249 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:29:25.249 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:29:25.249 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:29:25.250 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:29:25.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1141: TEST_ec_backfill_grow: local primary=1 2020-09-08T16:29:25.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1142: TEST_ec_backfill_grow: get_not_primary test obj1 2020-09-08T16:29:25.670 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1167: get_not_primary: local poolname=test 2020-09-08T16:29:25.670 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: get_not_primary: local objectname=obj1 2020-09-08T16:29:25.670 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: get_primary test obj1 2020-09-08T16:29:25.670 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:29:25.670 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:29:25.671 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:29:25.671 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:29:26.068 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: local primary=1 2020-09-08T16:29:26.069 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1171: get_not_primary: ceph --format json osd map test obj1 2020-09-08T16:29:26.069 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1172: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2020-09-08T16:29:26.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1142: TEST_ec_backfill_grow: local otherosd=0 2020-09-08T16:29:26.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1144: TEST_ec_backfill_grow: ceph osd set noout 2020-09-08T16:29:27.296 INFO:tasks.workunit.client.0.smithi065.stderr:noout is set 2020-09-08T16:29:27.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1145: TEST_ec_backfill_grow: kill_daemons td/osd-backfill-space TERM 0 2020-09-08T16:29:27.306 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:29:27.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:29:27.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:29:27.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:29:27.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:29:27.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:29:27.412 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1147: TEST_ec_backfill_grow: expr 200 / 4 2020-09-08T16:29:27.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1147: TEST_ec_backfill_grow: rmobjects=50 2020-09-08T16:29:27.413 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: seq 1 50 2020-09-08T16:29:27.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:27.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj1 2020-09-08T16:29:28.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:28.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj2 2020-09-08T16:29:28.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:28.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj3 2020-09-08T16:29:28.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:28.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj4 2020-09-08T16:29:28.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:28.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj5 2020-09-08T16:29:29.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:29.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj6 2020-09-08T16:29:29.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:29.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj7 2020-09-08T16:29:29.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:29.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj8 2020-09-08T16:29:29.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:29.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj9 2020-09-08T16:29:29.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:29.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj10 2020-09-08T16:29:30.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:30.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj11 2020-09-08T16:29:30.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:30.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj12 2020-09-08T16:29:30.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:30.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj13 2020-09-08T16:29:30.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:30.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj14 2020-09-08T16:29:31.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:31.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj15 2020-09-08T16:29:31.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:31.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj16 2020-09-08T16:29:31.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:31.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj17 2020-09-08T16:29:31.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:31.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj18 2020-09-08T16:29:31.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:31.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj19 2020-09-08T16:29:32.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:32.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj20 2020-09-08T16:29:32.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:32.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj21 2020-09-08T16:29:32.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:32.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj22 2020-09-08T16:29:32.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:32.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj23 2020-09-08T16:29:32.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:32.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj24 2020-09-08T16:29:33.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:33.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj25 2020-09-08T16:29:33.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:33.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj26 2020-09-08T16:29:33.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:33.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj27 2020-09-08T16:29:33.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:33.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj28 2020-09-08T16:29:33.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:33.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj29 2020-09-08T16:29:34.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:34.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj30 2020-09-08T16:29:34.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:34.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj31 2020-09-08T16:29:34.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:34.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj32 2020-09-08T16:29:34.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:34.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj33 2020-09-08T16:29:34.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:34.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj34 2020-09-08T16:29:35.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:35.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj35 2020-09-08T16:29:35.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:35.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj36 2020-09-08T16:29:35.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:35.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj37 2020-09-08T16:29:35.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:35.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj38 2020-09-08T16:29:36.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:36.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj39 2020-09-08T16:29:36.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:36.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj40 2020-09-08T16:29:36.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:36.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj41 2020-09-08T16:29:36.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:36.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj42 2020-09-08T16:29:36.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:36.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj43 2020-09-08T16:29:37.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:37.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj44 2020-09-08T16:29:37.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:37.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj45 2020-09-08T16:29:37.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:37.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj46 2020-09-08T16:29:37.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:37.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj47 2020-09-08T16:29:37.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:37.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj48 2020-09-08T16:29:38.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:38.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj49 2020-09-08T16:29:38.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2020-09-08T16:29:38.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1150: TEST_ec_backfill_grow: rados -p test rm obj50 2020-09-08T16:29:38.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1153: TEST_ec_backfill_grow: dd if=/dev/urandom of=td/osd-backfill-space/36kdata bs=1k count=36 2020-09-08T16:29:38.561 INFO:tasks.workunit.client.0.smithi065.stderr:36+0 records in 2020-09-08T16:29:38.562 INFO:tasks.workunit.client.0.smithi065.stderr:36+0 records out 2020-09-08T16:29:38.562 INFO:tasks.workunit.client.0.smithi065.stderr:36864 bytes (37 kB, 36 KiB) copied, 0.000336703 s, 109 MB/s 2020-09-08T16:29:38.562 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: expr 50 + 1 2020-09-08T16:29:38.567 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: seq 51 200 2020-09-08T16:29:38.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:38.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj51 td/osd-backfill-space/36kdata 2020-09-08T16:29:38.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:38.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj52 td/osd-backfill-space/36kdata 2020-09-08T16:29:38.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:38.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj53 td/osd-backfill-space/36kdata 2020-09-08T16:29:39.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:39.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj54 td/osd-backfill-space/36kdata 2020-09-08T16:29:39.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:39.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj55 td/osd-backfill-space/36kdata 2020-09-08T16:29:39.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:39.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj56 td/osd-backfill-space/36kdata 2020-09-08T16:29:39.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:39.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj57 td/osd-backfill-space/36kdata 2020-09-08T16:29:40.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:40.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj58 td/osd-backfill-space/36kdata 2020-09-08T16:29:40.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:40.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj59 td/osd-backfill-space/36kdata 2020-09-08T16:29:40.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:40.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj60 td/osd-backfill-space/36kdata 2020-09-08T16:29:40.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:40.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj61 td/osd-backfill-space/36kdata 2020-09-08T16:29:41.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:41.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj62 td/osd-backfill-space/36kdata 2020-09-08T16:29:41.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:41.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj63 td/osd-backfill-space/36kdata 2020-09-08T16:29:41.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:41.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj64 td/osd-backfill-space/36kdata 2020-09-08T16:29:42.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:42.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj65 td/osd-backfill-space/36kdata 2020-09-08T16:29:42.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:42.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj66 td/osd-backfill-space/36kdata 2020-09-08T16:29:42.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:42.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj67 td/osd-backfill-space/36kdata 2020-09-08T16:29:42.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:42.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj68 td/osd-backfill-space/36kdata 2020-09-08T16:29:43.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:43.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj69 td/osd-backfill-space/36kdata 2020-09-08T16:29:43.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:43.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj70 td/osd-backfill-space/36kdata 2020-09-08T16:29:43.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:43.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj71 td/osd-backfill-space/36kdata 2020-09-08T16:29:43.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:43.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj72 td/osd-backfill-space/36kdata 2020-09-08T16:29:44.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:44.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj73 td/osd-backfill-space/36kdata 2020-09-08T16:29:44.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:44.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj74 td/osd-backfill-space/36kdata 2020-09-08T16:29:44.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:44.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj75 td/osd-backfill-space/36kdata 2020-09-08T16:29:44.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:44.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj76 td/osd-backfill-space/36kdata 2020-09-08T16:29:44.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:44.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj77 td/osd-backfill-space/36kdata 2020-09-08T16:29:45.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:45.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj78 td/osd-backfill-space/36kdata 2020-09-08T16:29:45.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:45.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj79 td/osd-backfill-space/36kdata 2020-09-08T16:29:45.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:45.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj80 td/osd-backfill-space/36kdata 2020-09-08T16:29:45.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:45.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj81 td/osd-backfill-space/36kdata 2020-09-08T16:29:46.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:46.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj82 td/osd-backfill-space/36kdata 2020-09-08T16:29:46.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:46.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj83 td/osd-backfill-space/36kdata 2020-09-08T16:29:46.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:46.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj84 td/osd-backfill-space/36kdata 2020-09-08T16:29:46.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:46.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj85 td/osd-backfill-space/36kdata 2020-09-08T16:29:47.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:47.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj86 td/osd-backfill-space/36kdata 2020-09-08T16:29:47.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:47.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj87 td/osd-backfill-space/36kdata 2020-09-08T16:29:47.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:47.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj88 td/osd-backfill-space/36kdata 2020-09-08T16:29:47.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:47.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj89 td/osd-backfill-space/36kdata 2020-09-08T16:29:48.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:48.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj90 td/osd-backfill-space/36kdata 2020-09-08T16:29:48.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:48.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj91 td/osd-backfill-space/36kdata 2020-09-08T16:29:48.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:48.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj92 td/osd-backfill-space/36kdata 2020-09-08T16:29:48.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:48.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj93 td/osd-backfill-space/36kdata 2020-09-08T16:29:49.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:49.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj94 td/osd-backfill-space/36kdata 2020-09-08T16:29:49.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:49.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj95 td/osd-backfill-space/36kdata 2020-09-08T16:29:49.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:49.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj96 td/osd-backfill-space/36kdata 2020-09-08T16:29:49.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:49.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj97 td/osd-backfill-space/36kdata 2020-09-08T16:29:49.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:49.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj98 td/osd-backfill-space/36kdata 2020-09-08T16:29:50.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:50.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj99 td/osd-backfill-space/36kdata 2020-09-08T16:29:50.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:50.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj100 td/osd-backfill-space/36kdata 2020-09-08T16:29:50.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:50.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj101 td/osd-backfill-space/36kdata 2020-09-08T16:29:50.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:50.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj102 td/osd-backfill-space/36kdata 2020-09-08T16:29:51.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:51.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj103 td/osd-backfill-space/36kdata 2020-09-08T16:29:51.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:51.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj104 td/osd-backfill-space/36kdata 2020-09-08T16:29:51.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:51.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj105 td/osd-backfill-space/36kdata 2020-09-08T16:29:51.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:51.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj106 td/osd-backfill-space/36kdata 2020-09-08T16:29:52.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:52.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj107 td/osd-backfill-space/36kdata 2020-09-08T16:29:52.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:52.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj108 td/osd-backfill-space/36kdata 2020-09-08T16:29:52.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:52.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj109 td/osd-backfill-space/36kdata 2020-09-08T16:29:52.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:52.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj110 td/osd-backfill-space/36kdata 2020-09-08T16:29:53.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:53.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj111 td/osd-backfill-space/36kdata 2020-09-08T16:29:53.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:53.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj112 td/osd-backfill-space/36kdata 2020-09-08T16:29:53.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:53.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj113 td/osd-backfill-space/36kdata 2020-09-08T16:29:53.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:53.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj114 td/osd-backfill-space/36kdata 2020-09-08T16:29:53.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:53.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj115 td/osd-backfill-space/36kdata 2020-09-08T16:29:54.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:54.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj116 td/osd-backfill-space/36kdata 2020-09-08T16:29:54.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:54.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj117 td/osd-backfill-space/36kdata 2020-09-08T16:29:54.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:54.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj118 td/osd-backfill-space/36kdata 2020-09-08T16:29:54.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:54.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj119 td/osd-backfill-space/36kdata 2020-09-08T16:29:55.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:55.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj120 td/osd-backfill-space/36kdata 2020-09-08T16:29:55.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:55.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj121 td/osd-backfill-space/36kdata 2020-09-08T16:29:55.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:55.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj122 td/osd-backfill-space/36kdata 2020-09-08T16:29:55.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:55.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj123 td/osd-backfill-space/36kdata 2020-09-08T16:29:56.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:56.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj124 td/osd-backfill-space/36kdata 2020-09-08T16:29:56.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:56.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj125 td/osd-backfill-space/36kdata 2020-09-08T16:29:56.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:56.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj126 td/osd-backfill-space/36kdata 2020-09-08T16:29:56.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:56.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj127 td/osd-backfill-space/36kdata 2020-09-08T16:29:56.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:56.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj128 td/osd-backfill-space/36kdata 2020-09-08T16:29:57.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:57.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj129 td/osd-backfill-space/36kdata 2020-09-08T16:29:57.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:57.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj130 td/osd-backfill-space/36kdata 2020-09-08T16:29:57.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:57.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj131 td/osd-backfill-space/36kdata 2020-09-08T16:29:57.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:57.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj132 td/osd-backfill-space/36kdata 2020-09-08T16:29:58.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:58.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj133 td/osd-backfill-space/36kdata 2020-09-08T16:29:58.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:58.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj134 td/osd-backfill-space/36kdata 2020-09-08T16:29:58.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:58.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj135 td/osd-backfill-space/36kdata 2020-09-08T16:29:58.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:58.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj136 td/osd-backfill-space/36kdata 2020-09-08T16:29:59.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:59.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj137 td/osd-backfill-space/36kdata 2020-09-08T16:29:59.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:59.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj138 td/osd-backfill-space/36kdata 2020-09-08T16:29:59.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:59.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj139 td/osd-backfill-space/36kdata 2020-09-08T16:29:59.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:29:59.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj140 td/osd-backfill-space/36kdata 2020-09-08T16:30:00.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:00.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj141 td/osd-backfill-space/36kdata 2020-09-08T16:30:00.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:00.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj142 td/osd-backfill-space/36kdata 2020-09-08T16:30:00.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:00.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj143 td/osd-backfill-space/36kdata 2020-09-08T16:30:00.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:00.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj144 td/osd-backfill-space/36kdata 2020-09-08T16:30:00.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:00.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj145 td/osd-backfill-space/36kdata 2020-09-08T16:30:01.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:01.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj146 td/osd-backfill-space/36kdata 2020-09-08T16:30:01.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:01.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj147 td/osd-backfill-space/36kdata 2020-09-08T16:30:01.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:01.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj148 td/osd-backfill-space/36kdata 2020-09-08T16:30:01.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:01.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj149 td/osd-backfill-space/36kdata 2020-09-08T16:30:02.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:02.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj150 td/osd-backfill-space/36kdata 2020-09-08T16:30:02.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:02.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj151 td/osd-backfill-space/36kdata 2020-09-08T16:30:02.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:02.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj152 td/osd-backfill-space/36kdata 2020-09-08T16:30:02.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:02.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj153 td/osd-backfill-space/36kdata 2020-09-08T16:30:03.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:03.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj154 td/osd-backfill-space/36kdata 2020-09-08T16:30:03.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:03.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj155 td/osd-backfill-space/36kdata 2020-09-08T16:30:03.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:03.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj156 td/osd-backfill-space/36kdata 2020-09-08T16:30:03.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:03.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj157 td/osd-backfill-space/36kdata 2020-09-08T16:30:03.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:03.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj158 td/osd-backfill-space/36kdata 2020-09-08T16:30:04.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:04.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj159 td/osd-backfill-space/36kdata 2020-09-08T16:30:04.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:04.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj160 td/osd-backfill-space/36kdata 2020-09-08T16:30:04.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:04.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj161 td/osd-backfill-space/36kdata 2020-09-08T16:30:04.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:04.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj162 td/osd-backfill-space/36kdata 2020-09-08T16:30:05.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:05.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj163 td/osd-backfill-space/36kdata 2020-09-08T16:30:05.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:05.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj164 td/osd-backfill-space/36kdata 2020-09-08T16:30:05.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:05.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj165 td/osd-backfill-space/36kdata 2020-09-08T16:30:05.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:05.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj166 td/osd-backfill-space/36kdata 2020-09-08T16:30:06.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:06.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj167 td/osd-backfill-space/36kdata 2020-09-08T16:30:06.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:06.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj168 td/osd-backfill-space/36kdata 2020-09-08T16:30:06.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:06.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj169 td/osd-backfill-space/36kdata 2020-09-08T16:30:06.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:06.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj170 td/osd-backfill-space/36kdata 2020-09-08T16:30:07.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:07.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj171 td/osd-backfill-space/36kdata 2020-09-08T16:30:07.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:07.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj172 td/osd-backfill-space/36kdata 2020-09-08T16:30:07.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:07.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj173 td/osd-backfill-space/36kdata 2020-09-08T16:30:07.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:07.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj174 td/osd-backfill-space/36kdata 2020-09-08T16:30:07.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:07.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj175 td/osd-backfill-space/36kdata 2020-09-08T16:30:08.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:08.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj176 td/osd-backfill-space/36kdata 2020-09-08T16:30:08.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:08.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj177 td/osd-backfill-space/36kdata 2020-09-08T16:30:08.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:08.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj178 td/osd-backfill-space/36kdata 2020-09-08T16:30:08.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:08.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj179 td/osd-backfill-space/36kdata 2020-09-08T16:30:09.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:09.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj180 td/osd-backfill-space/36kdata 2020-09-08T16:30:09.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:09.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj181 td/osd-backfill-space/36kdata 2020-09-08T16:30:09.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:09.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj182 td/osd-backfill-space/36kdata 2020-09-08T16:30:09.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:09.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj183 td/osd-backfill-space/36kdata 2020-09-08T16:30:10.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:10.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj184 td/osd-backfill-space/36kdata 2020-09-08T16:30:10.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:10.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj185 td/osd-backfill-space/36kdata 2020-09-08T16:30:10.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:10.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj186 td/osd-backfill-space/36kdata 2020-09-08T16:30:10.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:10.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj187 td/osd-backfill-space/36kdata 2020-09-08T16:30:10.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:10.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj188 td/osd-backfill-space/36kdata 2020-09-08T16:30:11.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:11.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj189 td/osd-backfill-space/36kdata 2020-09-08T16:30:11.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:11.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj190 td/osd-backfill-space/36kdata 2020-09-08T16:30:11.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:11.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj191 td/osd-backfill-space/36kdata 2020-09-08T16:30:11.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:11.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj192 td/osd-backfill-space/36kdata 2020-09-08T16:30:12.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:12.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj193 td/osd-backfill-space/36kdata 2020-09-08T16:30:12.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:12.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj194 td/osd-backfill-space/36kdata 2020-09-08T16:30:12.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:12.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj195 td/osd-backfill-space/36kdata 2020-09-08T16:30:13.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:13.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj196 td/osd-backfill-space/36kdata 2020-09-08T16:30:13.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:13.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj197 td/osd-backfill-space/36kdata 2020-09-08T16:30:13.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:13.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj198 td/osd-backfill-space/36kdata 2020-09-08T16:30:13.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:13.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj199 td/osd-backfill-space/36kdata 2020-09-08T16:30:14.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2020-09-08T16:30:14.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1156: TEST_ec_backfill_grow: rados -p test put obj200 td/osd-backfill-space/36kdata 2020-09-08T16:30:14.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1159: TEST_ec_backfill_grow: activate_osd td/osd-backfill-space 0 2020-09-08T16:30:14.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/osd-backfill-space 2020-09-08T16:30:14.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T16:30:14.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=0 2020-09-08T16:30:14.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T16:30:14.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/osd-backfill-space/0 2020-09-08T16:30:14.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:30:14.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:30:14.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:30:14.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:30:14.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2020-09-08T16:30:14.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2020-09-08T16:30:14.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T16:30:14.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T16:30:14.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:30:14.293 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T16:30:14.293 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:30:14.293 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:30:14.294 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:30:14.294 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:30:14.294 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:30:14.294 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:30:14.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:30:14.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:30:14.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:30:14.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:30:14.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:30:14.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:30:14.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:30:14.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T16:30:14.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T16:30:14.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/osd-backfill-space/0 2020-09-08T16:30:14.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.0 2020-09-08T16:30:14.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 0 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:30:14.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/osd-backfill-space/0/whoami 2020-09-08T16:30:14.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 0 = 0 ']' 2020-09-08T16:30:14.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T16:30:14.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T16:30:14.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T16:30:14.300 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T16:30:14.318 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:30:14.322+0000 7f503a22dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:30:14.320 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:30:14.325+0000 7f503a22dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:30:14.322 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:30:14.326+0000 7f503a22dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:30:14.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 0 2020-09-08T16:30:14.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:30:14.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T16:30:14.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:30:14.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:30:14.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:30:14.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:30:14.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:30:14.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:30:14.705 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:30:14.837 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:30:14.841+0000 7f503a22dec0 -1 Falling back to public interface 2020-09-08T16:30:15.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:30:16.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:30:16.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:30:16.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:30:16.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:30:16.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:30:16.101 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:30:16.137 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:30:16.140+0000 7f503a22dec0 -1 osd.0 40 log_to_monitors {default=true} 2020-09-08T16:30:16.536 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 45 up_thru 0 down_at 43 last_clean_interval [5,40) [v2:127.0.0.1:6802/443122,v1:127.0.0.1:6803/443122] [v2:127.0.0.1:6804/443122,v1:127.0.0.1:6805/443122] exists,up 07416d68-aa9b-498d-ae58-af1c150dc7a5 2020-09-08T16:30:16.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:30:16.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:30:16.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:30:16.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1161: TEST_ec_backfill_grow: ceph tell osd.1 debug kick_recovery_wq 0 2020-09-08T16:30:16.674 INFO:tasks.workunit.client.0.smithi065.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2020-09-08T16:30:16.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1163: TEST_ec_backfill_grow: sleep 2 2020-09-08T16:30:18.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1165: TEST_ec_backfill_grow: wait_for_clean 2020-09-08T16:30:18.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:30:18.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:30:18.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:30:18.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:30:18.685 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:30:18.686 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:30:18.687 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:30:18.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:30:18.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:30:18.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:30:18.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:30:18.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:30:18.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:30:18.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:30:18.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:30:19.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:30:19.196 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:30:19.197 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:30:19.197 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:30:19.197 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T16:30:19.197 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T16:30:19.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:30:19.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:30:19.198 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:30:19.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=193273528323 2020-09-08T16:30:19.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 193273528323 2020-09-08T16:30:19.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-193273528323' 2020-09-08T16:30:19.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:30:19.331 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:30:19.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672994 2020-09-08T16:30:19.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672994 2020-09-08T16:30:19.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-193273528323 1-42949672994' 2020-09-08T16:30:19.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:30:19.490 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:30:19.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509472 2020-09-08T16:30:19.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509472 2020-09-08T16:30:19.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-193273528323 1-42949672994 2-64424509472' 2020-09-08T16:30:19.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:30:19.715 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:30:19.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345951 2020-09-08T16:30:19.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345951 2020-09-08T16:30:19.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-193273528323 1-42949672994 2-64424509472 3-85899345951' 2020-09-08T16:30:19.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:30:19.799 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:30:19.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182429 2020-09-08T16:30:19.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182429 2020-09-08T16:30:19.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-193273528323 1-42949672994 2-64424509472 3-85899345951 4-107374182429' 2020-09-08T16:30:19.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:30:19.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T16:30:20.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018908 2020-09-08T16:30:20.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018908 2020-09-08T16:30:20.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-193273528323 1-42949672994 2-64424509472 3-85899345951 4-107374182429 5-128849018908' 2020-09-08T16:30:20.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:30:20.066 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-193273528323 2020-09-08T16:30:20.066 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:30:20.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:30:20.066 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-193273528323 2020-09-08T16:30:20.067 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:30:20.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=193273528323 2020-09-08T16:30:20.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 193273528323' 2020-09-08T16:30:20.068 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:30:20.068 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 193273528323 2020-09-08T16:30:20.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 1 -lt 193273528323 2020-09-08T16:30:20.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:30:21.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:30:21.460 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:30:21.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 193273528324 -lt 193273528323 2020-09-08T16:30:21.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:30:21.901 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672994 2020-09-08T16:30:21.902 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:30:21.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:30:21.902 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672994 2020-09-08T16:30:21.903 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:30:21.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672994 2020-09-08T16:30:21.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672994' 2020-09-08T16:30:21.904 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:30:21.904 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672994 2020-09-08T16:30:22.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672994 -lt 42949672994 2020-09-08T16:30:22.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:30:22.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509472 2020-09-08T16:30:22.300 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:30:22.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:30:22.300 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509472 2020-09-08T16:30:22.301 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:30:22.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509472 2020-09-08T16:30:22.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509472' 2020-09-08T16:30:22.302 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:30:22.302 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509472 2020-09-08T16:30:22.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509473 -lt 64424509472 2020-09-08T16:30:22.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:30:22.704 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345951 2020-09-08T16:30:22.704 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:30:22.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:30:22.705 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345951 2020-09-08T16:30:22.705 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:30:22.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345951 2020-09-08T16:30:22.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345951' 2020-09-08T16:30:22.705 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:30:22.708 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345951 2020-09-08T16:30:23.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345951 -lt 85899345951 2020-09-08T16:30:23.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:30:23.114 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182429 2020-09-08T16:30:23.115 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:30:23.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:30:23.115 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182429 2020-09-08T16:30:23.116 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:30:23.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182429 2020-09-08T16:30:23.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182429' 2020-09-08T16:30:23.117 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:30:23.117 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182429 2020-09-08T16:30:23.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182430 -lt 107374182429 2020-09-08T16:30:23.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:30:23.552 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018908 2020-09-08T16:30:23.552 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:30:23.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T16:30:23.553 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018908 2020-09-08T16:30:23.553 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:30:23.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018908 2020-09-08T16:30:23.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018908' 2020-09-08T16:30:23.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T16:30:23.555 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018908 2020-09-08T16:30:23.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018908 -lt 128849018908 2020-09-08T16:30:23.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:30:23.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:30:23.955 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:30:24.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T16:30:24.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:30:24.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:30:24.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:30:24.508 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:30:24.508 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:30:24.508 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:30:24.509 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:30:24.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:30:24.927 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:30:24.928 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:30:24.928 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:30:25.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:30:25.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T16:30:25.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T16:30:25.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T16:30:25.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:30:25.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:30:25.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:30:25.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:30:25.517 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:30:25.517 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:30:25.517 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:30:25.517 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:30:25.518 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:30:25.518 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:30:25.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:30:25.903 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:30:25.903 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:30:25.903 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:30:26.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:30:26.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:30:26.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:30:26.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:30:26.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:30:26.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:30:26.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:30:26.426 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:30:26.426 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:30:26.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=95058 2020-09-08T16:30:26.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 95058 '!=' null 2020-09-08T16:30:26.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:30:26.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:30:26.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:30:27.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:30:27.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:30:27.048 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:30:27.048 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:30:27.048 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:30:27.048 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:30:27.049 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:30:27.049 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:30:27.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:30:27.437 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:30:27.438 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:30:27.438 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:30:27.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:30:27.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:30:27.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:30:27.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:30:27.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:30:27.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:30:27.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:30:27.980 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:30:27.981 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:30:28.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=77401 2020-09-08T16:30:28.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 77401 '!=' null 2020-09-08T16:30:28.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:30:28.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:30:28.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:30:28.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:30:28.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:30:28.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:30:28.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:30:28.602 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:30:28.602 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:30:28.602 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:30:28.602 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:30:28.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:30:28.987 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:30:28.988 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:30:28.988 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:30:29.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:30:29.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:30:29.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:30:29.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:30:29.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:30:29.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:30:29.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:30:29.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:30:29.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:30:30.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=134902 2020-09-08T16:30:30.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 134902 '!=' null 2020-09-08T16:30:30.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:30:30.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:30:30.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:30:30.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:30:30.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:30:30.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:30:30.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:30:30.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:30:30.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:30:30.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:30:30.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:30:30.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:30:30.531 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:30:30.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:30:30.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:30:31.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:30:31.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:30:31.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:30:31.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:30:31.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:30:31.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:30:31.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:30:31.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:30:31.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:30:31.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=132074 2020-09-08T16:30:31.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 132074 '!=' null 2020-09-08T16:30:31.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:30:31.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:30:31.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:30:31.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:30:31.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:30:31.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:30:31.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:30:31.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:30:31.700 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:30:31.700 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:30:31.700 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:30:32.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:30:32.090 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:30:32.090 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:30:32.091 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:30:32.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:30:32.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:30:32.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:30:32.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:30:32.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:30:32.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:30:32.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:30:32.616 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:30:32.616 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:30:33.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=132074 2020-09-08T16:30:33.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 132074 '!=' null 2020-09-08T16:30:33.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:30:33.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:30:33.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:30:33.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:30:33.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:30:33.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:30:33.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:30:33.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:30:33.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:30:33.308 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:30:33.308 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:30:33.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:30:33.694 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:30:33.694 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:30:33.695 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:30:34.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:30:34.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:30:34.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:30:34.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:30:34.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:30:34.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:30:34.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:30:34.217 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:30:34.217 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:30:34.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=184290 2020-09-08T16:30:34.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 184290 '!=' null 2020-09-08T16:30:34.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:30:34.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:30:34.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:30:34.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:30:34.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:30:34.866 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:30:34.866 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:30:34.867 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:30:34.867 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:30:34.867 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:30:34.867 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:30:35.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:30:35.252 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:30:35.253 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:30:35.253 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:30:35.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:30:35.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:30:35.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:30:35.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:30:35.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:30:35.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:30:35.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:30:35.789 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:30:35.790 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:30:36.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=138218 2020-09-08T16:30:36.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 138218 '!=' null 2020-09-08T16:30:36.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:30:36.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:30:36.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:30:36.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:30:36.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:30:36.412 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:30:36.413 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:30:36.413 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:30:36.413 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:30:36.413 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:30:36.413 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:30:36.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:30:36.799 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:30:36.800 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:30:36.800 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:30:37.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:30:37.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:30:37.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:30:37.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:30:37.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:30:37.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:30:37.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:30:37.335 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:30:37.335 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:30:37.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=138217 2020-09-08T16:30:37.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 138217 '!=' null 2020-09-08T16:30:37.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:30:37.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:30:37.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:30:37.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:30:37.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:30:37.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:30:37.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:30:37.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:30:37.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:30:37.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:30:37.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:30:38.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:30:38.354 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:30:38.354 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:30:38.355 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:30:38.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:30:38.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:30:38.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:30:38.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:30:38.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:30:38.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:30:38.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:30:38.877 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:30:38.877 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:30:39.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=208862 2020-09-08T16:30:39.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 208862 '!=' null 2020-09-08T16:30:39.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:30:39.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:30:39.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:30:39.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:30:39.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:30:39.497 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:30:39.497 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:30:39.497 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:30:39.497 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:30:39.497 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:30:39.498 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:30:39.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:30:39.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:30:39.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:30:39.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:30:40.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:30:40.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:30:40.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:30:40.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:30:40.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:30:40.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:30:40.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:30:40.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:30:40.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:30:40.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=208862 2020-09-08T16:30:40.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 208862 '!=' null 2020-09-08T16:30:40.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:30:40.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:30:40.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:30:41.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:30:41.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:30:41.031 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:30:41.031 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:30:41.031 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:30:41.032 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:30:41.032 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:30:41.032 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:30:41.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:30:41.416 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:30:41.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:30:41.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:30:41.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:30:41.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:30:41.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:30:41.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:30:41.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:30:41.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:30:41.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:30:41.939 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:30:41.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:30:42.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=141289 2020-09-08T16:30:42.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 141289 '!=' null 2020-09-08T16:30:42.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:30:42.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:30:42.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:30:42.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:30:42.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:30:42.559 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:30:42.559 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:30:42.560 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:30:42.560 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:30:42.561 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:30:42.562 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:30:42.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:30:42.948 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:30:42.949 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:30:42.950 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:30:43.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:30:43.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:30:43.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:30:43.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:30:43.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:30:43.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:30:43.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:30:43.572 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:30:43.572 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:30:44.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=215006 2020-09-08T16:30:44.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 215006 '!=' null 2020-09-08T16:30:44.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:30:44.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:30:44.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:30:44.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:30:44.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:30:44.213 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:30:44.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:30:44.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:30:44.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:30:44.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:30:44.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:30:44.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:30:44.600 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:30:44.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:30:44.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:30:45.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:30:45.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:30:45.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:30:45.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:30:45.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:30:45.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:30:45.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:30:45.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:30:45.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:30:45.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=144361 2020-09-08T16:30:45.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 144361 '!=' null 2020-09-08T16:30:45.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:30:45.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:30:45.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:30:45.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:30:45.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:30:45.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:30:45.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:30:45.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:30:45.762 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:30:45.762 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:30:45.762 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:30:46.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:30:46.147 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:30:46.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:30:46.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:30:46.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:30:46.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:30:46.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:30:46.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:30:46.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:30:46.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:30:46.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:30:46.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:30:46.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:30:47.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=144361 2020-09-08T16:30:47.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 144361 '!=' null 2020-09-08T16:30:47.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:30:47.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:30:47.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:30:47.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:30:47.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:30:47.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:30:47.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:30:47.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:30:47.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:30:47.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:30:47.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:30:47.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:30:47.680 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:30:47.680 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:30:47.681 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:30:48.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:30:48.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:30:48.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:30:48.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:30:48.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:30:48.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:30:48.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:30:48.245 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:30:48.245 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:30:48.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=144362 2020-09-08T16:30:48.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 144362 '!=' null 2020-09-08T16:30:48.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:30:48.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:30:48.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:30:48.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:30:48.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:30:48.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:30:48.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:30:48.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:30:48.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:30:48.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:30:48.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:30:49.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:30:49.294 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:30:49.294 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:30:49.294 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:30:49.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:30:49.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:30:49.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:30:49.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:30:49.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:30:49.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:30:49.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:30:49.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:30:49.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:30:50.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=211938 2020-09-08T16:30:50.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 211938 '!=' null 2020-09-08T16:30:50.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:30:50.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:30:50.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:30:50.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:30:50.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:30:50.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:30:50.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:30:50.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:30:50.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:30:50.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:30:50.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:30:50.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:30:50.836 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:30:50.837 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:30:50.837 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:30:51.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:30:51.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:30:51.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:30:51.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:30:51.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:30:51.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:30:51.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:30:51.366 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:30:51.366 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:30:51.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=141291 2020-09-08T16:30:51.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 141291 '!=' null 2020-09-08T16:30:51.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:30:51.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:30:51.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:30:52.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:30:52.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:30:52.017 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:30:52.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:30:52.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:30:52.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:30:52.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:30:52.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:30:52.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:30:52.416 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:30:52.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:30:52.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:30:53.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:30:53.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:30:53.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:30:53.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:30:53.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:30:53.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:30:53.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:30:53.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:30:53.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:30:53.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=170471 2020-09-08T16:30:53.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 170471 '!=' null 2020-09-08T16:30:53.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:30:53.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:30:53.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:30:53.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:30:53.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:30:53.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:30:53.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:30:53.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:30:53.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:30:53.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:30:53.656 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:30:54.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T16:30:54.040 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:30:54.041 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:30:54.041 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:30:54.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T16:30:54.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:30:54.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:30:54.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1167: TEST_ec_backfill_grow: delete_pool test 2020-09-08T16:30:54.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test 2020-09-08T16:30:54.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2020-09-08T16:30:55.093 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' does not exist 2020-09-08T16:30:55.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:1168: TEST_ec_backfill_grow: kill_daemons td/osd-backfill-space 2020-09-08T16:30:55.102 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:30:55.103 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:30:55.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:30:55.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:30:55.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:30:55.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:30:55.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:38: run: teardown td/osd-backfill-space 2020-09-08T16:30:55.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2020-09-08T16:30:55.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:30:55.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2020-09-08T16:30:55.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:30:55.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:30:55.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:30:55.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:30:55.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:30:55.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:30:55.221 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:30:55.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:30:55.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:30:55.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:30:55.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:30:55.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:30:55.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:30:55.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:30:55.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:30:55.226 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:30:55.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:30:55.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:30:55.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2020-09-08T16:30:55.250 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:30:55.250 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:30:55.251 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:30:55.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.154687 2020-09-08T16:30:55.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:30:55.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:30:55.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:35: run: for func in $funcs 2020-09-08T16:30:55.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:36: run: setup td/osd-backfill-space 2020-09-08T16:30:55.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-space 2020-09-08T16:30:55.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-space 2020-09-08T16:30:55.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2020-09-08T16:30:55.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:30:55.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2020-09-08T16:30:55.254 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:30:55.254 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:30:55.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:30:55.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:30:55.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:30:55.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:30:55.256 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:30:55.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:30:55.257 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:30:55.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:30:55.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:30:55.257 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:30:55.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:30:55.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:30:55.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:30:55.259 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:30:55.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:30:55.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:30:55.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2020-09-08T16:30:55.261 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:30:55.261 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:30:55.261 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:30:55.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.154687 2020-09-08T16:30:55.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:30:55.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:30:55.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-space 2020-09-08T16:30:55.263 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T16:30:55.264 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:30:55.264 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:30:55.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.154687 2020-09-08T16:30:55.266 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T16:30:55.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T16:30:55.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T16:30:55.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2020-09-08T16:30:55.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:37: run: TEST_ec_backfill_multi td/osd-backfill-space 2020-09-08T16:30:55.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:748: TEST_ec_backfill_multi: local dir=td/osd-backfill-space 2020-09-08T16:30:55.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:749: TEST_ec_backfill_multi: local EC= 2020-09-08T16:30:55.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:750: TEST_ec_backfill_multi: local pools=2 2020-09-08T16:30:55.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:751: TEST_ec_backfill_multi: local OSDS=6 2020-09-08T16:30:55.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:752: TEST_ec_backfill_multi: local k=3 2020-09-08T16:30:55.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:753: TEST_ec_backfill_multi: local m=2 2020-09-08T16:30:55.269 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:754: TEST_ec_backfill_multi: expr 600 / 3 2020-09-08T16:30:55.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:754: TEST_ec_backfill_multi: local ecobjects=200 2020-09-08T16:30:55.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:756: TEST_ec_backfill_multi: run_mon td/osd-backfill-space a 2020-09-08T16:30:55.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-space 2020-09-08T16:30:55.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T16:30:55.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T16:30:55.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T16:30:55.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-space/a 2020-09-08T16:30:55.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2020-09-08T16:30:55.575 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T16:30:55.576 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:30:55.576 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:30:55.576 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:30:55.576 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:30:55.576 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:30:55.577 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:30:55.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T16:30:55.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T16:30:55.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T16:30:55.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:30:55.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:30:55.762 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T16:30:55.762 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T16:30:55.762 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:30:55.762 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:30:55.763 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:30:55.763 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:30:55.764 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:30:55.764 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:30:55.764 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.154687/ceph-mon.a.asok 2020-09-08T16:30:55.764 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:30:55.764 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.154687/ceph-mon.a.asok config get fsid 2020-09-08T16:30:55.855 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T16:30:55.855 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:30:55.855 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:30:55.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T16:30:55.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T16:30:55.856 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:30:55.856 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:30:55.856 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:30:55.857 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:30:55.857 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:30:55.857 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:30:55.857 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.154687/ceph-mon.a.asok 2020-09-08T16:30:55.858 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:30:55.858 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.154687/ceph-mon.a.asok config get mon_host 2020-09-08T16:30:55.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:757: TEST_ec_backfill_multi: run_mgr td/osd-backfill-space x 2020-09-08T16:30:55.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-space 2020-09-08T16:30:55.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T16:30:55.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T16:30:55.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T16:30:55.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-space/x 2020-09-08T16:30:55.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T16:30:56.485 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T16:30:56.485 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:30:56.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:30:56.486 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:30:56.486 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:30:56.486 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:30:56.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:30:56.487 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:30:56.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:30:56.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:758: TEST_ec_backfill_multi: export CEPH_ARGS 2020-09-08T16:30:56.516 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:760: TEST_ec_backfill_multi: expr 6 - 1 2020-09-08T16:30:56.517 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:760: TEST_ec_backfill_multi: seq 0 5 2020-09-08T16:30:56.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:760: TEST_ec_backfill_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:30:56.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:762: TEST_ec_backfill_multi: run_osd td/osd-backfill-space 0 2020-09-08T16:30:56.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:30:56.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:30:56.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T16:30:56.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:30:56.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/0 2020-09-08T16:30:56.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:30:56.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:30:56.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:30:56.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:30:56.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2020-09-08T16:30:56.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2020-09-08T16:30:56.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:30:56.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:30:56.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:30:56.521 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:30:56.521 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:30:56.521 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:30:56.522 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:30:56.522 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:30:56.522 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:30:56.522 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:30:56.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:30:56.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:30:56.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:30:56.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:30:56.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:30:56.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:30:56.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:30:56.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:30:56.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:30:56.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:30:56.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:30:56.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/0 2020-09-08T16:30:56.525 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:30:56.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=91274daf-505f-42cd-bc39-dbd0c6756ee5 2020-09-08T16:30:56.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 91274daf-505f-42cd-bc39-dbd0c6756ee5' 2020-09-08T16:30:56.527 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:30:56.527 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 91274daf-505f-42cd-bc39-dbd0c6756ee5 2020-09-08T16:30:56.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDAsVdf6js2IBAArVQh3d61lf3Moj0ihG5F+Q== 2020-09-08T16:30:56.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDAsVdf6js2IBAArVQh3d61lf3Moj0ihG5F+Q=="}' 2020-09-08T16:30:56.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 91274daf-505f-42cd-bc39-dbd0c6756ee5 -i td/osd-backfill-space/0/new.json 2020-09-08T16:30:56.870 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:30:56.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/0/new.json 2020-09-08T16:30:56.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDAsVdf6js2IBAArVQh3d61lf3Moj0ihG5F+Q== --osd-uuid 91274daf-505f-42cd-bc39-dbd0c6756ee5 2020-09-08T16:30:56.908 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:30:56.913+0000 7f1f3cbd4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:30:56.910 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:30:56.915+0000 7f1f3cbd4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:30:56.911 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:30:56.917+0000 7f1f3cbd4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:30:56.912 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:30:56.918+0000 7f1f3cbd4ec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T16:30:56.912 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:30:56.918+0000 7f1f3cbd4ec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T16:30:56.913 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:30:56.918+0000 7f1f3cbd4ec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T16:30:56.950 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:30:56.955+0000 7f1f3cbd4ec0 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2020-09-08T16:31:01.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2020-09-08T16:31:01.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:31:01.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T16:31:01.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:31:01.074 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T16:31:01.600 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T16:31:01.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T16:31:01.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:31:01.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:31:01.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:31:01.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:31:01.629 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:01.629+0000 7f45f16baec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:01.652 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:01.652+0000 7f45f16baec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:01.652 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:01.653+0000 7f45f16baec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:01.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T16:31:01.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:31:01.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T16:31:01.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:31:01.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:31:01.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:31:01.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:31:01.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:31:01.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:31:01.998 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:31:02.164 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:02.169+0000 7f45f16baec0 -1 Falling back to public interface 2020-09-08T16:31:02.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:31:02.965 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:02.969+0000 7f45f16baec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T16:31:03.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:31:03.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:31:03.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:31:03.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:31:03.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:31:03.413 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:31:03.831 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/446533,v1:127.0.0.1:6803/446533] [v2:127.0.0.1:6804/446533,v1:127.0.0.1:6805/446533] exists,up 91274daf-505f-42cd-bc39-dbd0c6756ee5 2020-09-08T16:31:03.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:31:03.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:31:03.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:31:03.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:760: TEST_ec_backfill_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:31:03.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:762: TEST_ec_backfill_multi: run_osd td/osd-backfill-space 1 2020-09-08T16:31:03.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:31:03.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:31:03.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T16:31:03.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:31:03.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/1 2020-09-08T16:31:03.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:31:03.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:31:03.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:31:03.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:31:03.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2020-09-08T16:31:03.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2020-09-08T16:31:03.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:31:03.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:31:03.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:31:03.836 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:31:03.837 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:31:03.837 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:31:03.841 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:31:03.841 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:31:03.841 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:31:03.841 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:31:03.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:31:03.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:31:03.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:31:03.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:31:03.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:31:03.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:31:03.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:31:03.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:31:03.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:31:03.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:31:03.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:31:03.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/1 2020-09-08T16:31:03.845 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:31:03.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=5688c494-2dc7-4042-a3bb-438373bee7ec 2020-09-08T16:31:03.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 5688c494-2dc7-4042-a3bb-438373bee7ec' 2020-09-08T16:31:03.845 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:31:03.845 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 5688c494-2dc7-4042-a3bb-438373bee7ec 2020-09-08T16:31:03.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDHsVdfv1QDMxAAorh1TUH0UQzb3qjhZUDhCQ== 2020-09-08T16:31:03.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDHsVdfv1QDMxAAorh1TUH0UQzb3qjhZUDhCQ=="}' 2020-09-08T16:31:03.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 5688c494-2dc7-4042-a3bb-438373bee7ec -i td/osd-backfill-space/1/new.json 2020-09-08T16:31:04.378 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:31:04.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/1/new.json 2020-09-08T16:31:04.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDHsVdfv1QDMxAAorh1TUH0UQzb3qjhZUDhCQ== --osd-uuid 5688c494-2dc7-4042-a3bb-438373bee7ec 2020-09-08T16:31:04.417 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:04.422+0000 7f4fa46c6ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:04.419 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:04.423+0000 7f4fa46c6ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:04.420 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:04.424+0000 7f4fa46c6ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:04.421 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:04.425+0000 7f4fa46c6ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T16:31:04.421 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:04.425+0000 7f4fa46c6ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T16:31:04.421 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:04.425+0000 7f4fa46c6ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T16:31:04.471 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:04.476+0000 7f4fa46c6ec0 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2020-09-08T16:31:08.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2020-09-08T16:31:12.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:31:12.793 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T16:31:12.794 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T16:31:12.794 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:31:12.794 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:31:12.794 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/447527,v1:127.0.0.1:6811/447527] [v2:127.0.0.1:6812/447527,v1:127.0.0.1:6813/447527] exists,up 5688c494-2dc7-4042-a3bb-438373bee7ec 2020-09-08T16:31:12.794 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 eef5c6bf-1d02-4f16-abba-cf39a41cc9c8 2020-09-08T16:31:12.795 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:31:12.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T16:31:12.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:31:12.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T16:31:12.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:31:12.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:31:12.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:31:12.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:31:12.796 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:09.256+0000 7fe8f6a6aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:12.797 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:09.265+0000 7fe8f6a6aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:12.797 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:09.266+0000 7fe8f6a6aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:12.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T16:31:12.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:31:12.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T16:31:12.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:31:12.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:31:12.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:31:12.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:31:12.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:31:12.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:31:12.799 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:09.787+0000 7fe8f6a6aec0 -1 Falling back to public interface 2020-09-08T16:31:12.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:31:12.799 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:10.599+0000 7fe8f6a6aec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T16:31:12.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:31:12.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:31:12.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:31:12.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:31:12.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:31:12.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:31:12.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:31:12.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:31:12.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:760: TEST_ec_backfill_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:31:12.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:762: TEST_ec_backfill_multi: run_osd td/osd-backfill-space 2 2020-09-08T16:31:12.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:31:12.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:31:12.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T16:31:12.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:31:12.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/2 2020-09-08T16:31:12.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:31:12.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:31:12.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:31:12.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:31:12.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2020-09-08T16:31:12.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2020-09-08T16:31:12.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:31:12.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:31:12.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:31:12.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:31:12.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:31:12.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:31:12.805 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:31:12.805 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:31:12.805 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:31:12.805 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:31:12.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:31:12.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:31:12.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:31:12.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:31:12.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:31:12.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:31:12.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:31:12.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:31:12.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:31:12.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:31:12.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:31:12.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/2 2020-09-08T16:31:12.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:31:12.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=eef5c6bf-1d02-4f16-abba-cf39a41cc9c8 2020-09-08T16:31:12.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 eef5c6bf-1d02-4f16-abba-cf39a41cc9c8' 2020-09-08T16:31:12.809 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:31:12.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDPsVdfRodsHRAABhQBjUHZlrMwmxdMW03xSQ== 2020-09-08T16:31:12.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDPsVdfRodsHRAABhQBjUHZlrMwmxdMW03xSQ=="}' 2020-09-08T16:31:12.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new eef5c6bf-1d02-4f16-abba-cf39a41cc9c8 -i td/osd-backfill-space/2/new.json 2020-09-08T16:31:12.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/2/new.json 2020-09-08T16:31:12.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDPsVdfRodsHRAABhQBjUHZlrMwmxdMW03xSQ== --osd-uuid eef5c6bf-1d02-4f16-abba-cf39a41cc9c8 2020-09-08T16:31:12.810 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:12.068+0000 7f4cb9ebaec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:12.810 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:12.070+0000 7f4cb9ebaec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:12.810 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:12.071+0000 7f4cb9ebaec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:12.810 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:12.071+0000 7f4cb9ebaec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T16:31:12.811 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:12.071+0000 7f4cb9ebaec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T16:31:12.811 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:12.071+0000 7f4cb9ebaec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T16:31:12.811 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:12.125+0000 7f4cb9ebaec0 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2020-09-08T16:31:16.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2020-09-08T16:31:16.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:31:16.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T16:31:16.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:31:16.663 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T16:31:17.216 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T16:31:17.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T16:31:17.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:31:17.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:31:17.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:31:17.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:31:17.238 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:17.243+0000 7f9c8fbf7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:17.240 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:17.245+0000 7f9c8fbf7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:17.242 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:17.247+0000 7f9c8fbf7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:17.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T16:31:17.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:31:17.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T16:31:17.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:31:17.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:31:17.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:31:17.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:31:17.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:31:17.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:31:17.606 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:31:17.766 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:17.771+0000 7f9c8fbf7ec0 -1 Falling back to public interface 2020-09-08T16:31:18.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:31:18.641 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:18.646+0000 7f9c8fbf7ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T16:31:19.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:31:19.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:31:19.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:31:19.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:31:19.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:31:19.019 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:31:19.476 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/448521,v1:127.0.0.1:6819/448521] [v2:127.0.0.1:6820/448521,v1:127.0.0.1:6821/448521] exists,up eef5c6bf-1d02-4f16-abba-cf39a41cc9c8 2020-09-08T16:31:19.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:31:19.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:31:19.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:31:19.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:760: TEST_ec_backfill_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:31:19.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:762: TEST_ec_backfill_multi: run_osd td/osd-backfill-space 3 2020-09-08T16:31:19.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:31:19.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:31:19.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T16:31:19.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:31:19.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/3 2020-09-08T16:31:19.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:31:19.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:31:19.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:31:19.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:31:19.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/3' 2020-09-08T16:31:19.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/3/journal' 2020-09-08T16:31:19.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:31:19.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:31:19.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:31:19.480 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:31:19.480 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:31:19.480 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:31:19.481 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:31:19.481 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:31:19.481 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:31:19.481 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:31:19.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:31:19.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:31:19.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:31:19.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:31:19.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:31:19.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:31:19.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:31:19.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:31:19.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:31:19.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:31:19.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:31:19.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/3 2020-09-08T16:31:19.484 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:31:19.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=ae9c714f-ecf5-4a62-89aa-a011854e5756 2020-09-08T16:31:19.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 ae9c714f-ecf5-4a62-89aa-a011854e5756' 2020-09-08T16:31:19.485 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:31:19.485 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 ae9c714f-ecf5-4a62-89aa-a011854e5756 2020-09-08T16:31:19.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDXsVdfp9HEHRAAnp+3E3WJi5zp59eQ5zBeQg== 2020-09-08T16:31:19.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDXsVdfp9HEHRAAnp+3E3WJi5zp59eQ5zBeQg=="}' 2020-09-08T16:31:19.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new ae9c714f-ecf5-4a62-89aa-a011854e5756 -i td/osd-backfill-space/3/new.json 2020-09-08T16:31:20.051 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T16:31:20.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/3/new.json 2020-09-08T16:31:20.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDXsVdfp9HEHRAAnp+3E3WJi5zp59eQ5zBeQg== --osd-uuid ae9c714f-ecf5-4a62-89aa-a011854e5756 2020-09-08T16:31:20.090 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:20.095+0000 7f8c21e51ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:20.091 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:20.097+0000 7f8c21e51ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:20.092 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:20.098+0000 7f8c21e51ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:20.093 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:20.098+0000 7f8c21e51ec0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2020-09-08T16:31:20.093 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:20.098+0000 7f8c21e51ec0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2020-09-08T16:31:20.093 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:20.098+0000 7f8c21e51ec0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2020-09-08T16:31:20.172 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:20.178+0000 7f8c21e51ec0 -1 bluestore(td/osd-backfill-space/3) _read_fsid unparsable uuid 2020-09-08T16:31:24.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/3/keyring 2020-09-08T16:31:24.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:31:24.383 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T16:31:24.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T16:31:24.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:31:24.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T16:31:24.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:31:24.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:31:24.919 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T16:31:24.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:31:24.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:31:24.944 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:24.949+0000 7fd9e8bb8ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:24.955 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:24.960+0000 7fd9e8bb8ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:24.956 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:24.962+0000 7fd9e8bb8ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:25.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T16:31:25.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:31:25.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T16:31:25.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:31:25.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:31:25.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:31:25.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:31:25.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:31:25.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:31:25.324 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:31:25.473 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:25.478+0000 7fd9e8bb8ec0 -1 Falling back to public interface 2020-09-08T16:31:25.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:31:26.255 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:26.260+0000 7fd9e8bb8ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T16:31:26.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:31:26.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:31:26.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:31:26.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:31:26.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:31:26.719 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:31:27.166 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/449515,v1:127.0.0.1:6827/449515] [v2:127.0.0.1:6828/449515,v1:127.0.0.1:6829/449515] exists,up ae9c714f-ecf5-4a62-89aa-a011854e5756 2020-09-08T16:31:27.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:31:27.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:31:27.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:31:27.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:760: TEST_ec_backfill_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:31:27.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:762: TEST_ec_backfill_multi: run_osd td/osd-backfill-space 4 2020-09-08T16:31:27.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:31:27.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:31:27.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=4 2020-09-08T16:31:27.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:31:27.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/4 2020-09-08T16:31:27.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:31:27.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:31:27.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:31:27.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:31:27.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/4' 2020-09-08T16:31:27.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/4/journal' 2020-09-08T16:31:27.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:31:27.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:31:27.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:31:27.170 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:31:27.170 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:31:27.171 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:31:27.171 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:31:27.171 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:31:27.171 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:31:27.171 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:31:27.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:31:27.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:31:27.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:31:27.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:31:27.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:31:27.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:31:27.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:31:27.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:31:27.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:31:27.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:31:27.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:31:27.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/4 2020-09-08T16:31:27.174 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:31:27.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=59f30848-a09a-478c-a849-1e35a7c30558 2020-09-08T16:31:27.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd4 59f30848-a09a-478c-a849-1e35a7c30558' 2020-09-08T16:31:27.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:31:27.175 INFO:tasks.workunit.client.0.smithi065.stdout:add osd4 59f30848-a09a-478c-a849-1e35a7c30558 2020-09-08T16:31:27.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDfsVdfUjFKCxAAMcusxU14BvjeqD5oue/tnA== 2020-09-08T16:31:27.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDfsVdfUjFKCxAAMcusxU14BvjeqD5oue/tnA=="}' 2020-09-08T16:31:27.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 59f30848-a09a-478c-a849-1e35a7c30558 -i td/osd-backfill-space/4/new.json 2020-09-08T16:31:27.691 INFO:tasks.workunit.client.0.smithi065.stdout:4 2020-09-08T16:31:27.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/4/new.json 2020-09-08T16:31:27.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 4 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDfsVdfUjFKCxAAMcusxU14BvjeqD5oue/tnA== --osd-uuid 59f30848-a09a-478c-a849-1e35a7c30558 2020-09-08T16:31:27.733 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:27.735+0000 7f2826646ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:27.733 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:27.737+0000 7f2826646ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:27.734 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:27.738+0000 7f2826646ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:27.734 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:27.738+0000 7f2826646ec0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2020-09-08T16:31:27.734 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:27.738+0000 7f2826646ec0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2020-09-08T16:31:27.735 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:27.738+0000 7f2826646ec0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2020-09-08T16:31:27.791 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:27.797+0000 7f2826646ec0 -1 bluestore(td/osd-backfill-space/4) _read_fsid unparsable uuid 2020-09-08T16:31:32.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/4/keyring 2020-09-08T16:31:32.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:31:32.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd4 key to auth repository 2020-09-08T16:31:32.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:31:32.088 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd4 key to auth repository 2020-09-08T16:31:32.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.4 2020-09-08T16:31:32.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 4 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:31:32.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:31:32.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:31:32.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:31:32.640 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.4 2020-09-08T16:31:32.665 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:32.670+0000 7f27f8f8dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:32.667 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:32.672+0000 7f27f8f8dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:32.668 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:32.673+0000 7f27f8f8dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:33.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 4 2020-09-08T16:31:33.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:31:33.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=4 2020-09-08T16:31:33.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:31:33.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:31:33.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:31:33.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:31:33.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:31:33.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:31:33.033 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:31:33.185 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:33.190+0000 7f27f8f8dec0 -1 Falling back to public interface 2020-09-08T16:31:33.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:31:33.995 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:34.000+0000 7f27f8f8dec0 -1 osd.4 0 log_to_monitors {default=true} 2020-09-08T16:31:34.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:31:34.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:31:34.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:31:34.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:31:34.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:31:34.450 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:31:34.928 INFO:tasks.workunit.client.0.smithi065.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/450509,v1:127.0.0.1:6835/450509] [v2:127.0.0.1:6836/450509,v1:127.0.0.1:6837/450509] exists,up 59f30848-a09a-478c-a849-1e35a7c30558 2020-09-08T16:31:34.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:31:34.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:31:34.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:31:34.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:760: TEST_ec_backfill_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:31:34.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:762: TEST_ec_backfill_multi: run_osd td/osd-backfill-space 5 2020-09-08T16:31:34.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:31:34.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:31:34.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=5 2020-09-08T16:31:34.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:31:34.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/5 2020-09-08T16:31:34.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:31:34.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:31:34.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:31:34.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:31:34.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/5' 2020-09-08T16:31:34.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/5/journal' 2020-09-08T16:31:34.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:31:34.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:31:34.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:31:34.933 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:31:34.933 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:31:34.934 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:31:34.934 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:31:34.934 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:31:34.935 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:31:34.935 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:31:34.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:31:34.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:31:34.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:31:34.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:31:34.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:31:34.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:31:34.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:31:34.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:31:34.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:31:34.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:31:34.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:31:34.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/5 2020-09-08T16:31:34.938 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:31:34.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=f34d7a20-898a-4b71-88e3-c3d8f0dfac55 2020-09-08T16:31:34.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd5 f34d7a20-898a-4b71-88e3-c3d8f0dfac55' 2020-09-08T16:31:34.939 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:31:34.939 INFO:tasks.workunit.client.0.smithi065.stdout:add osd5 f34d7a20-898a-4b71-88e3-c3d8f0dfac55 2020-09-08T16:31:34.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDmsVdf7uG7OBAA1ZBfTIG4W58r5Hi/weewSQ== 2020-09-08T16:31:34.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDmsVdf7uG7OBAA1ZBfTIG4W58r5Hi/weewSQ=="}' 2020-09-08T16:31:34.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new f34d7a20-898a-4b71-88e3-c3d8f0dfac55 -i td/osd-backfill-space/5/new.json 2020-09-08T16:31:35.545 INFO:tasks.workunit.client.0.smithi065.stdout:5 2020-09-08T16:31:35.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/5/new.json 2020-09-08T16:31:35.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 5 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDmsVdf7uG7OBAA1ZBfTIG4W58r5Hi/weewSQ== --osd-uuid f34d7a20-898a-4b71-88e3-c3d8f0dfac55 2020-09-08T16:31:35.584 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:35.589+0000 7f9536938ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:35.585 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:35.591+0000 7f9536938ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:35.587 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:35.592+0000 7f9536938ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:35.588 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:35.593+0000 7f9536938ec0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2020-09-08T16:31:35.588 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:35.593+0000 7f9536938ec0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2020-09-08T16:31:35.588 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:35.593+0000 7f9536938ec0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2020-09-08T16:31:35.670 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:35.676+0000 7f9536938ec0 -1 bluestore(td/osd-backfill-space/5) _read_fsid unparsable uuid 2020-09-08T16:31:39.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/5/keyring 2020-09-08T16:31:39.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:31:39.888 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd5 key to auth repository 2020-09-08T16:31:39.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd5 key to auth repository 2020-09-08T16:31:39.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:31:40.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.5 2020-09-08T16:31:40.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 5 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:31:40.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:31:40.428 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.5 2020-09-08T16:31:40.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:31:40.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:31:40.454 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:40.459+0000 7f1899852ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:40.455 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:40.461+0000 7f1899852ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:40.456 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:40.462+0000 7f1899852ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:31:40.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 5 2020-09-08T16:31:40.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:31:40.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=5 2020-09-08T16:31:40.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:31:40.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:31:40.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:31:40.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:31:40.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:31:40.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T16:31:40.829 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:31:40.972 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:40.977+0000 7f1899852ec0 -1 Falling back to public interface 2020-09-08T16:31:41.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:31:41.794 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:31:41.800+0000 7f1899852ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-09-08T16:31:42.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:31:42.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:31:42.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:31:42.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:31:42.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T16:31:42.231 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:31:42.678 INFO:tasks.workunit.client.0.smithi065.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/451503,v1:127.0.0.1:6843/451503] [v2:127.0.0.1:6844/451503,v1:127.0.0.1:6845/451503] exists,up f34d7a20-898a-4b71-88e3-c3d8f0dfac55 2020-09-08T16:31:42.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:31:42.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:31:42.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:31:42.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:769: TEST_ec_backfill_multi: ceph osd set-backfillfull-ratio .85 2020-09-08T16:31:43.449 INFO:tasks.workunit.client.0.smithi065.stderr:osd set-backfillfull-ratio 0.85 2020-09-08T16:31:43.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:771: TEST_ec_backfill_multi: ceph osd set-require-min-compat-client luminous 2020-09-08T16:31:44.161 INFO:tasks.workunit.client.0.smithi065.stderr:set require_min_compat_client to luminous 2020-09-08T16:31:44.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:772: TEST_ec_backfill_multi: create_pool fillpool 1 1 2020-09-08T16:31:44.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create fillpool 1 1 2020-09-08T16:31:44.853 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'fillpool' already exists 2020-09-08T16:31:44.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:31:45.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:773: TEST_ec_backfill_multi: ceph osd pool set fillpool size 1 --yes-i-really-mean-it 2020-09-08T16:31:46.571 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 1 2020-09-08T16:31:46.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:781: TEST_ec_backfill_multi: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=9 2020-09-08T16:31:46.580 INFO:tasks.workunit.client.0.smithi065.stderr:9+0 records in 2020-09-08T16:31:46.580 INFO:tasks.workunit.client.0.smithi065.stderr:9+0 records out 2020-09-08T16:31:46.580 INFO:tasks.workunit.client.0.smithi065.stderr:9216 bytes (9.2 kB, 9.0 KiB) copied, 0.000105069 s, 87.7 MB/s 2020-09-08T16:31:46.581 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: seq 1 200 2020-09-08T16:31:46.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:46.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj1 td/osd-backfill-space/datafile 2020-09-08T16:31:47.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:47.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj2 td/osd-backfill-space/datafile 2020-09-08T16:31:47.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:47.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj3 td/osd-backfill-space/datafile 2020-09-08T16:31:47.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:47.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj4 td/osd-backfill-space/datafile 2020-09-08T16:31:47.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:47.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj5 td/osd-backfill-space/datafile 2020-09-08T16:31:47.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:47.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj6 td/osd-backfill-space/datafile 2020-09-08T16:31:47.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:47.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj7 td/osd-backfill-space/datafile 2020-09-08T16:31:48.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:48.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj8 td/osd-backfill-space/datafile 2020-09-08T16:31:48.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:48.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj9 td/osd-backfill-space/datafile 2020-09-08T16:31:48.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:48.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj10 td/osd-backfill-space/datafile 2020-09-08T16:31:48.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:48.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj11 td/osd-backfill-space/datafile 2020-09-08T16:31:48.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:48.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj12 td/osd-backfill-space/datafile 2020-09-08T16:31:48.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:48.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj13 td/osd-backfill-space/datafile 2020-09-08T16:31:48.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:48.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj14 td/osd-backfill-space/datafile 2020-09-08T16:31:48.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:48.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj15 td/osd-backfill-space/datafile 2020-09-08T16:31:48.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:48.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj16 td/osd-backfill-space/datafile 2020-09-08T16:31:48.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:48.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj17 td/osd-backfill-space/datafile 2020-09-08T16:31:48.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:48.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj18 td/osd-backfill-space/datafile 2020-09-08T16:31:48.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:48.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj19 td/osd-backfill-space/datafile 2020-09-08T16:31:48.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:48.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj20 td/osd-backfill-space/datafile 2020-09-08T16:31:49.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:49.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj21 td/osd-backfill-space/datafile 2020-09-08T16:31:49.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:49.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj22 td/osd-backfill-space/datafile 2020-09-08T16:31:49.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:49.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj23 td/osd-backfill-space/datafile 2020-09-08T16:31:49.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:49.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj24 td/osd-backfill-space/datafile 2020-09-08T16:31:49.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:49.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj25 td/osd-backfill-space/datafile 2020-09-08T16:31:49.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:49.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj26 td/osd-backfill-space/datafile 2020-09-08T16:31:49.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:49.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj27 td/osd-backfill-space/datafile 2020-09-08T16:31:49.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:49.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj28 td/osd-backfill-space/datafile 2020-09-08T16:31:49.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:49.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj29 td/osd-backfill-space/datafile 2020-09-08T16:31:49.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:49.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj30 td/osd-backfill-space/datafile 2020-09-08T16:31:49.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:49.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj31 td/osd-backfill-space/datafile 2020-09-08T16:31:49.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:49.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj32 td/osd-backfill-space/datafile 2020-09-08T16:31:50.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:50.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj33 td/osd-backfill-space/datafile 2020-09-08T16:31:50.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:50.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj34 td/osd-backfill-space/datafile 2020-09-08T16:31:50.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:50.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj35 td/osd-backfill-space/datafile 2020-09-08T16:31:50.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:50.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj36 td/osd-backfill-space/datafile 2020-09-08T16:31:50.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:50.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj37 td/osd-backfill-space/datafile 2020-09-08T16:31:50.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:50.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj38 td/osd-backfill-space/datafile 2020-09-08T16:31:50.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:50.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj39 td/osd-backfill-space/datafile 2020-09-08T16:31:50.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:50.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj40 td/osd-backfill-space/datafile 2020-09-08T16:31:50.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:50.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj41 td/osd-backfill-space/datafile 2020-09-08T16:31:50.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:50.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj42 td/osd-backfill-space/datafile 2020-09-08T16:31:50.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:50.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj43 td/osd-backfill-space/datafile 2020-09-08T16:31:50.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:50.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj44 td/osd-backfill-space/datafile 2020-09-08T16:31:51.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:51.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj45 td/osd-backfill-space/datafile 2020-09-08T16:31:51.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:51.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj46 td/osd-backfill-space/datafile 2020-09-08T16:31:51.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:51.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj47 td/osd-backfill-space/datafile 2020-09-08T16:31:51.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:51.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj48 td/osd-backfill-space/datafile 2020-09-08T16:31:51.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:51.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj49 td/osd-backfill-space/datafile 2020-09-08T16:31:51.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:51.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj50 td/osd-backfill-space/datafile 2020-09-08T16:31:51.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:51.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj51 td/osd-backfill-space/datafile 2020-09-08T16:31:51.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:51.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj52 td/osd-backfill-space/datafile 2020-09-08T16:31:51.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:51.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj53 td/osd-backfill-space/datafile 2020-09-08T16:31:51.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:51.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj54 td/osd-backfill-space/datafile 2020-09-08T16:31:51.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:51.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj55 td/osd-backfill-space/datafile 2020-09-08T16:31:51.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:51.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj56 td/osd-backfill-space/datafile 2020-09-08T16:31:51.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:51.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj57 td/osd-backfill-space/datafile 2020-09-08T16:31:52.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:52.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj58 td/osd-backfill-space/datafile 2020-09-08T16:31:52.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:52.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj59 td/osd-backfill-space/datafile 2020-09-08T16:31:52.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:52.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj60 td/osd-backfill-space/datafile 2020-09-08T16:31:52.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:52.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj61 td/osd-backfill-space/datafile 2020-09-08T16:31:52.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:52.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj62 td/osd-backfill-space/datafile 2020-09-08T16:31:52.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:52.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj63 td/osd-backfill-space/datafile 2020-09-08T16:31:52.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:52.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj64 td/osd-backfill-space/datafile 2020-09-08T16:31:52.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:52.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj65 td/osd-backfill-space/datafile 2020-09-08T16:31:52.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:52.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj66 td/osd-backfill-space/datafile 2020-09-08T16:31:52.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:52.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj67 td/osd-backfill-space/datafile 2020-09-08T16:31:52.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:52.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj68 td/osd-backfill-space/datafile 2020-09-08T16:31:52.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:52.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj69 td/osd-backfill-space/datafile 2020-09-08T16:31:53.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:53.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj70 td/osd-backfill-space/datafile 2020-09-08T16:31:53.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:53.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj71 td/osd-backfill-space/datafile 2020-09-08T16:31:53.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:53.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj72 td/osd-backfill-space/datafile 2020-09-08T16:31:53.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:53.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj73 td/osd-backfill-space/datafile 2020-09-08T16:31:53.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:53.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj74 td/osd-backfill-space/datafile 2020-09-08T16:31:53.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:53.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj75 td/osd-backfill-space/datafile 2020-09-08T16:31:53.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:53.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj76 td/osd-backfill-space/datafile 2020-09-08T16:31:53.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:53.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj77 td/osd-backfill-space/datafile 2020-09-08T16:31:53.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:53.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj78 td/osd-backfill-space/datafile 2020-09-08T16:31:53.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:53.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj79 td/osd-backfill-space/datafile 2020-09-08T16:31:53.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:53.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj80 td/osd-backfill-space/datafile 2020-09-08T16:31:53.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:53.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj81 td/osd-backfill-space/datafile 2020-09-08T16:31:53.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:53.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj82 td/osd-backfill-space/datafile 2020-09-08T16:31:54.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:54.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj83 td/osd-backfill-space/datafile 2020-09-08T16:31:54.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:54.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj84 td/osd-backfill-space/datafile 2020-09-08T16:31:54.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:54.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj85 td/osd-backfill-space/datafile 2020-09-08T16:31:54.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:54.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj86 td/osd-backfill-space/datafile 2020-09-08T16:31:54.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:54.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj87 td/osd-backfill-space/datafile 2020-09-08T16:31:54.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:54.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj88 td/osd-backfill-space/datafile 2020-09-08T16:31:54.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:54.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj89 td/osd-backfill-space/datafile 2020-09-08T16:31:54.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:54.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj90 td/osd-backfill-space/datafile 2020-09-08T16:31:54.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:54.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj91 td/osd-backfill-space/datafile 2020-09-08T16:31:54.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:54.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj92 td/osd-backfill-space/datafile 2020-09-08T16:31:54.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:54.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj93 td/osd-backfill-space/datafile 2020-09-08T16:31:54.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:54.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj94 td/osd-backfill-space/datafile 2020-09-08T16:31:55.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:55.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj95 td/osd-backfill-space/datafile 2020-09-08T16:31:55.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:55.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj96 td/osd-backfill-space/datafile 2020-09-08T16:31:55.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:55.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj97 td/osd-backfill-space/datafile 2020-09-08T16:31:55.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:55.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj98 td/osd-backfill-space/datafile 2020-09-08T16:31:55.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:55.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj99 td/osd-backfill-space/datafile 2020-09-08T16:31:55.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:55.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj100 td/osd-backfill-space/datafile 2020-09-08T16:31:55.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:55.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj101 td/osd-backfill-space/datafile 2020-09-08T16:31:55.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:55.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj102 td/osd-backfill-space/datafile 2020-09-08T16:31:55.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:55.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj103 td/osd-backfill-space/datafile 2020-09-08T16:31:55.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:55.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj104 td/osd-backfill-space/datafile 2020-09-08T16:31:55.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:55.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj105 td/osd-backfill-space/datafile 2020-09-08T16:31:55.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:55.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj106 td/osd-backfill-space/datafile 2020-09-08T16:31:55.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:55.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj107 td/osd-backfill-space/datafile 2020-09-08T16:31:56.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:56.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj108 td/osd-backfill-space/datafile 2020-09-08T16:31:56.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:56.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj109 td/osd-backfill-space/datafile 2020-09-08T16:31:56.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:56.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj110 td/osd-backfill-space/datafile 2020-09-08T16:31:56.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:56.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj111 td/osd-backfill-space/datafile 2020-09-08T16:31:56.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:56.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj112 td/osd-backfill-space/datafile 2020-09-08T16:31:56.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:56.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj113 td/osd-backfill-space/datafile 2020-09-08T16:31:56.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:56.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj114 td/osd-backfill-space/datafile 2020-09-08T16:31:56.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:56.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj115 td/osd-backfill-space/datafile 2020-09-08T16:31:56.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:56.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj116 td/osd-backfill-space/datafile 2020-09-08T16:31:56.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:56.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj117 td/osd-backfill-space/datafile 2020-09-08T16:31:56.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:56.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj118 td/osd-backfill-space/datafile 2020-09-08T16:31:56.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:56.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj119 td/osd-backfill-space/datafile 2020-09-08T16:31:57.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:57.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj120 td/osd-backfill-space/datafile 2020-09-08T16:31:57.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:57.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj121 td/osd-backfill-space/datafile 2020-09-08T16:31:57.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:57.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj122 td/osd-backfill-space/datafile 2020-09-08T16:31:57.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:57.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj123 td/osd-backfill-space/datafile 2020-09-08T16:31:57.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:57.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj124 td/osd-backfill-space/datafile 2020-09-08T16:31:57.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:57.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj125 td/osd-backfill-space/datafile 2020-09-08T16:31:57.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:57.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj126 td/osd-backfill-space/datafile 2020-09-08T16:31:57.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:57.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj127 td/osd-backfill-space/datafile 2020-09-08T16:31:57.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:57.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj128 td/osd-backfill-space/datafile 2020-09-08T16:31:57.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:57.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj129 td/osd-backfill-space/datafile 2020-09-08T16:31:57.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:57.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj130 td/osd-backfill-space/datafile 2020-09-08T16:31:57.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:57.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj131 td/osd-backfill-space/datafile 2020-09-08T16:31:57.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:57.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj132 td/osd-backfill-space/datafile 2020-09-08T16:31:58.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:58.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj133 td/osd-backfill-space/datafile 2020-09-08T16:31:58.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:58.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj134 td/osd-backfill-space/datafile 2020-09-08T16:31:58.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:58.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj135 td/osd-backfill-space/datafile 2020-09-08T16:31:58.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:58.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj136 td/osd-backfill-space/datafile 2020-09-08T16:31:58.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:58.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj137 td/osd-backfill-space/datafile 2020-09-08T16:31:58.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:58.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj138 td/osd-backfill-space/datafile 2020-09-08T16:31:58.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:58.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj139 td/osd-backfill-space/datafile 2020-09-08T16:31:58.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:58.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj140 td/osd-backfill-space/datafile 2020-09-08T16:31:58.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:58.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj141 td/osd-backfill-space/datafile 2020-09-08T16:31:58.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:58.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj142 td/osd-backfill-space/datafile 2020-09-08T16:31:58.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:58.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj143 td/osd-backfill-space/datafile 2020-09-08T16:31:58.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:58.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj144 td/osd-backfill-space/datafile 2020-09-08T16:31:59.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:59.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj145 td/osd-backfill-space/datafile 2020-09-08T16:31:59.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:59.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj146 td/osd-backfill-space/datafile 2020-09-08T16:31:59.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:59.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj147 td/osd-backfill-space/datafile 2020-09-08T16:31:59.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:59.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj148 td/osd-backfill-space/datafile 2020-09-08T16:31:59.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:59.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj149 td/osd-backfill-space/datafile 2020-09-08T16:31:59.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:59.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj150 td/osd-backfill-space/datafile 2020-09-08T16:31:59.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:59.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj151 td/osd-backfill-space/datafile 2020-09-08T16:31:59.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:59.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj152 td/osd-backfill-space/datafile 2020-09-08T16:31:59.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:59.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj153 td/osd-backfill-space/datafile 2020-09-08T16:31:59.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:59.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj154 td/osd-backfill-space/datafile 2020-09-08T16:31:59.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:59.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj155 td/osd-backfill-space/datafile 2020-09-08T16:31:59.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:59.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj156 td/osd-backfill-space/datafile 2020-09-08T16:31:59.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:31:59.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj157 td/osd-backfill-space/datafile 2020-09-08T16:32:00.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:00.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj158 td/osd-backfill-space/datafile 2020-09-08T16:32:00.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:00.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj159 td/osd-backfill-space/datafile 2020-09-08T16:32:00.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:00.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj160 td/osd-backfill-space/datafile 2020-09-08T16:32:00.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:00.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj161 td/osd-backfill-space/datafile 2020-09-08T16:32:00.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:00.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj162 td/osd-backfill-space/datafile 2020-09-08T16:32:00.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:00.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj163 td/osd-backfill-space/datafile 2020-09-08T16:32:00.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:00.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj164 td/osd-backfill-space/datafile 2020-09-08T16:32:00.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:00.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj165 td/osd-backfill-space/datafile 2020-09-08T16:32:00.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:00.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj166 td/osd-backfill-space/datafile 2020-09-08T16:32:00.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:00.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj167 td/osd-backfill-space/datafile 2020-09-08T16:32:01.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:01.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj168 td/osd-backfill-space/datafile 2020-09-08T16:32:01.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:01.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj169 td/osd-backfill-space/datafile 2020-09-08T16:32:01.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:01.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj170 td/osd-backfill-space/datafile 2020-09-08T16:32:01.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:01.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj171 td/osd-backfill-space/datafile 2020-09-08T16:32:01.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:01.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj172 td/osd-backfill-space/datafile 2020-09-08T16:32:01.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:01.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj173 td/osd-backfill-space/datafile 2020-09-08T16:32:01.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:01.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj174 td/osd-backfill-space/datafile 2020-09-08T16:32:01.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:01.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj175 td/osd-backfill-space/datafile 2020-09-08T16:32:01.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:01.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj176 td/osd-backfill-space/datafile 2020-09-08T16:32:01.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:01.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj177 td/osd-backfill-space/datafile 2020-09-08T16:32:01.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:01.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj178 td/osd-backfill-space/datafile 2020-09-08T16:32:01.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:01.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj179 td/osd-backfill-space/datafile 2020-09-08T16:32:02.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:02.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj180 td/osd-backfill-space/datafile 2020-09-08T16:32:02.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:02.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj181 td/osd-backfill-space/datafile 2020-09-08T16:32:02.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:02.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj182 td/osd-backfill-space/datafile 2020-09-08T16:32:02.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:02.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj183 td/osd-backfill-space/datafile 2020-09-08T16:32:02.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:02.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj184 td/osd-backfill-space/datafile 2020-09-08T16:32:02.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:02.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj185 td/osd-backfill-space/datafile 2020-09-08T16:32:02.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:02.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj186 td/osd-backfill-space/datafile 2020-09-08T16:32:02.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:02.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj187 td/osd-backfill-space/datafile 2020-09-08T16:32:02.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:02.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj188 td/osd-backfill-space/datafile 2020-09-08T16:32:02.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:02.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj189 td/osd-backfill-space/datafile 2020-09-08T16:32:02.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:02.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj190 td/osd-backfill-space/datafile 2020-09-08T16:32:02.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:02.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj191 td/osd-backfill-space/datafile 2020-09-08T16:32:02.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:02.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj192 td/osd-backfill-space/datafile 2020-09-08T16:32:03.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:03.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj193 td/osd-backfill-space/datafile 2020-09-08T16:32:03.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:03.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj194 td/osd-backfill-space/datafile 2020-09-08T16:32:03.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:03.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj195 td/osd-backfill-space/datafile 2020-09-08T16:32:03.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:03.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj196 td/osd-backfill-space/datafile 2020-09-08T16:32:03.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:03.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj197 td/osd-backfill-space/datafile 2020-09-08T16:32:03.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:03.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj198 td/osd-backfill-space/datafile 2020-09-08T16:32:03.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:03.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj199 td/osd-backfill-space/datafile 2020-09-08T16:32:03.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:782: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:03.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:784: TEST_ec_backfill_multi: rados -p fillpool put obj200 td/osd-backfill-space/datafile 2020-09-08T16:32:03.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:787: TEST_ec_backfill_multi: get_primary fillpool obj1 2020-09-08T16:32:03.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=fillpool 2020-09-08T16:32:03.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:32:03.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map fillpool obj1 2020-09-08T16:32:03.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:32:04.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:787: TEST_ec_backfill_multi: local fillosd=1 2020-09-08T16:32:04.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:788: TEST_ec_backfill_multi: ceph osd erasure-code-profile set ec-profile k=3 m=2 crush-failure-domain=osd technique=reed_sol_van plugin=jerasure 2020-09-08T16:32:04.708 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:790: TEST_ec_backfill_multi: osdlist 6 1 2020-09-08T16:32:04.708 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:723: osdlist: local OSDS=6 2020-09-08T16:32:04.709 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:724: osdlist: local excludeosd=1 2020-09-08T16:32:04.709 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:726: osdlist: osds= 2020-09-08T16:32:04.710 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:727: osdlist: expr 6 - 1 2020-09-08T16:32:04.710 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:727: osdlist: seq 0 5 2020-09-08T16:32:04.713 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:727: osdlist: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:32:04.713 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:729: osdlist: '[' 0 = 1 ']' 2020-09-08T16:32:04.713 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:733: osdlist: '[' -n '' ']' 2020-09-08T16:32:04.714 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:736: osdlist: osds=0 2020-09-08T16:32:04.714 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:727: osdlist: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:32:04.714 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:729: osdlist: '[' 1 = 1 ']' 2020-09-08T16:32:04.714 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:731: osdlist: continue 2020-09-08T16:32:04.714 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:727: osdlist: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:32:04.715 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:729: osdlist: '[' 2 = 1 ']' 2020-09-08T16:32:04.715 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:733: osdlist: '[' -n 0 ']' 2020-09-08T16:32:04.715 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:734: osdlist: osds='0 ' 2020-09-08T16:32:04.715 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:736: osdlist: osds='0 2' 2020-09-08T16:32:04.715 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:727: osdlist: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:32:04.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:729: osdlist: '[' 3 = 1 ']' 2020-09-08T16:32:04.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:733: osdlist: '[' -n '0 2' ']' 2020-09-08T16:32:04.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:734: osdlist: osds='0 2 ' 2020-09-08T16:32:04.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:736: osdlist: osds='0 2 3' 2020-09-08T16:32:04.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:727: osdlist: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:32:04.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:729: osdlist: '[' 4 = 1 ']' 2020-09-08T16:32:04.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:733: osdlist: '[' -n '0 2 3' ']' 2020-09-08T16:32:04.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:734: osdlist: osds='0 2 3 ' 2020-09-08T16:32:04.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:736: osdlist: osds='0 2 3 4' 2020-09-08T16:32:04.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:727: osdlist: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:32:04.718 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:729: osdlist: '[' 5 = 1 ']' 2020-09-08T16:32:04.718 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:733: osdlist: '[' -n '0 2 3 4' ']' 2020-09-08T16:32:04.718 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:734: osdlist: osds='0 2 3 4 ' 2020-09-08T16:32:04.718 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:736: osdlist: osds='0 2 3 4 5' 2020-09-08T16:32:04.718 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:738: osdlist: echo 0 2 3 4 5 2020-09-08T16:32:04.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:790: TEST_ec_backfill_multi: nonfillosds='0 2 3 4 5' 2020-09-08T16:32:04.719 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:792: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:04.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:792: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:04.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:794: TEST_ec_backfill_multi: ceph osd pool create test1 1 1 erasure ec-profile 2020-09-08T16:32:05.419 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test1' already exists 2020-09-08T16:32:05.428 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:795: TEST_ec_backfill_multi: expr 1 + 1 2020-09-08T16:32:05.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:795: TEST_ec_backfill_multi: ceph osd pg-upmap 2.0 0 2 3 4 5 2020-09-08T16:32:06.504 INFO:tasks.workunit.client.0.smithi065.stderr:set 2.0 pg_upmap mapping to [0,2,3,4,5] 2020-09-08T16:32:06.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:792: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:06.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:794: TEST_ec_backfill_multi: ceph osd pool create test2 1 1 erasure ec-profile 2020-09-08T16:32:07.519 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test2' already exists 2020-09-08T16:32:07.527 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:795: TEST_ec_backfill_multi: expr 2 + 1 2020-09-08T16:32:07.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:795: TEST_ec_backfill_multi: ceph osd pg-upmap 3.0 0 2 3 4 5 2020-09-08T16:32:08.777 INFO:tasks.workunit.client.0.smithi065.stderr:set 3.0 pg_upmap mapping to [0,2,3,4,5] 2020-09-08T16:32:08.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:800: TEST_ec_backfill_multi: sleep 15 2020-09-08T16:32:23.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:802: TEST_ec_backfill_multi: ceph pg dump pgs 2020-09-08T16:32:24.169 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T16:32:24.169 INFO:tasks.workunit.client.0.smithi065.stdout:3.0 0 0 0 0 0 0 0 0 0 0 active+clean+wait 2020-09-08T16:32:10.294148+0000 0'0 55:15 [0,2,3,4,5] 0 [0,2,3,4,5] 0 0'0 2020-09-08T16:32:07.178748+0000 0'0 2020-09-08T16:32:07.178748+0000 0 2020-09-08T16:32:24.169 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 200 0 0 0 0 1843200 0 0 100 100 active+clean 2020-09-08T16:31:47.207181+0000 41'200 52:226 [1] 1 [1] 1 0'0 2020-09-08T16:31:44.557150+0000 0'0 2020-09-08T16:31:44.557150+0000 0 2020-09-08T16:32:24.170 INFO:tasks.workunit.client.0.smithi065.stdout:2.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-09-08T16:32:07.924594+0000 0'0 54:20 [0,2,3,4,5] 0 [0,2,3,4,5] 0 0'0 2020-09-08T16:32:05.198351+0000 0'0 2020-09-08T16:32:05.198351+0000 0 2020-09-08T16:32:24.170 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T16:32:24.170 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T16:32:24.170 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:32:24.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:804: TEST_ec_backfill_multi: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=12 2020-09-08T16:32:24.179 INFO:tasks.workunit.client.0.smithi065.stderr:12+0 records in 2020-09-08T16:32:24.180 INFO:tasks.workunit.client.0.smithi065.stderr:12+0 records out 2020-09-08T16:32:24.180 INFO:tasks.workunit.client.0.smithi065.stderr:12288 bytes (12 kB, 12 KiB) copied, 0.000161011 s, 76.3 MB/s 2020-09-08T16:32:24.180 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: seq 1 200 2020-09-08T16:32:24.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:24.181 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:24.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:24.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj1-1 td/osd-backfill-space/datafile 2020-09-08T16:32:24.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:24.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj1-2 td/osd-backfill-space/datafile 2020-09-08T16:32:24.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:24.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:24.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:24.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj2-1 td/osd-backfill-space/datafile 2020-09-08T16:32:24.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:24.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj2-2 td/osd-backfill-space/datafile 2020-09-08T16:32:25.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:25.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:25.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:25.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj3-1 td/osd-backfill-space/datafile 2020-09-08T16:32:25.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:25.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj3-2 td/osd-backfill-space/datafile 2020-09-08T16:32:25.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:25.505 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:25.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:25.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj4-1 td/osd-backfill-space/datafile 2020-09-08T16:32:25.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:25.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj4-2 td/osd-backfill-space/datafile 2020-09-08T16:32:25.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:25.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:25.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:25.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj5-1 td/osd-backfill-space/datafile 2020-09-08T16:32:26.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:26.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj5-2 td/osd-backfill-space/datafile 2020-09-08T16:32:26.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:26.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:26.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:26.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj6-1 td/osd-backfill-space/datafile 2020-09-08T16:32:26.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:26.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj6-2 td/osd-backfill-space/datafile 2020-09-08T16:32:27.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:27.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:27.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:27.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj7-1 td/osd-backfill-space/datafile 2020-09-08T16:32:27.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:27.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj7-2 td/osd-backfill-space/datafile 2020-09-08T16:32:27.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:27.530 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:27.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:27.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj8-1 td/osd-backfill-space/datafile 2020-09-08T16:32:27.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:27.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj8-2 td/osd-backfill-space/datafile 2020-09-08T16:32:28.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:28.100 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:28.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:28.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj9-1 td/osd-backfill-space/datafile 2020-09-08T16:32:28.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:28.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj9-2 td/osd-backfill-space/datafile 2020-09-08T16:32:28.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:28.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:28.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:28.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj10-1 td/osd-backfill-space/datafile 2020-09-08T16:32:28.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:28.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj10-2 td/osd-backfill-space/datafile 2020-09-08T16:32:29.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:29.132 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:29.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:29.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj11-1 td/osd-backfill-space/datafile 2020-09-08T16:32:29.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:29.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj11-2 td/osd-backfill-space/datafile 2020-09-08T16:32:29.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:29.569 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:29.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:29.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj12-1 td/osd-backfill-space/datafile 2020-09-08T16:32:29.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:29.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj12-2 td/osd-backfill-space/datafile 2020-09-08T16:32:30.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:30.082 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:30.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:30.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj13-1 td/osd-backfill-space/datafile 2020-09-08T16:32:30.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:30.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj13-2 td/osd-backfill-space/datafile 2020-09-08T16:32:30.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:30.660 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:30.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:30.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj14-1 td/osd-backfill-space/datafile 2020-09-08T16:32:30.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:30.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj14-2 td/osd-backfill-space/datafile 2020-09-08T16:32:31.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:31.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:31.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:31.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj15-1 td/osd-backfill-space/datafile 2020-09-08T16:32:31.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:31.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj15-2 td/osd-backfill-space/datafile 2020-09-08T16:32:31.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:31.784 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:31.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:31.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj16-1 td/osd-backfill-space/datafile 2020-09-08T16:32:32.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:32.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj16-2 td/osd-backfill-space/datafile 2020-09-08T16:32:32.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:32.312 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:32.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:32.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj17-1 td/osd-backfill-space/datafile 2020-09-08T16:32:32.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:32.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj17-2 td/osd-backfill-space/datafile 2020-09-08T16:32:32.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:32.792 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:32.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:32.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj18-1 td/osd-backfill-space/datafile 2020-09-08T16:32:33.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:33.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj18-2 td/osd-backfill-space/datafile 2020-09-08T16:32:33.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:33.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:33.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:33.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj19-1 td/osd-backfill-space/datafile 2020-09-08T16:32:33.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:33.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj19-2 td/osd-backfill-space/datafile 2020-09-08T16:32:33.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:33.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:33.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:33.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj20-1 td/osd-backfill-space/datafile 2020-09-08T16:32:33.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:33.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj20-2 td/osd-backfill-space/datafile 2020-09-08T16:32:34.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:34.244 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:34.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:34.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj21-1 td/osd-backfill-space/datafile 2020-09-08T16:32:34.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:34.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj21-2 td/osd-backfill-space/datafile 2020-09-08T16:32:34.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:34.681 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:34.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:34.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj22-1 td/osd-backfill-space/datafile 2020-09-08T16:32:34.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:34.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj22-2 td/osd-backfill-space/datafile 2020-09-08T16:32:35.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:35.126 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:35.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:35.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj23-1 td/osd-backfill-space/datafile 2020-09-08T16:32:35.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:35.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj23-2 td/osd-backfill-space/datafile 2020-09-08T16:32:35.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:35.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:35.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:35.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj24-1 td/osd-backfill-space/datafile 2020-09-08T16:32:35.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:35.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj24-2 td/osd-backfill-space/datafile 2020-09-08T16:32:36.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:36.150 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:36.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:36.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj25-1 td/osd-backfill-space/datafile 2020-09-08T16:32:36.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:36.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj25-2 td/osd-backfill-space/datafile 2020-09-08T16:32:36.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:36.637 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:36.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:36.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj26-1 td/osd-backfill-space/datafile 2020-09-08T16:32:36.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:36.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj26-2 td/osd-backfill-space/datafile 2020-09-08T16:32:37.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:37.149 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:37.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:37.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj27-1 td/osd-backfill-space/datafile 2020-09-08T16:32:37.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:37.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj27-2 td/osd-backfill-space/datafile 2020-09-08T16:32:37.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:37.645 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:37.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:37.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj28-1 td/osd-backfill-space/datafile 2020-09-08T16:32:37.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:37.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj28-2 td/osd-backfill-space/datafile 2020-09-08T16:32:38.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:38.065 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:38.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:38.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj29-1 td/osd-backfill-space/datafile 2020-09-08T16:32:38.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:38.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj29-2 td/osd-backfill-space/datafile 2020-09-08T16:32:38.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:38.560 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:38.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:38.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj30-1 td/osd-backfill-space/datafile 2020-09-08T16:32:38.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:38.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj30-2 td/osd-backfill-space/datafile 2020-09-08T16:32:39.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:39.106 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:39.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:39.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj31-1 td/osd-backfill-space/datafile 2020-09-08T16:32:39.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:39.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj31-2 td/osd-backfill-space/datafile 2020-09-08T16:32:39.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:39.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:39.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:39.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj32-1 td/osd-backfill-space/datafile 2020-09-08T16:32:39.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:39.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj32-2 td/osd-backfill-space/datafile 2020-09-08T16:32:40.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:40.013 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:40.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:40.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj33-1 td/osd-backfill-space/datafile 2020-09-08T16:32:40.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:40.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj33-2 td/osd-backfill-space/datafile 2020-09-08T16:32:40.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:40.534 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:40.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:40.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj34-1 td/osd-backfill-space/datafile 2020-09-08T16:32:40.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:40.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj34-2 td/osd-backfill-space/datafile 2020-09-08T16:32:41.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:41.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:41.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:41.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj35-1 td/osd-backfill-space/datafile 2020-09-08T16:32:41.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:41.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj35-2 td/osd-backfill-space/datafile 2020-09-08T16:32:41.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:41.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:41.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:41.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj36-1 td/osd-backfill-space/datafile 2020-09-08T16:32:41.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:41.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj36-2 td/osd-backfill-space/datafile 2020-09-08T16:32:41.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:41.995 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:41.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:41.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj37-1 td/osd-backfill-space/datafile 2020-09-08T16:32:42.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:42.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj37-2 td/osd-backfill-space/datafile 2020-09-08T16:32:42.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:42.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:42.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:42.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj38-1 td/osd-backfill-space/datafile 2020-09-08T16:32:42.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:42.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj38-2 td/osd-backfill-space/datafile 2020-09-08T16:32:43.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:43.044 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:43.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:43.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj39-1 td/osd-backfill-space/datafile 2020-09-08T16:32:43.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:43.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj39-2 td/osd-backfill-space/datafile 2020-09-08T16:32:43.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:43.472 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:43.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:43.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj40-1 td/osd-backfill-space/datafile 2020-09-08T16:32:43.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:43.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj40-2 td/osd-backfill-space/datafile 2020-09-08T16:32:43.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:43.976 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:43.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:43.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj41-1 td/osd-backfill-space/datafile 2020-09-08T16:32:44.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:44.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj41-2 td/osd-backfill-space/datafile 2020-09-08T16:32:44.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:44.497 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:44.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:44.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj42-1 td/osd-backfill-space/datafile 2020-09-08T16:32:44.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:44.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj42-2 td/osd-backfill-space/datafile 2020-09-08T16:32:44.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:44.942 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:44.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:44.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj43-1 td/osd-backfill-space/datafile 2020-09-08T16:32:45.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:45.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj43-2 td/osd-backfill-space/datafile 2020-09-08T16:32:45.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:45.396 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:45.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:45.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj44-1 td/osd-backfill-space/datafile 2020-09-08T16:32:45.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:45.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj44-2 td/osd-backfill-space/datafile 2020-09-08T16:32:45.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:45.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:45.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:45.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj45-1 td/osd-backfill-space/datafile 2020-09-08T16:32:46.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:46.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj45-2 td/osd-backfill-space/datafile 2020-09-08T16:32:46.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:46.470 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:46.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:46.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj46-1 td/osd-backfill-space/datafile 2020-09-08T16:32:46.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:46.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj46-2 td/osd-backfill-space/datafile 2020-09-08T16:32:46.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:46.956 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:46.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:46.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj47-1 td/osd-backfill-space/datafile 2020-09-08T16:32:47.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:47.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj47-2 td/osd-backfill-space/datafile 2020-09-08T16:32:47.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:47.460 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:47.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:47.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj48-1 td/osd-backfill-space/datafile 2020-09-08T16:32:47.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:47.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj48-2 td/osd-backfill-space/datafile 2020-09-08T16:32:48.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:48.006 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:48.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:48.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj49-1 td/osd-backfill-space/datafile 2020-09-08T16:32:48.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:48.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj49-2 td/osd-backfill-space/datafile 2020-09-08T16:32:48.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:48.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:48.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:48.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj50-1 td/osd-backfill-space/datafile 2020-09-08T16:32:48.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:48.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj50-2 td/osd-backfill-space/datafile 2020-09-08T16:32:48.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:48.905 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:48.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:48.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj51-1 td/osd-backfill-space/datafile 2020-09-08T16:32:49.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:49.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj51-2 td/osd-backfill-space/datafile 2020-09-08T16:32:49.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:49.409 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:49.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:49.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj52-1 td/osd-backfill-space/datafile 2020-09-08T16:32:49.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:49.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj52-2 td/osd-backfill-space/datafile 2020-09-08T16:32:49.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:49.912 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:49.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:49.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj53-1 td/osd-backfill-space/datafile 2020-09-08T16:32:50.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:50.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj53-2 td/osd-backfill-space/datafile 2020-09-08T16:32:50.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:50.282 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:50.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:50.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj54-1 td/osd-backfill-space/datafile 2020-09-08T16:32:50.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:50.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj54-2 td/osd-backfill-space/datafile 2020-09-08T16:32:50.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:50.769 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:50.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:50.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj55-1 td/osd-backfill-space/datafile 2020-09-08T16:32:51.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:51.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj55-2 td/osd-backfill-space/datafile 2020-09-08T16:32:51.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:51.306 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:51.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:51.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj56-1 td/osd-backfill-space/datafile 2020-09-08T16:32:51.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:51.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj56-2 td/osd-backfill-space/datafile 2020-09-08T16:32:51.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:51.735 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:51.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:51.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj57-1 td/osd-backfill-space/datafile 2020-09-08T16:32:51.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:51.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj57-2 td/osd-backfill-space/datafile 2020-09-08T16:32:52.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:52.163 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:52.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:52.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj58-1 td/osd-backfill-space/datafile 2020-09-08T16:32:52.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:52.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj58-2 td/osd-backfill-space/datafile 2020-09-08T16:32:52.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:52.701 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:52.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:52.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj59-1 td/osd-backfill-space/datafile 2020-09-08T16:32:52.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:52.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj59-2 td/osd-backfill-space/datafile 2020-09-08T16:32:53.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:53.238 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:53.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:53.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj60-1 td/osd-backfill-space/datafile 2020-09-08T16:32:53.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:53.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj60-2 td/osd-backfill-space/datafile 2020-09-08T16:32:53.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:53.683 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:53.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:53.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj61-1 td/osd-backfill-space/datafile 2020-09-08T16:32:53.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:53.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj61-2 td/osd-backfill-space/datafile 2020-09-08T16:32:54.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:54.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:54.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:54.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj62-1 td/osd-backfill-space/datafile 2020-09-08T16:32:54.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:54.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj62-2 td/osd-backfill-space/datafile 2020-09-08T16:32:54.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:54.684 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:54.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:54.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj63-1 td/osd-backfill-space/datafile 2020-09-08T16:32:54.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:54.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj63-2 td/osd-backfill-space/datafile 2020-09-08T16:32:55.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:55.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:55.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:55.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj64-1 td/osd-backfill-space/datafile 2020-09-08T16:32:55.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:55.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj64-2 td/osd-backfill-space/datafile 2020-09-08T16:32:55.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:55.583 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:55.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:55.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj65-1 td/osd-backfill-space/datafile 2020-09-08T16:32:55.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:55.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj65-2 td/osd-backfill-space/datafile 2020-09-08T16:32:56.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:56.069 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:56.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:56.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj66-1 td/osd-backfill-space/datafile 2020-09-08T16:32:56.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:56.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj66-2 td/osd-backfill-space/datafile 2020-09-08T16:32:56.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:56.615 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:56.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:56.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj67-1 td/osd-backfill-space/datafile 2020-09-08T16:32:57.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:57.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj67-2 td/osd-backfill-space/datafile 2020-09-08T16:32:57.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:57.277 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:57.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:57.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj68-1 td/osd-backfill-space/datafile 2020-09-08T16:32:57.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:57.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj68-2 td/osd-backfill-space/datafile 2020-09-08T16:32:57.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:57.689 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:57.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:57.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj69-1 td/osd-backfill-space/datafile 2020-09-08T16:32:57.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:57.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj69-2 td/osd-backfill-space/datafile 2020-09-08T16:32:58.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:58.193 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:58.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:58.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj70-1 td/osd-backfill-space/datafile 2020-09-08T16:32:58.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:58.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj70-2 td/osd-backfill-space/datafile 2020-09-08T16:32:58.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:58.755 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:58.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:58.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj71-1 td/osd-backfill-space/datafile 2020-09-08T16:32:58.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:58.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj71-2 td/osd-backfill-space/datafile 2020-09-08T16:32:59.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:59.166 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:59.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:59.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj72-1 td/osd-backfill-space/datafile 2020-09-08T16:32:59.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:59.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj72-2 td/osd-backfill-space/datafile 2020-09-08T16:32:59.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:32:59.620 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:32:59.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:59.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj73-1 td/osd-backfill-space/datafile 2020-09-08T16:32:59.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:32:59.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj73-2 td/osd-backfill-space/datafile 2020-09-08T16:33:00.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:00.115 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:00.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:00.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj74-1 td/osd-backfill-space/datafile 2020-09-08T16:33:00.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:00.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj74-2 td/osd-backfill-space/datafile 2020-09-08T16:33:00.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:00.646 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:00.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:00.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj75-1 td/osd-backfill-space/datafile 2020-09-08T16:33:00.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:00.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj75-2 td/osd-backfill-space/datafile 2020-09-08T16:33:01.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:01.073 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:01.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:01.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj76-1 td/osd-backfill-space/datafile 2020-09-08T16:33:01.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:01.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj76-2 td/osd-backfill-space/datafile 2020-09-08T16:33:01.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:01.585 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:01.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:01.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj77-1 td/osd-backfill-space/datafile 2020-09-08T16:33:01.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:01.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj77-2 td/osd-backfill-space/datafile 2020-09-08T16:33:02.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:02.106 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:02.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:02.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj78-1 td/osd-backfill-space/datafile 2020-09-08T16:33:02.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:02.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj78-2 td/osd-backfill-space/datafile 2020-09-08T16:33:02.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:02.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:02.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:02.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj79-1 td/osd-backfill-space/datafile 2020-09-08T16:33:02.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:02.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj79-2 td/osd-backfill-space/datafile 2020-09-08T16:33:03.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:03.054 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:03.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:03.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj80-1 td/osd-backfill-space/datafile 2020-09-08T16:33:03.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:03.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj80-2 td/osd-backfill-space/datafile 2020-09-08T16:33:03.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:03.567 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:03.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:03.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj81-1 td/osd-backfill-space/datafile 2020-09-08T16:33:03.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:03.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj81-2 td/osd-backfill-space/datafile 2020-09-08T16:33:04.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:04.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:04.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:04.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj82-1 td/osd-backfill-space/datafile 2020-09-08T16:33:04.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:04.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj82-2 td/osd-backfill-space/datafile 2020-09-08T16:33:04.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:04.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:04.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:04.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj83-1 td/osd-backfill-space/datafile 2020-09-08T16:33:04.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:04.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj83-2 td/osd-backfill-space/datafile 2020-09-08T16:33:05.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:05.011 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:05.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:05.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj84-1 td/osd-backfill-space/datafile 2020-09-08T16:33:05.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:05.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj84-2 td/osd-backfill-space/datafile 2020-09-08T16:33:05.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:05.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:05.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:05.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj85-1 td/osd-backfill-space/datafile 2020-09-08T16:33:05.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:05.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj85-2 td/osd-backfill-space/datafile 2020-09-08T16:33:05.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:05.960 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:05.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:05.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj86-1 td/osd-backfill-space/datafile 2020-09-08T16:33:06.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:06.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj86-2 td/osd-backfill-space/datafile 2020-09-08T16:33:06.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:06.447 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:06.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:06.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj87-1 td/osd-backfill-space/datafile 2020-09-08T16:33:06.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:06.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj87-2 td/osd-backfill-space/datafile 2020-09-08T16:33:06.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:06.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:06.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:06.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj88-1 td/osd-backfill-space/datafile 2020-09-08T16:33:07.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:07.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj88-2 td/osd-backfill-space/datafile 2020-09-08T16:33:07.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:07.472 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:07.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:07.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj89-1 td/osd-backfill-space/datafile 2020-09-08T16:33:07.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:07.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj89-2 td/osd-backfill-space/datafile 2020-09-08T16:33:07.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:07.875 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:07.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:07.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj90-1 td/osd-backfill-space/datafile 2020-09-08T16:33:08.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:08.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj90-2 td/osd-backfill-space/datafile 2020-09-08T16:33:08.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:08.387 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:08.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:08.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj91-1 td/osd-backfill-space/datafile 2020-09-08T16:33:08.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:08.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj91-2 td/osd-backfill-space/datafile 2020-09-08T16:33:08.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:08.916 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:08.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:08.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj92-1 td/osd-backfill-space/datafile 2020-09-08T16:33:09.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:09.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj92-2 td/osd-backfill-space/datafile 2020-09-08T16:33:09.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:09.353 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:09.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:09.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj93-1 td/osd-backfill-space/datafile 2020-09-08T16:33:09.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:09.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj93-2 td/osd-backfill-space/datafile 2020-09-08T16:33:09.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:09.823 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:09.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:09.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj94-1 td/osd-backfill-space/datafile 2020-09-08T16:33:10.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:10.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj94-2 td/osd-backfill-space/datafile 2020-09-08T16:33:10.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:10.310 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:10.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:10.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj95-1 td/osd-backfill-space/datafile 2020-09-08T16:33:10.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:10.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj95-2 td/osd-backfill-space/datafile 2020-09-08T16:33:10.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:10.814 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:10.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:10.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj96-1 td/osd-backfill-space/datafile 2020-09-08T16:33:11.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:11.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj96-2 td/osd-backfill-space/datafile 2020-09-08T16:33:11.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:11.217 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:11.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:11.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj97-1 td/osd-backfill-space/datafile 2020-09-08T16:33:11.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:11.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj97-2 td/osd-backfill-space/datafile 2020-09-08T16:33:11.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:11.755 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:11.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:11.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj98-1 td/osd-backfill-space/datafile 2020-09-08T16:33:11.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:11.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj98-2 td/osd-backfill-space/datafile 2020-09-08T16:33:12.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:12.242 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:12.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:12.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj99-1 td/osd-backfill-space/datafile 2020-09-08T16:33:12.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:12.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj99-2 td/osd-backfill-space/datafile 2020-09-08T16:33:12.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:12.728 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:12.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:12.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj100-1 td/osd-backfill-space/datafile 2020-09-08T16:33:12.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:12.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj100-2 td/osd-backfill-space/datafile 2020-09-08T16:33:13.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:13.182 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:13.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:13.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj101-1 td/osd-backfill-space/datafile 2020-09-08T16:33:13.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:13.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj101-2 td/osd-backfill-space/datafile 2020-09-08T16:33:13.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:13.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:13.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:13.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj102-1 td/osd-backfill-space/datafile 2020-09-08T16:33:13.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:13.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj102-2 td/osd-backfill-space/datafile 2020-09-08T16:33:14.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:14.190 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:14.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:14.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj103-1 td/osd-backfill-space/datafile 2020-09-08T16:33:14.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:14.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj103-2 td/osd-backfill-space/datafile 2020-09-08T16:33:14.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:14.609 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:14.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:14.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj104-1 td/osd-backfill-space/datafile 2020-09-08T16:33:14.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:14.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj104-2 td/osd-backfill-space/datafile 2020-09-08T16:33:15.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:15.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:15.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:15.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj105-1 td/osd-backfill-space/datafile 2020-09-08T16:33:15.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:15.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj105-2 td/osd-backfill-space/datafile 2020-09-08T16:33:15.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:15.609 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:15.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:15.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj106-1 td/osd-backfill-space/datafile 2020-09-08T16:33:15.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:15.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj106-2 td/osd-backfill-space/datafile 2020-09-08T16:33:16.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:16.046 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:16.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:16.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj107-1 td/osd-backfill-space/datafile 2020-09-08T16:33:16.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:16.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj107-2 td/osd-backfill-space/datafile 2020-09-08T16:33:16.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:16.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:16.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:16.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj108-1 td/osd-backfill-space/datafile 2020-09-08T16:33:16.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:16.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj108-2 td/osd-backfill-space/datafile 2020-09-08T16:33:17.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:17.053 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:17.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:17.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj109-1 td/osd-backfill-space/datafile 2020-09-08T16:33:17.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:17.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj109-2 td/osd-backfill-space/datafile 2020-09-08T16:33:17.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:17.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:17.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:17.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj110-1 td/osd-backfill-space/datafile 2020-09-08T16:33:17.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:17.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj110-2 td/osd-backfill-space/datafile 2020-09-08T16:33:17.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:17.969 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:17.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:17.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj111-1 td/osd-backfill-space/datafile 2020-09-08T16:33:18.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:18.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj111-2 td/osd-backfill-space/datafile 2020-09-08T16:33:18.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:18.431 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:18.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:18.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj112-1 td/osd-backfill-space/datafile 2020-09-08T16:33:18.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:18.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj112-2 td/osd-backfill-space/datafile 2020-09-08T16:33:18.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:18.960 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:18.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:18.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj113-1 td/osd-backfill-space/datafile 2020-09-08T16:33:19.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:19.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj113-2 td/osd-backfill-space/datafile 2020-09-08T16:33:19.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:19.481 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:19.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:19.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj114-1 td/osd-backfill-space/datafile 2020-09-08T16:33:19.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:19.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj114-2 td/osd-backfill-space/datafile 2020-09-08T16:33:19.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:19.934 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:19.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:19.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj115-1 td/osd-backfill-space/datafile 2020-09-08T16:33:20.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:20.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj115-2 td/osd-backfill-space/datafile 2020-09-08T16:33:20.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:20.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:20.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:20.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj116-1 td/osd-backfill-space/datafile 2020-09-08T16:33:20.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:20.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj116-2 td/osd-backfill-space/datafile 2020-09-08T16:33:20.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:20.933 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:20.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:20.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj117-1 td/osd-backfill-space/datafile 2020-09-08T16:33:21.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:21.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj117-2 td/osd-backfill-space/datafile 2020-09-08T16:33:21.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:21.429 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:21.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:21.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj118-1 td/osd-backfill-space/datafile 2020-09-08T16:33:21.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:21.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj118-2 td/osd-backfill-space/datafile 2020-09-08T16:33:21.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:21.848 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:21.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:21.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj119-1 td/osd-backfill-space/datafile 2020-09-08T16:33:22.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:22.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj119-2 td/osd-backfill-space/datafile 2020-09-08T16:33:22.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:22.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:22.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:22.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj120-1 td/osd-backfill-space/datafile 2020-09-08T16:33:22.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:22.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj120-2 td/osd-backfill-space/datafile 2020-09-08T16:33:22.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:22.890 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:22.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:22.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj121-1 td/osd-backfill-space/datafile 2020-09-08T16:33:23.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:23.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj121-2 td/osd-backfill-space/datafile 2020-09-08T16:33:23.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:23.326 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:23.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:23.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj122-1 td/osd-backfill-space/datafile 2020-09-08T16:33:23.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:23.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj122-2 td/osd-backfill-space/datafile 2020-09-08T16:33:23.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:23.788 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:23.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:23.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj123-1 td/osd-backfill-space/datafile 2020-09-08T16:33:24.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:24.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj123-2 td/osd-backfill-space/datafile 2020-09-08T16:33:24.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:24.326 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:24.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:24.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj124-1 td/osd-backfill-space/datafile 2020-09-08T16:33:24.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:24.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj124-2 td/osd-backfill-space/datafile 2020-09-08T16:33:24.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:24.854 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:24.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:24.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj125-1 td/osd-backfill-space/datafile 2020-09-08T16:33:25.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:25.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj125-2 td/osd-backfill-space/datafile 2020-09-08T16:33:25.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:25.316 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:25.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:25.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj126-1 td/osd-backfill-space/datafile 2020-09-08T16:33:25.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:25.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj126-2 td/osd-backfill-space/datafile 2020-09-08T16:33:25.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:25.820 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:25.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:25.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj127-1 td/osd-backfill-space/datafile 2020-09-08T16:33:26.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:26.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj127-2 td/osd-backfill-space/datafile 2020-09-08T16:33:26.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:26.350 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:26.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:26.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj128-1 td/osd-backfill-space/datafile 2020-09-08T16:33:26.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:26.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj128-2 td/osd-backfill-space/datafile 2020-09-08T16:33:26.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:26.853 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:26.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:26.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj129-1 td/osd-backfill-space/datafile 2020-09-08T16:33:27.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:27.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj129-2 td/osd-backfill-space/datafile 2020-09-08T16:33:27.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:27.332 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:27.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:27.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj130-1 td/osd-backfill-space/datafile 2020-09-08T16:33:27.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:27.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj130-2 td/osd-backfill-space/datafile 2020-09-08T16:33:27.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:27.819 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:27.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:27.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj131-1 td/osd-backfill-space/datafile 2020-09-08T16:33:28.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:28.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj131-2 td/osd-backfill-space/datafile 2020-09-08T16:33:28.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:28.584 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:28.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:28.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj132-1 td/osd-backfill-space/datafile 2020-09-08T16:33:28.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:28.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj132-2 td/osd-backfill-space/datafile 2020-09-08T16:33:28.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:28.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:28.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:28.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj133-1 td/osd-backfill-space/datafile 2020-09-08T16:33:29.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:29.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj133-2 td/osd-backfill-space/datafile 2020-09-08T16:33:29.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:29.465 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:29.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:29.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj134-1 td/osd-backfill-space/datafile 2020-09-08T16:33:29.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:29.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj134-2 td/osd-backfill-space/datafile 2020-09-08T16:33:29.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:29.977 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:29.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:29.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj135-1 td/osd-backfill-space/datafile 2020-09-08T16:33:30.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:30.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj135-2 td/osd-backfill-space/datafile 2020-09-08T16:33:30.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:30.431 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:30.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:30.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj136-1 td/osd-backfill-space/datafile 2020-09-08T16:33:30.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:30.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj136-2 td/osd-backfill-space/datafile 2020-09-08T16:33:30.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:30.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:30.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:30.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj137-1 td/osd-backfill-space/datafile 2020-09-08T16:33:31.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:31.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj137-2 td/osd-backfill-space/datafile 2020-09-08T16:33:31.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:31.445 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:31.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:31.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj138-1 td/osd-backfill-space/datafile 2020-09-08T16:33:31.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:31.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj138-2 td/osd-backfill-space/datafile 2020-09-08T16:33:31.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:31.974 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:31.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:31.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj139-1 td/osd-backfill-space/datafile 2020-09-08T16:33:32.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:32.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj139-2 td/osd-backfill-space/datafile 2020-09-08T16:33:32.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:32.437 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:32.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:32.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj140-1 td/osd-backfill-space/datafile 2020-09-08T16:33:32.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:32.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj140-2 td/osd-backfill-space/datafile 2020-09-08T16:33:32.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:32.981 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:32.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:32.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj141-1 td/osd-backfill-space/datafile 2020-09-08T16:33:33.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:33.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj141-2 td/osd-backfill-space/datafile 2020-09-08T16:33:33.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:33.501 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:33.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:33.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj142-1 td/osd-backfill-space/datafile 2020-09-08T16:33:33.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:33.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj142-2 td/osd-backfill-space/datafile 2020-09-08T16:33:34.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:34.104 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:34.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:34.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj143-1 td/osd-backfill-space/datafile 2020-09-08T16:33:34.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:34.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj143-2 td/osd-backfill-space/datafile 2020-09-08T16:33:34.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:34.608 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:34.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:34.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj144-1 td/osd-backfill-space/datafile 2020-09-08T16:33:34.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:34.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj144-2 td/osd-backfill-space/datafile 2020-09-08T16:33:35.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:35.120 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:35.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:35.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj145-1 td/osd-backfill-space/datafile 2020-09-08T16:33:35.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:35.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj145-2 td/osd-backfill-space/datafile 2020-09-08T16:33:35.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:35.623 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:35.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:35.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj146-1 td/osd-backfill-space/datafile 2020-09-08T16:33:35.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:35.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj146-2 td/osd-backfill-space/datafile 2020-09-08T16:33:36.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:36.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:36.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:36.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj147-1 td/osd-backfill-space/datafile 2020-09-08T16:33:36.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:36.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj147-2 td/osd-backfill-space/datafile 2020-09-08T16:33:36.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:36.547 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:36.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:36.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj148-1 td/osd-backfill-space/datafile 2020-09-08T16:33:36.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:36.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj148-2 td/osd-backfill-space/datafile 2020-09-08T16:33:37.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:37.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:37.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:37.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj149-1 td/osd-backfill-space/datafile 2020-09-08T16:33:37.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:37.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj149-2 td/osd-backfill-space/datafile 2020-09-08T16:33:37.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:37.512 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:37.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:37.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj150-1 td/osd-backfill-space/datafile 2020-09-08T16:33:37.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:37.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj150-2 td/osd-backfill-space/datafile 2020-09-08T16:33:37.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:37.923 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:37.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:37.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj151-1 td/osd-backfill-space/datafile 2020-09-08T16:33:38.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:38.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj151-2 td/osd-backfill-space/datafile 2020-09-08T16:33:38.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:38.427 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:38.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:38.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj152-1 td/osd-backfill-space/datafile 2020-09-08T16:33:38.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:38.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj152-2 td/osd-backfill-space/datafile 2020-09-08T16:33:38.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:38.947 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:38.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:38.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj153-1 td/osd-backfill-space/datafile 2020-09-08T16:33:39.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:39.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj153-2 td/osd-backfill-space/datafile 2020-09-08T16:33:39.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:39.342 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:39.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:39.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj154-1 td/osd-backfill-space/datafile 2020-09-08T16:33:39.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:39.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj154-2 td/osd-backfill-space/datafile 2020-09-08T16:33:39.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:39.854 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:39.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:39.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj155-1 td/osd-backfill-space/datafile 2020-09-08T16:33:40.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:40.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj155-2 td/osd-backfill-space/datafile 2020-09-08T16:33:40.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:40.391 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:40.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:40.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj156-1 td/osd-backfill-space/datafile 2020-09-08T16:33:40.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:40.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj156-2 td/osd-backfill-space/datafile 2020-09-08T16:33:40.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:40.870 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:40.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:40.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj157-1 td/osd-backfill-space/datafile 2020-09-08T16:33:41.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:41.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj157-2 td/osd-backfill-space/datafile 2020-09-08T16:33:41.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:41.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:41.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:41.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj158-1 td/osd-backfill-space/datafile 2020-09-08T16:33:41.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:41.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj158-2 td/osd-backfill-space/datafile 2020-09-08T16:33:41.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:41.810 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:41.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:41.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj159-1 td/osd-backfill-space/datafile 2020-09-08T16:33:42.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:42.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj159-2 td/osd-backfill-space/datafile 2020-09-08T16:33:42.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:42.372 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:42.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:42.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj160-1 td/osd-backfill-space/datafile 2020-09-08T16:33:42.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:42.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj160-2 td/osd-backfill-space/datafile 2020-09-08T16:33:42.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:42.842 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:42.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:42.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj161-1 td/osd-backfill-space/datafile 2020-09-08T16:33:43.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:43.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj161-2 td/osd-backfill-space/datafile 2020-09-08T16:33:43.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:43.337 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:43.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:43.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj162-1 td/osd-backfill-space/datafile 2020-09-08T16:33:43.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:43.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj162-2 td/osd-backfill-space/datafile 2020-09-08T16:33:43.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:43.857 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:43.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:43.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj163-1 td/osd-backfill-space/datafile 2020-09-08T16:33:44.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:44.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj163-2 td/osd-backfill-space/datafile 2020-09-08T16:33:44.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:44.302 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:44.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:44.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj164-1 td/osd-backfill-space/datafile 2020-09-08T16:33:44.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:44.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj164-2 td/osd-backfill-space/datafile 2020-09-08T16:33:44.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:44.731 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:44.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:44.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj165-1 td/osd-backfill-space/datafile 2020-09-08T16:33:44.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:44.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj165-2 td/osd-backfill-space/datafile 2020-09-08T16:33:45.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:45.226 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:45.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:45.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj166-1 td/osd-backfill-space/datafile 2020-09-08T16:33:45.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:45.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj166-2 td/osd-backfill-space/datafile 2020-09-08T16:33:45.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:45.722 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:45.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:45.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj167-1 td/osd-backfill-space/datafile 2020-09-08T16:33:45.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:45.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj167-2 td/osd-backfill-space/datafile 2020-09-08T16:33:46.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:46.141 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:46.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:46.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj168-1 td/osd-backfill-space/datafile 2020-09-08T16:33:46.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:46.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj168-2 td/osd-backfill-space/datafile 2020-09-08T16:33:46.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:46.662 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:46.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:46.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj169-1 td/osd-backfill-space/datafile 2020-09-08T16:33:46.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:46.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj169-2 td/osd-backfill-space/datafile 2020-09-08T16:33:47.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:47.191 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:47.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:47.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj170-1 td/osd-backfill-space/datafile 2020-09-08T16:33:47.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:47.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj170-2 td/osd-backfill-space/datafile 2020-09-08T16:33:47.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:47.660 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:47.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:47.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj171-1 td/osd-backfill-space/datafile 2020-09-08T16:33:47.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:47.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj171-2 td/osd-backfill-space/datafile 2020-09-08T16:33:48.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:48.079 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:48.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:48.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj172-1 td/osd-backfill-space/datafile 2020-09-08T16:33:48.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:48.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj172-2 td/osd-backfill-space/datafile 2020-09-08T16:33:48.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:48.608 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:48.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:48.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj173-1 td/osd-backfill-space/datafile 2020-09-08T16:33:48.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:48.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj173-2 td/osd-backfill-space/datafile 2020-09-08T16:33:49.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:49.121 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:49.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:49.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj174-1 td/osd-backfill-space/datafile 2020-09-08T16:33:49.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:49.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj174-2 td/osd-backfill-space/datafile 2020-09-08T16:33:49.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:49.565 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:49.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:49.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj175-1 td/osd-backfill-space/datafile 2020-09-08T16:33:49.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:49.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj175-2 td/osd-backfill-space/datafile 2020-09-08T16:33:50.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:50.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:50.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:50.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj176-1 td/osd-backfill-space/datafile 2020-09-08T16:33:50.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:50.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj176-2 td/osd-backfill-space/datafile 2020-09-08T16:33:50.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:50.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:50.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:50.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj177-1 td/osd-backfill-space/datafile 2020-09-08T16:33:50.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:50.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj177-2 td/osd-backfill-space/datafile 2020-09-08T16:33:51.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:51.076 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:51.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:51.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj178-1 td/osd-backfill-space/datafile 2020-09-08T16:33:51.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:51.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj178-2 td/osd-backfill-space/datafile 2020-09-08T16:33:51.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:51.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:51.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:51.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj179-1 td/osd-backfill-space/datafile 2020-09-08T16:33:51.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:51.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj179-2 td/osd-backfill-space/datafile 2020-09-08T16:33:52.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:52.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:52.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:52.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj180-1 td/osd-backfill-space/datafile 2020-09-08T16:33:52.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:52.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj180-2 td/osd-backfill-space/datafile 2020-09-08T16:33:52.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:52.620 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:52.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:52.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj181-1 td/osd-backfill-space/datafile 2020-09-08T16:33:52.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:52.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj181-2 td/osd-backfill-space/datafile 2020-09-08T16:33:53.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:53.031 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:53.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:53.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj182-1 td/osd-backfill-space/datafile 2020-09-08T16:33:53.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:53.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj182-2 td/osd-backfill-space/datafile 2020-09-08T16:33:53.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:53.467 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:53.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:53.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj183-1 td/osd-backfill-space/datafile 2020-09-08T16:33:53.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:53.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj183-2 td/osd-backfill-space/datafile 2020-09-08T16:33:54.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:54.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:54.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:54.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj184-1 td/osd-backfill-space/datafile 2020-09-08T16:33:54.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:54.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj184-2 td/osd-backfill-space/datafile 2020-09-08T16:33:54.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:54.483 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:54.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:54.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj185-1 td/osd-backfill-space/datafile 2020-09-08T16:33:54.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:54.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj185-2 td/osd-backfill-space/datafile 2020-09-08T16:33:54.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:54.912 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:54.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:54.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj186-1 td/osd-backfill-space/datafile 2020-09-08T16:33:55.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:55.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj186-2 td/osd-backfill-space/datafile 2020-09-08T16:33:55.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:55.398 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:55.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:55.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj187-1 td/osd-backfill-space/datafile 2020-09-08T16:33:55.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:55.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj187-2 td/osd-backfill-space/datafile 2020-09-08T16:33:55.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:55.919 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:55.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:55.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj188-1 td/osd-backfill-space/datafile 2020-09-08T16:33:56.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:56.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj188-2 td/osd-backfill-space/datafile 2020-09-08T16:33:56.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:56.322 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:56.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:56.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj189-1 td/osd-backfill-space/datafile 2020-09-08T16:33:56.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:56.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj189-2 td/osd-backfill-space/datafile 2020-09-08T16:33:56.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:56.800 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:56.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:56.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj190-1 td/osd-backfill-space/datafile 2020-09-08T16:33:57.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:57.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj190-2 td/osd-backfill-space/datafile 2020-09-08T16:33:57.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:57.304 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:57.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:57.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj191-1 td/osd-backfill-space/datafile 2020-09-08T16:33:57.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:57.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj191-2 td/osd-backfill-space/datafile 2020-09-08T16:33:57.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:57.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:57.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:57.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj192-1 td/osd-backfill-space/datafile 2020-09-08T16:33:57.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:57.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj192-2 td/osd-backfill-space/datafile 2020-09-08T16:33:58.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:58.160 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:58.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:58.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj193-1 td/osd-backfill-space/datafile 2020-09-08T16:33:58.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:58.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj193-2 td/osd-backfill-space/datafile 2020-09-08T16:33:58.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:58.630 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:58.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:58.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj194-1 td/osd-backfill-space/datafile 2020-09-08T16:33:58.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:58.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj194-2 td/osd-backfill-space/datafile 2020-09-08T16:33:59.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:59.159 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:59.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:59.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj195-1 td/osd-backfill-space/datafile 2020-09-08T16:33:59.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:59.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj195-2 td/osd-backfill-space/datafile 2020-09-08T16:33:59.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:33:59.863 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:33:59.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:33:59.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj196-1 td/osd-backfill-space/datafile 2020-09-08T16:34:00.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:34:00.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj196-2 td/osd-backfill-space/datafile 2020-09-08T16:34:00.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:34:00.433 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:34:00.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:34:00.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj197-1 td/osd-backfill-space/datafile 2020-09-08T16:34:00.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:34:00.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj197-2 td/osd-backfill-space/datafile 2020-09-08T16:34:00.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:34:00.987 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:34:00.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:34:00.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj198-1 td/osd-backfill-space/datafile 2020-09-08T16:34:01.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:34:01.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj198-2 td/osd-backfill-space/datafile 2020-09-08T16:34:01.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:34:01.775 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:34:01.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:34:01.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj199-1 td/osd-backfill-space/datafile 2020-09-08T16:34:02.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:34:02.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj199-2 td/osd-backfill-space/datafile 2020-09-08T16:34:02.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:805: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2020-09-08T16:34:02.329 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:34:02.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:34:02.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test1 put obj200-1 td/osd-backfill-space/datafile 2020-09-08T16:34:02.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:807: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:34:02.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:809: TEST_ec_backfill_multi: rados -p test2 put obj200-2 td/osd-backfill-space/datafile 2020-09-08T16:34:02.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:813: TEST_ec_backfill_multi: ceph pg dump pgs 2020-09-08T16:34:03.255 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T16:34:03.256 INFO:tasks.workunit.client.0.smithi065.stdout:3.0 194 0 0 0 0 2383872 0 0 94 94 active+clean 2020-09-08T16:32:23.924073+0000 55'194 55:210 [0,2,3,4,5] 0 [0,2,3,4,5] 0 0'0 2020-09-08T16:32:07.178748+0000 0'0 2020-09-08T16:32:07.178748+0000 0 2020-09-08T16:34:03.256 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 200 0 0 0 0 1843200 0 0 100 100 active+clean 2020-09-08T16:31:47.207181+0000 41'200 56:228 [1] 1 [1] 1 0'0 2020-09-08T16:31:44.557150+0000 0'0 2020-09-08T16:31:44.557150+0000 0 2020-09-08T16:34:03.256 INFO:tasks.workunit.client.0.smithi065.stdout:2.0 194 0 0 0 0 2383872 0 0 94 94 active+clean 2020-09-08T16:32:07.924594+0000 55'194 55:214 [0,2,3,4,5] 0 [0,2,3,4,5] 0 0'0 2020-09-08T16:32:05.198351+0000 0'0 2020-09-08T16:32:05.198351+0000 0 2020-09-08T16:34:03.256 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T16:34:03.257 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T16:34:03.257 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:34:03.266 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:815: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:34:03.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:815: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:34:03.267 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:817: TEST_ec_backfill_multi: expr 1 + 1 2020-09-08T16:34:03.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:817: TEST_ec_backfill_multi: ceph osd pg-upmap 2.0 0 2 3 4 1 2020-09-08T16:34:04.198 INFO:tasks.workunit.client.0.smithi065.stderr:set 2.0 pg_upmap mapping to [0,2,3,4,1] 2020-09-08T16:34:04.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:815: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2020-09-08T16:34:04.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:817: TEST_ec_backfill_multi: expr 2 + 1 2020-09-08T16:34:04.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:817: TEST_ec_backfill_multi: ceph osd pg-upmap 3.0 0 2 3 4 1 2020-09-08T16:34:05.363 INFO:tasks.workunit.client.0.smithi065.stderr:set 3.0 pg_upmap mapping to [0,2,3,4,1] 2020-09-08T16:34:05.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:820: TEST_ec_backfill_multi: sleep 30 2020-09-08T16:34:35.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:822: TEST_ec_backfill_multi: wait_for_not_backfilling 240 2020-09-08T16:34:35.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:82: wait_for_not_backfilling: local timeout=240 2020-09-08T16:34:35.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:83: wait_for_not_backfilling: wait_for_not_state backfilling 240 2020-09-08T16:34:35.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:53: wait_for_not_state: local state=backfilling 2020-09-08T16:34:35.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:54: wait_for_not_state: local num_in_state=-1 2020-09-08T16:34:35.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:55: wait_for_not_state: local cur_in_state 2020-09-08T16:34:35.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: delays=($(get_timeout_delays $2 5)) 2020-09-08T16:34:35.378 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: get_timeout_delays 240 5 2020-09-08T16:34:35.378 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:34:35.379 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:34:35.379 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:34:35.379 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:34:35.379 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:34:35.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: local -a delays 2020-09-08T16:34:35.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:57: wait_for_not_state: local -i loop=0 2020-09-08T16:34:35.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:59: wait_for_not_state: flush_pg_stats 2020-09-08T16:34:35.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:34:35.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:34:35.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:34:35.919 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:34:35.919 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:34:35.920 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:34:35.920 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T16:34:35.920 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T16:34:35.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:34:35.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:34:35.921 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:34:36.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836525 2020-09-08T16:34:36.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836525 2020-09-08T16:34:36.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836525' 2020-09-08T16:34:36.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:34:36.054 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:34:36.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949673003 2020-09-08T16:34:36.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949673003 2020-09-08T16:34:36.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836525 1-42949673003' 2020-09-08T16:34:36.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:34:36.187 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:34:36.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509482 2020-09-08T16:34:36.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509482 2020-09-08T16:34:36.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836525 1-42949673003 2-64424509482' 2020-09-08T16:34:36.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:34:36.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:34:36.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345961 2020-09-08T16:34:36.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345961 2020-09-08T16:34:36.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836525 1-42949673003 2-64424509482 3-85899345961' 2020-09-08T16:34:36.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:34:36.454 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:34:36.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182439 2020-09-08T16:34:36.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182439 2020-09-08T16:34:36.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836525 1-42949673003 2-64424509482 3-85899345961 4-107374182439' 2020-09-08T16:34:36.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:34:36.587 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T16:34:36.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018917 2020-09-08T16:34:36.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018917 2020-09-08T16:34:36.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836525 1-42949673003 2-64424509482 3-85899345961 4-107374182439 5-128849018917' 2020-09-08T16:34:36.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:34:36.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836525 2020-09-08T16:34:36.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:34:36.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:34:36.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836525 2020-09-08T16:34:36.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:34:36.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836525 2020-09-08T16:34:36.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836525' 2020-09-08T16:34:36.725 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:34:36.726 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836525 2020-09-08T16:34:37.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836525 -lt 21474836525 2020-09-08T16:34:37.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:34:37.124 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949673003 2020-09-08T16:34:37.125 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:34:37.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:34:37.126 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949673003 2020-09-08T16:34:37.126 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:34:37.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949673003 2020-09-08T16:34:37.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949673003' 2020-09-08T16:34:37.127 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:34:37.127 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949673003 2020-09-08T16:34:37.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949673003 -lt 42949673003 2020-09-08T16:34:37.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:34:37.530 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509482 2020-09-08T16:34:37.530 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:34:37.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:34:37.531 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509482 2020-09-08T16:34:37.531 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:34:37.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509482 2020-09-08T16:34:37.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509482' 2020-09-08T16:34:37.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:34:37.532 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509482 2020-09-08T16:34:37.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509480 -lt 64424509482 2020-09-08T16:34:37.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:34:38.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:34:38.952 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:34:39.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509482 -lt 64424509482 2020-09-08T16:34:39.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:34:39.349 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345961 2020-09-08T16:34:39.350 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:34:39.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:34:39.350 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345961 2020-09-08T16:34:39.351 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:34:39.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345961 2020-09-08T16:34:39.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345961' 2020-09-08T16:34:39.352 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:34:39.352 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345961 2020-09-08T16:34:39.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345962 -lt 85899345961 2020-09-08T16:34:39.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:34:39.768 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182439 2020-09-08T16:34:39.768 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:34:39.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:34:39.769 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182439 2020-09-08T16:34:39.769 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:34:39.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182439 2020-09-08T16:34:39.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182439' 2020-09-08T16:34:39.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:34:39.771 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182439 2020-09-08T16:34:40.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182439 -lt 107374182439 2020-09-08T16:34:40.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:34:40.190 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018917 2020-09-08T16:34:40.191 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:34:40.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T16:34:40.191 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018917 2020-09-08T16:34:40.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:34:40.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018917 2020-09-08T16:34:40.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018917' 2020-09-08T16:34:40.193 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T16:34:40.193 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018917 2020-09-08T16:34:40.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018918 -lt 128849018917 2020-09-08T16:34:40.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: get_num_pgs 2020-09-08T16:34:40.605 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:34:40.605 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:34:41.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: test 3 == 0 2020-09-08T16:34:41.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:34:41.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:34:41.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:34:41.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:34:41.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:34:41.139 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:34:41.139 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:34:41.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=1 2020-09-08T16:34:41.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 1 = 0 2020-09-08T16:34:41.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 1 '!=' -1 2020-09-08T16:34:41.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:68: wait_for_not_state: loop=0 2020-09-08T16:34:41.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:69: wait_for_not_state: num_in_state=1 2020-09-08T16:34:41.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 5 2020-09-08T16:34:46.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:34:46.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:34:46.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:34:46.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:34:46.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:34:46.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:34:46.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:34:46.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:34:46.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=1 2020-09-08T16:34:46.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 1 = 0 2020-09-08T16:34:46.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:67: wait_for_not_state: test 1 '!=' 1 2020-09-08T16:34:46.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:70: wait_for_not_state: (( 1 >= 17 )) 2020-09-08T16:34:46.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:74: wait_for_not_state: sleep 10 2020-09-08T16:34:56.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:75: wait_for_not_state: loop+=1 2020-09-08T16:34:56.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:34:56.957 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:34:56.957 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:34:56.958 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:34:56.958 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:34:56.959 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:34:56.959 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:34:57.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=0 2020-09-08T16:34:57.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 0 = 0 2020-09-08T16:34:57.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: break 2020-09-08T16:34:57.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:77: wait_for_not_state: return 0 2020-09-08T16:34:57.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:823: TEST_ec_backfill_multi: wait_for_not_activating 60 2020-09-08T16:34:57.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:88: wait_for_not_activating: local timeout=60 2020-09-08T16:34:57.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:89: wait_for_not_activating: wait_for_not_state activating 60 2020-09-08T16:34:57.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:53: wait_for_not_state: local state=activating 2020-09-08T16:34:57.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:54: wait_for_not_state: local num_in_state=-1 2020-09-08T16:34:57.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:55: wait_for_not_state: local cur_in_state 2020-09-08T16:34:57.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: delays=($(get_timeout_delays $2 5)) 2020-09-08T16:34:57.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: get_timeout_delays 60 5 2020-09-08T16:34:57.367 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:34:57.367 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:34:57.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:34:57.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:34:57.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:34:57.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: local -a delays 2020-09-08T16:34:57.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:57: wait_for_not_state: local -i loop=0 2020-09-08T16:34:57.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:59: wait_for_not_state: flush_pg_stats 2020-09-08T16:34:57.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:34:57.408 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:34:57.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:34:57.819 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:34:57.819 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:34:57.819 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:34:57.820 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T16:34:57.820 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T16:34:57.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:34:57.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:34:57.821 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:34:57.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836531 2020-09-08T16:34:57.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836531 2020-09-08T16:34:57.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836531' 2020-09-08T16:34:57.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:34:57.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:34:58.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949673010 2020-09-08T16:34:58.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949673010 2020-09-08T16:34:58.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836531 1-42949673010' 2020-09-08T16:34:58.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:34:58.074 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:34:58.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509488 2020-09-08T16:34:58.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509488 2020-09-08T16:34:58.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836531 1-42949673010 2-64424509488' 2020-09-08T16:34:58.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:34:58.206 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:34:58.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345968 2020-09-08T16:34:58.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345968 2020-09-08T16:34:58.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836531 1-42949673010 2-64424509488 3-85899345968' 2020-09-08T16:34:58.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:34:58.339 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:34:58.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182445 2020-09-08T16:34:58.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182445 2020-09-08T16:34:58.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836531 1-42949673010 2-64424509488 3-85899345968 4-107374182445' 2020-09-08T16:34:58.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:34:58.472 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T16:34:58.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018924 2020-09-08T16:34:58.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018924 2020-09-08T16:34:58.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836531 1-42949673010 2-64424509488 3-85899345968 4-107374182445 5-128849018924' 2020-09-08T16:34:58.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:34:58.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836531 2020-09-08T16:34:58.605 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:34:58.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:34:58.606 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836531 2020-09-08T16:34:58.606 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:34:58.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836531 2020-09-08T16:34:58.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836531' 2020-09-08T16:34:58.608 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:34:58.609 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836531 2020-09-08T16:34:59.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836531 -lt 21474836531 2020-09-08T16:34:59.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:34:59.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949673010 2020-09-08T16:34:59.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:34:59.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:34:59.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949673010 2020-09-08T16:34:59.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:34:59.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949673010 2020-09-08T16:34:59.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949673010' 2020-09-08T16:34:59.007 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:34:59.007 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949673010 2020-09-08T16:34:59.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949673010 -lt 42949673010 2020-09-08T16:34:59.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:34:59.403 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509488 2020-09-08T16:34:59.403 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:34:59.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:34:59.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509488 2020-09-08T16:34:59.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:34:59.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509488 2020-09-08T16:34:59.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509488' 2020-09-08T16:34:59.405 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:34:59.406 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509488 2020-09-08T16:34:59.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509488 -lt 64424509488 2020-09-08T16:34:59.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:34:59.806 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345968 2020-09-08T16:34:59.807 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:34:59.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:34:59.807 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345968 2020-09-08T16:34:59.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:34:59.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345968 2020-09-08T16:34:59.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345968' 2020-09-08T16:34:59.809 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:34:59.809 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345968 2020-09-08T16:35:00.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345966 -lt 85899345968 2020-09-08T16:35:00.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:35:01.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:35:01.212 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:35:01.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345968 -lt 85899345968 2020-09-08T16:35:01.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:35:01.625 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182445 2020-09-08T16:35:01.625 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:35:01.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:35:01.626 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182445 2020-09-08T16:35:01.627 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:35:01.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182445 2020-09-08T16:35:01.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182445' 2020-09-08T16:35:01.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:35:01.628 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182445 2020-09-08T16:35:02.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182445 -lt 107374182445 2020-09-08T16:35:02.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:35:02.035 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018924 2020-09-08T16:35:02.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:35:02.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T16:35:02.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018924 2020-09-08T16:35:02.037 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:35:02.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018924 2020-09-08T16:35:02.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018924' 2020-09-08T16:35:02.038 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T16:35:02.038 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018924 2020-09-08T16:35:02.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018924 -lt 128849018924 2020-09-08T16:35:02.444 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: get_num_pgs 2020-09-08T16:35:02.445 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:35:02.445 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:35:02.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: test 3 == 0 2020-09-08T16:35:02.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:35:02.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state activating 2020-09-08T16:35:02.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=activating 2020-09-08T16:35:02.979 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:35:02.979 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("activating"))' 2020-09-08T16:35:02.979 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:35:02.979 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("activating"))] | length' 2020-09-08T16:35:03.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=0 2020-09-08T16:35:03.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 0 = 0 2020-09-08T16:35:03.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: break 2020-09-08T16:35:03.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:77: wait_for_not_state: return 0 2020-09-08T16:35:03.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:825: TEST_ec_backfill_multi: ceph pg dump pgs 2020-09-08T16:35:03.739 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T16:35:03.739 INFO:tasks.workunit.client.0.smithi065.stdout:3.0 200 0 0 200 0 2457600 0 0 100 100 active+remapped+backfill_toofull 2020-09-08T16:34:36.661155+0000 58'200 68:247 [0,2,3,4,1] 0 [0,2,3,4,5] 0 0'0 2020-09-08T16:32:07.178748+0000 0'0 2020-09-08T16:32:07.178748+0000 0 2020-09-08T16:35:03.740 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 200 0 0 0 0 1843200 0 0 100 100 active+clean 2020-09-08T16:31:47.207181+0000 41'200 68:238 [1] 1 [1] 1 0'0 2020-09-08T16:31:44.557150+0000 0'0 2020-09-08T16:31:44.557150+0000 0 2020-09-08T16:35:03.740 INFO:tasks.workunit.client.0.smithi065.stdout:2.0 200 0 0 0 0 2457600 0 0 100 100 active+clean 2020-09-08T16:34:48.690965+0000 58'200 69:660 [0,2,3,4,1] 0 [0,2,3,4,1] 0 0'0 2020-09-08T16:32:05.198351+0000 0'0 2020-09-08T16:32:05.198351+0000 0 2020-09-08T16:35:03.740 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T16:35:03.740 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T16:35:03.741 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:35:03.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:827: TEST_ec_backfill_multi: ERRORS=0 2020-09-08T16:35:03.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:828: TEST_ec_backfill_multi: ceph pg dump pgs 2020-09-08T16:35:03.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:828: TEST_ec_backfill_multi: grep -v '^1.0' 2020-09-08T16:35:03.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:828: TEST_ec_backfill_multi: grep +backfill_toofull 2020-09-08T16:35:03.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:828: TEST_ec_backfill_multi: wc -l 2020-09-08T16:35:04.121 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:35:04.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:828: TEST_ec_backfill_multi: '[' 1 '!=' 1 ']' 2020-09-08T16:35:04.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:834: TEST_ec_backfill_multi: ceph pg dump pgs 2020-09-08T16:35:04.131 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:834: TEST_ec_backfill_multi: grep -v '^1.0' 2020-09-08T16:35:04.131 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:834: TEST_ec_backfill_multi: grep active+clean 2020-09-08T16:35:04.131 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:834: TEST_ec_backfill_multi: wc -l 2020-09-08T16:35:04.506 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:35:04.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:834: TEST_ec_backfill_multi: '[' 1 '!=' 1 ']' 2020-09-08T16:35:04.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:840: TEST_ec_backfill_multi: '[' 0 '!=' 0 ']' 2020-09-08T16:35:04.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:845: TEST_ec_backfill_multi: delete_pool fillpool 2020-09-08T16:35:04.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=fillpool 2020-09-08T16:35:04.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete fillpool fillpool --yes-i-really-really-mean-it 2020-09-08T16:35:05.048 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'fillpool' does not exist 2020-09-08T16:35:05.056 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:846: TEST_ec_backfill_multi: seq 1 2 2020-09-08T16:35:05.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:846: TEST_ec_backfill_multi: for i in $(seq 1 $pools) 2020-09-08T16:35:05.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:848: TEST_ec_backfill_multi: delete_pool test1 2020-09-08T16:35:05.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test1 2020-09-08T16:35:05.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2020-09-08T16:35:05.613 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test1' does not exist 2020-09-08T16:35:05.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:846: TEST_ec_backfill_multi: for i in $(seq 1 $pools) 2020-09-08T16:35:05.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:848: TEST_ec_backfill_multi: delete_pool test2 2020-09-08T16:35:05.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test2 2020-09-08T16:35:05.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test2 test2 --yes-i-really-really-mean-it 2020-09-08T16:35:06.159 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test2' does not exist 2020-09-08T16:35:06.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:850: TEST_ec_backfill_multi: kill_daemons td/osd-backfill-space 2020-09-08T16:35:06.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:35:06.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:35:06.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:35:06.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:35:06.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:35:06.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:35:06.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:38: run: teardown td/osd-backfill-space 2020-09-08T16:35:06.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2020-09-08T16:35:06.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:35:06.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2020-09-08T16:35:06.280 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:35:06.280 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:35:06.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:35:06.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:35:06.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:35:06.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:35:06.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:35:06.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:35:06.288 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:35:06.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:35:06.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:35:06.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:35:06.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:35:06.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:35:06.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:35:06.291 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:35:06.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:35:06.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:35:06.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2020-09-08T16:35:06.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:35:06.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:35:06.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:35:06.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.154687 2020-09-08T16:35:06.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:35:06.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:35:06.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:35: run: for func in $funcs 2020-09-08T16:35:06.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:36: run: setup td/osd-backfill-space 2020-09-08T16:35:06.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-space 2020-09-08T16:35:06.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-space 2020-09-08T16:35:06.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2020-09-08T16:35:06.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:35:06.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2020-09-08T16:35:06.324 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:35:06.324 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:35:06.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:35:06.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:35:06.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:35:06.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:35:06.325 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:35:06.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:35:06.326 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:35:06.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:35:06.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:35:06.327 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:35:06.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:35:06.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:35:06.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:35:06.328 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:35:06.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:35:06.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:35:06.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2020-09-08T16:35:06.331 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:35:06.331 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:35:06.331 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:35:06.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.154687 2020-09-08T16:35:06.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:35:06.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:35:06.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-space 2020-09-08T16:35:06.333 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T16:35:06.333 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:35:06.333 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:35:06.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.154687 2020-09-08T16:35:06.335 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T16:35:06.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T16:35:06.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T16:35:06.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2020-09-08T16:35:06.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:37: run: TEST_ec_backfill_simple td/osd-backfill-space 2020-09-08T16:35:06.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:623: TEST_ec_backfill_simple: local dir=td/osd-backfill-space 2020-09-08T16:35:06.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:624: TEST_ec_backfill_simple: local EC= 2020-09-08T16:35:06.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:625: TEST_ec_backfill_simple: local pools=1 2020-09-08T16:35:06.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:626: TEST_ec_backfill_simple: local OSDS=6 2020-09-08T16:35:06.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:627: TEST_ec_backfill_simple: local k=3 2020-09-08T16:35:06.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:628: TEST_ec_backfill_simple: local m=2 2020-09-08T16:35:06.337 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:629: TEST_ec_backfill_simple: expr 600 / 3 2020-09-08T16:35:06.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:629: TEST_ec_backfill_simple: local ecobjects=200 2020-09-08T16:35:06.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:631: TEST_ec_backfill_simple: run_mon td/osd-backfill-space a 2020-09-08T16:35:06.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-space 2020-09-08T16:35:06.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T16:35:06.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T16:35:06.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T16:35:06.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-space/a 2020-09-08T16:35:06.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2020-09-08T16:35:06.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T16:35:06.630 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:35:06.630 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:35:06.630 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:35:06.630 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:35:06.630 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:35:06.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:35:06.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T16:35:06.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T16:35:06.790 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T16:35:06.790 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:35:06.791 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:35:06.791 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T16:35:06.791 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T16:35:06.791 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:35:06.791 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:35:06.792 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:35:06.792 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:35:06.792 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:35:06.792 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:35:06.792 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.154687/ceph-mon.a.asok 2020-09-08T16:35:06.793 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:35:06.793 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.154687/ceph-mon.a.asok config get fsid 2020-09-08T16:35:06.883 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T16:35:06.884 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:35:06.884 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:35:06.884 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T16:35:06.884 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T16:35:06.884 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:35:06.885 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:35:06.885 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:35:06.886 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:35:06.886 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:35:06.886 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:35:06.886 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.154687/ceph-mon.a.asok 2020-09-08T16:35:06.887 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:35:06.887 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.154687/ceph-mon.a.asok config get mon_host 2020-09-08T16:35:06.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:632: TEST_ec_backfill_simple: run_mgr td/osd-backfill-space x 2020-09-08T16:35:06.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-space 2020-09-08T16:35:06.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T16:35:06.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T16:35:06.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T16:35:06.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-space/x 2020-09-08T16:35:06.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T16:35:07.898 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T16:35:07.898 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:35:07.898 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:35:07.898 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:35:07.899 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:35:07.899 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:35:07.899 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:35:07.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:35:07.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:35:07.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:633: TEST_ec_backfill_simple: export CEPH_ARGS 2020-09-08T16:35:07.924 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:635: TEST_ec_backfill_simple: expr 6 - 1 2020-09-08T16:35:07.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:635: TEST_ec_backfill_simple: seq 0 5 2020-09-08T16:35:07.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:635: TEST_ec_backfill_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:35:07.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:637: TEST_ec_backfill_simple: run_osd td/osd-backfill-space 0 2020-09-08T16:35:07.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:35:07.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:35:07.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T16:35:07.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:35:07.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/0 2020-09-08T16:35:07.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:35:07.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:35:07.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:35:07.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:35:07.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2020-09-08T16:35:07.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2020-09-08T16:35:07.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:35:07.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:35:07.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:35:07.933 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:35:07.934 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:35:07.934 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:35:07.934 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:35:07.934 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:35:07.936 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:35:07.937 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:35:07.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:35:07.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:35:07.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:35:07.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:35:07.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:35:07.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:35:07.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:35:07.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:35:07.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:35:07.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:35:07.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:35:07.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/0 2020-09-08T16:35:07.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:35:07.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=977ebd3b-772e-4f9b-807c-3102f4a6c698 2020-09-08T16:35:07.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 977ebd3b-772e-4f9b-807c-3102f4a6c698' 2020-09-08T16:35:07.941 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:35:07.941 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 977ebd3b-772e-4f9b-807c-3102f4a6c698 2020-09-08T16:35:07.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQC7sldfsCvLOBAA7xKAnRj+ELRYjA2a/wpZdQ== 2020-09-08T16:35:07.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQC7sldfsCvLOBAA7xKAnRj+ELRYjA2a/wpZdQ=="}' 2020-09-08T16:35:07.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 977ebd3b-772e-4f9b-807c-3102f4a6c698 -i td/osd-backfill-space/0/new.json 2020-09-08T16:35:08.283 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:35:08.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/0/new.json 2020-09-08T16:35:08.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQC7sldfsCvLOBAA7xKAnRj+ELRYjA2a/wpZdQ== --osd-uuid 977ebd3b-772e-4f9b-807c-3102f4a6c698 2020-09-08T16:35:08.321 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:08.326+0000 7f21e0f66ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:08.323 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:08.327+0000 7f21e0f66ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:08.326 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:08.329+0000 7f21e0f66ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:08.326 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:08.330+0000 7f21e0f66ec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T16:35:08.326 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:08.330+0000 7f21e0f66ec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T16:35:08.327 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:08.330+0000 7f21e0f66ec0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2020-09-08T16:35:08.382 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:08.386+0000 7f21e0f66ec0 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2020-09-08T16:35:12.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2020-09-08T16:35:12.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:35:12.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T16:35:12.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:35:12.446 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T16:35:12.981 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T16:35:12.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T16:35:12.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:35:12.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:35:12.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:35:12.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:35:13.004 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:13.009+0000 7f64881abec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:13.025 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:13.023+0000 7f64881abec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:13.025 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:13.024+0000 7f64881abec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:13.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T16:35:13.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:35:13.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T16:35:13.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:35:13.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:35:13.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:35:13.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:35:13.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:35:13.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:35:13.376 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:35:13.541 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:13.546+0000 7f64881abec0 -1 Falling back to public interface 2020-09-08T16:35:13.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:35:14.309 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:14.314+0000 7f64881abec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T16:35:14.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:35:14.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:35:14.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:35:14.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:35:14.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:35:14.791 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:35:15.212 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/466673,v1:127.0.0.1:6803/466673] [v2:127.0.0.1:6804/466673,v1:127.0.0.1:6805/466673] exists,up 977ebd3b-772e-4f9b-807c-3102f4a6c698 2020-09-08T16:35:15.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:35:15.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:35:15.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:35:15.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:635: TEST_ec_backfill_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:35:15.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:637: TEST_ec_backfill_simple: run_osd td/osd-backfill-space 1 2020-09-08T16:35:15.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:35:15.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:35:15.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T16:35:15.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:35:15.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/1 2020-09-08T16:35:15.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:35:15.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:35:15.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:35:15.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:35:15.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2020-09-08T16:35:15.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2020-09-08T16:35:15.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:35:15.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:35:15.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:35:15.217 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:35:15.217 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:35:15.218 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:35:15.218 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:35:15.218 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:35:15.218 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:35:15.218 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:35:15.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:35:15.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:35:15.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:35:15.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:35:15.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:35:15.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:35:15.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:35:15.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:35:15.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:35:15.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:35:15.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:35:15.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/1 2020-09-08T16:35:15.221 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:35:15.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=a333195f-0819-4d4e-9d0d-9164461dd54b 2020-09-08T16:35:15.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 a333195f-0819-4d4e-9d0d-9164461dd54b' 2020-09-08T16:35:15.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:35:15.223 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 a333195f-0819-4d4e-9d0d-9164461dd54b 2020-09-08T16:35:15.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDDsldfg8cSDhAA3ZBCdarUiu8huDPJyji8CQ== 2020-09-08T16:35:15.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDDsldfg8cSDhAA3ZBCdarUiu8huDPJyji8CQ=="}' 2020-09-08T16:35:15.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new a333195f-0819-4d4e-9d0d-9164461dd54b -i td/osd-backfill-space/1/new.json 2020-09-08T16:35:15.771 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:35:15.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/1/new.json 2020-09-08T16:35:15.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDDsldfg8cSDhAA3ZBCdarUiu8huDPJyji8CQ== --osd-uuid a333195f-0819-4d4e-9d0d-9164461dd54b 2020-09-08T16:35:15.810 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:15.815+0000 7fcb8f048ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:15.812 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:15.817+0000 7fcb8f048ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:15.813 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:15.819+0000 7fcb8f048ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:15.814 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:15.819+0000 7fcb8f048ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T16:35:15.815 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:15.819+0000 7fcb8f048ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T16:35:15.815 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:15.819+0000 7fcb8f048ec0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2020-09-08T16:35:15.891 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:15.896+0000 7fcb8f048ec0 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2020-09-08T16:35:20.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2020-09-08T16:35:20.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:35:20.026 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T16:35:20.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T16:35:20.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:35:20.560 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T16:35:20.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T16:35:20.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:35:20.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:35:20.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:35:20.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:35:20.586 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:20.591+0000 7f889b060ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:20.596 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:20.601+0000 7f889b060ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:20.597 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:20.602+0000 7f889b060ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:20.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T16:35:20.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:35:20.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T16:35:20.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:35:20.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:35:20.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:35:20.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:35:20.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:35:20.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:35:20.963 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:35:21.113 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:21.118+0000 7f889b060ec0 -1 Falling back to public interface 2020-09-08T16:35:21.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:35:22.063 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:22.068+0000 7f889b060ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T16:35:22.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:35:22.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:35:22.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:35:22.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:35:22.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:35:22.363 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:35:22.826 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/467667,v1:127.0.0.1:6811/467667] [v2:127.0.0.1:6812/467667,v1:127.0.0.1:6813/467667] exists,up a333195f-0819-4d4e-9d0d-9164461dd54b 2020-09-08T16:35:22.827 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 cb65f952-253e-4e79-aec2-3797483daab8 2020-09-08T16:35:22.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:35:22.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:35:22.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:35:22.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:635: TEST_ec_backfill_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:35:22.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:637: TEST_ec_backfill_simple: run_osd td/osd-backfill-space 2 2020-09-08T16:35:22.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:35:22.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:35:22.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T16:35:22.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:35:22.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/2 2020-09-08T16:35:22.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:35:22.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:35:22.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:35:22.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:35:22.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2020-09-08T16:35:22.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2020-09-08T16:35:22.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:35:22.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:35:22.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:35:22.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:35:22.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:35:22.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:35:22.839 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:35:22.842 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:35:22.842 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:35:22.842 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:35:22.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:35:22.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:35:22.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:35:22.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:35:22.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:35:22.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:35:22.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:35:22.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:35:22.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:35:22.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:35:22.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:35:22.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/2 2020-09-08T16:35:22.855 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:35:22.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=cb65f952-253e-4e79-aec2-3797483daab8 2020-09-08T16:35:22.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 cb65f952-253e-4e79-aec2-3797483daab8' 2020-09-08T16:35:22.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:35:22.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDKsldfAVh8MhAAz7IzSNlqx/fNGLhyLsVCIw== 2020-09-08T16:35:22.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDKsldfAVh8MhAAz7IzSNlqx/fNGLhyLsVCIw=="}' 2020-09-08T16:35:22.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new cb65f952-253e-4e79-aec2-3797483daab8 -i td/osd-backfill-space/2/new.json 2020-09-08T16:35:23.446 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:35:23.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/2/new.json 2020-09-08T16:35:23.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDKsldfAVh8MhAAz7IzSNlqx/fNGLhyLsVCIw== --osd-uuid cb65f952-253e-4e79-aec2-3797483daab8 2020-09-08T16:35:23.485 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:23.490+0000 7fec78dcfec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:23.487 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:23.492+0000 7fec78dcfec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:23.488 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:23.493+0000 7fec78dcfec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:23.488 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:23.494+0000 7fec78dcfec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T16:35:23.489 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:23.494+0000 7fec78dcfec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T16:35:23.489 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:23.494+0000 7fec78dcfec0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2020-09-08T16:35:23.520 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:23.525+0000 7fec78dcfec0 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2020-09-08T16:35:27.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2020-09-08T16:35:27.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:35:27.786 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T16:35:27.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T16:35:27.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:35:28.324 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T16:35:28.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T16:35:28.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:35:28.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:35:28.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:35:28.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:35:28.350 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:28.355+0000 7f42338ffec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:28.372 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:28.372+0000 7f42338ffec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:28.373 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:28.373+0000 7f42338ffec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:28.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T16:35:28.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:35:28.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T16:35:28.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:35:28.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:35:28.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:35:28.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:35:28.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:35:28.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:35:28.725 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:35:28.884 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:28.889+0000 7f42338ffec0 -1 Falling back to public interface 2020-09-08T16:35:29.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:35:29.650 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:29.655+0000 7f42338ffec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T16:35:30.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:35:30.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:35:30.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:35:30.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:35:30.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:35:30.139 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:35:30.546 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/468661,v1:127.0.0.1:6819/468661] [v2:127.0.0.1:6820/468661,v1:127.0.0.1:6821/468661] exists,up cb65f952-253e-4e79-aec2-3797483daab8 2020-09-08T16:35:30.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:35:30.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:35:30.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:35:30.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:635: TEST_ec_backfill_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:35:30.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:637: TEST_ec_backfill_simple: run_osd td/osd-backfill-space 3 2020-09-08T16:35:30.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:35:30.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:35:30.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T16:35:30.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:35:30.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/3 2020-09-08T16:35:30.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:35:30.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:35:30.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:35:30.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:35:30.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/3' 2020-09-08T16:35:30.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/3/journal' 2020-09-08T16:35:30.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:35:30.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:35:30.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:35:30.551 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:35:30.551 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:35:30.551 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:35:30.551 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:35:30.551 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:35:30.552 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:35:30.552 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:35:30.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:35:30.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:35:30.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:35:30.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:35:30.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:35:30.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:35:30.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:35:30.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:35:30.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:35:30.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:35:30.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:35:30.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/3 2020-09-08T16:35:30.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:35:30.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=f2eae547-0fa9-4a47-a417-606f0f80fd6f 2020-09-08T16:35:30.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 f2eae547-0fa9-4a47-a417-606f0f80fd6f' 2020-09-08T16:35:30.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:35:30.556 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 f2eae547-0fa9-4a47-a417-606f0f80fd6f 2020-09-08T16:35:30.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDSsldfeNv2IRAANzihlbFlANdSufLBgyoMsA== 2020-09-08T16:35:30.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDSsldfeNv2IRAANzihlbFlANdSufLBgyoMsA=="}' 2020-09-08T16:35:30.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new f2eae547-0fa9-4a47-a417-606f0f80fd6f -i td/osd-backfill-space/3/new.json 2020-09-08T16:35:31.066 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T16:35:31.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/3/new.json 2020-09-08T16:35:31.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDSsldfeNv2IRAANzihlbFlANdSufLBgyoMsA== --osd-uuid f2eae547-0fa9-4a47-a417-606f0f80fd6f 2020-09-08T16:35:31.105 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:31.110+0000 7f31333e6ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:31.107 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:31.112+0000 7f31333e6ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:31.109 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:31.114+0000 7f31333e6ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:31.110 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:31.114+0000 7f31333e6ec0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2020-09-08T16:35:31.110 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:31.114+0000 7f31333e6ec0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2020-09-08T16:35:31.110 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:31.114+0000 7f31333e6ec0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2020-09-08T16:35:31.157 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:31.162+0000 7f31333e6ec0 -1 bluestore(td/osd-backfill-space/3) _read_fsid unparsable uuid 2020-09-08T16:35:35.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/3/keyring 2020-09-08T16:35:35.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:35:35.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T16:35:35.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:35:35.351 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T16:35:35.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T16:35:35.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:35:35.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:35:35.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:35:35.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:35:35.909 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T16:35:35.933 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:35.938+0000 7fecabf81ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:35.938 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:35.943+0000 7fecabf81ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:35.940 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:35.945+0000 7fecabf81ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:36.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T16:35:36.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:35:36.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T16:35:36.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:35:36.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:35:36.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:35:36.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:35:36.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:35:36.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:35:36.306 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:35:36.464 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:36.469+0000 7fecabf81ec0 -1 Falling back to public interface 2020-09-08T16:35:36.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:35:37.273 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:37.277+0000 7fecabf81ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T16:35:37.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:35:37.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:35:37.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:35:37.700 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:35:37.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:35:37.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:35:38.140 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/469655,v1:127.0.0.1:6827/469655] [v2:127.0.0.1:6828/469655,v1:127.0.0.1:6829/469655] exists,up f2eae547-0fa9-4a47-a417-606f0f80fd6f 2020-09-08T16:35:38.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:35:38.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:35:38.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:35:38.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:635: TEST_ec_backfill_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:35:38.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:637: TEST_ec_backfill_simple: run_osd td/osd-backfill-space 4 2020-09-08T16:35:38.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:35:38.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:35:38.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=4 2020-09-08T16:35:38.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:35:38.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/4 2020-09-08T16:35:38.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:35:38.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:35:38.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:35:38.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:35:38.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/4' 2020-09-08T16:35:38.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/4/journal' 2020-09-08T16:35:38.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:35:38.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:35:38.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:35:38.144 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:35:38.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:35:38.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:35:38.145 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:35:38.145 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:35:38.146 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:35:38.146 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:35:38.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:35:38.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:35:38.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:35:38.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:35:38.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:35:38.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:35:38.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:35:38.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:35:38.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:35:38.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:35:38.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:35:38.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/4 2020-09-08T16:35:38.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:35:38.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=c55715f1-042d-46dc-9ca7-13d2e0fc3f88 2020-09-08T16:35:38.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd4 c55715f1-042d-46dc-9ca7-13d2e0fc3f88' 2020-09-08T16:35:38.150 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:35:38.150 INFO:tasks.workunit.client.0.smithi065.stdout:add osd4 c55715f1-042d-46dc-9ca7-13d2e0fc3f88 2020-09-08T16:35:38.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDasldfYVzGCRAA5syxjbUJ+Y4e8IVIHBiYjg== 2020-09-08T16:35:38.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDasldfYVzGCRAA5syxjbUJ+Y4e8IVIHBiYjg=="}' 2020-09-08T16:35:38.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new c55715f1-042d-46dc-9ca7-13d2e0fc3f88 -i td/osd-backfill-space/4/new.json 2020-09-08T16:35:38.751 INFO:tasks.workunit.client.0.smithi065.stdout:4 2020-09-08T16:35:38.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/4/new.json 2020-09-08T16:35:38.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 4 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDasldfYVzGCRAA5syxjbUJ+Y4e8IVIHBiYjg== --osd-uuid c55715f1-042d-46dc-9ca7-13d2e0fc3f88 2020-09-08T16:35:38.790 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:38.795+0000 7f9bfe1cfec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:38.791 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:38.797+0000 7f9bfe1cfec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:38.793 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:38.798+0000 7f9bfe1cfec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:38.794 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:38.799+0000 7f9bfe1cfec0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2020-09-08T16:35:38.794 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:38.799+0000 7f9bfe1cfec0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2020-09-08T16:35:38.794 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:38.799+0000 7f9bfe1cfec0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2020-09-08T16:35:38.858 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:38.863+0000 7f9bfe1cfec0 -1 bluestore(td/osd-backfill-space/4) _read_fsid unparsable uuid 2020-09-08T16:35:43.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/4/keyring 2020-09-08T16:35:43.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:35:43.160 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd4 key to auth repository 2020-09-08T16:35:43.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd4 key to auth repository 2020-09-08T16:35:43.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:35:43.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.4 2020-09-08T16:35:43.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 4 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:35:43.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:35:43.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:35:43.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:35:43.704 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.4 2020-09-08T16:35:43.725 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:43.730+0000 7fda53444ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:43.748 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:43.751+0000 7fda53444ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:43.749 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:43.752+0000 7fda53444ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:44.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 4 2020-09-08T16:35:44.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:35:44.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=4 2020-09-08T16:35:44.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:35:44.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:35:44.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:35:44.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:35:44.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:35:44.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:35:44.111 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:35:44.267 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:44.272+0000 7fda53444ec0 -1 Falling back to public interface 2020-09-08T16:35:44.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:35:45.096 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:45.101+0000 7fda53444ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-09-08T16:35:45.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:35:45.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:35:45.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:35:45.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:35:45.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:35:45.515 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:35:45.927 INFO:tasks.workunit.client.0.smithi065.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/470649,v1:127.0.0.1:6835/470649] [v2:127.0.0.1:6836/470649,v1:127.0.0.1:6837/470649] exists,up c55715f1-042d-46dc-9ca7-13d2e0fc3f88 2020-09-08T16:35:45.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:35:45.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:35:45.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:35:45.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:635: TEST_ec_backfill_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-09-08T16:35:45.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:637: TEST_ec_backfill_simple: run_osd td/osd-backfill-space 5 2020-09-08T16:35:45.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-space 2020-09-08T16:35:45.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:35:45.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=5 2020-09-08T16:35:45.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:35:45.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-space/5 2020-09-08T16:35:45.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:35:45.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:35:45.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:35:45.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:35:45.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/5' 2020-09-08T16:35:45.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/5/journal' 2020-09-08T16:35:45.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:35:45.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:35:45.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:35:45.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:35:45.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:35:45.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:35:45.932 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:35:45.933 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:35:45.933 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:35:45.933 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:35:45.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:35:45.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:35:45.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:35:45.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:35:45.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:35:45.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:35:45.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:35:45.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:35:45.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:35:45.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:35:45.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:35:45.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-space/5 2020-09-08T16:35:45.964 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:35:45.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=fcff9745-63e0-4836-a1b3-dbb5fe50aaf9 2020-09-08T16:35:45.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd5 fcff9745-63e0-4836-a1b3-dbb5fe50aaf9' 2020-09-08T16:35:45.965 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:35:45.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDhsldfolm+OBAAfkRlDIaDvSpwl2YmJElwfA== 2020-09-08T16:35:45.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDhsldfolm+OBAAfkRlDIaDvSpwl2YmJElwfA=="}' 2020-09-08T16:35:45.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new fcff9745-63e0-4836-a1b3-dbb5fe50aaf9 -i td/osd-backfill-space/5/new.json 2020-09-08T16:35:45.966 INFO:tasks.workunit.client.0.smithi065.stdout:add osd5 fcff9745-63e0-4836-a1b3-dbb5fe50aaf9 2020-09-08T16:35:46.526 INFO:tasks.workunit.client.0.smithi065.stdout:5 2020-09-08T16:35:46.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-space/5/new.json 2020-09-08T16:35:46.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 5 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDhsldfolm+OBAAfkRlDIaDvSpwl2YmJElwfA== --osd-uuid fcff9745-63e0-4836-a1b3-dbb5fe50aaf9 2020-09-08T16:35:46.565 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:46.570+0000 7f866c42bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:46.572 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:46.572+0000 7f866c42bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:46.573 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:46.573+0000 7f866c42bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:46.573 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:46.574+0000 7f866c42bec0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2020-09-08T16:35:46.573 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:46.574+0000 7f866c42bec0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2020-09-08T16:35:46.573 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:46.574+0000 7f866c42bec0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2020-09-08T16:35:46.671 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:46.676+0000 7f866c42bec0 -1 bluestore(td/osd-backfill-space/5) _read_fsid unparsable uuid 2020-09-08T16:35:50.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-space/5/keyring 2020-09-08T16:35:50.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:35:50.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd5 key to auth repository 2020-09-08T16:35:50.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-space/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:35:50.904 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd5 key to auth repository 2020-09-08T16:35:51.444 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.5 2020-09-08T16:35:51.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.5 2020-09-08T16:35:51.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:35:51.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:35:51.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:35:51.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 5 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:35:51.548 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:51.471+0000 7f324e468ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:51.549 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:51.473+0000 7f324e468ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:51.549 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:51.474+0000 7f324e468ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:35:51.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 5 2020-09-08T16:35:51.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:35:51.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=5 2020-09-08T16:35:51.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:35:51.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:35:51.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:35:51.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:35:51.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:35:51.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T16:35:51.858 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:35:51.988 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:51.991+0000 7f324e468ec0 -1 Falling back to public interface 2020-09-08T16:35:52.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:35:52.795 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:35:52.799+0000 7f324e468ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-09-08T16:35:53.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:35:53.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:35:53.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:35:53.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T16:35:53.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:35:53.269 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:35:53.679 INFO:tasks.workunit.client.0.smithi065.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/471651,v1:127.0.0.1:6843/471651] [v2:127.0.0.1:6844/471651,v1:127.0.0.1:6845/471651] exists,up fcff9745-63e0-4836-a1b3-dbb5fe50aaf9 2020-09-08T16:35:53.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:35:53.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:35:53.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:35:53.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:640: TEST_ec_backfill_simple: ceph osd set-backfillfull-ratio .85 2020-09-08T16:35:54.507 INFO:tasks.workunit.client.0.smithi065.stderr:osd set-backfillfull-ratio 0.85 2020-09-08T16:35:54.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:641: TEST_ec_backfill_simple: create_pool fillpool 1 1 2020-09-08T16:35:54.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create fillpool 1 1 2020-09-08T16:35:55.059 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'fillpool' already exists 2020-09-08T16:35:55.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:35:56.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:642: TEST_ec_backfill_simple: ceph osd pool set fillpool size 1 --yes-i-really-mean-it 2020-09-08T16:35:56.858 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 1 2020-09-08T16:35:56.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:651: TEST_ec_backfill_simple: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=13 2020-09-08T16:35:56.868 INFO:tasks.workunit.client.0.smithi065.stderr:13+0 records in 2020-09-08T16:35:56.868 INFO:tasks.workunit.client.0.smithi065.stderr:13+0 records out 2020-09-08T16:35:56.869 INFO:tasks.workunit.client.0.smithi065.stderr:13312 bytes (13 kB, 13 KiB) copied, 0.000133076 s, 100 MB/s 2020-09-08T16:35:56.869 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: seq 1 200 2020-09-08T16:35:56.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:56.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj1 td/osd-backfill-space/datafile 2020-09-08T16:35:57.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:57.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj2 td/osd-backfill-space/datafile 2020-09-08T16:35:57.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:57.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj3 td/osd-backfill-space/datafile 2020-09-08T16:35:57.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:57.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj4 td/osd-backfill-space/datafile 2020-09-08T16:35:57.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:57.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj5 td/osd-backfill-space/datafile 2020-09-08T16:35:57.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:57.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj6 td/osd-backfill-space/datafile 2020-09-08T16:35:57.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:57.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj7 td/osd-backfill-space/datafile 2020-09-08T16:35:57.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:57.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj8 td/osd-backfill-space/datafile 2020-09-08T16:35:57.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:57.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj9 td/osd-backfill-space/datafile 2020-09-08T16:35:57.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:57.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj10 td/osd-backfill-space/datafile 2020-09-08T16:35:58.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:58.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj11 td/osd-backfill-space/datafile 2020-09-08T16:35:58.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:58.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj12 td/osd-backfill-space/datafile 2020-09-08T16:35:58.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:58.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj13 td/osd-backfill-space/datafile 2020-09-08T16:35:58.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:58.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj14 td/osd-backfill-space/datafile 2020-09-08T16:35:58.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:58.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj15 td/osd-backfill-space/datafile 2020-09-08T16:35:58.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:58.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj16 td/osd-backfill-space/datafile 2020-09-08T16:35:58.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:58.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj17 td/osd-backfill-space/datafile 2020-09-08T16:35:58.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:58.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj18 td/osd-backfill-space/datafile 2020-09-08T16:35:58.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:58.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj19 td/osd-backfill-space/datafile 2020-09-08T16:35:58.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:58.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj20 td/osd-backfill-space/datafile 2020-09-08T16:35:58.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:58.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj21 td/osd-backfill-space/datafile 2020-09-08T16:35:59.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:59.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj22 td/osd-backfill-space/datafile 2020-09-08T16:35:59.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:59.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj23 td/osd-backfill-space/datafile 2020-09-08T16:35:59.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:59.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj24 td/osd-backfill-space/datafile 2020-09-08T16:35:59.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:59.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj25 td/osd-backfill-space/datafile 2020-09-08T16:35:59.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:59.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj26 td/osd-backfill-space/datafile 2020-09-08T16:35:59.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:59.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj27 td/osd-backfill-space/datafile 2020-09-08T16:35:59.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:59.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj28 td/osd-backfill-space/datafile 2020-09-08T16:35:59.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:59.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj29 td/osd-backfill-space/datafile 2020-09-08T16:35:59.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:59.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj30 td/osd-backfill-space/datafile 2020-09-08T16:35:59.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:59.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj31 td/osd-backfill-space/datafile 2020-09-08T16:35:59.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:59.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj32 td/osd-backfill-space/datafile 2020-09-08T16:35:59.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:35:59.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj33 td/osd-backfill-space/datafile 2020-09-08T16:36:00.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:00.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj34 td/osd-backfill-space/datafile 2020-09-08T16:36:00.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:00.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj35 td/osd-backfill-space/datafile 2020-09-08T16:36:00.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:00.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj36 td/osd-backfill-space/datafile 2020-09-08T16:36:00.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:00.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj37 td/osd-backfill-space/datafile 2020-09-08T16:36:00.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:00.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj38 td/osd-backfill-space/datafile 2020-09-08T16:36:00.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:00.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj39 td/osd-backfill-space/datafile 2020-09-08T16:36:00.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:00.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj40 td/osd-backfill-space/datafile 2020-09-08T16:36:00.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:00.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj41 td/osd-backfill-space/datafile 2020-09-08T16:36:00.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:00.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj42 td/osd-backfill-space/datafile 2020-09-08T16:36:00.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:00.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj43 td/osd-backfill-space/datafile 2020-09-08T16:36:00.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:00.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj44 td/osd-backfill-space/datafile 2020-09-08T16:36:00.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:00.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj45 td/osd-backfill-space/datafile 2020-09-08T16:36:00.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:00.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj46 td/osd-backfill-space/datafile 2020-09-08T16:36:01.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:01.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj47 td/osd-backfill-space/datafile 2020-09-08T16:36:01.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:01.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj48 td/osd-backfill-space/datafile 2020-09-08T16:36:01.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:01.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj49 td/osd-backfill-space/datafile 2020-09-08T16:36:01.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:01.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj50 td/osd-backfill-space/datafile 2020-09-08T16:36:01.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:01.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj51 td/osd-backfill-space/datafile 2020-09-08T16:36:01.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:01.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj52 td/osd-backfill-space/datafile 2020-09-08T16:36:01.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:01.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj53 td/osd-backfill-space/datafile 2020-09-08T16:36:01.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:01.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj54 td/osd-backfill-space/datafile 2020-09-08T16:36:01.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:01.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj55 td/osd-backfill-space/datafile 2020-09-08T16:36:01.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:01.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj56 td/osd-backfill-space/datafile 2020-09-08T16:36:01.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:01.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj57 td/osd-backfill-space/datafile 2020-09-08T16:36:01.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:01.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj58 td/osd-backfill-space/datafile 2020-09-08T16:36:02.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:02.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj59 td/osd-backfill-space/datafile 2020-09-08T16:36:02.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:02.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj60 td/osd-backfill-space/datafile 2020-09-08T16:36:02.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:02.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj61 td/osd-backfill-space/datafile 2020-09-08T16:36:02.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:02.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj62 td/osd-backfill-space/datafile 2020-09-08T16:36:02.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:02.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj63 td/osd-backfill-space/datafile 2020-09-08T16:36:02.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:02.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj64 td/osd-backfill-space/datafile 2020-09-08T16:36:02.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:02.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj65 td/osd-backfill-space/datafile 2020-09-08T16:36:02.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:02.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj66 td/osd-backfill-space/datafile 2020-09-08T16:36:02.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:02.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj67 td/osd-backfill-space/datafile 2020-09-08T16:36:02.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:02.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj68 td/osd-backfill-space/datafile 2020-09-08T16:36:02.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:02.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj69 td/osd-backfill-space/datafile 2020-09-08T16:36:02.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:02.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj70 td/osd-backfill-space/datafile 2020-09-08T16:36:03.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:03.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj71 td/osd-backfill-space/datafile 2020-09-08T16:36:03.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:03.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj72 td/osd-backfill-space/datafile 2020-09-08T16:36:03.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:03.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj73 td/osd-backfill-space/datafile 2020-09-08T16:36:03.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:03.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj74 td/osd-backfill-space/datafile 2020-09-08T16:36:03.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:03.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj75 td/osd-backfill-space/datafile 2020-09-08T16:36:03.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:03.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj76 td/osd-backfill-space/datafile 2020-09-08T16:36:03.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:03.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj77 td/osd-backfill-space/datafile 2020-09-08T16:36:03.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:03.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj78 td/osd-backfill-space/datafile 2020-09-08T16:36:03.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:03.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj79 td/osd-backfill-space/datafile 2020-09-08T16:36:03.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:03.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj80 td/osd-backfill-space/datafile 2020-09-08T16:36:03.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:03.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj81 td/osd-backfill-space/datafile 2020-09-08T16:36:03.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:03.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj82 td/osd-backfill-space/datafile 2020-09-08T16:36:04.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:04.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj83 td/osd-backfill-space/datafile 2020-09-08T16:36:04.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:04.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj84 td/osd-backfill-space/datafile 2020-09-08T16:36:04.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:04.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj85 td/osd-backfill-space/datafile 2020-09-08T16:36:04.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:04.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj86 td/osd-backfill-space/datafile 2020-09-08T16:36:04.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:04.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj87 td/osd-backfill-space/datafile 2020-09-08T16:36:04.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:04.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj88 td/osd-backfill-space/datafile 2020-09-08T16:36:04.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:04.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj89 td/osd-backfill-space/datafile 2020-09-08T16:36:04.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:04.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj90 td/osd-backfill-space/datafile 2020-09-08T16:36:04.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:04.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj91 td/osd-backfill-space/datafile 2020-09-08T16:36:04.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:04.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj92 td/osd-backfill-space/datafile 2020-09-08T16:36:04.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:04.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj93 td/osd-backfill-space/datafile 2020-09-08T16:36:04.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:04.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj94 td/osd-backfill-space/datafile 2020-09-08T16:36:05.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:05.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj95 td/osd-backfill-space/datafile 2020-09-08T16:36:05.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:05.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj96 td/osd-backfill-space/datafile 2020-09-08T16:36:05.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:05.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj97 td/osd-backfill-space/datafile 2020-09-08T16:36:05.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:05.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj98 td/osd-backfill-space/datafile 2020-09-08T16:36:05.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:05.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj99 td/osd-backfill-space/datafile 2020-09-08T16:36:05.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:05.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj100 td/osd-backfill-space/datafile 2020-09-08T16:36:05.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:05.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj101 td/osd-backfill-space/datafile 2020-09-08T16:36:05.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:05.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj102 td/osd-backfill-space/datafile 2020-09-08T16:36:05.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:05.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj103 td/osd-backfill-space/datafile 2020-09-08T16:36:05.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:05.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj104 td/osd-backfill-space/datafile 2020-09-08T16:36:05.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:05.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj105 td/osd-backfill-space/datafile 2020-09-08T16:36:05.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:05.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj106 td/osd-backfill-space/datafile 2020-09-08T16:36:05.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:05.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj107 td/osd-backfill-space/datafile 2020-09-08T16:36:06.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:06.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj108 td/osd-backfill-space/datafile 2020-09-08T16:36:06.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:06.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj109 td/osd-backfill-space/datafile 2020-09-08T16:36:06.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:06.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj110 td/osd-backfill-space/datafile 2020-09-08T16:36:06.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:06.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj111 td/osd-backfill-space/datafile 2020-09-08T16:36:06.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:06.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj112 td/osd-backfill-space/datafile 2020-09-08T16:36:06.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:06.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj113 td/osd-backfill-space/datafile 2020-09-08T16:36:06.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:06.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj114 td/osd-backfill-space/datafile 2020-09-08T16:36:06.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:06.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj115 td/osd-backfill-space/datafile 2020-09-08T16:36:06.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:06.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj116 td/osd-backfill-space/datafile 2020-09-08T16:36:06.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:06.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj117 td/osd-backfill-space/datafile 2020-09-08T16:36:06.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:06.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj118 td/osd-backfill-space/datafile 2020-09-08T16:36:06.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:06.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj119 td/osd-backfill-space/datafile 2020-09-08T16:36:07.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:07.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj120 td/osd-backfill-space/datafile 2020-09-08T16:36:07.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:07.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj121 td/osd-backfill-space/datafile 2020-09-08T16:36:07.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:07.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj122 td/osd-backfill-space/datafile 2020-09-08T16:36:07.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:07.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj123 td/osd-backfill-space/datafile 2020-09-08T16:36:07.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:07.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj124 td/osd-backfill-space/datafile 2020-09-08T16:36:07.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:07.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj125 td/osd-backfill-space/datafile 2020-09-08T16:36:07.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:07.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj126 td/osd-backfill-space/datafile 2020-09-08T16:36:07.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:07.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj127 td/osd-backfill-space/datafile 2020-09-08T16:36:07.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:07.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj128 td/osd-backfill-space/datafile 2020-09-08T16:36:07.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:07.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj129 td/osd-backfill-space/datafile 2020-09-08T16:36:07.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:07.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj130 td/osd-backfill-space/datafile 2020-09-08T16:36:07.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:07.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj131 td/osd-backfill-space/datafile 2020-09-08T16:36:08.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:08.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj132 td/osd-backfill-space/datafile 2020-09-08T16:36:08.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:08.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj133 td/osd-backfill-space/datafile 2020-09-08T16:36:08.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:08.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj134 td/osd-backfill-space/datafile 2020-09-08T16:36:08.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:08.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj135 td/osd-backfill-space/datafile 2020-09-08T16:36:08.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:08.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj136 td/osd-backfill-space/datafile 2020-09-08T16:36:08.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:08.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj137 td/osd-backfill-space/datafile 2020-09-08T16:36:08.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:08.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj138 td/osd-backfill-space/datafile 2020-09-08T16:36:08.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:08.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj139 td/osd-backfill-space/datafile 2020-09-08T16:36:08.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:08.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj140 td/osd-backfill-space/datafile 2020-09-08T16:36:08.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:08.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj141 td/osd-backfill-space/datafile 2020-09-08T16:36:09.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:09.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj142 td/osd-backfill-space/datafile 2020-09-08T16:36:09.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:09.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj143 td/osd-backfill-space/datafile 2020-09-08T16:36:09.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:09.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj144 td/osd-backfill-space/datafile 2020-09-08T16:36:09.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:09.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj145 td/osd-backfill-space/datafile 2020-09-08T16:36:09.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:09.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj146 td/osd-backfill-space/datafile 2020-09-08T16:36:09.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:09.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj147 td/osd-backfill-space/datafile 2020-09-08T16:36:09.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:09.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj148 td/osd-backfill-space/datafile 2020-09-08T16:36:09.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:09.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj149 td/osd-backfill-space/datafile 2020-09-08T16:36:09.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:09.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj150 td/osd-backfill-space/datafile 2020-09-08T16:36:09.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:09.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj151 td/osd-backfill-space/datafile 2020-09-08T16:36:09.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:09.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj152 td/osd-backfill-space/datafile 2020-09-08T16:36:09.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:09.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj153 td/osd-backfill-space/datafile 2020-09-08T16:36:10.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:10.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj154 td/osd-backfill-space/datafile 2020-09-08T16:36:10.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:10.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj155 td/osd-backfill-space/datafile 2020-09-08T16:36:10.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:10.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj156 td/osd-backfill-space/datafile 2020-09-08T16:36:10.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:10.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj157 td/osd-backfill-space/datafile 2020-09-08T16:36:10.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:10.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj158 td/osd-backfill-space/datafile 2020-09-08T16:36:10.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:10.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj159 td/osd-backfill-space/datafile 2020-09-08T16:36:10.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:10.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj160 td/osd-backfill-space/datafile 2020-09-08T16:36:10.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:10.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj161 td/osd-backfill-space/datafile 2020-09-08T16:36:10.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:10.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj162 td/osd-backfill-space/datafile 2020-09-08T16:36:10.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:10.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj163 td/osd-backfill-space/datafile 2020-09-08T16:36:10.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:10.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj164 td/osd-backfill-space/datafile 2020-09-08T16:36:10.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:10.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj165 td/osd-backfill-space/datafile 2020-09-08T16:36:10.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:10.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj166 td/osd-backfill-space/datafile 2020-09-08T16:36:11.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:11.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj167 td/osd-backfill-space/datafile 2020-09-08T16:36:11.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:11.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj168 td/osd-backfill-space/datafile 2020-09-08T16:36:11.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:11.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj169 td/osd-backfill-space/datafile 2020-09-08T16:36:11.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:11.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj170 td/osd-backfill-space/datafile 2020-09-08T16:36:11.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:11.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj171 td/osd-backfill-space/datafile 2020-09-08T16:36:11.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:11.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj172 td/osd-backfill-space/datafile 2020-09-08T16:36:11.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:11.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj173 td/osd-backfill-space/datafile 2020-09-08T16:36:11.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:11.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj174 td/osd-backfill-space/datafile 2020-09-08T16:36:11.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:11.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj175 td/osd-backfill-space/datafile 2020-09-08T16:36:11.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:11.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj176 td/osd-backfill-space/datafile 2020-09-08T16:36:11.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:11.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj177 td/osd-backfill-space/datafile 2020-09-08T16:36:11.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:11.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj178 td/osd-backfill-space/datafile 2020-09-08T16:36:12.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:12.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj179 td/osd-backfill-space/datafile 2020-09-08T16:36:12.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:12.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj180 td/osd-backfill-space/datafile 2020-09-08T16:36:12.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:12.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj181 td/osd-backfill-space/datafile 2020-09-08T16:36:12.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:12.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj182 td/osd-backfill-space/datafile 2020-09-08T16:36:12.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:12.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj183 td/osd-backfill-space/datafile 2020-09-08T16:36:12.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:12.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj184 td/osd-backfill-space/datafile 2020-09-08T16:36:12.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:12.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj185 td/osd-backfill-space/datafile 2020-09-08T16:36:12.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:12.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj186 td/osd-backfill-space/datafile 2020-09-08T16:36:12.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:12.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj187 td/osd-backfill-space/datafile 2020-09-08T16:36:12.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:12.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj188 td/osd-backfill-space/datafile 2020-09-08T16:36:12.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:12.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj189 td/osd-backfill-space/datafile 2020-09-08T16:36:12.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:12.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj190 td/osd-backfill-space/datafile 2020-09-08T16:36:13.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:13.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj191 td/osd-backfill-space/datafile 2020-09-08T16:36:13.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:13.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj192 td/osd-backfill-space/datafile 2020-09-08T16:36:13.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:13.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj193 td/osd-backfill-space/datafile 2020-09-08T16:36:13.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:13.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj194 td/osd-backfill-space/datafile 2020-09-08T16:36:13.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:13.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj195 td/osd-backfill-space/datafile 2020-09-08T16:36:13.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:13.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj196 td/osd-backfill-space/datafile 2020-09-08T16:36:13.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:13.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj197 td/osd-backfill-space/datafile 2020-09-08T16:36:13.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:13.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj198 td/osd-backfill-space/datafile 2020-09-08T16:36:13.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:13.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj199 td/osd-backfill-space/datafile 2020-09-08T16:36:13.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:652: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:13.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:654: TEST_ec_backfill_simple: rados -p fillpool put obj200 td/osd-backfill-space/datafile 2020-09-08T16:36:13.863 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:657: TEST_ec_backfill_simple: get_primary fillpool obj1 2020-09-08T16:36:13.863 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=fillpool 2020-09-08T16:36:13.863 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:36:13.863 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map fillpool obj1 2020-09-08T16:36:13.864 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:36:14.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:657: TEST_ec_backfill_simple: local fillosd=1 2020-09-08T16:36:14.264 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:658: TEST_ec_backfill_simple: expr 1 + 1 2020-09-08T16:36:14.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:658: TEST_ec_backfill_simple: osd=2 2020-09-08T16:36:14.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:659: TEST_ec_backfill_simple: '[' 2 = 6 ']' 2020-09-08T16:36:14.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:663: TEST_ec_backfill_simple: sleep 5 2020-09-08T16:36:19.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:664: TEST_ec_backfill_simple: kill_daemon td/osd-backfill-space/osd.1.pid TERM 2020-09-08T16:36:19.267 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: cat td/osd-backfill-space/osd.1.pid 2020-09-08T16:36:19.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: local pid=467667 2020-09-08T16:36:19.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: local send_signal=TERM 2020-09-08T16:36:19.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2020-09-08T16:36:19.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:258: kill_daemon: local exit_code=1 2020-09-08T16:36:19.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2020-09-08T16:36:19.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 467667 2020-09-08T16:36:19.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2020-09-08T16:36:19.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2020-09-08T16:36:19.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.1 2020-09-08T16:36:19.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2020-09-08T16:36:19.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 467667 2020-09-08T16:36:19.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:265: kill_daemon: exit_code=0 2020-09-08T16:36:19.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:266: kill_daemon: break 2020-09-08T16:36:19.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:271: kill_daemon: return 0 2020-09-08T16:36:19.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:665: TEST_ec_backfill_simple: ceph osd out osd.1 2020-09-08T16:36:19.969 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already out. 2020-09-08T16:36:19.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:666: TEST_ec_backfill_simple: sleep 2 2020-09-08T16:36:21.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:667: TEST_ec_backfill_simple: ceph osd erasure-code-profile set ec-profile k=3 m=2 crush-failure-domain=osd technique=reed_sol_van plugin=jerasure 2020-09-08T16:36:22.566 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:669: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:22.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:669: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:22.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:671: TEST_ec_backfill_simple: ceph osd pool create test1 1 1 erasure ec-profile 2020-09-08T16:36:23.337 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test1' already exists 2020-09-08T16:36:23.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:676: TEST_ec_backfill_simple: sleep 5 2020-09-08T16:36:28.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:678: TEST_ec_backfill_simple: ceph pg dump pgs 2020-09-08T16:36:28.739 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T16:36:28.740 INFO:tasks.workunit.client.0.smithi065.stdout:2.0 0 0 0 0 0 0 0 0 0 0 creating+activating 2020-09-08T16:36:23.770251+0000 0'0 44:2 [3,5,4,0,2] 3 [3,5,4,0,2] 3 0'0 2020-09-08T16:36:23.107713+0000 0'0 2020-09-08T16:36:23.107713+0000 0 2020-09-08T16:36:28.740 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 200 0 0 0 0 2662400 0 0 100 100 stale+active+clean 2020-09-08T16:35:57.062236+0000 38'200 38:218 [1] 1 [1] 1 0'0 2020-09-08T16:35:54.861257+0000 0'0 2020-09-08T16:35:54.861257+0000 0 2020-09-08T16:36:28.740 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T16:36:28.740 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T16:36:28.741 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:36:28.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:680: TEST_ec_backfill_simple: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=18 2020-09-08T16:36:28.750 INFO:tasks.workunit.client.0.smithi065.stderr:18+0 records in 2020-09-08T16:36:28.751 INFO:tasks.workunit.client.0.smithi065.stderr:18+0 records out 2020-09-08T16:36:28.751 INFO:tasks.workunit.client.0.smithi065.stderr:18432 bytes (18 kB, 18 KiB) copied, 0.000202349 s, 91.1 MB/s 2020-09-08T16:36:28.752 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: seq 1 200 2020-09-08T16:36:28.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:28.753 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:28.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:28.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj1 td/osd-backfill-space/datafile 2020-09-08T16:36:28.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:28.927 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:28.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:28.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj2 td/osd-backfill-space/datafile 2020-09-08T16:36:29.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:29.212 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:29.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:29.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj3 td/osd-backfill-space/datafile 2020-09-08T16:36:29.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:29.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:29.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:29.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj4 td/osd-backfill-space/datafile 2020-09-08T16:36:29.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:29.779 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:29.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:29.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj5 td/osd-backfill-space/datafile 2020-09-08T16:36:30.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:30.039 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:30.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:30.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj6 td/osd-backfill-space/datafile 2020-09-08T16:36:30.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:30.400 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:30.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:30.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj7 td/osd-backfill-space/datafile 2020-09-08T16:36:30.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:30.637 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:30.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:30.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj8 td/osd-backfill-space/datafile 2020-09-08T16:36:30.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:30.864 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:30.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:30.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj9 td/osd-backfill-space/datafile 2020-09-08T16:36:31.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:31.150 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:31.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:31.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj10 td/osd-backfill-space/datafile 2020-09-08T16:36:31.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:31.418 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:31.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:31.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj11 td/osd-backfill-space/datafile 2020-09-08T16:36:31.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:31.670 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:31.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:31.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj12 td/osd-backfill-space/datafile 2020-09-08T16:36:31.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:31.939 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:31.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:31.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj13 td/osd-backfill-space/datafile 2020-09-08T16:36:32.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:32.173 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:32.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:32.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj14 td/osd-backfill-space/datafile 2020-09-08T16:36:32.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:32.422 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:32.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:32.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj15 td/osd-backfill-space/datafile 2020-09-08T16:36:32.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:32.694 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:32.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:32.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj16 td/osd-backfill-space/datafile 2020-09-08T16:36:32.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:32.955 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:32.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:32.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj17 td/osd-backfill-space/datafile 2020-09-08T16:36:33.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:33.239 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:33.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:33.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj18 td/osd-backfill-space/datafile 2020-09-08T16:36:33.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:33.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:33.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:33.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj19 td/osd-backfill-space/datafile 2020-09-08T16:36:33.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:33.806 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:33.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:33.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj20 td/osd-backfill-space/datafile 2020-09-08T16:36:34.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:34.079 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:34.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:34.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj21 td/osd-backfill-space/datafile 2020-09-08T16:36:34.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:34.330 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:34.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:34.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj22 td/osd-backfill-space/datafile 2020-09-08T16:36:34.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:34.581 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:34.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:34.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj23 td/osd-backfill-space/datafile 2020-09-08T16:36:34.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:34.858 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:34.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:34.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj24 td/osd-backfill-space/datafile 2020-09-08T16:36:35.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:35.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:35.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:35.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj25 td/osd-backfill-space/datafile 2020-09-08T16:36:35.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:35.362 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:35.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:35.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj26 td/osd-backfill-space/datafile 2020-09-08T16:36:35.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:35.622 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:35.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:35.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj27 td/osd-backfill-space/datafile 2020-09-08T16:36:35.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:35.849 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:35.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:35.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj28 td/osd-backfill-space/datafile 2020-09-08T16:36:36.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:36.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:36.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:36.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj29 td/osd-backfill-space/datafile 2020-09-08T16:36:36.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:36.378 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:36.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:36.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj30 td/osd-backfill-space/datafile 2020-09-08T16:36:36.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:36.638 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:36.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:36.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj31 td/osd-backfill-space/datafile 2020-09-08T16:36:36.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:36.890 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:36.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:36.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj32 td/osd-backfill-space/datafile 2020-09-08T16:36:37.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:37.150 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:37.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:37.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj33 td/osd-backfill-space/datafile 2020-09-08T16:36:37.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:37.385 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:37.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:37.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj34 td/osd-backfill-space/datafile 2020-09-08T16:36:37.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:37.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:37.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:37.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj35 td/osd-backfill-space/datafile 2020-09-08T16:36:37.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:37.897 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:37.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:37.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj36 td/osd-backfill-space/datafile 2020-09-08T16:36:38.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:38.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:38.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:38.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj37 td/osd-backfill-space/datafile 2020-09-08T16:36:38.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:38.434 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:38.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:38.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj38 td/osd-backfill-space/datafile 2020-09-08T16:36:38.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:38.686 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:38.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:38.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj39 td/osd-backfill-space/datafile 2020-09-08T16:36:38.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:38.951 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:38.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:38.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj40 td/osd-backfill-space/datafile 2020-09-08T16:36:39.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:39.398 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:39.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:39.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj41 td/osd-backfill-space/datafile 2020-09-08T16:36:39.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:39.624 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:39.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:39.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj42 td/osd-backfill-space/datafile 2020-09-08T16:36:39.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:39.868 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:39.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:39.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj43 td/osd-backfill-space/datafile 2020-09-08T16:36:40.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:40.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:40.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:40.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj44 td/osd-backfill-space/datafile 2020-09-08T16:36:40.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:40.413 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:40.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:40.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj45 td/osd-backfill-space/datafile 2020-09-08T16:36:40.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:40.666 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:40.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:40.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj46 td/osd-backfill-space/datafile 2020-09-08T16:36:40.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:40.922 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:40.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:40.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj47 td/osd-backfill-space/datafile 2020-09-08T16:36:41.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:41.170 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:41.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:41.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj48 td/osd-backfill-space/datafile 2020-09-08T16:36:41.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:41.388 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:41.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:41.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj49 td/osd-backfill-space/datafile 2020-09-08T16:36:41.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:41.597 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:41.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:41.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj50 td/osd-backfill-space/datafile 2020-09-08T16:36:41.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:41.849 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:41.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:41.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj51 td/osd-backfill-space/datafile 2020-09-08T16:36:42.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:42.111 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:42.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:42.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj52 td/osd-backfill-space/datafile 2020-09-08T16:36:42.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:42.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:42.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:42.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj53 td/osd-backfill-space/datafile 2020-09-08T16:36:42.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:42.621 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:42.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:42.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj54 td/osd-backfill-space/datafile 2020-09-08T16:36:42.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:42.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:42.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:42.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj55 td/osd-backfill-space/datafile 2020-09-08T16:36:43.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:43.074 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:43.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:43.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj56 td/osd-backfill-space/datafile 2020-09-08T16:36:43.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:43.309 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:43.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:43.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj57 td/osd-backfill-space/datafile 2020-09-08T16:36:43.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:43.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:43.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:43.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj58 td/osd-backfill-space/datafile 2020-09-08T16:36:43.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:43.788 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:43.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:43.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj59 td/osd-backfill-space/datafile 2020-09-08T16:36:44.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:44.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:44.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:44.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj60 td/osd-backfill-space/datafile 2020-09-08T16:36:44.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:44.383 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:44.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:44.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj61 td/osd-backfill-space/datafile 2020-09-08T16:36:44.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:44.619 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:44.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:44.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj62 td/osd-backfill-space/datafile 2020-09-08T16:36:44.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:44.887 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:44.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:44.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj63 td/osd-backfill-space/datafile 2020-09-08T16:36:45.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:45.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:45.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:45.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj64 td/osd-backfill-space/datafile 2020-09-08T16:36:45.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:45.340 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:45.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:45.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj65 td/osd-backfill-space/datafile 2020-09-08T16:36:45.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:45.578 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:45.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:45.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj66 td/osd-backfill-space/datafile 2020-09-08T16:36:45.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:45.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:45.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:45.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj67 td/osd-backfill-space/datafile 2020-09-08T16:36:46.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:46.111 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:46.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:46.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj68 td/osd-backfill-space/datafile 2020-09-08T16:36:46.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:46.372 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:46.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:46.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj69 td/osd-backfill-space/datafile 2020-09-08T16:36:46.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:46.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:46.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:46.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj70 td/osd-backfill-space/datafile 2020-09-08T16:36:46.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:46.883 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:46.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:46.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj71 td/osd-backfill-space/datafile 2020-09-08T16:36:47.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:47.119 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:47.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:47.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj72 td/osd-backfill-space/datafile 2020-09-08T16:36:47.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:47.378 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:47.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:47.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj73 td/osd-backfill-space/datafile 2020-09-08T16:36:47.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:47.622 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:47.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:47.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj74 td/osd-backfill-space/datafile 2020-09-08T16:36:47.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:47.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:47.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:47.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj75 td/osd-backfill-space/datafile 2020-09-08T16:36:48.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:48.184 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:48.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:48.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj76 td/osd-backfill-space/datafile 2020-09-08T16:36:48.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:48.436 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:48.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:48.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj77 td/osd-backfill-space/datafile 2020-09-08T16:36:48.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:48.707 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:48.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:48.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj78 td/osd-backfill-space/datafile 2020-09-08T16:36:48.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:48.924 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:48.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:48.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj79 td/osd-backfill-space/datafile 2020-09-08T16:36:49.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:49.176 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:49.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:49.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj80 td/osd-backfill-space/datafile 2020-09-08T16:36:49.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:49.457 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:49.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:49.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj81 td/osd-backfill-space/datafile 2020-09-08T16:36:49.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:49.754 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:49.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:49.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj82 td/osd-backfill-space/datafile 2020-09-08T16:36:50.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:50.031 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:50.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:50.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj83 td/osd-backfill-space/datafile 2020-09-08T16:36:50.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:50.316 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:50.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:50.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj84 td/osd-backfill-space/datafile 2020-09-08T16:36:50.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:50.576 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:50.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:50.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj85 td/osd-backfill-space/datafile 2020-09-08T16:36:50.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:50.803 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:50.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:50.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj86 td/osd-backfill-space/datafile 2020-09-08T16:36:51.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:51.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:51.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:51.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj87 td/osd-backfill-space/datafile 2020-09-08T16:36:51.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:51.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:51.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:51.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj88 td/osd-backfill-space/datafile 2020-09-08T16:36:51.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:51.642 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:51.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:51.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj89 td/osd-backfill-space/datafile 2020-09-08T16:36:51.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:51.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:51.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:51.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj90 td/osd-backfill-space/datafile 2020-09-08T16:36:52.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:52.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:52.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:52.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj91 td/osd-backfill-space/datafile 2020-09-08T16:36:52.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:52.488 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:52.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:52.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj92 td/osd-backfill-space/datafile 2020-09-08T16:36:52.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:52.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:52.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:52.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj93 td/osd-backfill-space/datafile 2020-09-08T16:36:52.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:52.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:52.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:52.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj94 td/osd-backfill-space/datafile 2020-09-08T16:36:53.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:53.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:53.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:53.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj95 td/osd-backfill-space/datafile 2020-09-08T16:36:53.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:53.478 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:53.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:53.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj96 td/osd-backfill-space/datafile 2020-09-08T16:36:53.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:53.755 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:53.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:53.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj97 td/osd-backfill-space/datafile 2020-09-08T16:36:54.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:54.032 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:54.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:54.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj98 td/osd-backfill-space/datafile 2020-09-08T16:36:54.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:54.316 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:54.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:54.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj99 td/osd-backfill-space/datafile 2020-09-08T16:36:54.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:54.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:54.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:54.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj100 td/osd-backfill-space/datafile 2020-09-08T16:36:54.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:54.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:54.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:54.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj101 td/osd-backfill-space/datafile 2020-09-08T16:36:55.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:55.029 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:55.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:55.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj102 td/osd-backfill-space/datafile 2020-09-08T16:36:55.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:55.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:55.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:55.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj103 td/osd-backfill-space/datafile 2020-09-08T16:36:55.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:55.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:55.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:55.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj104 td/osd-backfill-space/datafile 2020-09-08T16:36:55.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:55.819 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:55.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:55.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj105 td/osd-backfill-space/datafile 2020-09-08T16:36:56.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:56.127 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:56.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:56.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj106 td/osd-backfill-space/datafile 2020-09-08T16:36:56.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:56.362 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:56.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:56.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj107 td/osd-backfill-space/datafile 2020-09-08T16:36:56.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:56.630 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:56.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:56.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj108 td/osd-backfill-space/datafile 2020-09-08T16:36:56.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:56.873 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:56.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:56.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj109 td/osd-backfill-space/datafile 2020-09-08T16:36:57.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:57.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:57.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:57.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj110 td/osd-backfill-space/datafile 2020-09-08T16:36:57.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:57.402 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:57.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:57.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj111 td/osd-backfill-space/datafile 2020-09-08T16:36:57.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:57.695 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:57.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:57.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj112 td/osd-backfill-space/datafile 2020-09-08T16:36:57.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:57.963 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:57.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:57.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj113 td/osd-backfill-space/datafile 2020-09-08T16:36:58.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:58.199 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:58.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:58.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj114 td/osd-backfill-space/datafile 2020-09-08T16:36:58.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:58.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:58.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:58.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj115 td/osd-backfill-space/datafile 2020-09-08T16:36:58.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:58.685 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:58.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:58.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj116 td/osd-backfill-space/datafile 2020-09-08T16:36:58.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:58.970 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:58.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:58.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj117 td/osd-backfill-space/datafile 2020-09-08T16:36:59.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:59.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:59.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:59.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj118 td/osd-backfill-space/datafile 2020-09-08T16:36:59.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:59.540 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:59.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:59.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj119 td/osd-backfill-space/datafile 2020-09-08T16:36:59.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:36:59.826 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:36:59.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:36:59.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj120 td/osd-backfill-space/datafile 2020-09-08T16:37:00.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:00.111 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:00.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:00.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj121 td/osd-backfill-space/datafile 2020-09-08T16:37:00.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:00.387 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:00.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:00.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj122 td/osd-backfill-space/datafile 2020-09-08T16:37:00.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:00.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:00.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:00.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj123 td/osd-backfill-space/datafile 2020-09-08T16:37:00.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:00.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:00.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:00.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj124 td/osd-backfill-space/datafile 2020-09-08T16:37:01.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:01.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:01.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:01.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj125 td/osd-backfill-space/datafile 2020-09-08T16:37:01.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:01.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:01.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:01.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj126 td/osd-backfill-space/datafile 2020-09-08T16:37:01.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:01.662 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:01.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:01.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj127 td/osd-backfill-space/datafile 2020-09-08T16:37:01.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:01.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:01.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:01.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj128 td/osd-backfill-space/datafile 2020-09-08T16:37:02.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:02.216 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:02.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:02.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj129 td/osd-backfill-space/datafile 2020-09-08T16:37:02.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:02.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:02.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:02.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj130 td/osd-backfill-space/datafile 2020-09-08T16:37:02.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:02.694 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:02.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:02.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj131 td/osd-backfill-space/datafile 2020-09-08T16:37:02.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:02.979 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:02.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:02.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj132 td/osd-backfill-space/datafile 2020-09-08T16:37:03.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:03.239 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:03.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:03.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj133 td/osd-backfill-space/datafile 2020-09-08T16:37:03.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:03.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:03.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:03.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj134 td/osd-backfill-space/datafile 2020-09-08T16:37:03.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:03.764 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:03.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:03.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj135 td/osd-backfill-space/datafile 2020-09-08T16:37:04.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:04.052 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:04.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:04.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj136 td/osd-backfill-space/datafile 2020-09-08T16:37:04.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:04.329 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:04.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:04.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj137 td/osd-backfill-space/datafile 2020-09-08T16:37:04.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:04.597 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:04.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:04.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj138 td/osd-backfill-space/datafile 2020-09-08T16:37:04.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:04.891 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:04.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:04.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj139 td/osd-backfill-space/datafile 2020-09-08T16:37:05.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:05.184 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:05.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:05.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj140 td/osd-backfill-space/datafile 2020-09-08T16:37:05.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:05.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:05.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:05.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj141 td/osd-backfill-space/datafile 2020-09-08T16:37:05.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:05.745 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:05.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:05.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj142 td/osd-backfill-space/datafile 2020-09-08T16:37:06.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:06.039 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:06.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:06.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj143 td/osd-backfill-space/datafile 2020-09-08T16:37:06.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:06.283 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:06.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:06.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj144 td/osd-backfill-space/datafile 2020-09-08T16:37:06.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:06.559 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:06.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:06.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj145 td/osd-backfill-space/datafile 2020-09-08T16:37:06.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:06.810 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:06.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:06.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj146 td/osd-backfill-space/datafile 2020-09-08T16:37:07.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:07.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:07.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:07.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj147 td/osd-backfill-space/datafile 2020-09-08T16:37:07.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:07.363 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:07.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:07.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj148 td/osd-backfill-space/datafile 2020-09-08T16:37:07.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:07.648 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:07.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:07.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj149 td/osd-backfill-space/datafile 2020-09-08T16:37:07.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:07.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:07.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:07.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj150 td/osd-backfill-space/datafile 2020-09-08T16:37:08.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:08.177 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:08.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:08.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj151 td/osd-backfill-space/datafile 2020-09-08T16:37:08.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:08.428 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:08.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:08.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj152 td/osd-backfill-space/datafile 2020-09-08T16:37:08.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:08.705 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:08.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:08.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj153 td/osd-backfill-space/datafile 2020-09-08T16:37:08.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:08.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:08.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:08.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj154 td/osd-backfill-space/datafile 2020-09-08T16:37:09.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:09.269 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:09.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:09.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj155 td/osd-backfill-space/datafile 2020-09-08T16:37:09.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:09.519 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:09.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:09.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj156 td/osd-backfill-space/datafile 2020-09-08T16:37:09.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:09.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:09.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:09.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj157 td/osd-backfill-space/datafile 2020-09-08T16:37:10.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:10.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:10.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:10.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj158 td/osd-backfill-space/datafile 2020-09-08T16:37:10.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:10.420 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:10.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:10.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj159 td/osd-backfill-space/datafile 2020-09-08T16:37:10.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:10.696 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:10.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:10.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj160 td/osd-backfill-space/datafile 2020-09-08T16:37:10.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:10.998 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:10.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:10.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj161 td/osd-backfill-space/datafile 2020-09-08T16:37:11.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:11.275 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:11.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:11.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj162 td/osd-backfill-space/datafile 2020-09-08T16:37:11.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:11.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:11.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:11.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj163 td/osd-backfill-space/datafile 2020-09-08T16:37:11.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:11.820 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:11.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:11.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj164 td/osd-backfill-space/datafile 2020-09-08T16:37:12.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:12.089 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:12.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:12.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj165 td/osd-backfill-space/datafile 2020-09-08T16:37:12.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:12.365 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:12.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:12.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj166 td/osd-backfill-space/datafile 2020-09-08T16:37:12.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:12.608 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:12.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:12.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj167 td/osd-backfill-space/datafile 2020-09-08T16:37:12.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:12.894 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:12.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:12.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj168 td/osd-backfill-space/datafile 2020-09-08T16:37:13.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:13.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:13.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:13.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj169 td/osd-backfill-space/datafile 2020-09-08T16:37:13.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:13.422 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:13.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:13.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj170 td/osd-backfill-space/datafile 2020-09-08T16:37:13.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:13.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:13.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:13.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj171 td/osd-backfill-space/datafile 2020-09-08T16:37:13.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:13.942 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:13.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:13.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj172 td/osd-backfill-space/datafile 2020-09-08T16:37:14.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:14.202 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:14.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:14.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj173 td/osd-backfill-space/datafile 2020-09-08T16:37:14.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:14.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:14.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:14.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj174 td/osd-backfill-space/datafile 2020-09-08T16:37:14.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:14.748 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:14.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:14.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj175 td/osd-backfill-space/datafile 2020-09-08T16:37:15.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:15.066 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:15.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:15.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj176 td/osd-backfill-space/datafile 2020-09-08T16:37:15.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:15.334 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:15.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:15.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj177 td/osd-backfill-space/datafile 2020-09-08T16:37:15.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:15.595 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:15.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:15.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj178 td/osd-backfill-space/datafile 2020-09-08T16:37:15.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:15.821 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:15.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:15.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj179 td/osd-backfill-space/datafile 2020-09-08T16:37:16.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:16.073 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:16.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:16.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj180 td/osd-backfill-space/datafile 2020-09-08T16:37:16.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:16.324 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:16.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:16.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj181 td/osd-backfill-space/datafile 2020-09-08T16:37:16.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:16.593 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:16.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:16.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj182 td/osd-backfill-space/datafile 2020-09-08T16:37:16.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:16.845 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:16.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:16.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj183 td/osd-backfill-space/datafile 2020-09-08T16:37:17.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:17.121 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:17.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:17.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj184 td/osd-backfill-space/datafile 2020-09-08T16:37:17.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:17.390 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:17.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:17.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj185 td/osd-backfill-space/datafile 2020-09-08T16:37:17.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:17.616 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:17.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:17.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj186 td/osd-backfill-space/datafile 2020-09-08T16:37:17.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:17.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:17.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:17.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj187 td/osd-backfill-space/datafile 2020-09-08T16:37:18.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:18.178 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:18.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:18.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj188 td/osd-backfill-space/datafile 2020-09-08T16:37:18.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:18.471 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:18.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:18.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj189 td/osd-backfill-space/datafile 2020-09-08T16:37:18.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:18.739 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:18.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:18.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj190 td/osd-backfill-space/datafile 2020-09-08T16:37:19.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:19.041 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:19.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:19.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj191 td/osd-backfill-space/datafile 2020-09-08T16:37:19.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:19.297 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:19.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:19.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj192 td/osd-backfill-space/datafile 2020-09-08T16:37:19.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:19.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:19.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:19.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj193 td/osd-backfill-space/datafile 2020-09-08T16:37:19.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:19.826 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:19.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:19.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj194 td/osd-backfill-space/datafile 2020-09-08T16:37:20.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:20.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:20.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:20.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj195 td/osd-backfill-space/datafile 2020-09-08T16:37:20.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:20.438 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:20.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:20.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj196 td/osd-backfill-space/datafile 2020-09-08T16:37:20.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:20.702 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:20.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:20.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj197 td/osd-backfill-space/datafile 2020-09-08T16:37:20.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:20.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:20.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:20.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj198 td/osd-backfill-space/datafile 2020-09-08T16:37:21.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:21.226 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:21.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:21.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj199 td/osd-backfill-space/datafile 2020-09-08T16:37:21.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:681: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2020-09-08T16:37:21.461 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:37:21.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:683: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2020-09-08T16:37:21.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:685: TEST_ec_backfill_simple: rados -p test1 put obj200 td/osd-backfill-space/datafile 2020-09-08T16:37:21.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:689: TEST_ec_backfill_simple: kill_daemon td/osd-backfill-space/osd.2.pid TERM 2020-09-08T16:37:21.712 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: cat td/osd-backfill-space/osd.2.pid 2020-09-08T16:37:21.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: local pid=468661 2020-09-08T16:37:21.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: local send_signal=TERM 2020-09-08T16:37:21.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2020-09-08T16:37:21.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:258: kill_daemon: local exit_code=1 2020-09-08T16:37:21.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2020-09-08T16:37:21.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 468661 2020-09-08T16:37:21.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2020-09-08T16:37:21.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2020-09-08T16:37:21.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.1 2020-09-08T16:37:21.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2020-09-08T16:37:21.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 468661 2020-09-08T16:37:21.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:265: kill_daemon: exit_code=0 2020-09-08T16:37:21.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:266: kill_daemon: break 2020-09-08T16:37:21.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:271: kill_daemon: return 0 2020-09-08T16:37:21.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:690: TEST_ec_backfill_simple: ceph osd out osd.2 2020-09-08T16:37:22.478 INFO:tasks.workunit.client.0.smithi065.stderr:osd.2 is already out. 2020-09-08T16:37:22.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:692: TEST_ec_backfill_simple: activate_osd td/osd-backfill-space 1 2020-09-08T16:37:22.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/osd-backfill-space 2020-09-08T16:37:22.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T16:37:22.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=1 2020-09-08T16:37:22.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T16:37:22.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/osd-backfill-space/1 2020-09-08T16:37:22.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 ' 2020-09-08T16:37:22.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:37:22.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:37:22.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:37:22.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2020-09-08T16:37:22.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2020-09-08T16:37:22.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T16:37:22.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T16:37:22.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2020-09-08T16:37:22.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T16:37:22.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:37:22.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:37:22.493 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:37:22.493 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:37:22.493 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:37:22.494 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:37:22.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' 2020-09-08T16:37:22.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:37:22.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2020-09-08T16:37:22.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2020-09-08T16:37:22.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:37:22.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:37:22.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:37:22.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T16:37:22.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T16:37:22.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/osd-backfill-space/1 2020-09-08T16:37:22.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.1 2020-09-08T16:37:22.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 1 --fsid=60fa903b-8e8c-449c-894a-3b5c18b39374 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.154687/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:37:22.496 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/osd-backfill-space/1/whoami 2020-09-08T16:37:22.497 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T16:37:22.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 1 = 1 ']' 2020-09-08T16:37:22.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T16:37:22.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T16:37:22.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T16:37:22.514 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:37:22.520+0000 7fbbee224ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:37:22.516 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:37:22.521+0000 7fbbee224ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:37:22.517 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:37:22.522+0000 7fbbee224ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:37:22.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 1 2020-09-08T16:37:22.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:37:22.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T16:37:22.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:37:22.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:37:22.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:37:22.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:37:22.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:37:22.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:37:22.938 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:37:23.040 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:37:23.045+0000 7fbbee224ec0 -1 Falling back to public interface 2020-09-08T16:37:23.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:37:24.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:37:24.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:37:24.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:37:24.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:37:24.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:37:24.333 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:37:24.418 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:37:24.423+0000 7fbbee224ec0 -1 osd.1 38 log_to_monitors {default=true} 2020-09-08T16:37:24.747 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up out weight 0 up_from 48 up_thru 37 down_at 39 last_clean_interval [10,38) [v2:127.0.0.1:6810/480494,v1:127.0.0.1:6811/480494] [v2:127.0.0.1:6812/480494,v1:127.0.0.1:6813/480494] exists,up a333195f-0819-4d4e-9d0d-9164461dd54b 2020-09-08T16:37:24.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:37:24.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:37:24.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:37:24.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:693: TEST_ec_backfill_simple: ceph osd in osd.1 2020-09-08T16:37:25.312 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already in. 2020-09-08T16:37:25.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:694: TEST_ec_backfill_simple: sleep 30 2020-09-08T16:37:55.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:696: TEST_ec_backfill_simple: ceph pg dump pgs 2020-09-08T16:37:55.712 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T16:37:55.713 INFO:tasks.workunit.client.0.smithi065.stdout:2.0 200 0 200 200 0 3686400 0 0 100 100 active+undersized+degraded+remapped+backfill_toofull 2020-09-08T16:37:27.578944+0000 45'200 52:240 [3,5,1,0,4] 3 [3,5,4,0,NONE] 3 0'0 2020-09-08T16:36:23.107713+0000 0'0 2020-09-08T16:36:23.107713+0000 0 2020-09-08T16:37:55.733 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 200 0 0 0 0 2662400 0 0 100 100 active+clean 2020-09-08T16:37:26.226240+0000 38'200 51:228 [1] 1 [1] 1 0'0 2020-09-08T16:35:54.861257+0000 0'0 2020-09-08T16:35:54.861257+0000 0 2020-09-08T16:37:55.733 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T16:37:55.733 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T16:37:55.734 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:37:55.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:698: TEST_ec_backfill_simple: wait_for_not_backfilling 240 2020-09-08T16:37:55.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:82: wait_for_not_backfilling: local timeout=240 2020-09-08T16:37:55.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:83: wait_for_not_backfilling: wait_for_not_state backfilling 240 2020-09-08T16:37:55.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:53: wait_for_not_state: local state=backfilling 2020-09-08T16:37:55.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:54: wait_for_not_state: local num_in_state=-1 2020-09-08T16:37:55.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:55: wait_for_not_state: local cur_in_state 2020-09-08T16:37:55.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: delays=($(get_timeout_delays $2 5)) 2020-09-08T16:37:55.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: get_timeout_delays 240 5 2020-09-08T16:37:55.741 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:37:55.742 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:37:55.742 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:37:55.742 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:37:55.742 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:37:55.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: local -a delays 2020-09-08T16:37:55.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:57: wait_for_not_state: local -i loop=0 2020-09-08T16:37:55.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:59: wait_for_not_state: flush_pg_stats 2020-09-08T16:37:55.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:37:55.858 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:37:56.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:37:56.256 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:37:56.257 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:37:56.257 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:37:56.257 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T16:37:56.257 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T16:37:56.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:37:56.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:37:56.258 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:37:56.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836515 2020-09-08T16:37:56.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836515 2020-09-08T16:37:56.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836515' 2020-09-08T16:37:56.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:37:56.391 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:37:56.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=206158430217 2020-09-08T16:37:56.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 206158430217 2020-09-08T16:37:56.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836515 1-206158430217' 2020-09-08T16:37:56.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:37:56.525 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:37:56.615 INFO:tasks.workunit.client.0.smithi065.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-09-08T16:37:56.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq= 2020-09-08T16:37:56.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z '' 2020-09-08T16:37:56.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: continue 2020-09-08T16:37:56.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:37:56.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:37:56.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345951 2020-09-08T16:37:56.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345951 2020-09-08T16:37:56.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836515 1-206158430217 3-85899345951' 2020-09-08T16:37:56.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:37:56.751 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:37:56.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182429 2020-09-08T16:37:56.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182429 2020-09-08T16:37:56.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836515 1-206158430217 3-85899345951 4-107374182429' 2020-09-08T16:37:56.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:37:56.884 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T16:37:57.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018907 2020-09-08T16:37:57.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018907 2020-09-08T16:37:57.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836515 1-206158430217 3-85899345951 4-107374182429 5-128849018907' 2020-09-08T16:37:57.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:37:57.017 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836515 2020-09-08T16:37:57.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:37:57.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:37:57.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836515 2020-09-08T16:37:57.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:37:57.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836515 2020-09-08T16:37:57.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836515' 2020-09-08T16:37:57.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:37:57.020 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836515 2020-09-08T16:37:57.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836513 -lt 21474836515 2020-09-08T16:37:57.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:37:58.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:37:58.418 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:37:58.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836515 -lt 21474836515 2020-09-08T16:37:58.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:37:58.819 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-206158430217 2020-09-08T16:37:58.820 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:37:58.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:37:58.820 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-206158430217 2020-09-08T16:37:58.821 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:37:58.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=206158430217 2020-09-08T16:37:58.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 206158430217' 2020-09-08T16:37:58.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:37:58.822 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 206158430217 2020-09-08T16:37:59.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 206158430217 -lt 206158430217 2020-09-08T16:37:59.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:37:59.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345951 2020-09-08T16:37:59.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:37:59.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:37:59.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345951 2020-09-08T16:37:59.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:37:59.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345951 2020-09-08T16:37:59.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345951' 2020-09-08T16:37:59.225 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:37:59.225 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345951 2020-09-08T16:37:59.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345951 -lt 85899345951 2020-09-08T16:37:59.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:37:59.627 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182429 2020-09-08T16:37:59.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:37:59.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:37:59.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182429 2020-09-08T16:37:59.630 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:37:59.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182429 2020-09-08T16:37:59.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182429' 2020-09-08T16:37:59.630 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:37:59.631 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182429 2020-09-08T16:38:00.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182429 -lt 107374182429 2020-09-08T16:38:00.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:38:00.032 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018907 2020-09-08T16:38:00.032 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:38:00.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T16:38:00.033 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018907 2020-09-08T16:38:00.034 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:38:00.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018907 2020-09-08T16:38:00.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018907' 2020-09-08T16:38:00.035 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T16:38:00.035 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018907 2020-09-08T16:38:00.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018908 -lt 128849018907 2020-09-08T16:38:00.431 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: get_num_pgs 2020-09-08T16:38:00.431 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:38:00.432 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:38:00.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: test 2 == 0 2020-09-08T16:38:00.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:38:00.975 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state backfilling 2020-09-08T16:38:00.975 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling 2020-09-08T16:38:00.976 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:38:00.976 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2020-09-08T16:38:00.976 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:38:00.976 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2020-09-08T16:38:01.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=0 2020-09-08T16:38:01.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 0 = 0 2020-09-08T16:38:01.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: break 2020-09-08T16:38:01.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:77: wait_for_not_state: return 0 2020-09-08T16:38:01.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:699: TEST_ec_backfill_simple: wait_for_not_activating 60 2020-09-08T16:38:01.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:88: wait_for_not_activating: local timeout=60 2020-09-08T16:38:01.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:89: wait_for_not_activating: wait_for_not_state activating 60 2020-09-08T16:38:01.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:53: wait_for_not_state: local state=activating 2020-09-08T16:38:01.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:54: wait_for_not_state: local num_in_state=-1 2020-09-08T16:38:01.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:55: wait_for_not_state: local cur_in_state 2020-09-08T16:38:01.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: delays=($(get_timeout_delays $2 5)) 2020-09-08T16:38:01.363 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: get_timeout_delays 60 5 2020-09-08T16:38:01.363 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:38:01.363 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:38:01.363 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:38:01.364 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:38:01.364 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:38:01.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:56: wait_for_not_state: local -a delays 2020-09-08T16:38:01.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:57: wait_for_not_state: local -i loop=0 2020-09-08T16:38:01.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:59: wait_for_not_state: flush_pg_stats 2020-09-08T16:38:01.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:38:01.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:38:01.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:38:01.810 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:38:01.811 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:38:01.811 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:38:01.811 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T16:38:01.811 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T16:38:01.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:38:01.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:38:01.812 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:38:01.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836518 2020-09-08T16:38:01.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836518 2020-09-08T16:38:01.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836518' 2020-09-08T16:38:01.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:38:01.943 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:38:02.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=206158430220 2020-09-08T16:38:02.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 206158430220 2020-09-08T16:38:02.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836518 1-206158430220' 2020-09-08T16:38:02.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:38:02.079 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:38:02.167 INFO:tasks.workunit.client.0.smithi065.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-09-08T16:38:02.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq= 2020-09-08T16:38:02.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z '' 2020-09-08T16:38:02.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: continue 2020-09-08T16:38:02.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:38:02.170 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:38:02.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345954 2020-09-08T16:38:02.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345954 2020-09-08T16:38:02.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836518 1-206158430220 3-85899345954' 2020-09-08T16:38:02.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:38:02.303 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:38:02.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182432 2020-09-08T16:38:02.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182432 2020-09-08T16:38:02.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836518 1-206158430220 3-85899345954 4-107374182432' 2020-09-08T16:38:02.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:38:02.436 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T16:38:02.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018910 2020-09-08T16:38:02.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018910 2020-09-08T16:38:02.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836518 1-206158430220 3-85899345954 4-107374182432 5-128849018910' 2020-09-08T16:38:02.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:38:02.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836518 2020-09-08T16:38:02.569 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:38:02.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:38:02.569 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836518 2020-09-08T16:38:02.570 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:38:02.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836518 2020-09-08T16:38:02.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836518' 2020-09-08T16:38:02.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:38:02.571 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836518 2020-09-08T16:38:02.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836516 -lt 21474836518 2020-09-08T16:38:02.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:38:03.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:38:03.963 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:38:04.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836518 -lt 21474836518 2020-09-08T16:38:04.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:38:04.371 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-206158430220 2020-09-08T16:38:04.371 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:38:04.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:38:04.372 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-206158430220 2020-09-08T16:38:04.372 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:38:04.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=206158430220 2020-09-08T16:38:04.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 206158430220' 2020-09-08T16:38:04.373 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:38:04.373 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 206158430220 2020-09-08T16:38:04.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 206158430220 -lt 206158430220 2020-09-08T16:38:04.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:38:04.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345954 2020-09-08T16:38:04.784 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:38:04.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:38:04.784 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345954 2020-09-08T16:38:04.785 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:38:04.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345954 2020-09-08T16:38:04.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345954' 2020-09-08T16:38:04.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:38:04.786 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345954 2020-09-08T16:38:05.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345954 -lt 85899345954 2020-09-08T16:38:05.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:38:05.183 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182432 2020-09-08T16:38:05.183 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:38:05.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:38:05.184 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182432 2020-09-08T16:38:05.184 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:38:05.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182432 2020-09-08T16:38:05.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182432' 2020-09-08T16:38:05.186 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:38:05.186 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182432 2020-09-08T16:38:05.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182432 -lt 107374182432 2020-09-08T16:38:05.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:38:05.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018910 2020-09-08T16:38:05.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:38:05.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T16:38:05.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018910 2020-09-08T16:38:05.593 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:38:05.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018910 2020-09-08T16:38:05.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018910' 2020-09-08T16:38:05.594 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T16:38:05.594 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018910 2020-09-08T16:38:05.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018911 -lt 128849018910 2020-09-08T16:38:05.995 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: get_num_pgs 2020-09-08T16:38:05.995 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:38:05.996 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:38:06.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:60: wait_for_not_state: test 2 == 0 2020-09-08T16:38:06.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:64: wait_for_not_state: true 2020-09-08T16:38:06.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: get_num_in_state activating 2020-09-08T16:38:06.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:44: get_num_in_state: local state=activating 2020-09-08T16:38:06.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:45: get_num_in_state: local expression 2020-09-08T16:38:06.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("activating"))' 2020-09-08T16:38:06.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:47: get_num_in_state: ceph --format json pg dump pgs 2020-09-08T16:38:06.530 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:48: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("activating"))] | length' 2020-09-08T16:38:06.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:65: wait_for_not_state: cur_in_state=0 2020-09-08T16:38:06.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: test 0 = 0 2020-09-08T16:38:06.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:66: wait_for_not_state: break 2020-09-08T16:38:06.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:77: wait_for_not_state: return 0 2020-09-08T16:38:06.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:701: TEST_ec_backfill_simple: ceph pg dump pgs 2020-09-08T16:38:07.271 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T16:38:07.271 INFO:tasks.workunit.client.0.smithi065.stdout:2.0 200 0 200 200 0 3686400 0 0 100 100 active+undersized+degraded+remapped+backfill_toofull 2020-09-08T16:37:57.579949+0000 45'200 52:244 [3,5,1,0,4] 3 [3,5,4,0,NONE] 3 0'0 2020-09-08T16:36:23.107713+0000 0'0 2020-09-08T16:36:23.107713+0000 0 2020-09-08T16:38:07.271 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 200 0 0 0 0 2662400 0 0 100 100 active+clean 2020-09-08T16:37:26.226240+0000 38'200 51:228 [1] 1 [1] 1 0'0 2020-09-08T16:35:54.861257+0000 0'0 2020-09-08T16:35:54.861257+0000 0 2020-09-08T16:38:07.272 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T16:38:07.272 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T16:38:07.273 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:38:07.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:703: TEST_ec_backfill_simple: ERRORS=0 2020-09-08T16:38:07.282 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:704: TEST_ec_backfill_simple: ceph pg dump pgs 2020-09-08T16:38:07.282 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:704: TEST_ec_backfill_simple: grep -v '^1.0' 2020-09-08T16:38:07.283 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:704: TEST_ec_backfill_simple: grep +backfill_toofull 2020-09-08T16:38:07.283 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:704: TEST_ec_backfill_simple: wc -l 2020-09-08T16:38:07.659 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:38:07.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:704: TEST_ec_backfill_simple: '[' 1 '!=' 1 ']' 2020-09-08T16:38:07.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:709: TEST_ec_backfill_simple: '[' 0 '!=' 0 ']' 2020-09-08T16:38:07.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:714: TEST_ec_backfill_simple: delete_pool fillpool 2020-09-08T16:38:07.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=fillpool 2020-09-08T16:38:07.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete fillpool fillpool --yes-i-really-really-mean-it 2020-09-08T16:38:08.213 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'fillpool' does not exist 2020-09-08T16:38:08.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:715: TEST_ec_backfill_simple: seq 1 1 2020-09-08T16:38:08.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:715: TEST_ec_backfill_simple: for i in $(seq 1 $pools) 2020-09-08T16:38:08.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:717: TEST_ec_backfill_simple: delete_pool test1 2020-09-08T16:38:08.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test1 2020-09-08T16:38:08.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2020-09-08T16:38:08.753 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test1' does not exist 2020-09-08T16:38:08.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:719: TEST_ec_backfill_simple: kill_daemons td/osd-backfill-space 2020-09-08T16:38:08.763 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:38:08.763 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:38:08.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:38:08.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:38:08.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:38:08.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:38:08.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-space.sh:38: run: teardown td/osd-backfill-space 2020-09-08T16:38:08.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2020-09-08T16:38:08.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:38:08.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2020-09-08T16:38:08.874 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:38:08.874 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:38:08.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:38:08.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:38:08.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:38:08.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:38:08.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:38:08.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:38:08.881 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:38:08.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:38:08.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:38:08.883 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:38:08.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:38:08.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:38:08.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:38:08.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:38:08.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:38:08.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:38:08.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2020-09-08T16:38:08.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:38:08.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:38:08.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:38:08.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.154687 2020-09-08T16:38:08.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:38:08.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:38:08.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2151: main: code=0 2020-09-08T16:38:08.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2155: main: teardown td/osd-backfill-space 0 2020-09-08T16:38:08.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2020-09-08T16:38:08.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2020-09-08T16:38:08.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2020-09-08T16:38:08.909 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:38:08.909 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:38:08.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:38:08.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:38:08.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:38:08.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:38:08.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:38:08.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:38:08.912 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:38:08.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:38:08.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:38:08.912 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:38:08.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:38:08.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:38:08.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:38:08.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:38:08.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:38:08.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2020-09-08T16:38:08.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2020-09-08T16:38:08.916 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:38:08.916 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:38:08.916 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.154687 2020-09-08T16:38:08.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.154687 2020-09-08T16:38:08.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:38:08.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:38:08.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2156: main: return 0 2020-09-08T16:38:08.919 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-09-08T16:38:08.920 INFO:teuthology.orchestra.run.smithi065:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-09-08T16:38:08.998 INFO:tasks.workunit:Running workunit osd/osd-backfill-stats.sh... 2020-09-08T16:38:08.999 INFO:teuthology.orchestra.run.smithi065:workunit test osd/osd-backfill-stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dce4d291bd4243c9802c17d67b85a6da6bbc0f8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh 2020-09-08T16:38:09.060 INFO:tasks.workunit.client.0.smithi065.stderr:stty: 'standard input': Inappropriate ioctl for device 2020-09-08T16:38:09.070 INFO:tasks.workunit.client.0.smithi065.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2020-09-08T16:38:09.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T16:38:09.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T16:38:09.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: export PYTHONWARNINGS=ignore 2020-09-08T16:38:09.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: PYTHONWARNINGS=ignore 2020-09-08T16:38:09.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: export CEPH_CONF=/dev/null 2020-09-08T16:38:09.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: CEPH_CONF=/dev/null 2020-09-08T16:38:09.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2147: main: unset CEPH_ARGS 2020-09-08T16:38:09.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2149: main: local code 2020-09-08T16:38:09.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2150: main: run td/osd-backfill-stats 2020-09-08T16:38:09.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:21: run: local dir=td/osd-backfill-stats 2020-09-08T16:38:09.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:22: run: shift 2020-09-08T16:38:09.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:25: run: export CEPH_MON=127.0.0.1:7114 2020-09-08T16:38:09.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:25: run: CEPH_MON=127.0.0.1:7114 2020-09-08T16:38:09.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:26: run: export CEPH_ARGS 2020-09-08T16:38:09.074 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:27: run: uuidgen 2020-09-08T16:38:09.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:27: run: CEPH_ARGS+='--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none ' 2020-09-08T16:38:09.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7114 ' 2020-09-08T16:38:09.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:29: run: CEPH_ARGS+='--osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:38:09.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:30: run: export margin=10 2020-09-08T16:38:09.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:30: run: margin=10 2020-09-08T16:38:09.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:31: run: export objects=200 2020-09-08T16:38:09.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:31: run: objects=200 2020-09-08T16:38:09.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:32: run: export poolname=test 2020-09-08T16:38:09.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:32: run: poolname=test 2020-09-08T16:38:09.076 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:34: run: set 2020-09-08T16:38:09.076 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:34: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2020-09-08T16:38:09.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:34: run: local 'funcs=TEST_backfill_down_out 2020-09-08T16:38:09.079 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_backfill_ec_all_out 2020-09-08T16:38:09.079 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_backfill_ec_down_all_out 2020-09-08T16:38:09.079 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_backfill_ec_down_out 2020-09-08T16:38:09.080 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_backfill_ec_prim_out 2020-09-08T16:38:09.080 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_backfill_out 2020-09-08T16:38:09.080 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_backfill_out2 2020-09-08T16:38:09.080 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_backfill_remapped 2020-09-08T16:38:09.080 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_backfill_sizeup 2020-09-08T16:38:09.081 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_backfill_sizeup4_allout 2020-09-08T16:38:09.081 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_backfill_sizeup_out' 2020-09-08T16:38:09.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:35: run: for func in $funcs 2020-09-08T16:38:09.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2020-09-08T16:38:09.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2020-09-08T16:38:09.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2020-09-08T16:38:09.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T16:38:09.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:38:09.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T16:38:09.083 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:38:09.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:38:09.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:38:09.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:38:09.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:38:09.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:38:09.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:38:09.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:38:09.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:38:09.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:38:09.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:38:09.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:38:09.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:38:09.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:38:09.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:38:09.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:38:09.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:38:09.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:38:09.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T16:38:09.090 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:38:09.090 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:38:09.090 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:38:09.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T16:38:09.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:38:09.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:38:09.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2020-09-08T16:38:09.091 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T16:38:09.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:38:09.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:38:09.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.482138 2020-09-08T16:38:09.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T16:38:09.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2020-09-08T16:38:09.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2020-09-08T16:38:09.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T16:38:09.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2020-09-08T16:38:09.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:37: run: TEST_backfill_down_out td/osd-backfill-stats 2020-09-08T16:38:09.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:278: TEST_backfill_down_out: local dir=td/osd-backfill-stats 2020-09-08T16:38:09.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:280: TEST_backfill_down_out: run_mon td/osd-backfill-stats a 2020-09-08T16:38:09.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2020-09-08T16:38:09.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T16:38:09.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T16:38:09.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T16:38:09.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2020-09-08T16:38:09.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2020-09-08T16:38:09.377 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T16:38:09.378 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:38:09.378 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:38:09.379 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:38:09.379 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:38:09.379 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:38:09.379 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:38:09.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T16:38:09.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T16:38:09.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T16:38:09.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:38:09.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:38:09.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T16:38:09.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T16:38:09.556 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:38:09.556 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:38:09.556 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:38:09.556 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:38:09.556 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:38:09.557 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:38:09.557 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T16:38:09.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:38:09.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get fsid 2020-09-08T16:38:09.647 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T16:38:09.647 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:38:09.647 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:38:09.648 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T16:38:09.648 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T16:38:09.648 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:38:09.648 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:38:09.649 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:38:09.649 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:38:09.649 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:38:09.649 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:38:09.650 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T16:38:09.650 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:38:09.650 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get mon_host 2020-09-08T16:38:09.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:281: TEST_backfill_down_out: run_mgr td/osd-backfill-stats x 2020-09-08T16:38:09.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-stats 2020-09-08T16:38:09.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T16:38:09.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T16:38:09.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T16:38:09.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-stats/x 2020-09-08T16:38:09.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T16:38:10.632 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T16:38:10.632 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:38:10.632 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:38:10.633 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:38:10.633 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:38:10.633 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:38:10.633 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:38:10.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:38:10.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:38:10.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:282: TEST_backfill_down_out: run_osd td/osd-backfill-stats 0 2020-09-08T16:38:10.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:38:10.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:38:10.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T16:38:10.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:38:10.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/0 2020-09-08T16:38:10.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:38:10.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:38:10.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:38:10.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:38:10.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2020-09-08T16:38:10.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2020-09-08T16:38:10.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:38:10.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:38:10.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:38:10.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:38:10.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:38:10.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:38:10.663 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:38:10.664 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:38:10.664 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:38:10.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:38:10.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:38:10.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:38:10.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:38:10.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:38:10.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:38:10.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:38:10.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:38:10.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:38:10.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:38:10.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:38:10.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:38:10.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/0 2020-09-08T16:38:10.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:38:10.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=7b88fcb6-5d4c-4c1b-9b75-d40520b228d2 2020-09-08T16:38:10.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 7b88fcb6-5d4c-4c1b-9b75-d40520b228d2' 2020-09-08T16:38:10.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:38:10.669 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 7b88fcb6-5d4c-4c1b-9b75-d40520b228d2 2020-09-08T16:38:10.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBys1dfjOQxKRAAQ0CN5J1ZLmTfPPLYlb4hzA== 2020-09-08T16:38:10.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBys1dfjOQxKRAAQ0CN5J1ZLmTfPPLYlb4hzA=="}' 2020-09-08T16:38:10.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 7b88fcb6-5d4c-4c1b-9b75-d40520b228d2 -i td/osd-backfill-stats/0/new.json 2020-09-08T16:38:11.039 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:38:11.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/0/new.json 2020-09-08T16:38:11.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBys1dfjOQxKRAAQ0CN5J1ZLmTfPPLYlb4hzA== --osd-uuid 7b88fcb6-5d4c-4c1b-9b75-d40520b228d2 2020-09-08T16:38:11.075 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:11.080+0000 7f54835b3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:11.077 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:11.082+0000 7f54835b3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:11.079 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:11.084+0000 7f54835b3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:11.080 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:11.085+0000 7f54835b3ec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:38:11.080 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:11.085+0000 7f54835b3ec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:38:11.080 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:11.085+0000 7f54835b3ec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:38:11.121 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:11.124+0000 7f54835b3ec0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2020-09-08T16:38:15.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2020-09-08T16:38:15.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:38:15.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T16:38:15.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:38:15.339 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T16:38:15.876 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T16:38:15.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T16:38:15.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:38:15.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:38:15.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:38:15.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:38:15.900 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:15.904+0000 7fe4da7b9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:15.911 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:15.916+0000 7fe4da7b9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:15.912 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:15.917+0000 7fe4da7b9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:16.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T16:38:16.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:38:16.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T16:38:16.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:38:16.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:38:16.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:38:16.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:38:16.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:38:16.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:38:16.270 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:38:16.428 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:16.433+0000 7fe4da7b9ec0 -1 Falling back to public interface 2020-09-08T16:38:16.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:38:17.196 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:17.200+0000 7fe4da7b9ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T16:38:17.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:38:17.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:38:17.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:38:17.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:38:17.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:38:17.737 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:38:18.139 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/482996,v1:127.0.0.1:6803/482996] [v2:127.0.0.1:6804/482996,v1:127.0.0.1:6805/482996] exists,up 7b88fcb6-5d4c-4c1b-9b75-d40520b228d2 2020-09-08T16:38:18.139 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 0a82ca72-fcba-4d06-a1cf-5016ff2b8d6d 2020-09-08T16:38:18.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:38:18.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:38:18.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:38:18.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:283: TEST_backfill_down_out: run_osd td/osd-backfill-stats 1 2020-09-08T16:38:18.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:38:18.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:38:18.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T16:38:18.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:38:18.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/1 2020-09-08T16:38:18.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:38:18.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:38:18.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:38:18.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:38:18.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2020-09-08T16:38:18.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2020-09-08T16:38:18.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:38:18.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:38:18.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:38:18.144 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:38:18.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:38:18.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:38:18.145 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:38:18.145 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:38:18.146 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:38:18.146 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:38:18.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:38:18.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:38:18.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:38:18.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:38:18.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:38:18.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:38:18.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:38:18.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:38:18.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:38:18.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:38:18.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:38:18.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/1 2020-09-08T16:38:18.149 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:38:18.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=0a82ca72-fcba-4d06-a1cf-5016ff2b8d6d 2020-09-08T16:38:18.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 0a82ca72-fcba-4d06-a1cf-5016ff2b8d6d' 2020-09-08T16:38:18.149 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:38:18.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQB6s1dfcQCJCRAA6YZxbQqpW8Hr0C1PF4ilwQ== 2020-09-08T16:38:18.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQB6s1dfcQCJCRAA6YZxbQqpW8Hr0C1PF4ilwQ=="}' 2020-09-08T16:38:18.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 0a82ca72-fcba-4d06-a1cf-5016ff2b8d6d -i td/osd-backfill-stats/1/new.json 2020-09-08T16:38:18.669 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:38:18.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/1/new.json 2020-09-08T16:38:18.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQB6s1dfcQCJCRAA6YZxbQqpW8Hr0C1PF4ilwQ== --osd-uuid 0a82ca72-fcba-4d06-a1cf-5016ff2b8d6d 2020-09-08T16:38:18.711 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:18.709+0000 7f85fc644ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:18.711 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:18.711+0000 7f85fc644ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:18.711 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:18.712+0000 7f85fc644ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:18.711 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:18.713+0000 7f85fc644ec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:38:18.712 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:18.713+0000 7f85fc644ec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:38:18.712 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:18.713+0000 7f85fc644ec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:38:18.752 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:18.756+0000 7f85fc644ec0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2020-09-08T16:38:22.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2020-09-08T16:38:22.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:38:22.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T16:38:22.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:38:22.714 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T16:38:23.252 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T16:38:23.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T16:38:23.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:38:23.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:38:23.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:38:23.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:38:23.275 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:23.279+0000 7efdc6e67ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:23.299 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:23.303+0000 7efdc6e67ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:23.300 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:23.304+0000 7efdc6e67ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:23.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T16:38:23.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:38:23.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T16:38:23.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:38:23.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:38:23.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:38:23.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:38:23.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:38:23.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:38:23.648 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:38:23.819 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:23.824+0000 7efdc6e67ec0 -1 Falling back to public interface 2020-09-08T16:38:24.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:38:24.691 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:24.696+0000 7efdc6e67ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T16:38:25.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:38:25.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:38:25.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:38:25.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:38:25.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:38:25.058 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:38:25.475 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/483990,v1:127.0.0.1:6811/483990] [v2:127.0.0.1:6812/483990,v1:127.0.0.1:6813/483990] exists,up 0a82ca72-fcba-4d06-a1cf-5016ff2b8d6d 2020-09-08T16:38:25.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:38:25.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:38:25.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:38:25.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:284: TEST_backfill_down_out: run_osd td/osd-backfill-stats 2 2020-09-08T16:38:25.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:38:25.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:38:25.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T16:38:25.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:38:25.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/2 2020-09-08T16:38:25.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:38:25.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:38:25.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:38:25.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:38:25.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2020-09-08T16:38:25.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2020-09-08T16:38:25.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:38:25.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:38:25.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:38:25.479 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:38:25.479 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:38:25.480 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:38:25.480 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:38:25.480 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:38:25.480 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:38:25.480 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:38:25.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:38:25.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:38:25.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:38:25.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:38:25.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:38:25.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:38:25.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:38:25.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:38:25.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:38:25.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:38:25.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:38:25.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/2 2020-09-08T16:38:25.484 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:38:25.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=f5c4b3f0-083e-4518-96d2-776017ef0d02 2020-09-08T16:38:25.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 f5c4b3f0-083e-4518-96d2-776017ef0d02' 2020-09-08T16:38:25.484 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:38:25.484 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 f5c4b3f0-083e-4518-96d2-776017ef0d02 2020-09-08T16:38:25.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCBs1dfJm20HRAAtdUfzTANA6T/7QJPjSeUuA== 2020-09-08T16:38:25.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCBs1dfJm20HRAAtdUfzTANA6T/7QJPjSeUuA=="}' 2020-09-08T16:38:25.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new f5c4b3f0-083e-4518-96d2-776017ef0d02 -i td/osd-backfill-stats/2/new.json 2020-09-08T16:38:26.074 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:38:26.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/2/new.json 2020-09-08T16:38:26.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCBs1dfJm20HRAAtdUfzTANA6T/7QJPjSeUuA== --osd-uuid f5c4b3f0-083e-4518-96d2-776017ef0d02 2020-09-08T16:38:26.110 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:26.115+0000 7f07309cdec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:26.111 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:26.117+0000 7f07309cdec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:26.112 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:26.118+0000 7f07309cdec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:26.113 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:26.118+0000 7f07309cdec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:38:26.113 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:26.118+0000 7f07309cdec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:38:26.113 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:26.118+0000 7f07309cdec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:38:26.159 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:26.164+0000 7f07309cdec0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2020-09-08T16:38:30.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2020-09-08T16:38:30.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:38:30.344 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T16:38:30.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T16:38:30.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:38:30.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T16:38:30.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:38:30.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:38:30.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:38:30.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:38:30.874 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T16:38:30.896 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:30.900+0000 7fa05cc1bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:30.897 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:30.902+0000 7fa05cc1bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:30.899 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:30.904+0000 7fa05cc1bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:31.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T16:38:31.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:38:31.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T16:38:31.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:38:31.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:38:31.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:38:31.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:38:31.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:38:31.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:38:31.266 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:38:31.419 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:31.424+0000 7fa05cc1bec0 -1 Falling back to public interface 2020-09-08T16:38:31.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:38:32.182 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:32.187+0000 7fa05cc1bec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T16:38:32.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:38:32.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:38:32.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:38:32.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:38:32.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:38:32.677 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:38:33.087 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/484984,v1:127.0.0.1:6819/484984] [v2:127.0.0.1:6820/484984,v1:127.0.0.1:6821/484984] exists,up f5c4b3f0-083e-4518-96d2-776017ef0d02 2020-09-08T16:38:33.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:38:33.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:38:33.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:38:33.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:285: TEST_backfill_down_out: run_osd td/osd-backfill-stats 3 2020-09-08T16:38:33.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:38:33.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:38:33.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T16:38:33.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:38:33.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/3 2020-09-08T16:38:33.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:38:33.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:38:33.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:38:33.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:38:33.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2020-09-08T16:38:33.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2020-09-08T16:38:33.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:38:33.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:38:33.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:38:33.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:38:33.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:38:33.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:38:33.092 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:38:33.092 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:38:33.093 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:38:33.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:38:33.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:38:33.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:38:33.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:38:33.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:38:33.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:38:33.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:38:33.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:38:33.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:38:33.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:38:33.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:38:33.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:38:33.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/3 2020-09-08T16:38:33.096 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:38:33.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=f697a70e-3795-4cc2-be5f-d9c7039ef07e 2020-09-08T16:38:33.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 f697a70e-3795-4cc2-be5f-d9c7039ef07e' 2020-09-08T16:38:33.097 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:38:33.097 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 f697a70e-3795-4cc2-be5f-d9c7039ef07e 2020-09-08T16:38:33.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCJs1dffV2cBhAAeNgvY2Eia/4eCQ4ecZLyHA== 2020-09-08T16:38:33.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCJs1dffV2cBhAAeNgvY2Eia/4eCQ4ecZLyHA=="}' 2020-09-08T16:38:33.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new f697a70e-3795-4cc2-be5f-d9c7039ef07e -i td/osd-backfill-stats/3/new.json 2020-09-08T16:38:33.620 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T16:38:33.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/3/new.json 2020-09-08T16:38:33.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCJs1dffV2cBhAAeNgvY2Eia/4eCQ4ecZLyHA== --osd-uuid f697a70e-3795-4cc2-be5f-d9c7039ef07e 2020-09-08T16:38:33.657 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:33.662+0000 7f0411b37ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:33.658 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:33.664+0000 7f0411b37ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:33.660 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:33.665+0000 7f0411b37ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:33.661 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:33.666+0000 7f0411b37ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:38:33.661 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:33.666+0000 7f0411b37ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:38:33.661 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:33.666+0000 7f0411b37ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:38:33.728 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:33.729+0000 7f0411b37ec0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2020-09-08T16:38:37.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2020-09-08T16:38:37.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:38:37.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T16:38:37.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:38:37.910 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T16:38:38.441 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T16:38:38.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T16:38:38.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:38:38.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:38:38.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:38:38.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:38:38.464 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:38.469+0000 7f2f86be2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:38.491 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:38.494+0000 7f2f86be2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:38.491 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:38.495+0000 7f2f86be2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:38.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T16:38:38.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:38:38.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T16:38:38.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:38:38.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:38:38.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:38:38.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:38:38.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:38:38.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:38:38.862 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:38:39.006 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:39.011+0000 7f2f86be2ec0 -1 Falling back to public interface 2020-09-08T16:38:39.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:38:39.806 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:39.811+0000 7f2f86be2ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T16:38:40.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:38:40.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:38:40.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:38:40.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:38:40.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:38:40.262 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:38:40.673 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/485978,v1:127.0.0.1:6827/485978] [v2:127.0.0.1:6828/485978,v1:127.0.0.1:6829/485978] exists,up f697a70e-3795-4cc2-be5f-d9c7039ef07e 2020-09-08T16:38:40.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:38:40.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:38:40.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:38:40.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:286: TEST_backfill_down_out: run_osd td/osd-backfill-stats 4 2020-09-08T16:38:40.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:38:40.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:38:40.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=4 2020-09-08T16:38:40.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:38:40.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/4 2020-09-08T16:38:40.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:38:40.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:38:40.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:38:40.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:38:40.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2020-09-08T16:38:40.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2020-09-08T16:38:40.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:38:40.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:38:40.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:38:40.685 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:38:40.685 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:38:40.685 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:38:40.686 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:38:40.686 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:38:40.686 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:38:40.686 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:38:40.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:38:40.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:38:40.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:38:40.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:38:40.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:38:40.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:38:40.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:38:40.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:38:40.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:38:40.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:38:40.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:38:40.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/4 2020-09-08T16:38:40.689 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:38:40.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=e06ef56f-bf2e-4124-a39c-927c8cc669fd 2020-09-08T16:38:40.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd4 e06ef56f-bf2e-4124-a39c-927c8cc669fd' 2020-09-08T16:38:40.690 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:38:40.690 INFO:tasks.workunit.client.0.smithi065.stdout:add osd4 e06ef56f-bf2e-4124-a39c-927c8cc669fd 2020-09-08T16:38:40.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCQs1dficiAKRAAa7F7wKD9OaNDdf76eJn4fA== 2020-09-08T16:38:40.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCQs1dficiAKRAAa7F7wKD9OaNDdf76eJn4fA=="}' 2020-09-08T16:38:40.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new e06ef56f-bf2e-4124-a39c-927c8cc669fd -i td/osd-backfill-stats/4/new.json 2020-09-08T16:38:41.230 INFO:tasks.workunit.client.0.smithi065.stdout:4 2020-09-08T16:38:41.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/4/new.json 2020-09-08T16:38:41.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 4 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCQs1dficiAKRAAa7F7wKD9OaNDdf76eJn4fA== --osd-uuid e06ef56f-bf2e-4124-a39c-927c8cc669fd 2020-09-08T16:38:41.267 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:41.272+0000 7f2c391f9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:41.268 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:41.273+0000 7f2c391f9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:41.269 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:41.274+0000 7f2c391f9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:41.270 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:41.275+0000 7f2c391f9ec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:38:41.270 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:41.275+0000 7f2c391f9ec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:38:41.270 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:41.275+0000 7f2c391f9ec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:38:41.351 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:41.356+0000 7f2c391f9ec0 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2020-09-08T16:38:45.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2020-09-08T16:38:45.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:38:45.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd4 key to auth repository 2020-09-08T16:38:45.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:38:45.679 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd4 key to auth repository 2020-09-08T16:38:46.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.4 2020-09-08T16:38:46.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 4 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:38:46.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:38:46.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:38:46.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:38:46.226 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.4 2020-09-08T16:38:46.247 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:46.252+0000 7fdcf3800ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:46.268 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:46.273+0000 7fdcf3800ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:46.270 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:46.274+0000 7fdcf3800ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:46.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 4 2020-09-08T16:38:46.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:38:46.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=4 2020-09-08T16:38:46.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:38:46.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:38:46.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:38:46.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:38:46.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:38:46.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:38:46.640 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:38:46.786 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:46.790+0000 7fdcf3800ec0 -1 Falling back to public interface 2020-09-08T16:38:47.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:38:47.583 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:47.588+0000 7fdcf3800ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-09-08T16:38:48.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:38:48.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:38:48.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:38:48.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:38:48.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:38:48.041 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:38:48.476 INFO:tasks.workunit.client.0.smithi065.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/486972,v1:127.0.0.1:6835/486972] [v2:127.0.0.1:6836/486972,v1:127.0.0.1:6837/486972] exists,up e06ef56f-bf2e-4124-a39c-927c8cc669fd 2020-09-08T16:38:48.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:38:48.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:38:48.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:38:48.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:287: TEST_backfill_down_out: run_osd td/osd-backfill-stats 5 2020-09-08T16:38:48.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:38:48.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:38:48.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=5 2020-09-08T16:38:48.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:38:48.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/5 2020-09-08T16:38:48.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:38:48.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:38:48.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:38:48.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:38:48.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/5' 2020-09-08T16:38:48.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/5/journal' 2020-09-08T16:38:48.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:38:48.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:38:48.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:38:48.483 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:38:48.483 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:38:48.483 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:38:48.483 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:38:48.484 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:38:48.484 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:38:48.484 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:38:48.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:38:48.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:38:48.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:38:48.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:38:48.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:38:48.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:38:48.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:38:48.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:38:48.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:38:48.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:38:48.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:38:48.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/5 2020-09-08T16:38:48.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:38:48.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=35530352-ba50-4495-ae59-43d5c12f6db6 2020-09-08T16:38:48.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd5 35530352-ba50-4495-ae59-43d5c12f6db6' 2020-09-08T16:38:48.494 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:38:48.494 INFO:tasks.workunit.client.0.smithi065.stdout:add osd5 35530352-ba50-4495-ae59-43d5c12f6db6 2020-09-08T16:38:48.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCYs1dfZ6LPHRAAKQ7cLVfGxl7vnUKfEPPbEw== 2020-09-08T16:38:48.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCYs1dfZ6LPHRAAKQ7cLVfGxl7vnUKfEPPbEw=="}' 2020-09-08T16:38:48.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 35530352-ba50-4495-ae59-43d5c12f6db6 -i td/osd-backfill-stats/5/new.json 2020-09-08T16:38:49.045 INFO:tasks.workunit.client.0.smithi065.stdout:5 2020-09-08T16:38:49.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/5/new.json 2020-09-08T16:38:49.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 5 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCYs1dfZ6LPHRAAKQ7cLVfGxl7vnUKfEPPbEw== --osd-uuid 35530352-ba50-4495-ae59-43d5c12f6db6 2020-09-08T16:38:49.080 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:49.085+0000 7f8d2d86bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:49.091 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:49.096+0000 7f8d2d86bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:49.092 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:49.098+0000 7f8d2d86bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:49.093 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:49.098+0000 7f8d2d86bec0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2020-09-08T16:38:49.093 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:49.098+0000 7f8d2d86bec0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2020-09-08T16:38:49.094 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:49.098+0000 7f8d2d86bec0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2020-09-08T16:38:49.158 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:49.163+0000 7f8d2d86bec0 -1 bluestore(td/osd-backfill-stats/5) _read_fsid unparsable uuid 2020-09-08T16:38:53.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/5/keyring 2020-09-08T16:38:53.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:38:53.442 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd5 key to auth repository 2020-09-08T16:38:53.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd5 key to auth repository 2020-09-08T16:38:53.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:38:53.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.5 2020-09-08T16:38:53.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 5 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:38:53.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:38:53.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:38:53.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:38:53.983 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.5 2020-09-08T16:38:54.005 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:54.010+0000 7f7f5076cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:54.015 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:54.020+0000 7f7f5076cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:54.017 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:54.022+0000 7f7f5076cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:38:54.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 5 2020-09-08T16:38:54.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:38:54.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=5 2020-09-08T16:38:54.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:38:54.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:38:54.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:38:54.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:38:54.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:38:54.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T16:38:54.377 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:38:54.537 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:54.542+0000 7f7f5076cec0 -1 Falling back to public interface 2020-09-08T16:38:54.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:38:55.317 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:38:55.321+0000 7f7f5076cec0 -1 osd.5 0 log_to_monitors {default=true} 2020-09-08T16:38:55.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:38:55.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:38:55.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:38:55.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:38:55.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T16:38:55.777 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:38:56.184 INFO:tasks.workunit.client.0.smithi065.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/487974,v1:127.0.0.1:6843/487974] [v2:127.0.0.1:6844/487974,v1:127.0.0.1:6845/487974] exists,up 35530352-ba50-4495-ae59-43d5c12f6db6 2020-09-08T16:38:56.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:38:56.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:38:56.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:38:56.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:289: TEST_backfill_down_out: create_pool test 1 1 2020-09-08T16:38:56.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test 1 1 2020-09-08T16:38:56.853 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' already exists 2020-09-08T16:38:56.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:38:57.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:290: TEST_backfill_down_out: ceph osd pool set test size 2 2020-09-08T16:38:58.530 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 2 2020-09-08T16:38:58.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:291: TEST_backfill_down_out: sleep 5 2020-09-08T16:39:03.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:293: TEST_backfill_down_out: wait_for_clean 2020-09-08T16:39:03.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:39:03.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:39:03.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:39:03.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:39:03.542 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:39:03.543 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:39:03.543 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:39:03.543 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:39:03.543 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:39:03.543 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:39:03.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:39:03.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:39:03.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:39:03.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:39:03.650 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:39:04.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:39:04.051 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:39:04.051 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:39:04.052 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:39:04.052 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T16:39:04.052 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T16:39:04.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:39:04.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:39:04.053 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:39:04.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836492 2020-09-08T16:39:04.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836492 2020-09-08T16:39:04.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836492' 2020-09-08T16:39:04.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:39:04.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:39:04.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672970 2020-09-08T16:39:04.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672970 2020-09-08T16:39:04.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836492 1-42949672970' 2020-09-08T16:39:04.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:39:04.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:39:04.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509449 2020-09-08T16:39:04.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509449 2020-09-08T16:39:04.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836492 1-42949672970 2-64424509449' 2020-09-08T16:39:04.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:39:04.454 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:39:04.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345928 2020-09-08T16:39:04.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345928 2020-09-08T16:39:04.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836492 1-42949672970 2-64424509449 3-85899345928' 2020-09-08T16:39:04.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:39:04.585 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:39:04.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182406 2020-09-08T16:39:04.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182406 2020-09-08T16:39:04.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836492 1-42949672970 2-64424509449 3-85899345928 4-107374182406' 2020-09-08T16:39:04.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:39:04.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T16:39:04.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018884 2020-09-08T16:39:04.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018884 2020-09-08T16:39:04.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836492 1-42949672970 2-64424509449 3-85899345928 4-107374182406 5-128849018884' 2020-09-08T16:39:04.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:39:04.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836492 2020-09-08T16:39:04.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:39:04.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:39:04.848 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836492 2020-09-08T16:39:04.849 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:39:04.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836492 2020-09-08T16:39:04.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2020-09-08T16:39:04.850 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836492 2020-09-08T16:39:04.851 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:39:05.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836492 -lt 21474836492 2020-09-08T16:39:05.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:39:05.242 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672970 2020-09-08T16:39:05.242 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:39:05.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:39:05.244 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672970 2020-09-08T16:39:05.244 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:39:05.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672970 2020-09-08T16:39:05.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672970' 2020-09-08T16:39:05.245 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:39:05.246 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672970 2020-09-08T16:39:05.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672970 -lt 42949672970 2020-09-08T16:39:05.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:39:05.646 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509449 2020-09-08T16:39:05.646 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:39:05.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:39:05.648 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509449 2020-09-08T16:39:05.648 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:39:05.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509449 2020-09-08T16:39:05.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509449' 2020-09-08T16:39:05.649 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509449 2020-09-08T16:39:05.650 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:39:06.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509447 -lt 64424509449 2020-09-08T16:39:06.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:39:07.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:39:07.053 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:39:07.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509449 -lt 64424509449 2020-09-08T16:39:07.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:39:07.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345928 2020-09-08T16:39:07.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:39:07.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:39:07.457 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345928 2020-09-08T16:39:07.457 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:39:07.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345928 2020-09-08T16:39:07.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345928' 2020-09-08T16:39:07.459 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345928 2020-09-08T16:39:07.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:39:07.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345929 -lt 85899345928 2020-09-08T16:39:07.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:39:07.870 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182406 2020-09-08T16:39:07.871 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:39:07.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:39:07.871 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182406 2020-09-08T16:39:07.871 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:39:07.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182406 2020-09-08T16:39:07.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182406' 2020-09-08T16:39:07.872 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:39:07.872 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182406 2020-09-08T16:39:08.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182406 -lt 107374182406 2020-09-08T16:39:08.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:39:08.275 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018884 2020-09-08T16:39:08.275 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:39:08.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T16:39:08.275 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018884 2020-09-08T16:39:08.275 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:39:08.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018884 2020-09-08T16:39:08.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018884' 2020-09-08T16:39:08.276 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018884 2020-09-08T16:39:08.277 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T16:39:08.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018885 -lt 128849018884 2020-09-08T16:39:08.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:39:08.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:39:08.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:39:09.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T16:39:09.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:39:09.213 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:39:09.213 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:39:09.213 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:39:09.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:39:09.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:39:09.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:39:09.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T16:39:09.608 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:39:09.608 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:39:09.608 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:39:10.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T16:39:10.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:39:10.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:39:10.120 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: seq 1 200 2020-09-08T16:39:10.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:10.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj1 /dev/null 2020-09-08T16:39:10.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:10.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj2 /dev/null 2020-09-08T16:39:10.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:10.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj3 /dev/null 2020-09-08T16:39:10.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:10.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj4 /dev/null 2020-09-08T16:39:10.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:10.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj5 /dev/null 2020-09-08T16:39:10.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:10.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj6 /dev/null 2020-09-08T16:39:10.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:10.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj7 /dev/null 2020-09-08T16:39:10.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:10.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj8 /dev/null 2020-09-08T16:39:10.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:10.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj9 /dev/null 2020-09-08T16:39:11.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:11.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj10 /dev/null 2020-09-08T16:39:11.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:11.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj11 /dev/null 2020-09-08T16:39:11.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:11.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj12 /dev/null 2020-09-08T16:39:11.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:11.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj13 /dev/null 2020-09-08T16:39:11.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:11.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj14 /dev/null 2020-09-08T16:39:11.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:11.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj15 /dev/null 2020-09-08T16:39:11.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:11.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj16 /dev/null 2020-09-08T16:39:11.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:11.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj17 /dev/null 2020-09-08T16:39:11.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:11.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj18 /dev/null 2020-09-08T16:39:12.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:12.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj19 /dev/null 2020-09-08T16:39:12.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:12.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj20 /dev/null 2020-09-08T16:39:12.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:12.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj21 /dev/null 2020-09-08T16:39:12.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:12.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj22 /dev/null 2020-09-08T16:39:12.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:12.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj23 /dev/null 2020-09-08T16:39:12.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:12.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj24 /dev/null 2020-09-08T16:39:12.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:12.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj25 /dev/null 2020-09-08T16:39:12.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:12.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj26 /dev/null 2020-09-08T16:39:12.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:12.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj27 /dev/null 2020-09-08T16:39:13.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:13.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj28 /dev/null 2020-09-08T16:39:13.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:13.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj29 /dev/null 2020-09-08T16:39:13.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:13.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj30 /dev/null 2020-09-08T16:39:13.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:13.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj31 /dev/null 2020-09-08T16:39:13.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:13.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj32 /dev/null 2020-09-08T16:39:13.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:13.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj33 /dev/null 2020-09-08T16:39:13.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:13.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj34 /dev/null 2020-09-08T16:39:13.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:13.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj35 /dev/null 2020-09-08T16:39:13.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:13.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj36 /dev/null 2020-09-08T16:39:14.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:14.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj37 /dev/null 2020-09-08T16:39:14.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:14.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj38 /dev/null 2020-09-08T16:39:14.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:14.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj39 /dev/null 2020-09-08T16:39:14.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:14.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj40 /dev/null 2020-09-08T16:39:14.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:14.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj41 /dev/null 2020-09-08T16:39:14.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:14.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj42 /dev/null 2020-09-08T16:39:14.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:14.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj43 /dev/null 2020-09-08T16:39:14.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:14.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj44 /dev/null 2020-09-08T16:39:14.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:14.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj45 /dev/null 2020-09-08T16:39:14.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:14.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj46 /dev/null 2020-09-08T16:39:15.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:15.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj47 /dev/null 2020-09-08T16:39:15.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:15.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj48 /dev/null 2020-09-08T16:39:15.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:15.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj49 /dev/null 2020-09-08T16:39:15.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:15.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj50 /dev/null 2020-09-08T16:39:15.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:15.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj51 /dev/null 2020-09-08T16:39:15.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:15.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj52 /dev/null 2020-09-08T16:39:15.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:15.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj53 /dev/null 2020-09-08T16:39:15.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:15.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj54 /dev/null 2020-09-08T16:39:15.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:15.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj55 /dev/null 2020-09-08T16:39:15.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:15.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj56 /dev/null 2020-09-08T16:39:16.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:16.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj57 /dev/null 2020-09-08T16:39:16.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:16.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj58 /dev/null 2020-09-08T16:39:16.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:16.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj59 /dev/null 2020-09-08T16:39:16.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:16.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj60 /dev/null 2020-09-08T16:39:16.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:16.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj61 /dev/null 2020-09-08T16:39:16.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:16.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj62 /dev/null 2020-09-08T16:39:16.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:16.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj63 /dev/null 2020-09-08T16:39:16.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:16.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj64 /dev/null 2020-09-08T16:39:16.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:16.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj65 /dev/null 2020-09-08T16:39:17.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:17.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj66 /dev/null 2020-09-08T16:39:17.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:17.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj67 /dev/null 2020-09-08T16:39:17.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:17.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj68 /dev/null 2020-09-08T16:39:17.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:17.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj69 /dev/null 2020-09-08T16:39:17.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:17.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj70 /dev/null 2020-09-08T16:39:17.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:17.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj71 /dev/null 2020-09-08T16:39:17.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:17.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj72 /dev/null 2020-09-08T16:39:17.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:17.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj73 /dev/null 2020-09-08T16:39:17.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:17.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj74 /dev/null 2020-09-08T16:39:18.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:18.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj75 /dev/null 2020-09-08T16:39:18.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:18.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj76 /dev/null 2020-09-08T16:39:18.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:18.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj77 /dev/null 2020-09-08T16:39:18.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:18.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj78 /dev/null 2020-09-08T16:39:18.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:18.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj79 /dev/null 2020-09-08T16:39:18.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:18.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj80 /dev/null 2020-09-08T16:39:18.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:18.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj81 /dev/null 2020-09-08T16:39:18.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:18.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj82 /dev/null 2020-09-08T16:39:18.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:18.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj83 /dev/null 2020-09-08T16:39:19.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:19.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj84 /dev/null 2020-09-08T16:39:19.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:19.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj85 /dev/null 2020-09-08T16:39:19.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:19.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj86 /dev/null 2020-09-08T16:39:19.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:19.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj87 /dev/null 2020-09-08T16:39:19.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:19.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj88 /dev/null 2020-09-08T16:39:19.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:19.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj89 /dev/null 2020-09-08T16:39:19.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:19.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj90 /dev/null 2020-09-08T16:39:19.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:19.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj91 /dev/null 2020-09-08T16:39:19.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:19.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj92 /dev/null 2020-09-08T16:39:19.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:19.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj93 /dev/null 2020-09-08T16:39:20.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:20.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj94 /dev/null 2020-09-08T16:39:20.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:20.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj95 /dev/null 2020-09-08T16:39:20.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:20.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj96 /dev/null 2020-09-08T16:39:20.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:20.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj97 /dev/null 2020-09-08T16:39:20.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:20.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj98 /dev/null 2020-09-08T16:39:20.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:20.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj99 /dev/null 2020-09-08T16:39:20.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:20.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj100 /dev/null 2020-09-08T16:39:20.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:20.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj101 /dev/null 2020-09-08T16:39:20.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:20.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj102 /dev/null 2020-09-08T16:39:21.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:21.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj103 /dev/null 2020-09-08T16:39:21.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:21.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj104 /dev/null 2020-09-08T16:39:21.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:21.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj105 /dev/null 2020-09-08T16:39:21.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:21.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj106 /dev/null 2020-09-08T16:39:21.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:21.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj107 /dev/null 2020-09-08T16:39:21.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:21.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj108 /dev/null 2020-09-08T16:39:21.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:21.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj109 /dev/null 2020-09-08T16:39:21.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:21.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj110 /dev/null 2020-09-08T16:39:21.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:21.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj111 /dev/null 2020-09-08T16:39:21.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:21.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj112 /dev/null 2020-09-08T16:39:22.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:22.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj113 /dev/null 2020-09-08T16:39:22.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:22.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj114 /dev/null 2020-09-08T16:39:22.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:22.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj115 /dev/null 2020-09-08T16:39:22.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:22.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj116 /dev/null 2020-09-08T16:39:22.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:22.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj117 /dev/null 2020-09-08T16:39:22.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:22.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj118 /dev/null 2020-09-08T16:39:22.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:22.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj119 /dev/null 2020-09-08T16:39:22.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:22.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj120 /dev/null 2020-09-08T16:39:22.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:22.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj121 /dev/null 2020-09-08T16:39:23.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:23.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj122 /dev/null 2020-09-08T16:39:23.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:23.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj123 /dev/null 2020-09-08T16:39:23.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:23.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj124 /dev/null 2020-09-08T16:39:23.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:23.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj125 /dev/null 2020-09-08T16:39:23.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:23.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj126 /dev/null 2020-09-08T16:39:23.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:23.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj127 /dev/null 2020-09-08T16:39:23.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:23.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj128 /dev/null 2020-09-08T16:39:23.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:23.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj129 /dev/null 2020-09-08T16:39:23.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:23.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj130 /dev/null 2020-09-08T16:39:23.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:23.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj131 /dev/null 2020-09-08T16:39:24.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:24.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj132 /dev/null 2020-09-08T16:39:24.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:24.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj133 /dev/null 2020-09-08T16:39:24.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:24.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj134 /dev/null 2020-09-08T16:39:24.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:24.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj135 /dev/null 2020-09-08T16:39:24.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:24.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj136 /dev/null 2020-09-08T16:39:24.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:24.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj137 /dev/null 2020-09-08T16:39:24.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:24.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj138 /dev/null 2020-09-08T16:39:24.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:24.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj139 /dev/null 2020-09-08T16:39:24.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:24.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj140 /dev/null 2020-09-08T16:39:25.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:25.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj141 /dev/null 2020-09-08T16:39:25.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:25.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj142 /dev/null 2020-09-08T16:39:25.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:25.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj143 /dev/null 2020-09-08T16:39:25.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:25.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj144 /dev/null 2020-09-08T16:39:25.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:25.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj145 /dev/null 2020-09-08T16:39:25.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:25.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj146 /dev/null 2020-09-08T16:39:25.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:25.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj147 /dev/null 2020-09-08T16:39:25.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:25.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj148 /dev/null 2020-09-08T16:39:25.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:25.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj149 /dev/null 2020-09-08T16:39:26.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:26.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj150 /dev/null 2020-09-08T16:39:26.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:26.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj151 /dev/null 2020-09-08T16:39:26.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:26.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj152 /dev/null 2020-09-08T16:39:26.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:26.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj153 /dev/null 2020-09-08T16:39:26.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:26.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj154 /dev/null 2020-09-08T16:39:26.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:26.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj155 /dev/null 2020-09-08T16:39:26.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:26.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj156 /dev/null 2020-09-08T16:39:26.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:26.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj157 /dev/null 2020-09-08T16:39:26.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:26.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj158 /dev/null 2020-09-08T16:39:26.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:26.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj159 /dev/null 2020-09-08T16:39:27.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:27.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj160 /dev/null 2020-09-08T16:39:27.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:27.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj161 /dev/null 2020-09-08T16:39:27.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:27.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj162 /dev/null 2020-09-08T16:39:27.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:27.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj163 /dev/null 2020-09-08T16:39:27.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:27.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj164 /dev/null 2020-09-08T16:39:27.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:27.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj165 /dev/null 2020-09-08T16:39:27.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:27.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj166 /dev/null 2020-09-08T16:39:27.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:27.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj167 /dev/null 2020-09-08T16:39:27.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:27.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj168 /dev/null 2020-09-08T16:39:28.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:28.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj169 /dev/null 2020-09-08T16:39:28.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:28.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj170 /dev/null 2020-09-08T16:39:28.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:28.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj171 /dev/null 2020-09-08T16:39:28.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:28.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj172 /dev/null 2020-09-08T16:39:28.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:28.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj173 /dev/null 2020-09-08T16:39:28.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:28.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj174 /dev/null 2020-09-08T16:39:28.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:28.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj175 /dev/null 2020-09-08T16:39:28.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:28.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj176 /dev/null 2020-09-08T16:39:28.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:28.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj177 /dev/null 2020-09-08T16:39:28.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:28.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj178 /dev/null 2020-09-08T16:39:29.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:29.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj179 /dev/null 2020-09-08T16:39:29.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:29.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj180 /dev/null 2020-09-08T16:39:29.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:29.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj181 /dev/null 2020-09-08T16:39:29.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:29.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj182 /dev/null 2020-09-08T16:39:29.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:29.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj183 /dev/null 2020-09-08T16:39:29.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:29.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj184 /dev/null 2020-09-08T16:39:29.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:29.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj185 /dev/null 2020-09-08T16:39:29.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:29.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj186 /dev/null 2020-09-08T16:39:29.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:29.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj187 /dev/null 2020-09-08T16:39:29.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:29.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj188 /dev/null 2020-09-08T16:39:30.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:30.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj189 /dev/null 2020-09-08T16:39:30.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:30.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj190 /dev/null 2020-09-08T16:39:30.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:30.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj191 /dev/null 2020-09-08T16:39:30.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:30.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj192 /dev/null 2020-09-08T16:39:30.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:30.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj193 /dev/null 2020-09-08T16:39:30.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:30.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj194 /dev/null 2020-09-08T16:39:30.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:30.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj195 /dev/null 2020-09-08T16:39:30.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:30.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj196 /dev/null 2020-09-08T16:39:31.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:31.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj197 /dev/null 2020-09-08T16:39:31.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:31.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj198 /dev/null 2020-09-08T16:39:31.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:31.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj199 /dev/null 2020-09-08T16:39:31.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2020-09-08T16:39:31.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj200 /dev/null 2020-09-08T16:39:31.431 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:300: TEST_backfill_down_out: get_pg test obj1 2020-09-08T16:39:31.431 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1031: get_pg: local poolname=test 2020-09-08T16:39:31.432 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: local objectname=obj1 2020-09-08T16:39:31.432 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: ceph --format json osd map test obj1 2020-09-08T16:39:31.432 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: jq -r .pgid 2020-09-08T16:39:31.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:300: TEST_backfill_down_out: local PG=1.0 2020-09-08T16:39:31.845 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:302: TEST_backfill_down_out: get_primary test obj1 2020-09-08T16:39:31.846 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:39:31.846 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:39:31.846 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:39:31.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:39:32.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:302: TEST_backfill_down_out: local primary=1 2020-09-08T16:39:32.244 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:303: TEST_backfill_down_out: get_not_primary test obj1 2020-09-08T16:39:32.244 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1167: get_not_primary: local poolname=test 2020-09-08T16:39:32.244 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: get_not_primary: local objectname=obj1 2020-09-08T16:39:32.245 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: get_primary test obj1 2020-09-08T16:39:32.245 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:39:32.245 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:39:32.245 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:39:32.246 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:39:32.657 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: local primary=1 2020-09-08T16:39:32.658 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1171: get_not_primary: ceph --format json osd map test obj1 2020-09-08T16:39:32.658 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1172: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2020-09-08T16:39:33.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:303: TEST_backfill_down_out: local otherosd=0 2020-09-08T16:39:33.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:305: TEST_backfill_down_out: ceph osd set nobackfill 2020-09-08T16:39:33.751 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is set 2020-09-08T16:39:33.760 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:306: TEST_backfill_down_out: cat td/osd-backfill-stats/osd.0.pid 2020-09-08T16:39:33.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:306: TEST_backfill_down_out: kill 482996 2020-09-08T16:39:33.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:307: TEST_backfill_down_out: ceph osd down osd.0 2020-09-08T16:39:34.363 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already down. 2020-09-08T16:39:34.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:308: TEST_backfill_down_out: ceph osd out osd.0 2020-09-08T16:39:34.943 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already out. 2020-09-08T16:39:34.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:309: TEST_backfill_down_out: sleep 2 2020-09-08T16:39:36.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:310: TEST_backfill_down_out: ceph osd unset nobackfill 2020-09-08T16:39:37.699 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is unset 2020-09-08T16:39:37.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:312: TEST_backfill_down_out: wait_for_clean 2020-09-08T16:39:37.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:39:37.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:39:37.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:39:37.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:39:37.710 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:39:37.710 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:39:37.711 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:39:37.711 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:39:37.711 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:39:37.711 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:39:37.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:39:37.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:39:37.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:39:37.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:39:37.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:39:38.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:39:38.198 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:39:38.198 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:39:38.198 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:39:38.198 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T16:39:38.198 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T16:39:38.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:39:38.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:39:38.199 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:39:38.293 INFO:tasks.workunit.client.0.smithi065.stderr:Error ENXIO: problem getting command descriptions from osd.0 2020-09-08T16:39:38.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq= 2020-09-08T16:39:38.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z '' 2020-09-08T16:39:38.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: continue 2020-09-08T16:39:38.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:39:38.296 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:39:38.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672979 2020-09-08T16:39:38.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672979 2020-09-08T16:39:38.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 1-42949672979' 2020-09-08T16:39:38.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:39:38.429 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:39:38.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509458 2020-09-08T16:39:38.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509458 2020-09-08T16:39:38.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 1-42949672979 2-64424509458' 2020-09-08T16:39:38.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:39:38.562 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:39:38.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345937 2020-09-08T16:39:38.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345937 2020-09-08T16:39:38.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 1-42949672979 2-64424509458 3-85899345937' 2020-09-08T16:39:38.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:39:38.694 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:39:38.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182414 2020-09-08T16:39:38.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182414 2020-09-08T16:39:38.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 1-42949672979 2-64424509458 3-85899345937 4-107374182414' 2020-09-08T16:39:38.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:39:38.825 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T16:39:38.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018893 2020-09-08T16:39:38.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018893 2020-09-08T16:39:38.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 1-42949672979 2-64424509458 3-85899345937 4-107374182414 5-128849018893' 2020-09-08T16:39:38.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:39:38.958 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672979 2020-09-08T16:39:38.958 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:39:38.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:39:38.960 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672979 2020-09-08T16:39:38.961 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:39:38.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672979 2020-09-08T16:39:38.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672979' 2020-09-08T16:39:38.971 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:39:38.972 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672979 2020-09-08T16:39:39.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672979 -lt 42949672979 2020-09-08T16:39:39.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:39:39.351 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509458 2020-09-08T16:39:39.351 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:39:39.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:39:39.353 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509458 2020-09-08T16:39:39.353 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:39:39.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509458 2020-09-08T16:39:39.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509458' 2020-09-08T16:39:39.354 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509458 2020-09-08T16:39:39.355 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:39:39.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509455 -lt 64424509458 2020-09-08T16:39:39.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:39:40.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:39:40.757 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:39:41.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509458 -lt 64424509458 2020-09-08T16:39:41.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:39:41.154 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345937 2020-09-08T16:39:41.155 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:39:41.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:39:41.157 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345937 2020-09-08T16:39:41.157 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:39:41.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345937 2020-09-08T16:39:41.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345937' 2020-09-08T16:39:41.158 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345937 2020-09-08T16:39:41.159 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:39:41.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345937 -lt 85899345937 2020-09-08T16:39:41.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:39:41.587 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182414 2020-09-08T16:39:41.588 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:39:41.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:39:41.590 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182414 2020-09-08T16:39:41.590 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:39:41.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182414 2020-09-08T16:39:41.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182414' 2020-09-08T16:39:41.591 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182414 2020-09-08T16:39:41.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:39:42.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182415 -lt 107374182414 2020-09-08T16:39:42.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:39:42.015 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018893 2020-09-08T16:39:42.016 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:39:42.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T16:39:42.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018893 2020-09-08T16:39:42.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:39:42.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018893 2020-09-08T16:39:42.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018893' 2020-09-08T16:39:42.019 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018893 2020-09-08T16:39:42.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T16:39:42.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018893 -lt 128849018893 2020-09-08T16:39:42.416 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:39:42.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:39:42.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:39:42.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T16:39:42.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:39:42.939 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:39:42.939 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:39:42.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:39:42.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:39:42.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:39:42.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:39:43.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:39:43.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:39:43.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:39:43.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:39:43.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:39:43.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T16:39:43.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T16:39:43.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T16:39:43.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:39:43.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:39:43.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:39:43.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:39:43.943 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:39:43.943 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:39:43.943 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:39:43.943 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:39:43.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:39:43.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:39:44.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:39:44.322 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:39:44.322 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:39:44.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:39:44.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:39:44.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:39:44.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:39:44.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:39:44.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:39:44.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:39:44.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:39:44.852 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:39:44.852 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:39:45.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T16:39:45.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T16:39:45.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:39:45.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:39:45.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:39:45.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:39:45.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:39:45.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:39:45.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:39:45.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:39:45.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:39:45.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:39:45.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:39:45.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:39:45.863 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:39:45.863 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:39:45.863 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:39:46.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:39:46.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:39:46.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:39:46.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:39:46.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:39:46.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:39:46.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:39:46.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:39:46.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:39:46.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:39:46.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:39:46.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:39:46.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:39:46.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:39:47.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:39:47.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:39:47.002 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:39:47.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:39:47.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:39:47.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:39:47.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:39:47.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:39:47.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:39:47.390 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:39:47.391 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:39:47.391 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:39:47.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:39:47.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:39:47.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:39:47.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:39:47.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:39:47.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:39:47.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:39:47.952 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:39:47.952 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:39:48.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:39:48.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:39:48.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:39:48.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:39:48.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:39:48.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:39:48.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:39:48.583 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:39:48.583 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:39:48.583 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:39:48.584 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:39:48.584 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:39:48.584 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:39:48.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:39:48.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:39:48.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:39:48.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:39:49.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:39:49.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:39:49.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:39:49.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:39:49.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:39:49.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:39:49.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:39:49.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:39:49.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:39:50.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:39:50.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:39:50.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:39:50.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:39:50.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:39:50.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:39:50.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:39:50.107 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:39:50.107 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:39:50.107 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:39:50.107 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:39:50.108 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:39:50.108 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:39:50.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:39:50.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:39:50.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:39:50.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:39:51.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:39:51.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:39:51.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:39:51.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:39:51.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:39:51.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:39:51.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:39:51.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:39:51.020 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:39:51.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:39:51.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:39:51.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:39:51.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:39:51.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:39:51.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:39:51.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:39:51.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:39:51.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:39:51.650 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:39:51.650 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:39:51.650 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:39:51.650 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:39:52.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:39:52.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:39:52.037 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:39:52.037 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:39:52.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:39:52.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:39:52.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:39:52.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:39:52.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:39:52.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:39:52.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:39:52.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:39:52.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:39:53.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=6 2020-09-08T16:39:53.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 6 '!=' null 2020-09-08T16:39:53.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:39:53.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:39:53.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:39:53.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:39:53.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:39:53.218 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:39:53.218 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:39:53.218 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:39:53.218 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:39:53.219 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:39:53.219 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:39:53.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:39:53.603 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:39:53.603 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:39:53.603 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:39:54.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:39:54.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:39:54.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:39:54.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:39:54.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:39:54.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:39:54.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:39:54.135 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:39:54.135 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:39:54.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:39:54.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:39:54.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:39:54.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:39:54.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:39:54.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:39:54.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:39:54.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:39:54.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:39:54.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:39:54.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:39:54.751 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:39:54.751 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:39:55.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:39:55.134 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:39:55.134 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:39:55.135 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:39:55.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:39:55.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:39:55.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:39:55.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:39:55.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:39:55.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:39:55.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:39:55.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:39:55.666 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:39:56.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:39:56.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:39:56.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:39:56.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:39:56.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:39:56.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:39:56.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:39:56.294 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:39:56.294 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:39:56.294 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:39:56.295 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:39:56.295 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:39:56.295 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:39:56.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:39:56.683 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:39:56.684 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:39:56.684 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:39:57.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:39:57.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:39:57.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:39:57.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:39:57.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:39:57.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:39:57.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:39:57.198 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:39:57.199 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:39:57.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=8 2020-09-08T16:39:57.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 8 '!=' null 2020-09-08T16:39:57.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:39:57.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:39:57.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:39:57.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:39:57.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:39:57.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:39:57.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:39:57.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:39:57.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:39:57.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:39:57.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:39:58.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:39:58.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:39:58.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:39:58.225 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:39:58.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:39:58.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:39:58.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:39:58.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:39:58.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:39:58.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:39:58.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:39:58.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:39:58.751 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:39:59.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:39:59.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:39:59.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:39:59.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:39:59.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:39:59.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:39:59.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:39:59.379 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:39:59.380 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:39:59.380 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:39:59.380 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:39:59.380 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:39:59.380 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:39:59.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:39:59.760 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:39:59.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:39:59.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:40:00.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:40:00.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:40:00.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:40:00.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:40:00.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:40:00.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:40:00.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:40:00.292 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:40:00.293 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:40:00.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:40:00.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:40:00.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:40:00.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:40:00.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:40:00.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:40:00.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:40:00.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:40:00.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:40:00.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:40:00.912 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:40:00.912 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:40:00.912 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:40:01.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:40:01.300 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:40:01.300 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:40:01.301 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:40:01.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:40:01.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:40:01.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:40:01.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:40:01.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:40:01.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:40:01.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:40:01.820 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:40:01.820 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:40:02.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:40:02.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:40:02.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:40:02.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:40:02.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:40:02.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:40:02.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:40:02.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:40:02.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:40:02.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:40:02.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:40:02.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:40:02.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:40:02.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:40:02.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:40:02.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:40:02.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:40:03.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:40:03.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:40:03.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:40:03.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:40:03.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:40:03.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:40:03.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:40:03.352 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:40:03.352 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:40:03.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=8 2020-09-08T16:40:03.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 8 '!=' null 2020-09-08T16:40:03.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:40:03.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:40:03.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:40:03.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:40:03.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:40:03.974 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:40:03.974 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:40:03.974 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:40:03.974 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:40:03.975 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:40:03.975 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:40:04.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:40:04.363 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:40:04.363 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:40:04.363 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:40:04.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:40:04.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:40:04.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:40:04.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:40:04.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:40:04.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:40:04.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:40:04.883 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:40:04.883 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:40:05.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:40:05.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:40:05.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:40:05.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:40:05.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:40:05.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:40:05.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:40:05.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:40:05.501 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:40:05.501 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:40:05.501 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:40:05.501 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:40:05.502 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:40:05.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:40:08.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:40:08.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:40:08.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:40:08.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:40:08.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:40:08.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:40:08.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:40:08.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:40:08.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:40:08.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:40:08.534 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:40:08.534 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:40:08.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=8 2020-09-08T16:40:08.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 8 '!=' null 2020-09-08T16:40:08.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:40:08.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:40:08.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:40:08.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:40:08.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:40:08.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:40:08.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:40:08.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:40:08.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:40:08.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:40:08.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:40:08.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:40:08.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:40:08.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:40:08.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:40:08.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:40:08.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:40:08.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:40:08.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:40:08.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:40:08.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:40:08.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:40:08.540 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:40:08.540 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:40:08.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=8 2020-09-08T16:40:08.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 8 '!=' null 2020-09-08T16:40:08.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:40:08.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:40:08.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:40:08.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:40:08.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:40:08.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:40:08.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:40:08.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:40:08.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:40:08.587 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:40:08.587 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:40:08.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:40:08.969 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:40:08.970 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:40:08.970 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:40:09.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:40:09.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:40:09.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:40:09.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:40:09.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:40:09.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:40:09.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:40:09.496 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:40:09.496 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:40:10.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:40:10.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:40:10.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:40:10.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:40:10.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:40:10.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:40:10.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:40:10.118 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:40:10.118 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:40:10.119 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:40:10.119 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:40:10.119 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:40:10.119 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:40:10.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:40:10.498 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:40:10.498 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:40:10.498 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:40:11.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:40:11.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:40:11.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:40:11.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:40:11.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:40:11.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:40:11.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:40:11.017 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:40:11.017 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:40:11.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:40:11.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:40:11.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:40:11.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:40:11.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:40:11.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:40:11.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:40:11.643 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:40:11.644 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:40:11.644 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:40:11.644 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:40:11.644 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:40:11.644 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:40:12.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:40:12.015 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:40:12.015 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:40:12.015 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:40:12.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:40:12.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:40:12.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:40:12.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:40:12.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:40:12.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:40:12.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:40:12.542 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:40:12.542 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:40:13.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=6 2020-09-08T16:40:13.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 6 '!=' null 2020-09-08T16:40:13.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:40:13.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:40:13.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:40:13.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:40:13.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:40:13.157 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:40:13.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:40:13.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:40:13.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:40:13.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:40:13.159 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:40:13.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T16:40:13.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:40:13.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:40:13.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:40:14.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T16:40:14.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:40:14.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:40:14.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:314: TEST_backfill_down_out: check td/osd-backfill-stats 1.0 1 replicated 200 0 0 0 2020-09-08T16:40:14.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2020-09-08T16:40:14.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:64: check: local PG=1.0 2020-09-08T16:40:14.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:65: check: local primary=1 2020-09-08T16:40:14.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:66: check: local type=replicated 2020-09-08T16:40:14.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:67: check: local degraded_start=200 2020-09-08T16:40:14.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:68: check: local degraded_end=0 2020-09-08T16:40:14.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:69: check: local misplaced_start=0 2020-09-08T16:40:14.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:70: check: local misplaced_end=0 2020-09-08T16:40:14.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:71: check: local primary_start= 2020-09-08T16:40:14.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:72: check: local primary_end= 2020-09-08T16:40:14.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:73: check: local check_setup=true 2020-09-08T16:40:14.056 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2020-09-08T16:40:14.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2020-09-08T16:40:14.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:76: check: '[' true = true ']' 2020-09-08T16:40:14.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log td/osd-backfill-stats/osd.5.log 2020-09-08T16:40:14.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2020-09-08T16:40:14.066 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2020-09-08T16:40:14.066 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: wc -w 2020-09-08T16:40:14.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2020-09-08T16:40:14.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:86: check: local 'addp= ' 2020-09-08T16:40:14.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:87: check: '[' replicated = erasure ']' 2020-09-08T16:40:14.069 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2020-09-08T16:40:14.069 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:40:14.069 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: tail -1 2020-09-08T16:40:14.069 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2020-09-08T16:40:14.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: UPACT='[1,2]/[1]' 2020-09-08T16:40:14.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:93: check: '[' -n '[1,2]/[1]' ']' 2020-09-08T16:40:14.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:96: check: local which=degraded 2020-09-08T16:40:14.082 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:40:14.082 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:40:14.083 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -F ' [1,2]/[1] ' 2020-09-08T16:40:14.083 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -v est 2020-09-08T16:40:14.083 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: head -1 2020-09-08T16:40:14.083 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:40:14.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: FIRST=200 2020-09-08T16:40:14.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:98: check: '[' -n 200 ']' 2020-09-08T16:40:14.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:99: check: below_margin 200 200 2020-09-08T16:40:14.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=200 2020-09-08T16:40:14.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T16:40:14.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=200 2020-09-08T16:40:14.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T16:40:14.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:40:14.088 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:40:14.088 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: tail -1 2020-09-08T16:40:14.088 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:40:14.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: LAST=1 2020-09-08T16:40:14.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:101: check: '[' -n 1 ']' 2020-09-08T16:40:14.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:102: check: above_margin 1 0 2020-09-08T16:40:14.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=1 2020-09-08T16:40:14.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T16:40:14.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=0 2020-09-08T16:40:14.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T16:40:14.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:105: check: which=misplaced 2020-09-08T16:40:14.096 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:40:14.097 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:40:14.097 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -F ' [1,2]/[1] ' 2020-09-08T16:40:14.097 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -v est 2020-09-08T16:40:14.097 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: head -1 2020-09-08T16:40:14.097 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:40:14.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: FIRST=0 2020-09-08T16:40:14.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:107: check: '[' -n 0 ']' 2020-09-08T16:40:14.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:108: check: below_margin 0 0 2020-09-08T16:40:14.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=0 2020-09-08T16:40:14.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T16:40:14.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=0 2020-09-08T16:40:14.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T16:40:14.102 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:40:14.102 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:40:14.103 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: tail -1 2020-09-08T16:40:14.103 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:40:14.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: LAST=0 2020-09-08T16:40:14.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:110: check: '[' -n 0 ']' 2020-09-08T16:40:14.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:111: check: above_margin 0 0 2020-09-08T16:40:14.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=0 2020-09-08T16:40:14.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T16:40:14.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=0 2020-09-08T16:40:14.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T16:40:14.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2020-09-08T16:40:14.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:316: TEST_backfill_down_out: delete_pool test 2020-09-08T16:40:14.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test 2020-09-08T16:40:14.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2020-09-08T16:40:14.619 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' does not exist 2020-09-08T16:40:14.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:317: TEST_backfill_down_out: kill_daemons td/osd-backfill-stats 2020-09-08T16:40:14.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:40:14.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:40:14.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:40:14.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:40:14.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:40:15.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:40:15.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2020-09-08T16:40:15.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T16:40:15.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:40:15.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T16:40:15.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:40:15.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:40:15.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:40:15.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:40:15.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:40:15.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:40:15.952 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:40:15.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:40:15.952 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:40:15.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:40:15.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:40:15.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:40:15.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:40:15.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:40:15.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:40:15.956 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:40:15.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:40:15.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:40:15.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T16:40:15.973 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:40:15.974 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:40:15.974 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:40:15.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T16:40:15.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:40:15.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:40:15.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:35: run: for func in $funcs 2020-09-08T16:40:15.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2020-09-08T16:40:15.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2020-09-08T16:40:15.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2020-09-08T16:40:15.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T16:40:15.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:40:15.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T16:40:15.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:40:15.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:40:15.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:40:15.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:40:15.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:40:15.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:40:15.980 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:40:15.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:40:15.980 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:40:15.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:40:15.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:40:15.981 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:40:15.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:40:15.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:40:15.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:40:15.983 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:40:15.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:40:15.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:40:15.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T16:40:15.986 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:40:15.986 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:40:15.986 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:40:15.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T16:40:15.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:40:15.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:40:15.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2020-09-08T16:40:15.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T16:40:15.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:40:15.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:40:15.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.482138 2020-09-08T16:40:15.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T16:40:15.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T16:40:15.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T16:40:15.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2020-09-08T16:40:15.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:37: run: TEST_backfill_ec_all_out td/osd-backfill-stats 2020-09-08T16:40:15.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:515: TEST_backfill_ec_all_out: local dir=td/osd-backfill-stats 2020-09-08T16:40:15.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:517: TEST_backfill_ec_all_out: run_mon td/osd-backfill-stats a 2020-09-08T16:40:15.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2020-09-08T16:40:15.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T16:40:15.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T16:40:15.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T16:40:15.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2020-09-08T16:40:15.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2020-09-08T16:40:16.268 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T16:40:16.268 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:40:16.268 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:40:16.269 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:40:16.269 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:40:16.269 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:40:16.270 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:40:16.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T16:40:16.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T16:40:16.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T16:40:16.454 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:40:16.454 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:40:16.454 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T16:40:16.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T16:40:16.456 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:40:16.456 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:40:16.456 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:40:16.456 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:40:16.456 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:40:16.457 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:40:16.457 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T16:40:16.457 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:40:16.457 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get fsid 2020-09-08T16:40:16.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T16:40:16.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:40:16.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:40:16.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T16:40:16.559 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T16:40:16.559 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:40:16.559 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:40:16.559 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:40:16.560 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:40:16.560 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:40:16.560 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:40:16.561 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T16:40:16.561 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:40:16.561 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get mon_host 2020-09-08T16:40:16.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:518: TEST_backfill_ec_all_out: run_mgr td/osd-backfill-stats x 2020-09-08T16:40:16.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-stats 2020-09-08T16:40:16.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T16:40:16.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T16:40:16.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T16:40:16.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-stats/x 2020-09-08T16:40:16.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T16:40:17.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T16:40:17.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:40:17.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:40:17.550 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:40:17.550 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:40:17.550 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:40:17.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:40:17.551 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:40:17.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:40:17.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:519: TEST_backfill_ec_all_out: run_osd td/osd-backfill-stats 0 2020-09-08T16:40:17.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:40:17.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:40:17.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T16:40:17.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:40:17.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/0 2020-09-08T16:40:17.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:40:17.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:40:17.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:40:17.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:40:17.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2020-09-08T16:40:17.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2020-09-08T16:40:17.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:40:17.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:40:17.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:40:17.579 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:40:17.579 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:40:17.579 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:40:17.580 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:40:17.580 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:40:17.580 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:40:17.580 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:40:17.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:40:17.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:40:17.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:40:17.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:40:17.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:40:17.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:40:17.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:40:17.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:40:17.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:40:17.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:40:17.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:40:17.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/0 2020-09-08T16:40:17.584 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:40:17.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=7266455f-a28c-448d-8e16-8582124c107c 2020-09-08T16:40:17.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 7266455f-a28c-448d-8e16-8582124c107c' 2020-09-08T16:40:17.585 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:40:17.585 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 7266455f-a28c-448d-8e16-8582124c107c 2020-09-08T16:40:17.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDxs1dfRAFEJBAAtbE43o4yxebIeTXGBALwqg== 2020-09-08T16:40:17.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDxs1dfRAFEJBAAtbE43o4yxebIeTXGBALwqg=="}' 2020-09-08T16:40:17.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 7266455f-a28c-448d-8e16-8582124c107c -i td/osd-backfill-stats/0/new.json 2020-09-08T16:40:17.954 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:40:17.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/0/new.json 2020-09-08T16:40:17.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDxs1dfRAFEJBAAtbE43o4yxebIeTXGBALwqg== --osd-uuid 7266455f-a28c-448d-8e16-8582124c107c 2020-09-08T16:40:17.989 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:17.995+0000 7ff1a7e56ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:17.992 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:17.997+0000 7ff1a7e56ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:17.993 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:17.999+0000 7ff1a7e56ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:17.994 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:17.999+0000 7ff1a7e56ec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:40:17.994 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:17.999+0000 7ff1a7e56ec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:40:17.995 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:17.999+0000 7ff1a7e56ec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:40:18.034 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:18.039+0000 7ff1a7e56ec0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2020-09-08T16:40:22.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2020-09-08T16:40:22.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:40:22.832 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T16:40:22.833 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T16:40:22.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T16:40:22.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:40:22.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T16:40:22.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:40:22.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:40:22.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:40:22.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:40:22.835 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:22.773+0000 7f9ce7b7cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:22.835 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:22.803+0000 7f9ce7b7cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:22.835 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:22.805+0000 7f9ce7b7cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:23.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T16:40:23.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:40:23.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T16:40:23.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:40:23.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:40:23.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:40:23.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:40:23.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:40:23.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:40:23.141 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:40:23.316 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:23.320+0000 7f9ce7b7cec0 -1 Falling back to public interface 2020-09-08T16:40:23.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:40:24.106 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:24.111+0000 7f9ce7b7cec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T16:40:24.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:40:24.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:40:24.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:40:24.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:40:24.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:40:24.568 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:40:24.986 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/496275,v1:127.0.0.1:6803/496275] [v2:127.0.0.1:6804/496275,v1:127.0.0.1:6805/496275] exists,up 7266455f-a28c-448d-8e16-8582124c107c 2020-09-08T16:40:24.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:40:24.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:40:24.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:40:24.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:520: TEST_backfill_ec_all_out: run_osd td/osd-backfill-stats 1 2020-09-08T16:40:24.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:40:24.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:40:24.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T16:40:24.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:40:24.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/1 2020-09-08T16:40:24.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:40:24.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:40:24.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:40:24.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:40:24.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2020-09-08T16:40:24.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2020-09-08T16:40:24.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:40:24.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:40:24.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:40:24.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:40:24.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:40:24.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:40:24.990 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:40:24.991 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:40:24.991 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:40:24.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:40:24.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:40:24.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:40:24.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:40:24.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:40:24.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:40:24.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:40:24.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:40:24.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:40:24.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:40:24.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:40:24.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:40:24.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/1 2020-09-08T16:40:24.994 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:40:24.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=141f2497-642d-4d78-8036-64371f64c179 2020-09-08T16:40:24.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 141f2497-642d-4d78-8036-64371f64c179' 2020-09-08T16:40:24.995 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:40:24.995 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 141f2497-642d-4d78-8036-64371f64c179 2020-09-08T16:40:25.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQD5s1dfsMd4ABAAqCfuAUNvqF0eAw0fql3DsA== 2020-09-08T16:40:25.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQD5s1dfsMd4ABAAqCfuAUNvqF0eAw0fql3DsA=="}' 2020-09-08T16:40:25.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 141f2497-642d-4d78-8036-64371f64c179 -i td/osd-backfill-stats/1/new.json 2020-09-08T16:40:25.502 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:40:25.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/1/new.json 2020-09-08T16:40:25.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQD5s1dfsMd4ABAAqCfuAUNvqF0eAw0fql3DsA== --osd-uuid 141f2497-642d-4d78-8036-64371f64c179 2020-09-08T16:40:25.538 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:25.543+0000 7f5d3830aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:25.540 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:25.545+0000 7f5d3830aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:25.541 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:25.547+0000 7f5d3830aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:25.542 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:25.547+0000 7f5d3830aec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:40:25.543 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:25.547+0000 7f5d3830aec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:40:25.543 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:25.547+0000 7f5d3830aec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:40:25.591 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:25.597+0000 7f5d3830aec0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2020-09-08T16:40:30.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2020-09-08T16:40:30.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:40:30.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T16:40:30.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:40:30.120 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T16:40:30.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T16:40:30.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:40:30.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:40:30.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:40:30.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:40:30.650 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T16:40:30.672 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:30.677+0000 7fcd025e3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:30.689 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:30.694+0000 7fcd025e3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:30.690 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:30.695+0000 7fcd025e3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:31.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T16:40:31.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:40:31.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T16:40:31.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:40:31.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:40:31.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:40:31.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:40:31.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:40:31.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:40:31.045 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:40:31.208 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:31.213+0000 7fcd025e3ec0 -1 Falling back to public interface 2020-09-08T16:40:31.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:40:32.006 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:32.011+0000 7fcd025e3ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T16:40:32.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:40:32.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:40:32.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:40:32.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:40:32.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:40:32.461 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:40:32.891 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/497269,v1:127.0.0.1:6811/497269] [v2:127.0.0.1:6812/497269,v1:127.0.0.1:6813/497269] exists,up 141f2497-642d-4d78-8036-64371f64c179 2020-09-08T16:40:32.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:40:32.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:40:32.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:40:32.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:521: TEST_backfill_ec_all_out: run_osd td/osd-backfill-stats 2 2020-09-08T16:40:32.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:40:32.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:40:32.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T16:40:32.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:40:32.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/2 2020-09-08T16:40:32.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:40:32.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:40:32.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:40:32.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:40:32.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2020-09-08T16:40:32.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2020-09-08T16:40:32.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:40:32.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:40:32.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:40:32.895 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:40:32.895 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:40:32.895 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:40:32.896 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:40:32.896 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:40:32.896 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:40:32.896 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:40:32.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:40:32.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:40:32.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:40:32.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:40:32.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:40:32.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:40:32.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:40:32.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:40:32.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:40:32.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:40:32.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:40:32.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/2 2020-09-08T16:40:32.899 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:40:32.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=30b44457-841c-4705-b8bc-09f10cadf488 2020-09-08T16:40:32.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 30b44457-841c-4705-b8bc-09f10cadf488' 2020-09-08T16:40:32.901 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:40:32.901 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 30b44457-841c-4705-b8bc-09f10cadf488 2020-09-08T16:40:32.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAAtFdfBDpwNhAAyXw7LI8j1KaIcIgQqi/FZA== 2020-09-08T16:40:32.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAAtFdfBDpwNhAAyXw7LI8j1KaIcIgQqi/FZA=="}' 2020-09-08T16:40:32.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 30b44457-841c-4705-b8bc-09f10cadf488 -i td/osd-backfill-stats/2/new.json 2020-09-08T16:40:33.456 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:40:33.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/2/new.json 2020-09-08T16:40:33.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAAtFdfBDpwNhAAyXw7LI8j1KaIcIgQqi/FZA== --osd-uuid 30b44457-841c-4705-b8bc-09f10cadf488 2020-09-08T16:40:33.493 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:33.498+0000 7fdc7ff79ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:33.494 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:33.500+0000 7fdc7ff79ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:33.496 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:33.501+0000 7fdc7ff79ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:33.497 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:33.502+0000 7fdc7ff79ec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:40:33.497 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:33.502+0000 7fdc7ff79ec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:40:33.497 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:33.502+0000 7fdc7ff79ec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:40:33.534 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:33.539+0000 7fdc7ff79ec0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2020-09-08T16:40:37.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2020-09-08T16:40:37.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:40:37.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T16:40:37.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:40:37.782 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T16:40:38.322 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T16:40:38.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T16:40:38.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:40:38.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:40:38.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:40:38.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:40:38.345 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:38.350+0000 7f35b27a9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:38.361 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:38.366+0000 7f35b27a9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:38.362 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:38.368+0000 7f35b27a9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:38.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T16:40:38.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:40:38.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T16:40:38.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:40:38.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:40:38.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:40:38.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:40:38.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:40:38.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:40:38.717 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:40:38.877 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:38.882+0000 7f35b27a9ec0 -1 Falling back to public interface 2020-09-08T16:40:39.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:40:39.720 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:39.725+0000 7f35b27a9ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T16:40:40.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:40:40.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:40:40.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:40:40.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:40:40.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:40:40.129 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:40:40.554 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/498263,v1:127.0.0.1:6819/498263] [v2:127.0.0.1:6820/498263,v1:127.0.0.1:6821/498263] exists,up 30b44457-841c-4705-b8bc-09f10cadf488 2020-09-08T16:40:40.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:40:40.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:40:40.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:40:40.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:522: TEST_backfill_ec_all_out: run_osd td/osd-backfill-stats 3 2020-09-08T16:40:40.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:40:40.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:40:40.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T16:40:40.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:40:40.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/3 2020-09-08T16:40:40.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:40:40.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:40:40.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:40:40.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:40:40.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2020-09-08T16:40:40.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2020-09-08T16:40:40.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:40:40.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:40:40.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:40:40.563 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:40:40.563 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:40:40.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:40:40.564 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:40:40.564 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:40:40.564 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:40:40.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:40:40.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:40:40.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:40:40.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:40:40.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:40:40.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:40:40.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:40:40.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:40:40.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:40:40.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:40:40.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:40:40.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:40:40.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/3 2020-09-08T16:40:40.567 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:40:40.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=c69f1278-4858-4f3e-b305-acc82d818559 2020-09-08T16:40:40.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 c69f1278-4858-4f3e-b305-acc82d818559' 2020-09-08T16:40:40.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:40:40.569 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 c69f1278-4858-4f3e-b305-acc82d818559 2020-09-08T16:40:40.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAItFdfBIJXIhAAohZZ1cxHDZrmCoktYoa0EQ== 2020-09-08T16:40:40.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAItFdfBIJXIhAAohZZ1cxHDZrmCoktYoa0EQ=="}' 2020-09-08T16:40:40.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new c69f1278-4858-4f3e-b305-acc82d818559 -i td/osd-backfill-stats/3/new.json 2020-09-08T16:40:41.110 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T16:40:41.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/3/new.json 2020-09-08T16:40:41.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAItFdfBIJXIhAAohZZ1cxHDZrmCoktYoa0EQ== --osd-uuid c69f1278-4858-4f3e-b305-acc82d818559 2020-09-08T16:40:41.147 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:41.151+0000 7fd4351e5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:41.148 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:41.153+0000 7fd4351e5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:41.149 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:41.154+0000 7fd4351e5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:41.150 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:41.154+0000 7fd4351e5ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:40:41.150 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:41.154+0000 7fd4351e5ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:40:41.150 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:41.154+0000 7fd4351e5ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:40:41.203 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:41.209+0000 7fd4351e5ec0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2020-09-08T16:40:45.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2020-09-08T16:40:45.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:40:45.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T16:40:45.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:40:45.406 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T16:40:45.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T16:40:45.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:40:45.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:40:45.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:40:45.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:40:45.953 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T16:40:45.975 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:45.979+0000 7fc0ca5ffec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:45.977 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:45.981+0000 7fc0ca5ffec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:45.978 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:45.982+0000 7fc0ca5ffec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:46.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T16:40:46.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:40:46.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T16:40:46.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:40:46.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:40:46.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:40:46.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:40:46.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:40:46.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:40:46.346 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:40:46.502 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:46.506+0000 7fc0ca5ffec0 -1 Falling back to public interface 2020-09-08T16:40:46.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:40:47.317 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:47.321+0000 7fc0ca5ffec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T16:40:47.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:40:47.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:40:47.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:40:47.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:40:47.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:40:47.762 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:40:48.214 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/499257,v1:127.0.0.1:6827/499257] [v2:127.0.0.1:6828/499257,v1:127.0.0.1:6829/499257] exists,up c69f1278-4858-4f3e-b305-acc82d818559 2020-09-08T16:40:48.214 INFO:tasks.workunit.client.0.smithi065.stdout:add osd4 4b1ff845-37d7-4da5-a745-aa6d3b2114c3 2020-09-08T16:40:48.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:40:48.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:40:48.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:40:48.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:523: TEST_backfill_ec_all_out: run_osd td/osd-backfill-stats 4 2020-09-08T16:40:48.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:40:48.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:40:48.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=4 2020-09-08T16:40:48.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:40:48.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/4 2020-09-08T16:40:48.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:40:48.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:40:48.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:40:48.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:40:48.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2020-09-08T16:40:48.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2020-09-08T16:40:48.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:40:48.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:40:48.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:40:48.218 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:40:48.219 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:40:48.219 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:40:48.219 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:40:48.219 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:40:48.219 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:40:48.220 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:40:48.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:40:48.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:40:48.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:40:48.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:40:48.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:40:48.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:40:48.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:40:48.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:40:48.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:40:48.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:40:48.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:40:48.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/4 2020-09-08T16:40:48.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:40:48.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=4b1ff845-37d7-4da5-a745-aa6d3b2114c3 2020-09-08T16:40:48.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd4 4b1ff845-37d7-4da5-a745-aa6d3b2114c3' 2020-09-08T16:40:48.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:40:48.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAQtFdfo+LcDRAAnu/KCFj6v4Or4T+CRlVSwA== 2020-09-08T16:40:48.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAQtFdfo+LcDRAAnu/KCFj6v4Or4T+CRlVSwA=="}' 2020-09-08T16:40:48.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 4b1ff845-37d7-4da5-a745-aa6d3b2114c3 -i td/osd-backfill-stats/4/new.json 2020-09-08T16:40:48.742 INFO:tasks.workunit.client.0.smithi065.stdout:4 2020-09-08T16:40:48.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/4/new.json 2020-09-08T16:40:48.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 4 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAQtFdfo+LcDRAAnu/KCFj6v4Or4T+CRlVSwA== --osd-uuid 4b1ff845-37d7-4da5-a745-aa6d3b2114c3 2020-09-08T16:40:48.770 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:48.774+0000 7f5007a91ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:48.774 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:48.776+0000 7f5007a91ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:48.774 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:48.777+0000 7f5007a91ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:48.774 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:48.778+0000 7f5007a91ec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:40:48.775 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:48.778+0000 7f5007a91ec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:40:48.775 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:48.778+0000 7f5007a91ec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:40:48.833 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:48.837+0000 7f5007a91ec0 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2020-09-08T16:40:53.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2020-09-08T16:40:53.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:40:53.124 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd4 key to auth repository 2020-09-08T16:40:53.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd4 key to auth repository 2020-09-08T16:40:53.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:40:53.596 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.4 2020-09-08T16:40:53.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.4 2020-09-08T16:40:53.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 4 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:40:53.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:40:53.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:40:53.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:40:53.619 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:53.624+0000 7f283680cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:53.640 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:53.645+0000 7f283680cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:53.642 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:53.647+0000 7f283680cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:40:53.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 4 2020-09-08T16:40:53.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:40:53.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=4 2020-09-08T16:40:53.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:40:53.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:40:53.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:40:53.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:40:53.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:40:53.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:40:53.990 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:40:54.158 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:54.162+0000 7f283680cec0 -1 Falling back to public interface 2020-09-08T16:40:54.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:40:54.949 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:40:54.954+0000 7f283680cec0 -1 osd.4 0 log_to_monitors {default=true} 2020-09-08T16:40:55.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:40:55.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:40:55.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:40:55.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:40:55.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:40:55.398 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:40:55.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:40:56.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:40:56.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:40:56.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T16:40:56.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:40:56.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:40:56.926 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:40:57.335 INFO:tasks.workunit.client.0.smithi065.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/500259,v1:127.0.0.1:6835/500259] [v2:127.0.0.1:6836/500259,v1:127.0.0.1:6837/500259] exists,up 4b1ff845-37d7-4da5-a745-aa6d3b2114c3 2020-09-08T16:40:57.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:40:57.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:40:57.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:40:57.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:525: TEST_backfill_ec_all_out: ceph osd erasure-code-profile set myprofile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2020-09-08T16:40:57.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:526: TEST_backfill_ec_all_out: create_pool test 1 1 erasure myprofile 2020-09-08T16:40:57.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test 1 1 erasure myprofile 2020-09-08T16:40:58.695 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' already exists 2020-09-08T16:40:58.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:40:59.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:528: TEST_backfill_ec_all_out: wait_for_clean 2020-09-08T16:40:59.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:40:59.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:40:59.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:40:59.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:40:59.707 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:40:59.708 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:40:59.708 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:40:59.708 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:40:59.708 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:40:59.709 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:40:59.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:40:59.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:40:59.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:40:59.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:40:59.809 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:41:00.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:41:00.311 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:41:00.311 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:41:00.312 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:41:00.312 INFO:tasks.workunit.client.0.smithi065.stderr:4' 2020-09-08T16:41:00.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:41:00.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:41:00.313 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:41:00.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836490 2020-09-08T16:41:00.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836490 2020-09-08T16:41:00.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836490' 2020-09-08T16:41:00.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:41:00.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:41:00.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672968 2020-09-08T16:41:00.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672968 2020-09-08T16:41:00.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836490 1-42949672968' 2020-09-08T16:41:00.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:41:00.573 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:41:00.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509446 2020-09-08T16:41:00.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509446 2020-09-08T16:41:00.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836490 1-42949672968 2-64424509446' 2020-09-08T16:41:00.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:41:00.704 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:41:00.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345925 2020-09-08T16:41:00.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345925 2020-09-08T16:41:00.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836490 1-42949672968 2-64424509446 3-85899345925' 2020-09-08T16:41:00.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:41:00.836 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:41:00.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182403 2020-09-08T16:41:00.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182403 2020-09-08T16:41:00.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836490 1-42949672968 2-64424509446 3-85899345925 4-107374182403' 2020-09-08T16:41:00.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:41:00.973 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836490 2020-09-08T16:41:00.973 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:41:00.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:41:00.974 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836490 2020-09-08T16:41:00.974 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:41:00.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836490 2020-09-08T16:41:00.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2020-09-08T16:41:00.975 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:41:00.975 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836490 2020-09-08T16:41:01.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836488 -lt 21474836490 2020-09-08T16:41:01.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:41:02.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:41:02.358 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:41:02.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836491 -lt 21474836490 2020-09-08T16:41:02.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:41:02.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672968 2020-09-08T16:41:02.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:41:02.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:41:02.759 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672968 2020-09-08T16:41:02.759 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:41:02.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672968 2020-09-08T16:41:02.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672968' 2020-09-08T16:41:02.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:41:02.761 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672968 2020-09-08T16:41:03.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672968 -lt 42949672968 2020-09-08T16:41:03.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:41:03.165 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509446 2020-09-08T16:41:03.165 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:41:03.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:41:03.166 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509446 2020-09-08T16:41:03.166 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:41:03.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509446 2020-09-08T16:41:03.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509446' 2020-09-08T16:41:03.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:41:03.168 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509446 2020-09-08T16:41:03.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509447 -lt 64424509446 2020-09-08T16:41:03.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:41:03.567 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345925 2020-09-08T16:41:03.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:41:03.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:41:03.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345925 2020-09-08T16:41:03.569 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:41:03.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345925 2020-09-08T16:41:03.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345925' 2020-09-08T16:41:03.570 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:41:03.570 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345925 2020-09-08T16:41:03.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345925 -lt 85899345925 2020-09-08T16:41:03.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:41:03.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182403 2020-09-08T16:41:03.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:41:03.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:41:03.969 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182403 2020-09-08T16:41:03.969 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:41:03.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182403 2020-09-08T16:41:03.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182403' 2020-09-08T16:41:03.970 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:41:03.971 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182403 2020-09-08T16:41:04.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182404 -lt 107374182403 2020-09-08T16:41:04.379 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:41:04.380 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:41:04.380 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:41:04.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T16:41:04.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:41:04.924 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:41:04.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:41:04.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:41:04.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:41:04.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:41:04.926 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:41:05.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T16:41:05.301 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:41:05.301 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:41:05.302 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:41:05.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T16:41:05.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:41:05.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:41:05.844 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: seq 1 200 2020-09-08T16:41:05.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:05.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj1 /dev/null 2020-09-08T16:41:05.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:05.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj2 /dev/null 2020-09-08T16:41:06.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:06.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj3 /dev/null 2020-09-08T16:41:06.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:06.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj4 /dev/null 2020-09-08T16:41:06.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:06.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj5 /dev/null 2020-09-08T16:41:06.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:06.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj6 /dev/null 2020-09-08T16:41:06.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:06.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj7 /dev/null 2020-09-08T16:41:07.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:07.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj8 /dev/null 2020-09-08T16:41:07.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:07.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj9 /dev/null 2020-09-08T16:41:07.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:07.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj10 /dev/null 2020-09-08T16:41:07.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:07.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj11 /dev/null 2020-09-08T16:41:07.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:07.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj12 /dev/null 2020-09-08T16:41:07.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:07.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj13 /dev/null 2020-09-08T16:41:08.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:08.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj14 /dev/null 2020-09-08T16:41:08.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:08.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj15 /dev/null 2020-09-08T16:41:08.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:08.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj16 /dev/null 2020-09-08T16:41:08.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:08.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj17 /dev/null 2020-09-08T16:41:08.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:08.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj18 /dev/null 2020-09-08T16:41:09.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:09.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj19 /dev/null 2020-09-08T16:41:09.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:09.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj20 /dev/null 2020-09-08T16:41:09.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:09.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj21 /dev/null 2020-09-08T16:41:09.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:09.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj22 /dev/null 2020-09-08T16:41:09.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:09.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj23 /dev/null 2020-09-08T16:41:10.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:10.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj24 /dev/null 2020-09-08T16:41:10.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:10.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj25 /dev/null 2020-09-08T16:41:10.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:10.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj26 /dev/null 2020-09-08T16:41:10.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:10.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj27 /dev/null 2020-09-08T16:41:10.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:10.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj28 /dev/null 2020-09-08T16:41:10.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:10.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj29 /dev/null 2020-09-08T16:41:11.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:11.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj30 /dev/null 2020-09-08T16:41:11.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:11.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj31 /dev/null 2020-09-08T16:41:11.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:11.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj32 /dev/null 2020-09-08T16:41:11.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:11.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj33 /dev/null 2020-09-08T16:41:11.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:11.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj34 /dev/null 2020-09-08T16:41:12.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:12.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj35 /dev/null 2020-09-08T16:41:12.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:12.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj36 /dev/null 2020-09-08T16:41:12.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:12.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj37 /dev/null 2020-09-08T16:41:12.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:12.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj38 /dev/null 2020-09-08T16:41:12.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:12.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj39 /dev/null 2020-09-08T16:41:12.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:12.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj40 /dev/null 2020-09-08T16:41:13.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:13.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj41 /dev/null 2020-09-08T16:41:13.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:13.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj42 /dev/null 2020-09-08T16:41:13.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:13.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj43 /dev/null 2020-09-08T16:41:13.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:13.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj44 /dev/null 2020-09-08T16:41:13.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:13.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj45 /dev/null 2020-09-08T16:41:14.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:14.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj46 /dev/null 2020-09-08T16:41:14.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:14.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj47 /dev/null 2020-09-08T16:41:14.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:14.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj48 /dev/null 2020-09-08T16:41:14.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:14.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj49 /dev/null 2020-09-08T16:41:14.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:14.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj50 /dev/null 2020-09-08T16:41:15.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:15.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj51 /dev/null 2020-09-08T16:41:15.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:15.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj52 /dev/null 2020-09-08T16:41:15.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:15.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj53 /dev/null 2020-09-08T16:41:15.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:15.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj54 /dev/null 2020-09-08T16:41:15.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:15.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj55 /dev/null 2020-09-08T16:41:15.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:15.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj56 /dev/null 2020-09-08T16:41:16.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:16.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj57 /dev/null 2020-09-08T16:41:16.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:16.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj58 /dev/null 2020-09-08T16:41:16.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:16.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj59 /dev/null 2020-09-08T16:41:16.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:16.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj60 /dev/null 2020-09-08T16:41:16.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:16.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj61 /dev/null 2020-09-08T16:41:17.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:17.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj62 /dev/null 2020-09-08T16:41:17.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:17.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj63 /dev/null 2020-09-08T16:41:17.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:17.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj64 /dev/null 2020-09-08T16:41:17.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:17.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj65 /dev/null 2020-09-08T16:41:17.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:17.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj66 /dev/null 2020-09-08T16:41:17.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:17.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj67 /dev/null 2020-09-08T16:41:18.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:18.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj68 /dev/null 2020-09-08T16:41:18.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:18.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj69 /dev/null 2020-09-08T16:41:18.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:18.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj70 /dev/null 2020-09-08T16:41:18.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:18.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj71 /dev/null 2020-09-08T16:41:18.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:18.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj72 /dev/null 2020-09-08T16:41:19.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:19.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj73 /dev/null 2020-09-08T16:41:19.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:19.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj74 /dev/null 2020-09-08T16:41:19.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:19.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj75 /dev/null 2020-09-08T16:41:19.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:19.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj76 /dev/null 2020-09-08T16:41:19.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:19.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj77 /dev/null 2020-09-08T16:41:20.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:20.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj78 /dev/null 2020-09-08T16:41:20.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:20.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj79 /dev/null 2020-09-08T16:41:20.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:20.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj80 /dev/null 2020-09-08T16:41:20.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:20.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj81 /dev/null 2020-09-08T16:41:20.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:20.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj82 /dev/null 2020-09-08T16:41:20.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:20.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj83 /dev/null 2020-09-08T16:41:21.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:21.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj84 /dev/null 2020-09-08T16:41:21.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:21.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj85 /dev/null 2020-09-08T16:41:21.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:21.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj86 /dev/null 2020-09-08T16:41:21.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:21.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj87 /dev/null 2020-09-08T16:41:22.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:22.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj88 /dev/null 2020-09-08T16:41:22.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:22.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj89 /dev/null 2020-09-08T16:41:22.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:22.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj90 /dev/null 2020-09-08T16:41:22.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:22.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj91 /dev/null 2020-09-08T16:41:22.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:22.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj92 /dev/null 2020-09-08T16:41:22.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:22.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj93 /dev/null 2020-09-08T16:41:23.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:23.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj94 /dev/null 2020-09-08T16:41:23.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:23.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj95 /dev/null 2020-09-08T16:41:23.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:23.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj96 /dev/null 2020-09-08T16:41:23.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:23.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj97 /dev/null 2020-09-08T16:41:23.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:23.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj98 /dev/null 2020-09-08T16:41:24.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj99 /dev/null 2020-09-08T16:41:45.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj100 /dev/null 2020-09-08T16:41:45.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj101 /dev/null 2020-09-08T16:41:45.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj102 /dev/null 2020-09-08T16:41:45.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj103 /dev/null 2020-09-08T16:41:45.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj104 /dev/null 2020-09-08T16:41:45.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj105 /dev/null 2020-09-08T16:41:45.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj106 /dev/null 2020-09-08T16:41:45.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj107 /dev/null 2020-09-08T16:41:45.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj108 /dev/null 2020-09-08T16:41:45.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj109 /dev/null 2020-09-08T16:41:45.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj110 /dev/null 2020-09-08T16:41:45.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj111 /dev/null 2020-09-08T16:41:45.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj112 /dev/null 2020-09-08T16:41:45.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj113 /dev/null 2020-09-08T16:41:45.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj114 /dev/null 2020-09-08T16:41:45.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj115 /dev/null 2020-09-08T16:41:45.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj116 /dev/null 2020-09-08T16:41:45.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj117 /dev/null 2020-09-08T16:41:45.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj118 /dev/null 2020-09-08T16:41:45.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj119 /dev/null 2020-09-08T16:41:45.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj120 /dev/null 2020-09-08T16:41:45.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj121 /dev/null 2020-09-08T16:41:45.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj122 /dev/null 2020-09-08T16:41:45.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj123 /dev/null 2020-09-08T16:41:45.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj124 /dev/null 2020-09-08T16:41:45.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj125 /dev/null 2020-09-08T16:41:45.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj126 /dev/null 2020-09-08T16:41:45.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj127 /dev/null 2020-09-08T16:41:45.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj128 /dev/null 2020-09-08T16:41:45.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj129 /dev/null 2020-09-08T16:41:45.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj130 /dev/null 2020-09-08T16:41:45.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj131 /dev/null 2020-09-08T16:41:45.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj132 /dev/null 2020-09-08T16:41:45.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj133 /dev/null 2020-09-08T16:41:45.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj134 /dev/null 2020-09-08T16:41:45.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj135 /dev/null 2020-09-08T16:41:45.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj136 /dev/null 2020-09-08T16:41:45.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj137 /dev/null 2020-09-08T16:41:45.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj138 /dev/null 2020-09-08T16:41:45.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj139 /dev/null 2020-09-08T16:41:45.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj140 /dev/null 2020-09-08T16:41:45.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj141 /dev/null 2020-09-08T16:41:45.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj142 /dev/null 2020-09-08T16:41:45.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj143 /dev/null 2020-09-08T16:41:45.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj144 /dev/null 2020-09-08T16:41:45.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj145 /dev/null 2020-09-08T16:41:45.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj146 /dev/null 2020-09-08T16:41:45.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj147 /dev/null 2020-09-08T16:41:45.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj148 /dev/null 2020-09-08T16:41:45.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj149 /dev/null 2020-09-08T16:41:45.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj150 /dev/null 2020-09-08T16:41:45.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj151 /dev/null 2020-09-08T16:41:45.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj152 /dev/null 2020-09-08T16:41:45.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj153 /dev/null 2020-09-08T16:41:45.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj154 /dev/null 2020-09-08T16:41:45.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj155 /dev/null 2020-09-08T16:41:45.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj156 /dev/null 2020-09-08T16:41:45.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj157 /dev/null 2020-09-08T16:41:45.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj158 /dev/null 2020-09-08T16:41:45.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj159 /dev/null 2020-09-08T16:41:45.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj160 /dev/null 2020-09-08T16:41:45.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj161 /dev/null 2020-09-08T16:41:45.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj162 /dev/null 2020-09-08T16:41:45.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj163 /dev/null 2020-09-08T16:41:45.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj164 /dev/null 2020-09-08T16:41:45.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj165 /dev/null 2020-09-08T16:41:45.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj166 /dev/null 2020-09-08T16:41:45.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj167 /dev/null 2020-09-08T16:41:45.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj168 /dev/null 2020-09-08T16:41:45.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj169 /dev/null 2020-09-08T16:41:45.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj170 /dev/null 2020-09-08T16:41:45.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj171 /dev/null 2020-09-08T16:41:45.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj172 /dev/null 2020-09-08T16:41:45.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj173 /dev/null 2020-09-08T16:41:45.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj174 /dev/null 2020-09-08T16:41:45.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj175 /dev/null 2020-09-08T16:41:45.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj176 /dev/null 2020-09-08T16:41:45.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj177 /dev/null 2020-09-08T16:41:45.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj178 /dev/null 2020-09-08T16:41:45.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj179 /dev/null 2020-09-08T16:41:45.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj180 /dev/null 2020-09-08T16:41:45.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj181 /dev/null 2020-09-08T16:41:45.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj182 /dev/null 2020-09-08T16:41:45.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj183 /dev/null 2020-09-08T16:41:45.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj184 /dev/null 2020-09-08T16:41:45.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj185 /dev/null 2020-09-08T16:41:45.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj186 /dev/null 2020-09-08T16:41:45.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj187 /dev/null 2020-09-08T16:41:45.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj188 /dev/null 2020-09-08T16:41:45.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj189 /dev/null 2020-09-08T16:41:45.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj190 /dev/null 2020-09-08T16:41:45.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj191 /dev/null 2020-09-08T16:41:45.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj192 /dev/null 2020-09-08T16:41:45.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj193 /dev/null 2020-09-08T16:41:45.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj194 /dev/null 2020-09-08T16:41:45.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj195 /dev/null 2020-09-08T16:41:45.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj196 /dev/null 2020-09-08T16:41:45.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj197 /dev/null 2020-09-08T16:41:45.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj198 /dev/null 2020-09-08T16:41:45.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj199 /dev/null 2020-09-08T16:41:45.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2020-09-08T16:41:45.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj200 /dev/null 2020-09-08T16:41:45.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:535: TEST_backfill_ec_all_out: get_pg test obj1 2020-09-08T16:41:45.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1031: get_pg: local poolname=test 2020-09-08T16:41:45.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: local objectname=obj1 2020-09-08T16:41:45.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: ceph --format json osd map test obj1 2020-09-08T16:41:45.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: jq -r .pgid 2020-09-08T16:41:45.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:535: TEST_backfill_ec_all_out: local PG=1.0 2020-09-08T16:41:45.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:537: TEST_backfill_ec_all_out: get_primary test obj1 2020-09-08T16:41:45.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:41:45.551 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:41:45.551 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:41:45.551 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:41:45.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:537: TEST_backfill_ec_all_out: local primary=1 2020-09-08T16:41:45.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:539: TEST_backfill_ec_all_out: ceph osd set nobackfill 2020-09-08T16:41:45.552 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is set 2020-09-08T16:41:45.552 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:540: TEST_backfill_ec_all_out: get_osds test obj1 2020-09-08T16:41:45.552 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:959: get_osds: local poolname=test 2020-09-08T16:41:45.552 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:960: get_osds: local objectname=obj1 2020-09-08T16:41:45.552 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:963: get_osds: ceph --format json osd map test obj1 2020-09-08T16:41:45.553 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:963: get_osds: jq '.acting | .[]' 2020-09-08T16:41:45.553 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:963: get_osds: local 'osds=1 2020-09-08T16:41:45.553 INFO:tasks.workunit.client.0.smithi065.stderr:0 2020-09-08T16:41:45.554 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T16:41:45.555 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:965: get_osds: echo 1 0 2 2020-09-08T16:41:45.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:540: TEST_backfill_ec_all_out: for o in $(get_osds $poolname obj1) 2020-09-08T16:41:45.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:542: TEST_backfill_ec_all_out: ceph osd out osd.1 2020-09-08T16:41:45.556 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already out. 2020-09-08T16:41:45.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:540: TEST_backfill_ec_all_out: for o in $(get_osds $poolname obj1) 2020-09-08T16:41:45.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:542: TEST_backfill_ec_all_out: ceph osd out osd.0 2020-09-08T16:41:45.755 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already out. 2020-09-08T16:41:45.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:540: TEST_backfill_ec_all_out: for o in $(get_osds $poolname obj1) 2020-09-08T16:41:45.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:542: TEST_backfill_ec_all_out: ceph osd out osd.2 2020-09-08T16:41:46.548 INFO:tasks.workunit.client.0.smithi065.stderr:osd.2 is already out. 2020-09-08T16:41:46.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:545: TEST_backfill_ec_all_out: sleep 2 2020-09-08T16:41:48.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:546: TEST_backfill_ec_all_out: get_primary test obj1 2020-09-08T16:41:48.559 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:41:48.559 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:41:48.559 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:41:48.559 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:41:48.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:546: TEST_backfill_ec_all_out: primary=1 2020-09-08T16:41:48.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:547: TEST_backfill_ec_all_out: ceph osd unset nobackfill 2020-09-08T16:41:49.686 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is unset 2020-09-08T16:41:49.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:548: TEST_backfill_ec_all_out: ceph tell osd.1 get_latest_osdmap 2020-09-08T16:41:49.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:549: TEST_backfill_ec_all_out: ceph tell osd.1 debug kick_recovery_wq 0 2020-09-08T16:41:49.950 INFO:tasks.workunit.client.0.smithi065.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2020-09-08T16:41:49.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:550: TEST_backfill_ec_all_out: sleep 2 2020-09-08T16:41:51.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:552: TEST_backfill_ec_all_out: wait_for_clean 2020-09-08T16:41:51.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:41:51.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:41:51.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:41:51.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:41:51.961 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:41:51.962 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:41:51.962 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:41:51.963 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:41:51.963 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:41:51.963 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:41:52.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:41:52.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:41:52.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:41:52.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:41:52.069 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:41:52.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:41:52.512 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:41:52.513 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:41:52.513 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:41:52.513 INFO:tasks.workunit.client.0.smithi065.stderr:4' 2020-09-08T16:41:52.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:41:52.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:41:52.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:41:52.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836503 2020-09-08T16:41:52.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836503 2020-09-08T16:41:52.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836503' 2020-09-08T16:41:52.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:41:52.644 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:41:52.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672980 2020-09-08T16:41:52.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672980 2020-09-08T16:41:52.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836503 1-42949672980' 2020-09-08T16:41:52.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:41:52.777 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:41:52.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509459 2020-09-08T16:41:52.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509459 2020-09-08T16:41:52.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836503 1-42949672980 2-64424509459' 2020-09-08T16:41:52.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:41:52.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:41:53.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345937 2020-09-08T16:41:53.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345937 2020-09-08T16:41:53.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836503 1-42949672980 2-64424509459 3-85899345937' 2020-09-08T16:41:53.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:41:53.039 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:41:53.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182416 2020-09-08T16:41:53.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182416 2020-09-08T16:41:53.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836503 1-42949672980 2-64424509459 3-85899345937 4-107374182416' 2020-09-08T16:41:53.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:41:53.171 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836503 2020-09-08T16:41:53.171 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:41:53.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:41:53.172 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836503 2020-09-08T16:41:53.172 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:41:53.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836503 2020-09-08T16:41:53.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836503' 2020-09-08T16:41:53.174 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:41:53.174 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836503 2020-09-08T16:41:53.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836503 -lt 21474836503 2020-09-08T16:41:53.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:41:53.581 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672980 2020-09-08T16:41:53.581 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:41:53.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:41:53.582 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672980 2020-09-08T16:41:53.582 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:41:53.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672980 2020-09-08T16:41:53.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672980' 2020-09-08T16:41:53.583 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:41:53.584 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672980 2020-09-08T16:41:53.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672981 -lt 42949672980 2020-09-08T16:41:53.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:41:53.981 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509459 2020-09-08T16:41:53.981 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:41:53.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:41:53.982 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509459 2020-09-08T16:41:53.983 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:41:53.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509459 2020-09-08T16:41:53.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509459' 2020-09-08T16:41:53.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:41:53.984 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509459 2020-09-08T16:41:54.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509459 -lt 64424509459 2020-09-08T16:41:54.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:41:54.377 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345937 2020-09-08T16:41:54.377 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:41:54.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:41:54.378 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345937 2020-09-08T16:41:54.378 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:41:54.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345937 2020-09-08T16:41:54.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345937' 2020-09-08T16:41:54.380 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:41:54.380 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345937 2020-09-08T16:41:54.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345937 -lt 85899345937 2020-09-08T16:41:54.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:41:54.774 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182416 2020-09-08T16:41:54.774 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:41:54.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:41:54.775 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182416 2020-09-08T16:41:54.776 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:41:54.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182416 2020-09-08T16:41:54.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182416' 2020-09-08T16:41:54.777 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:41:54.777 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182416 2020-09-08T16:41:55.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182416 -lt 107374182416 2020-09-08T16:41:55.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:41:55.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:41:55.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:41:55.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T16:41:55.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:41:55.748 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:41:55.748 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:41:55.748 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:41:55.748 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:41:55.748 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:41:55.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:41:56.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:41:56.129 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:41:56.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:41:56.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:41:56.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:41:56.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T16:41:56.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T16:41:56.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T16:41:56.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:41:56.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:41:56.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:41:56.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:41:56.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:41:56.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:41:56.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:41:56.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:41:56.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:41:56.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:41:57.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:41:57.139 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:41:57.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:41:57.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:41:57.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:41:57.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:41:57.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:41:57.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:41:57.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:41:57.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:41:57.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:41:57.684 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:41:57.684 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:41:58.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=1 2020-09-08T16:41:58.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 1 '!=' null 2020-09-08T16:41:58.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:41:58.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:41:58.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:41:58.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:41:58.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:41:58.301 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:41:58.301 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:41:58.301 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:41:58.302 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:41:58.302 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:41:58.302 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:41:58.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:41:58.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:41:58.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:41:58.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:41:59.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:41:59.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:41:59.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:41:59.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:41:59.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:41:59.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:41:59.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:41:59.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:41:59.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:41:59.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:41:59.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:41:59.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:41:59.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:41:59.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:41:59.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:41:59.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:41:59.848 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:41:59.848 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:41:59.848 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:41:59.848 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:41:59.848 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:41:59.849 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:00.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:00.233 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:00.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:00.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:00.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:00.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:00.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:00.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:00.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:00.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:00.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:00.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:00.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:01.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:42:01.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:42:01.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:01.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:01.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:01.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:01.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:01.399 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:01.399 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:01.399 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:01.399 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:01.400 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:01.400 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:01.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:01.784 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:01.784 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:01.784 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:02.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:02.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:02.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:02.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:02.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:02.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:02.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:02.303 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:02.303 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:02.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T16:42:02.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T16:42:02.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:02.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:02.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:02.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:02.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:02.919 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:02.919 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:02.919 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:02.919 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:02.920 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:02.920 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:03.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:03.304 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:03.304 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:03.305 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:03.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:03.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:03.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:03.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:03.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:03.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:03.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:03.887 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:03.887 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:04.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:42:04.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:42:04.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:04.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:04.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:04.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:04.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:04.506 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:04.506 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:04.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:04.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:04.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:04.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:04.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:04.892 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:04.892 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:04.893 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:05.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:05.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:05.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:05.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:05.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:05.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:05.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:05.418 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:05.418 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:05.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T16:42:05.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T16:42:05.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:05.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:05.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:06.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:06.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:06.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:06.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:06.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:06.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:06.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:06.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:06.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:06.443 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:06.443 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:06.444 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:06.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:06.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:06.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:06.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:06.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:06.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:06.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:06.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:06.979 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:07.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T16:42:07.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T16:42:07.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:07.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:07.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:07.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:07.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:07.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:07.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:07.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:07.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:07.615 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:07.615 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:07.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:07.998 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:07.998 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:07.998 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:08.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:08.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:08.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:08.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:08.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:08.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:08.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:08.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:08.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:09.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T16:42:09.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T16:42:09.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:09.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:09.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:09.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:09.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:09.147 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:09.147 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:09.147 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:09.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:09.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:09.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:09.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:09.531 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:09.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:09.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:10.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:10.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:10.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:10.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:10.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:10.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:10.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:10.052 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:10.052 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:10.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:42:10.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:42:10.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:10.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:10.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:10.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:10.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:10.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:10.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:10.678 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:10.678 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:10.678 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:10.678 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:11.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:11.061 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:11.061 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:11.061 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:11.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:11.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:11.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:11.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:11.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:11.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:11.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:11.584 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:11.584 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:12.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:42:12.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:42:12.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:12.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:12.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:12.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:12.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:12.246 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:12.246 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:12.246 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:12.246 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:12.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:12.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:12.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:12.661 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:12.662 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:12.662 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:13.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:13.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:13.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:13.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:13.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:13.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:13.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:13.185 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:13.185 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:13.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:42:13.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:42:13.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:13.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:13.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:13.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:13.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:13.819 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:13.819 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:13.819 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:13.819 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:13.820 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:13.820 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:14.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:14.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:14.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:14.205 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:14.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:14.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:14.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:14.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:14.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:14.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:14.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:14.728 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:14.728 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:15.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:42:15.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:42:15.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:15.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:15.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:15.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:15.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:15.358 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:15.358 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:15.358 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:15.359 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:15.359 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:15.359 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:15.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:15.780 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:15.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:15.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:16.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:16.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:16.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:16.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:16.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:16.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:16.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:16.302 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:16.302 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:16.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:42:16.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:42:16.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:16.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:16.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:16.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:16.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:16.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:16.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:16.926 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:16.926 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:16.926 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:16.926 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:17.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:17.315 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:17.315 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:17.315 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:17.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:17.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:17.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:17.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:17.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:17.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:17.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:17.896 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:17.896 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:18.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:42:18.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:42:18.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:18.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:18.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:18.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:18.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:18.513 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:18.513 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:18.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:18.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:18.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:18.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:18.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:18.895 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:18.895 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:18.895 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:19.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:19.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:19.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:19.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:19.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:19.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:19.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:19.429 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:19.429 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:19.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:42:19.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:42:19.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:19.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:19.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:20.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:20.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:20.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:20.059 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:20.059 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:20.059 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:20.059 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:20.059 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:20.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:20.446 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:20.446 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:20.446 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:20.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:20.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:20.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:20.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:20.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:20.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:20.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:20.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:20.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:21.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:42:21.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:42:21.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:21.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:21.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:21.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:21.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:21.589 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:21.590 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:21.590 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:21.590 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:21.590 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:21.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:21.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:21.977 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:21.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:21.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:22.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:22.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:22.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:22.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:22.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:22.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:22.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:22.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:22.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:23.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:42:23.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:42:23.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:23.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:23.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:23.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:23.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:23.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:23.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:23.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:23.123 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:23.123 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:23.123 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:23.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:23.563 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:23.563 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:23.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:24.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:24.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:24.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:24.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:24.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:24.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:24.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:24.120 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:24.120 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:24.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:42:24.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:42:24.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:24.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:24.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:24.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:24.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:24.753 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:24.753 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:24.753 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:24.753 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:24.754 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:24.754 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:25.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:25.134 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:25.134 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:25.135 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:25.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:25.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:25.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:25.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:25.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:25.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:25.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:25.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:25.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:26.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:42:26.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:42:26.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:26.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:26.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:26.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:26.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:26.283 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:26.284 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:26.284 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:26.284 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:26.284 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:26.285 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:26.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:26.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:26.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:26.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:27.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:27.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:27.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:27.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:27.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:27.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:27.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:27.185 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:27.186 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:27.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:42:27.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:42:27.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:27.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:27.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:27.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:27.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:27.809 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:27.809 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:27.809 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:27.809 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:27.810 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:27.810 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:28.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:28.254 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:28.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:28.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:28.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:28.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:28.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:28.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:28.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:28.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:28.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:28.731 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:28.731 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:29.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:42:29.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:42:29.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:29.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:29.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:29.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:29.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:29.348 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:29.348 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:29.349 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:29.349 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:29.349 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:29.349 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:29.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:29.734 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:29.734 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:29.734 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:30.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:30.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:30.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:30.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:30.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:30.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:30.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:30.259 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:30.259 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:30.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:42:30.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:42:30.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:30.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:30.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:30.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:30.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:30.884 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:30.884 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:30.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:30.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:30.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:30.886 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:31.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:31.265 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:31.265 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:31.265 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:31.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:31.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:31.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:31.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:31.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:31.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:31.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:31.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:31.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:32.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T16:42:32.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T16:42:32.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:32.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:32.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:32.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:32.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:32.406 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:32.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:32.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:32.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:32.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:32.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:32.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:32.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:32.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:32.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:33.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:33.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:33.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:33.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:33.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:33.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:33.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:33.326 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:33.326 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:33.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:42:33.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:42:33.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:33.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:33.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:33.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:33.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:33.997 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:33.997 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:33.997 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:33.998 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:33.998 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:33.998 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:34.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:34.378 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:34.378 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:34.379 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:34.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:34.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:34.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:34.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:34.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:34.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:34.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:34.899 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:34.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:35.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:42:35.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:42:35.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:35.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:35.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:35.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:35.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:35.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:35.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:35.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:35.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:35.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:35.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:35.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:35.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:35.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:35.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:36.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:36.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:36.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:36.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:36.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:36.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:36.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:36.441 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:36.441 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:36.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:42:36.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:42:36.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:36.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:36.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:37.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:37.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:37.083 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:37.083 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:37.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:37.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:37.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:37.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:37.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:37.463 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:37.463 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:37.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:37.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:37.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:37.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:37.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:37.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:37.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:37.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:37.981 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:37.982 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:38.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:42:38.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:42:38.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:38.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:38.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:38.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:38.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:38.611 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:38.611 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:38.611 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:38.611 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:38.611 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:38.612 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:38.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:38.993 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:38.994 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:38.994 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:39.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:39.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:39.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:39.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:39.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:39.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:39.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:39.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:39.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:40.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:42:40.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:42:40.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:40.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:40.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:40.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:40.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:40.169 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:40.169 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:40.170 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:40.170 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:40.170 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:40.171 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:40.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:40.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:40.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:40.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:41.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:41.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:41.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:41.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:41.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:41.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:41.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:41.078 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:41.078 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:41.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:42:41.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:42:41.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:41.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:41.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:41.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:41.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:41.720 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:41.720 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:41.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:41.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:41.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:41.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:42.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:42.105 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:42.105 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:42.106 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:42.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:42.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:42.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:42.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:42.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:42.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:42.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:42.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:42.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:43.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:42:43.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:42:43.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:43.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:43.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:43.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:43.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:43.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:43.248 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:43.248 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:43.248 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:43.248 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:43.248 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:43.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:43.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:43.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:43.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:44.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:44.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:44.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:44.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:44.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:44.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:44.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:44.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:44.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:44.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:42:44.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:42:44.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:44.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:44.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:44.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:44.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:44.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:44.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:44.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:44.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:44.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:44.809 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:45.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:45.250 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:45.250 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:45.251 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:45.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:45.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:45.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:45.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:45.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:45.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:45.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:45.785 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:45.785 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:46.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:42:46.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:42:46.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:42:46.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:46.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:42:46.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:46.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:46.410 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:46.410 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:46.411 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:46.411 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:46.411 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:46.411 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:46.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:42:46.789 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:46.790 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:46.790 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:47.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:42:47.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:42:47.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:42:47.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:42:47.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:42:47.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:42:47.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:42:47.314 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:42:47.314 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:42:47.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T16:42:47.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T16:42:47.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 1 >= 13 )) 2020-09-08T16:42:47.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:42:47.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.2 2020-09-08T16:42:48.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:42:48.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:42:48.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:42:48.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:42:48.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:42:48.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:42:48.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:42:48.064 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:42:48.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T16:42:48.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:42:48.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:42:48.443 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:42:48.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T16:42:48.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:42:48.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:42:48.971 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:554: TEST_backfill_ec_all_out: expr 200 '*' 3 2020-09-08T16:42:48.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:554: TEST_backfill_ec_all_out: local misplaced=600 2020-09-08T16:42:48.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:555: TEST_backfill_ec_all_out: check td/osd-backfill-stats 1.0 1 erasure 0 0 600 200 2020-09-08T16:42:48.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2020-09-08T16:42:48.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:64: check: local PG=1.0 2020-09-08T16:42:48.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:65: check: local primary=1 2020-09-08T16:42:48.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:66: check: local type=erasure 2020-09-08T16:42:48.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:67: check: local degraded_start=0 2020-09-08T16:42:48.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:68: check: local degraded_end=0 2020-09-08T16:42:48.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:69: check: local misplaced_start=600 2020-09-08T16:42:48.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:70: check: local misplaced_end=200 2020-09-08T16:42:48.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:71: check: local primary_start= 2020-09-08T16:42:48.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:72: check: local primary_end= 2020-09-08T16:42:48.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:73: check: local check_setup=true 2020-09-08T16:42:48.976 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2020-09-08T16:42:48.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2020-09-08T16:42:48.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:76: check: '[' true = true ']' 2020-09-08T16:42:48.977 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log 2020-09-08T16:42:48.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2020-09-08T16:42:48.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2020-09-08T16:42:48.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: wc -w 2020-09-08T16:42:48.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2020-09-08T16:42:48.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:86: check: local 'addp= ' 2020-09-08T16:42:48.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:87: check: '[' erasure = erasure ']' 2020-09-08T16:42:48.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:89: check: addp=p 2020-09-08T16:42:48.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2020-09-08T16:42:48.992 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:42:48.992 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: tail -1 2020-09-08T16:42:48.993 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2020-09-08T16:42:49.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: UPACT='[4,3,NONE]/[1,0,2]' 2020-09-08T16:42:49.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:93: check: '[' -n '[4,3,NONE]/[1,0,2]' ']' 2020-09-08T16:42:49.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:96: check: local which=degraded 2020-09-08T16:42:49.017 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:42:49.018 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:42:49.018 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -F ' [4,3,NONE]/[1,0,2]p' 2020-09-08T16:42:49.018 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -v est 2020-09-08T16:42:49.018 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: head -1 2020-09-08T16:42:49.019 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:42:49.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: FIRST=0 2020-09-08T16:42:49.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:98: check: '[' -n 0 ']' 2020-09-08T16:42:49.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:99: check: below_margin 0 0 2020-09-08T16:42:49.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=0 2020-09-08T16:42:49.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T16:42:49.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=0 2020-09-08T16:42:49.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T16:42:49.025 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:42:49.025 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:42:49.025 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: tail -1 2020-09-08T16:42:49.025 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:42:49.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: LAST=0 2020-09-08T16:42:49.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:101: check: '[' -n 0 ']' 2020-09-08T16:42:49.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:102: check: above_margin 0 0 2020-09-08T16:42:49.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=0 2020-09-08T16:42:49.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T16:42:49.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=0 2020-09-08T16:42:49.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T16:42:49.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:105: check: which=misplaced 2020-09-08T16:42:49.039 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:42:49.039 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:42:49.039 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -F ' [4,3,NONE]/[1,0,2]p' 2020-09-08T16:42:49.039 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -v est 2020-09-08T16:42:49.039 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: head -1 2020-09-08T16:42:49.040 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:42:49.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: FIRST=600 2020-09-08T16:42:49.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:107: check: '[' -n 600 ']' 2020-09-08T16:42:49.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:108: check: below_margin 600 600 2020-09-08T16:42:49.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=600 2020-09-08T16:42:49.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T16:42:49.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=600 2020-09-08T16:42:49.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T16:42:49.045 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:42:49.045 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:42:49.045 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: tail -1 2020-09-08T16:42:49.046 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:42:49.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: LAST=202 2020-09-08T16:42:49.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:110: check: '[' -n 202 ']' 2020-09-08T16:42:49.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:111: check: above_margin 202 200 2020-09-08T16:42:49.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=202 2020-09-08T16:42:49.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T16:42:49.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=200 2020-09-08T16:42:49.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T16:42:49.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2020-09-08T16:42:49.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:557: TEST_backfill_ec_all_out: delete_pool test 2020-09-08T16:42:49.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test 2020-09-08T16:42:49.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2020-09-08T16:42:49.567 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' does not exist 2020-09-08T16:42:49.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:558: TEST_backfill_ec_all_out: kill_daemons td/osd-backfill-stats 2020-09-08T16:42:49.576 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:42:49.576 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:42:49.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:42:49.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:42:49.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:42:49.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:42:49.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2020-09-08T16:42:49.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T16:42:49.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:42:49.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T16:42:49.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:42:49.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:42:49.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:42:49.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:42:49.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:42:49.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:42:49.696 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:42:49.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:42:49.697 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:42:49.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:42:49.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:42:49.698 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:42:49.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:42:49.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:42:49.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:42:49.698 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:42:49.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:42:49.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:42:49.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T16:42:49.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:42:49.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:42:49.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:42:49.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T16:42:49.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:42:49.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:42:49.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:35: run: for func in $funcs 2020-09-08T16:42:49.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2020-09-08T16:42:49.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2020-09-08T16:42:49.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2020-09-08T16:42:49.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T16:42:49.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:42:49.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T16:42:49.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:42:49.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:42:49.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:42:49.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:42:49.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:42:49.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:42:49.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:42:49.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:42:49.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:42:49.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:42:49.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:42:49.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:42:49.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:42:49.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:42:49.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:42:49.725 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:42:49.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:42:49.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:42:49.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T16:42:49.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:42:49.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:42:49.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:42:49.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T16:42:49.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:42:49.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:42:49.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2020-09-08T16:42:49.730 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T16:42:49.730 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:42:49.730 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:42:49.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.482138 2020-09-08T16:42:49.731 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T16:42:49.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T16:42:49.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T16:42:49.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2020-09-08T16:42:49.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:37: run: TEST_backfill_ec_down_all_out td/osd-backfill-stats 2020-09-08T16:42:49.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:619: TEST_backfill_ec_down_all_out: local dir=td/osd-backfill-stats 2020-09-08T16:42:49.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:621: TEST_backfill_ec_down_all_out: run_mon td/osd-backfill-stats a 2020-09-08T16:42:49.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2020-09-08T16:42:49.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T16:42:49.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T16:42:49.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T16:42:49.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2020-09-08T16:42:49.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2020-09-08T16:42:50.025 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T16:42:50.025 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:42:50.026 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:42:50.026 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:42:50.026 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:42:50.026 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:42:50.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:42:50.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T16:42:50.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T16:42:50.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T16:42:50.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:42:50.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:42:50.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T16:42:50.212 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T16:42:50.212 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:42:50.212 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:42:50.212 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:42:50.212 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:42:50.213 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:42:50.213 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:42:50.213 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T16:42:50.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:42:50.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get fsid 2020-09-08T16:42:50.304 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T16:42:50.305 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:42:50.305 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:42:50.305 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T16:42:50.305 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T16:42:50.305 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:42:50.306 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:42:50.306 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:42:50.306 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:42:50.306 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:42:50.306 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:42:50.307 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T16:42:50.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:42:50.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get mon_host 2020-09-08T16:42:50.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:622: TEST_backfill_ec_down_all_out: run_mgr td/osd-backfill-stats x 2020-09-08T16:42:50.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-stats 2020-09-08T16:42:50.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T16:42:50.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T16:42:50.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T16:42:50.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-stats/x 2020-09-08T16:42:50.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T16:42:51.288 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T16:42:51.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:42:51.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:42:51.289 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:42:51.290 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:42:51.290 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:42:51.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:42:51.291 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:42:51.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:42:51.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:623: TEST_backfill_ec_down_all_out: run_osd td/osd-backfill-stats 0 2020-09-08T16:42:51.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:42:51.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:42:51.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T16:42:51.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:42:51.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/0 2020-09-08T16:42:51.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:42:51.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:42:51.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:42:51.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:42:51.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2020-09-08T16:42:51.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2020-09-08T16:42:51.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:42:51.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:42:51.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:42:51.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:42:51.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:42:51.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:42:51.319 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:42:51.319 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:42:51.320 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:42:51.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:42:51.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:42:51.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:42:51.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:42:51.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:42:51.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:42:51.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:42:51.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:42:51.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:42:51.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:42:51.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:42:51.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:42:51.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/0 2020-09-08T16:42:51.324 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:42:51.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=bd2496ac-0263-4889-ad00-9ca1e78f3377 2020-09-08T16:42:51.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 bd2496ac-0263-4889-ad00-9ca1e78f3377' 2020-09-08T16:42:51.324 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:42:51.325 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 bd2496ac-0263-4889-ad00-9ca1e78f3377 2020-09-08T16:42:51.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCLtFdfOE8dFBAAyrnAhJh5xWMpWK3RG5L0cQ== 2020-09-08T16:42:51.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCLtFdfOE8dFBAAyrnAhJh5xWMpWK3RG5L0cQ=="}' 2020-09-08T16:42:51.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new bd2496ac-0263-4889-ad00-9ca1e78f3377 -i td/osd-backfill-stats/0/new.json 2020-09-08T16:42:51.672 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:42:51.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/0/new.json 2020-09-08T16:42:51.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCLtFdfOE8dFBAAyrnAhJh5xWMpWK3RG5L0cQ== --osd-uuid bd2496ac-0263-4889-ad00-9ca1e78f3377 2020-09-08T16:42:51.708 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:42:51.713+0000 7fbf0bbcaec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:42:51.710 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:42:51.715+0000 7fbf0bbcaec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:42:51.711 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:42:51.716+0000 7fbf0bbcaec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:42:51.712 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:42:51.717+0000 7fbf0bbcaec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:42:51.712 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:42:51.717+0000 7fbf0bbcaec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:42:51.712 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:42:51.717+0000 7fbf0bbcaec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:42:51.767 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:42:51.772+0000 7fbf0bbcaec0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2020-09-08T16:42:56.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2020-09-08T16:42:56.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:42:56.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T16:42:56.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:42:56.259 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T16:42:56.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T16:42:56.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:42:56.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:42:56.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:42:56.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:42:56.802 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T16:42:56.822 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:42:56.827+0000 7f8eebcd7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:42:56.831 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:42:56.836+0000 7f8eebcd7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:42:56.832 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:42:56.837+0000 7f8eebcd7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:42:57.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T16:42:57.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:42:57.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T16:42:57.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:42:57.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:42:57.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:42:57.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:42:57.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:42:57.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:42:57.204 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:42:57.348 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:42:57.353+0000 7f8eebcd7ec0 -1 Falling back to public interface 2020-09-08T16:42:57.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:42:58.148 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:42:58.153+0000 7f8eebcd7ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T16:42:58.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:42:58.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:42:58.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:42:58.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:42:58.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:42:58.602 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:42:59.050 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/509626,v1:127.0.0.1:6803/509626] [v2:127.0.0.1:6804/509626,v1:127.0.0.1:6805/509626] exists,up bd2496ac-0263-4889-ad00-9ca1e78f3377 2020-09-08T16:42:59.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:42:59.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:42:59.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:42:59.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:624: TEST_backfill_ec_down_all_out: run_osd td/osd-backfill-stats 1 2020-09-08T16:42:59.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:42:59.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:42:59.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T16:42:59.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:42:59.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/1 2020-09-08T16:42:59.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:42:59.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:42:59.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:42:59.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:42:59.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2020-09-08T16:42:59.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2020-09-08T16:42:59.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:42:59.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:42:59.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:42:59.054 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:42:59.054 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:42:59.054 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:42:59.054 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:42:59.055 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:42:59.055 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:42:59.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:42:59.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:42:59.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:42:59.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:42:59.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:42:59.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:42:59.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:42:59.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:42:59.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:42:59.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:42:59.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:42:59.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:42:59.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/1 2020-09-08T16:42:59.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:42:59.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=0c8a9f39-18d0-4d9b-a923-a3e2b13ba98b 2020-09-08T16:42:59.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 0c8a9f39-18d0-4d9b-a923-a3e2b13ba98b' 2020-09-08T16:42:59.059 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:42:59.059 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 0c8a9f39-18d0-4d9b-a923-a3e2b13ba98b 2020-09-08T16:42:59.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCTtFdfFsVRBBAAjdD44X9oi8NpsBXnhUZL2A== 2020-09-08T16:42:59.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCTtFdfFsVRBBAAjdD44X9oi8NpsBXnhUZL2A=="}' 2020-09-08T16:42:59.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 0c8a9f39-18d0-4d9b-a923-a3e2b13ba98b -i td/osd-backfill-stats/1/new.json 2020-09-08T16:42:59.562 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:42:59.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/1/new.json 2020-09-08T16:42:59.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCTtFdfFsVRBBAAjdD44X9oi8NpsBXnhUZL2A== --osd-uuid 0c8a9f39-18d0-4d9b-a923-a3e2b13ba98b 2020-09-08T16:42:59.599 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:42:59.604+0000 7fc74f79eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:42:59.601 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:42:59.606+0000 7fc74f79eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:42:59.602 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:42:59.607+0000 7fc74f79eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:42:59.603 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:42:59.607+0000 7fc74f79eec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:42:59.603 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:42:59.607+0000 7fc74f79eec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:42:59.603 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:42:59.607+0000 7fc74f79eec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:42:59.655 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:42:59.660+0000 7fc74f79eec0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2020-09-08T16:43:04.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2020-09-08T16:43:04.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:43:04.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T16:43:04.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:43:04.203 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T16:43:04.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T16:43:04.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:43:04.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:43:04.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:43:04.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:43:04.744 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T16:43:04.766 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:04.771+0000 7f07de8b3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:04.769 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:04.774+0000 7f07de8b3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:04.770 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:04.775+0000 7f07de8b3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:05.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T16:43:05.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:43:05.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T16:43:05.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:43:05.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:43:05.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:43:05.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:43:05.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:43:05.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:43:05.137 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:43:05.286 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:05.291+0000 7f07de8b3ec0 -1 Falling back to public interface 2020-09-08T16:43:05.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:43:06.078 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:06.083+0000 7f07de8b3ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T16:43:06.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:43:06.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:43:06.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:43:06.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:43:06.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:43:06.552 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:43:06.954 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/510620,v1:127.0.0.1:6811/510620] [v2:127.0.0.1:6812/510620,v1:127.0.0.1:6813/510620] exists,up 0c8a9f39-18d0-4d9b-a923-a3e2b13ba98b 2020-09-08T16:43:06.954 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 02a42046-85ee-467c-81a3-85345b5e8509 2020-09-08T16:43:06.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:43:06.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:43:06.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:43:06.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:625: TEST_backfill_ec_down_all_out: run_osd td/osd-backfill-stats 2 2020-09-08T16:43:06.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:43:06.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:43:06.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T16:43:06.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:43:06.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/2 2020-09-08T16:43:06.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:43:06.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:43:06.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:43:06.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:43:06.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2020-09-08T16:43:06.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2020-09-08T16:43:06.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:43:06.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:43:06.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:43:06.958 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:43:06.958 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:43:06.958 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:43:06.959 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:43:06.959 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:43:06.959 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:43:06.959 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:43:06.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:43:06.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:43:06.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:43:06.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:43:06.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:43:06.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:43:06.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:43:06.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:43:06.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:43:06.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:43:06.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:43:06.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/2 2020-09-08T16:43:06.963 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:43:06.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=02a42046-85ee-467c-81a3-85345b5e8509 2020-09-08T16:43:06.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 02a42046-85ee-467c-81a3-85345b5e8509' 2020-09-08T16:43:06.965 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:43:06.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCatFdfLfATOhAACXSI+5Wv0/N0uumXQGURzQ== 2020-09-08T16:43:06.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCatFdfLfATOhAACXSI+5Wv0/N0uumXQGURzQ=="}' 2020-09-08T16:43:06.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 02a42046-85ee-467c-81a3-85345b5e8509 -i td/osd-backfill-stats/2/new.json 2020-09-08T16:43:07.505 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:43:07.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/2/new.json 2020-09-08T16:43:07.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCatFdfLfATOhAACXSI+5Wv0/N0uumXQGURzQ== --osd-uuid 02a42046-85ee-467c-81a3-85345b5e8509 2020-09-08T16:43:07.542 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:07.547+0000 7f0e1189fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:07.544 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:07.549+0000 7f0e1189fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:07.544 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:07.550+0000 7f0e1189fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:07.545 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:07.550+0000 7f0e1189fec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:43:07.545 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:07.550+0000 7f0e1189fec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:43:07.546 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:07.550+0000 7f0e1189fec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:43:07.594 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:07.599+0000 7f0e1189fec0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2020-09-08T16:43:11.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2020-09-08T16:43:11.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:43:11.786 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T16:43:11.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T16:43:11.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:43:12.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T16:43:12.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:43:12.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:43:12.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:43:12.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:43:12.324 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T16:43:12.346 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:12.349+0000 7f3226919ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:12.358 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:12.362+0000 7f3226919ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:12.359 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:12.363+0000 7f3226919ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:12.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T16:43:12.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:43:12.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T16:43:12.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:43:12.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:43:12.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:43:12.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:43:12.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:43:12.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:43:12.714 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:43:12.874 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:12.878+0000 7f3226919ec0 -1 Falling back to public interface 2020-09-08T16:43:13.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:43:13.675 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:13.679+0000 7f3226919ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T16:43:14.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:43:14.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:43:14.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:43:14.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:43:14.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:43:14.121 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:43:14.581 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/511614,v1:127.0.0.1:6819/511614] [v2:127.0.0.1:6820/511614,v1:127.0.0.1:6821/511614] exists,up 02a42046-85ee-467c-81a3-85345b5e8509 2020-09-08T16:43:14.582 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 f570ba32-0da8-4d05-8ad1-f741291ca2c2 2020-09-08T16:43:14.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:43:14.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:43:14.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:43:14.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:626: TEST_backfill_ec_down_all_out: run_osd td/osd-backfill-stats 3 2020-09-08T16:43:14.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:43:14.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:43:14.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T16:43:14.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:43:14.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/3 2020-09-08T16:43:14.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:43:14.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:43:14.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:43:14.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:43:14.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2020-09-08T16:43:14.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2020-09-08T16:43:14.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:43:14.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:43:14.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:43:14.588 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:43:14.589 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:43:14.589 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:43:14.590 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:43:14.590 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:43:14.591 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:43:14.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:43:14.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:43:14.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:43:14.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:43:14.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:43:14.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:43:14.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:43:14.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:43:14.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:43:14.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:43:14.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:43:14.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:43:14.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/3 2020-09-08T16:43:14.602 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:43:14.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=f570ba32-0da8-4d05-8ad1-f741291ca2c2 2020-09-08T16:43:14.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 f570ba32-0da8-4d05-8ad1-f741291ca2c2' 2020-09-08T16:43:14.603 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:43:14.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCitFdfpX7OIxAA3FWGjR6LpppuRG9RRDuvxA== 2020-09-08T16:43:14.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCitFdfpX7OIxAA3FWGjR6LpppuRG9RRDuvxA=="}' 2020-09-08T16:43:14.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new f570ba32-0da8-4d05-8ad1-f741291ca2c2 -i td/osd-backfill-stats/3/new.json 2020-09-08T16:43:15.091 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T16:43:15.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/3/new.json 2020-09-08T16:43:15.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCitFdfpX7OIxAA3FWGjR6LpppuRG9RRDuvxA== --osd-uuid f570ba32-0da8-4d05-8ad1-f741291ca2c2 2020-09-08T16:43:15.128 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:15.131+0000 7fa5efc7fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:15.129 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:15.133+0000 7fa5efc7fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:15.131 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:15.135+0000 7fa5efc7fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:15.131 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:15.135+0000 7fa5efc7fec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:43:15.132 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:15.135+0000 7fa5efc7fec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:43:15.132 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:15.135+0000 7fa5efc7fec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:43:15.225 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:15.229+0000 7fa5efc7fec0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2020-09-08T16:43:19.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2020-09-08T16:43:19.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:43:19.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T16:43:19.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:43:19.474 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T16:43:20.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T16:43:20.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:43:20.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:43:20.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:43:20.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:43:20.005 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T16:43:20.026 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:20.031+0000 7fce5df41ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:20.040 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:20.045+0000 7fce5df41ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:20.041 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:20.046+0000 7fce5df41ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:20.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T16:43:20.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:43:20.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T16:43:20.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:43:20.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:43:20.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:43:20.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:43:20.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:43:20.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:43:20.403 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:43:20.557 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:20.562+0000 7fce5df41ec0 -1 Falling back to public interface 2020-09-08T16:43:20.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:43:21.415 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:21.420+0000 7fce5df41ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T16:43:21.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:43:21.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:43:21.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:43:21.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:43:21.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:43:21.802 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:43:22.207 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/512608,v1:127.0.0.1:6827/512608] [v2:127.0.0.1:6828/512608,v1:127.0.0.1:6829/512608] exists,up f570ba32-0da8-4d05-8ad1-f741291ca2c2 2020-09-08T16:43:22.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:43:22.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:43:22.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:43:22.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:627: TEST_backfill_ec_down_all_out: run_osd td/osd-backfill-stats 4 2020-09-08T16:43:22.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:43:22.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:43:22.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=4 2020-09-08T16:43:22.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:43:22.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/4 2020-09-08T16:43:22.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:43:22.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:43:22.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:43:22.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:43:22.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2020-09-08T16:43:22.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2020-09-08T16:43:22.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:43:22.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:43:22.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:43:22.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:43:22.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:43:22.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:43:22.212 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:43:22.212 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:43:22.212 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:43:22.212 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:43:22.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:43:22.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:43:22.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:43:22.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:43:22.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:43:22.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:43:22.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:43:22.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:43:22.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:43:22.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:43:22.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:43:22.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/4 2020-09-08T16:43:22.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:43:22.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=22847e16-ea3f-4387-903f-ad4f1e2eb116 2020-09-08T16:43:22.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd4 22847e16-ea3f-4387-903f-ad4f1e2eb116' 2020-09-08T16:43:22.216 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:43:22.216 INFO:tasks.workunit.client.0.smithi065.stdout:add osd4 22847e16-ea3f-4387-903f-ad4f1e2eb116 2020-09-08T16:43:22.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCqtFdf9uykDRAAX6pqZgpDhTb3gDqxY0HBQw== 2020-09-08T16:43:22.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCqtFdf9uykDRAAX6pqZgpDhTb3gDqxY0HBQw=="}' 2020-09-08T16:43:22.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 22847e16-ea3f-4387-903f-ad4f1e2eb116 -i td/osd-backfill-stats/4/new.json 2020-09-08T16:43:22.723 INFO:tasks.workunit.client.0.smithi065.stdout:4 2020-09-08T16:43:22.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/4/new.json 2020-09-08T16:43:22.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 4 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCqtFdf9uykDRAAX6pqZgpDhTb3gDqxY0HBQw== --osd-uuid 22847e16-ea3f-4387-903f-ad4f1e2eb116 2020-09-08T16:43:22.760 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:22.765+0000 7f6967c0eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:22.762 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:22.767+0000 7f6967c0eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:22.763 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:22.768+0000 7f6967c0eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:22.763 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:22.769+0000 7f6967c0eec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:43:22.764 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:22.769+0000 7f6967c0eec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:43:22.764 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:22.769+0000 7f6967c0eec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:43:22.815 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:22.820+0000 7f6967c0eec0 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2020-09-08T16:43:27.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2020-09-08T16:43:27.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:43:27.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd4 key to auth repository 2020-09-08T16:43:27.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:43:27.259 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd4 key to auth repository 2020-09-08T16:43:27.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.4 2020-09-08T16:43:27.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 4 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:43:27.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:43:27.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:43:27.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:43:27.794 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.4 2020-09-08T16:43:27.815 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:27.820+0000 7f2babd63ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:27.839 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:27.844+0000 7f2babd63ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:27.840 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:27.846+0000 7f2babd63ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:28.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 4 2020-09-08T16:43:28.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:43:28.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=4 2020-09-08T16:43:28.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:43:28.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:43:28.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:43:28.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:43:28.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:43:28.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:43:28.192 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:43:28.357 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:28.362+0000 7f2babd63ec0 -1 Falling back to public interface 2020-09-08T16:43:28.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:43:29.131 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:29.136+0000 7f2babd63ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-09-08T16:43:29.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:43:29.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:43:29.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:43:29.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:43:29.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:43:29.606 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:43:30.094 INFO:tasks.workunit.client.0.smithi065.stdout:osd.4 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/513602,v1:127.0.0.1:6835/513602] [v2:127.0.0.1:6836/513602,v1:127.0.0.1:6837/513602] exists,up 22847e16-ea3f-4387-903f-ad4f1e2eb116 2020-09-08T16:43:30.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:43:30.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:43:30.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:43:30.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:628: TEST_backfill_ec_down_all_out: run_osd td/osd-backfill-stats 5 2020-09-08T16:43:30.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:43:30.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:43:30.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=5 2020-09-08T16:43:30.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:43:30.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/5 2020-09-08T16:43:30.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:43:30.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:43:30.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:43:30.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:43:30.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/5' 2020-09-08T16:43:30.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/5/journal' 2020-09-08T16:43:30.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:43:30.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:43:30.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:43:30.098 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:43:30.098 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:43:30.098 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:43:30.099 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:43:30.099 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:43:30.099 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:43:30.101 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:43:30.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:43:30.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:43:30.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:43:30.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:43:30.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:43:30.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:43:30.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:43:30.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:43:30.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:43:30.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:43:30.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:43:30.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/5 2020-09-08T16:43:30.103 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:43:30.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=248b7d51-0cac-49ef-a73e-72f7d015a59b 2020-09-08T16:43:30.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd5 248b7d51-0cac-49ef-a73e-72f7d015a59b' 2020-09-08T16:43:30.105 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:43:30.105 INFO:tasks.workunit.client.0.smithi065.stdout:add osd5 248b7d51-0cac-49ef-a73e-72f7d015a59b 2020-09-08T16:43:30.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCytFdfK+bdBhAAScqybcRYeOtOG0bFpvVkRQ== 2020-09-08T16:43:30.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCytFdfK+bdBhAAScqybcRYeOtOG0bFpvVkRQ=="}' 2020-09-08T16:43:30.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 248b7d51-0cac-49ef-a73e-72f7d015a59b -i td/osd-backfill-stats/5/new.json 2020-09-08T16:43:30.700 INFO:tasks.workunit.client.0.smithi065.stdout:5 2020-09-08T16:43:30.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/5/new.json 2020-09-08T16:43:30.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 5 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCytFdfK+bdBhAAScqybcRYeOtOG0bFpvVkRQ== --osd-uuid 248b7d51-0cac-49ef-a73e-72f7d015a59b 2020-09-08T16:43:30.737 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:30.742+0000 7f72f7a8dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:30.739 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:30.744+0000 7f72f7a8dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:30.739 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:30.745+0000 7f72f7a8dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:30.740 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:30.745+0000 7f72f7a8dec0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2020-09-08T16:43:30.741 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:30.745+0000 7f72f7a8dec0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2020-09-08T16:43:30.741 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:30.745+0000 7f72f7a8dec0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2020-09-08T16:43:30.808 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:30.813+0000 7f72f7a8dec0 -1 bluestore(td/osd-backfill-stats/5) _read_fsid unparsable uuid 2020-09-08T16:43:35.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/5/keyring 2020-09-08T16:43:35.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:43:35.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd5 key to auth repository 2020-09-08T16:43:35.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:43:35.021 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd5 key to auth repository 2020-09-08T16:43:35.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.5 2020-09-08T16:43:35.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 5 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:43:35.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:43:35.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:43:35.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:43:35.596 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.5 2020-09-08T16:43:35.618 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:35.623+0000 7ff4ec79dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:35.619 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:35.624+0000 7ff4ec79dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:35.620 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:35.625+0000 7ff4ec79dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:43:36.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 5 2020-09-08T16:43:36.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:43:36.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=5 2020-09-08T16:43:36.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:43:36.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:43:36.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:43:36.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:43:36.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:43:36.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T16:43:36.017 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:43:36.138 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:36.143+0000 7ff4ec79dec0 -1 Falling back to public interface 2020-09-08T16:43:36.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:43:36.943 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:43:36.947+0000 7ff4ec79dec0 -1 osd.5 0 log_to_monitors {default=true} 2020-09-08T16:43:37.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:43:54.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:43:54.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:43:54.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:43:54.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T16:43:54.710 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:43:54.743 INFO:tasks.workunit.client.0.smithi065.stdout:osd.5 up in weight 1 up_from 29 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/514596,v1:127.0.0.1:6843/514596] [v2:127.0.0.1:6844/514596,v1:127.0.0.1:6845/514596] exists,up 248b7d51-0cac-49ef-a73e-72f7d015a59b 2020-09-08T16:43:54.743 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836491 2020-09-08T16:43:54.744 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672969 2020-09-08T16:43:54.744 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509448 2020-09-08T16:43:54.744 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345927 2020-09-08T16:43:54.744 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 103079215109 2020-09-08T16:43:54.744 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 124554051587 2020-09-08T16:43:54.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:43:54.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:43:54.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:43:54.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:630: TEST_backfill_ec_down_all_out: ceph osd erasure-code-profile set myprofile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2020-09-08T16:43:54.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:631: TEST_backfill_ec_down_all_out: create_pool test 1 1 erasure myprofile 2020-09-08T16:43:54.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test 1 1 erasure myprofile 2020-09-08T16:43:54.746 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' already exists 2020-09-08T16:43:54.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:43:54.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:632: TEST_backfill_ec_down_all_out: ceph osd pool set test min_size 2 2020-09-08T16:43:54.747 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 min_size to 2 2020-09-08T16:43:54.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:634: TEST_backfill_ec_down_all_out: wait_for_clean 2020-09-08T16:43:54.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:43:54.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:43:54.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:43:54.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:43:54.748 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:43:54.748 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:43:54.748 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:43:54.748 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:43:54.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:43:54.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:43:54.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:43:54.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:43:54.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:43:54.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:43:54.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:43:54.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:43:54.750 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:43:54.750 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:43:54.751 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:43:54.751 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T16:43:54.751 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T16:43:54.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:43:54.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:43:54.751 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:43:54.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836491 2020-09-08T16:43:54.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836491 2020-09-08T16:43:54.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491' 2020-09-08T16:43:54.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:43:54.752 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:43:54.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672969 2020-09-08T16:43:54.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672969 2020-09-08T16:43:54.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969' 2020-09-08T16:43:54.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:43:54.753 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:43:54.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509448 2020-09-08T16:43:54.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509448 2020-09-08T16:43:54.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969 2-64424509448' 2020-09-08T16:43:54.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:43:54.754 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:43:54.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345927 2020-09-08T16:43:54.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345927 2020-09-08T16:43:54.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969 2-64424509448 3-85899345927' 2020-09-08T16:43:54.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:43:54.755 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:43:54.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=103079215109 2020-09-08T16:43:54.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 103079215109 2020-09-08T16:43:54.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969 2-64424509448 3-85899345927 4-103079215109' 2020-09-08T16:43:54.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:43:54.756 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T16:43:54.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=124554051587 2020-09-08T16:43:54.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 124554051587 2020-09-08T16:43:54.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969 2-64424509448 3-85899345927 4-103079215109 5-124554051587' 2020-09-08T16:43:54.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:43:54.757 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836491 2020-09-08T16:43:54.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:43:54.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:43:54.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836491 2020-09-08T16:43:54.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:43:54.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836491 2020-09-08T16:43:54.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2020-09-08T16:43:54.759 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:43:54.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836489 -lt 21474836491 2020-09-08T16:43:54.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:43:54.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:43:54.760 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:43:54.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836491 -lt 21474836491 2020-09-08T16:43:54.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:43:54.760 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672969 2020-09-08T16:43:54.760 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:43:54.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:43:54.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672969 2020-09-08T16:43:54.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:43:54.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672969 2020-09-08T16:43:54.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672969' 2020-09-08T16:43:54.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:43:54.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672970 -lt 42949672969 2020-09-08T16:43:54.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:43:54.762 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509448 2020-09-08T16:43:54.762 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:43:54.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:43:54.763 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509448 2020-09-08T16:43:54.763 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:43:54.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509448 2020-09-08T16:43:54.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509448' 2020-09-08T16:43:54.763 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:43:54.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509448 -lt 64424509448 2020-09-08T16:43:54.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:43:54.764 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345927 2020-09-08T16:43:54.764 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:43:54.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:43:54.765 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345927 2020-09-08T16:43:54.765 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:43:54.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345927 2020-09-08T16:43:54.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345927' 2020-09-08T16:43:54.765 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:43:54.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345928 -lt 85899345927 2020-09-08T16:43:54.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:43:54.766 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-103079215109 2020-09-08T16:43:54.766 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:43:54.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:43:54.767 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-103079215109 2020-09-08T16:43:54.767 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:43:54.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=103079215109 2020-09-08T16:43:54.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 103079215109' 2020-09-08T16:43:54.767 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:43:54.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 103079215109 -lt 103079215109 2020-09-08T16:43:54.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:43:54.768 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-124554051587 2020-09-08T16:43:54.768 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:43:54.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T16:43:54.768 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-124554051587 2020-09-08T16:43:54.769 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:43:54.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=124554051587 2020-09-08T16:43:54.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 124554051587' 2020-09-08T16:43:54.769 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T16:43:54.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 124554051588 -lt 124554051587 2020-09-08T16:43:54.770 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:43:54.770 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:43:54.770 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:43:54.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T16:43:54.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:43:54.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:43:54.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:43:54.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:43:54.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:43:54.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:43:54.772 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:43:54.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T16:43:54.772 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:43:54.772 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:43:54.772 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:43:54.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T16:43:54.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:43:54.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:43:54.773 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: seq 1 200 2020-09-08T16:43:54.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj1 /dev/null 2020-09-08T16:43:54.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj2 /dev/null 2020-09-08T16:43:54.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj3 /dev/null 2020-09-08T16:43:54.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj4 /dev/null 2020-09-08T16:43:54.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj5 /dev/null 2020-09-08T16:43:54.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj6 /dev/null 2020-09-08T16:43:54.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj7 /dev/null 2020-09-08T16:43:54.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj8 /dev/null 2020-09-08T16:43:54.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj9 /dev/null 2020-09-08T16:43:54.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj10 /dev/null 2020-09-08T16:43:54.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj11 /dev/null 2020-09-08T16:43:54.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj12 /dev/null 2020-09-08T16:43:54.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj13 /dev/null 2020-09-08T16:43:54.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj14 /dev/null 2020-09-08T16:43:54.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj15 /dev/null 2020-09-08T16:43:54.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj16 /dev/null 2020-09-08T16:43:54.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj17 /dev/null 2020-09-08T16:43:54.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj18 /dev/null 2020-09-08T16:43:54.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj19 /dev/null 2020-09-08T16:43:54.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj20 /dev/null 2020-09-08T16:43:54.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj21 /dev/null 2020-09-08T16:43:54.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj22 /dev/null 2020-09-08T16:43:54.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj23 /dev/null 2020-09-08T16:43:54.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj24 /dev/null 2020-09-08T16:43:54.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj25 /dev/null 2020-09-08T16:43:54.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj26 /dev/null 2020-09-08T16:43:54.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj27 /dev/null 2020-09-08T16:43:54.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj28 /dev/null 2020-09-08T16:43:54.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj29 /dev/null 2020-09-08T16:43:54.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj30 /dev/null 2020-09-08T16:43:54.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj31 /dev/null 2020-09-08T16:43:54.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj32 /dev/null 2020-09-08T16:43:54.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj33 /dev/null 2020-09-08T16:43:54.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj34 /dev/null 2020-09-08T16:43:54.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj35 /dev/null 2020-09-08T16:43:54.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj36 /dev/null 2020-09-08T16:43:54.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj37 /dev/null 2020-09-08T16:43:54.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj38 /dev/null 2020-09-08T16:43:54.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj39 /dev/null 2020-09-08T16:43:54.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj40 /dev/null 2020-09-08T16:43:54.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj41 /dev/null 2020-09-08T16:43:54.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj42 /dev/null 2020-09-08T16:43:54.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj43 /dev/null 2020-09-08T16:43:54.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:54.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj44 /dev/null 2020-09-08T16:43:55.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:55.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj45 /dev/null 2020-09-08T16:43:55.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:55.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj46 /dev/null 2020-09-08T16:43:55.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:55.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj47 /dev/null 2020-09-08T16:43:55.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:55.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj48 /dev/null 2020-09-08T16:43:55.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:55.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj49 /dev/null 2020-09-08T16:43:56.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:56.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj50 /dev/null 2020-09-08T16:43:56.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:56.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj51 /dev/null 2020-09-08T16:43:56.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:56.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj52 /dev/null 2020-09-08T16:43:56.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:56.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj53 /dev/null 2020-09-08T16:43:56.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:56.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj54 /dev/null 2020-09-08T16:43:56.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:56.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj55 /dev/null 2020-09-08T16:43:57.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:57.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj56 /dev/null 2020-09-08T16:43:57.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:57.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj57 /dev/null 2020-09-08T16:43:57.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:57.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj58 /dev/null 2020-09-08T16:43:57.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:57.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj59 /dev/null 2020-09-08T16:43:57.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:57.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj60 /dev/null 2020-09-08T16:43:57.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:57.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj61 /dev/null 2020-09-08T16:43:58.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:58.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj62 /dev/null 2020-09-08T16:43:58.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:58.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj63 /dev/null 2020-09-08T16:43:58.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:58.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj64 /dev/null 2020-09-08T16:43:58.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:58.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj65 /dev/null 2020-09-08T16:43:58.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:58.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj66 /dev/null 2020-09-08T16:43:58.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:58.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj67 /dev/null 2020-09-08T16:43:59.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:59.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj68 /dev/null 2020-09-08T16:43:59.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:59.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj69 /dev/null 2020-09-08T16:43:59.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:59.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj70 /dev/null 2020-09-08T16:43:59.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:59.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj71 /dev/null 2020-09-08T16:43:59.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:43:59.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj72 /dev/null 2020-09-08T16:44:00.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:00.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj73 /dev/null 2020-09-08T16:44:00.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:00.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj74 /dev/null 2020-09-08T16:44:00.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:00.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj75 /dev/null 2020-09-08T16:44:00.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:00.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj76 /dev/null 2020-09-08T16:44:00.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:00.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj77 /dev/null 2020-09-08T16:44:01.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:01.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj78 /dev/null 2020-09-08T16:44:01.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:01.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj79 /dev/null 2020-09-08T16:44:01.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:01.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj80 /dev/null 2020-09-08T16:44:01.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:01.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj81 /dev/null 2020-09-08T16:44:01.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:01.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj82 /dev/null 2020-09-08T16:44:01.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:01.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj83 /dev/null 2020-09-08T16:44:02.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:02.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj84 /dev/null 2020-09-08T16:44:02.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:02.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj85 /dev/null 2020-09-08T16:44:02.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:02.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj86 /dev/null 2020-09-08T16:44:02.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:02.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj87 /dev/null 2020-09-08T16:44:02.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:02.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj88 /dev/null 2020-09-08T16:44:02.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:02.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj89 /dev/null 2020-09-08T16:44:03.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:03.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj90 /dev/null 2020-09-08T16:44:03.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:03.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj91 /dev/null 2020-09-08T16:44:03.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:03.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj92 /dev/null 2020-09-08T16:44:03.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:03.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj93 /dev/null 2020-09-08T16:44:03.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:03.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj94 /dev/null 2020-09-08T16:44:03.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:03.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj95 /dev/null 2020-09-08T16:44:04.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:04.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj96 /dev/null 2020-09-08T16:44:04.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:04.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj97 /dev/null 2020-09-08T16:44:04.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:04.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj98 /dev/null 2020-09-08T16:44:04.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:04.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj99 /dev/null 2020-09-08T16:44:04.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:04.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj100 /dev/null 2020-09-08T16:44:04.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:04.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj101 /dev/null 2020-09-08T16:44:05.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:05.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj102 /dev/null 2020-09-08T16:44:05.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:05.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj103 /dev/null 2020-09-08T16:44:05.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:05.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj104 /dev/null 2020-09-08T16:44:05.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:05.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj105 /dev/null 2020-09-08T16:44:05.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:05.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj106 /dev/null 2020-09-08T16:44:05.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:05.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj107 /dev/null 2020-09-08T16:44:06.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:06.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj108 /dev/null 2020-09-08T16:44:06.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:06.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj109 /dev/null 2020-09-08T16:44:06.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:06.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj110 /dev/null 2020-09-08T16:44:06.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:06.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj111 /dev/null 2020-09-08T16:44:06.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:06.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj112 /dev/null 2020-09-08T16:44:06.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:06.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj113 /dev/null 2020-09-08T16:44:07.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:07.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj114 /dev/null 2020-09-08T16:44:07.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:07.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj115 /dev/null 2020-09-08T16:44:07.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:07.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj116 /dev/null 2020-09-08T16:44:07.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:07.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj117 /dev/null 2020-09-08T16:44:07.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:07.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj118 /dev/null 2020-09-08T16:44:07.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:07.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj119 /dev/null 2020-09-08T16:44:08.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:08.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj120 /dev/null 2020-09-08T16:44:08.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:08.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj121 /dev/null 2020-09-08T16:44:08.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:08.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj122 /dev/null 2020-09-08T16:44:08.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:08.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj123 /dev/null 2020-09-08T16:44:08.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:08.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj124 /dev/null 2020-09-08T16:44:09.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:09.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj125 /dev/null 2020-09-08T16:44:09.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:09.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj126 /dev/null 2020-09-08T16:44:09.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:09.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj127 /dev/null 2020-09-08T16:44:09.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:09.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj128 /dev/null 2020-09-08T16:44:09.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:09.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj129 /dev/null 2020-09-08T16:44:09.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:09.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj130 /dev/null 2020-09-08T16:44:10.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:10.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj131 /dev/null 2020-09-08T16:44:10.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:10.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj132 /dev/null 2020-09-08T16:44:10.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:10.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj133 /dev/null 2020-09-08T16:44:10.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:10.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj134 /dev/null 2020-09-08T16:44:10.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:10.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj135 /dev/null 2020-09-08T16:44:10.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:10.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj136 /dev/null 2020-09-08T16:44:11.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:11.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj137 /dev/null 2020-09-08T16:44:11.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:11.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj138 /dev/null 2020-09-08T16:44:11.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:11.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj139 /dev/null 2020-09-08T16:44:11.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:11.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj140 /dev/null 2020-09-08T16:44:11.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:11.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj141 /dev/null 2020-09-08T16:44:11.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:11.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj142 /dev/null 2020-09-08T16:44:12.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:12.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj143 /dev/null 2020-09-08T16:44:12.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:12.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj144 /dev/null 2020-09-08T16:44:12.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:12.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj145 /dev/null 2020-09-08T16:44:12.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:12.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj146 /dev/null 2020-09-08T16:44:12.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:12.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj147 /dev/null 2020-09-08T16:44:12.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:12.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj148 /dev/null 2020-09-08T16:44:13.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:13.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj149 /dev/null 2020-09-08T16:44:13.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:13.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj150 /dev/null 2020-09-08T16:44:13.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:13.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj151 /dev/null 2020-09-08T16:44:13.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:13.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj152 /dev/null 2020-09-08T16:44:13.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:13.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj153 /dev/null 2020-09-08T16:44:13.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:13.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj154 /dev/null 2020-09-08T16:44:14.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:14.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj155 /dev/null 2020-09-08T16:44:14.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:14.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj156 /dev/null 2020-09-08T16:44:14.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:14.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj157 /dev/null 2020-09-08T16:44:14.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:14.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj158 /dev/null 2020-09-08T16:44:14.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:14.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj159 /dev/null 2020-09-08T16:44:14.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:14.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj160 /dev/null 2020-09-08T16:44:15.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:15.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj161 /dev/null 2020-09-08T16:44:15.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:15.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj162 /dev/null 2020-09-08T16:44:15.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:15.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj163 /dev/null 2020-09-08T16:44:15.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:15.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj164 /dev/null 2020-09-08T16:44:15.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:15.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj165 /dev/null 2020-09-08T16:44:16.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:16.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj166 /dev/null 2020-09-08T16:44:16.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:16.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj167 /dev/null 2020-09-08T16:44:16.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:16.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj168 /dev/null 2020-09-08T16:44:16.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:16.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj169 /dev/null 2020-09-08T16:44:16.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:16.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj170 /dev/null 2020-09-08T16:44:16.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:16.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj171 /dev/null 2020-09-08T16:44:17.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:17.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj172 /dev/null 2020-09-08T16:44:17.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:17.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj173 /dev/null 2020-09-08T16:44:17.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:17.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj174 /dev/null 2020-09-08T16:44:17.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:17.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj175 /dev/null 2020-09-08T16:44:17.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:17.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj176 /dev/null 2020-09-08T16:44:17.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:17.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj177 /dev/null 2020-09-08T16:44:18.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:18.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj178 /dev/null 2020-09-08T16:44:18.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:18.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj179 /dev/null 2020-09-08T16:44:18.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:18.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj180 /dev/null 2020-09-08T16:44:18.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:18.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj181 /dev/null 2020-09-08T16:44:18.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:18.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj182 /dev/null 2020-09-08T16:44:18.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:18.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj183 /dev/null 2020-09-08T16:44:19.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:19.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj184 /dev/null 2020-09-08T16:44:19.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:19.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj185 /dev/null 2020-09-08T16:44:19.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:19.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj186 /dev/null 2020-09-08T16:44:19.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:19.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj187 /dev/null 2020-09-08T16:44:19.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:19.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj188 /dev/null 2020-09-08T16:44:19.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:19.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj189 /dev/null 2020-09-08T16:44:20.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:20.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj190 /dev/null 2020-09-08T16:44:20.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:20.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj191 /dev/null 2020-09-08T16:44:20.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:20.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj192 /dev/null 2020-09-08T16:44:20.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:20.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj193 /dev/null 2020-09-08T16:44:20.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:20.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj194 /dev/null 2020-09-08T16:44:21.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:21.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj195 /dev/null 2020-09-08T16:44:21.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:21.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj196 /dev/null 2020-09-08T16:44:21.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:21.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj197 /dev/null 2020-09-08T16:44:21.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:21.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj198 /dev/null 2020-09-08T16:44:21.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:21.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj199 /dev/null 2020-09-08T16:44:21.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2020-09-08T16:44:21.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj200 /dev/null 2020-09-08T16:44:22.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:641: TEST_backfill_ec_down_all_out: get_pg test obj1 2020-09-08T16:44:22.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1031: get_pg: local poolname=test 2020-09-08T16:44:22.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: local objectname=obj1 2020-09-08T16:44:22.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: ceph --format json osd map test obj1 2020-09-08T16:44:22.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: jq -r .pgid 2020-09-08T16:44:22.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:641: TEST_backfill_ec_down_all_out: local PG=1.0 2020-09-08T16:44:22.520 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:643: TEST_backfill_ec_down_all_out: get_primary test obj1 2020-09-08T16:44:22.520 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:44:22.520 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:44:22.520 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:44:22.520 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:44:22.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:643: TEST_backfill_ec_down_all_out: local primary=1 2020-09-08T16:44:22.935 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:644: TEST_backfill_ec_down_all_out: get_not_primary test obj1 2020-09-08T16:44:22.935 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1167: get_not_primary: local poolname=test 2020-09-08T16:44:22.935 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: get_not_primary: local objectname=obj1 2020-09-08T16:44:22.935 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: get_primary test obj1 2020-09-08T16:44:22.936 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:44:22.936 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:44:22.936 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:44:22.936 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:44:23.371 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: local primary=1 2020-09-08T16:44:23.372 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1171: get_not_primary: ceph --format json osd map test obj1 2020-09-08T16:44:23.372 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1172: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2020-09-08T16:44:23.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:644: TEST_backfill_ec_down_all_out: local otherosd=0 2020-09-08T16:44:23.774 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:645: TEST_backfill_ec_down_all_out: get_osds test obj1 2020-09-08T16:44:23.774 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:959: get_osds: local poolname=test 2020-09-08T16:44:23.774 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:960: get_osds: local objectname=obj1 2020-09-08T16:44:23.775 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:963: get_osds: ceph --format json osd map test obj1 2020-09-08T16:44:23.775 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:963: get_osds: jq '.acting | .[]' 2020-09-08T16:44:24.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:963: get_osds: local 'osds=1 2020-09-08T16:44:24.168 INFO:tasks.workunit.client.0.smithi065.stderr:0 2020-09-08T16:44:24.168 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T16:44:24.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:965: get_osds: echo 1 0 2 2020-09-08T16:44:24.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:645: TEST_backfill_ec_down_all_out: local 'allosds=1 0 2' 2020-09-08T16:44:24.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:647: TEST_backfill_ec_down_all_out: ceph osd set nobackfill 2020-09-08T16:44:24.874 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is set 2020-09-08T16:44:24.883 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:648: TEST_backfill_ec_down_all_out: cat td/osd-backfill-stats/osd.0.pid 2020-09-08T16:44:24.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:648: TEST_backfill_ec_down_all_out: kill 509626 2020-09-08T16:44:24.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:649: TEST_backfill_ec_down_all_out: ceph osd down osd.0 2020-09-08T16:44:25.299 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already down. 2020-09-08T16:44:25.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:650: TEST_backfill_ec_down_all_out: for o in $allosds 2020-09-08T16:44:25.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:652: TEST_backfill_ec_down_all_out: ceph osd out osd.1 2020-09-08T16:44:25.927 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already out. 2020-09-08T16:44:25.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:650: TEST_backfill_ec_down_all_out: for o in $allosds 2020-09-08T16:44:25.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:652: TEST_backfill_ec_down_all_out: ceph osd out osd.0 2020-09-08T16:44:26.935 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already out. 2020-09-08T16:44:26.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:650: TEST_backfill_ec_down_all_out: for o in $allosds 2020-09-08T16:44:26.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:652: TEST_backfill_ec_down_all_out: ceph osd out osd.2 2020-09-08T16:44:27.850 INFO:tasks.workunit.client.0.smithi065.stderr:osd.2 is already out. 2020-09-08T16:44:27.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:655: TEST_backfill_ec_down_all_out: sleep 2 2020-09-08T16:44:29.861 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:656: TEST_backfill_ec_down_all_out: get_primary test obj1 2020-09-08T16:44:29.862 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:44:29.862 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:44:29.862 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:44:29.862 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:44:30.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:656: TEST_backfill_ec_down_all_out: primary=1 2020-09-08T16:44:30.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:657: TEST_backfill_ec_down_all_out: ceph osd unset nobackfill 2020-09-08T16:44:30.998 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is unset 2020-09-08T16:44:31.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:658: TEST_backfill_ec_down_all_out: ceph tell osd.1 get_latest_osdmap 2020-09-08T16:44:31.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:659: TEST_backfill_ec_down_all_out: ceph tell osd.1 debug kick_recovery_wq 0 2020-09-08T16:44:31.264 INFO:tasks.workunit.client.0.smithi065.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2020-09-08T16:44:31.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:660: TEST_backfill_ec_down_all_out: sleep 2 2020-09-08T16:44:33.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:661: TEST_backfill_ec_down_all_out: flush_pg_stats 2020-09-08T16:44:33.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:44:33.274 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:44:33.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:44:33.686 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:44:33.686 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:44:33.686 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:44:33.687 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T16:44:33.687 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T16:44:33.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:44:33.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:44:33.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:44:33.776 INFO:tasks.workunit.client.0.smithi065.stderr:Error ENXIO: problem getting command descriptions from osd.0 2020-09-08T16:44:33.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq= 2020-09-08T16:44:33.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z '' 2020-09-08T16:44:33.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: continue 2020-09-08T16:44:33.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:44:33.779 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:44:33.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672982 2020-09-08T16:44:33.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672982 2020-09-08T16:44:33.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 1-42949672982' 2020-09-08T16:44:33.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:44:33.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:44:34.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509460 2020-09-08T16:44:34.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509460 2020-09-08T16:44:34.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 1-42949672982 2-64424509460' 2020-09-08T16:44:34.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:44:34.041 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:44:34.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345940 2020-09-08T16:44:34.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345940 2020-09-08T16:44:34.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 1-42949672982 2-64424509460 3-85899345940' 2020-09-08T16:44:34.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:44:34.172 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:44:34.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=103079215121 2020-09-08T16:44:34.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 103079215121 2020-09-08T16:44:34.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 1-42949672982 2-64424509460 3-85899345940 4-103079215121' 2020-09-08T16:44:34.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:44:34.304 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T16:44:34.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=124554051600 2020-09-08T16:44:34.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 124554051600 2020-09-08T16:44:34.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 1-42949672982 2-64424509460 3-85899345940 4-103079215121 5-124554051600' 2020-09-08T16:44:34.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:44:34.435 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672982 2020-09-08T16:44:34.436 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:44:34.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:44:34.436 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672982 2020-09-08T16:44:34.436 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:44:34.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672982 2020-09-08T16:44:34.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672982' 2020-09-08T16:44:34.437 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:44:34.438 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672982 2020-09-08T16:44:34.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672980 -lt 42949672982 2020-09-08T16:44:34.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:44:35.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:44:35.835 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:44:36.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672982 -lt 42949672982 2020-09-08T16:44:36.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:44:36.238 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509460 2020-09-08T16:44:36.238 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:44:36.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:44:36.239 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509460 2020-09-08T16:44:36.239 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:44:36.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509460 2020-09-08T16:44:36.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509460' 2020-09-08T16:44:36.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:44:36.241 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509460 2020-09-08T16:44:36.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509461 -lt 64424509460 2020-09-08T16:44:36.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:44:36.633 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345940 2020-09-08T16:44:36.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:44:36.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:44:36.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345940 2020-09-08T16:44:36.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:44:36.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345940 2020-09-08T16:44:36.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345940' 2020-09-08T16:44:36.636 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345940 2020-09-08T16:44:36.636 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:44:37.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345940 -lt 85899345940 2020-09-08T16:44:37.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:44:37.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-103079215121 2020-09-08T16:44:37.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:44:37.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:44:37.031 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-103079215121 2020-09-08T16:44:37.032 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:44:37.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=103079215121 2020-09-08T16:44:37.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 103079215121' 2020-09-08T16:44:37.033 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:44:37.033 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 103079215121 2020-09-08T16:44:37.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 103079215122 -lt 103079215121 2020-09-08T16:44:37.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:44:37.428 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-124554051600 2020-09-08T16:44:37.428 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:44:37.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T16:44:37.429 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-124554051600 2020-09-08T16:44:37.429 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:44:37.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=124554051600 2020-09-08T16:44:37.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 124554051600' 2020-09-08T16:44:37.436 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T16:44:37.436 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 124554051600 2020-09-08T16:44:37.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 124554051600 -lt 124554051600 2020-09-08T16:44:37.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:666: TEST_backfill_ec_down_all_out: true 2020-09-08T16:44:37.833 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:669: TEST_backfill_ec_down_all_out: ceph --format json pg dump pgs 2020-09-08T16:44:37.833 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:670: TEST_backfill_ec_down_all_out: jq '.pg_stats | [.[] | .state | select(. == "incomplete")] | length' 2020-09-08T16:44:38.206 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:44:38.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:669: TEST_backfill_ec_down_all_out: test 0 -ne 0 2020-09-08T16:44:38.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:674: TEST_backfill_ec_down_all_out: break 2020-09-08T16:44:38.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:676: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:44:38.587 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T16:44:38.588 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 200 0 192 384 0 0 0 0 100 100 active+undersized+degraded+remapped+backfilling 2020-09-08T16:44:28.607596+0000 37'200 50:275 [4,3,5] 4 [1,NONE,2] 1 0'0 2020-09-08T16:43:39.007827+0000 0'0 2020-09-08T16:43:39.007827+0000 0 2020-09-08T16:44:38.588 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T16:44:38.588 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T16:44:38.589 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:44:38.598 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: seq 1 60 2020-09-08T16:44:38.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:44:38.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:44:38.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:44:38.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:44:38.978 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:44:38.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 1 = 60 ']' 2020-09-08T16:44:38.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:44:39.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:44:39.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:44:39.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:44:39.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:44:40.373 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:44:40.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 2 = 60 ']' 2020-09-08T16:44:40.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:44:41.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:44:41.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:44:41.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:44:41.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:44:41.773 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:44:41.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 3 = 60 ']' 2020-09-08T16:44:41.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:44:42.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:44:42.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:44:42.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:44:42.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:44:43.167 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:44:43.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 4 = 60 ']' 2020-09-08T16:44:43.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:44:44.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:44:44.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:44:44.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:44:44.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:44:44.562 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:44:44.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 5 = 60 ']' 2020-09-08T16:44:44.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:44:45.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:44:45.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:44:45.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:44:45.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:44:45.957 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:44:45.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 6 = 60 ']' 2020-09-08T16:44:45.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:44:46.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:44:46.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:44:46.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:44:46.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:44:47.361 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:44:47.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 7 = 60 ']' 2020-09-08T16:44:47.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:44:48.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:44:48.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:44:48.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:44:48.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:44:48.755 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:44:48.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 8 = 60 ']' 2020-09-08T16:44:48.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:44:49.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:44:49.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:44:49.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:44:49.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:44:50.150 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:44:50.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 9 = 60 ']' 2020-09-08T16:44:50.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:44:51.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:44:51.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:44:51.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:44:51.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:44:51.550 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:44:51.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 10 = 60 ']' 2020-09-08T16:44:51.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:44:52.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:44:52.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:44:52.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:44:52.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:44:52.945 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:44:52.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 11 = 60 ']' 2020-09-08T16:44:52.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:44:53.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:44:53.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:44:53.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:44:53.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:44:54.350 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:44:54.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 12 = 60 ']' 2020-09-08T16:44:54.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:44:55.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:44:55.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:44:55.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:44:55.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:44:55.743 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:44:55.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 13 = 60 ']' 2020-09-08T16:44:55.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:44:56.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:44:56.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:44:56.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:44:56.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:44:57.141 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:44:57.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 14 = 60 ']' 2020-09-08T16:44:57.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:44:58.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:44:58.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:44:58.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:44:58.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:44:58.535 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:44:58.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 15 = 60 ']' 2020-09-08T16:44:58.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:44:59.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:44:59.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:44:59.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:44:59.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:44:59.931 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:44:59.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 16 = 60 ']' 2020-09-08T16:44:59.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:00.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:00.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:00.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:00.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:01.328 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:01.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 17 = 60 ']' 2020-09-08T16:45:01.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:02.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:02.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:02.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:02.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:02.722 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:02.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 18 = 60 ']' 2020-09-08T16:45:02.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:03.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:03.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:03.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:03.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:04.118 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:04.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 19 = 60 ']' 2020-09-08T16:45:04.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:05.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:05.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:05.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:05.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:05.507 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:05.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 20 = 60 ']' 2020-09-08T16:45:05.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:06.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:06.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:06.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:06.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:06.902 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:06.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 21 = 60 ']' 2020-09-08T16:45:06.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:07.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:07.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:07.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:07.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:08.296 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:08.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 22 = 60 ']' 2020-09-08T16:45:08.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:09.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:09.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:09.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:09.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:09.688 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:09.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 23 = 60 ']' 2020-09-08T16:45:09.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:10.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:10.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:10.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:10.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:11.083 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:11.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 24 = 60 ']' 2020-09-08T16:45:11.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:12.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:12.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:12.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:12.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:12.475 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:12.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 25 = 60 ']' 2020-09-08T16:45:12.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:13.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:13.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:13.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:13.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:13.876 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:13.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 26 = 60 ']' 2020-09-08T16:45:13.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:14.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:14.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:14.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:14.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:15.271 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:15.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 27 = 60 ']' 2020-09-08T16:45:15.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:16.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:16.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:16.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:16.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:16.669 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:16.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 28 = 60 ']' 2020-09-08T16:45:16.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:17.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:17.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:17.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:17.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:18.064 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:18.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 29 = 60 ']' 2020-09-08T16:45:18.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:19.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:19.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:19.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:19.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:19.483 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:19.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 30 = 60 ']' 2020-09-08T16:45:19.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:20.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:20.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:20.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:20.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:20.875 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:20.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 31 = 60 ']' 2020-09-08T16:45:20.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:21.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:21.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:21.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:21.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:22.273 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:22.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 32 = 60 ']' 2020-09-08T16:45:22.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:23.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:23.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:23.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:23.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:23.673 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:23.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 33 = 60 ']' 2020-09-08T16:45:23.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:24.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:24.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:24.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:24.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:25.066 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:25.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 34 = 60 ']' 2020-09-08T16:45:25.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:26.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:26.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:26.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:26.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:26.470 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:26.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 35 = 60 ']' 2020-09-08T16:45:26.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:27.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:27.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:27.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:27.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:27.863 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:27.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 36 = 60 ']' 2020-09-08T16:45:27.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:28.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:28.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:28.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:28.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:29.261 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:29.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 37 = 60 ']' 2020-09-08T16:45:29.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:30.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:30.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:30.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:30.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:30.662 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:30.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 38 = 60 ']' 2020-09-08T16:45:30.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2020-09-08T16:45:31.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 60) 2020-09-08T16:45:31.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:31.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2020-09-08T16:45:31.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2020-09-08T16:45:32.057 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:32.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:681: TEST_backfill_ec_down_all_out: break 2020-09-08T16:45:32.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:691: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2020-09-08T16:45:32.432 INFO:tasks.workunit.client.0.smithi065.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-09-08T16:45:32.432 INFO:tasks.workunit.client.0.smithi065.stdout:1.0 200 0 0 0 0 0 0 0 10 10 active+clean 2020-09-08T16:45:30.261252+0000 37'200 52:1051 [4,3,5] 4 [4,3,5] 4 0'0 2020-09-08T16:43:39.007827+0000 0'0 2020-09-08T16:43:39.007827+0000 0 2020-09-08T16:45:32.433 INFO:tasks.workunit.client.0.smithi065.stdout: 2020-09-08T16:45:32.433 INFO:tasks.workunit.client.0.smithi065.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-09-08T16:45:32.434 INFO:tasks.workunit.client.0.smithi065.stderr:dumped pgs 2020-09-08T16:45:32.444 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:693: TEST_backfill_ec_down_all_out: expr 200 '*' 2 2020-09-08T16:45:32.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:693: TEST_backfill_ec_down_all_out: local misplaced=400 2020-09-08T16:45:32.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:694: TEST_backfill_ec_down_all_out: check td/osd-backfill-stats 1.0 1 erasure 200 0 400 0 2020-09-08T16:45:32.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2020-09-08T16:45:32.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:64: check: local PG=1.0 2020-09-08T16:45:32.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:65: check: local primary=1 2020-09-08T16:45:32.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:66: check: local type=erasure 2020-09-08T16:45:32.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:67: check: local degraded_start=200 2020-09-08T16:45:32.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:68: check: local degraded_end=0 2020-09-08T16:45:32.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:69: check: local misplaced_start=400 2020-09-08T16:45:32.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:70: check: local misplaced_end=0 2020-09-08T16:45:32.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:71: check: local primary_start= 2020-09-08T16:45:32.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:72: check: local primary_end= 2020-09-08T16:45:32.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:73: check: local check_setup=true 2020-09-08T16:45:32.448 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2020-09-08T16:45:32.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2020-09-08T16:45:32.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:76: check: '[' true = true ']' 2020-09-08T16:45:32.449 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log td/osd-backfill-stats/osd.5.log 2020-09-08T16:45:32.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2020-09-08T16:45:32.463 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2020-09-08T16:45:32.463 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: wc -w 2020-09-08T16:45:32.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2020-09-08T16:45:32.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:86: check: local 'addp= ' 2020-09-08T16:45:32.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:87: check: '[' erasure = erasure ']' 2020-09-08T16:45:32.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:89: check: addp=p 2020-09-08T16:45:32.465 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2020-09-08T16:45:32.466 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:45:32.466 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: tail -1 2020-09-08T16:45:32.467 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2020-09-08T16:45:32.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: UPACT='[4,3,5]/[1,NONE,2]' 2020-09-08T16:45:32.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:93: check: '[' -n '[4,3,5]/[1,NONE,2]' ']' 2020-09-08T16:45:32.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:96: check: local which=degraded 2020-09-08T16:45:32.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:45:32.499 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:45:32.499 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -F ' [4,3,5]/[1,NONE,2]p' 2020-09-08T16:45:32.499 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -v est 2020-09-08T16:45:32.500 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: head -1 2020-09-08T16:45:32.501 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:45:32.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: FIRST=200 2020-09-08T16:45:32.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:98: check: '[' -n 200 ']' 2020-09-08T16:45:32.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:99: check: below_margin 200 200 2020-09-08T16:45:32.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=200 2020-09-08T16:45:32.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T16:45:32.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=200 2020-09-08T16:45:32.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T16:45:32.504 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:45:32.505 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:45:32.505 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: tail -1 2020-09-08T16:45:32.505 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:45:32.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: LAST=1 2020-09-08T16:45:32.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:101: check: '[' -n 1 ']' 2020-09-08T16:45:32.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:102: check: above_margin 1 0 2020-09-08T16:45:32.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=1 2020-09-08T16:45:32.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T16:45:32.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=0 2020-09-08T16:45:32.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T16:45:32.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:105: check: which=misplaced 2020-09-08T16:45:32.520 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:45:32.521 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:45:32.523 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -F ' [4,3,5]/[1,NONE,2]p' 2020-09-08T16:45:32.524 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -v est 2020-09-08T16:45:32.524 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: head -1 2020-09-08T16:45:32.524 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:45:32.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: FIRST=400 2020-09-08T16:45:32.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:107: check: '[' -n 400 ']' 2020-09-08T16:45:32.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:108: check: below_margin 400 400 2020-09-08T16:45:32.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=400 2020-09-08T16:45:32.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T16:45:32.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=400 2020-09-08T16:45:32.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T16:45:32.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:45:32.528 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:45:32.528 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: tail -1 2020-09-08T16:45:32.528 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:45:32.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: LAST=2 2020-09-08T16:45:32.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:110: check: '[' -n 2 ']' 2020-09-08T16:45:32.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:111: check: above_margin 2 0 2020-09-08T16:45:32.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=2 2020-09-08T16:45:32.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T16:45:32.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=0 2020-09-08T16:45:32.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T16:45:32.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2020-09-08T16:45:32.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:696: TEST_backfill_ec_down_all_out: delete_pool test 2020-09-08T16:45:32.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test 2020-09-08T16:45:32.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2020-09-08T16:45:33.051 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' does not exist 2020-09-08T16:45:33.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:697: TEST_backfill_ec_down_all_out: kill_daemons td/osd-backfill-stats 2020-09-08T16:45:33.060 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:45:33.061 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:45:33.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:45:33.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:45:33.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:45:33.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:45:33.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2020-09-08T16:45:33.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T16:45:33.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:45:33.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T16:45:33.176 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:45:33.177 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:45:33.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:45:33.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:45:33.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:45:33.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:45:33.179 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:45:33.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:45:33.179 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:45:33.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:45:33.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:45:33.180 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:45:33.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:45:33.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:45:33.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:45:33.182 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:45:33.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:45:33.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:45:33.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T16:45:33.200 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:45:33.200 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:45:33.201 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:45:33.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T16:45:33.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:45:33.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:45:33.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:35: run: for func in $funcs 2020-09-08T16:45:33.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2020-09-08T16:45:33.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2020-09-08T16:45:33.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2020-09-08T16:45:33.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T16:45:33.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:45:33.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T16:45:33.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:45:33.205 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:45:33.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:45:33.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:45:33.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:45:33.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:45:33.206 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:45:33.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:45:33.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:45:33.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:45:33.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:45:33.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:45:33.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:45:33.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:45:33.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:45:33.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:45:33.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:45:33.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:45:33.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T16:45:33.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:45:33.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:45:33.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:45:33.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T16:45:33.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:45:33.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:45:33.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2020-09-08T16:45:33.213 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T16:45:33.213 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:45:33.213 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:45:33.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.482138 2020-09-08T16:45:33.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T16:45:33.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T16:45:33.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T16:45:33.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2020-09-08T16:45:33.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:37: run: TEST_backfill_ec_down_out td/osd-backfill-stats 2020-09-08T16:45:33.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:708: TEST_backfill_ec_down_out: local dir=td/osd-backfill-stats 2020-09-08T16:45:33.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:710: TEST_backfill_ec_down_out: run_mon td/osd-backfill-stats a 2020-09-08T16:45:33.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2020-09-08T16:45:33.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T16:45:33.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T16:45:33.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T16:45:33.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2020-09-08T16:45:33.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2020-09-08T16:45:33.508 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T16:45:33.508 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:45:33.508 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:45:33.508 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:45:33.509 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:45:33.509 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:45:33.509 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:45:33.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T16:45:33.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T16:45:33.743 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T16:45:33.743 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:45:33.743 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:45:33.743 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T16:45:33.744 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T16:45:33.744 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:45:33.744 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:45:33.744 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:45:33.745 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:45:33.745 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:45:33.745 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:45:33.746 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T16:45:33.746 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:45:33.746 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get fsid 2020-09-08T16:45:33.841 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T16:45:33.841 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:45:33.841 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:45:33.842 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T16:45:33.842 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T16:45:33.842 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:45:33.842 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:45:33.842 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:45:33.843 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:45:33.843 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:45:33.843 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:45:33.843 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T16:45:33.844 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:45:33.844 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get mon_host 2020-09-08T16:45:33.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:711: TEST_backfill_ec_down_out: run_mgr td/osd-backfill-stats x 2020-09-08T16:45:33.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-stats 2020-09-08T16:45:33.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T16:45:33.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T16:45:33.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T16:45:33.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-stats/x 2020-09-08T16:45:33.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T16:45:34.820 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T16:45:34.821 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:45:34.821 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:45:34.821 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:45:34.821 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:45:34.822 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:45:34.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:45:34.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:45:34.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:45:34.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:712: TEST_backfill_ec_down_out: run_osd td/osd-backfill-stats 0 2020-09-08T16:45:34.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:45:34.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:45:34.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T16:45:34.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:45:34.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/0 2020-09-08T16:45:34.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:45:34.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:45:34.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:45:34.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:45:34.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2020-09-08T16:45:34.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2020-09-08T16:45:34.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:45:34.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:45:34.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:45:34.854 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:45:34.854 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:45:34.854 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:45:34.855 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:45:34.855 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:45:34.855 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:45:34.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:45:34.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:45:34.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:45:34.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:45:34.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:45:34.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:45:34.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:45:34.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:45:34.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:45:34.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:45:34.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:45:34.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:45:34.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/0 2020-09-08T16:45:34.858 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:45:34.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=1011cd16-a2b8-4812-bc57-2ec254ac83ab 2020-09-08T16:45:34.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 1011cd16-a2b8-4812-bc57-2ec254ac83ab' 2020-09-08T16:45:34.859 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:45:34.859 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 1011cd16-a2b8-4812-bc57-2ec254ac83ab 2020-09-08T16:45:34.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAutVdfYwDVMxAAIn2kQo9Fh05jrxh24BmhNA== 2020-09-08T16:45:34.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAutVdfYwDVMxAAIn2kQo9Fh05jrxh24BmhNA=="}' 2020-09-08T16:45:34.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 1011cd16-a2b8-4812-bc57-2ec254ac83ab -i td/osd-backfill-stats/0/new.json 2020-09-08T16:45:35.203 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:45:35.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/0/new.json 2020-09-08T16:45:35.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAutVdfYwDVMxAAIn2kQo9Fh05jrxh24BmhNA== --osd-uuid 1011cd16-a2b8-4812-bc57-2ec254ac83ab 2020-09-08T16:45:35.246 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:35.244+0000 7fb77c4feec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:45:35.247 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:35.246+0000 7fb77c4feec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:45:35.247 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:35.248+0000 7fb77c4feec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:45:35.247 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:35.248+0000 7fb77c4feec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:45:35.247 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:35.248+0000 7fb77c4feec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:45:35.248 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:35.248+0000 7fb77c4feec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:45:35.299 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:35.304+0000 7fb77c4feec0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2020-09-08T16:45:39.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2020-09-08T16:45:39.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:45:39.507 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T16:45:39.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T16:45:39.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:45:40.043 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T16:45:40.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T16:45:40.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:45:40.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:45:40.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:45:40.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:45:40.066 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:40.070+0000 7fe5732d2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:45:40.071 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:40.075+0000 7fe5732d2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:45:40.072 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:40.076+0000 7fe5732d2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:45:40.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T16:45:40.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:45:40.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T16:45:40.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:45:40.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:45:40.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:45:40.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:45:40.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:45:40.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:45:40.435 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:45:40.588 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:40.592+0000 7fe5732d2ec0 -1 Falling back to public interface 2020-09-08T16:45:40.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:45:41.399 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:41.401+0000 7fe5732d2ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T16:45:41.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:45:41.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:45:41.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:45:41.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:45:41.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:45:41.870 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:45:42.281 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/522431,v1:127.0.0.1:6803/522431] [v2:127.0.0.1:6804/522431,v1:127.0.0.1:6805/522431] exists,up 1011cd16-a2b8-4812-bc57-2ec254ac83ab 2020-09-08T16:45:42.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:45:42.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:45:42.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:45:42.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:713: TEST_backfill_ec_down_out: run_osd td/osd-backfill-stats 1 2020-09-08T16:45:42.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:45:42.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:45:42.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T16:45:42.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:45:42.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/1 2020-09-08T16:45:42.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:45:42.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:45:42.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:45:42.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:45:42.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2020-09-08T16:45:42.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2020-09-08T16:45:42.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:45:42.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:45:42.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:45:42.285 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:45:42.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:45:42.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:45:42.286 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:45:42.286 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:45:42.286 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:45:42.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:45:42.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:45:42.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:45:42.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:45:42.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:45:42.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:45:42.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:45:42.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:45:42.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:45:42.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:45:42.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:45:42.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:45:42.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/1 2020-09-08T16:45:42.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:45:42.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=4b13b38e-5c9a-4f3a-800d-ff11277509e3 2020-09-08T16:45:42.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 4b13b38e-5c9a-4f3a-800d-ff11277509e3' 2020-09-08T16:45:42.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:45:42.291 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 4b13b38e-5c9a-4f3a-800d-ff11277509e3 2020-09-08T16:45:42.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQA2tVdfoX8PEhAAkYCKUrlBIvMFOOEl337XBQ== 2020-09-08T16:45:42.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQA2tVdfoX8PEhAAkYCKUrlBIvMFOOEl337XBQ=="}' 2020-09-08T16:45:42.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 4b13b38e-5c9a-4f3a-800d-ff11277509e3 -i td/osd-backfill-stats/1/new.json 2020-09-08T16:45:42.809 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:45:42.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/1/new.json 2020-09-08T16:45:42.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQA2tVdfoX8PEhAAkYCKUrlBIvMFOOEl337XBQ== --osd-uuid 4b13b38e-5c9a-4f3a-800d-ff11277509e3 2020-09-08T16:45:42.839 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:42.844+0000 7f31ae96bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:45:42.840 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:42.846+0000 7f31ae96bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:45:42.842 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:42.847+0000 7f31ae96bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:45:42.843 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:42.848+0000 7f31ae96bec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:45:42.843 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:42.848+0000 7f31ae96bec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:45:42.843 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:42.848+0000 7f31ae96bec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:45:42.883 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:42.888+0000 7f31ae96bec0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2020-09-08T16:45:47.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2020-09-08T16:45:47.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:45:47.142 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T16:45:47.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T16:45:47.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:45:47.671 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T16:45:47.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T16:45:47.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:45:47.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:45:47.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:45:47.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:45:47.696 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:47.701+0000 7f3fc9b99ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:45:47.709 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:47.714+0000 7f3fc9b99ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:45:47.711 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:47.716+0000 7f3fc9b99ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:45:48.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T16:45:48.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:45:48.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T16:45:48.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:45:48.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:45:48.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:45:48.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:45:48.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:45:48.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:45:48.068 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:45:48.226 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:48.231+0000 7f3fc9b99ec0 -1 Falling back to public interface 2020-09-08T16:45:48.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:45:49.118 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:49.123+0000 7f3fc9b99ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T16:45:49.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:45:49.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:45:49.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:45:49.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:45:49.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:45:49.473 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:45:49.872 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/523433,v1:127.0.0.1:6811/523433] [v2:127.0.0.1:6812/523433,v1:127.0.0.1:6813/523433] exists,up 4b13b38e-5c9a-4f3a-800d-ff11277509e3 2020-09-08T16:45:49.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:45:49.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:45:49.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:45:49.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:714: TEST_backfill_ec_down_out: run_osd td/osd-backfill-stats 2 2020-09-08T16:45:49.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:45:49.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:45:49.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T16:45:49.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:45:49.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/2 2020-09-08T16:45:49.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:45:49.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:45:49.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:45:49.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:45:49.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2020-09-08T16:45:49.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2020-09-08T16:45:49.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:45:49.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:45:49.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:45:49.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:45:49.881 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:45:49.881 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:45:49.881 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:45:49.882 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:45:49.882 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:45:49.882 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:45:49.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:45:49.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:45:49.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:45:49.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:45:49.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:45:49.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:45:49.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:45:49.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:45:49.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:45:49.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:45:49.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:45:49.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/2 2020-09-08T16:45:49.887 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:45:49.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=2881e16a-78e4-45eb-9778-5560701dc554 2020-09-08T16:45:49.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 2881e16a-78e4-45eb-9778-5560701dc554' 2020-09-08T16:45:49.889 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:45:49.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQA9tVdfu/9KNRAAjE5vyLKFJhf8+io8734avA== 2020-09-08T16:45:49.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQA9tVdfu/9KNRAAjE5vyLKFJhf8+io8734avA=="}' 2020-09-08T16:45:49.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 2881e16a-78e4-45eb-9778-5560701dc554 -i td/osd-backfill-stats/2/new.json 2020-09-08T16:45:49.890 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 2881e16a-78e4-45eb-9778-5560701dc554 2020-09-08T16:45:50.424 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:45:50.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/2/new.json 2020-09-08T16:45:50.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQA9tVdfu/9KNRAAjE5vyLKFJhf8+io8734avA== --osd-uuid 2881e16a-78e4-45eb-9778-5560701dc554 2020-09-08T16:45:50.461 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:50.466+0000 7fc092adfec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:45:50.463 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:50.468+0000 7fc092adfec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:45:50.463 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:50.468+0000 7fc092adfec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:45:50.464 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:50.469+0000 7fc092adfec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:45:50.464 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:50.469+0000 7fc092adfec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:45:50.465 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:50.469+0000 7fc092adfec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:45:50.516 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:50.521+0000 7fc092adfec0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2020-09-08T16:45:54.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2020-09-08T16:45:54.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:45:54.745 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T16:45:54.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T16:45:54.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:45:55.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T16:45:55.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:45:55.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:45:55.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:45:55.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:45:55.284 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T16:45:55.306 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:55.311+0000 7f46f886bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:45:55.323 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:55.321+0000 7f46f886bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:45:55.323 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:55.322+0000 7f46f886bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:45:55.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T16:45:55.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:45:55.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T16:45:55.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:45:55.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:45:55.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:45:55.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:45:55.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:45:55.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:45:55.676 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:45:55.835 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:55.840+0000 7f46f886bec0 -1 Falling back to public interface 2020-09-08T16:45:56.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:45:56.658 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:56.662+0000 7f46f886bec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T16:45:57.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:45:57.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:45:57.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:45:57.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:45:57.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:45:57.081 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:45:57.541 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/524427,v1:127.0.0.1:6819/524427] [v2:127.0.0.1:6820/524427,v1:127.0.0.1:6821/524427] exists,up 2881e16a-78e4-45eb-9778-5560701dc554 2020-09-08T16:45:57.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:45:57.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:45:57.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:45:57.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:715: TEST_backfill_ec_down_out: run_osd td/osd-backfill-stats 3 2020-09-08T16:45:57.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:45:57.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:45:57.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T16:45:57.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:45:57.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/3 2020-09-08T16:45:57.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:45:57.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:45:57.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:45:57.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:45:57.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2020-09-08T16:45:57.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2020-09-08T16:45:57.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:45:57.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:45:57.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:45:57.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:45:57.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:45:57.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:45:57.549 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:45:57.549 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:45:57.550 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:45:57.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:45:57.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:45:57.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:45:57.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:45:57.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:45:57.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:45:57.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:45:57.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:45:57.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:45:57.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:45:57.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:45:57.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:45:57.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/3 2020-09-08T16:45:57.552 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:45:57.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=aafe396d-7951-45e0-96e2-de6043e438c2 2020-09-08T16:45:57.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 aafe396d-7951-45e0-96e2-de6043e438c2' 2020-09-08T16:45:57.553 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:45:57.553 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 aafe396d-7951-45e0-96e2-de6043e438c2 2020-09-08T16:45:57.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBFtVdfFmGjIRAAebKRtT9+qENfJppCLUFJ6A== 2020-09-08T16:45:57.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBFtVdfFmGjIRAAebKRtT9+qENfJppCLUFJ6A=="}' 2020-09-08T16:45:57.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new aafe396d-7951-45e0-96e2-de6043e438c2 -i td/osd-backfill-stats/3/new.json 2020-09-08T16:45:58.061 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T16:45:58.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/3/new.json 2020-09-08T16:45:58.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBFtVdfFmGjIRAAebKRtT9+qENfJppCLUFJ6A== --osd-uuid aafe396d-7951-45e0-96e2-de6043e438c2 2020-09-08T16:45:58.098 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:58.102+0000 7f32fd437ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:45:58.110 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:58.104+0000 7f32fd437ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:45:58.111 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:58.106+0000 7f32fd437ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:45:58.111 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:58.107+0000 7f32fd437ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:45:58.111 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:58.107+0000 7f32fd437ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:45:58.111 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:58.107+0000 7f32fd437ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:45:58.194 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:45:58.196+0000 7f32fd437ec0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2020-09-08T16:46:02.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2020-09-08T16:46:02.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:46:02.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T16:46:02.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:46:02.624 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T16:46:03.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T16:46:03.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:46:03.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:46:03.164 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T16:46:03.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:46:03.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:46:03.186 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:03.192+0000 7f1a1a945ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:46:03.188 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:03.193+0000 7f1a1a945ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:46:03.189 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:03.194+0000 7f1a1a945ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:46:03.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T16:46:03.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:46:03.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T16:46:03.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:46:03.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:46:03.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:46:03.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:46:03.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:46:03.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:46:03.557 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:46:03.706 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:03.711+0000 7f1a1a945ec0 -1 Falling back to public interface 2020-09-08T16:46:03.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:46:04.708 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:04.712+0000 7f1a1a945ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T16:46:04.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:46:04.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:46:04.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:46:04.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:46:04.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:46:04.978 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:46:05.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:46:06.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:46:06.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:46:06.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T16:46:06.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:46:06.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:46:06.404 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:46:06.806 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/525421,v1:127.0.0.1:6827/525421] [v2:127.0.0.1:6828/525421,v1:127.0.0.1:6829/525421] exists,up aafe396d-7951-45e0-96e2-de6043e438c2 2020-09-08T16:46:06.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:46:06.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:46:06.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:46:06.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:716: TEST_backfill_ec_down_out: run_osd td/osd-backfill-stats 4 2020-09-08T16:46:06.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:46:06.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:46:06.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=4 2020-09-08T16:46:06.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:46:06.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/4 2020-09-08T16:46:06.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:46:06.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:46:06.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:46:06.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:46:06.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2020-09-08T16:46:06.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2020-09-08T16:46:06.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:46:06.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:46:06.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:46:06.811 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:46:06.811 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:46:06.811 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:46:06.811 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:46:06.812 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:46:06.812 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:46:06.813 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:46:06.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:46:06.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:46:06.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:46:06.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:46:06.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:46:06.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:46:06.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:46:06.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:46:06.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:46:06.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:46:06.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:46:06.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/4 2020-09-08T16:46:06.816 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:46:06.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=dbc90c87-4a2a-42ae-ab6f-479ec86c2696 2020-09-08T16:46:06.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd4 dbc90c87-4a2a-42ae-ab6f-479ec86c2696' 2020-09-08T16:46:06.817 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:46:06.817 INFO:tasks.workunit.client.0.smithi065.stdout:add osd4 dbc90c87-4a2a-42ae-ab6f-479ec86c2696 2020-09-08T16:46:06.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBOtVdfq9NcMRAAmFvNnXAsOzY5Vjps/SlvxA== 2020-09-08T16:46:06.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBOtVdfq9NcMRAAmFvNnXAsOzY5Vjps/SlvxA=="}' 2020-09-08T16:46:06.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new dbc90c87-4a2a-42ae-ab6f-479ec86c2696 -i td/osd-backfill-stats/4/new.json 2020-09-08T16:46:07.331 INFO:tasks.workunit.client.0.smithi065.stdout:4 2020-09-08T16:46:07.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/4/new.json 2020-09-08T16:46:07.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 4 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBOtVdfq9NcMRAAmFvNnXAsOzY5Vjps/SlvxA== --osd-uuid dbc90c87-4a2a-42ae-ab6f-479ec86c2696 2020-09-08T16:46:07.368 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:07.373+0000 7fef0eff1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:46:07.369 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:07.374+0000 7fef0eff1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:46:07.371 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:07.376+0000 7fef0eff1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:46:07.372 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:07.376+0000 7fef0eff1ec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:46:07.372 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:07.376+0000 7fef0eff1ec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:46:07.372 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:07.376+0000 7fef0eff1ec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:46:07.407 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:07.412+0000 7fef0eff1ec0 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2020-09-08T16:46:11.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2020-09-08T16:46:11.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:46:11.895 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd4 key to auth repository 2020-09-08T16:46:11.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd4 key to auth repository 2020-09-08T16:46:11.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:46:12.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.4 2020-09-08T16:46:12.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 4 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:46:12.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:46:12.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:46:12.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:46:12.429 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.4 2020-09-08T16:46:12.451 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:12.456+0000 7f3356bd0ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:46:12.474 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:12.478+0000 7f3356bd0ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:46:12.474 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:12.480+0000 7f3356bd0ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:46:12.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 4 2020-09-08T16:46:12.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:46:12.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=4 2020-09-08T16:46:12.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:46:12.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:46:12.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:46:12.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:46:12.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:46:12.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:46:12.822 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:46:12.990 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:12.995+0000 7f3356bd0ec0 -1 Falling back to public interface 2020-09-08T16:46:13.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:46:13.782 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:13.787+0000 7f3356bd0ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-09-08T16:46:14.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:46:14.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:46:14.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:46:14.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:46:14.239 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:46:14.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:46:14.682 INFO:tasks.workunit.client.0.smithi065.stdout:osd.4 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/526441,v1:127.0.0.1:6835/526441] [v2:127.0.0.1:6836/526441,v1:127.0.0.1:6837/526441] exists,up dbc90c87-4a2a-42ae-ab6f-479ec86c2696 2020-09-08T16:46:14.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:46:14.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:46:14.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:46:14.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:717: TEST_backfill_ec_down_out: run_osd td/osd-backfill-stats 5 2020-09-08T16:46:14.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:46:14.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:46:14.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=5 2020-09-08T16:46:14.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:46:14.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/5 2020-09-08T16:46:14.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:46:14.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:46:14.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:46:14.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:46:14.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/5' 2020-09-08T16:46:14.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/5/journal' 2020-09-08T16:46:14.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:46:14.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:46:14.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:46:14.686 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:46:14.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:46:14.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:46:14.687 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:46:14.687 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:46:14.687 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:46:14.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:46:14.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:46:14.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:46:14.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:46:14.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:46:14.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:46:14.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:46:14.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:46:14.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:46:14.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:46:14.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:46:14.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:46:14.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/5 2020-09-08T16:46:14.690 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:46:14.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=6ded86e9-a40c-4a9e-9a9d-450ef59878b1 2020-09-08T16:46:14.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd5 6ded86e9-a40c-4a9e-9a9d-450ef59878b1' 2020-09-08T16:46:14.691 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:46:14.692 INFO:tasks.workunit.client.0.smithi065.stdout:add osd5 6ded86e9-a40c-4a9e-9a9d-450ef59878b1 2020-09-08T16:46:14.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBWtVdfr5L2KRAAvlQlxdGi9GVnyISl3eiFCQ== 2020-09-08T16:46:14.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBWtVdfr5L2KRAAvlQlxdGi9GVnyISl3eiFCQ=="}' 2020-09-08T16:46:14.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 6ded86e9-a40c-4a9e-9a9d-450ef59878b1 -i td/osd-backfill-stats/5/new.json 2020-09-08T16:46:15.257 INFO:tasks.workunit.client.0.smithi065.stdout:5 2020-09-08T16:46:15.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/5/new.json 2020-09-08T16:46:15.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 5 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBWtVdfr5L2KRAAvlQlxdGi9GVnyISl3eiFCQ== --osd-uuid 6ded86e9-a40c-4a9e-9a9d-450ef59878b1 2020-09-08T16:46:15.293 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:15.298+0000 7f93826f1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:46:15.294 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:15.300+0000 7f93826f1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:46:15.296 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:15.301+0000 7f93826f1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:46:15.297 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:15.302+0000 7f93826f1ec0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2020-09-08T16:46:15.297 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:15.302+0000 7f93826f1ec0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2020-09-08T16:46:15.297 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:15.302+0000 7f93826f1ec0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2020-09-08T16:46:15.343 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:15.348+0000 7f93826f1ec0 -1 bluestore(td/osd-backfill-stats/5) _read_fsid unparsable uuid 2020-09-08T16:46:19.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/5/keyring 2020-09-08T16:46:19.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:46:19.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd5 key to auth repository 2020-09-08T16:46:19.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:46:19.736 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd5 key to auth repository 2020-09-08T16:46:20.274 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.5 2020-09-08T16:46:20.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.5 2020-09-08T16:46:20.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 5 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:46:20.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:46:20.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:46:20.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:46:20.297 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:20.302+0000 7fcd54277ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:46:20.315 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:20.320+0000 7fcd54277ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:46:20.317 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:20.322+0000 7fcd54277ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:46:20.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 5 2020-09-08T16:46:20.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:46:20.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=5 2020-09-08T16:46:20.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:46:20.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:46:20.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:46:20.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:46:20.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T16:46:20.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:46:20.680 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:46:20.833 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:20.838+0000 7fcd54277ec0 -1 Falling back to public interface 2020-09-08T16:46:21.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:46:21.652 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:46:21.655+0000 7fcd54277ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-09-08T16:46:22.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:46:22.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:46:22.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:46:22.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T16:46:22.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:46:22.082 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:46:22.527 INFO:tasks.workunit.client.0.smithi065.stdout:osd.5 up in weight 1 up_from 29 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/527435,v1:127.0.0.1:6843/527435] [v2:127.0.0.1:6844/527435,v1:127.0.0.1:6845/527435] exists,up 6ded86e9-a40c-4a9e-9a9d-450ef59878b1 2020-09-08T16:46:22.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:46:22.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:46:22.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:46:22.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:719: TEST_backfill_ec_down_out: ceph osd erasure-code-profile set myprofile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2020-09-08T16:46:23.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:720: TEST_backfill_ec_down_out: create_pool test 1 1 erasure myprofile 2020-09-08T16:46:23.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test 1 1 erasure myprofile 2020-09-08T16:46:24.041 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' already exists 2020-09-08T16:46:24.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:46:25.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:721: TEST_backfill_ec_down_out: ceph osd pool set test min_size 2 2020-09-08T16:46:25.785 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 min_size to 2 2020-09-08T16:46:25.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:723: TEST_backfill_ec_down_out: wait_for_clean 2020-09-08T16:46:25.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:46:25.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:46:25.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:46:25.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:46:25.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:46:25.796 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:46:25.797 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:46:25.797 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:46:25.797 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:46:25.797 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:46:25.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:46:25.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:46:25.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:46:25.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:46:25.892 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:46:26.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:46:26.280 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:46:26.280 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:46:26.281 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:46:26.281 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T16:46:26.281 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T16:46:26.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:46:26.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:46:26.282 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:46:26.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836491 2020-09-08T16:46:26.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836491 2020-09-08T16:46:26.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491' 2020-09-08T16:46:26.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:46:26.436 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:46:26.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672970 2020-09-08T16:46:26.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672970 2020-09-08T16:46:26.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672970' 2020-09-08T16:46:26.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:46:26.575 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:46:26.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=60129542152 2020-09-08T16:46:26.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 60129542152 2020-09-08T16:46:26.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672970 2-60129542152' 2020-09-08T16:46:26.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:46:26.719 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:46:26.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=81604378631 2020-09-08T16:46:26.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 81604378631 2020-09-08T16:46:26.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672970 2-60129542152 3-81604378631' 2020-09-08T16:46:26.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:46:26.849 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:46:26.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=103079215109 2020-09-08T16:46:26.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 103079215109 2020-09-08T16:46:26.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672970 2-60129542152 3-81604378631 4-103079215109' 2020-09-08T16:46:26.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:46:26.986 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T16:46:27.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=124554051587 2020-09-08T16:46:27.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 124554051587 2020-09-08T16:46:27.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672970 2-60129542152 3-81604378631 4-103079215109 5-124554051587' 2020-09-08T16:46:27.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:46:27.117 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836491 2020-09-08T16:46:27.117 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:46:27.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:46:27.118 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836491 2020-09-08T16:46:27.118 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:46:27.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836491 2020-09-08T16:46:27.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2020-09-08T16:46:27.119 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:46:27.120 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836491 2020-09-08T16:46:27.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836491 -lt 21474836491 2020-09-08T16:46:27.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:46:27.510 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672970 2020-09-08T16:46:27.510 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:46:27.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:46:27.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672970 2020-09-08T16:46:27.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:46:27.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672970 2020-09-08T16:46:27.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672970' 2020-09-08T16:46:27.512 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:46:27.512 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672970 2020-09-08T16:46:27.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672970 -lt 42949672970 2020-09-08T16:46:27.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:46:27.908 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-60129542152 2020-09-08T16:46:27.908 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:46:27.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:46:27.909 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-60129542152 2020-09-08T16:46:27.909 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:46:27.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=60129542152 2020-09-08T16:46:27.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 60129542152' 2020-09-08T16:46:27.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:46:27.910 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 60129542152 2020-09-08T16:46:28.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 60129542150 -lt 60129542152 2020-09-08T16:46:28.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:46:29.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:46:29.303 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:46:29.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 60129542153 -lt 60129542152 2020-09-08T16:46:29.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:46:29.705 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-81604378631 2020-09-08T16:46:29.705 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:46:29.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:46:29.706 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-81604378631 2020-09-08T16:46:29.706 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:46:29.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=81604378631 2020-09-08T16:46:29.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 81604378631' 2020-09-08T16:46:29.707 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:46:29.708 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 81604378631 2020-09-08T16:46:30.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 81604378631 -lt 81604378631 2020-09-08T16:46:30.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:46:30.107 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-103079215109 2020-09-08T16:46:30.108 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:46:30.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:46:30.109 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-103079215109 2020-09-08T16:46:30.110 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:46:30.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=103079215109 2020-09-08T16:46:30.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 103079215109' 2020-09-08T16:46:30.110 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:46:30.111 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 103079215109 2020-09-08T16:46:30.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 103079215109 -lt 103079215109 2020-09-08T16:46:30.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:46:30.510 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-124554051587 2020-09-08T16:46:30.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:46:30.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T16:46:30.512 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-124554051587 2020-09-08T16:46:30.512 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:46:30.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=124554051587 2020-09-08T16:46:30.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 124554051587' 2020-09-08T16:46:30.513 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T16:46:30.513 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 124554051587 2020-09-08T16:46:30.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 124554051588 -lt 124554051587 2020-09-08T16:46:30.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:46:30.907 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:46:30.908 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:46:31.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T16:46:31.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:46:31.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:46:31.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:46:31.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:46:31.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:46:31.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:46:31.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:46:31.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T16:46:31.830 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:46:31.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:46:31.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:46:32.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T16:46:32.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:46:32.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:46:32.351 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: seq 1 200 2020-09-08T16:46:32.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:32.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj1 /dev/null 2020-09-08T16:46:32.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:32.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj2 /dev/null 2020-09-08T16:46:32.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:32.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj3 /dev/null 2020-09-08T16:46:32.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:32.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj4 /dev/null 2020-09-08T16:46:33.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:33.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj5 /dev/null 2020-09-08T16:46:33.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:33.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj6 /dev/null 2020-09-08T16:46:33.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:33.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj7 /dev/null 2020-09-08T16:46:33.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:33.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj8 /dev/null 2020-09-08T16:46:33.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:33.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj9 /dev/null 2020-09-08T16:46:33.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:33.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj10 /dev/null 2020-09-08T16:46:34.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:34.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj11 /dev/null 2020-09-08T16:46:34.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:34.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj12 /dev/null 2020-09-08T16:46:34.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:34.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj13 /dev/null 2020-09-08T16:46:34.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:34.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj14 /dev/null 2020-09-08T16:46:34.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:34.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj15 /dev/null 2020-09-08T16:46:34.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:34.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj16 /dev/null 2020-09-08T16:46:35.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:35.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj17 /dev/null 2020-09-08T16:46:35.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:35.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj18 /dev/null 2020-09-08T16:46:35.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:35.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj19 /dev/null 2020-09-08T16:46:35.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:35.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj20 /dev/null 2020-09-08T16:46:35.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:35.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj21 /dev/null 2020-09-08T16:46:36.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:36.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj22 /dev/null 2020-09-08T16:46:36.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:36.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj23 /dev/null 2020-09-08T16:46:36.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:36.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj24 /dev/null 2020-09-08T16:46:36.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:36.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj25 /dev/null 2020-09-08T16:46:36.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:36.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj26 /dev/null 2020-09-08T16:46:37.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:37.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj27 /dev/null 2020-09-08T16:46:37.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:37.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj28 /dev/null 2020-09-08T16:46:37.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:37.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj29 /dev/null 2020-09-08T16:46:37.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:37.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj30 /dev/null 2020-09-08T16:46:37.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:37.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj31 /dev/null 2020-09-08T16:46:37.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:37.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj32 /dev/null 2020-09-08T16:46:38.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:38.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj33 /dev/null 2020-09-08T16:46:38.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:38.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj34 /dev/null 2020-09-08T16:46:38.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:38.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj35 /dev/null 2020-09-08T16:46:38.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:38.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj36 /dev/null 2020-09-08T16:46:38.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:38.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj37 /dev/null 2020-09-08T16:46:39.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:39.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj38 /dev/null 2020-09-08T16:46:39.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:39.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj39 /dev/null 2020-09-08T16:46:39.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:39.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj40 /dev/null 2020-09-08T16:46:39.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:39.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj41 /dev/null 2020-09-08T16:46:39.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:39.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj42 /dev/null 2020-09-08T16:46:39.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:39.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj43 /dev/null 2020-09-08T16:46:40.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:40.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj44 /dev/null 2020-09-08T16:46:40.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:40.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj45 /dev/null 2020-09-08T16:46:40.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:40.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj46 /dev/null 2020-09-08T16:46:40.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:40.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj47 /dev/null 2020-09-08T16:46:40.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:40.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj48 /dev/null 2020-09-08T16:46:41.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:41.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj49 /dev/null 2020-09-08T16:46:41.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:41.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj50 /dev/null 2020-09-08T16:46:41.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:41.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj51 /dev/null 2020-09-08T16:46:41.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:41.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj52 /dev/null 2020-09-08T16:46:41.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:41.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj53 /dev/null 2020-09-08T16:46:41.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:41.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj54 /dev/null 2020-09-08T16:46:42.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:42.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj55 /dev/null 2020-09-08T16:46:42.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:42.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj56 /dev/null 2020-09-08T16:46:42.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:42.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj57 /dev/null 2020-09-08T16:46:42.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:42.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj58 /dev/null 2020-09-08T16:46:42.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:42.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj59 /dev/null 2020-09-08T16:46:42.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:42.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj60 /dev/null 2020-09-08T16:46:43.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:43.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj61 /dev/null 2020-09-08T16:46:43.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:43.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj62 /dev/null 2020-09-08T16:46:43.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:43.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj63 /dev/null 2020-09-08T16:46:43.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:43.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj64 /dev/null 2020-09-08T16:46:43.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:43.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj65 /dev/null 2020-09-08T16:46:43.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:43.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj66 /dev/null 2020-09-08T16:46:44.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:44.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj67 /dev/null 2020-09-08T16:46:44.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:44.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj68 /dev/null 2020-09-08T16:46:44.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:44.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj69 /dev/null 2020-09-08T16:46:44.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:44.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj70 /dev/null 2020-09-08T16:46:44.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:44.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj71 /dev/null 2020-09-08T16:46:45.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:45.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj72 /dev/null 2020-09-08T16:46:45.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:45.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj73 /dev/null 2020-09-08T16:46:45.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:45.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj74 /dev/null 2020-09-08T16:46:45.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:45.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj75 /dev/null 2020-09-08T16:46:45.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:45.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj76 /dev/null 2020-09-08T16:46:45.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:45.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj77 /dev/null 2020-09-08T16:46:46.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:46.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj78 /dev/null 2020-09-08T16:46:46.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:46.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj79 /dev/null 2020-09-08T16:46:46.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:46.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj80 /dev/null 2020-09-08T16:46:46.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:46.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj81 /dev/null 2020-09-08T16:46:46.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:46.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj82 /dev/null 2020-09-08T16:46:46.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:46.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj83 /dev/null 2020-09-08T16:46:47.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:47.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj84 /dev/null 2020-09-08T16:46:47.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:47.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj85 /dev/null 2020-09-08T16:46:47.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:47.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj86 /dev/null 2020-09-08T16:46:47.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:47.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj87 /dev/null 2020-09-08T16:46:47.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:47.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj88 /dev/null 2020-09-08T16:46:47.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:47.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj89 /dev/null 2020-09-08T16:46:48.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:48.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj90 /dev/null 2020-09-08T16:46:48.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:48.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj91 /dev/null 2020-09-08T16:46:48.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:48.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj92 /dev/null 2020-09-08T16:46:48.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:48.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj93 /dev/null 2020-09-08T16:46:48.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:48.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj94 /dev/null 2020-09-08T16:46:48.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:48.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj95 /dev/null 2020-09-08T16:46:49.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:49.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj96 /dev/null 2020-09-08T16:46:49.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:49.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj97 /dev/null 2020-09-08T16:46:49.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:49.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj98 /dev/null 2020-09-08T16:46:49.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:49.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj99 /dev/null 2020-09-08T16:46:49.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:49.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj100 /dev/null 2020-09-08T16:46:49.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:49.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj101 /dev/null 2020-09-08T16:46:50.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:50.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj102 /dev/null 2020-09-08T16:46:50.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:50.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj103 /dev/null 2020-09-08T16:46:50.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:50.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj104 /dev/null 2020-09-08T16:46:50.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:50.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj105 /dev/null 2020-09-08T16:46:50.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:50.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj106 /dev/null 2020-09-08T16:46:51.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:51.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj107 /dev/null 2020-09-08T16:46:51.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:51.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj108 /dev/null 2020-09-08T16:46:51.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:51.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj109 /dev/null 2020-09-08T16:46:51.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:51.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj110 /dev/null 2020-09-08T16:46:51.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:51.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj111 /dev/null 2020-09-08T16:46:52.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:52.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj112 /dev/null 2020-09-08T16:46:52.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:52.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj113 /dev/null 2020-09-08T16:46:52.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:52.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj114 /dev/null 2020-09-08T16:46:52.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:52.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj115 /dev/null 2020-09-08T16:46:52.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:52.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj116 /dev/null 2020-09-08T16:46:53.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:53.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj117 /dev/null 2020-09-08T16:46:53.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:53.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj118 /dev/null 2020-09-08T16:46:53.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:53.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj119 /dev/null 2020-09-08T16:46:53.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:53.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj120 /dev/null 2020-09-08T16:46:53.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:53.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj121 /dev/null 2020-09-08T16:46:53.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:53.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj122 /dev/null 2020-09-08T16:46:54.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:54.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj123 /dev/null 2020-09-08T16:46:54.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:54.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj124 /dev/null 2020-09-08T16:46:54.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:54.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj125 /dev/null 2020-09-08T16:46:54.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:54.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj126 /dev/null 2020-09-08T16:46:54.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:54.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj127 /dev/null 2020-09-08T16:46:54.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:54.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj128 /dev/null 2020-09-08T16:46:55.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:55.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj129 /dev/null 2020-09-08T16:46:55.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:55.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj130 /dev/null 2020-09-08T16:46:55.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:55.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj131 /dev/null 2020-09-08T16:46:55.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:55.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj132 /dev/null 2020-09-08T16:46:55.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:55.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj133 /dev/null 2020-09-08T16:46:56.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:56.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj134 /dev/null 2020-09-08T16:46:56.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:56.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj135 /dev/null 2020-09-08T16:46:56.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:56.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj136 /dev/null 2020-09-08T16:46:56.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:56.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj137 /dev/null 2020-09-08T16:46:56.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:56.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj138 /dev/null 2020-09-08T16:46:56.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:56.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj139 /dev/null 2020-09-08T16:46:57.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:57.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj140 /dev/null 2020-09-08T16:46:57.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:57.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj141 /dev/null 2020-09-08T16:46:57.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:57.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj142 /dev/null 2020-09-08T16:46:57.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:57.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj143 /dev/null 2020-09-08T16:46:57.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:57.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj144 /dev/null 2020-09-08T16:46:58.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:58.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj145 /dev/null 2020-09-08T16:46:58.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:58.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj146 /dev/null 2020-09-08T16:46:58.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:58.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj147 /dev/null 2020-09-08T16:46:58.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:58.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj148 /dev/null 2020-09-08T16:46:58.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:58.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj149 /dev/null 2020-09-08T16:46:58.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:58.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj150 /dev/null 2020-09-08T16:46:59.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:59.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj151 /dev/null 2020-09-08T16:46:59.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:59.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj152 /dev/null 2020-09-08T16:46:59.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:59.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj153 /dev/null 2020-09-08T16:46:59.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:59.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj154 /dev/null 2020-09-08T16:46:59.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:46:59.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj155 /dev/null 2020-09-08T16:47:00.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:00.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj156 /dev/null 2020-09-08T16:47:00.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:00.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj157 /dev/null 2020-09-08T16:47:00.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:00.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj158 /dev/null 2020-09-08T16:47:00.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:00.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj159 /dev/null 2020-09-08T16:47:00.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:00.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj160 /dev/null 2020-09-08T16:47:00.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:00.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj161 /dev/null 2020-09-08T16:47:01.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:01.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj162 /dev/null 2020-09-08T16:47:01.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:01.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj163 /dev/null 2020-09-08T16:47:01.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:01.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj164 /dev/null 2020-09-08T16:47:01.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:01.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj165 /dev/null 2020-09-08T16:47:01.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:01.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj166 /dev/null 2020-09-08T16:47:02.055 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:02.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj167 /dev/null 2020-09-08T16:47:02.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:02.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj168 /dev/null 2020-09-08T16:47:02.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:02.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj169 /dev/null 2020-09-08T16:47:02.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:02.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj170 /dev/null 2020-09-08T16:47:02.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:02.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj171 /dev/null 2020-09-08T16:47:02.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:02.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj172 /dev/null 2020-09-08T16:47:03.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:03.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj173 /dev/null 2020-09-08T16:47:03.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:03.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj174 /dev/null 2020-09-08T16:47:03.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:03.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj175 /dev/null 2020-09-08T16:47:03.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:03.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj176 /dev/null 2020-09-08T16:47:03.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:03.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj177 /dev/null 2020-09-08T16:47:04.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:04.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj178 /dev/null 2020-09-08T16:47:04.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:04.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj179 /dev/null 2020-09-08T16:47:04.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:04.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj180 /dev/null 2020-09-08T16:47:04.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:04.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj181 /dev/null 2020-09-08T16:47:04.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:04.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj182 /dev/null 2020-09-08T16:47:04.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:04.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj183 /dev/null 2020-09-08T16:47:05.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:05.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj184 /dev/null 2020-09-08T16:47:05.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:05.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj185 /dev/null 2020-09-08T16:47:05.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:05.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj186 /dev/null 2020-09-08T16:47:05.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:05.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj187 /dev/null 2020-09-08T16:47:06.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:06.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj188 /dev/null 2020-09-08T16:47:06.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:06.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj189 /dev/null 2020-09-08T16:47:06.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:06.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj190 /dev/null 2020-09-08T16:47:06.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:06.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj191 /dev/null 2020-09-08T16:47:06.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:06.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj192 /dev/null 2020-09-08T16:47:06.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:06.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj193 /dev/null 2020-09-08T16:47:07.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:07.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj194 /dev/null 2020-09-08T16:47:07.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:07.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj195 /dev/null 2020-09-08T16:47:07.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:07.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj196 /dev/null 2020-09-08T16:47:07.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:07.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj197 /dev/null 2020-09-08T16:47:07.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:07.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj198 /dev/null 2020-09-08T16:47:08.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:08.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj199 /dev/null 2020-09-08T16:47:08.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2020-09-08T16:47:08.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj200 /dev/null 2020-09-08T16:47:08.328 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:730: TEST_backfill_ec_down_out: get_pg test obj1 2020-09-08T16:47:08.329 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1031: get_pg: local poolname=test 2020-09-08T16:47:08.329 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: local objectname=obj1 2020-09-08T16:47:08.330 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: ceph --format json osd map test obj1 2020-09-08T16:47:08.330 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: jq -r .pgid 2020-09-08T16:47:08.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:730: TEST_backfill_ec_down_out: local PG=1.0 2020-09-08T16:47:08.736 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:732: TEST_backfill_ec_down_out: get_primary test obj1 2020-09-08T16:47:08.736 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:47:08.737 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:47:08.737 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:47:08.737 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:47:09.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:732: TEST_backfill_ec_down_out: local primary=1 2020-09-08T16:47:09.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:733: TEST_backfill_ec_down_out: get_not_primary test obj1 2020-09-08T16:47:09.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1167: get_not_primary: local poolname=test 2020-09-08T16:47:09.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: get_not_primary: local objectname=obj1 2020-09-08T16:47:09.204 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: get_primary test obj1 2020-09-08T16:47:09.205 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:47:09.205 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:47:09.206 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:47:09.206 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:47:09.599 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: local primary=1 2020-09-08T16:47:09.600 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1171: get_not_primary: ceph --format json osd map test obj1 2020-09-08T16:47:09.600 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1172: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2020-09-08T16:47:09.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:733: TEST_backfill_ec_down_out: local otherosd=0 2020-09-08T16:47:09.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:735: TEST_backfill_ec_down_out: ceph osd set nobackfill 2020-09-08T16:47:10.732 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is set 2020-09-08T16:47:10.740 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:736: TEST_backfill_ec_down_out: cat td/osd-backfill-stats/osd.0.pid 2020-09-08T16:47:10.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:736: TEST_backfill_ec_down_out: kill 522431 2020-09-08T16:47:10.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:737: TEST_backfill_ec_down_out: ceph osd down osd.0 2020-09-08T16:47:11.230 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already down. 2020-09-08T16:47:11.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:738: TEST_backfill_ec_down_out: ceph osd out osd.0 2020-09-08T16:47:11.836 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already out. 2020-09-08T16:47:11.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:740: TEST_backfill_ec_down_out: sleep 2 2020-09-08T16:47:13.846 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:741: TEST_backfill_ec_down_out: get_primary test obj1 2020-09-08T16:47:13.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:47:13.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:47:13.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:47:13.848 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:47:14.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:741: TEST_backfill_ec_down_out: primary=1 2020-09-08T16:47:14.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:742: TEST_backfill_ec_down_out: ceph osd unset nobackfill 2020-09-08T16:47:14.947 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is unset 2020-09-08T16:47:14.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:743: TEST_backfill_ec_down_out: ceph tell osd.1 get_latest_osdmap 2020-09-08T16:47:15.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:744: TEST_backfill_ec_down_out: ceph tell osd.1 debug kick_recovery_wq 0 2020-09-08T16:47:15.213 INFO:tasks.workunit.client.0.smithi065.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2020-09-08T16:47:15.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:745: TEST_backfill_ec_down_out: sleep 2 2020-09-08T16:47:17.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:747: TEST_backfill_ec_down_out: wait_for_clean 2020-09-08T16:47:17.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:47:17.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:47:17.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:47:17.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:47:17.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:47:17.225 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:47:17.233 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:47:17.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:47:17.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:47:17.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:47:17.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:47:17.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:47:17.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:47:17.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:47:17.334 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:47:17.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:47:17.731 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:47:17.731 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:47:17.731 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:47:17.731 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T16:47:17.731 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T16:47:17.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:47:17.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:47:17.732 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:47:17.848 INFO:tasks.workunit.client.0.smithi065.stderr:Error ENXIO: problem getting command descriptions from osd.0 2020-09-08T16:47:17.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq= 2020-09-08T16:47:17.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z '' 2020-09-08T16:47:17.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: continue 2020-09-08T16:47:17.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:47:17.850 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:47:17.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672982 2020-09-08T16:47:17.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672982 2020-09-08T16:47:17.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 1-42949672982' 2020-09-08T16:47:17.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:47:17.982 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:47:18.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=60129542165 2020-09-08T16:47:18.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 60129542165 2020-09-08T16:47:18.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 1-42949672982 2-60129542165' 2020-09-08T16:47:18.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:47:18.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:47:18.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=81604378643 2020-09-08T16:47:18.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 81604378643 2020-09-08T16:47:18.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 1-42949672982 2-60129542165 3-81604378643' 2020-09-08T16:47:18.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:47:18.243 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:47:18.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=103079215121 2020-09-08T16:47:18.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 103079215121 2020-09-08T16:47:18.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 1-42949672982 2-60129542165 3-81604378643 4-103079215121' 2020-09-08T16:47:18.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:47:18.374 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T16:47:18.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=124554051600 2020-09-08T16:47:18.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 124554051600 2020-09-08T16:47:18.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 1-42949672982 2-60129542165 3-81604378643 4-103079215121 5-124554051600' 2020-09-08T16:47:18.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:47:18.505 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672982 2020-09-08T16:47:18.506 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:47:18.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:47:18.506 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672982 2020-09-08T16:47:18.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:47:18.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672982 2020-09-08T16:47:18.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672982' 2020-09-08T16:47:18.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:47:18.508 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672982 2020-09-08T16:47:18.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672982 -lt 42949672982 2020-09-08T16:47:18.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:47:18.902 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-60129542165 2020-09-08T16:47:18.902 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:47:18.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:47:18.903 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-60129542165 2020-09-08T16:47:18.903 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:47:18.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=60129542165 2020-09-08T16:47:18.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 60129542165' 2020-09-08T16:47:18.905 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:47:18.905 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 60129542165 2020-09-08T16:47:19.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 60129542165 -lt 60129542165 2020-09-08T16:47:19.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:47:19.336 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-81604378643 2020-09-08T16:47:19.337 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:47:19.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:47:19.337 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-81604378643 2020-09-08T16:47:19.337 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:47:19.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=81604378643 2020-09-08T16:47:19.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 81604378643' 2020-09-08T16:47:19.338 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:47:19.339 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 81604378643 2020-09-08T16:47:19.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 81604378643 -lt 81604378643 2020-09-08T16:47:19.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:47:19.729 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-103079215121 2020-09-08T16:47:19.729 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:47:19.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:47:19.730 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-103079215121 2020-09-08T16:47:19.730 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:47:19.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=103079215121 2020-09-08T16:47:19.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 103079215121' 2020-09-08T16:47:19.731 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:47:19.732 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 103079215121 2020-09-08T16:47:20.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 103079215121 -lt 103079215121 2020-09-08T16:47:20.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:47:20.149 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-124554051600 2020-09-08T16:47:20.150 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:47:20.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T16:47:20.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-124554051600 2020-09-08T16:47:20.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:47:20.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=124554051600 2020-09-08T16:47:20.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 124554051600' 2020-09-08T16:47:20.152 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T16:47:20.152 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 124554051600 2020-09-08T16:47:20.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 124554051600 -lt 124554051600 2020-09-08T16:47:20.543 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:47:20.543 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:20.543 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:21.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T16:47:21.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:21.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:21.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:21.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:21.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:21.072 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:21.072 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:21.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:21.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:21.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:21.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:21.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:21.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T16:47:21.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T16:47:21.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T16:47:21.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:21.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:22.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:22.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:22.073 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:22.073 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:22.073 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:22.074 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:22.074 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:22.074 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:22.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:22.454 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:22.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:22.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:23.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:23.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:23.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:23.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:23.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:23.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:23.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:23.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:23.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:23.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:47:23.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:47:23.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:23.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:23.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:23.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:23.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:23.643 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:23.643 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:23.644 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:23.644 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:23.644 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:23.644 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:24.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:24.035 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:24.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:24.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:24.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:24.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:24.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:24.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:24.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:24.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:24.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:24.551 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:24.552 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:25.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T16:47:25.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T16:47:25.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:25.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:25.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:25.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:25.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:25.195 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:25.195 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:25.195 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:25.195 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:25.196 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:25.196 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:25.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:25.573 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:25.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:25.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:26.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:26.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:26.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:26.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:26.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:26.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:26.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:26.095 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:26.095 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:26.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T16:47:26.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T16:47:26.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:26.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:26.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:26.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:26.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:26.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:26.725 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:26.725 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:26.725 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:26.725 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:26.725 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:27.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:27.109 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:27.110 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:27.110 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:27.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:27.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:27.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:27.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:27.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:27.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:27.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:27.633 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:27.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:28.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:47:28.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:47:28.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:28.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:28.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:28.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:28.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:28.252 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:28.252 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:28.252 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:28.253 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:28.253 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:28.253 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:28.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:28.638 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:28.639 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:28.639 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:29.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:29.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:29.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:29.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:29.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:29.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:29.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:29.160 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:29.160 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:29.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:47:29.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:47:29.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:29.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:29.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:29.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:29.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:29.782 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:29.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:29.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:29.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:29.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:29.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:30.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:30.169 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:30.169 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:30.169 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:30.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:30.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:30.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:30.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:30.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:30.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:30.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:30.686 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:30.686 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:31.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:47:31.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:47:31.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:31.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:31.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:31.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:31.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:31.332 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:31.333 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:31.333 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:31.333 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:31.334 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:31.334 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:31.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:31.715 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:31.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:31.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:32.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:32.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:32.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:32.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:32.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:32.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:32.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:32.242 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:32.242 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:32.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:47:32.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:47:32.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:32.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:32.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:32.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:32.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:32.874 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:32.874 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:32.875 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:32.875 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:32.875 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:32.875 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:33.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:33.257 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:33.257 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:33.257 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:33.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:33.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:33.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:33.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:33.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:33.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:33.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:33.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:33.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:34.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:47:34.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:47:34.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:34.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:34.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:34.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:34.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:34.403 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:34.403 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:34.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:34.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:34.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:34.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:34.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:34.794 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:34.794 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:34.794 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:35.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:35.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:35.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:35.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:35.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:35.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:35.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:35.324 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:35.324 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:35.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:47:35.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:47:35.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:35.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:35.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:35.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:35.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:35.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:35.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:35.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:35.955 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:35.955 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:35.955 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:36.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:36.333 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:36.334 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:36.334 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:36.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:36.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:36.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:36.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:36.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:36.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:36.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:36.865 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:36.866 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:37.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=6 2020-09-08T16:47:37.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 6 '!=' null 2020-09-08T16:47:37.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:37.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:37.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:37.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:37.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:37.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:37.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:37.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:37.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:37.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:37.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:37.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:37.870 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:37.871 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:37.871 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:38.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:38.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:38.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:38.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:38.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:38.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:38.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:38.392 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:38.392 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:38.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:47:38.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:47:38.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:38.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:38.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:39.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:39.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:39.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:39.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:39.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:39.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:39.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:39.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:39.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:39.444 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:39.444 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:39.445 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:39.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:39.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:39.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:39.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:39.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:39.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:39.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:39.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:39.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:40.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:47:40.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:47:40.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:40.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:40.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:40.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:40.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:40.588 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:40.588 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:40.588 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:40.589 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:40.589 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:40.589 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:40.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:40.977 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:40.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:40.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:41.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:41.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:41.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:41.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:41.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:41.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:41.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:41.495 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:41.495 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:42.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=6 2020-09-08T16:47:42.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 6 '!=' null 2020-09-08T16:47:42.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:42.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:42.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:42.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:42.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:42.152 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:42.152 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:42.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:42.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:42.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:42.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:42.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:42.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:42.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:42.540 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:43.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:43.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:43.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:43.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:43.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:43.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:43.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:43.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:43.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:43.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:47:43.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:47:43.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:43.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:43.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:43.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:43.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:43.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:43.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:43.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:43.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:43.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:43.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:44.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:44.066 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:44.067 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:44.067 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:44.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:44.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:44.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:44.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:44.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:44.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:44.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:44.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:44.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:45.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:47:45.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:47:45.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:45.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:45.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:45.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:45.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:45.242 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:45.242 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:45.242 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:45.242 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:45.242 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:45.243 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:45.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:45.620 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:45.621 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:45.621 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:46.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:46.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:46.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:46.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:46.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:46.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:46.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:46.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:46.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:46.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:47:46.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:47:46.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:46.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:46.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:46.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:46.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:46.884 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:46.884 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:46.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:46.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:46.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:46.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:47.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:47.293 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:47.294 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:47.294 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:47.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:47.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:47.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:47.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:47.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:47.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:47.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:47.815 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:47.815 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:48.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=6 2020-09-08T16:47:48.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 6 '!=' null 2020-09-08T16:47:48.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:48.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:48.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:48.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:48.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:48.458 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:48.458 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:48.458 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:48.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:48.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:48.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:48.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:48.840 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:48.840 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:48.840 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:49.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:49.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:49.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:49.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:49.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:49.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:49.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:49.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:49.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:49.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:47:49.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:47:49.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:49.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:49.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:49.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:49.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:49.999 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:49.999 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:49.999 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:50.000 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:50.000 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:50.000 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:50.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:50.390 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:50.390 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:50.391 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:50.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:50.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:50.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:50.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:50.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:50.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:50.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:50.912 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:50.912 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:51.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=6 2020-09-08T16:47:51.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 6 '!=' null 2020-09-08T16:47:51.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:51.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:51.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:51.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:51.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:51.540 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:51.540 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:51.540 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:51.540 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:51.540 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:51.541 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:51.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:51.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:51.933 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:51.933 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:52.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:52.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:52.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:52.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:52.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:52.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:52.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:52.462 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:52.462 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:52.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:47:52.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:47:52.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:52.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:52.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:53.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:53.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:53.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:53.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:53.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:53.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:53.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:53.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:53.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:53.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:53.470 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:53.470 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:53.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:53.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:53.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:53.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:53.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:53.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:54.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:54.000 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:54.000 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:54.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:47:54.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:47:54.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:54.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:54.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:54.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:54.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:54.642 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:54.642 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:54.642 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:54.642 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:54.643 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:54.643 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:55.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:55.029 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:55.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:55.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:55.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:55.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:55.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:55.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:55.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:55.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:55.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:55.552 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:55.552 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:56.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:47:56.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:47:56.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:56.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:56.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:56.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:56.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:56.354 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:56.354 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:56.355 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:56.355 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:56.355 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:56.355 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:56.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:47:56.567 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:56.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:56.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:57.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:47:57.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:47:57.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:47:57.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:47:57.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:47:57.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:47:57.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:47:57.119 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:47:57.119 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:47:57.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:47:57.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:47:57.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:47:57.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:47:57.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:47:57.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:47:57.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:47:57.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:47:57.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:47:57.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:47:57.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:47:57.759 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:47:57.759 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:47:58.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T16:47:58.139 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:47:58.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:47:58.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:47:58.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T16:47:58.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:47:58.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:47:58.672 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:749: TEST_backfill_ec_down_out: expr 200 '*' 2 2020-09-08T16:47:58.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:749: TEST_backfill_ec_down_out: local misplaced=400 2020-09-08T16:47:58.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:750: TEST_backfill_ec_down_out: check td/osd-backfill-stats 1.0 1 erasure 200 0 0 0 2020-09-08T16:47:58.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2020-09-08T16:47:58.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:64: check: local PG=1.0 2020-09-08T16:47:58.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:65: check: local primary=1 2020-09-08T16:47:58.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:66: check: local type=erasure 2020-09-08T16:47:58.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:67: check: local degraded_start=200 2020-09-08T16:47:58.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:68: check: local degraded_end=0 2020-09-08T16:47:58.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:69: check: local misplaced_start=0 2020-09-08T16:47:58.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:70: check: local misplaced_end=0 2020-09-08T16:47:58.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:71: check: local primary_start= 2020-09-08T16:47:58.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:72: check: local primary_end= 2020-09-08T16:47:58.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:73: check: local check_setup=true 2020-09-08T16:47:58.676 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2020-09-08T16:47:58.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2020-09-08T16:47:58.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:76: check: '[' true = true ']' 2020-09-08T16:47:58.678 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log td/osd-backfill-stats/osd.5.log 2020-09-08T16:47:58.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2020-09-08T16:47:58.690 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2020-09-08T16:47:58.690 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: wc -w 2020-09-08T16:47:58.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2020-09-08T16:47:58.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:86: check: local 'addp= ' 2020-09-08T16:47:58.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:87: check: '[' erasure = erasure ']' 2020-09-08T16:47:58.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:89: check: addp=p 2020-09-08T16:47:58.692 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2020-09-08T16:47:58.692 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:47:58.693 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: tail -1 2020-09-08T16:47:58.693 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2020-09-08T16:47:58.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: UPACT='[1,3,2]/[1,NONE,2]' 2020-09-08T16:47:58.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:93: check: '[' -n '[1,3,2]/[1,NONE,2]' ']' 2020-09-08T16:47:58.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:96: check: local which=degraded 2020-09-08T16:47:58.709 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:47:58.709 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:47:58.710 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -F ' [1,3,2]/[1,NONE,2]p' 2020-09-08T16:47:58.710 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -v est 2020-09-08T16:47:58.711 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: head -1 2020-09-08T16:47:58.711 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:47:58.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: FIRST=200 2020-09-08T16:47:58.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:98: check: '[' -n 200 ']' 2020-09-08T16:47:58.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:99: check: below_margin 200 200 2020-09-08T16:47:58.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=200 2020-09-08T16:47:58.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T16:47:58.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=200 2020-09-08T16:47:58.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T16:47:58.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:47:58.717 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:47:58.718 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: tail -1 2020-09-08T16:47:58.718 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:47:58.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: LAST=1 2020-09-08T16:47:58.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:101: check: '[' -n 1 ']' 2020-09-08T16:47:58.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:102: check: above_margin 1 0 2020-09-08T16:47:58.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=1 2020-09-08T16:47:58.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T16:47:58.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=0 2020-09-08T16:47:58.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T16:47:58.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:105: check: which=misplaced 2020-09-08T16:47:58.729 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:47:58.730 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:47:58.730 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -F ' [1,3,2]/[1,NONE,2]p' 2020-09-08T16:47:58.730 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -v est 2020-09-08T16:47:58.730 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: head -1 2020-09-08T16:47:58.731 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:47:58.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: FIRST=0 2020-09-08T16:47:58.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:107: check: '[' -n 0 ']' 2020-09-08T16:47:58.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:108: check: below_margin 0 0 2020-09-08T16:47:58.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=0 2020-09-08T16:47:58.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T16:47:58.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=0 2020-09-08T16:47:58.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T16:47:58.736 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:47:58.736 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:47:58.737 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: tail -1 2020-09-08T16:47:58.737 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:47:58.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: LAST=0 2020-09-08T16:47:58.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:110: check: '[' -n 0 ']' 2020-09-08T16:47:58.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:111: check: above_margin 0 0 2020-09-08T16:47:58.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=0 2020-09-08T16:47:58.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T16:47:58.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=0 2020-09-08T16:47:58.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T16:47:58.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2020-09-08T16:47:58.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:752: TEST_backfill_ec_down_out: delete_pool test 2020-09-08T16:47:58.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test 2020-09-08T16:47:58.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2020-09-08T16:47:59.288 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' does not exist 2020-09-08T16:47:59.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:753: TEST_backfill_ec_down_out: kill_daemons td/osd-backfill-stats 2020-09-08T16:47:59.297 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:47:59.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:47:59.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:47:59.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:47:59.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:47:59.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:47:59.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2020-09-08T16:47:59.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T16:47:59.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:47:59.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T16:47:59.610 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:47:59.610 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:47:59.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:47:59.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:47:59.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:47:59.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:47:59.616 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:47:59.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:47:59.617 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:47:59.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:47:59.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:47:59.618 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:47:59.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:47:59.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:47:59.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:47:59.621 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:47:59.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:47:59.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:47:59.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T16:47:59.639 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:47:59.639 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:47:59.639 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:47:59.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T16:47:59.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:47:59.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:47:59.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:35: run: for func in $funcs 2020-09-08T16:47:59.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2020-09-08T16:47:59.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2020-09-08T16:47:59.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2020-09-08T16:47:59.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T16:47:59.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:47:59.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T16:47:59.643 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:47:59.643 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:47:59.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:47:59.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:47:59.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:47:59.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:47:59.646 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:47:59.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:47:59.647 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:47:59.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:47:59.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:47:59.647 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:47:59.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:47:59.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:47:59.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:47:59.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:47:59.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:47:59.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:47:59.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T16:47:59.650 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:47:59.650 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:47:59.651 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:47:59.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T16:47:59.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:47:59.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:47:59.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2020-09-08T16:47:59.653 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T16:47:59.653 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:47:59.653 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:47:59.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.482138 2020-09-08T16:47:59.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T16:47:59.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T16:47:59.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T16:47:59.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2020-09-08T16:47:59.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:37: run: TEST_backfill_ec_prim_out td/osd-backfill-stats 2020-09-08T16:47:59.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:569: TEST_backfill_ec_prim_out: local dir=td/osd-backfill-stats 2020-09-08T16:47:59.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:571: TEST_backfill_ec_prim_out: run_mon td/osd-backfill-stats a 2020-09-08T16:47:59.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2020-09-08T16:47:59.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T16:47:59.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T16:47:59.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T16:47:59.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2020-09-08T16:47:59.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2020-09-08T16:47:59.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T16:47:59.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:47:59.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:47:59.945 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:47:59.946 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:47:59.946 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:47:59.946 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:47:59.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T16:48:00.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T16:48:00.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T16:48:00.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:48:00.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:48:00.123 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T16:48:00.123 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T16:48:00.124 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:48:00.124 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:48:00.124 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:48:00.125 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:48:00.125 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:48:00.125 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:48:00.125 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T16:48:00.125 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:48:00.126 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get fsid 2020-09-08T16:48:00.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T16:48:00.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:48:00.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:48:00.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T16:48:00.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T16:48:00.223 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:48:00.223 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:48:00.224 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:48:00.224 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:48:00.224 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:48:00.224 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:48:00.225 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T16:48:00.225 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:48:00.225 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get mon_host 2020-09-08T16:48:00.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:572: TEST_backfill_ec_prim_out: run_mgr td/osd-backfill-stats x 2020-09-08T16:48:00.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-stats 2020-09-08T16:48:00.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T16:48:00.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T16:48:00.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T16:48:00.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-stats/x 2020-09-08T16:48:00.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T16:48:00.837 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T16:48:00.837 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:48:00.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:48:00.838 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:48:00.838 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:48:00.838 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:48:00.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:48:00.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:48:00.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:48:00.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:573: TEST_backfill_ec_prim_out: run_osd td/osd-backfill-stats 0 2020-09-08T16:48:00.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:48:00.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:48:00.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T16:48:00.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:48:00.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/0 2020-09-08T16:48:00.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:48:00.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:48:00.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:48:00.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:48:00.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2020-09-08T16:48:00.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2020-09-08T16:48:00.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:48:00.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:48:00.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:48:00.868 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:48:00.868 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:48:00.868 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:48:00.868 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:48:00.868 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:48:00.869 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:48:00.869 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:48:00.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:48:00.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:48:00.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:48:00.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:48:00.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:48:00.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:48:00.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:48:00.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:48:00.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:48:00.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:48:00.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:48:00.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/0 2020-09-08T16:48:00.872 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:48:00.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=ce28e517-8a10-447f-b16b-a9fdc3145df3 2020-09-08T16:48:00.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 ce28e517-8a10-447f-b16b-a9fdc3145df3' 2020-09-08T16:48:00.873 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:48:00.873 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 ce28e517-8a10-447f-b16b-a9fdc3145df3 2020-09-08T16:48:00.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDAtVdfK7PdNBAAghCeaNIYdgOXO2w2ZxIz4w== 2020-09-08T16:48:00.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDAtVdfK7PdNBAAghCeaNIYdgOXO2w2ZxIz4w=="}' 2020-09-08T16:48:00.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new ce28e517-8a10-447f-b16b-a9fdc3145df3 -i td/osd-backfill-stats/0/new.json 2020-09-08T16:48:01.224 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:48:01.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/0/new.json 2020-09-08T16:48:01.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDAtVdfK7PdNBAAghCeaNIYdgOXO2w2ZxIz4w== --osd-uuid ce28e517-8a10-447f-b16b-a9fdc3145df3 2020-09-08T16:48:01.262 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:01.264+0000 7f75ff689ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:01.263 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:01.266+0000 7f75ff689ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:01.264 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:01.268+0000 7f75ff689ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:01.264 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:01.268+0000 7f75ff689ec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:48:01.264 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:01.268+0000 7f75ff689ec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:48:01.264 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:01.268+0000 7f75ff689ec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:48:01.319 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:01.324+0000 7f75ff689ec0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2020-09-08T16:48:05.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2020-09-08T16:48:05.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:48:05.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T16:48:05.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:48:05.550 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T16:48:06.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T16:48:06.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:48:06.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:48:06.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:48:06.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:48:06.083 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T16:48:06.105 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:06.109+0000 7fd7228acec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:06.107 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:06.111+0000 7fd7228acec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:06.109 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:06.113+0000 7fd7228acec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:06.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T16:48:06.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:48:06.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T16:48:06.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:48:06.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:48:06.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:48:06.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:48:06.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:48:06.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:48:06.480 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:48:06.634 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:06.638+0000 7fd7228acec0 -1 Falling back to public interface 2020-09-08T16:48:06.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:48:07.475 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:07.479+0000 7fd7228acec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T16:48:07.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:48:07.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:48:07.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:48:07.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:48:07.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:48:07.912 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:48:08.316 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/536095,v1:127.0.0.1:6803/536095] [v2:127.0.0.1:6804/536095,v1:127.0.0.1:6805/536095] exists,up ce28e517-8a10-447f-b16b-a9fdc3145df3 2020-09-08T16:48:08.317 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 2cdcfaf0-e375-4212-923a-89a1653f5886 2020-09-08T16:48:08.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:48:08.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:48:08.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:48:08.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:574: TEST_backfill_ec_prim_out: run_osd td/osd-backfill-stats 1 2020-09-08T16:48:08.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:48:08.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:48:08.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T16:48:08.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:48:08.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/1 2020-09-08T16:48:08.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:48:08.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:48:08.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:48:08.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:48:08.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2020-09-08T16:48:08.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2020-09-08T16:48:08.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:48:08.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:48:08.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:48:08.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:48:08.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:48:08.322 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:48:08.322 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:48:08.322 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:48:08.322 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:48:08.322 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:48:08.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:48:08.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:48:08.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:48:08.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:48:08.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:48:08.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:48:08.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:48:08.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:48:08.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:48:08.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:48:08.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:48:08.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/1 2020-09-08T16:48:08.325 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:48:08.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=2cdcfaf0-e375-4212-923a-89a1653f5886 2020-09-08T16:48:08.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 2cdcfaf0-e375-4212-923a-89a1653f5886' 2020-09-08T16:48:08.326 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:48:08.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDItVdfW2EcFBAAnV948hMj5aSjQSs1oe4CIg== 2020-09-08T16:48:08.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDItVdfW2EcFBAAnV948hMj5aSjQSs1oe4CIg=="}' 2020-09-08T16:48:08.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 2cdcfaf0-e375-4212-923a-89a1653f5886 -i td/osd-backfill-stats/1/new.json 2020-09-08T16:48:08.857 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:48:08.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/1/new.json 2020-09-08T16:48:08.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDItVdfW2EcFBAAnV948hMj5aSjQSs1oe4CIg== --osd-uuid 2cdcfaf0-e375-4212-923a-89a1653f5886 2020-09-08T16:48:08.894 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:08.899+0000 7fa16c08fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:08.896 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:08.901+0000 7fa16c08fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:08.898 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:08.903+0000 7fa16c08fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:08.898 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:08.903+0000 7fa16c08fec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:48:08.899 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:08.903+0000 7fa16c08fec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:48:08.899 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:08.903+0000 7fa16c08fec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:48:08.939 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:08.944+0000 7fa16c08fec0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2020-09-08T16:48:12.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2020-09-08T16:48:12.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:48:12.922 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T16:48:12.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T16:48:12.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:48:13.452 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T16:48:13.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T16:48:13.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:48:13.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:48:13.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:48:13.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:48:13.478 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:13.481+0000 7f9f8b6e0ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:13.486 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:13.491+0000 7f9f8b6e0ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:13.488 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:13.492+0000 7f9f8b6e0ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:13.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T16:48:13.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:48:13.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T16:48:13.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:48:13.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:48:13.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:48:13.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:48:13.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:48:13.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:48:13.843 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:48:14.009 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:14.014+0000 7f9f8b6e0ec0 -1 Falling back to public interface 2020-09-08T16:48:14.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:48:14.836 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:14.841+0000 7f9f8b6e0ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T16:48:15.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:48:15.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:48:15.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:48:15.263 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:48:15.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:48:15.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:48:15.671 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/537089,v1:127.0.0.1:6811/537089] [v2:127.0.0.1:6812/537089,v1:127.0.0.1:6813/537089] exists,up 2cdcfaf0-e375-4212-923a-89a1653f5886 2020-09-08T16:48:15.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:48:15.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:48:15.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:48:15.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:575: TEST_backfill_ec_prim_out: run_osd td/osd-backfill-stats 2 2020-09-08T16:48:15.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:48:15.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:48:15.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T16:48:15.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:48:15.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/2 2020-09-08T16:48:15.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:48:15.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:48:15.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:48:15.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:48:15.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2020-09-08T16:48:15.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2020-09-08T16:48:15.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:48:15.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:48:15.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:48:15.675 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:48:15.675 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:48:15.675 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:48:15.676 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:48:15.676 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:48:15.676 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:48:15.676 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:48:15.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:48:15.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:48:15.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:48:15.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:48:15.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:48:15.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:48:15.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:48:15.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:48:15.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:48:15.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:48:15.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:48:15.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/2 2020-09-08T16:48:15.679 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:48:15.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=13bcb1e4-6b37-48b5-bff2-f11494096b9f 2020-09-08T16:48:15.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 13bcb1e4-6b37-48b5-bff2-f11494096b9f' 2020-09-08T16:48:15.681 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:48:15.681 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 13bcb1e4-6b37-48b5-bff2-f11494096b9f 2020-09-08T16:48:15.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDPtVdfDFpIKRAAFgQM5pGgTx173mpMERK0Tg== 2020-09-08T16:48:15.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDPtVdfDFpIKRAAFgQM5pGgTx173mpMERK0Tg=="}' 2020-09-08T16:48:15.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 13bcb1e4-6b37-48b5-bff2-f11494096b9f -i td/osd-backfill-stats/2/new.json 2020-09-08T16:48:16.269 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:48:16.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/2/new.json 2020-09-08T16:48:16.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDPtVdfDFpIKRAAFgQM5pGgTx173mpMERK0Tg== --osd-uuid 13bcb1e4-6b37-48b5-bff2-f11494096b9f 2020-09-08T16:48:16.305 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:16.310+0000 7f8aba64bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:16.307 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:16.312+0000 7f8aba64bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:16.309 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:16.314+0000 7f8aba64bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:16.310 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:16.314+0000 7f8aba64bec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:48:16.311 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:16.315+0000 7f8aba64bec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:48:16.311 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:16.315+0000 7f8aba64bec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:48:16.360 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:16.365+0000 7f8aba64bec0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2020-09-08T16:48:20.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2020-09-08T16:48:20.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:48:20.586 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T16:48:20.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T16:48:20.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:48:21.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T16:48:21.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:48:21.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:48:21.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:48:21.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:48:21.130 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T16:48:21.153 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:21.157+0000 7fa7fe4ddec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:21.154 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:21.159+0000 7fa7fe4ddec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:21.155 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:21.160+0000 7fa7fe4ddec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:21.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T16:48:21.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:48:21.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T16:48:21.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:48:21.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:48:21.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:48:21.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:48:21.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:48:21.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:48:21.550 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:48:21.673 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:21.677+0000 7fa7fe4ddec0 -1 Falling back to public interface 2020-09-08T16:48:21.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:48:22.458 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:22.462+0000 7fa7fe4ddec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T16:48:22.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:48:22.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:48:22.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:48:22.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:48:22.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:48:22.962 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:48:23.376 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/538083,v1:127.0.0.1:6819/538083] [v2:127.0.0.1:6820/538083,v1:127.0.0.1:6821/538083] exists,up 13bcb1e4-6b37-48b5-bff2-f11494096b9f 2020-09-08T16:48:23.376 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 d5fb3985-befd-4ee7-b000-c6080297b661 2020-09-08T16:48:23.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:48:23.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:48:23.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:48:23.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:576: TEST_backfill_ec_prim_out: run_osd td/osd-backfill-stats 3 2020-09-08T16:48:23.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:48:23.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:48:23.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T16:48:23.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:48:23.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/3 2020-09-08T16:48:23.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:48:23.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:48:23.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:48:23.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:48:23.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2020-09-08T16:48:23.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2020-09-08T16:48:23.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:48:23.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:48:23.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:48:23.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:48:23.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:48:23.382 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:48:23.382 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:48:23.382 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:48:23.382 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:48:23.383 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:48:23.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:48:23.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:48:23.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:48:23.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:48:23.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:48:23.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:48:23.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:48:23.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:48:23.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:48:23.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:48:23.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:48:23.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/3 2020-09-08T16:48:23.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:48:23.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=d5fb3985-befd-4ee7-b000-c6080297b661 2020-09-08T16:48:23.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 d5fb3985-befd-4ee7-b000-c6080297b661' 2020-09-08T16:48:23.387 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:48:23.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDXtVdfmmOgFxAApTB791d2gMkYZyyehqKj8Q== 2020-09-08T16:48:23.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDXtVdfmmOgFxAApTB791d2gMkYZyyehqKj8Q=="}' 2020-09-08T16:48:23.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new d5fb3985-befd-4ee7-b000-c6080297b661 -i td/osd-backfill-stats/3/new.json 2020-09-08T16:48:23.915 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T16:48:23.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/3/new.json 2020-09-08T16:48:23.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDXtVdfmmOgFxAApTB791d2gMkYZyyehqKj8Q== --osd-uuid d5fb3985-befd-4ee7-b000-c6080297b661 2020-09-08T16:48:23.952 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:23.957+0000 7fa43dbe8ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:23.953 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:23.958+0000 7fa43dbe8ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:23.955 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:23.960+0000 7fa43dbe8ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:23.956 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:23.960+0000 7fa43dbe8ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:48:23.956 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:23.961+0000 7fa43dbe8ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:48:23.956 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:23.961+0000 7fa43dbe8ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:48:23.998 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:24.003+0000 7fa43dbe8ec0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2020-09-08T16:48:28.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2020-09-08T16:48:28.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:48:28.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T16:48:28.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:48:28.197 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T16:48:28.739 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T16:48:28.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T16:48:28.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:48:28.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:48:28.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:48:28.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:48:28.762 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:28.767+0000 7f2cfdd4cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:28.779 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:28.784+0000 7f2cfdd4cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:28.780 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:28.785+0000 7f2cfdd4cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:29.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T16:48:29.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:48:29.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T16:48:29.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:48:29.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:48:29.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:48:29.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:48:29.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:48:29.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:48:29.136 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:48:29.301 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:29.306+0000 7f2cfdd4cec0 -1 Falling back to public interface 2020-09-08T16:48:29.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:48:30.082 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:30.087+0000 7f2cfdd4cec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T16:48:30.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:48:30.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:48:30.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:48:30.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:48:30.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:48:30.552 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:48:30.976 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/539077,v1:127.0.0.1:6827/539077] [v2:127.0.0.1:6828/539077,v1:127.0.0.1:6829/539077] exists,up d5fb3985-befd-4ee7-b000-c6080297b661 2020-09-08T16:48:30.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:48:30.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:48:30.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:48:30.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:577: TEST_backfill_ec_prim_out: run_osd td/osd-backfill-stats 4 2020-09-08T16:48:30.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:48:30.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:48:30.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=4 2020-09-08T16:48:30.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:48:30.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/4 2020-09-08T16:48:30.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:48:30.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:48:30.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:48:30.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:48:30.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2020-09-08T16:48:30.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2020-09-08T16:48:30.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:48:30.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:48:30.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:48:30.980 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:48:30.980 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:48:30.980 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:48:30.980 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:48:30.980 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:48:30.981 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:48:30.981 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:48:30.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:48:30.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:48:30.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:48:30.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:48:30.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:48:30.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:48:30.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:48:30.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:48:30.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:48:30.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:48:30.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:48:30.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/4 2020-09-08T16:48:30.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:48:30.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=3942ebe0-47e7-4033-b6fc-ffa8e583abd8 2020-09-08T16:48:30.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd4 3942ebe0-47e7-4033-b6fc-ffa8e583abd8' 2020-09-08T16:48:30.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:48:30.985 INFO:tasks.workunit.client.0.smithi065.stdout:add osd4 3942ebe0-47e7-4033-b6fc-ffa8e583abd8 2020-09-08T16:48:30.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDetVdfCsZ3OxAAZzmXRDVBioorsZsrzV1cTA== 2020-09-08T16:48:30.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDetVdfCsZ3OxAAZzmXRDVBioorsZsrzV1cTA=="}' 2020-09-08T16:48:30.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 3942ebe0-47e7-4033-b6fc-ffa8e583abd8 -i td/osd-backfill-stats/4/new.json 2020-09-08T16:48:31.497 INFO:tasks.workunit.client.0.smithi065.stdout:4 2020-09-08T16:48:31.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/4/new.json 2020-09-08T16:48:31.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 4 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDetVdfCsZ3OxAAZzmXRDVBioorsZsrzV1cTA== --osd-uuid 3942ebe0-47e7-4033-b6fc-ffa8e583abd8 2020-09-08T16:48:31.534 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:31.538+0000 7ff999f57ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:31.535 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:31.540+0000 7ff999f57ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:31.537 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:31.542+0000 7ff999f57ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:31.538 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:31.542+0000 7ff999f57ec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:48:31.538 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:31.542+0000 7ff999f57ec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:48:31.538 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:31.542+0000 7ff999f57ec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:48:31.582 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:31.587+0000 7ff999f57ec0 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2020-09-08T16:48:36.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2020-09-08T16:48:36.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:48:36.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd4 key to auth repository 2020-09-08T16:48:36.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:48:36.109 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd4 key to auth repository 2020-09-08T16:48:36.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.4 2020-09-08T16:48:36.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 4 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:48:36.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:48:36.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:48:36.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:48:36.645 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.4 2020-09-08T16:48:36.667 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:36.672+0000 7f37386cdec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:36.686 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:36.686+0000 7f37386cdec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:36.686 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:36.687+0000 7f37386cdec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:48:37.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 4 2020-09-08T16:48:37.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:48:37.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=4 2020-09-08T16:48:37.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:48:37.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:48:37.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:48:37.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:48:37.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:48:37.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:48:37.042 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:48:37.201 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:37.206+0000 7f37386cdec0 -1 Falling back to public interface 2020-09-08T16:48:37.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:48:38.049 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:48:38.053+0000 7f37386cdec0 -1 osd.4 0 log_to_monitors {default=true} 2020-09-08T16:48:38.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:48:38.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:48:38.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:48:38.433 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:48:38.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:48:38.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:48:38.846 INFO:tasks.workunit.client.0.smithi065.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/540071,v1:127.0.0.1:6835/540071] [v2:127.0.0.1:6836/540071,v1:127.0.0.1:6837/540071] exists,up 3942ebe0-47e7-4033-b6fc-ffa8e583abd8 2020-09-08T16:48:38.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:48:38.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:48:38.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:48:38.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:579: TEST_backfill_ec_prim_out: ceph osd erasure-code-profile set myprofile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2020-09-08T16:48:39.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:580: TEST_backfill_ec_prim_out: create_pool test 1 1 erasure myprofile 2020-09-08T16:48:39.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test 1 1 erasure myprofile 2020-09-08T16:48:40.260 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' already exists 2020-09-08T16:48:40.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:48:41.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:582: TEST_backfill_ec_prim_out: wait_for_clean 2020-09-08T16:48:41.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:48:41.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:48:41.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:48:41.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:48:41.271 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:48:41.272 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:48:41.272 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:48:41.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:48:41.273 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:48:41.273 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:48:41.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:48:41.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:48:41.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:48:41.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:48:41.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:48:41.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:48:41.852 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:48:41.852 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:48:41.853 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:48:41.853 INFO:tasks.workunit.client.0.smithi065.stderr:4' 2020-09-08T16:48:41.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:48:41.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:48:41.853 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:48:41.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836489 2020-09-08T16:48:41.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836489 2020-09-08T16:48:41.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836489' 2020-09-08T16:48:41.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:48:41.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:48:42.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672968 2020-09-08T16:48:42.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672968 2020-09-08T16:48:42.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836489 1-42949672968' 2020-09-08T16:48:42.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:48:42.115 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:48:42.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509446 2020-09-08T16:48:42.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509446 2020-09-08T16:48:42.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836489 1-42949672968 2-64424509446' 2020-09-08T16:48:42.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:48:42.246 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:48:42.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345925 2020-09-08T16:48:42.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345925 2020-09-08T16:48:42.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836489 1-42949672968 2-64424509446 3-85899345925' 2020-09-08T16:48:42.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:48:42.376 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:48:42.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182403 2020-09-08T16:48:42.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182403 2020-09-08T16:48:42.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836489 1-42949672968 2-64424509446 3-85899345925 4-107374182403' 2020-09-08T16:48:42.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:48:42.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836489 2020-09-08T16:48:42.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:48:42.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:48:42.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836489 2020-09-08T16:48:42.508 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:48:42.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836489 2020-09-08T16:48:42.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836489' 2020-09-08T16:48:42.509 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:48:42.509 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836489 2020-09-08T16:48:42.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836489 -lt 21474836489 2020-09-08T16:48:42.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:48:42.898 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672968 2020-09-08T16:48:42.898 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:48:42.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:48:42.899 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672968 2020-09-08T16:48:42.899 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:48:42.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672968 2020-09-08T16:48:42.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672968' 2020-09-08T16:48:42.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:48:42.901 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672968 2020-09-08T16:48:43.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672968 -lt 42949672968 2020-09-08T16:48:43.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:48:43.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509446 2020-09-08T16:48:43.324 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:48:43.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:48:43.324 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509446 2020-09-08T16:48:43.325 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:48:43.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509446 2020-09-08T16:48:43.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509446' 2020-09-08T16:48:43.326 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:48:43.326 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509446 2020-09-08T16:48:43.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509446 -lt 64424509446 2020-09-08T16:48:43.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:48:43.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345925 2020-09-08T16:48:43.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:48:43.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:48:43.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345925 2020-09-08T16:48:43.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:48:43.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345925 2020-09-08T16:48:43.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345925' 2020-09-08T16:48:43.718 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:48:43.719 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345925 2020-09-08T16:48:44.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345925 -lt 85899345925 2020-09-08T16:48:44.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:48:44.110 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182403 2020-09-08T16:48:44.110 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:48:44.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:48:44.111 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182403 2020-09-08T16:48:44.111 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:48:44.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182403 2020-09-08T16:48:44.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182403' 2020-09-08T16:48:44.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:48:44.113 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182403 2020-09-08T16:48:44.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182403 -lt 107374182403 2020-09-08T16:48:44.503 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:48:44.504 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:48:44.504 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:48:45.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T16:48:45.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:48:45.045 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:48:45.046 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:48:45.046 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:48:45.046 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:48:45.047 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:48:45.047 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:48:45.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T16:48:45.433 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:48:45.433 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:48:45.433 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:48:45.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T16:48:45.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:48:45.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:48:45.956 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: seq 1 200 2020-09-08T16:48:45.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:45.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj1 /dev/null 2020-09-08T16:48:46.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:46.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj2 /dev/null 2020-09-08T16:48:46.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:46.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj3 /dev/null 2020-09-08T16:48:46.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:46.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj4 /dev/null 2020-09-08T16:48:46.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:46.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj5 /dev/null 2020-09-08T16:48:46.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:46.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj6 /dev/null 2020-09-08T16:48:47.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:47.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj7 /dev/null 2020-09-08T16:48:47.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:47.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj8 /dev/null 2020-09-08T16:48:47.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:47.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj9 /dev/null 2020-09-08T16:48:47.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:47.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj10 /dev/null 2020-09-08T16:48:47.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:47.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj11 /dev/null 2020-09-08T16:48:48.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:48.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj12 /dev/null 2020-09-08T16:48:48.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:48.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj13 /dev/null 2020-09-08T16:48:48.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:48.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj14 /dev/null 2020-09-08T16:48:48.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:48.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj15 /dev/null 2020-09-08T16:48:48.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:48.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj16 /dev/null 2020-09-08T16:48:48.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:48.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj17 /dev/null 2020-09-08T16:48:49.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:49.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj18 /dev/null 2020-09-08T16:48:49.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:49.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj19 /dev/null 2020-09-08T16:48:49.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:49.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj20 /dev/null 2020-09-08T16:48:49.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:49.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj21 /dev/null 2020-09-08T16:48:49.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:49.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj22 /dev/null 2020-09-08T16:48:50.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:50.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj23 /dev/null 2020-09-08T16:48:50.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:50.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj24 /dev/null 2020-09-08T16:48:50.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:50.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj25 /dev/null 2020-09-08T16:48:50.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:50.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj26 /dev/null 2020-09-08T16:48:50.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:50.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj27 /dev/null 2020-09-08T16:48:50.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:50.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj28 /dev/null 2020-09-08T16:48:51.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:51.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj29 /dev/null 2020-09-08T16:48:51.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:51.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj30 /dev/null 2020-09-08T16:48:51.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:51.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj31 /dev/null 2020-09-08T16:48:51.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:51.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj32 /dev/null 2020-09-08T16:48:51.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:51.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj33 /dev/null 2020-09-08T16:48:52.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:52.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj34 /dev/null 2020-09-08T16:48:52.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:52.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj35 /dev/null 2020-09-08T16:48:52.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:52.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj36 /dev/null 2020-09-08T16:48:52.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:52.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj37 /dev/null 2020-09-08T16:48:52.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:52.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj38 /dev/null 2020-09-08T16:48:52.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:52.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj39 /dev/null 2020-09-08T16:48:53.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:53.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj40 /dev/null 2020-09-08T16:48:53.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:53.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj41 /dev/null 2020-09-08T16:48:53.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:53.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj42 /dev/null 2020-09-08T16:48:53.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:53.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj43 /dev/null 2020-09-08T16:48:53.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:53.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj44 /dev/null 2020-09-08T16:48:53.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:53.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj45 /dev/null 2020-09-08T16:48:54.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:54.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj46 /dev/null 2020-09-08T16:48:54.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:54.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj47 /dev/null 2020-09-08T16:48:54.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:54.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj48 /dev/null 2020-09-08T16:48:54.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:54.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj49 /dev/null 2020-09-08T16:48:54.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:54.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj50 /dev/null 2020-09-08T16:48:55.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:55.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj51 /dev/null 2020-09-08T16:48:55.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:55.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj52 /dev/null 2020-09-08T16:48:55.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:55.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj53 /dev/null 2020-09-08T16:48:55.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:55.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj54 /dev/null 2020-09-08T16:48:55.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:55.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj55 /dev/null 2020-09-08T16:48:55.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:55.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj56 /dev/null 2020-09-08T16:48:56.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:56.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj57 /dev/null 2020-09-08T16:48:56.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:56.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj58 /dev/null 2020-09-08T16:48:56.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:56.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj59 /dev/null 2020-09-08T16:48:56.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:56.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj60 /dev/null 2020-09-08T16:48:56.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:56.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj61 /dev/null 2020-09-08T16:48:56.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:56.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj62 /dev/null 2020-09-08T16:48:57.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:57.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj63 /dev/null 2020-09-08T16:48:57.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:57.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj64 /dev/null 2020-09-08T16:48:57.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:57.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj65 /dev/null 2020-09-08T16:48:57.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:57.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj66 /dev/null 2020-09-08T16:48:57.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:57.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj67 /dev/null 2020-09-08T16:48:58.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:58.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj68 /dev/null 2020-09-08T16:48:58.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:58.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj69 /dev/null 2020-09-08T16:48:58.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:58.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj70 /dev/null 2020-09-08T16:48:58.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:58.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj71 /dev/null 2020-09-08T16:48:58.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:58.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj72 /dev/null 2020-09-08T16:48:58.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:58.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj73 /dev/null 2020-09-08T16:48:59.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:59.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj74 /dev/null 2020-09-08T16:48:59.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:59.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj75 /dev/null 2020-09-08T16:48:59.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:59.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj76 /dev/null 2020-09-08T16:48:59.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:59.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj77 /dev/null 2020-09-08T16:48:59.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:59.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj78 /dev/null 2020-09-08T16:48:59.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:48:59.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj79 /dev/null 2020-09-08T16:49:00.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:00.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj80 /dev/null 2020-09-08T16:49:00.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:00.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj81 /dev/null 2020-09-08T16:49:00.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:00.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj82 /dev/null 2020-09-08T16:49:00.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:00.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj83 /dev/null 2020-09-08T16:49:00.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:00.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj84 /dev/null 2020-09-08T16:49:01.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:01.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj85 /dev/null 2020-09-08T16:49:01.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:01.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj86 /dev/null 2020-09-08T16:49:01.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:01.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj87 /dev/null 2020-09-08T16:49:01.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:01.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj88 /dev/null 2020-09-08T16:49:01.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:01.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj89 /dev/null 2020-09-08T16:49:01.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:01.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj90 /dev/null 2020-09-08T16:49:02.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:02.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj91 /dev/null 2020-09-08T16:49:02.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:02.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj92 /dev/null 2020-09-08T16:49:02.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:02.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj93 /dev/null 2020-09-08T16:49:02.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:02.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj94 /dev/null 2020-09-08T16:49:02.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:02.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj95 /dev/null 2020-09-08T16:49:02.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:02.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj96 /dev/null 2020-09-08T16:49:03.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:03.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj97 /dev/null 2020-09-08T16:49:03.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:03.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj98 /dev/null 2020-09-08T16:49:03.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:03.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj99 /dev/null 2020-09-08T16:49:03.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:03.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj100 /dev/null 2020-09-08T16:49:04.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:04.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj101 /dev/null 2020-09-08T16:49:04.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:04.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj102 /dev/null 2020-09-08T16:49:04.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:04.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj103 /dev/null 2020-09-08T16:49:04.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:04.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj104 /dev/null 2020-09-08T16:49:04.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:04.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj105 /dev/null 2020-09-08T16:49:05.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:05.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj106 /dev/null 2020-09-08T16:49:05.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:05.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj107 /dev/null 2020-09-08T16:49:05.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:05.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj108 /dev/null 2020-09-08T16:49:05.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:05.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj109 /dev/null 2020-09-08T16:49:05.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:05.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj110 /dev/null 2020-09-08T16:49:05.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:05.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj111 /dev/null 2020-09-08T16:49:06.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:06.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj112 /dev/null 2020-09-08T16:49:06.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:06.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj113 /dev/null 2020-09-08T16:49:06.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:06.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj114 /dev/null 2020-09-08T16:49:06.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:06.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj115 /dev/null 2020-09-08T16:49:06.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:06.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj116 /dev/null 2020-09-08T16:49:06.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:06.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj117 /dev/null 2020-09-08T16:49:07.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:07.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj118 /dev/null 2020-09-08T16:49:07.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:07.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj119 /dev/null 2020-09-08T16:49:07.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:07.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj120 /dev/null 2020-09-08T16:49:07.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:07.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj121 /dev/null 2020-09-08T16:49:07.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:07.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj122 /dev/null 2020-09-08T16:49:07.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:07.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj123 /dev/null 2020-09-08T16:49:08.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:08.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj124 /dev/null 2020-09-08T16:49:08.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:08.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj125 /dev/null 2020-09-08T16:49:08.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:08.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj126 /dev/null 2020-09-08T16:49:08.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:08.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj127 /dev/null 2020-09-08T16:49:08.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:08.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj128 /dev/null 2020-09-08T16:49:09.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:09.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj129 /dev/null 2020-09-08T16:49:09.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:09.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj130 /dev/null 2020-09-08T16:49:09.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:09.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj131 /dev/null 2020-09-08T16:49:09.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:09.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj132 /dev/null 2020-09-08T16:49:09.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:09.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj133 /dev/null 2020-09-08T16:49:09.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:09.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj134 /dev/null 2020-09-08T16:49:10.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:10.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj135 /dev/null 2020-09-08T16:49:10.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:10.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj136 /dev/null 2020-09-08T16:49:10.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:10.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj137 /dev/null 2020-09-08T16:49:10.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:10.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj138 /dev/null 2020-09-08T16:49:10.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:10.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj139 /dev/null 2020-09-08T16:49:10.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:10.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj140 /dev/null 2020-09-08T16:49:11.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:11.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj141 /dev/null 2020-09-08T16:49:11.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:11.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj142 /dev/null 2020-09-08T16:49:11.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:11.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj143 /dev/null 2020-09-08T16:49:11.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:11.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj144 /dev/null 2020-09-08T16:49:11.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:11.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj145 /dev/null 2020-09-08T16:49:11.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:11.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj146 /dev/null 2020-09-08T16:49:12.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:12.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj147 /dev/null 2020-09-08T16:49:12.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:12.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj148 /dev/null 2020-09-08T16:49:12.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:12.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj149 /dev/null 2020-09-08T16:49:12.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:12.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj150 /dev/null 2020-09-08T16:49:12.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:12.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj151 /dev/null 2020-09-08T16:49:13.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:13.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj152 /dev/null 2020-09-08T16:49:13.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:13.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj153 /dev/null 2020-09-08T16:49:13.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:13.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj154 /dev/null 2020-09-08T16:49:13.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:13.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj155 /dev/null 2020-09-08T16:49:13.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:13.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj156 /dev/null 2020-09-08T16:49:13.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:13.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj157 /dev/null 2020-09-08T16:49:14.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:14.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj158 /dev/null 2020-09-08T16:49:14.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:14.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj159 /dev/null 2020-09-08T16:49:14.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:14.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj160 /dev/null 2020-09-08T16:49:14.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:14.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj161 /dev/null 2020-09-08T16:49:14.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:14.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj162 /dev/null 2020-09-08T16:49:14.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:14.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj163 /dev/null 2020-09-08T16:49:15.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:15.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj164 /dev/null 2020-09-08T16:49:15.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:15.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj165 /dev/null 2020-09-08T16:49:15.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:15.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj166 /dev/null 2020-09-08T16:49:15.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:15.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj167 /dev/null 2020-09-08T16:49:15.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:15.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj168 /dev/null 2020-09-08T16:49:16.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:16.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj169 /dev/null 2020-09-08T16:49:16.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:16.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj170 /dev/null 2020-09-08T16:49:16.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:16.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj171 /dev/null 2020-09-08T16:49:16.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:16.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj172 /dev/null 2020-09-08T16:49:16.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:16.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj173 /dev/null 2020-09-08T16:49:16.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:16.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj174 /dev/null 2020-09-08T16:49:17.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:17.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj175 /dev/null 2020-09-08T16:49:17.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:17.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj176 /dev/null 2020-09-08T16:49:17.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:17.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj177 /dev/null 2020-09-08T16:49:17.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:17.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj178 /dev/null 2020-09-08T16:49:17.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:17.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj179 /dev/null 2020-09-08T16:49:18.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:18.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj180 /dev/null 2020-09-08T16:49:18.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:18.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj181 /dev/null 2020-09-08T16:49:18.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:18.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj182 /dev/null 2020-09-08T16:49:18.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:18.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj183 /dev/null 2020-09-08T16:49:18.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:18.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj184 /dev/null 2020-09-08T16:49:18.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:18.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj185 /dev/null 2020-09-08T16:49:19.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:19.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj186 /dev/null 2020-09-08T16:49:19.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:19.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj187 /dev/null 2020-09-08T16:49:19.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:19.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj188 /dev/null 2020-09-08T16:49:19.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:19.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj189 /dev/null 2020-09-08T16:49:19.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:19.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj190 /dev/null 2020-09-08T16:49:19.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:19.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj191 /dev/null 2020-09-08T16:49:20.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:20.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj192 /dev/null 2020-09-08T16:49:20.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:20.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj193 /dev/null 2020-09-08T16:49:20.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:20.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj194 /dev/null 2020-09-08T16:49:20.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:20.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj195 /dev/null 2020-09-08T16:49:20.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:20.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj196 /dev/null 2020-09-08T16:49:20.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:20.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj197 /dev/null 2020-09-08T16:49:21.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:21.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj198 /dev/null 2020-09-08T16:49:21.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:21.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj199 /dev/null 2020-09-08T16:49:21.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2020-09-08T16:49:21.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj200 /dev/null 2020-09-08T16:49:21.720 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:589: TEST_backfill_ec_prim_out: get_pg test obj1 2020-09-08T16:49:21.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1031: get_pg: local poolname=test 2020-09-08T16:49:21.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: local objectname=obj1 2020-09-08T16:49:21.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: ceph --format json osd map test obj1 2020-09-08T16:49:21.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: jq -r .pgid 2020-09-08T16:49:22.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:589: TEST_backfill_ec_prim_out: local PG=1.0 2020-09-08T16:49:22.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:591: TEST_backfill_ec_prim_out: get_primary test obj1 2020-09-08T16:49:22.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:49:22.129 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:49:22.129 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:49:22.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:49:22.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:591: TEST_backfill_ec_prim_out: local primary=1 2020-09-08T16:49:22.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:593: TEST_backfill_ec_prim_out: ceph osd set nobackfill 2020-09-08T16:49:23.324 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is set 2020-09-08T16:49:23.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:594: TEST_backfill_ec_prim_out: ceph osd out osd.1 2020-09-08T16:49:23.873 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already out. 2020-09-08T16:49:23.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:596: TEST_backfill_ec_prim_out: sleep 2 2020-09-08T16:49:25.884 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:597: TEST_backfill_ec_prim_out: get_primary test obj1 2020-09-08T16:49:25.884 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:49:25.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:49:25.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:49:25.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:49:26.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:597: TEST_backfill_ec_prim_out: primary=1 2020-09-08T16:49:26.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:598: TEST_backfill_ec_prim_out: ceph osd unset nobackfill 2020-09-08T16:49:27.029 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is unset 2020-09-08T16:49:27.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:599: TEST_backfill_ec_prim_out: ceph tell osd.1 get_latest_osdmap 2020-09-08T16:49:27.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:600: TEST_backfill_ec_prim_out: ceph tell osd.1 debug kick_recovery_wq 0 2020-09-08T16:49:27.302 INFO:tasks.workunit.client.0.smithi065.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2020-09-08T16:49:27.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:601: TEST_backfill_ec_prim_out: sleep 2 2020-09-08T16:49:29.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:603: TEST_backfill_ec_prim_out: wait_for_clean 2020-09-08T16:49:29.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:49:29.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:49:29.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:49:29.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:49:29.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:49:29.321 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:49:29.322 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:49:29.322 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:49:29.322 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:49:29.322 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:49:29.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:49:29.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:49:29.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:49:29.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:49:29.422 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:49:29.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:49:29.814 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:49:29.814 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:49:29.814 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:49:29.814 INFO:tasks.workunit.client.0.smithi065.stderr:4' 2020-09-08T16:49:29.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:49:29.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:49:29.815 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:49:29.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836501 2020-09-08T16:49:29.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836501 2020-09-08T16:49:29.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836501' 2020-09-08T16:49:29.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:49:29.946 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:49:30.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672979 2020-09-08T16:49:30.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672979 2020-09-08T16:49:30.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836501 1-42949672979' 2020-09-08T16:49:30.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:49:30.079 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:49:30.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509458 2020-09-08T16:49:30.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509458 2020-09-08T16:49:30.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836501 1-42949672979 2-64424509458' 2020-09-08T16:49:30.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:49:30.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:49:30.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345936 2020-09-08T16:49:30.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345936 2020-09-08T16:49:30.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836501 1-42949672979 2-64424509458 3-85899345936' 2020-09-08T16:49:30.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:49:30.340 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:49:30.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182415 2020-09-08T16:49:30.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182415 2020-09-08T16:49:30.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836501 1-42949672979 2-64424509458 3-85899345936 4-107374182415' 2020-09-08T16:49:30.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:49:30.476 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836501 2020-09-08T16:49:30.476 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:49:30.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:49:30.477 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836501 2020-09-08T16:49:30.477 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:49:30.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836501 2020-09-08T16:49:30.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836501' 2020-09-08T16:49:30.478 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:49:30.478 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836501 2020-09-08T16:49:30.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836501 -lt 21474836501 2020-09-08T16:49:30.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:49:30.920 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672979 2020-09-08T16:49:30.921 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:49:30.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:49:30.921 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672979 2020-09-08T16:49:30.922 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:49:30.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672979 2020-09-08T16:49:30.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672979' 2020-09-08T16:49:30.923 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:49:30.923 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672979 2020-09-08T16:49:31.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672979 -lt 42949672979 2020-09-08T16:49:31.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:49:31.345 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509458 2020-09-08T16:49:31.346 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:49:31.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:49:31.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509458 2020-09-08T16:49:31.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:49:31.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509458 2020-09-08T16:49:31.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509458' 2020-09-08T16:49:31.348 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:49:31.348 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509458 2020-09-08T16:49:31.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509458 -lt 64424509458 2020-09-08T16:49:31.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:49:31.747 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345936 2020-09-08T16:49:31.748 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:49:31.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:49:31.748 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345936 2020-09-08T16:49:31.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:49:31.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345936 2020-09-08T16:49:31.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345936' 2020-09-08T16:49:31.752 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:49:31.752 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345936 2020-09-08T16:49:32.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345936 -lt 85899345936 2020-09-08T16:49:32.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:49:32.146 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182415 2020-09-08T16:49:32.147 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:49:32.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:49:32.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182415 2020-09-08T16:49:32.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:49:32.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182415 2020-09-08T16:49:32.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182415' 2020-09-08T16:49:32.149 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:49:32.149 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182415 2020-09-08T16:49:32.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182415 -lt 107374182415 2020-09-08T16:49:32.543 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:49:32.543 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:49:32.543 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:49:33.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T16:49:33.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:49:33.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:49:33.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:49:33.064 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:49:33.064 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:49:33.064 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:49:33.064 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:49:33.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:49:33.443 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:49:33.443 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:49:33.443 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:49:33.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:49:33.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T16:49:33.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T16:49:33.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T16:49:33.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:49:33.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:49:34.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:49:34.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:49:34.082 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:49:34.082 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:49:34.082 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:49:34.082 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:49:34.083 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:49:34.083 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:49:34.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:49:34.463 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:49:34.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:49:34.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:49:35.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:49:35.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:49:35.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:49:35.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:49:35.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:49:35.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:49:35.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:49:35.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:49:35.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:49:35.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T16:49:35.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T16:49:35.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:49:35.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:49:35.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:49:35.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:49:35.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:49:35.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:49:35.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:49:35.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:49:35.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:49:35.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:49:35.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:49:36.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:49:36.033 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:49:36.034 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:49:36.034 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:49:36.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:49:36.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:49:36.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:49:36.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:49:36.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:49:36.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:49:36.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:49:36.561 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:49:36.561 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:49:37.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:49:37.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:49:37.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:49:37.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:49:37.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:49:37.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:49:37.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:49:37.191 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:49:37.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:49:37.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:49:37.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:49:37.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:49:37.193 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:49:37.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:49:37.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:49:37.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:49:37.575 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:49:38.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:49:38.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:49:38.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:49:38.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:49:38.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:49:38.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:49:38.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:49:38.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:49:38.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:49:38.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:49:38.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:49:38.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:49:38.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:49:38.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:49:38.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:49:38.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:49:38.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:49:38.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:49:38.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:49:38.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:49:38.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:49:38.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:49:39.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:49:39.098 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:49:39.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:49:39.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:49:39.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:49:39.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:49:39.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:49:39.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:49:39.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:49:39.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:49:39.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:49:39.615 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:49:39.616 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:49:40.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:49:40.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:49:40.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:49:40.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:49:40.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:49:40.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:49:40.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:49:40.263 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:49:40.263 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:49:40.263 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:49:40.263 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:49:40.263 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:49:40.264 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:49:40.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:49:40.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:49:40.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:49:40.656 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:49:41.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:49:41.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:49:41.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:49:41.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:49:41.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:49:41.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:49:41.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:49:41.189 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:49:41.189 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:49:41.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:49:41.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:49:41.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:49:41.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:49:41.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:49:41.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:49:41.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:49:41.836 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:49:41.836 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:49:41.837 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:49:41.837 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:49:41.837 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:49:41.837 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:49:42.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:49:42.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:49:42.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:49:42.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:49:42.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:49:42.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:49:42.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:49:42.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:49:42.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:49:42.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:49:42.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:49:42.740 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:49:42.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:49:43.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:49:43.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:49:43.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:49:43.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:49:43.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:49:43.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:49:43.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:49:43.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:49:43.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:49:43.382 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:49:43.382 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:49:43.382 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:49:43.383 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:49:43.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:49:43.763 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:49:43.764 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:49:43.764 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:49:44.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:49:44.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:49:44.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:49:44.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:49:44.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:49:44.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:49:44.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:49:44.293 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:49:44.310 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:49:44.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:49:44.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:49:44.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:49:44.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:49:44.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:49:44.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:49:44.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:49:44.915 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:49:44.915 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:49:44.915 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:49:44.915 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:49:44.916 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:49:44.916 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:49:45.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:49:45.297 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:49:45.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:49:45.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:49:45.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:49:45.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:49:45.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:49:45.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:49:45.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:49:45.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:49:45.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:49:45.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:49:45.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:49:46.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:49:46.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:49:46.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:49:46.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:49:46.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:49:46.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:49:46.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:49:46.473 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:49:46.474 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:49:46.474 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:49:46.474 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:49:46.474 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:49:46.474 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:49:46.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:49:46.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:49:46.857 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:49:46.857 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:49:47.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:49:47.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:49:47.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:49:47.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:49:47.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:49:47.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:49:47.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:49:47.393 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:49:47.393 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:49:47.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=6 2020-09-08T16:49:47.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 6 '!=' null 2020-09-08T16:49:47.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:49:47.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:49:47.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:49:48.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:49:48.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:49:48.037 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:49:48.038 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:49:48.038 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:49:48.038 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:49:48.038 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:49:48.039 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:49:48.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:49:48.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:49:48.418 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:49:48.418 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:49:48.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:49:48.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:49:48.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:49:48.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:49:48.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:49:48.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:49:48.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:49:48.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:49:48.946 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:49:49.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:49:49.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:49:49.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:49:49.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:49:49.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:49:49.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:49:49.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:49:49.567 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:49:49.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:49:49.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:49:49.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:49:49.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:49:49.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:49:49.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:49:49.949 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:49:49.950 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:49:49.950 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:49:50.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:49:50.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:49:50.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:49:50.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:49:50.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:49:50.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:49:50.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:49:50.475 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:49:50.476 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:49:51.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:49:51.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:49:51.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:49:51.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:49:51.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:49:51.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:49:51.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:49:51.105 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:49:51.105 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:49:51.106 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:49:51.106 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:49:51.106 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:49:51.106 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:49:51.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:49:51.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:49:51.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:49:51.501 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:49:52.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:49:52.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:49:52.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:49:52.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:49:52.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:49:52.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:49:52.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:49:52.022 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:49:52.022 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:49:52.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:49:52.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:49:52.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:49:52.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:49:52.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:49:52.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:49:52.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:49:52.640 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:49:52.640 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:49:52.640 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:49:52.640 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:49:52.640 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:49:52.641 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:49:53.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:49:53.021 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:49:53.022 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:49:53.022 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:49:53.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:49:53.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:49:53.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:49:53.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:49:53.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:49:53.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:49:53.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:49:53.545 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:49:53.545 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:49:54.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=6 2020-09-08T16:49:54.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 6 '!=' null 2020-09-08T16:49:54.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:49:54.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:49:54.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:49:54.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:49:54.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:49:54.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:49:54.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:49:54.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:49:54.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:49:54.176 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:49:54.176 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:49:54.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:49:54.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:49:54.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:49:54.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:49:55.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:49:55.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:49:55.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:49:55.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:49:55.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:49:55.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:49:55.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:49:55.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:49:55.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:49:55.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:49:55.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:49:55.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:49:55.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:49:55.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:49:55.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:49:55.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:49:55.713 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:49:55.713 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:49:55.714 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:49:55.714 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:49:55.714 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:49:55.714 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:49:56.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:49:56.101 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:49:56.101 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:49:56.101 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:49:56.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:49:56.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:49:56.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:49:56.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:49:56.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:49:56.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:49:56.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:49:56.620 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:49:56.620 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:49:57.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=6 2020-09-08T16:49:57.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 6 '!=' null 2020-09-08T16:49:57.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:49:57.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:49:57.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:49:57.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:49:57.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:49:57.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:49:57.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:49:57.240 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:49:57.241 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:49:57.241 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:49:57.241 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:49:57.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:49:57.622 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:49:57.622 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:49:57.623 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:49:58.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:49:58.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:49:58.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:49:58.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:49:58.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:49:58.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:49:58.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:49:58.165 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:49:58.165 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:49:58.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=6 2020-09-08T16:49:58.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 6 '!=' null 2020-09-08T16:49:58.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:49:58.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:49:58.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:49:58.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:49:58.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:49:58.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:49:58.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:49:58.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:49:58.787 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:49:58.787 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:49:58.787 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:49:59.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:49:59.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:49:59.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:49:59.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:49:59.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:49:59.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:49:59.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:49:59.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:49:59.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:49:59.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:49:59.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:49:59.685 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:49:59.686 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:50:00.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:50:00.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:50:00.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:50:00.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:50:00.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:50:00.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:50:00.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:50:00.309 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:50:00.309 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:50:00.310 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:50:00.310 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:50:00.310 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:50:00.310 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:50:00.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:50:00.692 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:50:00.693 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:50:00.693 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:50:01.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:50:01.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:50:01.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:50:01.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:50:01.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:50:01.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:50:01.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:50:01.217 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:50:01.217 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:50:01.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:50:01.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:50:01.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:50:01.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:50:01.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:50:01.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:50:01.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:50:01.835 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:50:01.835 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:50:01.835 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:50:01.836 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:50:01.836 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:50:01.836 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:50:02.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:50:02.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:50:02.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:50:02.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:50:02.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:50:02.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:50:02.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:50:02.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:50:02.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:50:02.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:50:02.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:50:02.747 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:50:02.747 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:50:03.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=6 2020-09-08T16:50:03.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 6 '!=' null 2020-09-08T16:50:03.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:50:03.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:50:03.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:50:03.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:50:03.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:50:03.374 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:50:03.374 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:50:03.374 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:50:03.375 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:50:03.375 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:50:03.375 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:50:03.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:50:03.756 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:50:03.757 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:50:03.757 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:50:04.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:50:04.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:50:04.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:50:04.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:50:04.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:50:04.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:50:04.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:50:04.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:50:04.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:50:04.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=6 2020-09-08T16:50:04.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 6 '!=' null 2020-09-08T16:50:04.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:50:04.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:50:04.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:50:04.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:50:04.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:50:04.889 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:50:04.889 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:50:04.889 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:50:04.890 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:50:04.890 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:50:04.890 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:50:05.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:50:05.285 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:50:05.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:50:05.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:50:05.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:50:05.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:50:05.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:50:05.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:50:05.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:50:05.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:50:05.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:50:05.810 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:50:05.811 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:50:06.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:50:06.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:50:06.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:50:06.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:50:06.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:50:06.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:50:06.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:50:06.430 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:50:06.430 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:50:06.430 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:50:06.431 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:50:06.431 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:50:06.431 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:50:06.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:50:06.810 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:50:06.811 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:50:06.811 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:50:07.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:50:07.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:50:07.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:50:07.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:50:07.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:50:07.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:50:07.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:50:07.337 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:50:07.337 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:50:07.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=6 2020-09-08T16:50:07.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 6 '!=' null 2020-09-08T16:50:07.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:50:07.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:50:07.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:50:07.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:50:07.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:50:07.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:50:07.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:50:07.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:50:07.993 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:50:07.993 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:50:07.993 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:50:08.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:50:08.370 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:50:08.370 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:50:08.371 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:50:08.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:50:08.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:50:08.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:50:08.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:50:08.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:50:08.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:50:08.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:50:08.937 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:50:08.937 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:50:09.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=6 2020-09-08T16:50:09.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 6 '!=' null 2020-09-08T16:50:09.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:50:09.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:50:09.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:50:09.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:50:09.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:50:09.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:50:09.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:50:09.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:50:09.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:50:09.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:50:09.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:50:09.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:50:09.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:50:09.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:50:09.915 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:50:10.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:50:10.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:50:10.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:50:10.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:50:10.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:50:10.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:50:10.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:50:10.437 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:50:10.437 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:50:10.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T16:50:10.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T16:50:10.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 1 >= 13 )) 2020-09-08T16:50:10.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:50:10.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.2 2020-09-08T16:50:11.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:50:11.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:50:11.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:50:11.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:50:11.157 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:50:11.157 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:50:11.157 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:50:11.157 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:50:11.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T16:50:11.542 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:50:11.543 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:50:11.543 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:50:12.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T16:50:12.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:50:12.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:50:12.060 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:605: TEST_backfill_ec_prim_out: expr 200 '*' 3 2020-09-08T16:50:12.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:605: TEST_backfill_ec_prim_out: local misplaced=600 2020-09-08T16:50:12.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:606: TEST_backfill_ec_prim_out: check td/osd-backfill-stats 1.0 1 erasure 0 0 200 0 2020-09-08T16:50:12.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2020-09-08T16:50:12.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:64: check: local PG=1.0 2020-09-08T16:50:12.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:65: check: local primary=1 2020-09-08T16:50:12.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:66: check: local type=erasure 2020-09-08T16:50:12.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:67: check: local degraded_start=0 2020-09-08T16:50:12.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:68: check: local degraded_end=0 2020-09-08T16:50:12.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:69: check: local misplaced_start=200 2020-09-08T16:50:12.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:70: check: local misplaced_end=0 2020-09-08T16:50:12.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:71: check: local primary_start= 2020-09-08T16:50:12.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:72: check: local primary_end= 2020-09-08T16:50:12.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:73: check: local check_setup=true 2020-09-08T16:50:12.065 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2020-09-08T16:50:12.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2020-09-08T16:50:12.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:76: check: '[' true = true ']' 2020-09-08T16:50:12.066 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log 2020-09-08T16:50:12.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2020-09-08T16:50:12.081 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2020-09-08T16:50:12.081 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: wc -w 2020-09-08T16:50:12.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2020-09-08T16:50:12.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:86: check: local 'addp= ' 2020-09-08T16:50:12.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:87: check: '[' erasure = erasure ']' 2020-09-08T16:50:12.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:89: check: addp=p 2020-09-08T16:50:12.082 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2020-09-08T16:50:12.082 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:50:12.082 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: tail -1 2020-09-08T16:50:12.083 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2020-09-08T16:50:12.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: UPACT='[4,0,2]/[1,0,2]' 2020-09-08T16:50:12.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:93: check: '[' -n '[4,0,2]/[1,0,2]' ']' 2020-09-08T16:50:12.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:96: check: local which=degraded 2020-09-08T16:50:12.097 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:50:12.098 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:50:12.098 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -F ' [4,0,2]/[1,0,2]p' 2020-09-08T16:50:12.099 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -v est 2020-09-08T16:50:12.099 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: head -1 2020-09-08T16:50:12.099 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:50:12.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: FIRST=0 2020-09-08T16:50:12.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:98: check: '[' -n 0 ']' 2020-09-08T16:50:12.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:99: check: below_margin 0 0 2020-09-08T16:50:12.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=0 2020-09-08T16:50:12.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T16:50:12.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=0 2020-09-08T16:50:12.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T16:50:12.105 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:50:12.106 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:50:12.106 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: tail -1 2020-09-08T16:50:12.106 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:50:12.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: LAST=0 2020-09-08T16:50:12.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:101: check: '[' -n 0 ']' 2020-09-08T16:50:12.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:102: check: above_margin 0 0 2020-09-08T16:50:12.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=0 2020-09-08T16:50:12.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T16:50:12.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=0 2020-09-08T16:50:12.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T16:50:12.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:105: check: which=misplaced 2020-09-08T16:50:12.117 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:50:12.117 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:50:12.117 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -F ' [4,0,2]/[1,0,2]p' 2020-09-08T16:50:12.117 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -v est 2020-09-08T16:50:12.118 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: head -1 2020-09-08T16:50:12.118 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:50:12.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: FIRST=200 2020-09-08T16:50:12.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:107: check: '[' -n 200 ']' 2020-09-08T16:50:12.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:108: check: below_margin 200 200 2020-09-08T16:50:12.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=200 2020-09-08T16:50:12.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T16:50:12.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=200 2020-09-08T16:50:12.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T16:50:12.123 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:50:12.123 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:50:12.124 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: tail -1 2020-09-08T16:50:12.124 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:50:12.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: LAST=1 2020-09-08T16:50:12.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:110: check: '[' -n 1 ']' 2020-09-08T16:50:12.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:111: check: above_margin 1 0 2020-09-08T16:50:12.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=1 2020-09-08T16:50:12.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T16:50:12.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=0 2020-09-08T16:50:12.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T16:50:12.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2020-09-08T16:50:12.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:608: TEST_backfill_ec_prim_out: delete_pool test 2020-09-08T16:50:12.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test 2020-09-08T16:50:12.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2020-09-08T16:50:12.655 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' does not exist 2020-09-08T16:50:12.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:609: TEST_backfill_ec_prim_out: kill_daemons td/osd-backfill-stats 2020-09-08T16:50:12.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:50:12.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:50:12.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:50:12.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:50:12.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:50:12.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:50:12.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2020-09-08T16:50:12.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T16:50:12.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:50:12.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T16:50:12.784 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:50:12.784 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:50:12.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:50:12.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:50:12.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:50:12.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:50:12.789 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:50:12.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:50:12.790 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:50:12.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:50:12.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:50:12.791 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:50:12.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:50:12.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:50:12.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:50:12.794 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:50:12.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:50:12.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:50:12.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T16:50:12.810 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:50:12.810 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:50:12.810 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:50:12.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T16:50:12.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:50:12.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:50:12.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:35: run: for func in $funcs 2020-09-08T16:50:12.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2020-09-08T16:50:12.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2020-09-08T16:50:12.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2020-09-08T16:50:12.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T16:50:12.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:50:12.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T16:50:12.814 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:50:12.814 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:50:12.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:50:12.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:50:12.815 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:50:12.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:50:12.816 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:50:12.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:50:12.817 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:50:12.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:50:12.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:50:12.817 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:50:12.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:50:12.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:50:12.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:50:12.819 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:50:12.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:50:12.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:50:12.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T16:50:12.820 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:50:12.821 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:50:12.821 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:50:12.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T16:50:12.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:50:12.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:50:12.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2020-09-08T16:50:12.823 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T16:50:12.823 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:50:12.823 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:50:12.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.482138 2020-09-08T16:50:12.825 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T16:50:12.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T16:50:12.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T16:50:12.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2020-09-08T16:50:12.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:37: run: TEST_backfill_out td/osd-backfill-stats 2020-09-08T16:50:12.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:230: TEST_backfill_out: local dir=td/osd-backfill-stats 2020-09-08T16:50:12.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:232: TEST_backfill_out: run_mon td/osd-backfill-stats a 2020-09-08T16:50:12.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2020-09-08T16:50:12.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T16:50:12.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T16:50:12.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T16:50:12.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2020-09-08T16:50:12.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2020-09-08T16:50:13.116 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T16:50:13.116 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:50:13.117 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:50:13.117 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:50:13.117 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:50:13.117 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:50:13.117 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:50:13.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T16:50:13.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T16:50:13.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T16:50:13.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:50:13.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:50:13.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T16:50:13.312 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T16:50:13.312 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:50:13.312 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:50:13.312 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:50:13.312 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:50:13.313 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:50:13.313 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:50:13.313 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T16:50:13.313 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:50:13.313 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get fsid 2020-09-08T16:50:13.402 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T16:50:13.403 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:50:13.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:50:13.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T16:50:13.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T16:50:13.404 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:50:13.405 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:50:13.405 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:50:13.405 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:50:13.405 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:50:13.405 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:50:13.406 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T16:50:13.406 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:50:13.407 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get mon_host 2020-09-08T16:50:13.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:233: TEST_backfill_out: run_mgr td/osd-backfill-stats x 2020-09-08T16:50:13.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-stats 2020-09-08T16:50:13.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T16:50:13.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T16:50:13.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T16:50:13.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-stats/x 2020-09-08T16:50:13.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T16:50:14.399 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T16:50:14.399 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:50:14.400 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:50:14.400 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:50:14.400 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:50:14.400 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:50:14.401 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:50:14.401 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:50:14.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:50:14.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:234: TEST_backfill_out: run_osd td/osd-backfill-stats 0 2020-09-08T16:50:14.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:50:14.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:50:14.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T16:50:14.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:50:14.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/0 2020-09-08T16:50:14.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:50:14.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:50:14.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:50:14.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:50:14.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2020-09-08T16:50:14.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2020-09-08T16:50:14.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:50:14.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:50:14.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:50:14.428 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:50:14.428 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:50:14.428 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:50:14.430 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:50:14.430 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:50:14.431 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:50:14.431 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:50:14.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:50:14.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:50:14.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:50:14.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:50:14.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:50:14.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:50:14.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:50:14.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:50:14.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:50:14.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:50:14.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:50:14.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/0 2020-09-08T16:50:14.433 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:50:14.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=37092449-5e49-4ce2-b929-bf229009f20b 2020-09-08T16:50:14.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 37092449-5e49-4ce2-b929-bf229009f20b' 2020-09-08T16:50:14.434 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:50:14.434 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 37092449-5e49-4ce2-b929-bf229009f20b 2020-09-08T16:50:14.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBGtldfe5VBGxAAyBMZ++wpuwrOibZMiceNEg== 2020-09-08T16:50:14.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBGtldfe5VBGxAAyBMZ++wpuwrOibZMiceNEg=="}' 2020-09-08T16:50:14.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 37092449-5e49-4ce2-b929-bf229009f20b -i td/osd-backfill-stats/0/new.json 2020-09-08T16:50:14.789 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:50:14.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/0/new.json 2020-09-08T16:50:14.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBGtldfe5VBGxAAyBMZ++wpuwrOibZMiceNEg== --osd-uuid 37092449-5e49-4ce2-b929-bf229009f20b 2020-09-08T16:50:14.825 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:14.830+0000 7f981e3ecec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:14.826 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:14.831+0000 7f981e3ecec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:14.828 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:14.833+0000 7f981e3ecec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:14.829 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:14.834+0000 7f981e3ecec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:50:14.829 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:14.834+0000 7f981e3ecec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:50:14.830 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:14.834+0000 7f981e3ecec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:50:14.867 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:14.871+0000 7f981e3ecec0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2020-09-08T16:50:19.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2020-09-08T16:50:19.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:50:19.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T16:50:19.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:50:19.138 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T16:50:19.666 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T16:50:19.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T16:50:19.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:50:19.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:50:19.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:50:19.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:50:19.689 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:19.694+0000 7f1ce4969ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:19.706 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:19.711+0000 7f1ce4969ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:19.708 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:19.713+0000 7f1ce4969ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:20.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T16:50:20.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:50:20.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T16:50:20.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:50:20.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:50:20.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:50:20.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:50:20.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:50:20.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:50:20.059 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:50:20.227 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:20.231+0000 7f1ce4969ec0 -1 Falling back to public interface 2020-09-08T16:50:20.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:50:21.015 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:21.020+0000 7f1ce4969ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T16:50:21.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:50:21.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:50:21.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:50:21.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:50:21.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:50:21.487 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:50:21.901 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/548605,v1:127.0.0.1:6803/548605] [v2:127.0.0.1:6804/548605,v1:127.0.0.1:6805/548605] exists,up 37092449-5e49-4ce2-b929-bf229009f20b 2020-09-08T16:50:21.901 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 d2bf7afa-10a0-4338-b74d-fbb042cce02b 2020-09-08T16:50:21.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:50:21.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:50:21.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:50:21.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:235: TEST_backfill_out: run_osd td/osd-backfill-stats 1 2020-09-08T16:50:21.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:50:21.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:50:21.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T16:50:21.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:50:21.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/1 2020-09-08T16:50:21.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:50:21.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:50:21.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:50:21.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:50:21.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2020-09-08T16:50:21.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2020-09-08T16:50:21.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:50:21.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:50:21.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:50:21.919 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:50:21.919 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:50:21.919 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:50:21.919 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:50:21.920 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:50:21.920 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:50:21.920 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:50:21.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:50:21.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:50:21.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:50:21.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:50:21.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:50:21.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:50:21.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:50:21.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:50:21.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:50:21.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:50:21.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:50:21.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/1 2020-09-08T16:50:21.923 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:50:21.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=d2bf7afa-10a0-4338-b74d-fbb042cce02b 2020-09-08T16:50:21.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 d2bf7afa-10a0-4338-b74d-fbb042cce02b' 2020-09-08T16:50:21.924 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:50:21.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBNtldfsAjwNhAAMjaEN7yBlM3WANSozfn2Xg== 2020-09-08T16:50:21.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBNtldfsAjwNhAAMjaEN7yBlM3WANSozfn2Xg=="}' 2020-09-08T16:50:21.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new d2bf7afa-10a0-4338-b74d-fbb042cce02b -i td/osd-backfill-stats/1/new.json 2020-09-08T16:50:22.431 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:50:22.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/1/new.json 2020-09-08T16:50:22.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBNtldfsAjwNhAAMjaEN7yBlM3WANSozfn2Xg== --osd-uuid d2bf7afa-10a0-4338-b74d-fbb042cce02b 2020-09-08T16:50:22.470 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:22.472+0000 7fba67be7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:22.470 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:22.474+0000 7fba67be7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:22.474 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:22.476+0000 7fba67be7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:22.474 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:22.476+0000 7fba67be7ec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:50:22.475 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:22.476+0000 7fba67be7ec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:50:22.475 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:22.476+0000 7fba67be7ec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:50:22.522 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:22.527+0000 7fba67be7ec0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2020-09-08T16:50:26.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2020-09-08T16:50:26.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:50:26.483 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T16:50:26.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T16:50:26.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:50:27.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T16:50:27.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:50:27.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:50:27.017 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T16:50:27.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:50:27.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:50:27.052 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:27.057+0000 7ff1cc735ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:27.054 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:27.059+0000 7ff1cc735ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:27.055 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:27.060+0000 7ff1cc735ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:27.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T16:50:27.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:50:27.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T16:50:27.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:50:27.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:50:27.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:50:27.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:50:27.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:50:27.425 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:50:27.426 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:50:27.578 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:27.583+0000 7ff1cc735ec0 -1 Falling back to public interface 2020-09-08T16:50:27.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:50:28.469 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:28.474+0000 7ff1cc735ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T16:50:28.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:50:28.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:50:28.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:50:28.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:50:28.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:50:28.845 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:50:29.258 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/549599,v1:127.0.0.1:6811/549599] [v2:127.0.0.1:6812/549599,v1:127.0.0.1:6813/549599] exists,up d2bf7afa-10a0-4338-b74d-fbb042cce02b 2020-09-08T16:50:29.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:50:29.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:50:29.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:50:29.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:236: TEST_backfill_out: run_osd td/osd-backfill-stats 2 2020-09-08T16:50:29.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:50:29.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:50:29.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T16:50:29.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:50:29.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/2 2020-09-08T16:50:29.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:50:29.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:50:29.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:50:29.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:50:29.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2020-09-08T16:50:29.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2020-09-08T16:50:29.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:50:29.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:50:29.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:50:29.262 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:50:29.262 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:50:29.263 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:50:29.263 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:50:29.263 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:50:29.263 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:50:29.263 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:50:29.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:50:29.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:50:29.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:50:29.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:50:29.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:50:29.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:50:29.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:50:29.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:50:29.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:50:29.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:50:29.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:50:29.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/2 2020-09-08T16:50:29.266 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:50:29.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=80fe0f00-2667-48fa-b861-7896a5584a25 2020-09-08T16:50:29.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 80fe0f00-2667-48fa-b861-7896a5584a25' 2020-09-08T16:50:29.267 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:50:29.268 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 80fe0f00-2667-48fa-b861-7896a5584a25 2020-09-08T16:50:29.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBVtldfMZWuEBAA+yGHW6A0BXtslHASDinBMg== 2020-09-08T16:50:29.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBVtldfMZWuEBAA+yGHW6A0BXtslHASDinBMg=="}' 2020-09-08T16:50:29.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 80fe0f00-2667-48fa-b861-7896a5584a25 -i td/osd-backfill-stats/2/new.json 2020-09-08T16:50:29.817 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:50:29.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/2/new.json 2020-09-08T16:50:29.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBVtldfMZWuEBAA+yGHW6A0BXtslHASDinBMg== --osd-uuid 80fe0f00-2667-48fa-b861-7896a5584a25 2020-09-08T16:50:29.854 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:29.859+0000 7ffa8c914ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:29.855 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:29.860+0000 7ffa8c914ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:29.857 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:29.862+0000 7ffa8c914ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:29.858 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:29.863+0000 7ffa8c914ec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:50:29.858 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:29.863+0000 7ffa8c914ec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:50:29.859 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:29.863+0000 7ffa8c914ec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:50:29.935 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:29.940+0000 7ffa8c914ec0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2020-09-08T16:50:34.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2020-09-08T16:50:34.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:50:34.255 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T16:50:34.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T16:50:34.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:50:34.799 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T16:50:34.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T16:50:34.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:50:34.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:50:34.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:50:34.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:50:34.822 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:34.826+0000 7f52cd9d0ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:34.824 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:34.828+0000 7f52cd9d0ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:34.825 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:34.829+0000 7f52cd9d0ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:35.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T16:50:35.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:50:35.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T16:50:35.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:50:35.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:50:35.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:50:35.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:50:35.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:50:35.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:50:35.191 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:50:35.350 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:35.353+0000 7f52cd9d0ec0 -1 Falling back to public interface 2020-09-08T16:50:35.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:50:36.136 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:36.140+0000 7f52cd9d0ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T16:50:36.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:50:36.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:50:36.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:50:36.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:50:36.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:50:36.599 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:50:37.003 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/550593,v1:127.0.0.1:6819/550593] [v2:127.0.0.1:6820/550593,v1:127.0.0.1:6821/550593] exists,up 80fe0f00-2667-48fa-b861-7896a5584a25 2020-09-08T16:50:37.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:50:37.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:50:37.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:50:37.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:237: TEST_backfill_out: run_osd td/osd-backfill-stats 3 2020-09-08T16:50:37.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:50:37.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:50:37.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T16:50:37.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:50:37.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/3 2020-09-08T16:50:37.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:50:37.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:50:37.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:50:37.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:50:37.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2020-09-08T16:50:37.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2020-09-08T16:50:37.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:50:37.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:50:37.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:50:37.008 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:50:37.010 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:50:37.010 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:50:37.010 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:50:37.011 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:50:37.011 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:50:37.011 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:50:37.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:50:37.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:50:37.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:50:37.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:50:37.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:50:37.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:50:37.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:50:37.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:50:37.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:50:37.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:50:37.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:50:37.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/3 2020-09-08T16:50:37.014 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:50:37.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=a7f6ef2e-a567-4478-a43e-9cef43c88103 2020-09-08T16:50:37.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 a7f6ef2e-a567-4478-a43e-9cef43c88103' 2020-09-08T16:50:37.015 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:50:37.016 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 a7f6ef2e-a567-4478-a43e-9cef43c88103 2020-09-08T16:50:37.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBdtldfE3CNARAA4K1QnVFUHT7aSV4pcggghg== 2020-09-08T16:50:37.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBdtldfE3CNARAA4K1QnVFUHT7aSV4pcggghg=="}' 2020-09-08T16:50:37.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new a7f6ef2e-a567-4478-a43e-9cef43c88103 -i td/osd-backfill-stats/3/new.json 2020-09-08T16:50:37.549 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T16:50:37.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/3/new.json 2020-09-08T16:50:37.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBdtldfE3CNARAA4K1QnVFUHT7aSV4pcggghg== --osd-uuid a7f6ef2e-a567-4478-a43e-9cef43c88103 2020-09-08T16:50:37.585 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:37.590+0000 7fc927d30ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:37.587 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:37.592+0000 7fc927d30ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:37.594 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:37.593+0000 7fc927d30ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:37.595 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:37.594+0000 7fc927d30ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:50:37.595 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:37.594+0000 7fc927d30ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:50:37.595 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:37.594+0000 7fc927d30ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:50:37.645 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:37.650+0000 7fc927d30ec0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2020-09-08T16:50:41.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2020-09-08T16:50:41.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:50:41.996 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T16:50:41.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T16:50:41.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:50:42.540 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T16:50:42.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T16:50:42.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:50:42.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:50:42.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:50:42.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:50:42.564 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:42.569+0000 7f65ed025ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:42.574 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:42.579+0000 7f65ed025ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:42.576 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:42.580+0000 7f65ed025ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:42.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T16:50:42.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:50:42.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T16:50:42.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:50:42.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:50:42.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:50:42.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:50:42.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:50:42.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:50:42.953 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:50:43.092 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:43.096+0000 7f65ed025ec0 -1 Falling back to public interface 2020-09-08T16:50:43.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:50:43.891 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:43.896+0000 7f65ed025ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T16:50:44.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:50:44.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:50:44.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:50:44.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:50:44.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:50:44.345 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:50:44.776 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/551587,v1:127.0.0.1:6827/551587] [v2:127.0.0.1:6828/551587,v1:127.0.0.1:6829/551587] exists,up a7f6ef2e-a567-4478-a43e-9cef43c88103 2020-09-08T16:50:44.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:50:44.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:50:44.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:50:44.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:238: TEST_backfill_out: run_osd td/osd-backfill-stats 4 2020-09-08T16:50:44.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:50:44.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:50:44.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=4 2020-09-08T16:50:44.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:50:44.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/4 2020-09-08T16:50:44.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:50:44.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:50:44.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:50:44.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:50:44.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2020-09-08T16:50:44.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2020-09-08T16:50:44.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:50:44.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:50:44.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:50:44.780 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:50:44.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:50:44.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:50:44.781 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:50:44.781 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:50:44.781 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:50:44.782 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:50:44.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:50:44.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:50:44.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:50:44.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:50:44.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:50:44.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:50:44.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:50:44.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:50:44.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:50:44.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:50:44.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:50:44.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/4 2020-09-08T16:50:44.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:50:44.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=a5a16a82-d8cd-451b-81c3-e07bf5b00a7c 2020-09-08T16:50:44.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd4 a5a16a82-d8cd-451b-81c3-e07bf5b00a7c' 2020-09-08T16:50:44.787 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:50:44.788 INFO:tasks.workunit.client.0.smithi065.stdout:add osd4 a5a16a82-d8cd-451b-81c3-e07bf5b00a7c 2020-09-08T16:50:44.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBktldfF8uNLxAA80cdG27+bupuoeTiwsIrWQ== 2020-09-08T16:50:44.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBktldfF8uNLxAA80cdG27+bupuoeTiwsIrWQ=="}' 2020-09-08T16:50:44.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new a5a16a82-d8cd-451b-81c3-e07bf5b00a7c -i td/osd-backfill-stats/4/new.json 2020-09-08T16:50:45.335 INFO:tasks.workunit.client.0.smithi065.stdout:4 2020-09-08T16:50:45.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/4/new.json 2020-09-08T16:50:45.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 4 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBktldfF8uNLxAA80cdG27+bupuoeTiwsIrWQ== --osd-uuid a5a16a82-d8cd-451b-81c3-e07bf5b00a7c 2020-09-08T16:50:45.372 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:45.377+0000 7f37b69dcec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:45.373 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:45.378+0000 7f37b69dcec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:45.375 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:45.380+0000 7f37b69dcec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:45.376 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:45.381+0000 7f37b69dcec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:50:45.376 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:45.381+0000 7f37b69dcec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:50:45.376 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:45.381+0000 7f37b69dcec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:50:45.410 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:45.415+0000 7f37b69dcec0 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2020-09-08T16:50:49.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2020-09-08T16:50:49.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:50:49.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd4 key to auth repository 2020-09-08T16:50:49.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:50:49.895 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd4 key to auth repository 2020-09-08T16:50:50.452 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.4 2020-09-08T16:50:50.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.4 2020-09-08T16:50:50.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 4 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:50:50.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:50:50.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:50:50.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:50:50.475 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:50.480+0000 7f34215bdec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:50.487 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:50.489+0000 7f34215bdec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:50.487 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:50.490+0000 7f34215bdec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:50.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 4 2020-09-08T16:50:50.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:50:50.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=4 2020-09-08T16:50:50.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:50:50.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:50:50.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:50:50.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:50:50.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:50:50.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:50:50.857 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:50:51.009 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:51.013+0000 7f34215bdec0 -1 Falling back to public interface 2020-09-08T16:50:51.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:50:51.801 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:51.806+0000 7f34215bdec0 -1 osd.4 0 log_to_monitors {default=true} 2020-09-08T16:50:52.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:50:52.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:50:52.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:50:52.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:50:52.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:50:52.264 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:50:52.735 INFO:tasks.workunit.client.0.smithi065.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/552589,v1:127.0.0.1:6835/552589] [v2:127.0.0.1:6836/552589,v1:127.0.0.1:6837/552589] exists,up a5a16a82-d8cd-451b-81c3-e07bf5b00a7c 2020-09-08T16:50:52.736 INFO:tasks.workunit.client.0.smithi065.stdout:add osd5 4997e198-8108-4886-8674-1cbe009a89ab 2020-09-08T16:50:52.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:50:52.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:50:52.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:50:52.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:239: TEST_backfill_out: run_osd td/osd-backfill-stats 5 2020-09-08T16:50:52.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:50:52.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:50:52.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=5 2020-09-08T16:50:52.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:50:52.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/5 2020-09-08T16:50:52.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:50:52.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:50:52.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:50:52.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:50:52.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/5' 2020-09-08T16:50:52.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/5/journal' 2020-09-08T16:50:52.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:50:52.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:50:52.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:50:52.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:50:52.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:50:52.743 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:50:52.743 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:50:52.744 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:50:52.744 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:50:52.744 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:50:52.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:50:52.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:50:52.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:50:52.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:50:52.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:50:52.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:50:52.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:50:52.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:50:52.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:50:52.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:50:52.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:50:52.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/5 2020-09-08T16:50:52.747 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:50:52.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=4997e198-8108-4886-8674-1cbe009a89ab 2020-09-08T16:50:52.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd5 4997e198-8108-4886-8674-1cbe009a89ab' 2020-09-08T16:50:52.748 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:50:52.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBstldfybcRLRAAdMnzuxlROfX5Y8z2JIFWAg== 2020-09-08T16:50:52.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBstldfybcRLRAAdMnzuxlROfX5Y8z2JIFWAg=="}' 2020-09-08T16:50:52.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 4997e198-8108-4886-8674-1cbe009a89ab -i td/osd-backfill-stats/5/new.json 2020-09-08T16:50:53.267 INFO:tasks.workunit.client.0.smithi065.stdout:5 2020-09-08T16:50:53.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/5/new.json 2020-09-08T16:50:53.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 5 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBstldfybcRLRAAdMnzuxlROfX5Y8z2JIFWAg== --osd-uuid 4997e198-8108-4886-8674-1cbe009a89ab 2020-09-08T16:50:53.303 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:53.308+0000 7f60f0208ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:53.317 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:53.322+0000 7f60f0208ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:53.318 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:53.323+0000 7f60f0208ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:53.319 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:53.324+0000 7f60f0208ec0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2020-09-08T16:50:53.320 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:53.324+0000 7f60f0208ec0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2020-09-08T16:50:53.320 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:53.324+0000 7f60f0208ec0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2020-09-08T16:50:53.384 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:53.389+0000 7f60f0208ec0 -1 bluestore(td/osd-backfill-stats/5) _read_fsid unparsable uuid 2020-09-08T16:50:57.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/5/keyring 2020-09-08T16:50:57.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:50:57.853 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd5 key to auth repository 2020-09-08T16:50:57.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd5 key to auth repository 2020-09-08T16:50:57.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:50:58.389 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.5 2020-09-08T16:50:58.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.5 2020-09-08T16:50:58.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:50:58.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:50:58.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:50:58.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 5 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:50:58.412 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:58.417+0000 7f211eb5fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:58.425 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:58.419+0000 7f211eb5fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:58.425 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:58.421+0000 7f211eb5fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:50:58.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 5 2020-09-08T16:50:58.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:50:58.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=5 2020-09-08T16:50:58.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:50:58.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:50:58.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:50:58.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:50:58.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T16:50:58.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:50:58.783 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:50:58.938 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:58.942+0000 7f211eb5fec0 -1 Falling back to public interface 2020-09-08T16:50:59.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:50:59.726 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:50:59.730+0000 7f211eb5fec0 -1 osd.5 0 log_to_monitors {default=true} 2020-09-08T16:51:00.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:51:00.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:51:00.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:51:00.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:51:00.178 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:51:00.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T16:51:00.610 INFO:tasks.workunit.client.0.smithi065.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/553583,v1:127.0.0.1:6843/553583] [v2:127.0.0.1:6844/553583,v1:127.0.0.1:6845/553583] exists,up 4997e198-8108-4886-8674-1cbe009a89ab 2020-09-08T16:51:00.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:51:00.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:51:00.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:51:00.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:241: TEST_backfill_out: create_pool test 1 1 2020-09-08T16:51:00.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test 1 1 2020-09-08T16:51:01.227 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' already exists 2020-09-08T16:51:01.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:51:02.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:242: TEST_backfill_out: ceph osd pool set test size 2 2020-09-08T16:51:03.036 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 2 2020-09-08T16:51:03.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:243: TEST_backfill_out: sleep 5 2020-09-08T16:51:08.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:245: TEST_backfill_out: wait_for_clean 2020-09-08T16:51:08.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:51:08.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:51:08.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:51:08.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:51:08.050 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:51:08.050 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:51:08.050 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:51:08.051 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:51:08.051 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:51:08.051 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:51:08.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:51:08.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:51:08.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:51:08.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:51:08.157 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:51:08.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:51:08.578 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:51:08.578 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:51:08.579 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:51:08.579 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T16:51:08.579 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T16:51:08.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:51:08.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:51:08.580 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:51:08.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836492 2020-09-08T16:51:08.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836492 2020-09-08T16:51:08.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836492' 2020-09-08T16:51:08.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:51:08.707 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:51:08.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672970 2020-09-08T16:51:08.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672970 2020-09-08T16:51:08.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836492 1-42949672970' 2020-09-08T16:51:08.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:51:08.837 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:51:08.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509450 2020-09-08T16:51:08.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509450 2020-09-08T16:51:08.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836492 1-42949672970 2-64424509450' 2020-09-08T16:51:08.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:51:08.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:51:09.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345927 2020-09-08T16:51:09.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345927 2020-09-08T16:51:09.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836492 1-42949672970 2-64424509450 3-85899345927' 2020-09-08T16:51:09.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:51:09.100 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:51:09.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182406 2020-09-08T16:51:09.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182406 2020-09-08T16:51:09.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836492 1-42949672970 2-64424509450 3-85899345927 4-107374182406' 2020-09-08T16:51:09.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:51:09.229 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T16:51:09.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018884 2020-09-08T16:51:09.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018884 2020-09-08T16:51:09.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836492 1-42949672970 2-64424509450 3-85899345927 4-107374182406 5-128849018884' 2020-09-08T16:51:09.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:51:09.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836492 2020-09-08T16:51:09.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:51:09.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:51:09.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836492 2020-09-08T16:51:09.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:51:09.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836492 2020-09-08T16:51:09.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2020-09-08T16:51:09.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:51:09.369 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836492 2020-09-08T16:51:10.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836490 -lt 21474836492 2020-09-08T16:51:10.593 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:51:11.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:51:11.589 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:51:11.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836492 -lt 21474836492 2020-09-08T16:51:11.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:51:11.995 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672970 2020-09-08T16:51:11.995 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:51:11.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:51:11.996 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672970 2020-09-08T16:51:11.996 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:51:11.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672970 2020-09-08T16:51:11.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672970' 2020-09-08T16:51:11.997 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:51:11.998 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672970 2020-09-08T16:51:12.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672971 -lt 42949672970 2020-09-08T16:51:12.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:51:12.403 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509450 2020-09-08T16:51:12.403 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:51:12.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:51:12.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509450 2020-09-08T16:51:12.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:51:12.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509450 2020-09-08T16:51:12.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509450' 2020-09-08T16:51:12.405 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:51:12.405 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509450 2020-09-08T16:51:12.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509450 -lt 64424509450 2020-09-08T16:51:12.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:51:12.803 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345927 2020-09-08T16:51:12.803 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:51:12.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:51:12.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345927 2020-09-08T16:51:12.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:51:12.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345927 2020-09-08T16:51:12.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345927' 2020-09-08T16:51:12.805 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345927 2020-09-08T16:51:12.805 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:51:13.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345928 -lt 85899345927 2020-09-08T16:51:13.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:51:13.202 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182406 2020-09-08T16:51:13.202 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:51:13.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:51:13.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182406 2020-09-08T16:51:13.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:51:13.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182406 2020-09-08T16:51:13.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182406' 2020-09-08T16:51:13.206 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:51:13.206 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182406 2020-09-08T16:51:13.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182406 -lt 107374182406 2020-09-08T16:51:13.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:51:13.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018884 2020-09-08T16:51:13.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:51:13.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T16:51:13.615 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018884 2020-09-08T16:51:13.615 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:51:13.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018884 2020-09-08T16:51:13.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018884' 2020-09-08T16:51:13.616 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T16:51:13.617 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018884 2020-09-08T16:51:14.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018885 -lt 128849018884 2020-09-08T16:51:14.009 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:51:14.010 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:51:14.010 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:51:14.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T16:51:14.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:51:14.551 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:51:14.551 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:51:14.551 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:51:14.552 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:51:14.552 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:51:14.552 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:51:14.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T16:51:14.937 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:51:14.937 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:51:14.938 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:51:15.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T16:51:15.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:51:15.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:51:15.458 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: seq 1 200 2020-09-08T16:51:15.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:15.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj1 /dev/null 2020-09-08T16:51:15.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:15.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj2 /dev/null 2020-09-08T16:51:15.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:15.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj3 /dev/null 2020-09-08T16:51:15.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:15.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj4 /dev/null 2020-09-08T16:51:15.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:15.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj5 /dev/null 2020-09-08T16:51:15.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:15.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj6 /dev/null 2020-09-08T16:51:16.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:16.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj7 /dev/null 2020-09-08T16:51:16.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:16.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj8 /dev/null 2020-09-08T16:51:16.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:16.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj9 /dev/null 2020-09-08T16:51:16.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:16.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj10 /dev/null 2020-09-08T16:51:16.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:16.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj11 /dev/null 2020-09-08T16:51:16.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:16.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj12 /dev/null 2020-09-08T16:51:16.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:16.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj13 /dev/null 2020-09-08T16:51:16.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:16.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj14 /dev/null 2020-09-08T16:51:16.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:16.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj15 /dev/null 2020-09-08T16:51:16.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:16.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj16 /dev/null 2020-09-08T16:51:17.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:17.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj17 /dev/null 2020-09-08T16:51:17.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:17.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj18 /dev/null 2020-09-08T16:51:17.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:17.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj19 /dev/null 2020-09-08T16:51:17.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:17.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj20 /dev/null 2020-09-08T16:51:17.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:17.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj21 /dev/null 2020-09-08T16:51:17.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:17.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj22 /dev/null 2020-09-08T16:51:17.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:17.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj23 /dev/null 2020-09-08T16:51:17.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:17.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj24 /dev/null 2020-09-08T16:51:17.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:17.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj25 /dev/null 2020-09-08T16:51:18.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:18.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj26 /dev/null 2020-09-08T16:51:18.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:18.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj27 /dev/null 2020-09-08T16:51:18.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:18.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj28 /dev/null 2020-09-08T16:51:18.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:18.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj29 /dev/null 2020-09-08T16:51:18.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:18.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj30 /dev/null 2020-09-08T16:51:18.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:18.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj31 /dev/null 2020-09-08T16:51:18.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:18.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj32 /dev/null 2020-09-08T16:51:18.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:18.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj33 /dev/null 2020-09-08T16:51:18.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:18.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj34 /dev/null 2020-09-08T16:51:18.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:18.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj35 /dev/null 2020-09-08T16:51:19.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:19.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj36 /dev/null 2020-09-08T16:51:19.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:19.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj37 /dev/null 2020-09-08T16:51:19.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:19.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj38 /dev/null 2020-09-08T16:51:19.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:19.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj39 /dev/null 2020-09-08T16:51:19.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:19.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj40 /dev/null 2020-09-08T16:51:19.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:19.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj41 /dev/null 2020-09-08T16:51:19.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:19.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj42 /dev/null 2020-09-08T16:51:19.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:19.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj43 /dev/null 2020-09-08T16:51:19.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:19.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj44 /dev/null 2020-09-08T16:51:19.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:19.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj45 /dev/null 2020-09-08T16:51:19.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:19.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj46 /dev/null 2020-09-08T16:51:20.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:20.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj47 /dev/null 2020-09-08T16:51:20.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:20.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj48 /dev/null 2020-09-08T16:51:20.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:20.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj49 /dev/null 2020-09-08T16:51:20.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:20.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj50 /dev/null 2020-09-08T16:51:20.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:20.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj51 /dev/null 2020-09-08T16:51:20.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:20.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj52 /dev/null 2020-09-08T16:51:20.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:20.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj53 /dev/null 2020-09-08T16:51:20.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:20.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj54 /dev/null 2020-09-08T16:51:20.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:20.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj55 /dev/null 2020-09-08T16:51:20.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:20.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj56 /dev/null 2020-09-08T16:51:21.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:21.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj57 /dev/null 2020-09-08T16:51:21.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:21.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj58 /dev/null 2020-09-08T16:51:21.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:21.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj59 /dev/null 2020-09-08T16:51:21.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:21.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj60 /dev/null 2020-09-08T16:51:21.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:21.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj61 /dev/null 2020-09-08T16:51:21.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:21.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj62 /dev/null 2020-09-08T16:51:21.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:21.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj63 /dev/null 2020-09-08T16:51:21.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:21.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj64 /dev/null 2020-09-08T16:51:21.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:21.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj65 /dev/null 2020-09-08T16:51:21.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:21.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj66 /dev/null 2020-09-08T16:51:21.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:21.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj67 /dev/null 2020-09-08T16:51:22.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:22.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj68 /dev/null 2020-09-08T16:51:22.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:22.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj69 /dev/null 2020-09-08T16:51:22.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:22.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj70 /dev/null 2020-09-08T16:51:22.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:22.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj71 /dev/null 2020-09-08T16:51:22.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:22.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj72 /dev/null 2020-09-08T16:51:22.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:22.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj73 /dev/null 2020-09-08T16:51:22.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:22.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj74 /dev/null 2020-09-08T16:51:22.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:22.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj75 /dev/null 2020-09-08T16:51:22.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:22.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj76 /dev/null 2020-09-08T16:51:23.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:23.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj77 /dev/null 2020-09-08T16:51:23.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:23.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj78 /dev/null 2020-09-08T16:51:23.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:23.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj79 /dev/null 2020-09-08T16:51:23.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:23.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj80 /dev/null 2020-09-08T16:51:23.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:23.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj81 /dev/null 2020-09-08T16:51:23.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:23.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj82 /dev/null 2020-09-08T16:51:23.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:23.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj83 /dev/null 2020-09-08T16:51:23.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:23.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj84 /dev/null 2020-09-08T16:51:23.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:23.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj85 /dev/null 2020-09-08T16:51:23.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:23.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj86 /dev/null 2020-09-08T16:51:23.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:23.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj87 /dev/null 2020-09-08T16:51:24.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:24.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj88 /dev/null 2020-09-08T16:51:24.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:24.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj89 /dev/null 2020-09-08T16:51:24.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:24.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj90 /dev/null 2020-09-08T16:51:24.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:24.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj91 /dev/null 2020-09-08T16:51:24.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:24.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj92 /dev/null 2020-09-08T16:51:24.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:24.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj93 /dev/null 2020-09-08T16:51:24.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:24.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj94 /dev/null 2020-09-08T16:51:24.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:24.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj95 /dev/null 2020-09-08T16:51:24.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:24.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj96 /dev/null 2020-09-08T16:51:25.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:25.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj97 /dev/null 2020-09-08T16:51:25.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:25.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj98 /dev/null 2020-09-08T16:51:25.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:25.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj99 /dev/null 2020-09-08T16:51:25.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:25.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj100 /dev/null 2020-09-08T16:51:25.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:25.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj101 /dev/null 2020-09-08T16:51:25.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:25.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj102 /dev/null 2020-09-08T16:51:25.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:25.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj103 /dev/null 2020-09-08T16:51:25.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:25.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj104 /dev/null 2020-09-08T16:51:25.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:25.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj105 /dev/null 2020-09-08T16:51:25.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:25.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj106 /dev/null 2020-09-08T16:51:25.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:25.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj107 /dev/null 2020-09-08T16:51:26.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:26.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj108 /dev/null 2020-09-08T16:51:26.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:26.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj109 /dev/null 2020-09-08T16:51:26.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:26.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj110 /dev/null 2020-09-08T16:51:26.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:26.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj111 /dev/null 2020-09-08T16:51:26.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:26.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj112 /dev/null 2020-09-08T16:51:26.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:26.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj113 /dev/null 2020-09-08T16:51:26.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:26.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj114 /dev/null 2020-09-08T16:51:26.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:26.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj115 /dev/null 2020-09-08T16:51:26.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:26.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj116 /dev/null 2020-09-08T16:51:27.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:27.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj117 /dev/null 2020-09-08T16:51:27.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:27.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj118 /dev/null 2020-09-08T16:51:27.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:27.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj119 /dev/null 2020-09-08T16:51:27.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:27.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj120 /dev/null 2020-09-08T16:51:27.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:27.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj121 /dev/null 2020-09-08T16:51:27.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:27.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj122 /dev/null 2020-09-08T16:51:27.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:27.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj123 /dev/null 2020-09-08T16:51:27.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:27.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj124 /dev/null 2020-09-08T16:51:27.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:27.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj125 /dev/null 2020-09-08T16:51:27.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:27.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj126 /dev/null 2020-09-08T16:51:27.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:27.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj127 /dev/null 2020-09-08T16:51:28.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:28.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj128 /dev/null 2020-09-08T16:51:28.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:28.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj129 /dev/null 2020-09-08T16:51:28.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:28.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj130 /dev/null 2020-09-08T16:51:28.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:28.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj131 /dev/null 2020-09-08T16:51:28.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:28.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj132 /dev/null 2020-09-08T16:51:28.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:28.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj133 /dev/null 2020-09-08T16:51:28.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:28.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj134 /dev/null 2020-09-08T16:51:28.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:28.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj135 /dev/null 2020-09-08T16:51:28.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:28.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj136 /dev/null 2020-09-08T16:51:29.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:29.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj137 /dev/null 2020-09-08T16:51:29.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:29.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj138 /dev/null 2020-09-08T16:51:29.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:29.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj139 /dev/null 2020-09-08T16:51:29.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:29.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj140 /dev/null 2020-09-08T16:51:29.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:29.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj141 /dev/null 2020-09-08T16:51:29.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:29.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj142 /dev/null 2020-09-08T16:51:29.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:29.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj143 /dev/null 2020-09-08T16:51:29.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:29.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj144 /dev/null 2020-09-08T16:51:29.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:29.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj145 /dev/null 2020-09-08T16:51:29.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:29.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj146 /dev/null 2020-09-08T16:51:29.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:29.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj147 /dev/null 2020-09-08T16:51:30.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:30.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj148 /dev/null 2020-09-08T16:51:30.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:30.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj149 /dev/null 2020-09-08T16:51:30.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:30.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj150 /dev/null 2020-09-08T16:51:30.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:30.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj151 /dev/null 2020-09-08T16:51:30.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:30.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj152 /dev/null 2020-09-08T16:51:30.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:30.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj153 /dev/null 2020-09-08T16:51:30.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:30.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj154 /dev/null 2020-09-08T16:51:30.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:30.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj155 /dev/null 2020-09-08T16:51:30.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:30.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj156 /dev/null 2020-09-08T16:51:30.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:30.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj157 /dev/null 2020-09-08T16:51:30.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:30.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj158 /dev/null 2020-09-08T16:51:31.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:31.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj159 /dev/null 2020-09-08T16:51:31.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:31.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj160 /dev/null 2020-09-08T16:51:31.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:31.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj161 /dev/null 2020-09-08T16:51:31.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:31.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj162 /dev/null 2020-09-08T16:51:31.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:31.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj163 /dev/null 2020-09-08T16:51:31.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:31.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj164 /dev/null 2020-09-08T16:51:31.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:31.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj165 /dev/null 2020-09-08T16:51:31.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:31.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj166 /dev/null 2020-09-08T16:51:31.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:31.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj167 /dev/null 2020-09-08T16:51:31.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:31.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj168 /dev/null 2020-09-08T16:51:31.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:31.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj169 /dev/null 2020-09-08T16:51:32.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:32.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj170 /dev/null 2020-09-08T16:51:32.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:32.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj171 /dev/null 2020-09-08T16:51:32.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:32.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj172 /dev/null 2020-09-08T16:51:32.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:32.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj173 /dev/null 2020-09-08T16:51:32.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:32.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj174 /dev/null 2020-09-08T16:51:32.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:32.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj175 /dev/null 2020-09-08T16:51:32.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:32.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj176 /dev/null 2020-09-08T16:51:32.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:32.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj177 /dev/null 2020-09-08T16:51:32.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:32.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj178 /dev/null 2020-09-08T16:51:33.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:33.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj179 /dev/null 2020-09-08T16:51:33.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:33.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj180 /dev/null 2020-09-08T16:51:33.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:33.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj181 /dev/null 2020-09-08T16:51:33.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:33.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj182 /dev/null 2020-09-08T16:51:33.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:33.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj183 /dev/null 2020-09-08T16:51:33.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:33.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj184 /dev/null 2020-09-08T16:51:33.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:33.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj185 /dev/null 2020-09-08T16:51:33.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:33.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj186 /dev/null 2020-09-08T16:51:33.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:33.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj187 /dev/null 2020-09-08T16:51:33.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:33.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj188 /dev/null 2020-09-08T16:51:33.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:33.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj189 /dev/null 2020-09-08T16:51:34.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:34.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj190 /dev/null 2020-09-08T16:51:34.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:34.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj191 /dev/null 2020-09-08T16:51:34.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:34.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj192 /dev/null 2020-09-08T16:51:34.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:34.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj193 /dev/null 2020-09-08T16:51:34.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:34.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj194 /dev/null 2020-09-08T16:51:34.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:34.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj195 /dev/null 2020-09-08T16:51:34.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:34.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj196 /dev/null 2020-09-08T16:51:34.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:34.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj197 /dev/null 2020-09-08T16:51:34.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:34.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj198 /dev/null 2020-09-08T16:51:34.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:34.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj199 /dev/null 2020-09-08T16:51:35.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2020-09-08T16:51:35.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj200 /dev/null 2020-09-08T16:51:35.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:252: TEST_backfill_out: get_pg test obj1 2020-09-08T16:51:35.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1031: get_pg: local poolname=test 2020-09-08T16:51:35.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: local objectname=obj1 2020-09-08T16:51:35.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: ceph --format json osd map test obj1 2020-09-08T16:51:35.176 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: jq -r .pgid 2020-09-08T16:51:35.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:252: TEST_backfill_out: local PG=1.0 2020-09-08T16:51:35.570 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:254: TEST_backfill_out: get_primary test obj1 2020-09-08T16:51:35.570 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:51:35.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:51:35.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:51:35.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:51:35.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:254: TEST_backfill_out: local primary=1 2020-09-08T16:51:35.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:256: TEST_backfill_out: ceph osd set nobackfill 2020-09-08T16:51:36.828 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is set 2020-09-08T16:51:36.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:257: TEST_backfill_out: get_not_primary test obj1 2020-09-08T16:51:36.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1167: get_not_primary: local poolname=test 2020-09-08T16:51:36.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: get_not_primary: local objectname=obj1 2020-09-08T16:51:36.839 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: get_primary test obj1 2020-09-08T16:51:36.839 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:51:36.839 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:51:36.840 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:51:36.840 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:51:37.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: local primary=1 2020-09-08T16:51:37.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1171: get_not_primary: ceph --format json osd map test obj1 2020-09-08T16:51:37.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1172: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2020-09-08T16:51:37.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:257: TEST_backfill_out: ceph osd out osd.0 2020-09-08T16:51:38.275 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already out. 2020-09-08T16:51:38.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:258: TEST_backfill_out: sleep 2 2020-09-08T16:51:40.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:259: TEST_backfill_out: ceph osd unset nobackfill 2020-09-08T16:51:41.124 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is unset 2020-09-08T16:51:41.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:261: TEST_backfill_out: wait_for_clean 2020-09-08T16:51:41.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:51:41.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:51:41.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:51:41.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:51:41.136 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:51:41.136 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:51:41.136 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:51:41.136 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:51:41.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:51:41.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:51:41.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:51:41.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:51:41.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:51:41.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:51:41.230 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:51:41.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:51:41.625 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:51:41.625 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:51:41.625 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:51:41.626 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T16:51:41.626 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T16:51:41.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:51:41.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:51:41.626 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:51:41.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836500 2020-09-08T16:51:41.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836500 2020-09-08T16:51:41.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836500' 2020-09-08T16:51:41.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:51:41.756 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:51:41.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672979 2020-09-08T16:51:41.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672979 2020-09-08T16:51:41.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836500 1-42949672979' 2020-09-08T16:51:41.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:51:41.888 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:51:42.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509458 2020-09-08T16:51:42.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509458 2020-09-08T16:51:42.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836500 1-42949672979 2-64424509458' 2020-09-08T16:51:42.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:51:42.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:51:42.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345936 2020-09-08T16:51:42.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345936 2020-09-08T16:51:42.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836500 1-42949672979 2-64424509458 3-85899345936' 2020-09-08T16:51:42.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:51:42.150 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:51:42.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182414 2020-09-08T16:51:42.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182414 2020-09-08T16:51:42.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836500 1-42949672979 2-64424509458 3-85899345936 4-107374182414' 2020-09-08T16:51:42.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:51:42.281 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T16:51:42.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018893 2020-09-08T16:51:42.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018893 2020-09-08T16:51:42.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836500 1-42949672979 2-64424509458 3-85899345936 4-107374182414 5-128849018893' 2020-09-08T16:51:42.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:51:42.413 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836500 2020-09-08T16:51:42.413 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:51:42.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:51:42.414 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836500 2020-09-08T16:51:42.414 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:51:42.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836500 2020-09-08T16:51:42.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836500' 2020-09-08T16:51:42.415 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:51:42.415 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836500 2020-09-08T16:51:42.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836500 -lt 21474836500 2020-09-08T16:51:42.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:51:42.829 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672979 2020-09-08T16:51:42.829 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:51:42.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:51:42.830 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672979 2020-09-08T16:51:42.830 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:51:42.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672979 2020-09-08T16:51:42.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672979' 2020-09-08T16:51:42.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:51:42.832 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672979 2020-09-08T16:51:43.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672979 -lt 42949672979 2020-09-08T16:51:43.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:51:43.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509458 2020-09-08T16:51:43.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:51:43.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:51:43.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509458 2020-09-08T16:51:43.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:51:43.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509458 2020-09-08T16:51:43.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509458' 2020-09-08T16:51:43.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:51:43.225 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509458 2020-09-08T16:51:43.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509458 -lt 64424509458 2020-09-08T16:51:43.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:51:43.636 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345936 2020-09-08T16:51:43.636 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:51:43.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:51:43.637 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345936 2020-09-08T16:51:43.637 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:51:43.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345936 2020-09-08T16:51:43.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345936' 2020-09-08T16:51:43.638 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:51:43.639 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345936 2020-09-08T16:51:44.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345936 -lt 85899345936 2020-09-08T16:51:44.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:51:44.033 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182414 2020-09-08T16:51:44.033 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:51:44.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:51:44.034 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182414 2020-09-08T16:51:44.034 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:51:44.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182414 2020-09-08T16:51:44.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182414' 2020-09-08T16:51:44.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:51:44.036 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182414 2020-09-08T16:51:44.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182415 -lt 107374182414 2020-09-08T16:51:44.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:51:44.431 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018893 2020-09-08T16:51:44.431 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:51:44.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T16:51:44.432 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018893 2020-09-08T16:51:44.432 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:51:44.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018893 2020-09-08T16:51:44.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018893' 2020-09-08T16:51:44.433 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T16:51:44.433 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018893 2020-09-08T16:51:44.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018893 -lt 128849018893 2020-09-08T16:51:44.826 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:51:44.826 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:51:44.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:51:45.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T16:51:45.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:51:45.352 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:51:45.352 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:51:45.352 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:51:45.352 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:51:45.352 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:51:45.353 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:51:45.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:51:45.734 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:51:45.735 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:51:45.735 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:51:46.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:51:46.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T16:51:46.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T16:51:46.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T16:51:46.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:51:46.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:51:46.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:51:46.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:51:46.357 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:51:46.358 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:51:46.358 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:51:46.358 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:51:46.358 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:51:46.359 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:51:46.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:51:46.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:51:46.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:51:46.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:51:47.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:51:47.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:51:47.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:51:47.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:51:47.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:51:47.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:51:47.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:51:47.267 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:51:47.267 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:51:47.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:51:47.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:51:47.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:51:47.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:51:47.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:51:47.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:51:47.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:51:47.890 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:51:47.890 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:51:47.891 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:51:47.891 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:51:47.891 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:51:47.891 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:51:48.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:51:48.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:51:48.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:51:48.370 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:51:48.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:51:48.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:51:48.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:51:48.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:51:48.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:51:48.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:51:48.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:51:48.890 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:51:48.890 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:51:49.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:51:49.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:51:49.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:51:49.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:51:49.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:51:49.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:51:49.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:51:49.522 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:51:49.522 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:51:49.522 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:51:49.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:51:49.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:51:49.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:51:49.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:51:49.904 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:51:49.905 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:51:49.905 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:51:50.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:51:50.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:51:50.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:51:50.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:51:50.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:51:50.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:51:50.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:51:50.419 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:51:50.420 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:51:50.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:51:50.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:51:50.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:51:50.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:51:50.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:51:51.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:51:51.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:51:51.070 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:51:51.070 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:51:51.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:51:51.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:51:51.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:51:51.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:51:51.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:51:51.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:51:51.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:51:51.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:51:51.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:51:51.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:51:51.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:51:51.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:51:51.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:51:51.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:51:51.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:51:51.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:51:51.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:51:52.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:51:52.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:51:52.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:51:52.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:51:52.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:51:52.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:51:52.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:51:52.603 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:51:52.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:51:52.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:51:52.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:51:52.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:51:52.605 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:51:52.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:51:52.987 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:51:52.988 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:51:52.988 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:51:53.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:51:53.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:51:53.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:51:53.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:51:53.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:51:53.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:51:53.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:51:53.510 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:51:53.510 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:51:54.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:51:54.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:51:54.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:51:54.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:51:54.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:51:54.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:51:54.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:51:54.131 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:51:54.131 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:51:54.131 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:51:54.131 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:51:54.131 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:51:54.132 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:51:54.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:51:54.512 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:51:54.513 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:51:54.513 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:51:55.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:51:55.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:51:55.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:51:55.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:51:55.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:51:55.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:51:55.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:51:55.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:51:55.031 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:51:55.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:51:55.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:51:55.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:51:55.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:51:55.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:51:55.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:51:55.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:51:55.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:51:55.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:51:55.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:51:55.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:51:55.670 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:51:55.670 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:51:56.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:51:56.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:51:56.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:51:56.055 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:51:56.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:51:56.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:51:56.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:51:56.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:51:56.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:51:56.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:51:56.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:51:56.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:51:56.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:51:57.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=7 2020-09-08T16:51:57.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 7 '!=' null 2020-09-08T16:51:57.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:51:57.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:51:57.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:51:57.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:51:57.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:51:57.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:51:57.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:51:57.193 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:51:57.193 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:51:57.193 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:51:57.193 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:51:57.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:51:57.572 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:51:57.572 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:51:57.573 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:51:58.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:51:58.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:51:58.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:51:58.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:51:58.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:51:58.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:51:58.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:51:58.094 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:51:58.094 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:51:58.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:51:58.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:51:58.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:51:58.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:51:58.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:51:58.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:51:58.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:51:58.713 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:51:58.713 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:51:58.714 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:51:58.714 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:51:58.714 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:51:58.714 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:51:59.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:51:59.096 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:51:59.097 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:51:59.097 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:51:59.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:51:59.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:51:59.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:51:59.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:51:59.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:51:59.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:51:59.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:51:59.622 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:51:59.623 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:52:00.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:52:00.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:52:00.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:52:00.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:52:00.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:52:00.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:52:00.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:52:00.253 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:52:00.253 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:52:00.253 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:52:00.253 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:52:00.254 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:52:00.254 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:52:00.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:52:00.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:52:00.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:52:00.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:52:01.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:52:01.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:52:01.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:52:01.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:52:01.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:52:01.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:52:01.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:52:01.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:52:01.149 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:52:01.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=8 2020-09-08T16:52:01.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 8 '!=' null 2020-09-08T16:52:01.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:52:01.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:52:01.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:52:01.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:52:01.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:52:01.772 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:52:01.773 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:52:01.773 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:52:01.774 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:52:01.774 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:52:01.774 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:52:02.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:52:02.150 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:52:02.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:52:02.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:52:02.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:52:02.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:52:02.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:52:02.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:52:02.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:52:02.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:52:02.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:52:02.674 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:52:02.674 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:52:03.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:52:03.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:52:03.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:52:03.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:52:03.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:52:03.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:52:03.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:52:03.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:52:03.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:52:03.300 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:52:03.300 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:52:03.300 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:52:03.300 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:52:03.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:52:03.680 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:52:03.680 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:52:03.680 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:52:04.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:52:04.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:52:04.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:52:04.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:52:04.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:52:04.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:52:04.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:52:04.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:52:04.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:52:04.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:52:04.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:52:04.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:52:04.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:52:04.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:52:04.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:52:04.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:52:04.825 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:52:04.825 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:52:04.826 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:52:04.826 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:52:04.826 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:52:04.826 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:52:05.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:52:05.206 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:52:05.206 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:52:05.206 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:52:05.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:52:05.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:52:05.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:52:05.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:52:05.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:52:05.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:52:05.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:52:05.735 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:52:05.735 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:52:06.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:52:06.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:52:06.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:52:06.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:52:06.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:52:06.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:52:06.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:52:06.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:52:06.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:52:06.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:52:06.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:52:06.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:52:06.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:52:06.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:52:06.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:52:06.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:52:06.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:52:07.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:52:07.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:52:07.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:52:07.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:52:07.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:52:07.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:52:07.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:52:07.269 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:52:07.269 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:52:07.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=8 2020-09-08T16:52:07.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 8 '!=' null 2020-09-08T16:52:07.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:52:07.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:52:07.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:52:07.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:52:07.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:52:07.890 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:52:07.891 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:52:07.891 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:52:07.891 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:52:07.891 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:52:07.891 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:52:08.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:52:08.280 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:52:08.280 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:52:08.281 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:52:08.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:52:08.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:52:08.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:52:08.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:52:08.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:52:08.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:52:08.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:52:08.803 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:52:08.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:52:09.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:52:09.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:52:09.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:52:09.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:52:09.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:52:09.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:52:09.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:52:09.445 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:52:09.445 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:52:09.445 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:52:09.446 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:52:09.446 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:52:09.446 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:52:09.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:52:09.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:52:09.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:52:09.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:52:10.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:52:10.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:52:10.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:52:10.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:52:10.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:52:10.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:52:10.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:52:10.365 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:52:10.365 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:52:10.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=8 2020-09-08T16:52:10.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 8 '!=' null 2020-09-08T16:52:10.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:52:10.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:52:10.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:52:10.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:52:10.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:52:11.000 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:52:11.000 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:52:11.000 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:52:11.000 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:52:11.000 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:52:11.001 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:52:11.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:52:11.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:52:11.382 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:52:11.382 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:52:11.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:52:11.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:52:11.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:52:11.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:52:11.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:52:11.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:52:11.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:52:11.908 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:52:11.908 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:52:12.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=8 2020-09-08T16:52:12.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 8 '!=' null 2020-09-08T16:52:12.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:52:12.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:52:12.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:52:12.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:52:12.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:52:12.708 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:52:12.708 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:52:12.708 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:52:12.709 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:52:12.709 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:52:12.709 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:52:13.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:52:13.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:52:13.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:52:13.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:52:13.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:52:13.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:52:13.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:52:13.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:52:13.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:52:13.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:52:13.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:52:13.602 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:52:13.602 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:52:14.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=8 2020-09-08T16:52:14.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 8 '!=' null 2020-09-08T16:52:14.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:52:14.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:52:14.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:52:14.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:52:14.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:52:14.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:52:14.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:52:14.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:52:14.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:52:14.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:52:14.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:52:14.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:52:14.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:52:14.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:52:14.605 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:52:15.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:52:15.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:52:15.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:52:15.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:52:15.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:52:15.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:52:15.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:52:15.121 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:52:15.121 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:52:15.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:52:15.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:52:15.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:52:15.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:52:15.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:52:15.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:52:15.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:52:15.740 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:52:15.740 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:52:15.740 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:52:15.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:52:15.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:52:15.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:52:16.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:52:16.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:52:16.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:52:16.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:52:16.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:52:16.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:52:16.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:52:16.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:52:16.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:52:16.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:52:16.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:52:16.638 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:52:16.638 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:52:17.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:52:17.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:52:17.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:52:17.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:52:17.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:52:17.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:52:17.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:52:17.256 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:52:17.256 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:52:17.256 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:52:17.256 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:52:17.256 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:52:17.257 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:52:17.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T16:52:17.636 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:52:17.637 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:52:17.637 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:52:18.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T16:52:18.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:52:18.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:52:18.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:263: TEST_backfill_out: check td/osd-backfill-stats 1.0 1 replicated 0 0 200 0 2020-09-08T16:52:18.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2020-09-08T16:52:18.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:64: check: local PG=1.0 2020-09-08T16:52:18.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:65: check: local primary=1 2020-09-08T16:52:18.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:66: check: local type=replicated 2020-09-08T16:52:18.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:67: check: local degraded_start=0 2020-09-08T16:52:18.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:68: check: local degraded_end=0 2020-09-08T16:52:18.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:69: check: local misplaced_start=200 2020-09-08T16:52:18.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:70: check: local misplaced_end=0 2020-09-08T16:52:18.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:71: check: local primary_start= 2020-09-08T16:52:18.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:72: check: local primary_end= 2020-09-08T16:52:18.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:73: check: local check_setup=true 2020-09-08T16:52:18.160 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2020-09-08T16:52:18.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2020-09-08T16:52:18.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:76: check: '[' true = true ']' 2020-09-08T16:52:18.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log td/osd-backfill-stats/osd.5.log 2020-09-08T16:52:18.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2020-09-08T16:52:18.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2020-09-08T16:52:18.169 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: wc -w 2020-09-08T16:52:18.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2020-09-08T16:52:18.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:86: check: local 'addp= ' 2020-09-08T16:52:18.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:87: check: '[' replicated = erasure ']' 2020-09-08T16:52:18.171 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2020-09-08T16:52:18.171 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:52:18.171 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: tail -1 2020-09-08T16:52:18.171 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2020-09-08T16:52:18.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: UPACT='[1,2]/[1,0]' 2020-09-08T16:52:18.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:93: check: '[' -n '[1,2]/[1,0]' ']' 2020-09-08T16:52:18.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:96: check: local which=degraded 2020-09-08T16:52:18.183 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:52:18.184 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:52:18.184 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -F ' [1,2]/[1,0] ' 2020-09-08T16:52:18.184 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -v est 2020-09-08T16:52:18.184 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: head -1 2020-09-08T16:52:18.185 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:52:18.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: FIRST=0 2020-09-08T16:52:18.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:98: check: '[' -n 0 ']' 2020-09-08T16:52:18.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:99: check: below_margin 0 0 2020-09-08T16:52:18.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=0 2020-09-08T16:52:18.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T16:52:18.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=0 2020-09-08T16:52:18.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T16:52:18.189 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:52:18.190 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:52:18.190 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: tail -1 2020-09-08T16:52:18.190 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:52:18.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: LAST=0 2020-09-08T16:52:18.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:101: check: '[' -n 0 ']' 2020-09-08T16:52:18.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:102: check: above_margin 0 0 2020-09-08T16:52:18.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=0 2020-09-08T16:52:18.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T16:52:18.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=0 2020-09-08T16:52:18.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T16:52:18.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:105: check: which=misplaced 2020-09-08T16:52:18.197 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:52:18.198 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:52:18.199 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -F ' [1,2]/[1,0] ' 2020-09-08T16:52:18.199 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -v est 2020-09-08T16:52:18.199 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: head -1 2020-09-08T16:52:18.199 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:52:18.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: FIRST=200 2020-09-08T16:52:18.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:107: check: '[' -n 200 ']' 2020-09-08T16:52:18.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:108: check: below_margin 200 200 2020-09-08T16:52:18.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=200 2020-09-08T16:52:18.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T16:52:18.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=200 2020-09-08T16:52:18.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T16:52:18.202 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:52:18.203 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:52:18.203 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: tail -1 2020-09-08T16:52:18.203 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:52:18.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: LAST=1 2020-09-08T16:52:18.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:110: check: '[' -n 1 ']' 2020-09-08T16:52:18.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:111: check: above_margin 1 0 2020-09-08T16:52:18.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=1 2020-09-08T16:52:18.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T16:52:18.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=0 2020-09-08T16:52:18.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T16:52:18.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2020-09-08T16:52:18.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:265: TEST_backfill_out: delete_pool test 2020-09-08T16:52:18.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test 2020-09-08T16:52:18.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2020-09-08T16:52:18.734 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' does not exist 2020-09-08T16:52:18.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:266: TEST_backfill_out: kill_daemons td/osd-backfill-stats 2020-09-08T16:52:18.743 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:52:18.743 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:52:18.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:52:18.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:52:18.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:52:18.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:52:18.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2020-09-08T16:52:18.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T16:52:18.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:52:18.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T16:52:18.855 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:52:18.855 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:52:18.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:52:18.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:52:18.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:52:18.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:52:18.861 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:52:18.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:52:18.863 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:52:18.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:52:18.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:52:18.864 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:52:18.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:52:18.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:52:18.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:52:18.866 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:52:18.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:52:18.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:52:18.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T16:52:18.881 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:52:18.882 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:52:18.882 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:52:18.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T16:52:18.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:52:18.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:52:18.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:35: run: for func in $funcs 2020-09-08T16:52:18.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2020-09-08T16:52:18.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2020-09-08T16:52:18.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2020-09-08T16:52:18.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T16:52:18.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:52:18.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T16:52:18.886 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:52:18.886 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:52:18.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:52:18.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:52:18.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:52:18.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:52:18.888 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:52:18.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:52:18.888 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:52:18.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:52:18.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:52:18.889 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:52:18.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:52:18.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:52:18.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:52:18.891 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:52:18.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:52:18.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:52:18.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T16:52:18.892 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:52:18.893 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:52:18.893 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:52:18.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T16:52:18.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:52:18.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:52:18.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2020-09-08T16:52:18.895 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T16:52:18.895 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:52:18.895 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:52:18.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.482138 2020-09-08T16:52:18.897 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T16:52:18.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T16:52:18.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T16:52:18.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2020-09-08T16:52:18.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:37: run: TEST_backfill_out2 td/osd-backfill-stats 2020-09-08T16:52:18.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:329: TEST_backfill_out2: local dir=td/osd-backfill-stats 2020-09-08T16:52:18.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:331: TEST_backfill_out2: run_mon td/osd-backfill-stats a 2020-09-08T16:52:18.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2020-09-08T16:52:18.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T16:52:18.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T16:52:18.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T16:52:18.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2020-09-08T16:52:18.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2020-09-08T16:52:19.183 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T16:52:19.184 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:52:19.184 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:52:19.184 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:52:19.184 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:52:19.184 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:52:19.185 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:52:19.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T16:52:19.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T16:52:19.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T16:52:19.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:52:19.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:52:19.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T16:52:19.370 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T16:52:19.370 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:52:19.370 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:52:19.370 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:52:19.370 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:52:19.371 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:52:19.371 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:52:19.371 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T16:52:19.371 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:52:19.372 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get fsid 2020-09-08T16:52:19.463 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T16:52:19.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:52:19.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:52:19.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T16:52:19.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T16:52:19.465 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:52:19.465 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:52:19.465 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:52:19.466 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:52:19.466 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:52:19.466 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:52:19.466 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T16:52:19.466 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:52:19.467 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get mon_host 2020-09-08T16:52:19.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:332: TEST_backfill_out2: run_mgr td/osd-backfill-stats x 2020-09-08T16:52:19.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-stats 2020-09-08T16:52:19.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T16:52:19.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T16:52:19.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T16:52:19.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-stats/x 2020-09-08T16:52:19.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T16:52:20.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T16:52:20.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:52:20.456 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:52:20.456 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:52:20.456 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:52:20.456 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:52:20.456 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:52:20.468 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:52:20.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:52:20.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:333: TEST_backfill_out2: run_osd td/osd-backfill-stats 0 2020-09-08T16:52:20.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:52:20.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:52:20.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T16:52:20.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:52:20.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/0 2020-09-08T16:52:20.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:52:20.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:52:20.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:52:20.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:52:20.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2020-09-08T16:52:20.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2020-09-08T16:52:20.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:52:20.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:52:20.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:52:20.485 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:52:20.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:52:20.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:52:20.486 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:52:20.486 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:52:20.487 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:52:20.487 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:52:20.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:52:20.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:52:20.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:52:20.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:52:20.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:52:20.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:52:20.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:52:20.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:52:20.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:52:20.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:52:20.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:52:20.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/0 2020-09-08T16:52:20.489 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:52:20.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=8d533148-e245-432f-a3d5-f52c3af81bba 2020-09-08T16:52:20.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 8d533148-e245-432f-a3d5-f52c3af81bba' 2020-09-08T16:52:20.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:52:20.491 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 8d533148-e245-432f-a3d5-f52c3af81bba 2020-09-08T16:52:20.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDEtldfp/sIHhAAYbw9pCDOL59BWIJAeOwhfA== 2020-09-08T16:52:20.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDEtldfp/sIHhAAYbw9pCDOL59BWIJAeOwhfA=="}' 2020-09-08T16:52:20.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 8d533148-e245-432f-a3d5-f52c3af81bba -i td/osd-backfill-stats/0/new.json 2020-09-08T16:52:20.838 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:52:20.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/0/new.json 2020-09-08T16:52:20.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDEtldfp/sIHhAAYbw9pCDOL59BWIJAeOwhfA== --osd-uuid 8d533148-e245-432f-a3d5-f52c3af81bba 2020-09-08T16:52:20.877 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:20.879+0000 7fb0fdf92ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:20.877 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:20.881+0000 7fb0fdf92ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:20.878 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:20.882+0000 7fb0fdf92ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:20.878 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:20.883+0000 7fb0fdf92ec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:52:20.878 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:20.883+0000 7fb0fdf92ec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:52:20.878 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:20.883+0000 7fb0fdf92ec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:52:20.917 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:20.921+0000 7fb0fdf92ec0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2020-09-08T16:52:25.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2020-09-08T16:52:25.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:52:25.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T16:52:25.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:52:25.151 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T16:52:25.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T16:52:25.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:52:25.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:52:25.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:52:25.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:52:25.690 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T16:52:25.711 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:25.716+0000 7fd1d635bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:25.730 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:25.735+0000 7fd1d635bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:25.732 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:25.737+0000 7fd1d635bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:26.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T16:52:26.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:52:26.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T16:52:26.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:52:26.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:52:26.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:52:26.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:52:26.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:52:26.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:52:26.080 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:52:26.248 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:26.253+0000 7fd1d635bec0 -1 Falling back to public interface 2020-09-08T16:52:26.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:52:27.056 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:27.061+0000 7fd1d635bec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T16:52:27.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:52:27.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:52:27.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:52:27.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:52:27.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:52:27.500 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:52:27.908 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/561908,v1:127.0.0.1:6803/561908] [v2:127.0.0.1:6804/561908,v1:127.0.0.1:6805/561908] exists,up 8d533148-e245-432f-a3d5-f52c3af81bba 2020-09-08T16:52:27.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:52:27.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:52:27.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:52:27.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:334: TEST_backfill_out2: run_osd td/osd-backfill-stats 1 2020-09-08T16:52:27.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:52:27.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:52:27.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T16:52:27.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:52:27.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/1 2020-09-08T16:52:27.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:52:27.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:52:27.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:52:27.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:52:27.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2020-09-08T16:52:27.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2020-09-08T16:52:27.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:52:27.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:52:27.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:52:27.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:52:27.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:52:27.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:52:27.913 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:52:27.913 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:52:27.914 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:52:27.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:52:27.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:52:27.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:52:27.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:52:27.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:52:27.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:52:27.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:52:27.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:52:27.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:52:27.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:52:27.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:52:27.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:52:27.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/1 2020-09-08T16:52:27.916 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:52:27.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=da411c2e-bee7-4094-8473-ae077cd1ca03 2020-09-08T16:52:27.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 da411c2e-bee7-4094-8473-ae077cd1ca03' 2020-09-08T16:52:27.918 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:52:27.918 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 da411c2e-bee7-4094-8473-ae077cd1ca03 2020-09-08T16:52:27.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDLtldfEWh/NxAAl3Dc2lI3EorizbxLaIrXgw== 2020-09-08T16:52:27.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDLtldfEWh/NxAAl3Dc2lI3EorizbxLaIrXgw=="}' 2020-09-08T16:52:27.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new da411c2e-bee7-4094-8473-ae077cd1ca03 -i td/osd-backfill-stats/1/new.json 2020-09-08T16:52:28.429 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:52:28.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/1/new.json 2020-09-08T16:52:28.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDLtldfEWh/NxAAl3Dc2lI3EorizbxLaIrXgw== --osd-uuid da411c2e-bee7-4094-8473-ae077cd1ca03 2020-09-08T16:52:28.466 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:28.471+0000 7f16860dcec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:28.467 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:28.472+0000 7f16860dcec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:28.469 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:28.474+0000 7f16860dcec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:28.470 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:28.474+0000 7f16860dcec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:52:28.470 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:28.474+0000 7f16860dcec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:52:28.471 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:28.474+0000 7f16860dcec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:52:28.518 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:28.523+0000 7f16860dcec0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2020-09-08T16:52:32.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2020-09-08T16:52:32.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:52:32.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T16:52:32.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:52:32.742 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T16:52:33.275 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T16:52:33.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T16:52:33.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:52:33.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:52:33.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:52:33.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:52:33.298 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:33.303+0000 7fa3e163bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:33.310 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:33.315+0000 7fa3e163bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:33.311 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:33.316+0000 7fa3e163bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:33.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T16:52:33.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:52:33.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T16:52:33.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:52:33.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:52:33.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:52:33.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:52:33.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:52:33.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:52:33.680 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:52:33.827 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:33.831+0000 7fa3e163bec0 -1 Falling back to public interface 2020-09-08T16:52:34.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:52:34.702 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:34.707+0000 7fa3e163bec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T16:52:35.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:52:35.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:52:35.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:52:35.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:52:35.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:52:35.071 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:52:35.471 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/562902,v1:127.0.0.1:6811/562902] [v2:127.0.0.1:6812/562902,v1:127.0.0.1:6813/562902] exists,up da411c2e-bee7-4094-8473-ae077cd1ca03 2020-09-08T16:52:35.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:52:35.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:52:35.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:52:35.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:335: TEST_backfill_out2: run_osd td/osd-backfill-stats 2 2020-09-08T16:52:35.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:52:35.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:52:35.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T16:52:35.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:52:35.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/2 2020-09-08T16:52:35.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:52:35.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:52:35.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:52:35.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:52:35.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2020-09-08T16:52:35.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2020-09-08T16:52:35.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:52:35.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:52:35.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:52:35.481 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:52:35.481 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:52:35.481 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:52:35.482 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:52:35.482 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:52:35.482 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:52:35.482 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:52:35.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:52:35.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:52:35.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:52:35.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:52:35.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:52:35.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:52:35.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:52:35.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:52:35.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:52:35.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:52:35.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:52:35.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/2 2020-09-08T16:52:35.485 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:52:35.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=90e72747-258d-4c53-a36e-126cd64fcc1b 2020-09-08T16:52:35.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 90e72747-258d-4c53-a36e-126cd64fcc1b' 2020-09-08T16:52:35.485 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:52:35.486 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 90e72747-258d-4c53-a36e-126cd64fcc1b 2020-09-08T16:52:35.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDTtldfVi96HRAAr/Q4lJG/7wpLG0zt3RlmeA== 2020-09-08T16:52:35.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDTtldfVi96HRAAr/Q4lJG/7wpLG0zt3RlmeA=="}' 2020-09-08T16:52:35.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 90e72747-258d-4c53-a36e-126cd64fcc1b -i td/osd-backfill-stats/2/new.json 2020-09-08T16:52:36.093 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:52:36.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/2/new.json 2020-09-08T16:52:36.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDTtldfVi96HRAAr/Q4lJG/7wpLG0zt3RlmeA== --osd-uuid 90e72747-258d-4c53-a36e-126cd64fcc1b 2020-09-08T16:52:36.132 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:36.134+0000 7f0100adaec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:36.133 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:36.135+0000 7f0100adaec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:36.133 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:36.136+0000 7f0100adaec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:36.133 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:36.137+0000 7f0100adaec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:52:36.133 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:36.137+0000 7f0100adaec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:52:36.136 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:36.137+0000 7f0100adaec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:52:36.209 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:36.214+0000 7f0100adaec0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2020-09-08T16:52:40.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2020-09-08T16:52:40.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:52:40.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T16:52:40.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:52:40.451 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T16:52:41.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T16:52:41.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:52:41.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:52:41.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:52:41.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:52:41.013 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T16:52:41.035 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:41.040+0000 7f11766fbec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:41.058 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:41.062+0000 7f11766fbec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:41.059 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:41.064+0000 7f11766fbec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:41.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T16:52:41.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:52:41.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T16:52:41.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:52:41.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:52:41.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:52:41.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:52:41.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:52:41.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:52:41.407 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:52:41.578 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:41.583+0000 7f11766fbec0 -1 Falling back to public interface 2020-09-08T16:52:41.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:52:42.434 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:42.439+0000 7f11766fbec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T16:52:42.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:52:42.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:52:42.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:52:42.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:52:42.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:52:42.823 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:52:43.283 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/563896,v1:127.0.0.1:6819/563896] [v2:127.0.0.1:6820/563896,v1:127.0.0.1:6821/563896] exists,up 90e72747-258d-4c53-a36e-126cd64fcc1b 2020-09-08T16:52:43.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:52:43.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:52:43.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:52:43.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:336: TEST_backfill_out2: run_osd td/osd-backfill-stats 3 2020-09-08T16:52:43.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:52:43.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:52:43.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T16:52:43.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:52:43.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/3 2020-09-08T16:52:43.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:52:43.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:52:43.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:52:43.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:52:43.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2020-09-08T16:52:43.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2020-09-08T16:52:43.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:52:43.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:52:43.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:52:43.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:52:43.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:52:43.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:52:43.287 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:52:43.287 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:52:43.288 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:52:43.288 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:52:43.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:52:43.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:52:43.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:52:43.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:52:43.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:52:43.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:52:43.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:52:43.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:52:43.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:52:43.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:52:43.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:52:43.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/3 2020-09-08T16:52:43.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:52:43.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=f4216a06-7f9e-49ee-b59a-2564a42b9612 2020-09-08T16:52:43.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 f4216a06-7f9e-49ee-b59a-2564a42b9612' 2020-09-08T16:52:43.292 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:52:43.292 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 f4216a06-7f9e-49ee-b59a-2564a42b9612 2020-09-08T16:52:43.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDbtldfE0smEhAArBuHBhI3XVy0wscZNZhwrQ== 2020-09-08T16:52:43.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDbtldfE0smEhAArBuHBhI3XVy0wscZNZhwrQ=="}' 2020-09-08T16:52:43.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new f4216a06-7f9e-49ee-b59a-2564a42b9612 -i td/osd-backfill-stats/3/new.json 2020-09-08T16:52:43.850 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T16:52:43.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/3/new.json 2020-09-08T16:52:43.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDbtldfE0smEhAArBuHBhI3XVy0wscZNZhwrQ== --osd-uuid f4216a06-7f9e-49ee-b59a-2564a42b9612 2020-09-08T16:52:43.886 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:43.891+0000 7f14b3360ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:43.888 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:43.893+0000 7f14b3360ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:43.888 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:43.894+0000 7f14b3360ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:43.889 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:43.894+0000 7f14b3360ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:52:43.889 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:43.894+0000 7f14b3360ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:52:43.890 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:43.894+0000 7f14b3360ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:52:43.945 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:43.945+0000 7f14b3360ec0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2020-09-08T16:52:48.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2020-09-08T16:52:48.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:52:48.450 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T16:52:48.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T16:52:48.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:52:49.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T16:52:49.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:52:49.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:52:49.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:52:49.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:52:49.004 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T16:52:49.026 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:49.030+0000 7fad5bd89ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:49.044 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:49.043+0000 7fad5bd89ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:49.045 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:49.045+0000 7fad5bd89ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:49.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T16:52:49.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:52:49.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T16:52:49.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:52:49.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:52:49.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:52:49.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:52:49.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:52:49.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:52:49.396 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:52:49.558 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:49.563+0000 7fad5bd89ec0 -1 Falling back to public interface 2020-09-08T16:52:49.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:52:50.423 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:50.428+0000 7fad5bd89ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T16:52:50.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:52:50.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:52:50.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:52:50.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:52:50.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:52:50.806 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:52:51.241 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/564898,v1:127.0.0.1:6827/564898] [v2:127.0.0.1:6828/564898,v1:127.0.0.1:6829/564898] exists,up f4216a06-7f9e-49ee-b59a-2564a42b9612 2020-09-08T16:52:51.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:52:51.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:52:51.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:52:51.242 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:337: TEST_backfill_out2: run_osd td/osd-backfill-stats 4 2020-09-08T16:52:51.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:52:51.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:52:51.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=4 2020-09-08T16:52:51.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:52:51.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/4 2020-09-08T16:52:51.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:52:51.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:52:51.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:52:51.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:52:51.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2020-09-08T16:52:51.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2020-09-08T16:52:51.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:52:51.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:52:51.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:52:51.245 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:52:51.246 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:52:51.246 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:52:51.246 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:52:51.246 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:52:51.246 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:52:51.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:52:51.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:52:51.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:52:51.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:52:51.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:52:51.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:52:51.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:52:51.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:52:51.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:52:51.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:52:51.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:52:51.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:52:51.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/4 2020-09-08T16:52:51.249 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:52:51.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=e0f4091a-54f6-46d3-be06-6c48221ec84c 2020-09-08T16:52:51.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd4 e0f4091a-54f6-46d3-be06-6c48221ec84c' 2020-09-08T16:52:51.251 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:52:51.251 INFO:tasks.workunit.client.0.smithi065.stdout:add osd4 e0f4091a-54f6-46d3-be06-6c48221ec84c 2020-09-08T16:52:51.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDjtldf+x6wDxAAjjSOS2SU9eo/59lDhbJpBA== 2020-09-08T16:52:51.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDjtldf+x6wDxAAjjSOS2SU9eo/59lDhbJpBA=="}' 2020-09-08T16:52:51.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new e0f4091a-54f6-46d3-be06-6c48221ec84c -i td/osd-backfill-stats/4/new.json 2020-09-08T16:52:51.856 INFO:tasks.workunit.client.0.smithi065.stdout:4 2020-09-08T16:52:51.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/4/new.json 2020-09-08T16:52:51.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 4 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDjtldf+x6wDxAAjjSOS2SU9eo/59lDhbJpBA== --osd-uuid e0f4091a-54f6-46d3-be06-6c48221ec84c 2020-09-08T16:52:51.892 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:51.897+0000 7f2f29793ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:51.894 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:51.899+0000 7f2f29793ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:51.894 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:51.899+0000 7f2f29793ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:51.895 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:51.900+0000 7f2f29793ec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:52:51.895 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:51.900+0000 7f2f29793ec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:52:51.896 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:51.900+0000 7f2f29793ec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:52:51.939 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:51.944+0000 7f2f29793ec0 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2020-09-08T16:52:56.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2020-09-08T16:52:56.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:52:56.223 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd4 key to auth repository 2020-09-08T16:52:56.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd4 key to auth repository 2020-09-08T16:52:56.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:52:56.759 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.4 2020-09-08T16:52:56.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.4 2020-09-08T16:52:56.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 4 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:52:56.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:52:56.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:52:56.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:52:56.782 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:56.787+0000 7fbd02b17ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:56.784 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:56.789+0000 7fbd02b17ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:56.785 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:56.790+0000 7fbd02b17ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:57.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 4 2020-09-08T16:52:57.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:52:57.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=4 2020-09-08T16:52:57.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:52:57.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:52:57.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:52:57.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:52:57.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:52:57.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:52:57.169 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:52:57.316 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:57.321+0000 7fbd02b17ec0 -1 Falling back to public interface 2020-09-08T16:52:57.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:52:58.097 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:58.102+0000 7fbd02b17ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-09-08T16:52:58.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:52:58.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:52:58.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:52:58.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:52:58.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:52:58.558 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:52:58.979 INFO:tasks.workunit.client.0.smithi065.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/565892,v1:127.0.0.1:6835/565892] [v2:127.0.0.1:6836/565892,v1:127.0.0.1:6837/565892] exists,up e0f4091a-54f6-46d3-be06-6c48221ec84c 2020-09-08T16:52:58.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:52:58.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:52:58.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:52:58.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:338: TEST_backfill_out2: run_osd td/osd-backfill-stats 5 2020-09-08T16:52:58.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:52:58.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:52:58.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=5 2020-09-08T16:52:58.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:52:58.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/5 2020-09-08T16:52:58.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:52:58.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:52:58.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:52:58.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:52:58.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/5' 2020-09-08T16:52:58.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/5/journal' 2020-09-08T16:52:58.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:52:58.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:52:58.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:52:58.983 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:52:58.986 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:52:58.986 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:52:58.986 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:52:58.986 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:52:58.987 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:52:58.987 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:52:58.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:52:58.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:52:58.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:52:58.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:52:58.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:52:58.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:52:58.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:52:58.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:52:58.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:52:58.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:52:58.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:52:58.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/5 2020-09-08T16:52:58.989 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:52:58.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=163d1a0f-c82e-4eb8-866f-41698eac3ace 2020-09-08T16:52:58.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd5 163d1a0f-c82e-4eb8-866f-41698eac3ace' 2020-09-08T16:52:58.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:52:58.991 INFO:tasks.workunit.client.0.smithi065.stdout:add osd5 163d1a0f-c82e-4eb8-866f-41698eac3ace 2020-09-08T16:52:58.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDrtldfdzoVABAAxAKFUqows7j+kx+IZWEBQw== 2020-09-08T16:52:58.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDrtldfdzoVABAAxAKFUqows7j+kx+IZWEBQw=="}' 2020-09-08T16:52:58.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 163d1a0f-c82e-4eb8-866f-41698eac3ace -i td/osd-backfill-stats/5/new.json 2020-09-08T16:52:59.530 INFO:tasks.workunit.client.0.smithi065.stdout:5 2020-09-08T16:52:59.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/5/new.json 2020-09-08T16:52:59.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 5 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDrtldfdzoVABAAxAKFUqows7j+kx+IZWEBQw== --osd-uuid 163d1a0f-c82e-4eb8-866f-41698eac3ace 2020-09-08T16:52:59.566 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:59.570+0000 7f3e5404dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:59.590 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:59.594+0000 7f3e5404dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:59.591 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:59.595+0000 7f3e5404dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:52:59.592 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:59.596+0000 7f3e5404dec0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2020-09-08T16:52:59.592 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:59.596+0000 7f3e5404dec0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2020-09-08T16:52:59.593 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:59.596+0000 7f3e5404dec0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2020-09-08T16:52:59.692 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:52:59.694+0000 7f3e5404dec0 -1 bluestore(td/osd-backfill-stats/5) _read_fsid unparsable uuid 2020-09-08T16:53:04.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/5/keyring 2020-09-08T16:53:04.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:53:04.208 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd5 key to auth repository 2020-09-08T16:53:04.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd5 key to auth repository 2020-09-08T16:53:04.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:53:04.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.5 2020-09-08T16:53:04.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 5 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:53:04.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:53:04.752 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.5 2020-09-08T16:53:04.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:53:04.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:53:04.774 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:53:04.779+0000 7f8d42340ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:53:04.776 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:53:04.781+0000 7f8d42340ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:53:04.777 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:53:04.782+0000 7f8d42340ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:53:05.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 5 2020-09-08T16:53:05.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:53:05.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=5 2020-09-08T16:53:05.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:53:05.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:53:05.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:53:05.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:53:05.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:53:05.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T16:53:05.174 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:53:05.295 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:53:05.300+0000 7f8d42340ec0 -1 Falling back to public interface 2020-09-08T16:53:05.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:53:06.099 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:53:06.104+0000 7f8d42340ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-09-08T16:53:06.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:53:06.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:53:06.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:53:06.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:53:06.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T16:53:06.570 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:53:06.974 INFO:tasks.workunit.client.0.smithi065.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/566886,v1:127.0.0.1:6843/566886] [v2:127.0.0.1:6844/566886,v1:127.0.0.1:6845/566886] exists,up 163d1a0f-c82e-4eb8-866f-41698eac3ace 2020-09-08T16:53:06.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:53:06.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:53:06.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:53:06.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:340: TEST_backfill_out2: create_pool test 1 1 2020-09-08T16:53:06.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test 1 1 2020-09-08T16:53:07.567 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' already exists 2020-09-08T16:53:07.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:53:08.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:341: TEST_backfill_out2: ceph osd pool set test size 2 2020-09-08T16:53:09.268 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 2 2020-09-08T16:53:09.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:342: TEST_backfill_out2: sleep 5 2020-09-08T16:53:14.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:344: TEST_backfill_out2: wait_for_clean 2020-09-08T16:53:14.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:53:14.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:53:14.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:53:14.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:53:14.280 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:53:14.281 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:53:14.281 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:53:14.281 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:53:14.281 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:53:14.281 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:53:14.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:53:14.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:53:14.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:53:14.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:53:14.388 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:53:14.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:53:14.783 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:53:14.783 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:53:14.783 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:53:14.784 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T16:53:14.784 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T16:53:14.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:53:14.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:53:14.784 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:53:14.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836492 2020-09-08T16:53:14.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836492 2020-09-08T16:53:14.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836492' 2020-09-08T16:53:14.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:53:14.916 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:53:15.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672970 2020-09-08T16:53:15.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672970 2020-09-08T16:53:15.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836492 1-42949672970' 2020-09-08T16:53:15.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:53:15.051 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:53:15.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509449 2020-09-08T16:53:15.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509449 2020-09-08T16:53:15.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836492 1-42949672970 2-64424509449' 2020-09-08T16:53:15.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:53:15.178 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:53:15.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345927 2020-09-08T16:53:15.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345927 2020-09-08T16:53:15.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836492 1-42949672970 2-64424509449 3-85899345927' 2020-09-08T16:53:15.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:53:15.308 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:53:15.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182406 2020-09-08T16:53:15.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182406 2020-09-08T16:53:15.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836492 1-42949672970 2-64424509449 3-85899345927 4-107374182406' 2020-09-08T16:53:15.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:53:15.439 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T16:53:15.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018884 2020-09-08T16:53:15.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018884 2020-09-08T16:53:15.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836492 1-42949672970 2-64424509449 3-85899345927 4-107374182406 5-128849018884' 2020-09-08T16:53:15.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:53:15.570 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836492 2020-09-08T16:53:15.570 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:53:15.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:53:15.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836492 2020-09-08T16:53:15.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:53:15.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836492 2020-09-08T16:53:15.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2020-09-08T16:53:15.572 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:53:15.573 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836492 2020-09-08T16:53:15.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836490 -lt 21474836492 2020-09-08T16:53:15.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:53:16.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:53:16.962 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:53:17.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836492 -lt 21474836492 2020-09-08T16:53:17.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:53:17.366 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672970 2020-09-08T16:53:17.366 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:53:17.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:53:17.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672970 2020-09-08T16:53:17.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:53:17.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672970 2020-09-08T16:53:17.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672970' 2020-09-08T16:53:17.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:53:17.369 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672970 2020-09-08T16:53:17.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672971 -lt 42949672970 2020-09-08T16:53:17.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:53:17.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509449 2020-09-08T16:53:17.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:53:17.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:53:17.772 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509449 2020-09-08T16:53:17.772 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:53:17.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509449 2020-09-08T16:53:17.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509449' 2020-09-08T16:53:17.774 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:53:17.774 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509449 2020-09-08T16:53:18.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509449 -lt 64424509449 2020-09-08T16:53:18.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:53:18.169 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345927 2020-09-08T16:53:18.170 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:53:18.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:53:18.170 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345927 2020-09-08T16:53:18.171 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:53:18.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345927 2020-09-08T16:53:18.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345927' 2020-09-08T16:53:18.172 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:53:18.172 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345927 2020-09-08T16:53:18.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345928 -lt 85899345927 2020-09-08T16:53:18.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:53:18.579 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182406 2020-09-08T16:53:18.579 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:53:18.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:53:18.580 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182406 2020-09-08T16:53:18.581 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:53:18.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182406 2020-09-08T16:53:18.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182406' 2020-09-08T16:53:18.582 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:53:18.582 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182406 2020-09-08T16:53:18.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182406 -lt 107374182406 2020-09-08T16:53:18.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:53:18.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018884 2020-09-08T16:53:18.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:53:18.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T16:53:18.979 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018884 2020-09-08T16:53:18.979 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:53:18.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018884 2020-09-08T16:53:18.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018884' 2020-09-08T16:53:18.981 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T16:53:18.981 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018884 2020-09-08T16:53:19.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018885 -lt 128849018884 2020-09-08T16:53:19.371 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:53:19.371 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:53:19.372 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:53:19.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T16:53:19.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:53:19.903 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:53:19.903 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:53:19.903 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:53:19.904 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:53:19.904 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:53:19.904 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:53:20.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T16:53:20.281 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:53:20.281 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:53:20.282 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:53:20.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T16:53:20.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:53:20.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:53:20.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: seq 1 200 2020-09-08T16:53:20.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:20.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj1 /dev/null 2020-09-08T16:53:20.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:20.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj2 /dev/null 2020-09-08T16:53:21.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:21.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj3 /dev/null 2020-09-08T16:53:21.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:21.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj4 /dev/null 2020-09-08T16:53:21.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:21.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj5 /dev/null 2020-09-08T16:53:21.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:21.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj6 /dev/null 2020-09-08T16:53:21.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:21.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj7 /dev/null 2020-09-08T16:53:21.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:21.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj8 /dev/null 2020-09-08T16:53:21.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:21.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj9 /dev/null 2020-09-08T16:53:21.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:21.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj10 /dev/null 2020-09-08T16:53:21.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:21.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj11 /dev/null 2020-09-08T16:53:21.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:21.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj12 /dev/null 2020-09-08T16:53:22.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:22.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj13 /dev/null 2020-09-08T16:53:22.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:22.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj14 /dev/null 2020-09-08T16:53:22.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:22.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj15 /dev/null 2020-09-08T16:53:22.426 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:22.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj16 /dev/null 2020-09-08T16:53:22.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:22.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj17 /dev/null 2020-09-08T16:53:22.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:22.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj18 /dev/null 2020-09-08T16:53:22.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:22.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj19 /dev/null 2020-09-08T16:53:22.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:22.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj20 /dev/null 2020-09-08T16:53:22.978 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:22.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj21 /dev/null 2020-09-08T16:53:23.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:23.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj22 /dev/null 2020-09-08T16:53:23.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:23.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj23 /dev/null 2020-09-08T16:53:23.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:23.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj24 /dev/null 2020-09-08T16:53:23.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:23.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj25 /dev/null 2020-09-08T16:53:23.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:23.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj26 /dev/null 2020-09-08T16:53:23.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:23.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj27 /dev/null 2020-09-08T16:53:23.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:23.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj28 /dev/null 2020-09-08T16:53:23.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:23.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj29 /dev/null 2020-09-08T16:53:23.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:23.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj30 /dev/null 2020-09-08T16:53:24.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:24.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj31 /dev/null 2020-09-08T16:53:24.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:24.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj32 /dev/null 2020-09-08T16:53:24.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:24.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj33 /dev/null 2020-09-08T16:53:24.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:24.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj34 /dev/null 2020-09-08T16:53:24.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:24.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj35 /dev/null 2020-09-08T16:53:24.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:24.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj36 /dev/null 2020-09-08T16:53:24.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:24.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj37 /dev/null 2020-09-08T16:53:24.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:24.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj38 /dev/null 2020-09-08T16:53:24.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:24.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj39 /dev/null 2020-09-08T16:53:24.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:24.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj40 /dev/null 2020-09-08T16:53:25.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:25.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj41 /dev/null 2020-09-08T16:53:25.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:25.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj42 /dev/null 2020-09-08T16:53:25.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:25.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj43 /dev/null 2020-09-08T16:53:25.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:25.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj44 /dev/null 2020-09-08T16:53:25.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:25.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj45 /dev/null 2020-09-08T16:53:25.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:25.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj46 /dev/null 2020-09-08T16:53:25.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:25.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj47 /dev/null 2020-09-08T16:53:25.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:25.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj48 /dev/null 2020-09-08T16:53:25.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:25.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj49 /dev/null 2020-09-08T16:53:26.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:26.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj50 /dev/null 2020-09-08T16:53:26.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:26.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj51 /dev/null 2020-09-08T16:53:26.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:26.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj52 /dev/null 2020-09-08T16:53:26.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:26.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj53 /dev/null 2020-09-08T16:53:26.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:26.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj54 /dev/null 2020-09-08T16:53:26.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:26.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj55 /dev/null 2020-09-08T16:53:26.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:26.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj56 /dev/null 2020-09-08T16:53:26.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:26.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj57 /dev/null 2020-09-08T16:53:26.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:26.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj58 /dev/null 2020-09-08T16:53:27.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:27.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj59 /dev/null 2020-09-08T16:53:27.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:27.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj60 /dev/null 2020-09-08T16:53:27.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:27.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj61 /dev/null 2020-09-08T16:53:27.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:27.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj62 /dev/null 2020-09-08T16:53:27.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:27.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj63 /dev/null 2020-09-08T16:53:27.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:27.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj64 /dev/null 2020-09-08T16:53:27.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:27.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj65 /dev/null 2020-09-08T16:53:27.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:27.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj66 /dev/null 2020-09-08T16:53:27.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:27.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj67 /dev/null 2020-09-08T16:53:28.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:28.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj68 /dev/null 2020-09-08T16:53:28.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:28.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj69 /dev/null 2020-09-08T16:53:28.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:28.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj70 /dev/null 2020-09-08T16:53:28.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:28.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj71 /dev/null 2020-09-08T16:53:28.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:28.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj72 /dev/null 2020-09-08T16:53:28.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:28.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj73 /dev/null 2020-09-08T16:53:28.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:28.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj74 /dev/null 2020-09-08T16:53:28.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:28.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj75 /dev/null 2020-09-08T16:53:28.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:28.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj76 /dev/null 2020-09-08T16:53:28.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:28.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj77 /dev/null 2020-09-08T16:53:29.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:29.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj78 /dev/null 2020-09-08T16:53:29.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:29.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj79 /dev/null 2020-09-08T16:53:29.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:29.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj80 /dev/null 2020-09-08T16:53:29.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:29.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj81 /dev/null 2020-09-08T16:53:29.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:29.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj82 /dev/null 2020-09-08T16:53:29.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:29.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj83 /dev/null 2020-09-08T16:53:29.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:29.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj84 /dev/null 2020-09-08T16:53:29.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:29.814 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj85 /dev/null 2020-09-08T16:53:29.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:29.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj86 /dev/null 2020-09-08T16:53:30.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:30.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj87 /dev/null 2020-09-08T16:53:30.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:30.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj88 /dev/null 2020-09-08T16:53:30.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:30.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj89 /dev/null 2020-09-08T16:53:30.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:30.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj90 /dev/null 2020-09-08T16:53:30.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:30.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj91 /dev/null 2020-09-08T16:53:30.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:30.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj92 /dev/null 2020-09-08T16:53:30.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:30.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj93 /dev/null 2020-09-08T16:53:30.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:30.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj94 /dev/null 2020-09-08T16:53:30.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:30.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj95 /dev/null 2020-09-08T16:53:31.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:31.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj96 /dev/null 2020-09-08T16:53:31.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:31.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj97 /dev/null 2020-09-08T16:53:31.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:31.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj98 /dev/null 2020-09-08T16:53:31.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:31.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj99 /dev/null 2020-09-08T16:53:31.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:31.428 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj100 /dev/null 2020-09-08T16:53:31.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:31.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj101 /dev/null 2020-09-08T16:53:31.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:31.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj102 /dev/null 2020-09-08T16:53:31.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:31.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj103 /dev/null 2020-09-08T16:53:31.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:31.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj104 /dev/null 2020-09-08T16:53:31.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:31.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj105 /dev/null 2020-09-08T16:53:32.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:32.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj106 /dev/null 2020-09-08T16:53:32.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:32.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj107 /dev/null 2020-09-08T16:53:32.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:32.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj108 /dev/null 2020-09-08T16:53:32.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:32.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj109 /dev/null 2020-09-08T16:53:32.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:32.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj110 /dev/null 2020-09-08T16:53:32.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:32.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj111 /dev/null 2020-09-08T16:53:32.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:32.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj112 /dev/null 2020-09-08T16:53:32.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:32.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj113 /dev/null 2020-09-08T16:53:32.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:32.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj114 /dev/null 2020-09-08T16:53:33.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:33.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj115 /dev/null 2020-09-08T16:53:33.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:33.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj116 /dev/null 2020-09-08T16:53:33.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:33.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj117 /dev/null 2020-09-08T16:53:33.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:33.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj118 /dev/null 2020-09-08T16:53:33.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:33.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj119 /dev/null 2020-09-08T16:53:33.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:33.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj120 /dev/null 2020-09-08T16:53:33.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:33.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj121 /dev/null 2020-09-08T16:53:33.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:33.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj122 /dev/null 2020-09-08T16:53:33.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:33.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj123 /dev/null 2020-09-08T16:53:33.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:33.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj124 /dev/null 2020-09-08T16:53:34.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:34.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj125 /dev/null 2020-09-08T16:53:34.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:34.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj126 /dev/null 2020-09-08T16:53:34.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:34.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj127 /dev/null 2020-09-08T16:53:34.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:34.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj128 /dev/null 2020-09-08T16:53:34.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:34.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj129 /dev/null 2020-09-08T16:53:34.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:34.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj130 /dev/null 2020-09-08T16:53:34.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:34.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj131 /dev/null 2020-09-08T16:53:34.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:34.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj132 /dev/null 2020-09-08T16:53:34.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:34.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj133 /dev/null 2020-09-08T16:53:35.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:35.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj134 /dev/null 2020-09-08T16:53:35.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:35.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj135 /dev/null 2020-09-08T16:53:35.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:35.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj136 /dev/null 2020-09-08T16:53:35.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:35.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj137 /dev/null 2020-09-08T16:53:35.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:35.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj138 /dev/null 2020-09-08T16:53:35.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:35.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj139 /dev/null 2020-09-08T16:53:35.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:35.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj140 /dev/null 2020-09-08T16:53:35.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:35.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj141 /dev/null 2020-09-08T16:53:35.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:35.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj142 /dev/null 2020-09-08T16:53:36.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:36.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj143 /dev/null 2020-09-08T16:53:36.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:36.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj144 /dev/null 2020-09-08T16:53:36.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:36.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj145 /dev/null 2020-09-08T16:53:36.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:36.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj146 /dev/null 2020-09-08T16:53:36.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:36.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj147 /dev/null 2020-09-08T16:53:36.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:36.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj148 /dev/null 2020-09-08T16:53:36.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:36.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj149 /dev/null 2020-09-08T16:53:36.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:36.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj150 /dev/null 2020-09-08T16:53:36.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:36.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj151 /dev/null 2020-09-08T16:53:36.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:36.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj152 /dev/null 2020-09-08T16:53:37.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:37.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj153 /dev/null 2020-09-08T16:53:37.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:37.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj154 /dev/null 2020-09-08T16:53:37.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:37.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj155 /dev/null 2020-09-08T16:53:37.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:37.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj156 /dev/null 2020-09-08T16:53:37.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:37.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj157 /dev/null 2020-09-08T16:53:37.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:37.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj158 /dev/null 2020-09-08T16:53:37.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:37.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj159 /dev/null 2020-09-08T16:53:37.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:37.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj160 /dev/null 2020-09-08T16:53:37.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:37.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj161 /dev/null 2020-09-08T16:53:38.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:38.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj162 /dev/null 2020-09-08T16:53:38.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:38.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj163 /dev/null 2020-09-08T16:53:38.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:38.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj164 /dev/null 2020-09-08T16:53:38.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:38.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj165 /dev/null 2020-09-08T16:53:38.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:38.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj166 /dev/null 2020-09-08T16:53:38.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:38.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj167 /dev/null 2020-09-08T16:53:38.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:38.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj168 /dev/null 2020-09-08T16:53:38.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:38.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj169 /dev/null 2020-09-08T16:53:38.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:38.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj170 /dev/null 2020-09-08T16:53:38.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:38.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj171 /dev/null 2020-09-08T16:53:39.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:39.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj172 /dev/null 2020-09-08T16:53:39.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:39.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj173 /dev/null 2020-09-08T16:53:39.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:39.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj174 /dev/null 2020-09-08T16:53:39.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:39.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj175 /dev/null 2020-09-08T16:53:39.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:39.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj176 /dev/null 2020-09-08T16:53:39.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:39.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj177 /dev/null 2020-09-08T16:53:39.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:39.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj178 /dev/null 2020-09-08T16:53:39.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:39.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj179 /dev/null 2020-09-08T16:53:39.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:39.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj180 /dev/null 2020-09-08T16:53:40.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:40.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj181 /dev/null 2020-09-08T16:53:40.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:40.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj182 /dev/null 2020-09-08T16:53:40.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:40.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj183 /dev/null 2020-09-08T16:53:40.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:40.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj184 /dev/null 2020-09-08T16:53:40.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:40.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj185 /dev/null 2020-09-08T16:53:40.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:40.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj186 /dev/null 2020-09-08T16:53:40.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:40.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj187 /dev/null 2020-09-08T16:53:40.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:40.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj188 /dev/null 2020-09-08T16:53:40.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:40.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj189 /dev/null 2020-09-08T16:53:41.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:41.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj190 /dev/null 2020-09-08T16:53:41.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:41.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj191 /dev/null 2020-09-08T16:53:41.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:41.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj192 /dev/null 2020-09-08T16:53:41.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:41.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj193 /dev/null 2020-09-08T16:53:41.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:41.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj194 /dev/null 2020-09-08T16:53:41.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:41.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj195 /dev/null 2020-09-08T16:53:41.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:41.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj196 /dev/null 2020-09-08T16:53:41.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:41.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj197 /dev/null 2020-09-08T16:53:41.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:41.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj198 /dev/null 2020-09-08T16:53:41.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:41.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj199 /dev/null 2020-09-08T16:53:42.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2020-09-08T16:53:42.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj200 /dev/null 2020-09-08T16:53:42.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:351: TEST_backfill_out2: get_pg test obj1 2020-09-08T16:53:42.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1031: get_pg: local poolname=test 2020-09-08T16:53:42.139 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: local objectname=obj1 2020-09-08T16:53:42.139 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: ceph --format json osd map test obj1 2020-09-08T16:53:42.139 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: jq -r .pgid 2020-09-08T16:53:42.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:351: TEST_backfill_out2: local PG=1.0 2020-09-08T16:53:42.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:353: TEST_backfill_out2: get_primary test obj1 2020-09-08T16:53:42.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:53:42.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:53:42.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:53:42.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:53:42.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:353: TEST_backfill_out2: local primary=1 2020-09-08T16:53:42.933 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:354: TEST_backfill_out2: get_not_primary test obj1 2020-09-08T16:53:42.934 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1167: get_not_primary: local poolname=test 2020-09-08T16:53:42.934 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: get_not_primary: local objectname=obj1 2020-09-08T16:53:42.935 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: get_primary test obj1 2020-09-08T16:53:42.935 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:53:42.935 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:53:42.936 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:53:42.936 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:53:43.336 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: local primary=1 2020-09-08T16:53:43.337 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1171: get_not_primary: ceph --format json osd map test obj1 2020-09-08T16:53:43.337 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1172: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2020-09-08T16:53:43.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:354: TEST_backfill_out2: local otherosd=0 2020-09-08T16:53:43.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:356: TEST_backfill_out2: ceph osd set nobackfill 2020-09-08T16:53:44.518 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is set 2020-09-08T16:53:44.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:357: TEST_backfill_out2: ceph osd pool set test size 3 2020-09-08T16:53:45.203 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 3 2020-09-08T16:53:45.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:358: TEST_backfill_out2: ceph osd out osd.0 2020-09-08T16:53:45.904 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already out. 2020-09-08T16:53:45.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:359: TEST_backfill_out2: ceph osd out osd.1 2020-09-08T16:53:46.649 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already out. 2020-09-08T16:53:46.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:361: TEST_backfill_out2: sleep 2 2020-09-08T16:53:48.660 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:362: TEST_backfill_out2: get_primary test obj1 2020-09-08T16:53:48.660 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:53:48.661 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:53:48.661 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:53:48.661 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:53:49.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:362: TEST_backfill_out2: primary=1 2020-09-08T16:53:49.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:363: TEST_backfill_out2: ceph osd unset nobackfill 2020-09-08T16:53:49.836 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is unset 2020-09-08T16:53:49.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:364: TEST_backfill_out2: ceph tell osd.1 get_latest_osdmap 2020-09-08T16:53:50.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:365: TEST_backfill_out2: ceph tell osd.1 debug kick_recovery_wq 0 2020-09-08T16:53:50.178 INFO:tasks.workunit.client.0.smithi065.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2020-09-08T16:53:50.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:366: TEST_backfill_out2: sleep 2 2020-09-08T16:53:52.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:368: TEST_backfill_out2: wait_for_clean 2020-09-08T16:53:52.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:53:52.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:53:52.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:53:52.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:53:52.190 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:53:52.191 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:53:52.191 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:53:52.191 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:53:52.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:53:52.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:53:52.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:53:52.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:53:52.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:53:52.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:53:52.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:53:52.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:53:52.700 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:53:52.700 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:53:52.701 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:53:52.701 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T16:53:52.701 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T16:53:52.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:53:52.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:53:52.702 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:53:52.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836501 2020-09-08T16:53:52.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836501 2020-09-08T16:53:52.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836501' 2020-09-08T16:53:52.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:53:52.828 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:53:52.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672980 2020-09-08T16:53:52.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672980 2020-09-08T16:53:52.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836501 1-42949672980' 2020-09-08T16:53:52.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:53:52.961 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:53:53.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509458 2020-09-08T16:53:53.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509458 2020-09-08T16:53:53.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836501 1-42949672980 2-64424509458' 2020-09-08T16:53:53.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:53:53.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:53:53.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345937 2020-09-08T16:53:53.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345937 2020-09-08T16:53:53.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836501 1-42949672980 2-64424509458 3-85899345937' 2020-09-08T16:53:53.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:53:53.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:53:53.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182415 2020-09-08T16:53:53.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182415 2020-09-08T16:53:53.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836501 1-42949672980 2-64424509458 3-85899345937 4-107374182415' 2020-09-08T16:53:53.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:53:53.356 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T16:53:53.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018894 2020-09-08T16:53:53.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018894 2020-09-08T16:53:53.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836501 1-42949672980 2-64424509458 3-85899345937 4-107374182415 5-128849018894' 2020-09-08T16:53:53.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:53:53.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836501 2020-09-08T16:53:53.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:53:53.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:53:53.487 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836501 2020-09-08T16:53:53.487 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:53:53.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836501 2020-09-08T16:53:53.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836501' 2020-09-08T16:53:53.489 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:53:53.489 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836501 2020-09-08T16:53:53.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836499 -lt 21474836501 2020-09-08T16:53:53.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:53:54.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:53:54.884 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:53:55.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836502 -lt 21474836501 2020-09-08T16:53:55.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:53:55.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672980 2020-09-08T16:53:55.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:53:55.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:53:55.288 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672980 2020-09-08T16:53:55.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:53:55.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672980 2020-09-08T16:53:55.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672980' 2020-09-08T16:53:55.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:53:55.290 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672980 2020-09-08T16:53:55.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672980 -lt 42949672980 2020-09-08T16:53:55.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:53:55.710 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509458 2020-09-08T16:53:55.710 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:53:55.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:53:55.711 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509458 2020-09-08T16:53:55.711 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:53:55.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509458 2020-09-08T16:53:55.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509458' 2020-09-08T16:53:55.713 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:53:55.713 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509458 2020-09-08T16:53:56.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509459 -lt 64424509458 2020-09-08T16:53:56.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:53:56.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345937 2020-09-08T16:53:56.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:53:56.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:53:56.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345937 2020-09-08T16:53:56.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:53:56.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345937 2020-09-08T16:53:56.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345937' 2020-09-08T16:53:56.114 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:53:56.115 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345937 2020-09-08T16:53:56.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345937 -lt 85899345937 2020-09-08T16:53:56.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:53:56.530 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182415 2020-09-08T16:53:56.530 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:53:56.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:53:56.531 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182415 2020-09-08T16:53:56.531 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:53:56.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182415 2020-09-08T16:53:56.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182415' 2020-09-08T16:53:56.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:53:56.533 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182415 2020-09-08T16:53:56.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182416 -lt 107374182415 2020-09-08T16:53:56.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:53:56.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018894 2020-09-08T16:53:56.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:53:56.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T16:53:56.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018894 2020-09-08T16:53:56.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:53:56.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018894 2020-09-08T16:53:56.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018894' 2020-09-08T16:53:56.993 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T16:53:56.994 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018894 2020-09-08T16:53:57.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018894 -lt 128849018894 2020-09-08T16:53:57.387 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:53:57.388 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:53:57.388 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:53:57.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T16:53:57.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:53:57.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:53:57.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:53:57.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:53:57.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:53:57.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:53:57.911 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:53:58.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:53:58.301 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:53:58.301 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:53:58.302 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:53:58.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:53:58.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T16:53:58.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T16:53:58.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T16:53:58.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:53:58.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:53:58.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:53:58.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:53:58.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:53:58.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:53:58.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:53:58.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:53:58.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:53:58.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:53:59.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:53:59.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:53:59.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:53:59.308 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:53:59.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:53:59.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:53:59.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:53:59.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:53:59.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:53:59.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:53:59.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:53:59.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:53:59.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:00.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T16:54:00.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T16:54:00.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:00.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:00.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:00.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:00.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:00.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:00.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:00.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:00.456 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:00.456 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:00.456 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:00.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:00.841 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:00.841 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:00.841 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:01.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:01.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:01.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:01.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:01.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:01.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:01.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:01.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:01.369 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:01.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T16:54:01.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T16:54:01.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:01.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:01.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:01.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:01.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:01.989 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:01.989 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:01.989 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:01.989 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:01.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:01.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:02.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:02.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:02.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:02.418 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:02.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:02.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:02.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:02.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:02.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:02.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:02.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:02.936 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:02.936 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:03.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:54:03.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:54:03.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:03.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:03.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:03.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:03.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:03.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:03.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:03.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:03.572 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:03.572 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:03.572 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:03.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:03.960 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:03.960 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:03.960 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:04.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:04.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:04.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:04.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:04.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:04.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:04.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:04.476 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:04.476 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:04.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:54:04.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:54:04.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:04.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:04.998 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:05.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:05.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:05.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:05.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:05.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:05.100 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:05.100 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:05.100 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:05.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:05.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:05.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:05.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:06.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:06.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:06.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:06.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:06.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:06.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:06.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:06.040 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:06.041 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:06.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:54:06.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:54:06.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:06.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:06.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:06.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:06.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:06.674 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:06.674 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:06.674 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:06.675 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:06.675 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:06.675 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:07.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:07.057 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:07.057 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:07.057 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:07.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:07.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:07.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:07.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:07.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:07.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:07.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:07.577 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:07.577 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:08.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:54:08.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:54:08.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:08.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:08.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:08.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:08.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:08.198 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:08.198 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:08.198 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:08.199 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:08.199 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:08.199 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:08.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:08.579 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:08.580 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:08.580 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:09.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:09.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:09.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:09.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:09.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:09.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:09.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:09.106 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:09.106 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:09.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:54:09.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:54:09.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:09.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:09.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:09.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:09.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:09.729 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:09.729 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:09.729 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:09.729 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:09.730 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:09.730 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:10.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:10.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:10.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:10.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:10.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:10.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:10.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:10.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:10.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:10.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:10.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:10.671 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:10.671 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:11.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:54:11.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:54:11.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:11.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:11.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:11.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:11.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:11.297 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:11.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:11.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:11.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:11.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:11.299 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:11.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:11.683 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:11.684 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:11.684 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:12.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:12.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:12.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:12.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:12.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:12.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:12.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:12.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:12.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:12.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:54:12.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:54:12.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:12.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:12.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:12.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:12.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:12.861 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:12.861 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:12.862 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:12.862 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:12.862 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:12.862 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:13.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:13.257 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:13.258 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:13.258 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:13.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:13.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:13.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:13.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:13.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:13.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:13.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:13.812 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:13.812 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:14.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:54:14.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:54:14.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:14.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:14.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:14.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:14.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:14.436 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:14.436 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:14.437 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:14.437 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:14.437 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:14.437 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:14.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:14.823 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:14.823 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:14.823 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:15.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:15.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:15.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:15.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:15.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:15.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:15.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:15.373 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:15.374 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:15.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:54:15.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:54:15.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:15.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:15.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:16.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:16.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:16.024 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:16.024 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:16.024 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:16.025 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:16.025 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:16.025 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:16.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:16.412 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:16.412 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:16.413 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:16.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:16.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:16.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:16.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:16.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:16.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:16.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:16.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:16.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:17.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:54:17.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:54:17.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:17.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:17.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:17.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:17.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:17.566 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:17.567 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:17.567 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:17.567 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:17.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:17.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:17.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:17.948 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:17.949 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:17.949 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:18.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:18.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:18.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:18.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:18.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:18.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:18.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:18.484 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:18.485 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:19.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:54:19.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:54:19.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:19.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:19.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:19.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:19.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:19.104 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:19.104 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:19.104 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:19.105 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:19.105 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:19.105 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:19.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:19.485 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:19.485 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:19.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:20.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:20.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:20.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:20.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:20.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:20.013 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:20.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:20.014 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:20.014 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:20.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:54:20.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:54:20.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:20.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:20.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:20.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:20.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:20.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:20.664 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:20.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:20.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:20.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:20.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:21.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:21.047 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:21.047 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:21.048 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:21.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:21.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:21.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:21.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:21.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:21.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:21.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:21.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:21.568 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:22.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:54:22.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:54:22.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:22.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:22.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:22.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:22.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:22.183 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:22.184 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:22.184 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:22.184 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:22.184 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:22.184 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:22.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:22.572 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:22.572 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:22.572 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:23.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:23.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:23.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:23.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:23.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:23.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:23.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:23.091 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:23.091 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:23.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:54:23.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:54:23.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:23.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:23.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:23.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:23.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:23.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:23.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:23.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:23.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:23.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:23.717 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:24.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:24.098 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:24.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:24.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:24.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:24.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:24.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:24.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:24.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:24.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:24.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:24.619 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:24.619 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:25.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:54:25.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:54:25.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:25.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:25.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:25.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:25.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:25.254 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:25.254 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:25.254 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:25.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:25.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:25.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:25.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:25.637 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:25.637 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:25.637 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:26.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:26.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:26.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:26.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:26.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:26.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:26.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:26.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:26.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:26.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:54:26.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:54:26.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:26.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:26.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:26.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:26.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:26.828 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:26.828 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:26.829 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:26.829 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:26.829 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:26.829 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:27.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:27.212 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:27.212 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:27.213 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:27.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:27.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:27.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:27.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:27.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:27.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:27.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:27.737 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:27.737 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:28.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:54:28.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:54:28.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:28.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:28.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:28.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:28.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:28.357 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:28.357 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:28.357 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:28.358 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:28.358 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:28.358 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:28.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:28.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:28.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:28.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:29.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:29.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:29.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:29.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:29.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:29.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:29.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:29.304 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:29.304 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:29.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:54:29.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:54:29.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:29.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:29.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:29.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:29.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:29.938 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:29.939 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:29.939 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:29.939 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:29.939 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:29.939 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:30.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:30.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:30.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:30.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:30.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:30.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:30.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:30.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:30.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:30.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:30.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:30.855 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:30.855 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:31.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:54:31.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:54:31.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:31.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:31.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:31.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:31.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:31.482 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:31.483 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:31.483 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:31.483 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:31.483 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:31.483 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:31.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:31.867 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:31.868 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:31.868 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:32.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:32.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:32.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:32.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:32.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:32.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:32.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:32.393 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:32.394 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:32.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:54:32.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:54:32.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:32.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:32.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:33.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:33.015 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:33.015 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:33.015 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:33.016 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:33.016 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:33.016 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:33.016 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:33.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:33.397 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:33.397 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:33.398 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:33.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:33.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:33.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:33.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:33.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:33.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:33.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:33.918 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:33.918 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:34.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:54:34.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:54:34.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:34.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:34.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:34.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:34.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:34.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:34.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:34.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:34.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:34.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:34.592 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:34.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:34.974 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:34.974 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:34.974 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:35.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:35.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:35.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:35.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:35.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:35.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:35.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:35.502 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:35.503 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:36.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:54:36.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:54:36.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:36.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:36.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:36.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:36.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:36.124 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:36.124 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:36.124 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:36.124 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:36.124 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:36.125 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:36.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:36.509 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:36.509 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:36.510 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:37.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:37.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:37.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:37.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:37.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:37.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:37.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:37.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:37.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:37.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:54:37.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:54:37.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:37.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:37.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:37.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:37.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:37.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:37.666 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:37.666 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:37.666 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:37.666 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:37.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:38.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:38.050 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:38.050 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:38.050 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:38.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:38.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:38.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:38.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:38.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:38.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:38.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:38.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:38.575 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:39.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:54:39.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:54:39.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:39.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:39.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:39.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:39.189 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:39.189 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:39.190 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:39.190 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:39.190 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:39.190 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:39.190 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:39.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:39.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:39.575 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:39.575 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:40.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:40.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:40.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:40.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:40.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:40.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:40.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:40.180 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:40.180 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:40.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T16:54:40.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T16:54:40.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:40.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:40.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:40.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:40.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:40.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:40.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:40.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:40.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:40.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:40.797 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:41.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:41.176 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:41.177 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:41.177 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:41.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:41.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:41.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:41.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:41.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:41.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:41.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:41.698 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:41.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:42.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T16:54:42.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T16:54:42.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:42.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:42.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:42.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:42.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:42.312 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:42.312 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:42.313 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:42.313 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:42.313 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:42.313 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:42.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:42.693 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:42.694 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:42.694 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:43.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:43.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:43.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:43.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:43.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:43.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:43.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:43.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:43.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:43.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T16:54:43.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T16:54:43.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:54:43.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:43.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:54:43.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:43.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:43.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:43.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:43.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:43.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:43.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:43.833 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:44.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:54:44.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:44.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:44.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:44.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:54:44.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:54:44.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:54:44.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:54:44.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:54:44.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:54:44.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:54:44.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:54:44.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:54:45.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2020-09-08T16:54:45.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2020-09-08T16:54:45.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 1 >= 13 )) 2020-09-08T16:54:45.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:54:45.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.2 2020-09-08T16:54:45.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:54:45.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:54:45.485 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:54:45.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:54:45.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:54:45.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:54:45.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:54:45.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:54:45.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T16:54:45.868 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:54:45.869 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:54:45.869 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:54:46.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T16:54:46.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:54:46.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:54:46.396 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:370: TEST_backfill_out2: expr 200 '*' 2 2020-09-08T16:54:46.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:370: TEST_backfill_out2: local misplaced=400 2020-09-08T16:54:46.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:372: TEST_backfill_out2: check td/osd-backfill-stats 1.0 1 replicated 200 0 400 0 2020-09-08T16:54:46.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2020-09-08T16:54:46.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:64: check: local PG=1.0 2020-09-08T16:54:46.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:65: check: local primary=1 2020-09-08T16:54:46.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:66: check: local type=replicated 2020-09-08T16:54:46.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:67: check: local degraded_start=200 2020-09-08T16:54:46.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:68: check: local degraded_end=0 2020-09-08T16:54:46.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:69: check: local misplaced_start=400 2020-09-08T16:54:46.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:70: check: local misplaced_end=0 2020-09-08T16:54:46.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:71: check: local primary_start= 2020-09-08T16:54:46.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:72: check: local primary_end= 2020-09-08T16:54:46.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:73: check: local check_setup=true 2020-09-08T16:54:46.401 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2020-09-08T16:54:46.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2020-09-08T16:54:46.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:76: check: '[' true = true ']' 2020-09-08T16:54:46.402 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log td/osd-backfill-stats/osd.5.log 2020-09-08T16:54:46.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2020-09-08T16:54:46.412 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2020-09-08T16:54:46.412 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: wc -w 2020-09-08T16:54:46.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2020-09-08T16:54:46.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:86: check: local 'addp= ' 2020-09-08T16:54:46.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:87: check: '[' replicated = erasure ']' 2020-09-08T16:54:46.414 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2020-09-08T16:54:46.414 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:54:46.414 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: tail -1 2020-09-08T16:54:46.414 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2020-09-08T16:54:46.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: UPACT='[2,4,3]/[1,0]' 2020-09-08T16:54:46.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:93: check: '[' -n '[2,4,3]/[1,0]' ']' 2020-09-08T16:54:46.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:96: check: local which=degraded 2020-09-08T16:54:46.439 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:54:46.440 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:54:46.440 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -F ' [2,4,3]/[1,0] ' 2020-09-08T16:54:46.440 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -v est 2020-09-08T16:54:46.440 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: head -1 2020-09-08T16:54:46.440 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:54:46.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: FIRST=200 2020-09-08T16:54:46.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:98: check: '[' -n 200 ']' 2020-09-08T16:54:46.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:99: check: below_margin 200 200 2020-09-08T16:54:46.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=200 2020-09-08T16:54:46.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T16:54:46.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=200 2020-09-08T16:54:46.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T16:54:46.445 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:54:46.445 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:54:46.446 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: tail -1 2020-09-08T16:54:46.446 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:54:46.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: LAST=1 2020-09-08T16:54:46.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:101: check: '[' -n 1 ']' 2020-09-08T16:54:46.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:102: check: above_margin 1 0 2020-09-08T16:54:46.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=1 2020-09-08T16:54:46.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T16:54:46.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=0 2020-09-08T16:54:46.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T16:54:46.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:105: check: which=misplaced 2020-09-08T16:54:46.457 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:54:46.457 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:54:46.458 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -F ' [2,4,3]/[1,0] ' 2020-09-08T16:54:46.458 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -v est 2020-09-08T16:54:46.458 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: head -1 2020-09-08T16:54:46.458 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:54:46.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: FIRST=400 2020-09-08T16:54:46.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:107: check: '[' -n 400 ']' 2020-09-08T16:54:46.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:108: check: below_margin 400 400 2020-09-08T16:54:46.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=400 2020-09-08T16:54:46.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T16:54:46.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=400 2020-09-08T16:54:46.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T16:54:46.462 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:54:46.462 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:54:46.462 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: tail -1 2020-09-08T16:54:46.463 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:54:46.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: LAST=2 2020-09-08T16:54:46.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:110: check: '[' -n 2 ']' 2020-09-08T16:54:46.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:111: check: above_margin 2 0 2020-09-08T16:54:46.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=2 2020-09-08T16:54:46.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T16:54:46.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=0 2020-09-08T16:54:46.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T16:54:46.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2020-09-08T16:54:46.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:374: TEST_backfill_out2: delete_pool test 2020-09-08T16:54:46.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test 2020-09-08T16:54:46.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2020-09-08T16:54:47.017 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' does not exist 2020-09-08T16:54:47.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:375: TEST_backfill_out2: kill_daemons td/osd-backfill-stats 2020-09-08T16:54:47.026 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:54:47.026 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:54:47.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:54:47.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:54:47.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:54:47.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:54:47.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2020-09-08T16:54:47.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T16:54:47.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:54:47.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T16:54:47.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:54:47.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:54:47.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:54:47.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:54:47.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:54:47.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:54:47.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:54:47.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:54:47.144 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:54:47.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:54:47.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:54:47.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:54:47.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:54:47.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:54:47.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:54:47.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:54:47.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:54:47.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:54:47.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T16:54:47.166 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:54:47.166 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:54:47.166 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:54:47.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T16:54:47.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:54:47.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:54:47.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:35: run: for func in $funcs 2020-09-08T16:54:47.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2020-09-08T16:54:47.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2020-09-08T16:54:47.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2020-09-08T16:54:47.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T16:54:47.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:54:47.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T16:54:47.170 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:54:47.170 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:54:47.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:54:47.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:54:47.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:54:47.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:54:47.172 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:54:47.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:54:47.172 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:54:47.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:54:47.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:54:47.173 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:54:47.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:54:47.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:54:47.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:54:47.175 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:54:47.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:54:47.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:54:47.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T16:54:47.176 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:54:47.177 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:54:47.177 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:54:47.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T16:54:47.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:54:47.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:54:47.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2020-09-08T16:54:47.179 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T16:54:47.179 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:54:47.179 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:54:47.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.482138 2020-09-08T16:54:47.181 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T16:54:47.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T16:54:47.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T16:54:47.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2020-09-08T16:54:47.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:37: run: TEST_backfill_remapped td/osd-backfill-stats 2020-09-08T16:54:47.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:442: TEST_backfill_remapped: local dir=td/osd-backfill-stats 2020-09-08T16:54:47.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:444: TEST_backfill_remapped: run_mon td/osd-backfill-stats a 2020-09-08T16:54:47.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2020-09-08T16:54:47.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T16:54:47.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T16:54:47.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T16:54:47.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2020-09-08T16:54:47.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2020-09-08T16:54:47.474 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T16:54:47.474 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:54:47.474 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:54:47.475 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:54:47.475 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:54:47.475 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:54:47.475 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:54:47.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T16:54:47.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T16:54:47.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T16:54:47.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:54:47.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:54:47.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T16:54:47.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T16:54:47.635 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:54:47.635 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:54:47.635 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:54:47.636 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:54:47.636 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:54:47.636 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:54:47.636 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T16:54:47.637 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:54:47.637 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get fsid 2020-09-08T16:54:47.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T16:54:47.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:54:47.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:54:47.728 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T16:54:47.728 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T16:54:47.728 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:54:47.728 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:54:47.729 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:54:47.729 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:54:47.729 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:54:47.729 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:54:47.729 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T16:54:47.730 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:54:47.730 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get mon_host 2020-09-08T16:54:47.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:445: TEST_backfill_remapped: run_mgr td/osd-backfill-stats x 2020-09-08T16:54:47.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-stats 2020-09-08T16:54:47.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T16:54:47.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T16:54:47.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T16:54:47.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-stats/x 2020-09-08T16:54:47.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T16:54:48.712 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T16:54:48.713 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:54:48.713 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:54:48.713 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:54:48.713 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:54:48.714 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:54:48.714 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:54:48.714 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:54:48.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:54:48.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:446: TEST_backfill_remapped: run_osd td/osd-backfill-stats 0 2020-09-08T16:54:48.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:54:48.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:54:48.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T16:54:48.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:54:48.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/0 2020-09-08T16:54:48.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:54:48.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:54:48.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:54:48.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:54:48.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2020-09-08T16:54:48.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2020-09-08T16:54:48.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:54:48.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:54:48.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:54:48.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:54:48.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:54:48.741 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:54:48.741 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:54:48.741 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:54:48.742 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:54:48.742 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:54:48.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:54:48.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:54:48.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:54:48.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:54:48.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:54:48.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:54:48.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:54:48.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:54:48.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:54:48.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:54:48.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:54:48.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/0 2020-09-08T16:54:48.746 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:54:48.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=e21f8064-95dd-4218-99a3-da0836b1f9e0 2020-09-08T16:54:48.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 e21f8064-95dd-4218-99a3-da0836b1f9e0' 2020-09-08T16:54:48.747 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:54:48.747 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 e21f8064-95dd-4218-99a3-da0836b1f9e0 2020-09-08T16:54:48.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBYt1df5PLlLRAAwGBED2PLIg0FnU4XYug3hw== 2020-09-08T16:54:48.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBYt1df5PLlLRAAwGBED2PLIg0FnU4XYug3hw=="}' 2020-09-08T16:54:48.765 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new e21f8064-95dd-4218-99a3-da0836b1f9e0 -i td/osd-backfill-stats/0/new.json 2020-09-08T16:54:49.102 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:54:49.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/0/new.json 2020-09-08T16:54:49.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBYt1df5PLlLRAAwGBED2PLIg0FnU4XYug3hw== --osd-uuid e21f8064-95dd-4218-99a3-da0836b1f9e0 2020-09-08T16:54:49.138 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:54:49.143+0000 7f4a2f889ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:54:49.140 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:54:49.145+0000 7f4a2f889ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:54:49.141 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:54:49.146+0000 7f4a2f889ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:54:49.142 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:54:49.147+0000 7f4a2f889ec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:54:49.142 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:54:49.147+0000 7f4a2f889ec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:54:49.143 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:54:49.147+0000 7f4a2f889ec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:54:49.176 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:54:49.178+0000 7f4a2f889ec0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2020-09-08T16:54:53.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2020-09-08T16:54:53.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:54:53.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T16:54:53.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:54:53.441 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T16:54:53.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T16:54:53.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:54:53.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:54:53.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:54:53.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:54:53.971 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T16:54:53.993 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:54:53.997+0000 7f639f741ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:54:54.021 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:54:54.025+0000 7f639f741ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:54:54.022 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:54:54.027+0000 7f639f741ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:54:54.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T16:54:54.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:54:54.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T16:54:54.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:54:54.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:54:54.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:54:54.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:54:54.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:54:54.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:54:54.365 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:54:54.536 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:54:54.541+0000 7f639f741ec0 -1 Falling back to public interface 2020-09-08T16:54:54.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:54:55.346 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:54:55.350+0000 7f639f741ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T16:54:55.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:54:55.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:54:55.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:54:55.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:54:55.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:54:55.799 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:54:56.230 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/576157,v1:127.0.0.1:6803/576157] [v2:127.0.0.1:6804/576157,v1:127.0.0.1:6805/576157] exists,up e21f8064-95dd-4218-99a3-da0836b1f9e0 2020-09-08T16:54:56.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:54:56.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:54:56.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:54:56.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:447: TEST_backfill_remapped: run_osd td/osd-backfill-stats 1 2020-09-08T16:54:56.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:54:56.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:54:56.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T16:54:56.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:54:56.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/1 2020-09-08T16:54:56.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:54:56.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:54:56.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:54:56.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:54:56.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2020-09-08T16:54:56.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2020-09-08T16:54:56.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:54:56.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:54:56.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:54:56.235 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:54:56.235 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:54:56.235 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:54:56.235 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:54:56.235 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:54:56.236 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:54:56.236 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:54:56.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:54:56.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:54:56.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:54:56.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:54:56.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:54:56.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:54:56.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:54:56.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:54:56.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:54:56.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:54:56.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:54:56.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/1 2020-09-08T16:54:56.238 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:54:56.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=6e2a0e6f-1c03-4c94-aa48-91e651c4afc8 2020-09-08T16:54:56.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 6e2a0e6f-1c03-4c94-aa48-91e651c4afc8' 2020-09-08T16:54:56.246 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:54:56.246 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 6e2a0e6f-1c03-4c94-aa48-91e651c4afc8 2020-09-08T16:54:56.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBgt1dfcbwEDxAA5y07fJmQUDQvf3vhod/jSA== 2020-09-08T16:54:56.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBgt1dfcbwEDxAA5y07fJmQUDQvf3vhod/jSA=="}' 2020-09-08T16:54:56.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 6e2a0e6f-1c03-4c94-aa48-91e651c4afc8 -i td/osd-backfill-stats/1/new.json 2020-09-08T16:54:56.810 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:54:56.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/1/new.json 2020-09-08T16:54:56.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBgt1dfcbwEDxAA5y07fJmQUDQvf3vhod/jSA== --osd-uuid 6e2a0e6f-1c03-4c94-aa48-91e651c4afc8 2020-09-08T16:54:56.847 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:54:56.852+0000 7f5175ef4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:54:56.848 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:54:56.853+0000 7f5175ef4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:54:56.850 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:54:56.855+0000 7f5175ef4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:54:56.850 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:54:56.855+0000 7f5175ef4ec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:54:56.851 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:54:56.855+0000 7f5175ef4ec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:54:56.851 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:54:56.855+0000 7f5175ef4ec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:54:56.902 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:54:56.907+0000 7f5175ef4ec0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2020-09-08T16:55:01.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2020-09-08T16:55:01.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:55:01.151 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T16:55:01.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T16:55:01.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:55:01.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T16:55:01.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:55:01.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:55:01.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:55:01.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:55:01.684 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T16:55:01.705 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:01.710+0000 7f2b182fdec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:55:01.724 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:01.728+0000 7f2b182fdec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:55:01.725 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:01.730+0000 7f2b182fdec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:55:02.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T16:55:02.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:55:02.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T16:55:02.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:55:02.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:55:02.073 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:55:02.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:55:02.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:55:02.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:55:02.074 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:55:02.240 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:02.245+0000 7f2b182fdec0 -1 Falling back to public interface 2020-09-08T16:55:02.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:55:03.043 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:03.045+0000 7f2b182fdec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T16:55:03.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:55:03.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:55:03.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:55:03.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:55:03.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:55:03.489 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:55:03.910 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/577151,v1:127.0.0.1:6811/577151] [v2:127.0.0.1:6812/577151,v1:127.0.0.1:6813/577151] exists,up 6e2a0e6f-1c03-4c94-aa48-91e651c4afc8 2020-09-08T16:55:03.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:55:03.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:55:03.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:55:03.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:448: TEST_backfill_remapped: run_osd td/osd-backfill-stats 2 2020-09-08T16:55:03.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:55:03.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:55:03.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T16:55:03.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:55:03.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/2 2020-09-08T16:55:03.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:55:03.912 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:55:03.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:55:03.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:55:03.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2020-09-08T16:55:03.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2020-09-08T16:55:03.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:55:03.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:55:03.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:55:03.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:55:03.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:55:03.919 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:55:03.919 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:55:03.919 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:55:03.920 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:55:03.920 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:55:03.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:55:03.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:55:03.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:55:03.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:55:03.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:55:03.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:55:03.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:55:03.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:55:03.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:55:03.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:55:03.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:55:03.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/2 2020-09-08T16:55:03.922 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:55:03.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=cf22928c-bf33-4b67-8ac9-3a5f7704b195 2020-09-08T16:55:03.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 cf22928c-bf33-4b67-8ac9-3a5f7704b195' 2020-09-08T16:55:03.924 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:55:03.924 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 cf22928c-bf33-4b67-8ac9-3a5f7704b195 2020-09-08T16:55:03.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBnt1df1oKJNxAAWxzNEBL/h9Y5BgZ4Wx7RuQ== 2020-09-08T16:55:03.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBnt1df1oKJNxAAWxzNEBL/h9Y5BgZ4Wx7RuQ=="}' 2020-09-08T16:55:03.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new cf22928c-bf33-4b67-8ac9-3a5f7704b195 -i td/osd-backfill-stats/2/new.json 2020-09-08T16:55:04.438 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:55:04.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/2/new.json 2020-09-08T16:55:04.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBnt1df1oKJNxAAWxzNEBL/h9Y5BgZ4Wx7RuQ== --osd-uuid cf22928c-bf33-4b67-8ac9-3a5f7704b195 2020-09-08T16:55:04.475 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:04.480+0000 7fc6177d7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:55:04.477 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:04.482+0000 7fc6177d7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:55:04.478 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:04.483+0000 7fc6177d7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:55:04.479 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:04.484+0000 7fc6177d7ec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:55:04.479 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:04.484+0000 7fc6177d7ec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:55:04.479 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:04.484+0000 7fc6177d7ec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:55:04.522 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:04.527+0000 7fc6177d7ec0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2020-09-08T16:55:08.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2020-09-08T16:55:08.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:55:08.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T16:55:08.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:55:08.773 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T16:55:09.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T16:55:09.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:55:09.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:55:09.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:55:09.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:55:09.309 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T16:55:09.331 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:09.336+0000 7fa9bcbd3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:55:09.333 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:09.338+0000 7fa9bcbd3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:55:09.338 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:09.339+0000 7fa9bcbd3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:55:09.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T16:55:09.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:55:09.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T16:55:09.709 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:55:09.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:55:09.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:55:09.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:55:09.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:55:09.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:55:09.711 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:55:09.851 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:09.855+0000 7fa9bcbd3ec0 -1 Falling back to public interface 2020-09-08T16:55:10.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:55:10.675 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:10.675+0000 7fa9bcbd3ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T16:55:11.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:55:11.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:55:11.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:55:11.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:55:11.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:55:11.125 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:55:11.528 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/578145,v1:127.0.0.1:6819/578145] [v2:127.0.0.1:6820/578145,v1:127.0.0.1:6821/578145] exists,up cf22928c-bf33-4b67-8ac9-3a5f7704b195 2020-09-08T16:55:11.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:55:11.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:55:11.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:55:11.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:449: TEST_backfill_remapped: run_osd td/osd-backfill-stats 3 2020-09-08T16:55:11.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:55:11.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:55:11.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T16:55:11.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:55:11.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/3 2020-09-08T16:55:11.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:55:11.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:55:11.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:55:11.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:55:11.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2020-09-08T16:55:11.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2020-09-08T16:55:11.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:55:11.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:55:11.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:55:11.533 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:55:11.533 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:55:11.533 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:55:11.533 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:55:11.533 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:55:11.534 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:55:11.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:55:11.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:55:11.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:55:11.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:55:11.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:55:11.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:55:11.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:55:11.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:55:11.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:55:11.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:55:11.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:55:11.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:55:11.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/3 2020-09-08T16:55:11.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:55:11.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=31d2f000-bb9b-4626-9eb7-ef72003ec26c 2020-09-08T16:55:11.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 31d2f000-bb9b-4626-9eb7-ef72003ec26c' 2020-09-08T16:55:11.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:55:11.539 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 31d2f000-bb9b-4626-9eb7-ef72003ec26c 2020-09-08T16:55:11.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBvt1dfeoHAIBAAPH11rfabMNks6LUvZFTlOQ== 2020-09-08T16:55:11.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBvt1dfeoHAIBAAPH11rfabMNks6LUvZFTlOQ=="}' 2020-09-08T16:55:11.544 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 31d2f000-bb9b-4626-9eb7-ef72003ec26c -i td/osd-backfill-stats/3/new.json 2020-09-08T16:55:12.047 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T16:55:12.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/3/new.json 2020-09-08T16:55:12.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBvt1dfeoHAIBAAPH11rfabMNks6LUvZFTlOQ== --osd-uuid 31d2f000-bb9b-4626-9eb7-ef72003ec26c 2020-09-08T16:55:12.085 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:12.090+0000 7f00ba386ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:55:12.087 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:12.092+0000 7f00ba386ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:55:12.087 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:12.092+0000 7f00ba386ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:55:12.088 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:12.093+0000 7f00ba386ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:55:12.088 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:12.093+0000 7f00ba386ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:55:12.089 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:12.093+0000 7f00ba386ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:55:12.135 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:12.140+0000 7f00ba386ec0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2020-09-08T16:55:16.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2020-09-08T16:55:16.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:55:16.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T16:55:16.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:55:16.327 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T16:55:16.886 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T16:55:16.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T16:55:16.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:55:16.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:55:16.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:55:16.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:55:16.909 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:16.914+0000 7f52bee05ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:55:16.911 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:16.916+0000 7f52bee05ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:55:16.912 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:16.917+0000 7f52bee05ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:55:17.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T16:55:17.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:55:17.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T16:55:17.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:55:17.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:55:17.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:55:17.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:55:17.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:55:17.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:55:17.279 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:55:17.430 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:17.434+0000 7f52bee05ec0 -1 Falling back to public interface 2020-09-08T16:55:17.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:55:18.248 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:55:18.247+0000 7f52bee05ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T16:55:18.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:55:18.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:55:18.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:55:18.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:55:18.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:55:18.680 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:55:19.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:55:20.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:55:20.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:55:20.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T16:55:20.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:55:20.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:55:20.130 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:55:20.531 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/579139,v1:127.0.0.1:6827/579139] [v2:127.0.0.1:6828/579139,v1:127.0.0.1:6829/579139] exists,up 31d2f000-bb9b-4626-9eb7-ef72003ec26c 2020-09-08T16:55:20.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:55:20.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:55:20.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:55:20.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:451: TEST_backfill_remapped: create_pool test 1 1 2020-09-08T16:55:20.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test 1 1 2020-09-08T16:55:21.069 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' already exists 2020-09-08T16:55:21.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:55:22.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:452: TEST_backfill_remapped: ceph osd pool set test size 3 2020-09-08T16:55:22.736 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 3 2020-09-08T16:55:22.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:453: TEST_backfill_remapped: sleep 5 2020-09-08T16:55:27.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:455: TEST_backfill_remapped: wait_for_clean 2020-09-08T16:55:27.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:55:27.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:55:27.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:55:27.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:55:27.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:55:27.749 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:55:27.749 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:55:27.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:55:27.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:55:27.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:55:27.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:55:27.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:55:27.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:55:27.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:55:27.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:55:28.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:55:28.248 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:55:28.248 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:55:28.248 INFO:tasks.workunit.client.0.smithi065.stderr:3' 2020-09-08T16:55:28.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:55:28.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:55:28.249 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:55:28.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836489 2020-09-08T16:55:28.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836489 2020-09-08T16:55:28.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836489' 2020-09-08T16:55:28.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:55:28.388 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:55:28.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672967 2020-09-08T16:55:28.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672967 2020-09-08T16:55:28.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836489 1-42949672967' 2020-09-08T16:55:28.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:55:28.518 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:55:28.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509447 2020-09-08T16:55:28.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509447 2020-09-08T16:55:28.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836489 1-42949672967 2-64424509447' 2020-09-08T16:55:28.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:55:28.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:55:28.777 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345924 2020-09-08T16:55:28.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345924 2020-09-08T16:55:28.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836489 1-42949672967 2-64424509447 3-85899345924' 2020-09-08T16:55:28.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:55:28.778 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836489 2020-09-08T16:55:28.779 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:55:28.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:55:28.780 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836489 2020-09-08T16:55:28.780 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:55:28.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836489 2020-09-08T16:55:28.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836489' 2020-09-08T16:55:28.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:55:28.781 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836489 2020-09-08T16:55:29.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836489 -lt 21474836489 2020-09-08T16:55:29.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:55:29.169 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672967 2020-09-08T16:55:29.169 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:55:29.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:55:29.170 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672967 2020-09-08T16:55:29.171 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:55:29.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672967 2020-09-08T16:55:29.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672967' 2020-09-08T16:55:29.172 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:55:29.172 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672967 2020-09-08T16:55:29.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672965 -lt 42949672967 2020-09-08T16:55:29.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:55:30.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:55:30.576 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:55:30.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672968 -lt 42949672967 2020-09-08T16:55:30.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:55:30.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509447 2020-09-08T16:55:30.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:55:30.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:55:30.986 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509447 2020-09-08T16:55:30.986 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:55:30.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509447 2020-09-08T16:55:30.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509447' 2020-09-08T16:55:30.988 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:55:30.988 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509447 2020-09-08T16:55:31.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509447 -lt 64424509447 2020-09-08T16:55:31.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:55:31.384 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345924 2020-09-08T16:55:31.385 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:55:31.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:55:31.385 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345924 2020-09-08T16:55:31.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:55:31.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345924 2020-09-08T16:55:31.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345924' 2020-09-08T16:55:31.387 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:55:31.387 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345924 2020-09-08T16:55:31.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345925 -lt 85899345924 2020-09-08T16:55:31.782 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:55:31.782 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:55:31.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:55:32.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T16:55:32.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:55:32.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:55:32.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:55:32.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:55:32.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:55:32.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:55:32.312 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:55:32.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T16:55:32.698 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:55:32.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:55:32.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:55:33.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T16:55:33.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:55:33.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:55:33.229 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: seq 1 200 2020-09-08T16:55:33.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:33.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj1 /dev/null 2020-09-08T16:55:33.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:33.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj2 /dev/null 2020-09-08T16:55:33.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:33.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj3 /dev/null 2020-09-08T16:55:33.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:33.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj4 /dev/null 2020-09-08T16:55:33.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:33.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj5 /dev/null 2020-09-08T16:55:33.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:33.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj6 /dev/null 2020-09-08T16:55:34.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:34.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj7 /dev/null 2020-09-08T16:55:34.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:34.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj8 /dev/null 2020-09-08T16:55:34.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:34.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj9 /dev/null 2020-09-08T16:55:34.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:34.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj10 /dev/null 2020-09-08T16:55:34.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:34.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj11 /dev/null 2020-09-08T16:55:34.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:34.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj12 /dev/null 2020-09-08T16:55:34.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:34.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj13 /dev/null 2020-09-08T16:55:34.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:34.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj14 /dev/null 2020-09-08T16:55:35.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:35.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj15 /dev/null 2020-09-08T16:55:35.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:35.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj16 /dev/null 2020-09-08T16:55:35.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:35.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj17 /dev/null 2020-09-08T16:55:35.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:35.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj18 /dev/null 2020-09-08T16:55:35.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:35.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj19 /dev/null 2020-09-08T16:55:35.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:35.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj20 /dev/null 2020-09-08T16:55:35.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:35.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj21 /dev/null 2020-09-08T16:55:35.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:35.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj22 /dev/null 2020-09-08T16:55:36.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:36.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj23 /dev/null 2020-09-08T16:55:36.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:36.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj24 /dev/null 2020-09-08T16:55:36.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:36.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj25 /dev/null 2020-09-08T16:55:36.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:36.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj26 /dev/null 2020-09-08T16:55:36.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:36.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj27 /dev/null 2020-09-08T16:55:36.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:36.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj28 /dev/null 2020-09-08T16:55:36.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:36.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj29 /dev/null 2020-09-08T16:55:37.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:37.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj30 /dev/null 2020-09-08T16:55:37.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:37.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj31 /dev/null 2020-09-08T16:55:37.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:37.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj32 /dev/null 2020-09-08T16:55:37.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:37.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj33 /dev/null 2020-09-08T16:55:37.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:37.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj34 /dev/null 2020-09-08T16:55:37.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:37.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj35 /dev/null 2020-09-08T16:55:37.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:37.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj36 /dev/null 2020-09-08T16:55:37.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:37.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj37 /dev/null 2020-09-08T16:55:37.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:37.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj38 /dev/null 2020-09-08T16:55:38.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:38.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj39 /dev/null 2020-09-08T16:55:38.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:38.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj40 /dev/null 2020-09-08T16:55:38.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:38.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj41 /dev/null 2020-09-08T16:55:38.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:38.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj42 /dev/null 2020-09-08T16:55:38.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:38.611 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj43 /dev/null 2020-09-08T16:55:38.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:38.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj44 /dev/null 2020-09-08T16:55:38.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:38.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj45 /dev/null 2020-09-08T16:55:39.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:39.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj46 /dev/null 2020-09-08T16:55:39.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:39.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj47 /dev/null 2020-09-08T16:55:39.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:39.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj48 /dev/null 2020-09-08T16:55:39.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:39.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj49 /dev/null 2020-09-08T16:55:39.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:39.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj50 /dev/null 2020-09-08T16:55:39.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:39.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj51 /dev/null 2020-09-08T16:55:39.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:39.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj52 /dev/null 2020-09-08T16:55:39.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:39.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj53 /dev/null 2020-09-08T16:55:40.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:40.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj54 /dev/null 2020-09-08T16:55:40.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:40.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj55 /dev/null 2020-09-08T16:55:40.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:40.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj56 /dev/null 2020-09-08T16:55:40.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:40.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj57 /dev/null 2020-09-08T16:55:40.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:40.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj58 /dev/null 2020-09-08T16:55:40.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:40.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj59 /dev/null 2020-09-08T16:55:40.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:40.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj60 /dev/null 2020-09-08T16:55:40.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:40.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj61 /dev/null 2020-09-08T16:55:41.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:41.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj62 /dev/null 2020-09-08T16:55:41.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:41.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj63 /dev/null 2020-09-08T16:55:41.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:41.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj64 /dev/null 2020-09-08T16:55:41.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:41.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj65 /dev/null 2020-09-08T16:55:41.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:41.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj66 /dev/null 2020-09-08T16:55:41.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:41.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj67 /dev/null 2020-09-08T16:55:41.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:41.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj68 /dev/null 2020-09-08T16:55:41.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:41.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj69 /dev/null 2020-09-08T16:55:42.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:42.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj70 /dev/null 2020-09-08T16:55:42.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:42.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj71 /dev/null 2020-09-08T16:55:42.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:42.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj72 /dev/null 2020-09-08T16:55:42.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:42.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj73 /dev/null 2020-09-08T16:55:42.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:42.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj74 /dev/null 2020-09-08T16:55:42.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:42.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj75 /dev/null 2020-09-08T16:55:42.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:42.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj76 /dev/null 2020-09-08T16:55:42.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:42.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj77 /dev/null 2020-09-08T16:55:43.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:43.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj78 /dev/null 2020-09-08T16:55:43.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:43.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj79 /dev/null 2020-09-08T16:55:43.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:43.329 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj80 /dev/null 2020-09-08T16:55:43.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:43.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj81 /dev/null 2020-09-08T16:55:43.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:43.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj82 /dev/null 2020-09-08T16:55:43.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:43.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj83 /dev/null 2020-09-08T16:55:43.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:43.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj84 /dev/null 2020-09-08T16:55:43.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:43.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj85 /dev/null 2020-09-08T16:55:44.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:44.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj86 /dev/null 2020-09-08T16:55:44.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:44.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj87 /dev/null 2020-09-08T16:55:44.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:44.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj88 /dev/null 2020-09-08T16:55:44.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:44.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj89 /dev/null 2020-09-08T16:55:44.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:44.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj90 /dev/null 2020-09-08T16:55:44.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:44.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj91 /dev/null 2020-09-08T16:55:44.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:44.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj92 /dev/null 2020-09-08T16:55:44.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:44.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj93 /dev/null 2020-09-08T16:55:45.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:45.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj94 /dev/null 2020-09-08T16:55:45.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:45.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj95 /dev/null 2020-09-08T16:55:45.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:45.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj96 /dev/null 2020-09-08T16:55:45.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:45.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj97 /dev/null 2020-09-08T16:55:45.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:45.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj98 /dev/null 2020-09-08T16:55:45.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:45.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj99 /dev/null 2020-09-08T16:55:45.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:45.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj100 /dev/null 2020-09-08T16:55:45.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:45.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj101 /dev/null 2020-09-08T16:55:46.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:46.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj102 /dev/null 2020-09-08T16:55:46.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:46.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj103 /dev/null 2020-09-08T16:55:46.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:46.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj104 /dev/null 2020-09-08T16:55:46.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:46.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj105 /dev/null 2020-09-08T16:55:46.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:46.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj106 /dev/null 2020-09-08T16:55:46.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:46.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj107 /dev/null 2020-09-08T16:55:46.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:46.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj108 /dev/null 2020-09-08T16:55:46.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:46.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj109 /dev/null 2020-09-08T16:55:47.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:47.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj110 /dev/null 2020-09-08T16:55:47.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:47.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj111 /dev/null 2020-09-08T16:55:47.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:47.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj112 /dev/null 2020-09-08T16:55:47.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:47.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj113 /dev/null 2020-09-08T16:55:47.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:47.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj114 /dev/null 2020-09-08T16:55:47.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:47.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj115 /dev/null 2020-09-08T16:55:47.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:47.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj116 /dev/null 2020-09-08T16:55:48.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:48.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj117 /dev/null 2020-09-08T16:55:48.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:48.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj118 /dev/null 2020-09-08T16:55:48.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:48.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj119 /dev/null 2020-09-08T16:55:48.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:48.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj120 /dev/null 2020-09-08T16:55:48.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:48.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj121 /dev/null 2020-09-08T16:55:48.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:48.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj122 /dev/null 2020-09-08T16:55:48.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:48.818 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj123 /dev/null 2020-09-08T16:55:48.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:48.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj124 /dev/null 2020-09-08T16:55:49.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:49.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj125 /dev/null 2020-09-08T16:55:49.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:49.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj126 /dev/null 2020-09-08T16:55:49.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:49.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj127 /dev/null 2020-09-08T16:55:49.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:49.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj128 /dev/null 2020-09-08T16:55:49.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:49.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj129 /dev/null 2020-09-08T16:55:49.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:49.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj130 /dev/null 2020-09-08T16:55:50.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:50.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj131 /dev/null 2020-09-08T16:55:50.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:50.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj132 /dev/null 2020-09-08T16:55:50.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:50.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj133 /dev/null 2020-09-08T16:55:50.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:50.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj134 /dev/null 2020-09-08T16:55:50.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:50.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj135 /dev/null 2020-09-08T16:55:50.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:50.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj136 /dev/null 2020-09-08T16:55:50.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:50.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj137 /dev/null 2020-09-08T16:55:50.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:50.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj138 /dev/null 2020-09-08T16:55:51.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:51.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj139 /dev/null 2020-09-08T16:55:51.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:51.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj140 /dev/null 2020-09-08T16:55:51.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:51.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj141 /dev/null 2020-09-08T16:55:51.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:51.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj142 /dev/null 2020-09-08T16:55:51.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:51.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj143 /dev/null 2020-09-08T16:55:51.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:51.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj144 /dev/null 2020-09-08T16:55:51.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:51.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj145 /dev/null 2020-09-08T16:55:51.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:51.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj146 /dev/null 2020-09-08T16:55:52.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:52.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj147 /dev/null 2020-09-08T16:55:52.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:52.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj148 /dev/null 2020-09-08T16:55:52.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:52.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj149 /dev/null 2020-09-08T16:55:52.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:52.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj150 /dev/null 2020-09-08T16:55:52.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:52.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj151 /dev/null 2020-09-08T16:55:52.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:52.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj152 /dev/null 2020-09-08T16:55:52.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:52.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj153 /dev/null 2020-09-08T16:55:53.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:53.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj154 /dev/null 2020-09-08T16:55:53.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:53.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj155 /dev/null 2020-09-08T16:55:53.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:53.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj156 /dev/null 2020-09-08T16:55:53.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:53.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj157 /dev/null 2020-09-08T16:55:53.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:53.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj158 /dev/null 2020-09-08T16:55:53.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:53.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj159 /dev/null 2020-09-08T16:55:53.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:53.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj160 /dev/null 2020-09-08T16:55:54.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:54.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj161 /dev/null 2020-09-08T16:55:54.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:54.164 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj162 /dev/null 2020-09-08T16:55:54.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:54.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj163 /dev/null 2020-09-08T16:55:54.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:54.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj164 /dev/null 2020-09-08T16:55:54.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:54.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj165 /dev/null 2020-09-08T16:55:54.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:54.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj166 /dev/null 2020-09-08T16:55:54.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:54.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj167 /dev/null 2020-09-08T16:55:54.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:54.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj168 /dev/null 2020-09-08T16:55:55.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:55.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj169 /dev/null 2020-09-08T16:55:55.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:55.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj170 /dev/null 2020-09-08T16:55:55.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:55.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj171 /dev/null 2020-09-08T16:55:55.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:55.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj172 /dev/null 2020-09-08T16:55:55.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:55.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj173 /dev/null 2020-09-08T16:55:55.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:55.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj174 /dev/null 2020-09-08T16:55:55.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:55.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj175 /dev/null 2020-09-08T16:55:55.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:55.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj176 /dev/null 2020-09-08T16:55:56.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:56.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj177 /dev/null 2020-09-08T16:55:56.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:56.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj178 /dev/null 2020-09-08T16:55:56.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:56.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj179 /dev/null 2020-09-08T16:55:56.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:56.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj180 /dev/null 2020-09-08T16:55:56.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:56.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj181 /dev/null 2020-09-08T16:55:56.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:56.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj182 /dev/null 2020-09-08T16:55:56.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:56.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj183 /dev/null 2020-09-08T16:55:56.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:56.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj184 /dev/null 2020-09-08T16:55:57.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:57.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj185 /dev/null 2020-09-08T16:55:57.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:57.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj186 /dev/null 2020-09-08T16:55:57.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:57.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj187 /dev/null 2020-09-08T16:55:57.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:57.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj188 /dev/null 2020-09-08T16:55:57.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:57.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj189 /dev/null 2020-09-08T16:55:57.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:57.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj190 /dev/null 2020-09-08T16:55:57.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:57.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj191 /dev/null 2020-09-08T16:55:57.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:57.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj192 /dev/null 2020-09-08T16:55:58.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:58.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj193 /dev/null 2020-09-08T16:55:58.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:58.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj194 /dev/null 2020-09-08T16:55:58.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:58.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj195 /dev/null 2020-09-08T16:55:58.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:58.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj196 /dev/null 2020-09-08T16:55:58.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:58.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj197 /dev/null 2020-09-08T16:55:58.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:58.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj198 /dev/null 2020-09-08T16:55:58.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:58.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj199 /dev/null 2020-09-08T16:55:59.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2020-09-08T16:55:59.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj200 /dev/null 2020-09-08T16:55:59.135 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:462: TEST_backfill_remapped: get_pg test obj1 2020-09-08T16:55:59.135 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1031: get_pg: local poolname=test 2020-09-08T16:55:59.135 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: local objectname=obj1 2020-09-08T16:55:59.136 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: ceph --format json osd map test obj1 2020-09-08T16:55:59.136 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: jq -r .pgid 2020-09-08T16:55:59.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:462: TEST_backfill_remapped: local PG=1.0 2020-09-08T16:55:59.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:464: TEST_backfill_remapped: get_primary test obj1 2020-09-08T16:55:59.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:55:59.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:55:59.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:55:59.540 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:55:59.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:464: TEST_backfill_remapped: local primary=1 2020-09-08T16:55:59.942 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:465: TEST_backfill_remapped: get_not_primary test obj1 2020-09-08T16:55:59.943 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1167: get_not_primary: local poolname=test 2020-09-08T16:55:59.943 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: get_not_primary: local objectname=obj1 2020-09-08T16:55:59.944 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: get_primary test obj1 2020-09-08T16:55:59.944 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:55:59.944 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:55:59.944 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:55:59.945 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:56:00.358 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: local primary=1 2020-09-08T16:56:00.359 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1172: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2020-09-08T16:56:00.359 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1171: get_not_primary: ceph --format json osd map test obj1 2020-09-08T16:56:00.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:465: TEST_backfill_remapped: local otherosd=0 2020-09-08T16:56:00.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:467: TEST_backfill_remapped: ceph osd set nobackfill 2020-09-08T16:56:01.455 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is set 2020-09-08T16:56:01.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:468: TEST_backfill_remapped: ceph osd out osd.0 2020-09-08T16:56:02.055 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already out. 2020-09-08T16:56:02.064 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:469: TEST_backfill_remapped: get_osds test obj1 2020-09-08T16:56:02.064 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:959: get_osds: local poolname=test 2020-09-08T16:56:02.065 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:960: get_osds: local objectname=obj1 2020-09-08T16:56:02.065 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:963: get_osds: ceph --format json osd map test obj1 2020-09-08T16:56:02.065 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:963: get_osds: jq '.acting | .[]' 2020-09-08T16:56:02.503 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:963: get_osds: local 'osds=1 2020-09-08T16:56:02.503 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:56:02.504 INFO:tasks.workunit.client.0.smithi065.stderr:0' 2020-09-08T16:56:02.505 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:965: get_osds: echo 1 2 0 2020-09-08T16:56:02.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:469: TEST_backfill_remapped: for i in $(get_osds $poolname obj1) 2020-09-08T16:56:02.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:471: TEST_backfill_remapped: '[' 1 = 1 -o 1 = 0 ']' 2020-09-08T16:56:02.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:473: TEST_backfill_remapped: continue 2020-09-08T16:56:02.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:469: TEST_backfill_remapped: for i in $(get_osds $poolname obj1) 2020-09-08T16:56:02.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:471: TEST_backfill_remapped: '[' 2 = 1 -o 2 = 0 ']' 2020-09-08T16:56:02.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:475: TEST_backfill_remapped: ceph osd out osd.2 2020-09-08T16:56:03.260 INFO:tasks.workunit.client.0.smithi065.stderr:osd.2 is already out. 2020-09-08T16:56:03.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:476: TEST_backfill_remapped: break 2020-09-08T16:56:03.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:478: TEST_backfill_remapped: ceph osd out osd.1 2020-09-08T16:56:04.120 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already out. 2020-09-08T16:56:04.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:479: TEST_backfill_remapped: ceph osd pool set test size 2 2020-09-08T16:56:04.983 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 2 2020-09-08T16:56:04.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:480: TEST_backfill_remapped: sleep 2 2020-09-08T16:56:06.993 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:484: TEST_backfill_remapped: get_primary test obj1 2020-09-08T16:56:06.994 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:56:06.994 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:56:06.994 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:56:06.994 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:56:07.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:484: TEST_backfill_remapped: primary=0 2020-09-08T16:56:07.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:486: TEST_backfill_remapped: ceph osd unset nobackfill 2020-09-08T16:56:08.219 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is unset 2020-09-08T16:56:08.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:487: TEST_backfill_remapped: ceph tell osd.0 get_latest_osdmap 2020-09-08T16:56:08.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:488: TEST_backfill_remapped: ceph tell osd.0 debug kick_recovery_wq 0 2020-09-08T16:56:08.483 INFO:tasks.workunit.client.0.smithi065.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2020-09-08T16:56:08.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:490: TEST_backfill_remapped: sleep 2 2020-09-08T16:56:10.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:492: TEST_backfill_remapped: wait_for_clean 2020-09-08T16:56:10.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:56:10.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:56:10.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:56:10.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:56:10.494 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:56:10.494 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:56:10.495 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:56:10.495 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:56:10.495 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:56:10.495 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:56:10.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:56:10.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:56:10.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:56:10.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:56:10.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:56:11.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:56:11.003 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:56:11.003 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:56:11.003 INFO:tasks.workunit.client.0.smithi065.stderr:3' 2020-09-08T16:56:11.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:56:11.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:56:11.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:56:11.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836499 2020-09-08T16:56:11.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836499 2020-09-08T16:56:11.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836499' 2020-09-08T16:56:11.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:56:11.134 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:56:11.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672978 2020-09-08T16:56:11.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672978 2020-09-08T16:56:11.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836499 1-42949672978' 2020-09-08T16:56:11.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:56:11.264 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:56:11.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509457 2020-09-08T16:56:11.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509457 2020-09-08T16:56:11.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836499 1-42949672978 2-64424509457' 2020-09-08T16:56:11.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:56:11.395 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:56:11.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345935 2020-09-08T16:56:11.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345935 2020-09-08T16:56:11.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836499 1-42949672978 2-64424509457 3-85899345935' 2020-09-08T16:56:11.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:56:11.525 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836499 2020-09-08T16:56:11.525 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:56:11.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:56:11.526 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836499 2020-09-08T16:56:11.526 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:56:11.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836499 2020-09-08T16:56:11.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836499' 2020-09-08T16:56:11.527 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:56:11.527 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836499 2020-09-08T16:56:11.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836497 -lt 21474836499 2020-09-08T16:56:11.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:56:12.919 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:56:12.920 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:56:13.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836500 -lt 21474836499 2020-09-08T16:56:13.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:56:13.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672978 2020-09-08T16:56:13.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:56:13.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:56:13.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672978 2020-09-08T16:56:13.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:56:13.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672978 2020-09-08T16:56:13.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672978' 2020-09-08T16:56:13.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:56:13.323 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672978 2020-09-08T16:56:13.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672978 -lt 42949672978 2020-09-08T16:56:13.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:56:13.730 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509457 2020-09-08T16:56:13.731 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:56:13.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:56:13.731 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509457 2020-09-08T16:56:13.732 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:56:13.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509457 2020-09-08T16:56:13.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509457' 2020-09-08T16:56:13.733 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:56:13.733 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509457 2020-09-08T16:56:14.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509458 -lt 64424509457 2020-09-08T16:56:14.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:56:14.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345935 2020-09-08T16:56:14.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:56:14.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:56:14.129 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345935 2020-09-08T16:56:14.129 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:56:14.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345935 2020-09-08T16:56:14.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345935' 2020-09-08T16:56:14.131 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:56:14.131 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345935 2020-09-08T16:56:14.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345935 -lt 85899345935 2020-09-08T16:56:14.527 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:56:14.527 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:56:14.527 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:56:15.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T16:56:15.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:56:15.051 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:56:15.051 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:56:15.052 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:56:15.052 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:56:15.052 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:56:15.052 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:56:15.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:56:15.458 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:56:15.458 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:56:15.458 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:56:15.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:56:15.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T16:56:15.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T16:56:15.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T16:56:15.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:56:15.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:56:16.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:56:16.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:56:16.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:56:16.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:56:16.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:56:16.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:56:16.086 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:56:16.087 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:56:16.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:56:16.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:56:16.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:56:16.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:56:17.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:56:17.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:56:17.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:56:17.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:56:17.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:56:17.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:56:17.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:56:17.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:56:17.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:56:17.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T16:56:17.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T16:56:17.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:56:17.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:56:17.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:56:17.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:56:17.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:56:17.680 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:56:17.680 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:56:17.680 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:56:17.681 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:56:17.681 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:56:17.681 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:56:18.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:56:18.074 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:56:18.075 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:56:18.075 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:56:18.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:56:18.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:56:18.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:56:18.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:56:18.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:56:18.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:56:18.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:56:18.636 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:56:18.637 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:56:19.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:56:19.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:56:19.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:56:19.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:56:19.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:56:19.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:56:19.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:56:19.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:56:19.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:56:19.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:56:19.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:56:19.256 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:56:19.256 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:56:19.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:56:19.638 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:56:19.639 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:56:19.639 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:56:20.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:56:20.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:56:20.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:56:20.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:56:20.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:56:20.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:56:20.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:56:20.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:56:20.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:56:20.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:56:20.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:56:20.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:56:20.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:56:20.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:56:20.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:56:20.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:56:20.788 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:56:20.788 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:56:20.788 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:56:20.788 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:56:20.788 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:56:20.789 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:56:21.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:56:21.317 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:56:21.317 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:56:21.318 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:56:21.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:56:21.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:56:21.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:56:21.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:56:21.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:56:21.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:56:21.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:56:21.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:56:21.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:56:22.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:56:22.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:56:22.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:56:22.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:56:22.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:56:22.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:56:22.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:56:22.467 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:56:22.467 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:56:22.467 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:56:22.467 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:56:22.468 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:56:22.468 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:56:22.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:56:22.866 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:56:22.867 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:56:22.867 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:56:23.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:56:23.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:56:23.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:56:23.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:56:23.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:56:23.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:56:23.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:56:23.405 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:56:23.406 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:56:23.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=7 2020-09-08T16:56:23.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 7 '!=' null 2020-09-08T16:56:23.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:56:23.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:56:23.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:56:24.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:56:24.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:56:24.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:56:24.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:56:24.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:56:24.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:56:24.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:56:24.028 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:56:24.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:56:24.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:56:24.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:56:24.405 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:56:24.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:56:24.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:56:24.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:56:24.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:56:24.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:56:24.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:56:24.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:56:24.924 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:56:24.924 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:56:25.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:56:25.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:56:25.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:56:25.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:56:25.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:56:25.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:56:25.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:56:25.559 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:56:25.559 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:56:25.559 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:56:25.559 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:56:25.560 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:56:25.560 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:56:25.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:56:25.943 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:56:25.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:56:25.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:56:26.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:56:26.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:56:26.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:56:26.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:56:26.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:56:26.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:56:26.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:56:26.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:56:26.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:56:26.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:56:26.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:56:26.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:56:26.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:56:26.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:56:27.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:56:27.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:56:27.089 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:56:27.089 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:56:27.090 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:56:27.090 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:56:27.090 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:56:27.090 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:56:27.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:56:27.473 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:56:27.474 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:56:27.474 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:56:27.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:56:27.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:56:27.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:56:27.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:56:27.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:56:27.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:56:27.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:56:27.989 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:56:27.989 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:56:28.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:56:28.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:56:28.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:56:28.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:56:28.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:56:28.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:56:28.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:56:28.609 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:56:28.609 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:56:28.609 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:56:28.610 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:56:28.610 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:56:28.610 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:56:28.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:56:28.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:56:28.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:56:28.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:56:29.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:56:29.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:56:29.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:56:29.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:56:29.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:56:29.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:56:29.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:56:29.513 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:56:29.513 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:56:30.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=8 2020-09-08T16:56:30.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 8 '!=' null 2020-09-08T16:56:30.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:56:30.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:56:30.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:56:30.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:56:30.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:56:30.139 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:56:30.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:56:30.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:56:30.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:56:30.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:56:30.141 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:56:30.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:56:30.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:56:30.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:56:30.525 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:56:31.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:56:31.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:56:31.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:56:31.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:56:31.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:56:31.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:56:31.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:56:31.050 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:56:31.050 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:56:31.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:56:31.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:56:31.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:56:31.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:56:31.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:56:31.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:56:31.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:56:31.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:56:31.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:56:31.678 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:56:31.678 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:56:31.678 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:56:31.678 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:56:32.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:56:32.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:56:32.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:56:32.071 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:56:32.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:56:32.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:56:32.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:56:32.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:56:32.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:56:32.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:56:32.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:56:32.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:56:32.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:56:33.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=8 2020-09-08T16:56:33.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 8 '!=' null 2020-09-08T16:56:33.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:56:33.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:56:33.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:56:33.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:56:33.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:56:33.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:56:33.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:56:33.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:56:33.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:56:33.225 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:56:33.225 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:56:33.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:56:33.608 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:56:33.608 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:56:33.609 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:56:34.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:56:34.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:56:34.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:56:34.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:56:34.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:56:34.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:56:34.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:56:34.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:56:34.130 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:56:34.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=8 2020-09-08T16:56:34.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 8 '!=' null 2020-09-08T16:56:34.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:56:34.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:56:34.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:56:34.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:56:34.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:56:34.757 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:56:34.757 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:56:34.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:56:34.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:56:34.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:56:34.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:56:35.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:56:35.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:56:35.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:56:35.141 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:56:35.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:56:35.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:56:35.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:56:35.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:56:35.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:56:35.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:56:35.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:56:35.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:56:35.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:56:36.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:56:36.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:56:36.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:56:36.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:56:36.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:56:36.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:56:36.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:56:36.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:56:36.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:56:36.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:56:36.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:56:36.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:56:36.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:56:36.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:56:36.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:56:36.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:56:36.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:56:37.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:56:37.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:56:37.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:56:37.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:56:37.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:56:37.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:56:37.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:56:37.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:56:37.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:56:37.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:56:37.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:56:37.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:56:37.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:56:37.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:56:37.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:56:37.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:56:37.813 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:56:37.814 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:56:37.814 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:56:37.814 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:56:37.814 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:56:37.814 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:56:38.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:56:38.197 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:56:38.197 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:56:38.198 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:56:38.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:56:38.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:56:38.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:56:38.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:56:38.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:56:38.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:56:38.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:56:38.719 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:56:38.719 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:56:39.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=6 2020-09-08T16:56:39.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 6 '!=' null 2020-09-08T16:56:39.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:56:39.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:56:39.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:56:39.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:56:39.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:56:39.373 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:56:39.373 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:56:39.373 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:56:39.374 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:56:39.374 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:56:39.374 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:56:39.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:56:39.757 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:56:39.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:56:39.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:56:40.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:56:40.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:56:40.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:56:40.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:56:40.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:56:40.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:56:40.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:56:40.280 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:56:40.280 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:56:40.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:56:40.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:56:40.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:56:40.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:56:40.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:56:40.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:56:40.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:56:40.897 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:56:40.898 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:56:40.898 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:56:40.898 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:56:40.898 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:56:40.898 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:56:41.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T16:56:41.282 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:56:41.283 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:56:41.283 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:56:41.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T16:56:41.816 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:56:41.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:56:41.817 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:494: TEST_backfill_remapped: expr 200 '*' 2 2020-09-08T16:56:41.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:494: TEST_backfill_remapped: local misplaced=400 2020-09-08T16:56:41.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:496: TEST_backfill_remapped: check td/osd-backfill-stats 1.0 0 replicated 0 0 400 200 '' '' false 2020-09-08T16:56:41.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2020-09-08T16:56:41.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:64: check: local PG=1.0 2020-09-08T16:56:41.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:65: check: local primary=0 2020-09-08T16:56:41.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:66: check: local type=replicated 2020-09-08T16:56:41.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:67: check: local degraded_start=0 2020-09-08T16:56:41.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:68: check: local degraded_end=0 2020-09-08T16:56:41.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:69: check: local misplaced_start=400 2020-09-08T16:56:41.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:70: check: local misplaced_end=200 2020-09-08T16:56:41.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:71: check: local primary_start= 2020-09-08T16:56:41.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:72: check: local primary_end= 2020-09-08T16:56:41.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:73: check: local check_setup=false 2020-09-08T16:56:41.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log 2020-09-08T16:56:41.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.0.log 2020-09-08T16:56:41.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:76: check: '[' false = true ']' 2020-09-08T16:56:41.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:86: check: local 'addp= ' 2020-09-08T16:56:41.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:87: check: '[' replicated = erasure ']' 2020-09-08T16:56:41.826 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2020-09-08T16:56:41.826 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats ' td/osd-backfill-stats/osd.0.log 2020-09-08T16:56:41.827 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: tail -1 2020-09-08T16:56:41.827 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2020-09-08T16:56:41.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: UPACT='[3]/[0,1]' 2020-09-08T16:56:41.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:93: check: '[' -n '[3]/[0,1]' ']' 2020-09-08T16:56:41.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:96: check: local which=degraded 2020-09-08T16:56:41.833 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:56:41.833 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.0.log 2020-09-08T16:56:41.833 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -F ' [3]/[0,1] ' 2020-09-08T16:56:41.833 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -v est 2020-09-08T16:56:41.834 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: head -1 2020-09-08T16:56:41.834 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:56:41.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: FIRST=0 2020-09-08T16:56:41.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:98: check: '[' -n 0 ']' 2020-09-08T16:56:41.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:99: check: below_margin 0 0 2020-09-08T16:56:41.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=0 2020-09-08T16:56:41.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T16:56:41.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=0 2020-09-08T16:56:41.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T16:56:41.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:56:41.839 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.0.log 2020-09-08T16:56:41.839 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: tail -1 2020-09-08T16:56:41.839 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:56:41.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: LAST=0 2020-09-08T16:56:41.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:101: check: '[' -n 0 ']' 2020-09-08T16:56:41.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:102: check: above_margin 0 0 2020-09-08T16:56:41.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=0 2020-09-08T16:56:41.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T16:56:41.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=0 2020-09-08T16:56:41.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T16:56:41.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:105: check: which=misplaced 2020-09-08T16:56:41.844 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:56:41.845 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.0.log 2020-09-08T16:56:41.845 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -F ' [3]/[0,1] ' 2020-09-08T16:56:41.845 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -v est 2020-09-08T16:56:41.847 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: head -1 2020-09-08T16:56:41.847 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:56:41.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: FIRST=400 2020-09-08T16:56:41.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:107: check: '[' -n 400 ']' 2020-09-08T16:56:41.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:108: check: below_margin 400 400 2020-09-08T16:56:41.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=400 2020-09-08T16:56:41.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T16:56:41.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=400 2020-09-08T16:56:41.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T16:56:41.850 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:56:41.850 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.0.log 2020-09-08T16:56:41.850 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: tail -1 2020-09-08T16:56:41.850 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:56:41.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: LAST=201 2020-09-08T16:56:41.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:110: check: '[' -n 201 ']' 2020-09-08T16:56:41.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:111: check: above_margin 201 200 2020-09-08T16:56:41.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=201 2020-09-08T16:56:41.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T16:56:41.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=200 2020-09-08T16:56:41.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T16:56:41.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2020-09-08T16:56:41.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:498: TEST_backfill_remapped: delete_pool test 2020-09-08T16:56:41.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test 2020-09-08T16:56:41.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2020-09-08T16:56:42.376 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' does not exist 2020-09-08T16:56:42.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:499: TEST_backfill_remapped: kill_daemons td/osd-backfill-stats 2020-09-08T16:56:42.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:56:42.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:56:42.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:56:42.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:56:42.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:56:42.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:56:42.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2020-09-08T16:56:42.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T16:56:42.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:56:42.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T16:56:42.496 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:56:42.496 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:56:42.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:56:42.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:56:42.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:56:42.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:56:42.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:56:42.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:56:42.501 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:56:42.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:56:42.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:56:42.502 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:56:42.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:56:42.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:56:42.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:56:42.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:56:42.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:56:42.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:56:42.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T16:56:42.519 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:56:42.519 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:56:42.519 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:56:42.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T16:56:42.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:56:42.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:56:42.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:35: run: for func in $funcs 2020-09-08T16:56:42.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2020-09-08T16:56:42.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2020-09-08T16:56:42.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2020-09-08T16:56:42.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T16:56:42.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:56:42.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T16:56:42.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:56:42.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:56:42.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:56:42.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:56:42.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:56:42.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:56:42.525 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:56:42.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:56:42.525 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:56:42.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:56:42.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:56:42.526 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:56:42.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:56:42.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:56:42.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:56:42.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:56:42.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:56:42.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:56:42.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T16:56:42.529 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:56:42.530 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:56:42.530 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:56:42.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T16:56:42.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:56:42.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:56:42.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2020-09-08T16:56:42.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T16:56:42.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:56:42.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:56:42.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.482138 2020-09-08T16:56:42.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T16:56:42.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T16:56:42.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T16:56:42.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2020-09-08T16:56:42.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:37: run: TEST_backfill_sizeup td/osd-backfill-stats 2020-09-08T16:56:42.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:133: TEST_backfill_sizeup: local dir=td/osd-backfill-stats 2020-09-08T16:56:42.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:135: TEST_backfill_sizeup: run_mon td/osd-backfill-stats a 2020-09-08T16:56:42.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2020-09-08T16:56:42.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T16:56:42.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T16:56:42.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T16:56:42.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2020-09-08T16:56:42.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2020-09-08T16:56:42.830 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T16:56:42.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:56:42.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:56:42.831 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:56:42.831 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:56:42.831 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:56:42.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:56:42.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T16:56:43.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T16:56:43.016 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T16:56:43.016 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:56:43.017 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:56:43.017 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T16:56:43.017 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T16:56:43.017 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:56:43.017 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:56:43.018 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:56:43.018 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:56:43.018 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:56:43.018 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:56:43.018 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T16:56:43.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:56:43.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get fsid 2020-09-08T16:56:43.110 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T16:56:43.110 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:56:43.110 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:56:43.111 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T16:56:43.111 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T16:56:43.111 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:56:43.111 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:56:43.112 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:56:43.112 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:56:43.112 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:56:43.112 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:56:43.112 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T16:56:43.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:56:43.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get mon_host 2020-09-08T16:56:43.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:136: TEST_backfill_sizeup: run_mgr td/osd-backfill-stats x 2020-09-08T16:56:43.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-stats 2020-09-08T16:56:43.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T16:56:43.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T16:56:43.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T16:56:43.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-stats/x 2020-09-08T16:56:43.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T16:56:44.094 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T16:56:44.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:56:44.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:56:44.099 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:56:44.099 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:56:44.099 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:56:44.100 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:56:44.100 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:56:44.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:56:44.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:137: TEST_backfill_sizeup: export CEPH_ARGS 2020-09-08T16:56:44.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:138: TEST_backfill_sizeup: run_osd td/osd-backfill-stats 0 2020-09-08T16:56:44.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:56:44.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:56:44.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T16:56:44.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:56:44.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/0 2020-09-08T16:56:44.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:56:44.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:56:44.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:56:44.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:56:44.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2020-09-08T16:56:44.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2020-09-08T16:56:44.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:56:44.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:56:44.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:56:44.123 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:56:44.124 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:56:44.124 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:56:44.124 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:56:44.124 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:56:44.124 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:56:44.125 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:56:44.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:56:44.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:56:44.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:56:44.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:56:44.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:56:44.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:56:44.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:56:44.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:56:44.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:56:44.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:56:44.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:56:44.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/0 2020-09-08T16:56:44.127 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:56:44.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=d849b92a-2ef1-41ed-9bda-588e34a861ca 2020-09-08T16:56:44.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 d849b92a-2ef1-41ed-9bda-588e34a861ca' 2020-09-08T16:56:44.129 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:56:44.129 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 d849b92a-2ef1-41ed-9bda-588e34a861ca 2020-09-08T16:56:44.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDMt1dfgxyuCBAALCutWzil7mL6RY+Wl9HrJw== 2020-09-08T16:56:44.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDMt1dfgxyuCBAALCutWzil7mL6RY+Wl9HrJw=="}' 2020-09-08T16:56:44.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new d849b92a-2ef1-41ed-9bda-588e34a861ca -i td/osd-backfill-stats/0/new.json 2020-09-08T16:56:44.478 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:56:44.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/0/new.json 2020-09-08T16:56:44.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDMt1dfgxyuCBAALCutWzil7mL6RY+Wl9HrJw== --osd-uuid d849b92a-2ef1-41ed-9bda-588e34a861ca 2020-09-08T16:56:44.515 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:44.519+0000 7f4ad9c76ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:56:44.516 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:44.521+0000 7f4ad9c76ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:56:44.518 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:44.523+0000 7f4ad9c76ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:56:44.519 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:44.523+0000 7f4ad9c76ec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:56:44.519 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:44.523+0000 7f4ad9c76ec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:56:44.519 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:44.523+0000 7f4ad9c76ec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:56:44.581 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:44.585+0000 7f4ad9c76ec0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2020-09-08T16:56:48.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2020-09-08T16:56:48.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:56:48.799 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T16:56:48.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T16:56:48.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:56:49.344 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T16:56:49.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T16:56:49.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:56:49.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:56:49.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:56:49.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:56:49.367 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:49.372+0000 7f7821ec2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:56:49.387 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:49.391+0000 7f7821ec2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:56:49.389 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:49.393+0000 7f7821ec2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:56:49.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T16:56:49.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:56:49.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T16:56:49.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:56:49.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:56:49.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:56:49.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:56:49.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:56:49.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:56:49.737 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:56:49.904 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:49.909+0000 7f7821ec2ec0 -1 Falling back to public interface 2020-09-08T16:56:50.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:56:50.696 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:50.701+0000 7f7821ec2ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T16:56:51.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:56:51.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:56:51.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:56:51.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:56:51.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:56:51.166 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:56:51.572 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/587143,v1:127.0.0.1:6803/587143] [v2:127.0.0.1:6804/587143,v1:127.0.0.1:6805/587143] exists,up d849b92a-2ef1-41ed-9bda-588e34a861ca 2020-09-08T16:56:51.573 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 114b79f6-625f-4fa4-94f2-88cf5383c133 2020-09-08T16:56:51.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:56:51.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:56:51.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:56:51.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:139: TEST_backfill_sizeup: run_osd td/osd-backfill-stats 1 2020-09-08T16:56:51.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:56:51.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:56:51.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T16:56:51.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:56:51.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/1 2020-09-08T16:56:51.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:56:51.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:56:51.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:56:51.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:56:51.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2020-09-08T16:56:51.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2020-09-08T16:56:51.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:56:51.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:56:51.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:56:51.577 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:56:51.577 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:56:51.577 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:56:51.577 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:56:51.577 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:56:51.578 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:56:51.578 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:56:51.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:56:51.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:56:51.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:56:51.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:56:51.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:56:51.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:56:51.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:56:51.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:56:51.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:56:51.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:56:51.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:56:51.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/1 2020-09-08T16:56:51.580 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:56:51.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=114b79f6-625f-4fa4-94f2-88cf5383c133 2020-09-08T16:56:51.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 114b79f6-625f-4fa4-94f2-88cf5383c133' 2020-09-08T16:56:51.581 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:56:51.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDTt1dfYGJbIxAAAN/Av7Ua/qblqwgIXCZOHw== 2020-09-08T16:56:51.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDTt1dfYGJbIxAAAN/Av7Ua/qblqwgIXCZOHw=="}' 2020-09-08T16:56:51.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 114b79f6-625f-4fa4-94f2-88cf5383c133 -i td/osd-backfill-stats/1/new.json 2020-09-08T16:56:52.221 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:56:52.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/1/new.json 2020-09-08T16:56:52.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDTt1dfYGJbIxAAAN/Av7Ua/qblqwgIXCZOHw== --osd-uuid 114b79f6-625f-4fa4-94f2-88cf5383c133 2020-09-08T16:56:52.257 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:52.262+0000 7fdb93ba5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:56:52.259 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:52.264+0000 7fdb93ba5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:56:52.261 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:52.266+0000 7fdb93ba5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:56:52.261 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:52.266+0000 7fdb93ba5ec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:56:52.262 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:52.266+0000 7fdb93ba5ec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:56:52.262 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:52.266+0000 7fdb93ba5ec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:56:52.310 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:52.316+0000 7fdb93ba5ec0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2020-09-08T16:56:56.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2020-09-08T16:56:56.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:56:56.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T16:56:56.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:56:56.577 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T16:56:57.107 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T16:56:57.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T16:56:57.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:56:57.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:56:57.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:56:57.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:56:57.131 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:57.136+0000 7f0993961ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:56:57.217 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:57.222+0000 7f0993961ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:56:57.219 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:57.224+0000 7f0993961ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:56:57.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T16:56:57.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:56:57.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T16:56:57.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:56:57.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:56:57.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:56:57.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:56:57.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:56:57.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:56:57.524 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:56:57.735 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:57.740+0000 7f0993961ec0 -1 Falling back to public interface 2020-09-08T16:56:57.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:56:58.526 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:58.530+0000 7f0993961ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T16:56:58.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:56:58.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:56:58.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:56:58.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:56:58.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:56:58.945 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:56:59.344 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/588155,v1:127.0.0.1:6811/588155] [v2:127.0.0.1:6812/588155,v1:127.0.0.1:6813/588155] exists,up 114b79f6-625f-4fa4-94f2-88cf5383c133 2020-09-08T16:56:59.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:56:59.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:56:59.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:56:59.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:140: TEST_backfill_sizeup: run_osd td/osd-backfill-stats 2 2020-09-08T16:56:59.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:56:59.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:56:59.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T16:56:59.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:56:59.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/2 2020-09-08T16:56:59.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:56:59.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:56:59.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:56:59.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:56:59.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2020-09-08T16:56:59.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2020-09-08T16:56:59.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:56:59.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:56:59.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:56:59.348 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:56:59.348 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:56:59.348 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:56:59.348 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:56:59.349 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:56:59.349 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:56:59.349 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:56:59.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:56:59.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:56:59.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:56:59.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:56:59.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:56:59.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:56:59.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:56:59.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:56:59.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:56:59.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:56:59.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:56:59.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/2 2020-09-08T16:56:59.352 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:56:59.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=6e831f75-bd0b-49bc-88bc-4fb3bd9f5dd7 2020-09-08T16:56:59.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 6e831f75-bd0b-49bc-88bc-4fb3bd9f5dd7' 2020-09-08T16:56:59.353 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:56:59.353 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 6e831f75-bd0b-49bc-88bc-4fb3bd9f5dd7 2020-09-08T16:56:59.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDbt1dfbsPJFRAAzfJYCUker1Iubfl2OMSHpw== 2020-09-08T16:56:59.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDbt1dfbsPJFRAAzfJYCUker1Iubfl2OMSHpw=="}' 2020-09-08T16:56:59.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 6e831f75-bd0b-49bc-88bc-4fb3bd9f5dd7 -i td/osd-backfill-stats/2/new.json 2020-09-08T16:56:59.907 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:56:59.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/2/new.json 2020-09-08T16:56:59.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDbt1dfbsPJFRAAzfJYCUker1Iubfl2OMSHpw== --osd-uuid 6e831f75-bd0b-49bc-88bc-4fb3bd9f5dd7 2020-09-08T16:56:59.943 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:59.948+0000 7f02c1703ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:56:59.945 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:59.950+0000 7f02c1703ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:56:59.946 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:59.951+0000 7f02c1703ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:56:59.947 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:59.951+0000 7f02c1703ec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:56:59.947 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:59.951+0000 7f02c1703ec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:56:59.947 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:56:59.951+0000 7f02c1703ec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:56:59.999 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:00.004+0000 7f02c1703ec0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2020-09-08T16:57:04.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2020-09-08T16:57:04.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:57:04.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T16:57:04.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:57:04.261 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T16:57:04.789 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T16:57:04.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T16:57:04.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:57:04.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:57:04.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:57:04.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:57:04.812 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:04.817+0000 7fbe65c8dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:57:04.825 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:04.830+0000 7fbe65c8dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:57:04.826 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:04.831+0000 7fbe65c8dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:57:05.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T16:57:05.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:57:05.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T16:57:05.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:57:05.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:57:05.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:57:05.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:57:05.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:57:05.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:57:05.182 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:57:05.344 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:05.348+0000 7fbe65c8dec0 -1 Falling back to public interface 2020-09-08T16:57:05.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:57:06.168 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:06.172+0000 7fbe65c8dec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T16:57:06.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:57:06.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:57:06.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:57:06.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:57:06.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:57:06.591 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:57:07.000 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/589131,v1:127.0.0.1:6819/589131] [v2:127.0.0.1:6820/589131,v1:127.0.0.1:6821/589131] exists,up 6e831f75-bd0b-49bc-88bc-4fb3bd9f5dd7 2020-09-08T16:57:07.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:57:07.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:57:07.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:57:07.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:141: TEST_backfill_sizeup: run_osd td/osd-backfill-stats 3 2020-09-08T16:57:07.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:57:07.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:57:07.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T16:57:07.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:57:07.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/3 2020-09-08T16:57:07.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:57:07.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:57:07.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:57:07.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:57:07.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2020-09-08T16:57:07.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2020-09-08T16:57:07.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:57:07.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:57:07.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:57:07.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:57:07.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:57:07.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:57:07.005 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:57:07.005 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:57:07.006 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:57:07.006 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:57:07.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:57:07.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:57:07.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:57:07.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:57:07.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:57:07.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:57:07.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:57:07.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:57:07.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:57:07.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:57:07.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:57:07.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/3 2020-09-08T16:57:07.009 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:57:07.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=0a610dc3-857c-4506-a1ab-f95ad0059c76 2020-09-08T16:57:07.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 0a610dc3-857c-4506-a1ab-f95ad0059c76' 2020-09-08T16:57:07.010 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:57:07.010 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 0a610dc3-857c-4506-a1ab-f95ad0059c76 2020-09-08T16:57:07.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDjt1df085SARAAdU7AUc7cR2mWEeNmlfEXzw== 2020-09-08T16:57:07.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDjt1df085SARAAdU7AUc7cR2mWEeNmlfEXzw=="}' 2020-09-08T16:57:07.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 0a610dc3-857c-4506-a1ab-f95ad0059c76 -i td/osd-backfill-stats/3/new.json 2020-09-08T16:57:07.608 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T16:57:07.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/3/new.json 2020-09-08T16:57:07.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDjt1df085SARAAdU7AUc7cR2mWEeNmlfEXzw== --osd-uuid 0a610dc3-857c-4506-a1ab-f95ad0059c76 2020-09-08T16:57:07.644 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:07.648+0000 7f410213bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:57:07.645 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:07.649+0000 7f410213bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:57:07.647 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:07.651+0000 7f410213bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:57:07.648 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:07.652+0000 7f410213bec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:57:07.648 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:07.652+0000 7f410213bec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:57:07.648 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:07.652+0000 7f410213bec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:57:07.683 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:07.688+0000 7f410213bec0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2020-09-08T16:57:11.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2020-09-08T16:57:11.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:57:11.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T16:57:11.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:57:11.877 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T16:57:12.412 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T16:57:12.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T16:57:12.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:57:12.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:57:12.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:57:12.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:57:12.435 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:12.440+0000 7fab1698fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:57:12.436 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:12.442+0000 7fab1698fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:57:12.438 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:12.443+0000 7fab1698fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:57:12.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T16:57:12.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:57:12.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T16:57:12.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:57:12.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:57:12.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:57:12.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:57:12.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:57:12.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:57:12.832 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:57:12.953 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:12.957+0000 7fab1698fec0 -1 Falling back to public interface 2020-09-08T16:57:13.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:57:13.742 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:13.747+0000 7fab1698fec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T16:57:14.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:57:14.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:57:14.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:57:14.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:57:14.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:57:14.259 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:57:14.778 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/590125,v1:127.0.0.1:6827/590125] [v2:127.0.0.1:6828/590125,v1:127.0.0.1:6829/590125] exists,up 0a610dc3-857c-4506-a1ab-f95ad0059c76 2020-09-08T16:57:14.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:57:14.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:57:14.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:57:14.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:142: TEST_backfill_sizeup: run_osd td/osd-backfill-stats 4 2020-09-08T16:57:14.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:57:14.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:57:14.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=4 2020-09-08T16:57:14.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:57:14.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/4 2020-09-08T16:57:14.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:57:14.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:57:14.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:57:14.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:57:14.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2020-09-08T16:57:14.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2020-09-08T16:57:14.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:57:14.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:57:14.782 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:57:14.782 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:57:14.782 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:57:14.782 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:57:14.783 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:57:14.783 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:57:14.783 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:57:14.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:57:14.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:57:14.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:57:14.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:57:14.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:57:14.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:57:14.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:57:14.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:57:14.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:57:14.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:57:14.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:57:14.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:57:14.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/4 2020-09-08T16:57:14.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:57:14.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=5fd6af65-d171-4bc1-93ed-7a25ae1a9d7f 2020-09-08T16:57:14.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd4 5fd6af65-d171-4bc1-93ed-7a25ae1a9d7f' 2020-09-08T16:57:14.787 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:57:14.787 INFO:tasks.workunit.client.0.smithi065.stdout:add osd4 5fd6af65-d171-4bc1-93ed-7a25ae1a9d7f 2020-09-08T16:57:14.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDqt1dfjbmqLxAA/tLEdzY20YVmryUy1TjGPw== 2020-09-08T16:57:14.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDqt1dfjbmqLxAA/tLEdzY20YVmryUy1TjGPw=="}' 2020-09-08T16:57:14.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 5fd6af65-d171-4bc1-93ed-7a25ae1a9d7f -i td/osd-backfill-stats/4/new.json 2020-09-08T16:57:15.382 INFO:tasks.workunit.client.0.smithi065.stdout:4 2020-09-08T16:57:15.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/4/new.json 2020-09-08T16:57:15.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 4 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDqt1dfjbmqLxAA/tLEdzY20YVmryUy1TjGPw== --osd-uuid 5fd6af65-d171-4bc1-93ed-7a25ae1a9d7f 2020-09-08T16:57:15.419 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:15.423+0000 7f27aa1f5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:57:15.420 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:15.425+0000 7f27aa1f5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:57:15.422 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:15.426+0000 7f27aa1f5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:57:15.423 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:15.428+0000 7f27aa1f5ec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:57:15.423 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:15.428+0000 7f27aa1f5ec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:57:15.423 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:15.428+0000 7f27aa1f5ec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:57:15.500 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:15.505+0000 7f27aa1f5ec0 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2020-09-08T16:57:19.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2020-09-08T16:57:19.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:57:19.712 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd4 key to auth repository 2020-09-08T16:57:19.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd4 key to auth repository 2020-09-08T16:57:19.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:57:20.272 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.4 2020-09-08T16:57:20.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.4 2020-09-08T16:57:20.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 4 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:57:20.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:57:20.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:57:20.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:57:20.292 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:20.297+0000 7f3ee525cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:57:20.294 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:20.299+0000 7f3ee525cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:57:20.295 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:20.300+0000 7f3ee525cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:57:20.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 4 2020-09-08T16:57:20.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:57:20.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=4 2020-09-08T16:57:20.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:57:20.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:57:20.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:57:20.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:57:20.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:57:20.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:57:20.664 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:57:20.815 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:20.816+0000 7f3ee525cec0 -1 Falling back to public interface 2020-09-08T16:57:21.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:57:21.644 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:21.648+0000 7f3ee525cec0 -1 osd.4 0 log_to_monitors {default=true} 2020-09-08T16:57:22.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:57:22.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:57:22.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:57:22.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:57:22.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:57:22.068 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:57:22.519 INFO:tasks.workunit.client.0.smithi065.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/591119,v1:127.0.0.1:6835/591119] [v2:127.0.0.1:6836/591119,v1:127.0.0.1:6837/591119] exists,up 5fd6af65-d171-4bc1-93ed-7a25ae1a9d7f 2020-09-08T16:57:22.519 INFO:tasks.workunit.client.0.smithi065.stdout:add osd5 2d848ff5-199e-4db1-be6b-388e1efd4f06 2020-09-08T16:57:22.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:57:22.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:57:22.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:57:22.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:143: TEST_backfill_sizeup: run_osd td/osd-backfill-stats 5 2020-09-08T16:57:22.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:57:22.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:57:22.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=5 2020-09-08T16:57:22.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:57:22.521 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/5 2020-09-08T16:57:22.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:57:22.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:57:22.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:57:22.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:57:22.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/5' 2020-09-08T16:57:22.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/5/journal' 2020-09-08T16:57:22.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:57:22.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:57:22.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:57:22.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:57:22.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:57:22.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:57:22.524 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:57:22.524 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:57:22.524 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:57:22.525 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:57:22.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:57:22.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:57:22.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:57:22.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:57:22.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:57:22.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:57:22.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:57:22.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:57:22.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:57:22.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:57:22.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:57:22.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/5 2020-09-08T16:57:22.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:57:22.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=2d848ff5-199e-4db1-be6b-388e1efd4f06 2020-09-08T16:57:22.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd5 2d848ff5-199e-4db1-be6b-388e1efd4f06' 2020-09-08T16:57:22.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:57:22.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDyt1dfYSr/HxAApgeKr+Z3/b/93G+Z0Klr3g== 2020-09-08T16:57:22.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDyt1dfYSr/HxAApgeKr+Z3/b/93G+Z0Klr3g=="}' 2020-09-08T16:57:22.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 2d848ff5-199e-4db1-be6b-388e1efd4f06 -i td/osd-backfill-stats/5/new.json 2020-09-08T16:57:23.090 INFO:tasks.workunit.client.0.smithi065.stdout:5 2020-09-08T16:57:23.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/5/new.json 2020-09-08T16:57:23.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 5 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDyt1dfYSr/HxAApgeKr+Z3/b/93G+Z0Klr3g== --osd-uuid 2d848ff5-199e-4db1-be6b-388e1efd4f06 2020-09-08T16:57:23.126 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:23.131+0000 7fc853d80ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:57:23.127 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:23.132+0000 7fc853d80ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:57:23.128 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:23.133+0000 7fc853d80ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:57:23.130 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:23.134+0000 7fc853d80ec0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2020-09-08T16:57:23.130 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:23.134+0000 7fc853d80ec0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2020-09-08T16:57:23.131 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:23.134+0000 7fc853d80ec0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2020-09-08T16:57:23.176 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:23.181+0000 7fc853d80ec0 -1 bluestore(td/osd-backfill-stats/5) _read_fsid unparsable uuid 2020-09-08T16:57:27.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/5/keyring 2020-09-08T16:57:27.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:57:27.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd5 key to auth repository 2020-09-08T16:57:27.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:57:27.655 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd5 key to auth repository 2020-09-08T16:57:28.186 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.5 2020-09-08T16:57:28.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.5 2020-09-08T16:57:28.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 5 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:57:28.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:57:28.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:57:28.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:57:28.209 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:28.214+0000 7f103ea8fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:57:28.211 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:28.216+0000 7f103ea8fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:57:28.212 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:28.217+0000 7f103ea8fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:57:28.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 5 2020-09-08T16:57:28.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:57:28.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=5 2020-09-08T16:57:28.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:57:28.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:57:28.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:57:28.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:57:28.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:57:28.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T16:57:28.585 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:57:28.733 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:28.738+0000 7f103ea8fec0 -1 Falling back to public interface 2020-09-08T16:57:28.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:57:29.488 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:57:29.490+0000 7f103ea8fec0 -1 osd.5 0 log_to_monitors {default=true} 2020-09-08T16:57:29.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:57:29.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:57:29.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:57:29.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T16:57:29.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:57:29.990 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:57:30.399 INFO:tasks.workunit.client.0.smithi065.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/592114,v1:127.0.0.1:6843/592114] [v2:127.0.0.1:6844/592114,v1:127.0.0.1:6845/592114] exists,up 2d848ff5-199e-4db1-be6b-388e1efd4f06 2020-09-08T16:57:30.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:57:30.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:57:30.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:57:30.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:145: TEST_backfill_sizeup: create_pool test 1 1 2020-09-08T16:57:30.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test 1 1 2020-09-08T16:57:30.953 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' already exists 2020-09-08T16:57:30.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:57:31.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:146: TEST_backfill_sizeup: ceph osd pool set test size 1 --yes-i-really-mean-it 2020-09-08T16:57:32.930 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 1 2020-09-08T16:57:32.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:148: TEST_backfill_sizeup: wait_for_clean 2020-09-08T16:57:32.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:57:32.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:57:32.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:57:32.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:57:32.941 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:57:32.941 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:57:32.942 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:57:32.942 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:57:32.942 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:57:32.942 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:57:33.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:57:33.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:57:33.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:57:33.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:57:33.037 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:57:33.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:57:33.512 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:57:33.513 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:57:33.513 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:57:33.513 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T16:57:33.513 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T16:57:33.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:57:33.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:57:33.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:57:33.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836491 2020-09-08T16:57:33.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836491 2020-09-08T16:57:33.643 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491' 2020-09-08T16:57:33.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:57:33.644 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:57:33.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672969 2020-09-08T16:57:33.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672969 2020-09-08T16:57:33.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969' 2020-09-08T16:57:33.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:57:33.775 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:57:33.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509448 2020-09-08T16:57:33.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509448 2020-09-08T16:57:33.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969 2-64424509448' 2020-09-08T16:57:33.905 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:57:33.905 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:57:34.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345926 2020-09-08T16:57:34.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345926 2020-09-08T16:57:34.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969 2-64424509448 3-85899345926' 2020-09-08T16:57:34.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:57:34.037 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:57:34.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182406 2020-09-08T16:57:34.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182406 2020-09-08T16:57:34.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969 2-64424509448 3-85899345926 4-107374182406' 2020-09-08T16:57:34.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:57:34.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T16:57:34.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018883 2020-09-08T16:57:34.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018883 2020-09-08T16:57:34.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969 2-64424509448 3-85899345926 4-107374182406 5-128849018883' 2020-09-08T16:57:34.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:57:34.297 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836491 2020-09-08T16:57:34.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:57:34.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:57:34.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836491 2020-09-08T16:57:34.298 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:57:34.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836491 2020-09-08T16:57:34.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2020-09-08T16:57:34.300 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:57:34.300 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836491 2020-09-08T16:57:34.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836491 -lt 21474836491 2020-09-08T16:57:34.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:57:34.692 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672969 2020-09-08T16:57:34.692 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:57:34.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:57:34.693 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672969 2020-09-08T16:57:34.694 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:57:34.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672969 2020-09-08T16:57:34.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672969' 2020-09-08T16:57:34.695 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:57:34.695 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672969 2020-09-08T16:57:35.106 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672969 -lt 42949672969 2020-09-08T16:57:35.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:57:35.107 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509448 2020-09-08T16:57:35.107 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:57:35.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:57:35.108 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509448 2020-09-08T16:57:35.108 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:57:35.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509448 2020-09-08T16:57:35.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509448' 2020-09-08T16:57:35.110 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:57:35.110 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509448 2020-09-08T16:57:35.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509447 -lt 64424509448 2020-09-08T16:57:35.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:57:36.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:57:36.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:57:36.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509448 -lt 64424509448 2020-09-08T16:57:36.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:57:36.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345926 2020-09-08T16:57:36.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:57:36.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:57:36.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345926 2020-09-08T16:57:36.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:57:36.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345926 2020-09-08T16:57:36.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345926' 2020-09-08T16:57:36.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:57:36.932 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345926 2020-09-08T16:57:37.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345927 -lt 85899345926 2020-09-08T16:57:37.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:57:37.342 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182406 2020-09-08T16:57:37.342 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:57:37.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:57:37.343 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182406 2020-09-08T16:57:37.343 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:57:37.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182406 2020-09-08T16:57:37.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182406' 2020-09-08T16:57:37.345 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:57:37.345 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182406 2020-09-08T16:57:37.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182406 -lt 107374182406 2020-09-08T16:57:37.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:57:37.748 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018883 2020-09-08T16:57:37.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:57:37.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T16:57:37.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018883 2020-09-08T16:57:37.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:57:37.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018883 2020-09-08T16:57:37.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018883' 2020-09-08T16:57:37.751 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T16:57:37.751 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018883 2020-09-08T16:57:38.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018884 -lt 128849018883 2020-09-08T16:57:38.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:57:38.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:57:38.162 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:57:38.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T16:57:38.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:57:38.680 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:57:38.680 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:57:38.680 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:57:38.681 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:57:38.681 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:57:38.681 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:57:39.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T16:57:39.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:57:39.059 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:57:39.059 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:57:39.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T16:57:39.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:57:39.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:57:39.578 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: seq 1 200 2020-09-08T16:57:39.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:39.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj1 /dev/null 2020-09-08T16:57:39.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:39.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj2 /dev/null 2020-09-08T16:57:39.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:39.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj3 /dev/null 2020-09-08T16:57:39.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:39.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj4 /dev/null 2020-09-08T16:57:39.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:39.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj5 /dev/null 2020-09-08T16:57:39.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:39.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj6 /dev/null 2020-09-08T16:57:39.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:39.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj7 /dev/null 2020-09-08T16:57:40.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:40.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj8 /dev/null 2020-09-08T16:57:40.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:40.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj9 /dev/null 2020-09-08T16:57:40.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:40.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj10 /dev/null 2020-09-08T16:57:40.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:40.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj11 /dev/null 2020-09-08T16:57:40.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:40.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj12 /dev/null 2020-09-08T16:57:40.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:40.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj13 /dev/null 2020-09-08T16:57:40.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:40.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj14 /dev/null 2020-09-08T16:57:40.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:40.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj15 /dev/null 2020-09-08T16:57:40.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:40.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj16 /dev/null 2020-09-08T16:57:40.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:40.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj17 /dev/null 2020-09-08T16:57:40.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:40.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj18 /dev/null 2020-09-08T16:57:40.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:40.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj19 /dev/null 2020-09-08T16:57:40.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:40.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj20 /dev/null 2020-09-08T16:57:40.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:40.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj21 /dev/null 2020-09-08T16:57:40.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:40.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj22 /dev/null 2020-09-08T16:57:41.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:41.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj23 /dev/null 2020-09-08T16:57:41.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:41.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj24 /dev/null 2020-09-08T16:57:41.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:41.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj25 /dev/null 2020-09-08T16:57:41.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:41.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj26 /dev/null 2020-09-08T16:57:41.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:41.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj27 /dev/null 2020-09-08T16:57:41.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:41.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj28 /dev/null 2020-09-08T16:57:41.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:41.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj29 /dev/null 2020-09-08T16:57:41.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:41.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj30 /dev/null 2020-09-08T16:57:41.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:41.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj31 /dev/null 2020-09-08T16:57:41.572 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:41.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj32 /dev/null 2020-09-08T16:57:41.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:41.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj33 /dev/null 2020-09-08T16:57:41.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:41.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj34 /dev/null 2020-09-08T16:57:41.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:41.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj35 /dev/null 2020-09-08T16:57:41.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:41.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj36 /dev/null 2020-09-08T16:57:41.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:41.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj37 /dev/null 2020-09-08T16:57:41.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:41.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj38 /dev/null 2020-09-08T16:57:42.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:42.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj39 /dev/null 2020-09-08T16:57:42.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:42.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj40 /dev/null 2020-09-08T16:57:42.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:42.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj41 /dev/null 2020-09-08T16:57:42.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:42.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj42 /dev/null 2020-09-08T16:57:42.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:42.317 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj43 /dev/null 2020-09-08T16:57:42.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:42.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj44 /dev/null 2020-09-08T16:57:42.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:42.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj45 /dev/null 2020-09-08T16:57:42.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:42.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj46 /dev/null 2020-09-08T16:57:42.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:42.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj47 /dev/null 2020-09-08T16:57:42.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:42.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj48 /dev/null 2020-09-08T16:57:42.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:42.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj49 /dev/null 2020-09-08T16:57:42.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:42.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj50 /dev/null 2020-09-08T16:57:42.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:42.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj51 /dev/null 2020-09-08T16:57:42.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:42.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj52 /dev/null 2020-09-08T16:57:42.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:42.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj53 /dev/null 2020-09-08T16:57:42.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:42.994 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj54 /dev/null 2020-09-08T16:57:43.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:43.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj55 /dev/null 2020-09-08T16:57:43.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:43.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj56 /dev/null 2020-09-08T16:57:43.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:43.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj57 /dev/null 2020-09-08T16:57:43.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:43.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj58 /dev/null 2020-09-08T16:57:43.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:43.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj59 /dev/null 2020-09-08T16:57:43.395 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:43.396 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj60 /dev/null 2020-09-08T16:57:43.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:43.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj61 /dev/null 2020-09-08T16:57:43.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:43.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj62 /dev/null 2020-09-08T16:57:43.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:43.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj63 /dev/null 2020-09-08T16:57:43.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:43.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj64 /dev/null 2020-09-08T16:57:43.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:43.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj65 /dev/null 2020-09-08T16:57:43.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:43.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj66 /dev/null 2020-09-08T16:57:43.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:43.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj67 /dev/null 2020-09-08T16:57:43.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:43.906 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj68 /dev/null 2020-09-08T16:57:43.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:43.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj69 /dev/null 2020-09-08T16:57:44.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:44.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj70 /dev/null 2020-09-08T16:57:44.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:44.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj71 /dev/null 2020-09-08T16:57:44.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:44.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj72 /dev/null 2020-09-08T16:57:44.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:44.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj73 /dev/null 2020-09-08T16:57:44.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:44.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj74 /dev/null 2020-09-08T16:57:44.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:44.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj75 /dev/null 2020-09-08T16:57:44.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:44.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj76 /dev/null 2020-09-08T16:57:44.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:44.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj77 /dev/null 2020-09-08T16:57:44.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:44.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj78 /dev/null 2020-09-08T16:57:44.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:44.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj79 /dev/null 2020-09-08T16:57:44.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:44.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj80 /dev/null 2020-09-08T16:57:44.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:44.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj81 /dev/null 2020-09-08T16:57:44.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:44.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj82 /dev/null 2020-09-08T16:57:44.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:44.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj83 /dev/null 2020-09-08T16:57:44.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:44.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj84 /dev/null 2020-09-08T16:57:45.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:45.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj85 /dev/null 2020-09-08T16:57:45.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:45.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj86 /dev/null 2020-09-08T16:57:45.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:45.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj87 /dev/null 2020-09-08T16:57:45.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:45.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj88 /dev/null 2020-09-08T16:57:45.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:45.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj89 /dev/null 2020-09-08T16:57:45.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:45.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj90 /dev/null 2020-09-08T16:57:45.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:45.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj91 /dev/null 2020-09-08T16:57:45.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:45.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj92 /dev/null 2020-09-08T16:57:45.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:45.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj93 /dev/null 2020-09-08T16:57:45.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:45.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj94 /dev/null 2020-09-08T16:57:45.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:45.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj95 /dev/null 2020-09-08T16:57:45.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:45.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj96 /dev/null 2020-09-08T16:57:45.787 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:45.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj97 /dev/null 2020-09-08T16:57:45.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:45.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj98 /dev/null 2020-09-08T16:57:45.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:45.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj99 /dev/null 2020-09-08T16:57:46.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:46.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj100 /dev/null 2020-09-08T16:57:46.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:46.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj101 /dev/null 2020-09-08T16:57:46.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:46.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj102 /dev/null 2020-09-08T16:57:46.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:46.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj103 /dev/null 2020-09-08T16:57:46.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:46.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj104 /dev/null 2020-09-08T16:57:46.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:46.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj105 /dev/null 2020-09-08T16:57:46.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:46.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj106 /dev/null 2020-09-08T16:57:46.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:46.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj107 /dev/null 2020-09-08T16:57:46.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:46.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj108 /dev/null 2020-09-08T16:57:46.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:46.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj109 /dev/null 2020-09-08T16:57:46.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:46.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj110 /dev/null 2020-09-08T16:57:46.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:46.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj111 /dev/null 2020-09-08T16:57:46.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:46.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj112 /dev/null 2020-09-08T16:57:46.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:46.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj113 /dev/null 2020-09-08T16:57:46.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:46.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj114 /dev/null 2020-09-08T16:57:46.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:46.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj115 /dev/null 2020-09-08T16:57:47.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:47.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj116 /dev/null 2020-09-08T16:57:47.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:47.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj117 /dev/null 2020-09-08T16:57:47.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:47.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj118 /dev/null 2020-09-08T16:57:47.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:47.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj119 /dev/null 2020-09-08T16:57:47.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:47.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj120 /dev/null 2020-09-08T16:57:47.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:47.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj121 /dev/null 2020-09-08T16:57:47.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:47.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj122 /dev/null 2020-09-08T16:57:47.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:47.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj123 /dev/null 2020-09-08T16:57:47.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:47.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj124 /dev/null 2020-09-08T16:57:47.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:47.594 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj125 /dev/null 2020-09-08T16:57:47.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:47.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj126 /dev/null 2020-09-08T16:57:47.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:47.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj127 /dev/null 2020-09-08T16:57:47.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:47.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj128 /dev/null 2020-09-08T16:57:47.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:47.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj129 /dev/null 2020-09-08T16:57:47.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:47.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj130 /dev/null 2020-09-08T16:57:48.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:48.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj131 /dev/null 2020-09-08T16:57:48.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:48.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj132 /dev/null 2020-09-08T16:57:48.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:48.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj133 /dev/null 2020-09-08T16:57:48.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:48.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj134 /dev/null 2020-09-08T16:57:48.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:48.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj135 /dev/null 2020-09-08T16:57:48.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:48.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj136 /dev/null 2020-09-08T16:57:48.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:48.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj137 /dev/null 2020-09-08T16:57:48.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:48.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj138 /dev/null 2020-09-08T16:57:48.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:48.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj139 /dev/null 2020-09-08T16:57:48.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:48.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj140 /dev/null 2020-09-08T16:57:48.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:48.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj141 /dev/null 2020-09-08T16:57:48.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:48.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj142 /dev/null 2020-09-08T16:57:48.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:48.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj143 /dev/null 2020-09-08T16:57:48.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:48.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj144 /dev/null 2020-09-08T16:57:49.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:49.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj145 /dev/null 2020-09-08T16:57:49.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:49.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj146 /dev/null 2020-09-08T16:57:49.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:49.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj147 /dev/null 2020-09-08T16:57:49.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:49.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj148 /dev/null 2020-09-08T16:57:49.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:49.241 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj149 /dev/null 2020-09-08T16:57:49.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:49.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj150 /dev/null 2020-09-08T16:57:49.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:49.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj151 /dev/null 2020-09-08T16:57:49.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:49.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj152 /dev/null 2020-09-08T16:57:49.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:49.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj153 /dev/null 2020-09-08T16:57:49.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:49.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj154 /dev/null 2020-09-08T16:57:49.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:49.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj155 /dev/null 2020-09-08T16:57:49.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:49.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj156 /dev/null 2020-09-08T16:57:49.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:49.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj157 /dev/null 2020-09-08T16:57:49.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:49.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj158 /dev/null 2020-09-08T16:57:49.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:49.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj159 /dev/null 2020-09-08T16:57:49.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:49.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj160 /dev/null 2020-09-08T16:57:50.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:50.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj161 /dev/null 2020-09-08T16:57:50.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:50.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj162 /dev/null 2020-09-08T16:57:50.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:50.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj163 /dev/null 2020-09-08T16:57:50.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:50.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj164 /dev/null 2020-09-08T16:57:50.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:50.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj165 /dev/null 2020-09-08T16:57:50.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:50.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj166 /dev/null 2020-09-08T16:57:50.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:50.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj167 /dev/null 2020-09-08T16:57:50.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:50.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj168 /dev/null 2020-09-08T16:57:50.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:50.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj169 /dev/null 2020-09-08T16:57:50.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:50.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj170 /dev/null 2020-09-08T16:57:50.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:50.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj171 /dev/null 2020-09-08T16:57:50.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:50.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj172 /dev/null 2020-09-08T16:57:50.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:50.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj173 /dev/null 2020-09-08T16:57:50.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:50.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj174 /dev/null 2020-09-08T16:57:50.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:50.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj175 /dev/null 2020-09-08T16:57:50.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:50.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj176 /dev/null 2020-09-08T16:57:51.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:51.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj177 /dev/null 2020-09-08T16:57:51.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:51.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj178 /dev/null 2020-09-08T16:57:51.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:51.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj179 /dev/null 2020-09-08T16:57:51.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:51.240 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj180 /dev/null 2020-09-08T16:57:51.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:51.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj181 /dev/null 2020-09-08T16:57:51.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:51.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj182 /dev/null 2020-09-08T16:57:51.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:51.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj183 /dev/null 2020-09-08T16:57:51.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:51.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj184 /dev/null 2020-09-08T16:57:51.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:51.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj185 /dev/null 2020-09-08T16:57:51.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:51.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj186 /dev/null 2020-09-08T16:57:51.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:51.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj187 /dev/null 2020-09-08T16:57:51.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:51.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj188 /dev/null 2020-09-08T16:57:51.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:51.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj189 /dev/null 2020-09-08T16:57:51.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:51.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj190 /dev/null 2020-09-08T16:57:51.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:51.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj191 /dev/null 2020-09-08T16:57:52.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:52.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj192 /dev/null 2020-09-08T16:57:52.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:52.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj193 /dev/null 2020-09-08T16:57:52.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:52.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj194 /dev/null 2020-09-08T16:57:52.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:52.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj195 /dev/null 2020-09-08T16:57:52.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:52.327 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj196 /dev/null 2020-09-08T16:57:52.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:52.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj197 /dev/null 2020-09-08T16:57:52.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:52.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj198 /dev/null 2020-09-08T16:57:52.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:52.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj199 /dev/null 2020-09-08T16:57:52.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2020-09-08T16:57:52.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj200 /dev/null 2020-09-08T16:57:52.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:155: TEST_backfill_sizeup: ceph osd set nobackfill 2020-09-08T16:57:53.348 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is set 2020-09-08T16:57:53.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:156: TEST_backfill_sizeup: ceph osd pool set test size 3 2020-09-08T16:57:54.211 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 3 2020-09-08T16:57:54.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:157: TEST_backfill_sizeup: sleep 2 2020-09-08T16:57:56.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:158: TEST_backfill_sizeup: ceph osd unset nobackfill 2020-09-08T16:57:56.953 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is unset 2020-09-08T16:57:56.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:160: TEST_backfill_sizeup: wait_for_clean 2020-09-08T16:57:56.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:57:56.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:57:56.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:57:56.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:57:56.963 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:57:56.964 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:57:56.964 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:57:56.964 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:57:56.964 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:57:56.965 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:57:57.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:57:57.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:57:57.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:57:57.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:57:57.060 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:57:57.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:57:57.473 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:57:57.473 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:57:57.473 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:57:57.474 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T16:57:57.474 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T16:57:57.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:57:57.474 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:57:57.474 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:57:57.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836498 2020-09-08T16:57:57.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836498 2020-09-08T16:57:57.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498' 2020-09-08T16:57:57.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:57:57.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:57:57.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672976 2020-09-08T16:57:57.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672976 2020-09-08T16:57:57.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498 1-42949672976' 2020-09-08T16:57:57.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:57:57.759 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:57:57.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509455 2020-09-08T16:57:57.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509455 2020-09-08T16:57:57.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498 1-42949672976 2-64424509455' 2020-09-08T16:57:57.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:57:57.891 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:57:58.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345933 2020-09-08T16:57:58.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345933 2020-09-08T16:57:58.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498 1-42949672976 2-64424509455 3-85899345933' 2020-09-08T16:57:58.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:57:58.022 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:57:58.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182413 2020-09-08T16:57:58.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182413 2020-09-08T16:57:58.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498 1-42949672976 2-64424509455 3-85899345933 4-107374182413' 2020-09-08T16:57:58.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:57:58.154 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T16:57:58.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018890 2020-09-08T16:57:58.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018890 2020-09-08T16:57:58.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498 1-42949672976 2-64424509455 3-85899345933 4-107374182413 5-128849018890' 2020-09-08T16:57:58.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:57:58.305 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836498 2020-09-08T16:57:58.306 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:57:58.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:57:58.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836498 2020-09-08T16:57:58.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:57:58.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836498 2020-09-08T16:57:58.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836498' 2020-09-08T16:57:58.308 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:57:58.308 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836498 2020-09-08T16:57:59.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836498 -lt 21474836498 2020-09-08T16:57:59.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:57:59.034 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672976 2020-09-08T16:57:59.035 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:57:59.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:57:59.035 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672976 2020-09-08T16:57:59.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:57:59.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672976 2020-09-08T16:57:59.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672976' 2020-09-08T16:57:59.037 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:57:59.037 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672976 2020-09-08T16:57:59.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672976 -lt 42949672976 2020-09-08T16:57:59.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:57:59.433 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509455 2020-09-08T16:57:59.433 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:57:59.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:57:59.434 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509455 2020-09-08T16:57:59.435 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:57:59.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509455 2020-09-08T16:57:59.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509455' 2020-09-08T16:57:59.436 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:57:59.436 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509455 2020-09-08T16:57:59.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509455 -lt 64424509455 2020-09-08T16:57:59.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:57:59.828 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345933 2020-09-08T16:57:59.828 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:57:59.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:57:59.829 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345933 2020-09-08T16:57:59.829 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:57:59.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345933 2020-09-08T16:57:59.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345933' 2020-09-08T16:57:59.830 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:57:59.830 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345933 2020-09-08T16:58:00.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345933 -lt 85899345933 2020-09-08T16:58:00.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:58:00.225 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182413 2020-09-08T16:58:00.225 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:58:00.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:58:00.226 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182413 2020-09-08T16:58:00.226 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:58:00.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182413 2020-09-08T16:58:00.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182413' 2020-09-08T16:58:00.227 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:58:00.227 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182413 2020-09-08T16:58:00.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182413 -lt 107374182413 2020-09-08T16:58:00.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:58:00.621 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018890 2020-09-08T16:58:00.621 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:58:00.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T16:58:00.622 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018890 2020-09-08T16:58:00.622 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:58:00.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018890 2020-09-08T16:58:00.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018890' 2020-09-08T16:58:00.623 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T16:58:00.623 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018890 2020-09-08T16:58:01.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018890 -lt 128849018890 2020-09-08T16:58:01.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:58:01.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:01.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:01.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T16:58:01.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:01.577 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:01.578 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:01.578 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:01.578 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:01.578 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:01.583 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:01.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:01.962 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:01.962 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:01.963 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:02.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:02.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T16:58:02.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T16:58:02.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T16:58:02.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:02.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:02.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:02.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:02.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:02.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:02.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:02.587 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:02.587 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:02.587 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:02.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:02.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:02.969 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:02.969 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:03.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:03.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:03.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:03.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:03.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:03.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:03.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:03.488 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:03.488 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:04.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=0 2020-09-08T16:58:04.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 0 '!=' null 2020-09-08T16:58:04.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:04.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:04.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:04.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:04.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:04.126 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:04.126 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:04.126 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:04.127 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:04.127 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:04.127 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:04.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:04.506 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:04.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:04.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:05.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:05.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:05.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:05.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:05.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:05.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:05.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:05.031 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:05.031 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:05.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=0 2020-09-08T16:58:05.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 0 '!=' null 2020-09-08T16:58:05.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:05.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:05.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:05.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:05.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:05.653 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:05.653 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:05.653 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:05.653 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:05.654 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:05.654 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:06.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:06.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:06.037 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:06.037 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:06.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:06.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:06.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:06.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:06.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:06.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:06.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:06.560 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:06.561 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:07.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:58:07.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:58:07.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:07.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:07.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:07.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:07.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:07.235 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:07.235 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:07.235 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:07.236 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:07.236 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:07.236 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:07.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:07.641 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:07.641 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:07.642 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:08.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:08.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:08.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:08.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:08.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:08.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:08.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:08.182 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:08.183 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:08.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T16:58:08.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T16:58:08.749 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:08.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:08.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:08.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:08.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:08.850 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:08.851 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:08.851 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:08.851 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:08.851 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:08.851 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:09.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:09.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:09.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:09.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:09.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:09.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:09.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:09.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:09.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:09.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:09.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:09.762 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:09.762 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:10.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:58:10.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:58:10.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:10.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:10.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:10.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:10.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:10.387 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:10.387 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:10.387 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:10.388 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:10.388 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:10.388 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:10.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:10.769 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:10.769 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:10.770 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:11.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:11.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:11.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:11.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:11.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:11.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:11.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:11.296 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:11.296 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:11.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:58:11.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:58:11.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:11.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:11.822 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:11.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:11.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:11.924 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:11.924 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:11.924 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:11.924 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:11.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:11.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:12.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:12.311 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:12.312 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:12.312 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:12.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:12.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:12.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:12.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:12.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:12.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:12.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:12.837 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:12.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:13.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:58:13.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:58:13.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:13.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:13.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:13.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:13.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:13.478 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:13.478 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:13.479 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:13.479 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:13.479 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:13.479 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:13.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:13.871 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:13.871 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:13.872 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:14.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:14.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:14.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:14.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:14.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:14.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:14.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:14.425 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:14.425 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:14.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:58:14.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:58:14.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:14.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:14.944 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:15.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:15.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:15.045 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:15.045 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:15.045 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:15.045 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:15.046 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:15.046 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:15.424 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:15.425 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:15.426 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:15.426 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:15.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:15.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:15.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:15.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:15.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:15.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:15.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:15.949 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:15.949 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:16.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:58:16.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:58:16.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:16.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:16.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:16.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:16.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:16.607 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:16.607 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:16.607 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:16.608 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:16.608 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:16.608 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:16.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:16.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:16.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:16.986 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:17.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:17.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:17.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:17.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:17.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:17.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:17.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:17.506 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:17.506 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:18.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:58:18.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:58:18.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:18.065 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:18.066 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:18.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:18.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:18.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:18.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:18.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:18.167 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:18.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:18.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:18.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:18.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:18.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:18.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:19.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:19.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:19.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:19.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:19.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:19.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:19.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:19.069 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:19.070 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:19.597 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:58:19.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:58:19.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:19.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:19.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:19.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:19.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:19.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:19.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:19.700 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:19.700 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:19.700 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:19.700 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:20.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:20.081 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:20.081 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:20.082 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:20.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:20.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:20.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:20.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:20.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:20.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:20.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:20.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:20.604 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:21.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:58:21.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:58:21.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:21.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:21.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:21.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:21.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:21.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:21.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:21.223 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:21.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:21.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:21.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:21.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:21.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:21.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:21.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:22.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:22.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:22.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:22.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:22.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:22.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:22.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:22.129 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:22.129 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:22.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:58:22.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:58:22.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:22.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:22.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:22.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:22.752 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:22.753 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:22.753 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:22.753 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:22.754 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:22.754 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:22.754 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:23.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:23.135 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:23.135 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:23.135 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:23.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:23.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:23.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:23.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:23.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:23.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:23.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:23.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:23.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:24.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:58:24.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:58:24.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:24.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:24.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:24.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:24.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:24.325 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:24.326 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:24.326 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:24.326 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:24.326 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:24.326 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:24.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:24.711 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:24.711 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:24.711 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:25.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:25.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:25.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:25.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:25.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:25.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:25.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:25.233 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:25.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:25.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:58:25.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:58:25.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:25.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:25.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:25.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:25.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:25.887 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:25.887 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:25.887 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:25.887 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:25.888 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:25.888 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:26.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:26.269 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:26.270 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:26.270 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:26.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:26.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:26.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:26.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:26.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:26.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:26.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:26.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:26.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:27.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=6 2020-09-08T16:58:27.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 6 '!=' null 2020-09-08T16:58:27.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:27.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:27.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:27.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:27.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:27.415 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:27.416 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:27.416 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:27.416 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:27.416 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:27.416 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:27.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:27.803 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:27.803 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:27.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:28.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:28.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:28.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:28.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:28.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:28.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:28.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:28.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:28.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:28.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:58:28.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:58:28.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:28.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:28.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:28.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:28.943 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:28.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:28.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:28.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:28.944 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:28.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:28.945 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:29.326 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:29.327 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:29.328 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:29.328 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:29.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:29.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:29.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:29.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:29.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:29.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:29.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:29.858 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:29.858 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:30.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:58:30.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:58:30.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:30.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:30.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:30.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:30.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:30.494 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:30.494 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:30.494 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:30.494 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:30.494 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:30.495 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:30.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:30.872 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:30.872 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:30.873 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:31.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:31.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:31.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:31.393 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:31.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:31.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:31.394 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:31.394 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:31.394 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:31.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:58:31.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:58:31.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:31.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:31.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:32.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:32.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:32.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:32.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:32.020 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:32.020 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:32.020 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:32.020 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:32.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:32.402 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:32.403 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:32.403 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:32.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:32.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:32.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:32.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:32.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:32.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:32.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:32.927 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:32.928 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:33.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:58:33.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:58:33.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:33.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:33.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:33.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:33.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:33.547 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:33.547 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:33.547 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:33.547 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:33.547 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:33.548 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:33.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:33.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:33.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:33.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:34.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:34.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:34.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:34.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:34.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:34.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:34.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:34.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:34.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:35.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T16:58:35.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T16:58:35.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:35.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:35.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:35.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:35.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:35.120 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:35.120 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:35.120 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:35.121 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:35.121 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:35.121 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:35.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:35.504 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:35.504 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:35.504 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:36.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:36.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:36.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:36.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:36.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:36.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:36.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:36.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:36.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:36.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=6 2020-09-08T16:58:36.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 6 '!=' null 2020-09-08T16:58:36.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:36.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:36.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:36.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:36.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:36.651 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:36.651 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:36.651 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:36.652 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:36.652 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:36.652 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:37.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:37.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:37.031 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:37.031 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:37.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:37.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:37.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:37.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:37.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:37.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:37.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:37.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:37.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:38.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=6 2020-09-08T16:58:38.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 6 '!=' null 2020-09-08T16:58:38.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:38.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:38.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:38.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:38.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:38.182 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:38.182 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:38.182 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:38.182 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:38.183 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:38.183 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:38.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:38.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:38.565 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:38.565 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:39.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:39.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:39.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:39.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:39.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:39.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:39.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:39.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:39.088 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:39.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T16:58:39.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T16:58:39.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:39.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:39.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:39.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:39.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:39.703 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:39.703 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:39.703 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:39.703 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:39.703 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:39.704 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:40.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:40.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:40.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:40.085 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:40.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:40.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:40.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:40.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:40.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:40.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:40.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:40.605 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:40.605 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:41.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:58:41.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:58:41.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:41.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:41.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:41.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:41.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:41.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:41.323 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:41.324 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:41.324 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:41.324 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:41.325 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:41.701 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:41.702 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:41.702 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:41.703 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:42.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:42.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:42.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:42.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:42.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:42.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:42.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:42.225 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:42.225 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:42.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T16:58:42.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T16:58:42.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:42.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:42.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:42.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:42.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:42.849 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:42.849 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:42.850 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:42.850 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:42.850 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:42.850 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:43.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:43.227 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:43.228 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:43.228 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:43.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:43.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:43.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:43.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:43.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:43.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:43.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:43.746 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:43.746 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:44.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T16:58:44.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T16:58:44.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:44.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:44.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:44.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:44.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:44.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:44.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:44.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:44.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:44.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:44.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:44.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T16:58:44.744 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:44.745 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:44.745 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:45.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T16:58:45.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T16:58:45.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T16:58:45.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T16:58:45.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T16:58:45.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T16:58:45.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T16:58:45.269 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T16:58:45.269 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T16:58:45.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T16:58:45.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T16:58:45.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T16:58:45.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T16:58:45.784 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T16:58:45.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T16:58:45.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:58:45.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:58:45.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:58:45.886 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:58:45.886 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:58:45.886 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:58:45.886 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:58:46.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T16:58:46.275 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:58:46.275 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:58:46.275 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:58:46.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T16:58:46.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:58:46.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:58:46.798 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:162: TEST_backfill_sizeup: get_primary test obj1 2020-09-08T16:58:46.799 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:58:46.799 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:58:46.799 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:58:46.799 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:58:47.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:162: TEST_backfill_sizeup: local primary=1 2020-09-08T16:58:47.200 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:163: TEST_backfill_sizeup: get_pg test obj1 2020-09-08T16:58:47.200 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1031: get_pg: local poolname=test 2020-09-08T16:58:47.200 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: local objectname=obj1 2020-09-08T16:58:47.201 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: ceph --format json osd map test obj1 2020-09-08T16:58:47.201 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: jq -r .pgid 2020-09-08T16:58:47.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:163: TEST_backfill_sizeup: local PG=1.0 2020-09-08T16:58:47.618 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:165: TEST_backfill_sizeup: expr 200 '*' 2 2020-09-08T16:58:47.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:165: TEST_backfill_sizeup: local degraded=400 2020-09-08T16:58:47.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:166: TEST_backfill_sizeup: check td/osd-backfill-stats 1.0 1 replicated 400 0 0 0 2020-09-08T16:58:47.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2020-09-08T16:58:47.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:64: check: local PG=1.0 2020-09-08T16:58:47.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:65: check: local primary=1 2020-09-08T16:58:47.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:66: check: local type=replicated 2020-09-08T16:58:47.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:67: check: local degraded_start=400 2020-09-08T16:58:47.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:68: check: local degraded_end=0 2020-09-08T16:58:47.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:69: check: local misplaced_start=0 2020-09-08T16:58:47.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:70: check: local misplaced_end=0 2020-09-08T16:58:47.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:71: check: local primary_start= 2020-09-08T16:58:47.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:72: check: local primary_end= 2020-09-08T16:58:47.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:73: check: local check_setup=true 2020-09-08T16:58:47.623 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2020-09-08T16:58:47.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2020-09-08T16:58:47.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:76: check: '[' true = true ']' 2020-09-08T16:58:47.624 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log td/osd-backfill-stats/osd.5.log 2020-09-08T16:58:47.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2020-09-08T16:58:47.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2020-09-08T16:58:47.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: wc -w 2020-09-08T16:58:47.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2020-09-08T16:58:47.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:86: check: local 'addp= ' 2020-09-08T16:58:47.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:87: check: '[' replicated = erasure ']' 2020-09-08T16:58:47.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2020-09-08T16:58:47.634 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:58:47.634 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: tail -1 2020-09-08T16:58:47.634 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2020-09-08T16:58:47.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: UPACT='[1,0,2]/[1]' 2020-09-08T16:58:47.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:93: check: '[' -n '[1,0,2]/[1]' ']' 2020-09-08T16:58:47.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:96: check: local which=degraded 2020-09-08T16:58:47.650 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:58:47.651 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:58:47.651 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -F ' [1,0,2]/[1] ' 2020-09-08T16:58:47.651 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -v est 2020-09-08T16:58:47.653 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: head -1 2020-09-08T16:58:47.653 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:58:47.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: FIRST=400 2020-09-08T16:58:47.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:98: check: '[' -n 400 ']' 2020-09-08T16:58:47.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:99: check: below_margin 400 400 2020-09-08T16:58:47.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=400 2020-09-08T16:58:47.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T16:58:47.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=400 2020-09-08T16:58:47.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T16:58:47.656 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:58:47.656 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:58:47.657 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: tail -1 2020-09-08T16:58:47.657 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:58:47.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: LAST=2 2020-09-08T16:58:47.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:101: check: '[' -n 2 ']' 2020-09-08T16:58:47.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:102: check: above_margin 2 0 2020-09-08T16:58:47.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=2 2020-09-08T16:58:47.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T16:58:47.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=0 2020-09-08T16:58:47.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T16:58:47.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:105: check: which=misplaced 2020-09-08T16:58:47.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:58:47.667 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:58:47.667 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -F ' [1,0,2]/[1] ' 2020-09-08T16:58:47.667 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -v est 2020-09-08T16:58:47.667 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: head -1 2020-09-08T16:58:47.669 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:58:47.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: FIRST=0 2020-09-08T16:58:47.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:107: check: '[' -n 0 ']' 2020-09-08T16:58:47.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:108: check: below_margin 0 0 2020-09-08T16:58:47.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=0 2020-09-08T16:58:47.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T16:58:47.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=0 2020-09-08T16:58:47.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T16:58:47.670 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T16:58:47.671 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2020-09-08T16:58:47.671 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: tail -1 2020-09-08T16:58:47.671 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T16:58:47.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: LAST=0 2020-09-08T16:58:47.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:110: check: '[' -n 0 ']' 2020-09-08T16:58:47.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:111: check: above_margin 0 0 2020-09-08T16:58:47.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=0 2020-09-08T16:58:47.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T16:58:47.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=0 2020-09-08T16:58:47.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T16:58:47.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2020-09-08T16:58:47.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:168: TEST_backfill_sizeup: delete_pool test 2020-09-08T16:58:47.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test 2020-09-08T16:58:47.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2020-09-08T16:58:48.192 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' does not exist 2020-09-08T16:58:48.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:169: TEST_backfill_sizeup: kill_daemons td/osd-backfill-stats 2020-09-08T16:58:48.219 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:58:48.220 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:58:48.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:58:48.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:58:48.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:58:48.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:58:48.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2020-09-08T16:58:48.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T16:58:48.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:58:48.313 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T16:58:48.313 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:58:48.314 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:58:48.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:58:48.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:58:48.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:58:48.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:58:48.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:58:48.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:58:48.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:58:48.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:58:48.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:58:48.322 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:58:48.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:58:48.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:58:48.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:58:48.324 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:58:48.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:58:48.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:58:48.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T16:58:48.340 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:58:48.340 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:58:48.341 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:58:48.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T16:58:48.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:58:48.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:58:48.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:35: run: for func in $funcs 2020-09-08T16:58:48.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2020-09-08T16:58:48.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2020-09-08T16:58:48.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2020-09-08T16:58:48.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T16:58:48.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T16:58:48.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T16:58:48.344 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T16:58:48.345 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T16:58:48.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T16:58:48.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T16:58:48.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T16:58:48.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T16:58:48.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T16:58:48.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T16:58:48.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T16:58:48.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T16:58:48.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T16:58:48.348 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T16:58:48.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:58:48.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T16:58:48.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T16:58:48.349 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T16:58:48.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T16:58:48.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T16:58:48.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T16:58:48.351 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T16:58:48.351 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:58:48.351 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:58:48.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T16:58:48.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T16:58:48.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T16:58:48.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2020-09-08T16:58:48.354 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T16:58:48.354 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:58:48.354 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:58:48.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.482138 2020-09-08T16:58:48.356 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T16:58:48.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T16:58:48.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T16:58:48.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2020-09-08T16:58:48.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:37: run: TEST_backfill_sizeup4_allout td/osd-backfill-stats 2020-09-08T16:58:48.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:389: TEST_backfill_sizeup4_allout: local dir=td/osd-backfill-stats 2020-09-08T16:58:48.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:391: TEST_backfill_sizeup4_allout: run_mon td/osd-backfill-stats a 2020-09-08T16:58:48.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2020-09-08T16:58:48.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T16:58:48.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T16:58:48.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T16:58:48.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2020-09-08T16:58:48.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2020-09-08T16:58:48.648 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T16:58:48.648 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:58:48.648 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:58:48.649 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:58:48.649 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:58:48.649 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:58:48.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:58:48.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T16:58:48.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T16:58:48.833 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T16:58:48.833 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:58:48.833 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:58:48.834 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T16:58:48.834 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T16:58:48.834 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:58:48.834 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:58:48.834 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:58:48.835 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:58:48.835 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:58:48.836 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:58:48.836 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T16:58:48.836 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:58:48.836 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get fsid 2020-09-08T16:58:48.928 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T16:58:48.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T16:58:48.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T16:58:48.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T16:58:48.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T16:58:48.930 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T16:58:48.930 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T16:58:48.930 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T16:58:48.931 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T16:58:48.931 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:58:48.932 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:58:48.932 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T16:58:48.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T16:58:48.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get mon_host 2020-09-08T16:58:49.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:392: TEST_backfill_sizeup4_allout: run_mgr td/osd-backfill-stats x 2020-09-08T16:58:49.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-stats 2020-09-08T16:58:49.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T16:58:49.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T16:58:49.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T16:58:49.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-stats/x 2020-09-08T16:58:49.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T16:58:49.919 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T16:58:49.919 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:58:49.919 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:58:49.920 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:58:49.920 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:58:49.920 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:58:49.920 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:58:49.921 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:58:49.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T16:58:49.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:393: TEST_backfill_sizeup4_allout: run_osd td/osd-backfill-stats 0 2020-09-08T16:58:49.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:58:49.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:58:49.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T16:58:49.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:58:49.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/0 2020-09-08T16:58:49.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:58:49.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:58:49.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:58:49.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:58:49.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2020-09-08T16:58:49.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2020-09-08T16:58:49.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:58:49.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:58:49.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:58:49.949 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:58:49.949 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:58:49.949 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:58:49.949 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:58:49.950 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:58:49.950 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:58:49.950 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:58:49.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:58:49.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:58:49.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:58:49.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:58:49.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:58:49.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:58:49.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:58:49.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:58:49.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:58:49.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:58:49.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:58:49.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/0 2020-09-08T16:58:49.953 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:58:49.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=f768c3ba-132c-4513-96ad-247021bf30ad 2020-09-08T16:58:49.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 f768c3ba-132c-4513-96ad-247021bf30ad' 2020-09-08T16:58:49.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:58:49.954 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 f768c3ba-132c-4513-96ad-247021bf30ad 2020-09-08T16:58:49.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBJuFdfnpROOhAAYuH5ixPu++JxJ0xqsnG79w== 2020-09-08T16:58:49.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBJuFdfnpROOhAAYuH5ixPu++JxJ0xqsnG79w=="}' 2020-09-08T16:58:49.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new f768c3ba-132c-4513-96ad-247021bf30ad -i td/osd-backfill-stats/0/new.json 2020-09-08T16:58:50.310 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:58:50.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/0/new.json 2020-09-08T16:58:50.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBJuFdfnpROOhAAYuH5ixPu++JxJ0xqsnG79w== --osd-uuid f768c3ba-132c-4513-96ad-247021bf30ad 2020-09-08T16:58:50.346 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:58:50.351+0000 7f1c95e06ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:58:50.348 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:58:50.353+0000 7f1c95e06ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:58:50.349 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:58:50.354+0000 7f1c95e06ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:58:50.350 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:58:50.355+0000 7f1c95e06ec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:58:50.350 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:58:50.355+0000 7f1c95e06ec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:58:50.351 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:58:50.355+0000 7f1c95e06ec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T16:58:50.391 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:58:50.394+0000 7f1c95e06ec0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2020-09-08T16:58:54.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2020-09-08T16:58:54.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:58:54.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T16:58:54.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:58:54.570 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T16:58:55.102 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T16:58:55.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T16:58:55.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:58:55.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:58:55.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:58:55.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:58:55.121 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:58:55.126+0000 7fa821252ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:58:55.123 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:58:55.128+0000 7fa821252ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:58:55.124 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:58:55.129+0000 7fa821252ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:58:55.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T16:58:55.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:58:55.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T16:58:55.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:58:55.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:58:55.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:58:55.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:58:55.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:58:55.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:58:55.494 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:58:55.644 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:58:55.649+0000 7fa821252ec0 -1 Falling back to public interface 2020-09-08T16:58:55.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:58:56.420 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:58:56.424+0000 7fa821252ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T16:58:56.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:58:56.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:58:56.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:58:56.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:58:56.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T16:58:56.900 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:58:57.295 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/601027,v1:127.0.0.1:6803/601027] [v2:127.0.0.1:6804/601027,v1:127.0.0.1:6805/601027] exists,up f768c3ba-132c-4513-96ad-247021bf30ad 2020-09-08T16:58:57.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:58:57.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:58:57.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:58:57.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:394: TEST_backfill_sizeup4_allout: run_osd td/osd-backfill-stats 1 2020-09-08T16:58:57.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:58:57.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:58:57.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T16:58:57.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:58:57.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/1 2020-09-08T16:58:57.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:58:57.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:58:57.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:58:57.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:58:57.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2020-09-08T16:58:57.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2020-09-08T16:58:57.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:58:57.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:58:57.300 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:58:57.300 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:58:57.300 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:58:57.300 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:58:57.301 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:58:57.301 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:58:57.301 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:58:57.301 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:58:57.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:58:57.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:58:57.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:58:57.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:58:57.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:58:57.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:58:57.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:58:57.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:58:57.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:58:57.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:58:57.304 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:58:57.305 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/1 2020-09-08T16:58:57.305 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:58:57.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=90b376ab-6206-43e9-991e-341c096e273c 2020-09-08T16:58:57.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 90b376ab-6206-43e9-991e-341c096e273c' 2020-09-08T16:58:57.306 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:58:57.306 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 90b376ab-6206-43e9-991e-341c096e273c 2020-09-08T16:58:57.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBRuFdf48TfEhAA0qEfBlQfrh0YpXa2AT7h2w== 2020-09-08T16:58:57.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBRuFdf48TfEhAA0qEfBlQfrh0YpXa2AT7h2w=="}' 2020-09-08T16:58:57.312 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 90b376ab-6206-43e9-991e-341c096e273c -i td/osd-backfill-stats/1/new.json 2020-09-08T16:58:57.853 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:58:57.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/1/new.json 2020-09-08T16:58:57.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBRuFdf48TfEhAA0qEfBlQfrh0YpXa2AT7h2w== --osd-uuid 90b376ab-6206-43e9-991e-341c096e273c 2020-09-08T16:58:57.890 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:58:57.895+0000 7fd760b8bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:58:57.891 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:58:57.896+0000 7fd760b8bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:58:57.893 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:58:57.898+0000 7fd760b8bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:58:57.894 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:58:57.899+0000 7fd760b8bec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:58:57.894 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:58:57.899+0000 7fd760b8bec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:58:57.894 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:58:57.899+0000 7fd760b8bec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T16:58:57.943 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:58:57.948+0000 7fd760b8bec0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2020-09-08T16:59:02.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2020-09-08T16:59:02.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:59:02.167 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T16:59:02.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T16:59:02.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:59:02.701 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T16:59:02.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T16:59:02.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:59:02.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:59:02.702 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:59:02.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:59:02.724 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:02.729+0000 7f90836f0ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:59:02.748 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:02.753+0000 7f90836f0ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:59:02.750 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:02.755+0000 7f90836f0ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:59:03.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T16:59:03.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:59:03.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T16:59:03.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:59:03.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:59:03.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:59:03.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:59:03.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:59:03.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:59:03.096 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:59:03.267 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:03.271+0000 7f90836f0ec0 -1 Falling back to public interface 2020-09-08T16:59:03.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:59:04.199 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:04.204+0000 7f90836f0ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T16:59:04.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:59:04.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:59:04.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:59:04.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T16:59:04.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:59:04.498 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:59:04.927 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/602025,v1:127.0.0.1:6811/602025] [v2:127.0.0.1:6812/602025,v1:127.0.0.1:6813/602025] exists,up 90b376ab-6206-43e9-991e-341c096e273c 2020-09-08T16:59:04.928 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 f2f11ff8-262d-47a4-8b5f-ec677ee4896d 2020-09-08T16:59:04.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:59:04.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:59:04.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:59:04.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:395: TEST_backfill_sizeup4_allout: run_osd td/osd-backfill-stats 2 2020-09-08T16:59:04.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:59:04.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:59:04.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T16:59:04.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:59:04.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/2 2020-09-08T16:59:04.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:59:04.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:59:04.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:59:04.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:59:04.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2020-09-08T16:59:04.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2020-09-08T16:59:04.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:59:04.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:59:04.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:59:04.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:59:04.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:59:04.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:59:04.933 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:59:04.933 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:59:04.933 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:59:04.933 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:59:04.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:59:04.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:59:04.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:59:04.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:59:04.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:59:04.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:59:04.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:59:04.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:59:04.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:59:04.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:59:04.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:59:04.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/2 2020-09-08T16:59:04.936 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:59:04.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=f2f11ff8-262d-47a4-8b5f-ec677ee4896d 2020-09-08T16:59:04.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 f2f11ff8-262d-47a4-8b5f-ec677ee4896d' 2020-09-08T16:59:04.936 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:59:04.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBYuFdfjAxwOBAAx/PSndB7gSZyQUDO+7dHPg== 2020-09-08T16:59:04.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBYuFdfjAxwOBAAx/PSndB7gSZyQUDO+7dHPg=="}' 2020-09-08T16:59:04.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new f2f11ff8-262d-47a4-8b5f-ec677ee4896d -i td/osd-backfill-stats/2/new.json 2020-09-08T16:59:05.462 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T16:59:05.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/2/new.json 2020-09-08T16:59:05.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBYuFdfjAxwOBAAx/PSndB7gSZyQUDO+7dHPg== --osd-uuid f2f11ff8-262d-47a4-8b5f-ec677ee4896d 2020-09-08T16:59:05.498 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:05.503+0000 7fe35847cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:59:05.500 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:05.505+0000 7fe35847cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:59:05.501 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:05.506+0000 7fe35847cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:59:05.502 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:05.506+0000 7fe35847cec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:59:05.502 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:05.506+0000 7fe35847cec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:59:05.502 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:05.506+0000 7fe35847cec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T16:59:05.550 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:05.555+0000 7fe35847cec0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2020-09-08T16:59:10.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2020-09-08T16:59:10.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:59:10.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T16:59:10.080 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:59:10.080 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T16:59:10.614 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T16:59:10.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T16:59:10.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:59:10.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:59:10.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:59:10.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:59:10.638 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:10.642+0000 7fd0ed233ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:59:10.670 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:10.675+0000 7fd0ed233ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:59:10.672 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:10.676+0000 7fd0ed233ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:59:11.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T16:59:11.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:59:11.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T16:59:11.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:59:11.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:59:11.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:59:11.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:59:11.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:59:11.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:59:11.007 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:59:11.187 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:11.192+0000 7fd0ed233ec0 -1 Falling back to public interface 2020-09-08T16:59:11.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:59:12.069 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:12.074+0000 7fd0ed233ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T16:59:12.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:59:12.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:59:12.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:59:12.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:59:12.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T16:59:12.417 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:59:12.829 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/603019,v1:127.0.0.1:6819/603019] [v2:127.0.0.1:6820/603019,v1:127.0.0.1:6821/603019] exists,up f2f11ff8-262d-47a4-8b5f-ec677ee4896d 2020-09-08T16:59:12.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:59:12.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:59:12.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:59:12.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:396: TEST_backfill_sizeup4_allout: run_osd td/osd-backfill-stats 3 2020-09-08T16:59:12.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:59:12.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:59:12.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T16:59:12.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:59:12.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/3 2020-09-08T16:59:12.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:59:12.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:59:12.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:59:12.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:59:12.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2020-09-08T16:59:12.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2020-09-08T16:59:12.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:59:12.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:59:12.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:59:12.833 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:59:12.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:59:12.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:59:12.839 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:59:12.839 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:59:12.839 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:59:12.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:59:12.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:59:12.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:59:12.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:59:12.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:59:12.840 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:59:12.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:59:12.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:59:12.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:59:12.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:59:12.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:59:12.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:59:12.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/3 2020-09-08T16:59:12.842 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:59:12.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=f8783dd8-353b-47dc-8999-9f45f829f790 2020-09-08T16:59:12.843 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 f8783dd8-353b-47dc-8999-9f45f829f790' 2020-09-08T16:59:12.843 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:59:12.843 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 f8783dd8-353b-47dc-8999-9f45f829f790 2020-09-08T16:59:12.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBguFdf6ZOxMhAAi5cu9glLKwSsMk6KWiVZHA== 2020-09-08T16:59:12.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBguFdf6ZOxMhAAi5cu9glLKwSsMk6KWiVZHA=="}' 2020-09-08T16:59:12.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new f8783dd8-353b-47dc-8999-9f45f829f790 -i td/osd-backfill-stats/3/new.json 2020-09-08T16:59:13.451 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T16:59:13.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/3/new.json 2020-09-08T16:59:13.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBguFdf6ZOxMhAAi5cu9glLKwSsMk6KWiVZHA== --osd-uuid f8783dd8-353b-47dc-8999-9f45f829f790 2020-09-08T16:59:13.488 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:13.492+0000 7f19f7187ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:59:13.490 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:13.494+0000 7f19f7187ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:59:13.491 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:13.496+0000 7f19f7187ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:59:13.492 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:13.497+0000 7f19f7187ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:59:13.492 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:13.497+0000 7f19f7187ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:59:13.492 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:13.497+0000 7f19f7187ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T16:59:13.545 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:13.550+0000 7f19f7187ec0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2020-09-08T16:59:17.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2020-09-08T16:59:17.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:59:17.716 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T16:59:17.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T16:59:17.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:59:18.270 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T16:59:18.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T16:59:18.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:59:18.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:59:18.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:59:18.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:59:18.294 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:18.298+0000 7fcd1c102ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:59:18.295 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:18.300+0000 7fcd1c102ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:59:18.296 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:18.301+0000 7fcd1c102ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:59:18.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T16:59:18.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:59:18.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T16:59:18.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:59:18.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:59:18.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:59:18.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:59:18.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:59:18.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:59:18.664 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:59:18.815 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:18.820+0000 7fcd1c102ec0 -1 Falling back to public interface 2020-09-08T16:59:19.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:59:19.619 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:19.624+0000 7fcd1c102ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T16:59:20.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:59:20.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:59:20.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:59:20.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:59:20.069 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T16:59:20.070 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:59:20.495 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/604013,v1:127.0.0.1:6827/604013] [v2:127.0.0.1:6828/604013,v1:127.0.0.1:6829/604013] exists,up f8783dd8-353b-47dc-8999-9f45f829f790 2020-09-08T16:59:20.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:59:20.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:59:20.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:59:20.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:397: TEST_backfill_sizeup4_allout: run_osd td/osd-backfill-stats 4 2020-09-08T16:59:20.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T16:59:20.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T16:59:20.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=4 2020-09-08T16:59:20.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T16:59:20.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/4 2020-09-08T16:59:20.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T16:59:20.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T16:59:20.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T16:59:20.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T16:59:20.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2020-09-08T16:59:20.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2020-09-08T16:59:20.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T16:59:20.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T16:59:20.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T16:59:20.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T16:59:20.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T16:59:20.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T16:59:20.499 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T16:59:20.499 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T16:59:20.500 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T16:59:20.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:59:20.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T16:59:20.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T16:59:20.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T16:59:20.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T16:59:20.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T16:59:20.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T16:59:20.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T16:59:20.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T16:59:20.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:59:20.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T16:59:20.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T16:59:20.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/4 2020-09-08T16:59:20.502 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T16:59:20.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=f4bc38ee-8d34-4189-bc71-e4d2dabc4f93 2020-09-08T16:59:20.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd4 f4bc38ee-8d34-4189-bc71-e4d2dabc4f93' 2020-09-08T16:59:20.504 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T16:59:20.504 INFO:tasks.workunit.client.0.smithi065.stdout:add osd4 f4bc38ee-8d34-4189-bc71-e4d2dabc4f93 2020-09-08T16:59:20.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBouFdfEUPWHhAAib1Two1MaanawXRhy0CH7A== 2020-09-08T16:59:20.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBouFdfEUPWHhAAib1Two1MaanawXRhy0CH7A=="}' 2020-09-08T16:59:20.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new f4bc38ee-8d34-4189-bc71-e4d2dabc4f93 -i td/osd-backfill-stats/4/new.json 2020-09-08T16:59:21.091 INFO:tasks.workunit.client.0.smithi065.stdout:4 2020-09-08T16:59:21.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/4/new.json 2020-09-08T16:59:21.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 4 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBouFdfEUPWHhAAib1Two1MaanawXRhy0CH7A== --osd-uuid f4bc38ee-8d34-4189-bc71-e4d2dabc4f93 2020-09-08T16:59:21.128 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:21.133+0000 7f264b412ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:59:21.151 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:21.156+0000 7f264b412ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:59:21.153 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:21.158+0000 7f264b412ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:59:21.154 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:21.158+0000 7f264b412ec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:59:21.154 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:21.158+0000 7f264b412ec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:59:21.154 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:21.158+0000 7f264b412ec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T16:59:21.218 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:21.223+0000 7f264b412ec0 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2020-09-08T16:59:25.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2020-09-08T16:59:25.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T16:59:25.502 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd4 key to auth repository 2020-09-08T16:59:25.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd4 key to auth repository 2020-09-08T16:59:25.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T16:59:26.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.4 2020-09-08T16:59:26.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T16:59:26.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T16:59:26.032 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.4 2020-09-08T16:59:26.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T16:59:26.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 4 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T16:59:26.055 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:26.059+0000 7f4637abeec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:59:26.074 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:26.079+0000 7f4637abeec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:59:26.075 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:26.080+0000 7f4637abeec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T16:59:26.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 4 2020-09-08T16:59:26.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T16:59:26.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=4 2020-09-08T16:59:26.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T16:59:26.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T16:59:26.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:59:26.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T16:59:26.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:59:26.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:59:26.423 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T16:59:26.591 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:26.596+0000 7f4637abeec0 -1 Falling back to public interface 2020-09-08T16:59:26.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T16:59:27.392 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T16:59:27.396+0000 7f4637abeec0 -1 osd.4 0 log_to_monitors {default=true} 2020-09-08T16:59:27.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T16:59:27.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T16:59:27.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T16:59:27.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T16:59:27.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T16:59:27.834 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T16:59:28.281 INFO:tasks.workunit.client.0.smithi065.stdout:osd.4 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/605007,v1:127.0.0.1:6835/605007] [v2:127.0.0.1:6836/605007,v1:127.0.0.1:6837/605007] exists,up f4bc38ee-8d34-4189-bc71-e4d2dabc4f93 2020-09-08T16:59:28.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T16:59:28.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T16:59:28.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T16:59:28.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:399: TEST_backfill_sizeup4_allout: create_pool test 1 1 2020-09-08T16:59:28.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test 1 1 2020-09-08T16:59:28.818 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' already exists 2020-09-08T16:59:28.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T16:59:29.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:400: TEST_backfill_sizeup4_allout: ceph osd pool set test size 2 2020-09-08T16:59:30.645 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 2 2020-09-08T16:59:30.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:402: TEST_backfill_sizeup4_allout: wait_for_clean 2020-09-08T16:59:30.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T16:59:30.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T16:59:30.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T16:59:30.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T16:59:30.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T16:59:30.656 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T16:59:30.656 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T16:59:30.656 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T16:59:30.656 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T16:59:30.657 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T16:59:30.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T16:59:30.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T16:59:30.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T16:59:30.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T16:59:30.751 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T16:59:31.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T16:59:31.146 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T16:59:31.146 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T16:59:31.147 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T16:59:31.147 INFO:tasks.workunit.client.0.smithi065.stderr:4' 2020-09-08T16:59:31.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T16:59:31.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:59:31.148 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T16:59:31.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836489 2020-09-08T16:59:31.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836489 2020-09-08T16:59:31.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836489' 2020-09-08T16:59:31.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:59:31.278 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T16:59:31.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672969 2020-09-08T16:59:31.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672969 2020-09-08T16:59:31.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836489 1-42949672969' 2020-09-08T16:59:31.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:59:31.409 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T16:59:31.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=60129542150 2020-09-08T16:59:31.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 60129542150 2020-09-08T16:59:31.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836489 1-42949672969 2-60129542150' 2020-09-08T16:59:31.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:59:31.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T16:59:31.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=81604378629 2020-09-08T16:59:31.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 81604378629 2020-09-08T16:59:31.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836489 1-42949672969 2-60129542150 3-81604378629' 2020-09-08T16:59:31.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T16:59:31.670 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T16:59:31.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=103079215108 2020-09-08T16:59:31.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 103079215108 2020-09-08T16:59:31.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836489 1-42949672969 2-60129542150 3-81604378629 4-103079215108' 2020-09-08T16:59:31.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:59:31.802 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836489 2020-09-08T16:59:31.803 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:59:31.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T16:59:31.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836489 2020-09-08T16:59:31.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:59:31.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836489 2020-09-08T16:59:31.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836489' 2020-09-08T16:59:31.805 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T16:59:31.805 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836489 2020-09-08T16:59:32.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836489 -lt 21474836489 2020-09-08T16:59:32.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:59:32.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672969 2020-09-08T16:59:32.235 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:59:32.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T16:59:32.236 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672969 2020-09-08T16:59:32.236 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:59:32.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672969 2020-09-08T16:59:32.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672969' 2020-09-08T16:59:32.237 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T16:59:32.237 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672969 2020-09-08T16:59:32.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672969 -lt 42949672969 2020-09-08T16:59:32.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:59:32.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-60129542150 2020-09-08T16:59:32.629 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:59:32.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T16:59:32.630 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-60129542150 2020-09-08T16:59:32.630 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:59:32.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=60129542150 2020-09-08T16:59:32.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2020-09-08T16:59:32.631 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T16:59:32.631 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 60129542150 2020-09-08T16:59:33.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 60129542150 -lt 60129542150 2020-09-08T16:59:33.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:59:33.035 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-81604378629 2020-09-08T16:59:33.035 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:59:33.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T16:59:33.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-81604378629 2020-09-08T16:59:33.037 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:59:33.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=81604378629 2020-09-08T16:59:33.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 81604378629' 2020-09-08T16:59:33.038 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 81604378629 2020-09-08T16:59:33.038 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T16:59:33.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 81604378629 -lt 81604378629 2020-09-08T16:59:33.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T16:59:33.467 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-103079215108 2020-09-08T16:59:33.468 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T16:59:33.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T16:59:33.468 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-103079215108 2020-09-08T16:59:33.469 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T16:59:33.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=103079215108 2020-09-08T16:59:33.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 103079215108' 2020-09-08T16:59:33.470 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:59:33.470 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 103079215108 2020-09-08T16:59:33.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 103079215106 -lt 103079215108 2020-09-08T16:59:33.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T16:59:34.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T16:59:34.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T16:59:35.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 103079215109 -lt 103079215108 2020-09-08T16:59:35.282 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T16:59:35.283 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:59:35.283 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:59:35.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T16:59:35.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T16:59:35.837 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T16:59:35.837 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T16:59:35.837 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T16:59:35.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T16:59:35.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T16:59:35.838 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T16:59:36.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T16:59:36.219 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T16:59:36.219 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T16:59:36.219 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T16:59:36.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T16:59:36.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T16:59:36.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T16:59:36.730 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: seq 1 200 2020-09-08T16:59:36.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:36.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj1 /dev/null 2020-09-08T16:59:36.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:36.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj2 /dev/null 2020-09-08T16:59:36.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:36.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj3 /dev/null 2020-09-08T16:59:37.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:37.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj4 /dev/null 2020-09-08T16:59:37.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:37.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj5 /dev/null 2020-09-08T16:59:37.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:37.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj6 /dev/null 2020-09-08T16:59:37.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:37.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj7 /dev/null 2020-09-08T16:59:37.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:37.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj8 /dev/null 2020-09-08T16:59:37.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:37.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj9 /dev/null 2020-09-08T16:59:37.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:37.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj10 /dev/null 2020-09-08T16:59:37.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:37.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj11 /dev/null 2020-09-08T16:59:37.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:37.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj12 /dev/null 2020-09-08T16:59:37.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:37.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj13 /dev/null 2020-09-08T16:59:38.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:38.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj14 /dev/null 2020-09-08T16:59:38.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:38.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj15 /dev/null 2020-09-08T16:59:38.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:38.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj16 /dev/null 2020-09-08T16:59:38.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:38.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj17 /dev/null 2020-09-08T16:59:38.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:38.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj18 /dev/null 2020-09-08T16:59:38.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:38.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj19 /dev/null 2020-09-08T16:59:38.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:38.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj20 /dev/null 2020-09-08T16:59:38.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:38.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj21 /dev/null 2020-09-08T16:59:38.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:38.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj22 /dev/null 2020-09-08T16:59:38.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:38.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj23 /dev/null 2020-09-08T16:59:38.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:38.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj24 /dev/null 2020-09-08T16:59:39.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:39.021 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj25 /dev/null 2020-09-08T16:59:39.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:39.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj26 /dev/null 2020-09-08T16:59:39.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:39.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj27 /dev/null 2020-09-08T16:59:39.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:39.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj28 /dev/null 2020-09-08T16:59:39.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:39.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj29 /dev/null 2020-09-08T16:59:39.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:39.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj30 /dev/null 2020-09-08T16:59:39.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:39.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj31 /dev/null 2020-09-08T16:59:39.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:39.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj32 /dev/null 2020-09-08T16:59:39.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:39.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj33 /dev/null 2020-09-08T16:59:39.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:39.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj34 /dev/null 2020-09-08T16:59:39.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:39.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj35 /dev/null 2020-09-08T16:59:40.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:40.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj36 /dev/null 2020-09-08T16:59:40.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:40.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj37 /dev/null 2020-09-08T16:59:40.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:40.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj38 /dev/null 2020-09-08T16:59:40.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:40.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj39 /dev/null 2020-09-08T16:59:40.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:40.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj40 /dev/null 2020-09-08T16:59:40.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:40.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj41 /dev/null 2020-09-08T16:59:40.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:40.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj42 /dev/null 2020-09-08T16:59:40.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:40.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj43 /dev/null 2020-09-08T16:59:40.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:40.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj44 /dev/null 2020-09-08T16:59:40.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:40.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj45 /dev/null 2020-09-08T16:59:40.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:40.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj46 /dev/null 2020-09-08T16:59:41.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:41.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj47 /dev/null 2020-09-08T16:59:41.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:41.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj48 /dev/null 2020-09-08T16:59:41.230 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:41.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj49 /dev/null 2020-09-08T16:59:41.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:41.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj50 /dev/null 2020-09-08T16:59:41.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:41.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj51 /dev/null 2020-09-08T16:59:41.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:41.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj52 /dev/null 2020-09-08T16:59:41.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:41.615 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj53 /dev/null 2020-09-08T16:59:41.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:41.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj54 /dev/null 2020-09-08T16:59:41.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:41.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj55 /dev/null 2020-09-08T16:59:41.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:41.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj56 /dev/null 2020-09-08T16:59:42.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:42.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj57 /dev/null 2020-09-08T16:59:42.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:42.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj58 /dev/null 2020-09-08T16:59:42.476 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:42.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj59 /dev/null 2020-09-08T16:59:42.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:42.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj60 /dev/null 2020-09-08T16:59:42.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:42.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj61 /dev/null 2020-09-08T16:59:42.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:42.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj62 /dev/null 2020-09-08T16:59:42.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:42.820 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj63 /dev/null 2020-09-08T16:59:42.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:42.920 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj64 /dev/null 2020-09-08T16:59:42.995 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:42.996 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj65 /dev/null 2020-09-08T16:59:43.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:43.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj66 /dev/null 2020-09-08T16:59:43.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:43.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj67 /dev/null 2020-09-08T16:59:43.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:43.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj68 /dev/null 2020-09-08T16:59:43.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:43.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj69 /dev/null 2020-09-08T16:59:43.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:43.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj70 /dev/null 2020-09-08T16:59:43.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:43.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj71 /dev/null 2020-09-08T16:59:43.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:43.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj72 /dev/null 2020-09-08T16:59:43.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:43.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj73 /dev/null 2020-09-08T16:59:43.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:43.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj74 /dev/null 2020-09-08T16:59:43.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:43.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj75 /dev/null 2020-09-08T16:59:43.999 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:44.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj76 /dev/null 2020-09-08T16:59:44.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:44.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj77 /dev/null 2020-09-08T16:59:44.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:44.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj78 /dev/null 2020-09-08T16:59:44.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:44.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj79 /dev/null 2020-09-08T16:59:44.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:44.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj80 /dev/null 2020-09-08T16:59:44.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:44.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj81 /dev/null 2020-09-08T16:59:44.577 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:44.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj82 /dev/null 2020-09-08T16:59:44.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:44.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj83 /dev/null 2020-09-08T16:59:44.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:44.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj84 /dev/null 2020-09-08T16:59:44.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:44.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj85 /dev/null 2020-09-08T16:59:44.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:44.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj86 /dev/null 2020-09-08T16:59:45.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:45.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj87 /dev/null 2020-09-08T16:59:45.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:45.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj88 /dev/null 2020-09-08T16:59:45.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:45.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj89 /dev/null 2020-09-08T16:59:45.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:45.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj90 /dev/null 2020-09-08T16:59:45.405 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:45.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj91 /dev/null 2020-09-08T16:59:45.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:45.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj92 /dev/null 2020-09-08T16:59:45.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:45.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj93 /dev/null 2020-09-08T16:59:45.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:45.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj94 /dev/null 2020-09-08T16:59:45.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:45.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj95 /dev/null 2020-09-08T16:59:45.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:45.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj96 /dev/null 2020-09-08T16:59:46.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:46.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj97 /dev/null 2020-09-08T16:59:46.108 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:46.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj98 /dev/null 2020-09-08T16:59:46.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:46.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj99 /dev/null 2020-09-08T16:59:46.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:46.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj100 /dev/null 2020-09-08T16:59:46.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:46.385 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj101 /dev/null 2020-09-08T16:59:46.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:46.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj102 /dev/null 2020-09-08T16:59:46.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:46.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj103 /dev/null 2020-09-08T16:59:46.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:46.651 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj104 /dev/null 2020-09-08T16:59:46.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:46.759 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj105 /dev/null 2020-09-08T16:59:46.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:46.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj106 /dev/null 2020-09-08T16:59:46.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:46.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj107 /dev/null 2020-09-08T16:59:47.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:47.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj108 /dev/null 2020-09-08T16:59:47.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:47.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj109 /dev/null 2020-09-08T16:59:47.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:47.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj110 /dev/null 2020-09-08T16:59:47.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:47.319 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj111 /dev/null 2020-09-08T16:59:47.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:47.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj112 /dev/null 2020-09-08T16:59:47.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:47.529 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj113 /dev/null 2020-09-08T16:59:47.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:47.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj114 /dev/null 2020-09-08T16:59:47.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:47.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj115 /dev/null 2020-09-08T16:59:47.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:47.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj116 /dev/null 2020-09-08T16:59:47.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:47.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj117 /dev/null 2020-09-08T16:59:48.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:48.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj118 /dev/null 2020-09-08T16:59:48.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:48.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj119 /dev/null 2020-09-08T16:59:48.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:48.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj120 /dev/null 2020-09-08T16:59:48.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:48.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj121 /dev/null 2020-09-08T16:59:48.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:48.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj122 /dev/null 2020-09-08T16:59:48.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:48.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj123 /dev/null 2020-09-08T16:59:48.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:48.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj124 /dev/null 2020-09-08T16:59:48.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:48.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj125 /dev/null 2020-09-08T16:59:48.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:48.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj126 /dev/null 2020-09-08T16:59:48.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:48.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj127 /dev/null 2020-09-08T16:59:49.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:49.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj128 /dev/null 2020-09-08T16:59:49.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:49.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj129 /dev/null 2020-09-08T16:59:49.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:49.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj130 /dev/null 2020-09-08T16:59:49.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:49.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj131 /dev/null 2020-09-08T16:59:49.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:49.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj132 /dev/null 2020-09-08T16:59:49.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:49.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj133 /dev/null 2020-09-08T16:59:49.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:49.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj134 /dev/null 2020-09-08T16:59:49.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:49.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj135 /dev/null 2020-09-08T16:59:49.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:49.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj136 /dev/null 2020-09-08T16:59:49.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:49.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj137 /dev/null 2020-09-08T16:59:49.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:49.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj138 /dev/null 2020-09-08T16:59:50.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:50.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj139 /dev/null 2020-09-08T16:59:50.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:50.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj140 /dev/null 2020-09-08T16:59:50.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:50.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj141 /dev/null 2020-09-08T16:59:50.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:50.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj142 /dev/null 2020-09-08T16:59:50.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:50.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj143 /dev/null 2020-09-08T16:59:50.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:50.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj144 /dev/null 2020-09-08T16:59:50.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:50.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj145 /dev/null 2020-09-08T16:59:50.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:50.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj146 /dev/null 2020-09-08T16:59:50.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:50.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj147 /dev/null 2020-09-08T16:59:50.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:50.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj148 /dev/null 2020-09-08T16:59:50.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:50.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj149 /dev/null 2020-09-08T16:59:51.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:51.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj150 /dev/null 2020-09-08T16:59:51.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:51.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj151 /dev/null 2020-09-08T16:59:51.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:51.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj152 /dev/null 2020-09-08T16:59:51.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:51.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj153 /dev/null 2020-09-08T16:59:51.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:51.436 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj154 /dev/null 2020-09-08T16:59:51.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:51.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj155 /dev/null 2020-09-08T16:59:51.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:51.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj156 /dev/null 2020-09-08T16:59:51.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:51.729 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj157 /dev/null 2020-09-08T16:59:51.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:51.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj158 /dev/null 2020-09-08T16:59:51.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:51.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj159 /dev/null 2020-09-08T16:59:52.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:52.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj160 /dev/null 2020-09-08T16:59:52.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:52.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj161 /dev/null 2020-09-08T16:59:52.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:52.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj162 /dev/null 2020-09-08T16:59:52.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:52.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj163 /dev/null 2020-09-08T16:59:52.381 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:52.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj164 /dev/null 2020-09-08T16:59:52.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:52.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj165 /dev/null 2020-09-08T16:59:52.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:52.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj166 /dev/null 2020-09-08T16:59:52.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:52.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj167 /dev/null 2020-09-08T16:59:52.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:52.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj168 /dev/null 2020-09-08T16:59:52.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:52.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj169 /dev/null 2020-09-08T16:59:52.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:52.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj170 /dev/null 2020-09-08T16:59:53.067 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:53.068 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj171 /dev/null 2020-09-08T16:59:53.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:53.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj172 /dev/null 2020-09-08T16:59:53.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:53.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj173 /dev/null 2020-09-08T16:59:53.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:53.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj174 /dev/null 2020-09-08T16:59:53.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:53.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj175 /dev/null 2020-09-08T16:59:53.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:53.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj176 /dev/null 2020-09-08T16:59:53.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:53.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj177 /dev/null 2020-09-08T16:59:53.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:53.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj178 /dev/null 2020-09-08T16:59:53.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:53.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj179 /dev/null 2020-09-08T16:59:53.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:53.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj180 /dev/null 2020-09-08T16:59:54.038 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:54.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj181 /dev/null 2020-09-08T16:59:54.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:54.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj182 /dev/null 2020-09-08T16:59:54.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:54.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj183 /dev/null 2020-09-08T16:59:54.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:54.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj184 /dev/null 2020-09-08T16:59:54.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:54.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj185 /dev/null 2020-09-08T16:59:54.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:54.566 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj186 /dev/null 2020-09-08T16:59:54.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:54.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj187 /dev/null 2020-09-08T16:59:54.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:54.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj188 /dev/null 2020-09-08T16:59:54.841 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:54.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj189 /dev/null 2020-09-08T16:59:54.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:54.942 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj190 /dev/null 2020-09-08T16:59:55.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:55.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj191 /dev/null 2020-09-08T16:59:55.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:55.109 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj192 /dev/null 2020-09-08T16:59:55.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:55.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj193 /dev/null 2020-09-08T16:59:55.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:55.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj194 /dev/null 2020-09-08T16:59:55.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:55.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj195 /dev/null 2020-09-08T16:59:55.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:55.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj196 /dev/null 2020-09-08T16:59:55.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:55.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj197 /dev/null 2020-09-08T16:59:55.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:55.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj198 /dev/null 2020-09-08T16:59:55.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:55.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj199 /dev/null 2020-09-08T16:59:55.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2020-09-08T16:59:55.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj200 /dev/null 2020-09-08T16:59:55.971 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:409: TEST_backfill_sizeup4_allout: get_pg test obj1 2020-09-08T16:59:55.972 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1031: get_pg: local poolname=test 2020-09-08T16:59:55.972 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: local objectname=obj1 2020-09-08T16:59:55.972 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: ceph --format json osd map test obj1 2020-09-08T16:59:55.972 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: jq -r .pgid 2020-09-08T16:59:56.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:409: TEST_backfill_sizeup4_allout: local PG=1.0 2020-09-08T16:59:56.366 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:411: TEST_backfill_sizeup4_allout: get_primary test obj1 2020-09-08T16:59:56.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:59:56.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:59:56.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:59:56.367 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:59:56.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:411: TEST_backfill_sizeup4_allout: local primary=1 2020-09-08T16:59:56.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:412: TEST_backfill_sizeup4_allout: get_not_primary test obj1 2020-09-08T16:59:56.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1167: get_not_primary: local poolname=test 2020-09-08T16:59:56.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: get_not_primary: local objectname=obj1 2020-09-08T16:59:56.787 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: get_primary test obj1 2020-09-08T16:59:56.787 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T16:59:56.787 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T16:59:56.788 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T16:59:56.788 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T16:59:57.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: local primary=1 2020-09-08T16:59:57.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1171: get_not_primary: ceph --format json osd map test obj1 2020-09-08T16:59:57.210 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1172: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2020-09-08T16:59:57.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:412: TEST_backfill_sizeup4_allout: local otherosd=0 2020-09-08T16:59:57.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:414: TEST_backfill_sizeup4_allout: ceph osd set nobackfill 2020-09-08T16:59:58.409 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is set 2020-09-08T16:59:58.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:415: TEST_backfill_sizeup4_allout: ceph osd out osd.0 2020-09-08T16:59:59.006 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already out. 2020-09-08T16:59:59.014 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:416: TEST_backfill_sizeup4_allout: ceph osd out osd.1 2020-09-08T16:59:59.841 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already out. 2020-09-08T16:59:59.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:417: TEST_backfill_sizeup4_allout: ceph osd pool set test size 4 2020-09-08T17:00:00.676 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 4 2020-09-08T17:00:00.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:419: TEST_backfill_sizeup4_allout: sleep 2 2020-09-08T17:00:02.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:420: TEST_backfill_sizeup4_allout: get_primary test obj1 2020-09-08T17:00:02.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T17:00:02.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T17:00:02.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T17:00:02.688 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T17:00:03.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:420: TEST_backfill_sizeup4_allout: primary=1 2020-09-08T17:00:03.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:421: TEST_backfill_sizeup4_allout: ceph osd unset nobackfill 2020-09-08T17:00:03.913 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is unset 2020-09-08T17:00:03.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:422: TEST_backfill_sizeup4_allout: ceph tell osd.1 get_latest_osdmap 2020-09-08T17:00:04.054 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:423: TEST_backfill_sizeup4_allout: ceph tell osd.1 debug kick_recovery_wq 0 2020-09-08T17:00:04.202 INFO:tasks.workunit.client.0.smithi065.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2020-09-08T17:00:04.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:424: TEST_backfill_sizeup4_allout: sleep 2 2020-09-08T17:00:06.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:426: TEST_backfill_sizeup4_allout: wait_for_clean 2020-09-08T17:00:06.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T17:00:06.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T17:00:06.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T17:00:06.213 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T17:00:06.213 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T17:00:06.214 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T17:00:06.214 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T17:00:06.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T17:00:06.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T17:00:06.215 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T17:00:06.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T17:00:06.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T17:00:06.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T17:00:06.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T17:00:06.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T17:00:06.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T17:00:06.715 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T17:00:06.715 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T17:00:06.716 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T17:00:06.716 INFO:tasks.workunit.client.0.smithi065.stderr:4' 2020-09-08T17:00:06.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T17:00:06.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:00:06.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T17:00:06.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836498 2020-09-08T17:00:06.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836498 2020-09-08T17:00:06.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498' 2020-09-08T17:00:06.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:00:06.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T17:00:06.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672978 2020-09-08T17:00:06.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672978 2020-09-08T17:00:06.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498 1-42949672978' 2020-09-08T17:00:06.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:00:06.980 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T17:00:07.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=60129542159 2020-09-08T17:00:07.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 60129542159 2020-09-08T17:00:07.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498 1-42949672978 2-60129542159' 2020-09-08T17:00:07.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:00:07.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T17:00:07.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=81604378638 2020-09-08T17:00:07.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 81604378638 2020-09-08T17:00:07.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498 1-42949672978 2-60129542159 3-81604378638' 2020-09-08T17:00:07.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:00:07.246 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T17:00:07.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=103079215117 2020-09-08T17:00:07.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 103079215117 2020-09-08T17:00:07.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498 1-42949672978 2-60129542159 3-81604378638 4-103079215117' 2020-09-08T17:00:07.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:00:07.375 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836498 2020-09-08T17:00:07.375 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:00:07.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T17:00:07.376 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836498 2020-09-08T17:00:07.376 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:00:07.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836498 2020-09-08T17:00:07.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836498' 2020-09-08T17:00:07.377 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T17:00:07.378 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836498 2020-09-08T17:00:07.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836496 -lt 21474836498 2020-09-08T17:00:07.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T17:00:08.775 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T17:00:08.776 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T17:00:09.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836499 -lt 21474836498 2020-09-08T17:00:09.183 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:00:09.183 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672978 2020-09-08T17:00:09.184 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:00:09.184 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T17:00:09.184 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672978 2020-09-08T17:00:09.185 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:00:09.185 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672978 2020-09-08T17:00:09.186 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672978' 2020-09-08T17:00:09.186 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T17:00:09.186 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672978 2020-09-08T17:00:09.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672978 -lt 42949672978 2020-09-08T17:00:09.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:00:09.581 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-60129542159 2020-09-08T17:00:09.581 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:00:09.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T17:00:09.582 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-60129542159 2020-09-08T17:00:09.582 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:00:09.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=60129542159 2020-09-08T17:00:09.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 60129542159' 2020-09-08T17:00:09.583 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T17:00:09.584 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 60129542159 2020-09-08T17:00:10.017 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 60129542160 -lt 60129542159 2020-09-08T17:00:10.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:00:10.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-81604378638 2020-09-08T17:00:10.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:00:10.019 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T17:00:10.020 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-81604378638 2020-09-08T17:00:10.020 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:00:10.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=81604378638 2020-09-08T17:00:10.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 81604378638' 2020-09-08T17:00:10.025 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T17:00:10.025 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 81604378638 2020-09-08T17:00:10.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 81604378638 -lt 81604378638 2020-09-08T17:00:10.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:00:10.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-103079215117 2020-09-08T17:00:10.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:00:10.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T17:00:10.418 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-103079215117 2020-09-08T17:00:10.418 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:00:10.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=103079215117 2020-09-08T17:00:10.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 103079215117' 2020-09-08T17:00:10.419 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T17:00:10.420 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 103079215117 2020-09-08T17:00:10.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 103079215118 -lt 103079215117 2020-09-08T17:00:10.810 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T17:00:10.811 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:10.811 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:11.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T17:00:11.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:11.331 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:11.331 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:11.331 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:11.331 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:11.331 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:11.332 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:11.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:11.722 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:11.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:11.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:12.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:12.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T17:00:12.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T17:00:12.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T17:00:12.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:12.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:12.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:12.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:12.353 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:12.353 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:12.353 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:12.354 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:12.354 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:12.354 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:12.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:12.731 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:12.732 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:12.732 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:13.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:13.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:13.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:13.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:13.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:13.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:13.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:13.624 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:13.624 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:14.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T17:00:14.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T17:00:14.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:14.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:14.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:14.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:14.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:14.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:14.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:14.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:14.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:14.248 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:14.248 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:14.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:14.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:14.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:14.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:15.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:15.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:15.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:15.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:15.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:15.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:15.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:15.195 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:15.195 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:15.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T17:00:15.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T17:00:15.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:15.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:15.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:15.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:15.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:15.826 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:15.826 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:15.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:15.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:15.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:15.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:16.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:16.271 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:16.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:16.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:16.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:16.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:16.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:16.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:16.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:16.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:16.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:16.795 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:16.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:17.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:00:17.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:00:17.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:17.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:17.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:17.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:17.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:17.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:17.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:17.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:17.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:17.443 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:17.443 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:17.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:17.819 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:17.820 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:17.820 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:18.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:18.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:18.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:18.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:18.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:18.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:18.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:18.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:18.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:18.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:00:18.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:00:18.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:18.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:18.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:18.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:18.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:18.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:18.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:18.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:18.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:18.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:18.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:19.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:19.351 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:19.352 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:19.352 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:19.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:19.895 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:19.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:19.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:19.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:19.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:19.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:19.897 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:19.897 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:20.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T17:00:20.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T17:00:20.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:20.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:20.435 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:20.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:20.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:20.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:20.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:20.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:20.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:20.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:20.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:20.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:20.921 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:20.922 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:20.922 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:21.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:21.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:21.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:21.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:21.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:21.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:21.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:21.488 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:21.488 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:22.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T17:00:22.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T17:00:22.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:22.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:22.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:22.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:22.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:22.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:22.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:22.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:22.154 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:22.154 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:22.154 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:22.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:22.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:22.533 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:22.533 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:23.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:23.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:23.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:23.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:23.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:23.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:23.053 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:23.053 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:23.053 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:23.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T17:00:23.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T17:00:23.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:23.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:23.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:23.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:23.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:23.676 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:23.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:23.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:23.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:23.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:23.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:24.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:24.061 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:24.061 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:24.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:24.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:24.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:24.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:24.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:24.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:24.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:24.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:24.583 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:24.584 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:25.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:00:25.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:00:25.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:25.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:25.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:25.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:25.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:25.199 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:25.199 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:25.199 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:25.200 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:25.200 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:25.201 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:25.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:25.581 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:25.582 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:25.582 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:26.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:26.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:26.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:26.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:26.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:26.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:26.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:26.098 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:26.098 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:26.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T17:00:26.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T17:00:26.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:26.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:26.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:26.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:26.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:26.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:26.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:26.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:26.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:26.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:26.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:27.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:27.104 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:27.105 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:27.105 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:27.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:27.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:27.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:27.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:27.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:27.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:27.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:27.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:27.628 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:28.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:00:28.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:00:28.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:28.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:28.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:28.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:28.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:28.250 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:28.250 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:28.251 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:28.251 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:28.251 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:28.251 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:28.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:28.634 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:28.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:28.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:29.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:29.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:29.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:29.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:29.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:29.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:29.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:29.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:29.159 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:29.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:00:29.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:00:29.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:29.750 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:29.751 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:29.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:29.850 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:29.851 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:29.851 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:29.852 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:29.852 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:29.852 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:29.852 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:30.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:30.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:30.235 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:30.235 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:30.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:30.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:30.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:30.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:30.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:30.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:30.758 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:30.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:30.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:31.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:00:31.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:00:31.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:31.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:31.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:31.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:31.380 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:31.380 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:31.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:31.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:31.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:31.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:31.382 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:31.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:31.762 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:31.768 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:31.768 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:32.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:32.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:32.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:32.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:32.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:32.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:32.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:32.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:32.291 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:32.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T17:00:32.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T17:00:32.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:32.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:32.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:32.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:32.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:32.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:32.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:32.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:32.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:32.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:32.986 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:33.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:33.372 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:33.373 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:33.373 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:33.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:33.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:33.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:33.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:33.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:33.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:33.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:33.901 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:33.901 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:34.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:00:34.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:00:34.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:34.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:34.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:34.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:34.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:34.530 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:34.530 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:34.531 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:34.531 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:34.531 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:34.531 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:34.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:34.916 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:34.917 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:34.917 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:35.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:35.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:35.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:35.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:35.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:35.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:35.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:35.440 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:35.440 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:35.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:00:35.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:00:35.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:35.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:35.992 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:36.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:36.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:36.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:36.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:36.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:36.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:36.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:36.094 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:36.475 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:36.475 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:36.476 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:36.476 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:36.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:36.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:36.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:36.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:36.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:36.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:36.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:36.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:36.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:37.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T17:00:37.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T17:00:37.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:37.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:37.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:37.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:37.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:37.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:37.655 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:37.656 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:37.656 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:37.656 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:37.656 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:38.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:38.036 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:38.037 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:38.037 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:38.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:38.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:38.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:38.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:38.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:38.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:38.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:38.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:38.564 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:39.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:00:39.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:00:39.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:39.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:39.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:39.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:39.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:39.210 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:39.210 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:39.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:39.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:39.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:39.211 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:39.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:39.593 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:39.593 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:39.594 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:40.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:40.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:40.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:40.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:40.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:40.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:40.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:40.120 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:40.120 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:40.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:00:40.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:00:40.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:40.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:40.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:40.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:40.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:40.754 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:40.755 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:40.755 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:40.755 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:40.755 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:40.755 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:41.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:41.141 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:41.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:41.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:41.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:41.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:41.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:41.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:41.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:41.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:41.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:41.672 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:41.672 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:42.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T17:00:42.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T17:00:42.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:42.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:42.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:42.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:42.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:42.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:42.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:42.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:42.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:42.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:42.291 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:42.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:42.670 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:42.670 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:42.671 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:43.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:43.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:43.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:43.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:43.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:43.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:43.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:43.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:43.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:43.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T17:00:43.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T17:00:43.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:43.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:43.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:43.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:43.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:43.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:43.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:43.839 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:43.840 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:43.840 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:43.840 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:44.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:44.219 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:44.220 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:44.220 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:44.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:44.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:44.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:44.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:44.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:44.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:44.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:44.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:44.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:45.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:00:45.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:00:45.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:45.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:45.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:45.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:45.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:45.512 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:45.513 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:45.513 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:45.513 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:45.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:45.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:45.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:45.892 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:45.892 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:45.892 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:46.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:46.421 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:46.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:46.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:46.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:46.422 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:46.423 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:46.423 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:46.423 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:46.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T17:00:46.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T17:00:46.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:46.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:46.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:47.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:47.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:47.078 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:47.078 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:47.078 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:47.078 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:47.079 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:47.079 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:47.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:47.460 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:47.460 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:47.461 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:47.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:47.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:47.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:47.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:47.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:47.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:47.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:47.983 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:47.984 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:48.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:00:48.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:00:48.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:48.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:48.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:48.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:48.602 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:48.602 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:48.602 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:48.602 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:48.603 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:48.603 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:48.603 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:48.993 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:48.994 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:48.994 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:48.995 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:49.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:49.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:49.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:49.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:49.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:49.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:49.520 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:49.520 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:49.520 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:50.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:00:50.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:00:50.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:50.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:50.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:50.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:50.225 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:50.225 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:50.225 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:50.226 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:50.226 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:50.226 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:50.227 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:50.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:50.608 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:50.608 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:50.609 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:51.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:51.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:51.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:51.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:51.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:51.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:51.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:51.134 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:51.134 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:51.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:00:51.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:00:51.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:51.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:51.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:51.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:51.785 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:51.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:51.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:51.786 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:51.787 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:51.787 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:51.787 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:52.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:52.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:52.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:52.168 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:52.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:52.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:52.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:52.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:52.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:52.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:52.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:52.693 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:52.693 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:53.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T17:00:53.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T17:00:53.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:53.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:53.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:53.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:53.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:53.359 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:53.359 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:53.359 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:53.359 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:53.359 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:53.360 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:53.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:53.739 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:53.739 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:53.739 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:54.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:54.321 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:54.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:54.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:54.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:54.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:54.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:54.324 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:54.324 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:54.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:00:54.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:00:54.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:54.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:54.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:54.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:54.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:54.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:54.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:54.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:54.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:54.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:54.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:55.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:55.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:55.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:55.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:55.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:55.962 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:55.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:55.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:55.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:55.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:55.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:55.964 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:55.964 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:56.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T17:00:56.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T17:00:56.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:56.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:56.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:56.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:56.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:56.588 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:56.588 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:56.588 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:56.588 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:56.589 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:56.589 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:56.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:56.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:56.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:56.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:57.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:57.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:57.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:57.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:57.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:57.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:57.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:57.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:57.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:58.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T17:00:58.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T17:00:58.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:58.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:58.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:58.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:58.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:58.111 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:58.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:58.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:58.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:58.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:58.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:00:58.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:00:58.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:00:58.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:00:58.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:00:59.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:00:59.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:00:59.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:00:59.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:00:59.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:00:59.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:00:59.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:00:59.012 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:00:59.013 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:00:59.532 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T17:00:59.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T17:00:59.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:00:59.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:00:59.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:00:59.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:00:59.634 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:00:59.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:00:59.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:00:59.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:00:59.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:00:59.635 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:00:59.636 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:01:00.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T17:01:00.012 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:01:00.013 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:01:00.013 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:01:00.530 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T17:01:00.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T17:01:00.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T17:01:00.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:428: TEST_backfill_sizeup4_allout: expr 200 '*' 2 2020-09-08T17:01:00.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:428: TEST_backfill_sizeup4_allout: local misdeg=400 2020-09-08T17:01:00.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:429: TEST_backfill_sizeup4_allout: check td/osd-backfill-stats 1.0 1 replicated 400 0 400 200 2020-09-08T17:01:00.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2020-09-08T17:01:00.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:64: check: local PG=1.0 2020-09-08T17:01:00.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:65: check: local primary=1 2020-09-08T17:01:00.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:66: check: local type=replicated 2020-09-08T17:01:00.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:67: check: local degraded_start=400 2020-09-08T17:01:00.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:68: check: local degraded_end=0 2020-09-08T17:01:00.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:69: check: local misplaced_start=400 2020-09-08T17:01:00.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:70: check: local misplaced_end=200 2020-09-08T17:01:00.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:71: check: local primary_start= 2020-09-08T17:01:00.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:72: check: local primary_end= 2020-09-08T17:01:00.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:73: check: local check_setup=true 2020-09-08T17:01:00.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2020-09-08T17:01:00.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2020-09-08T17:01:00.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:76: check: '[' true = true ']' 2020-09-08T17:01:00.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log 2020-09-08T17:01:00.545 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2020-09-08T17:01:00.545 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2020-09-08T17:01:00.546 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: wc -w 2020-09-08T17:01:00.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2020-09-08T17:01:00.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:86: check: local 'addp= ' 2020-09-08T17:01:00.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:87: check: '[' replicated = erasure ']' 2020-09-08T17:01:00.548 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2020-09-08T17:01:00.548 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats ' td/osd-backfill-stats/osd.1.log 2020-09-08T17:01:00.548 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: tail -1 2020-09-08T17:01:00.548 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2020-09-08T17:01:00.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: UPACT='[2,4,3]/[1,0]' 2020-09-08T17:01:00.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:93: check: '[' -n '[2,4,3]/[1,0]' ']' 2020-09-08T17:01:00.573 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:96: check: local which=degraded 2020-09-08T17:01:00.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T17:01:00.575 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2020-09-08T17:01:00.575 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -F ' [2,4,3]/[1,0] ' 2020-09-08T17:01:00.575 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -v est 2020-09-08T17:01:00.575 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: head -1 2020-09-08T17:01:00.575 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T17:01:00.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: FIRST=400 2020-09-08T17:01:00.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:98: check: '[' -n 400 ']' 2020-09-08T17:01:00.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:99: check: below_margin 400 400 2020-09-08T17:01:00.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=400 2020-09-08T17:01:00.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T17:01:00.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=400 2020-09-08T17:01:00.580 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T17:01:00.580 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T17:01:00.580 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2020-09-08T17:01:00.581 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: tail -1 2020-09-08T17:01:00.581 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T17:01:00.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: LAST=2 2020-09-08T17:01:00.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:101: check: '[' -n 2 ']' 2020-09-08T17:01:00.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:102: check: above_margin 2 0 2020-09-08T17:01:00.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=2 2020-09-08T17:01:00.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T17:01:00.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=0 2020-09-08T17:01:00.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T17:01:00.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:105: check: which=misplaced 2020-09-08T17:01:00.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T17:01:00.592 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2020-09-08T17:01:00.592 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -F ' [2,4,3]/[1,0] ' 2020-09-08T17:01:00.593 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -v est 2020-09-08T17:01:00.593 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: head -1 2020-09-08T17:01:00.593 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T17:01:00.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: FIRST=400 2020-09-08T17:01:00.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:107: check: '[' -n 400 ']' 2020-09-08T17:01:00.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:108: check: below_margin 400 400 2020-09-08T17:01:00.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=400 2020-09-08T17:01:00.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T17:01:00.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=400 2020-09-08T17:01:00.596 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T17:01:00.597 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T17:01:00.597 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2020-09-08T17:01:00.597 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: tail -1 2020-09-08T17:01:00.598 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T17:01:00.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: LAST=201 2020-09-08T17:01:00.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:110: check: '[' -n 201 ']' 2020-09-08T17:01:00.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:111: check: above_margin 201 200 2020-09-08T17:01:00.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=201 2020-09-08T17:01:00.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T17:01:00.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=200 2020-09-08T17:01:00.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T17:01:00.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2020-09-08T17:01:00.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:431: TEST_backfill_sizeup4_allout: delete_pool test 2020-09-08T17:01:00.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test 2020-09-08T17:01:00.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2020-09-08T17:01:01.118 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' does not exist 2020-09-08T17:01:01.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:432: TEST_backfill_sizeup4_allout: kill_daemons td/osd-backfill-stats 2020-09-08T17:01:01.127 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:01:01.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:01:01.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:01:01.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:01:01.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:01:01.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:01:01.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2020-09-08T17:01:01.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T17:01:01.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T17:01:01.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T17:01:01.238 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:01:01.239 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:01:01.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:01:01.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:01:01.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:01:01.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:01:01.244 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:01:01.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:01:01.245 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:01:01.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:01:01.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:01:01.246 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:01:01.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:01:01.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:01:01.248 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:01:01.248 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:01:01.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:01:01.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T17:01:01.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T17:01:01.265 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:01:01.265 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:01:01.266 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T17:01:01.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T17:01:01.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:01:01.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:01:01.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:35: run: for func in $funcs 2020-09-08T17:01:01.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2020-09-08T17:01:01.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2020-09-08T17:01:01.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2020-09-08T17:01:01.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T17:01:01.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T17:01:01.269 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T17:01:01.269 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:01:01.270 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:01:01.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:01:01.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:01:01.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:01:01.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:01:01.271 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:01:01.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:01:01.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:01:01.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:01:01.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:01:01.272 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:01:01.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:01:01.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:01:01.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:01:01.274 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:01:01.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:01:01.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T17:01:01.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T17:01:01.276 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:01:01.276 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:01:01.276 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T17:01:01.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T17:01:01.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:01:01.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:01:01.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2020-09-08T17:01:01.278 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T17:01:01.279 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:01:01.279 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T17:01:01.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.482138 2020-09-08T17:01:01.281 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T17:01:01.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T17:01:01.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T17:01:01.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2020-09-08T17:01:01.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:37: run: TEST_backfill_sizeup_out td/osd-backfill-stats 2020-09-08T17:01:01.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:182: TEST_backfill_sizeup_out: local dir=td/osd-backfill-stats 2020-09-08T17:01:01.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:184: TEST_backfill_sizeup_out: run_mon td/osd-backfill-stats a 2020-09-08T17:01:01.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2020-09-08T17:01:01.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T17:01:01.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T17:01:01.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T17:01:01.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2020-09-08T17:01:01.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2020-09-08T17:01:01.578 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T17:01:01.578 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:01:01.578 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:01:01.579 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:01:01.579 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:01:01.579 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T17:01:01.579 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T17:01:01.579 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T17:01:01.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T17:01:01.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T17:01:01.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T17:01:01.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T17:01:01.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T17:01:01.783 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T17:01:01.783 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T17:01:01.783 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T17:01:01.783 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T17:01:01.784 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T17:01:01.784 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:01:01.784 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T17:01:01.784 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T17:01:01.784 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T17:01:01.785 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get fsid 2020-09-08T17:01:01.878 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T17:01:01.878 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T17:01:01.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T17:01:01.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T17:01:01.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T17:01:01.879 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T17:01:01.880 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T17:01:01.880 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T17:01:01.880 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T17:01:01.880 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:01:01.880 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T17:01:01.881 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.482138/ceph-mon.a.asok 2020-09-08T17:01:01.881 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T17:01:01.882 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.482138/ceph-mon.a.asok config get mon_host 2020-09-08T17:01:01.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:185: TEST_backfill_sizeup_out: run_mgr td/osd-backfill-stats x 2020-09-08T17:01:01.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-backfill-stats 2020-09-08T17:01:01.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T17:01:01.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T17:01:01.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T17:01:01.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-backfill-stats/x 2020-09-08T17:01:01.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T17:01:02.869 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T17:01:02.869 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:01:02.869 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:01:02.870 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:01:02.870 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:01:02.870 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T17:01:02.870 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T17:01:02.871 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T17:01:02.871 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T17:01:02.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:186: TEST_backfill_sizeup_out: run_osd td/osd-backfill-stats 0 2020-09-08T17:01:02.896 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T17:01:02.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T17:01:02.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T17:01:02.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T17:01:02.897 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/0 2020-09-08T17:01:02.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T17:01:02.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:01:02.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:01:02.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:01:02.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2020-09-08T17:01:02.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2020-09-08T17:01:02.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T17:01:02.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T17:01:02.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T17:01:02.899 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T17:01:02.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:01:02.900 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:01:02.900 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:01:02.900 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:01:02.900 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T17:01:02.901 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T17:01:02.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T17:01:02.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:01:02.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T17:01:02.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T17:01:02.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T17:01:02.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T17:01:02.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:01:02.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:01:02.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:01:02.902 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T17:01:02.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T17:01:02.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/0 2020-09-08T17:01:02.904 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T17:01:02.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=fecee306-b107-4d96-9ea6-bd45b561e307 2020-09-08T17:01:02.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 fecee306-b107-4d96-9ea6-bd45b561e307' 2020-09-08T17:01:02.904 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T17:01:02.905 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 fecee306-b107-4d96-9ea6-bd45b561e307 2020-09-08T17:01:02.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDOuFdfwBbANhAAsqReo9eNWtPsVbSqibKO4g== 2020-09-08T17:01:02.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDOuFdfwBbANhAAsqReo9eNWtPsVbSqibKO4g=="}' 2020-09-08T17:01:02.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new fecee306-b107-4d96-9ea6-bd45b561e307 -i td/osd-backfill-stats/0/new.json 2020-09-08T17:01:03.256 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:01:03.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/0/new.json 2020-09-08T17:01:03.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDOuFdfwBbANhAAsqReo9eNWtPsVbSqibKO4g== --osd-uuid fecee306-b107-4d96-9ea6-bd45b561e307 2020-09-08T17:01:03.292 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:03.297+0000 7f497863dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:03.293 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:03.298+0000 7f497863dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:03.295 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:03.300+0000 7f497863dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:03.295 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:03.300+0000 7f497863dec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T17:01:03.296 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:03.300+0000 7f497863dec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T17:01:03.296 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:03.300+0000 7f497863dec0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2020-09-08T17:01:03.343 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:03.347+0000 7f497863dec0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2020-09-08T17:01:07.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2020-09-08T17:01:07.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T17:01:07.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T17:01:07.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:01:07.689 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T17:01:08.227 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T17:01:08.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T17:01:08.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:01:08.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T17:01:08.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T17:01:08.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T17:01:08.251 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:08.256+0000 7fb50aef9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:08.257 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:08.262+0000 7fb50aef9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:08.259 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:08.264+0000 7fb50aef9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:08.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T17:01:08.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:01:08.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T17:01:08.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:01:08.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:01:08.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:01:08.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:01:08.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:01:08.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:01:08.622 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:01:08.775 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:08.780+0000 7fb50aef9ec0 -1 Falling back to public interface 2020-09-08T17:01:09.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:01:09.574 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:09.579+0000 7fb50aef9ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T17:01:10.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:01:10.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:01:10.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:01:10.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:01:10.032 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:01:10.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:01:10.450 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/614176,v1:127.0.0.1:6803/614176] [v2:127.0.0.1:6804/614176,v1:127.0.0.1:6805/614176] exists,up fecee306-b107-4d96-9ea6-bd45b561e307 2020-09-08T17:01:10.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:01:10.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:01:10.451 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:01:10.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:187: TEST_backfill_sizeup_out: run_osd td/osd-backfill-stats 1 2020-09-08T17:01:10.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T17:01:10.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T17:01:10.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T17:01:10.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T17:01:10.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/1 2020-09-08T17:01:10.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T17:01:10.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:01:10.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:01:10.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:01:10.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2020-09-08T17:01:10.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2020-09-08T17:01:10.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T17:01:10.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T17:01:10.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T17:01:10.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T17:01:10.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:01:10.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:01:10.455 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:01:10.455 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:01:10.456 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T17:01:10.456 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T17:01:10.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T17:01:10.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:01:10.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T17:01:10.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T17:01:10.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T17:01:10.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T17:01:10.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:01:10.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:01:10.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:01:10.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T17:01:10.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T17:01:10.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/1 2020-09-08T17:01:10.458 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T17:01:10.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=ab7dfef5-c02c-4323-9b12-a667cda2486d 2020-09-08T17:01:10.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 ab7dfef5-c02c-4323-9b12-a667cda2486d' 2020-09-08T17:01:10.460 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T17:01:10.460 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 ab7dfef5-c02c-4323-9b12-a667cda2486d 2020-09-08T17:01:10.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDWuFdfuW0iHBAAWtLnETi7pQuWn8g6G6k77Q== 2020-09-08T17:01:10.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDWuFdfuW0iHBAAWtLnETi7pQuWn8g6G6k77Q=="}' 2020-09-08T17:01:10.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new ab7dfef5-c02c-4323-9b12-a667cda2486d -i td/osd-backfill-stats/1/new.json 2020-09-08T17:01:10.972 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:01:10.983 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/1/new.json 2020-09-08T17:01:10.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDWuFdfuW0iHBAAWtLnETi7pQuWn8g6G6k77Q== --osd-uuid ab7dfef5-c02c-4323-9b12-a667cda2486d 2020-09-08T17:01:11.009 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:11.014+0000 7fd80a915ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:11.011 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:11.016+0000 7fd80a915ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:11.012 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:11.017+0000 7fd80a915ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:11.013 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:11.018+0000 7fd80a915ec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T17:01:11.013 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:11.018+0000 7fd80a915ec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T17:01:11.013 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:11.018+0000 7fd80a915ec0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2020-09-08T17:01:11.047 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:11.052+0000 7fd80a915ec0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2020-09-08T17:01:15.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2020-09-08T17:01:15.598 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T17:01:15.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T17:01:15.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:01:15.600 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T17:01:16.135 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T17:01:16.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T17:01:16.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:01:16.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T17:01:16.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T17:01:16.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T17:01:16.158 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:16.162+0000 7f0e418afec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:16.170 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:16.174+0000 7f0e418afec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:16.172 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:16.176+0000 7f0e418afec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:16.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T17:01:16.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:01:16.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T17:01:16.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:01:16.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:01:16.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:01:16.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:01:16.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:01:16.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:01:16.527 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:01:16.688 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:16.691+0000 7f0e418afec0 -1 Falling back to public interface 2020-09-08T17:01:16.948 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:01:17.512 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:17.516+0000 7f0e418afec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T17:01:17.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:01:17.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:01:17.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:01:17.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:01:17.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:01:17.951 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:01:18.358 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/615170,v1:127.0.0.1:6811/615170] [v2:127.0.0.1:6812/615170,v1:127.0.0.1:6813/615170] exists,up ab7dfef5-c02c-4323-9b12-a667cda2486d 2020-09-08T17:01:18.358 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 0e4269e4-f7e1-4c55-9149-7909b26421f0 2020-09-08T17:01:18.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:01:18.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:01:18.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:01:18.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:188: TEST_backfill_sizeup_out: run_osd td/osd-backfill-stats 2 2020-09-08T17:01:18.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T17:01:18.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T17:01:18.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T17:01:18.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T17:01:18.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/2 2020-09-08T17:01:18.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T17:01:18.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:01:18.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:01:18.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:01:18.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2020-09-08T17:01:18.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2020-09-08T17:01:18.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T17:01:18.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T17:01:18.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T17:01:18.363 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T17:01:18.363 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:01:18.363 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:01:18.363 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:01:18.363 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:01:18.364 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T17:01:18.364 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T17:01:18.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T17:01:18.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:01:18.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T17:01:18.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T17:01:18.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T17:01:18.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T17:01:18.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:01:18.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:01:18.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:01:18.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T17:01:18.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T17:01:18.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/2 2020-09-08T17:01:18.372 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T17:01:18.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=0e4269e4-f7e1-4c55-9149-7909b26421f0 2020-09-08T17:01:18.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 0e4269e4-f7e1-4c55-9149-7909b26421f0' 2020-09-08T17:01:18.373 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T17:01:18.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDeuFdfik1xFhAAwmA7Z9SAmifEnqwujJCCew== 2020-09-08T17:01:18.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDeuFdfik1xFhAAwmA7Z9SAmifEnqwujJCCew=="}' 2020-09-08T17:01:18.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 0e4269e4-f7e1-4c55-9149-7909b26421f0 -i td/osd-backfill-stats/2/new.json 2020-09-08T17:01:18.960 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T17:01:18.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/2/new.json 2020-09-08T17:01:18.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDeuFdfik1xFhAAwmA7Z9SAmifEnqwujJCCew== --osd-uuid 0e4269e4-f7e1-4c55-9149-7909b26421f0 2020-09-08T17:01:18.997 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:19.001+0000 7fb168b99ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:18.998 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:19.003+0000 7fb168b99ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:19.000 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:19.005+0000 7fb168b99ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:19.001 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:19.006+0000 7fb168b99ec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T17:01:19.001 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:19.006+0000 7fb168b99ec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T17:01:19.001 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:19.006+0000 7fb168b99ec0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2020-09-08T17:01:19.084 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:19.088+0000 7fb168b99ec0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2020-09-08T17:01:23.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2020-09-08T17:01:23.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T17:01:23.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T17:01:23.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:01:23.049 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T17:01:23.581 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T17:01:23.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:01:23.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T17:01:23.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T17:01:23.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T17:01:23.583 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T17:01:23.605 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:23.609+0000 7f5995745ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:23.609 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:23.614+0000 7f5995745ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:23.611 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:23.616+0000 7f5995745ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:23.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T17:01:23.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:01:23.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T17:01:23.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:01:23.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:01:23.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:01:23.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:01:23.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:01:23.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T17:01:23.981 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:01:24.132 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:24.137+0000 7f5995745ec0 -1 Falling back to public interface 2020-09-08T17:01:24.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:01:24.986 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:24.991+0000 7f5995745ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T17:01:25.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:01:25.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:01:25.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:01:25.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:01:25.392 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T17:01:25.392 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:01:25.795 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/616164,v1:127.0.0.1:6819/616164] [v2:127.0.0.1:6820/616164,v1:127.0.0.1:6821/616164] exists,up 0e4269e4-f7e1-4c55-9149-7909b26421f0 2020-09-08T17:01:25.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:01:25.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:01:25.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:01:25.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:189: TEST_backfill_sizeup_out: run_osd td/osd-backfill-stats 3 2020-09-08T17:01:25.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T17:01:25.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T17:01:25.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T17:01:25.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T17:01:25.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/3 2020-09-08T17:01:25.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T17:01:25.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:01:25.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:01:25.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:01:25.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2020-09-08T17:01:25.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2020-09-08T17:01:25.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T17:01:25.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T17:01:25.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T17:01:25.799 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T17:01:25.799 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:01:25.800 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:01:25.800 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:01:25.800 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:01:25.800 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T17:01:25.801 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T17:01:25.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T17:01:25.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:01:25.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T17:01:25.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T17:01:25.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T17:01:25.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T17:01:25.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:01:25.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:01:25.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:01:25.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T17:01:25.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T17:01:25.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/3 2020-09-08T17:01:25.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T17:01:25.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=bd686851-7252-4fa2-83b8-288a9e6f310f 2020-09-08T17:01:25.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 bd686851-7252-4fa2-83b8-288a9e6f310f' 2020-09-08T17:01:25.805 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T17:01:25.805 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 bd686851-7252-4fa2-83b8-288a9e6f310f 2020-09-08T17:01:25.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDluFdfF/W0MBAAS8I/WVTBSvXYNStJ8zc1HA== 2020-09-08T17:01:25.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDluFdfF/W0MBAAS8I/WVTBSvXYNStJ8zc1HA=="}' 2020-09-08T17:01:25.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new bd686851-7252-4fa2-83b8-288a9e6f310f -i td/osd-backfill-stats/3/new.json 2020-09-08T17:01:26.358 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T17:01:26.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/3/new.json 2020-09-08T17:01:26.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDluFdfF/W0MBAAS8I/WVTBSvXYNStJ8zc1HA== --osd-uuid bd686851-7252-4fa2-83b8-288a9e6f310f 2020-09-08T17:01:26.394 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:26.399+0000 7f3a3c011ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:26.396 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:26.401+0000 7f3a3c011ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:26.398 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:26.402+0000 7f3a3c011ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:26.400 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:26.404+0000 7f3a3c011ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T17:01:26.400 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:26.404+0000 7f3a3c011ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T17:01:26.400 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:26.404+0000 7f3a3c011ec0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2020-09-08T17:01:26.447 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:26.452+0000 7f3a3c011ec0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2020-09-08T17:01:30.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2020-09-08T17:01:30.938 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T17:01:30.939 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T17:01:30.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T17:01:30.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:01:31.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T17:01:31.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T17:01:31.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:01:31.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T17:01:31.479 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T17:01:31.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T17:01:31.502 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:31.507+0000 7f70f4d02ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:31.525 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:31.529+0000 7f70f4d02ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:31.526 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:31.531+0000 7f70f4d02ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:31.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T17:01:31.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:01:31.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T17:01:31.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:01:31.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:01:31.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:01:31.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:01:31.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:01:31.876 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T17:01:31.876 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:01:32.042 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:32.046+0000 7f70f4d02ec0 -1 Falling back to public interface 2020-09-08T17:01:32.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:01:32.885 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:32.890+0000 7f70f4d02ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T17:01:33.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:01:33.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:01:33.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:01:33.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:01:33.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T17:01:33.285 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:01:33.719 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/617158,v1:127.0.0.1:6827/617158] [v2:127.0.0.1:6828/617158,v1:127.0.0.1:6829/617158] exists,up bd686851-7252-4fa2-83b8-288a9e6f310f 2020-09-08T17:01:33.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:01:33.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:01:33.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:01:33.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:190: TEST_backfill_sizeup_out: run_osd td/osd-backfill-stats 4 2020-09-08T17:01:33.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T17:01:33.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T17:01:33.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=4 2020-09-08T17:01:33.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T17:01:33.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/4 2020-09-08T17:01:33.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T17:01:33.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:01:33.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:01:33.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:01:33.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2020-09-08T17:01:33.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2020-09-08T17:01:33.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T17:01:33.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T17:01:33.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T17:01:33.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T17:01:33.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:01:33.723 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:01:33.724 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:01:33.724 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:01:33.724 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T17:01:33.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T17:01:33.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T17:01:33.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:01:33.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T17:01:33.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T17:01:33.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T17:01:33.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T17:01:33.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:01:33.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:01:33.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:01:33.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T17:01:33.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T17:01:33.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/4 2020-09-08T17:01:33.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T17:01:33.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=0feaa5fd-09d3-4743-a048-22b944410279 2020-09-08T17:01:33.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd4 0feaa5fd-09d3-4743-a048-22b944410279' 2020-09-08T17:01:33.728 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T17:01:33.728 INFO:tasks.workunit.client.0.smithi065.stdout:add osd4 0feaa5fd-09d3-4743-a048-22b944410279 2020-09-08T17:01:33.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDtuFdfyDknLBAA1yDsKxX6hF4YHKH2hHpH5Q== 2020-09-08T17:01:33.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDtuFdfyDknLBAA1yDsKxX6hF4YHKH2hHpH5Q=="}' 2020-09-08T17:01:33.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 0feaa5fd-09d3-4743-a048-22b944410279 -i td/osd-backfill-stats/4/new.json 2020-09-08T17:01:34.241 INFO:tasks.workunit.client.0.smithi065.stdout:4 2020-09-08T17:01:34.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/4/new.json 2020-09-08T17:01:34.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 4 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDtuFdfyDknLBAA1yDsKxX6hF4YHKH2hHpH5Q== --osd-uuid 0feaa5fd-09d3-4743-a048-22b944410279 2020-09-08T17:01:34.278 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:34.283+0000 7fa841fdcec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:34.279 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:34.284+0000 7fa841fdcec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:34.281 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:34.286+0000 7fa841fdcec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:34.282 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:34.286+0000 7fa841fdcec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T17:01:34.282 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:34.286+0000 7fa841fdcec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T17:01:34.282 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:34.286+0000 7fa841fdcec0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2020-09-08T17:01:34.324 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:34.329+0000 7fa841fdcec0 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2020-09-08T17:01:38.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2020-09-08T17:01:38.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T17:01:38.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd4 key to auth repository 2020-09-08T17:01:38.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:01:38.855 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd4 key to auth repository 2020-09-08T17:01:39.411 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.4 2020-09-08T17:01:39.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.4 2020-09-08T17:01:39.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 4 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:01:39.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T17:01:39.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T17:01:39.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T17:01:39.438 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:39.440+0000 7f4d2c86fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:39.457 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:39.462+0000 7f4d2c86fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:39.458 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:39.463+0000 7f4d2c86fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:39.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 4 2020-09-08T17:01:39.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:01:39.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=4 2020-09-08T17:01:39.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:01:39.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:01:39.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:01:39.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:01:39.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:01:39.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T17:01:39.806 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:01:39.976 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:39.979+0000 7f4d2c86fec0 -1 Falling back to public interface 2020-09-08T17:01:40.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:01:40.815 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:40.820+0000 7f4d2c86fec0 -1 osd.4 0 log_to_monitors {default=true} 2020-09-08T17:01:41.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:01:41.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:01:41.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:01:41.216 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:01:41.217 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:01:41.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.4 up' 2020-09-08T17:01:41.635 INFO:tasks.workunit.client.0.smithi065.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/618152,v1:127.0.0.1:6835/618152] [v2:127.0.0.1:6836/618152,v1:127.0.0.1:6837/618152] exists,up 0feaa5fd-09d3-4743-a048-22b944410279 2020-09-08T17:01:41.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:01:41.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:01:41.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:01:41.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:191: TEST_backfill_sizeup_out: run_osd td/osd-backfill-stats 5 2020-09-08T17:01:41.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-backfill-stats 2020-09-08T17:01:41.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T17:01:41.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=5 2020-09-08T17:01:41.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T17:01:41.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-backfill-stats/5 2020-09-08T17:01:41.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2020-09-08T17:01:41.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:01:41.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:01:41.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:01:41.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/5' 2020-09-08T17:01:41.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/5/journal' 2020-09-08T17:01:41.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T17:01:41.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T17:01:41.642 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2020-09-08T17:01:41.642 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T17:01:41.642 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:01:41.643 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:01:41.643 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:01:41.643 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:01:41.644 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T17:01:41.644 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T17:01:41.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' 2020-09-08T17:01:41.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:01:41.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T17:01:41.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T17:01:41.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2020-09-08T17:01:41.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2020-09-08T17:01:41.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:01:41.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:01:41.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:01:41.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T17:01:41.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T17:01:41.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-backfill-stats/5 2020-09-08T17:01:41.647 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T17:01:41.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=0ebe4c07-91db-432f-9beb-cd84f4956320 2020-09-08T17:01:41.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd5 0ebe4c07-91db-432f-9beb-cd84f4956320' 2020-09-08T17:01:41.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T17:01:41.649 INFO:tasks.workunit.client.0.smithi065.stdout:add osd5 0ebe4c07-91db-432f-9beb-cd84f4956320 2020-09-08T17:01:41.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQD1uFdflPcwJxAAQBs78LIOwxgwBHo2mPfXbQ== 2020-09-08T17:01:41.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQD1uFdflPcwJxAAQBs78LIOwxgwBHo2mPfXbQ=="}' 2020-09-08T17:01:41.653 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 0ebe4c07-91db-432f-9beb-cd84f4956320 -i td/osd-backfill-stats/5/new.json 2020-09-08T17:01:42.191 INFO:tasks.workunit.client.0.smithi065.stdout:5 2020-09-08T17:01:42.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-backfill-stats/5/new.json 2020-09-08T17:01:42.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 5 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQD1uFdflPcwJxAAQBs78LIOwxgwBHo2mPfXbQ== --osd-uuid 0ebe4c07-91db-432f-9beb-cd84f4956320 2020-09-08T17:01:42.227 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:42.232+0000 7f9f5b18cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:42.229 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:42.234+0000 7f9f5b18cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:42.230 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:42.235+0000 7f9f5b18cec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:42.231 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:42.236+0000 7f9f5b18cec0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2020-09-08T17:01:42.231 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:42.236+0000 7f9f5b18cec0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2020-09-08T17:01:42.231 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:42.236+0000 7f9f5b18cec0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2020-09-08T17:01:42.285 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:42.290+0000 7f9f5b18cec0 -1 bluestore(td/osd-backfill-stats/5) _read_fsid unparsable uuid 2020-09-08T17:01:46.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-backfill-stats/5/keyring 2020-09-08T17:01:46.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T17:01:46.509 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd5 key to auth repository 2020-09-08T17:01:46.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd5 key to auth repository 2020-09-08T17:01:46.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-backfill-stats/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:01:47.042 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.5 2020-09-08T17:01:47.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.5 2020-09-08T17:01:47.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T17:01:47.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 5 --fsid=6040c96d-b58b-4ec8-b0c9-4b9d62cf0df9 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.482138/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:01:47.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T17:01:47.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T17:01:47.066 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:47.071+0000 7fc2d4247ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:47.082 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:47.087+0000 7fc2d4247ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:47.084 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:47.089+0000 7fc2d4247ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:01:47.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 5 2020-09-08T17:01:47.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:01:47.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=5 2020-09-08T17:01:47.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:01:47.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:01:47.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:01:47.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:01:47.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:01:47.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T17:01:47.440 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:01:47.600 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:47.605+0000 7fc2d4247ec0 -1 Falling back to public interface 2020-09-08T17:01:47.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:01:48.366 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:01:48.371+0000 7fc2d4247ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-09-08T17:01:48.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:01:48.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:01:48.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:01:48.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:01:48.849 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.5 up' 2020-09-08T17:01:48.849 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:01:49.264 INFO:tasks.workunit.client.0.smithi065.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/619146,v1:127.0.0.1:6843/619146] [v2:127.0.0.1:6844/619146,v1:127.0.0.1:6845/619146] exists,up 0ebe4c07-91db-432f-9beb-cd84f4956320 2020-09-08T17:01:49.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:01:49.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:01:49.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:01:49.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:193: TEST_backfill_sizeup_out: create_pool test 1 1 2020-09-08T17:01:49.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create test 1 1 2020-09-08T17:01:49.969 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' already exists 2020-09-08T17:01:49.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T17:01:50.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:194: TEST_backfill_sizeup_out: ceph osd pool set test size 1 --yes-i-really-mean-it 2020-09-08T17:01:51.946 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 1 2020-09-08T17:01:51.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:196: TEST_backfill_sizeup_out: wait_for_clean 2020-09-08T17:01:51.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T17:01:51.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T17:01:51.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T17:01:51.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T17:01:51.955 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T17:01:51.956 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T17:01:51.956 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T17:01:51.957 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T17:01:51.957 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T17:01:51.957 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T17:01:52.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T17:01:52.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T17:01:52.051 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T17:01:52.052 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T17:01:52.052 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T17:01:52.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T17:01:52.498 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T17:01:52.498 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T17:01:52.499 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T17:01:52.499 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T17:01:52.499 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T17:01:52.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T17:01:52.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:01:52.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T17:01:52.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836491 2020-09-08T17:01:52.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836491 2020-09-08T17:01:52.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491' 2020-09-08T17:01:52.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:01:52.630 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T17:01:52.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672969 2020-09-08T17:01:52.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672969 2020-09-08T17:01:52.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969' 2020-09-08T17:01:52.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:01:52.761 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T17:01:52.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509448 2020-09-08T17:01:52.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509448 2020-09-08T17:01:52.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969 2-64424509448' 2020-09-08T17:01:52.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:01:52.893 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T17:01:53.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345926 2020-09-08T17:01:53.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345926 2020-09-08T17:01:53.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969 2-64424509448 3-85899345926' 2020-09-08T17:01:53.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:01:53.024 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T17:01:53.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182405 2020-09-08T17:01:53.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182405 2020-09-08T17:01:53.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969 2-64424509448 3-85899345926 4-107374182405' 2020-09-08T17:01:53.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:01:53.155 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T17:01:53.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018883 2020-09-08T17:01:53.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018883 2020-09-08T17:01:53.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969 2-64424509448 3-85899345926 4-107374182405 5-128849018883' 2020-09-08T17:01:53.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:01:53.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836491 2020-09-08T17:01:53.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:01:53.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T17:01:53.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836491 2020-09-08T17:01:53.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:01:53.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836491 2020-09-08T17:01:53.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2020-09-08T17:01:53.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T17:01:53.289 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836491 2020-09-08T17:01:53.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836491 -lt 21474836491 2020-09-08T17:01:53.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:01:53.684 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672969 2020-09-08T17:01:53.685 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:01:53.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T17:01:53.685 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672969 2020-09-08T17:01:53.686 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:01:53.686 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672969 2020-09-08T17:01:53.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672969' 2020-09-08T17:01:53.687 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T17:01:53.687 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672969 2020-09-08T17:01:54.102 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672967 -lt 42949672969 2020-09-08T17:01:54.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T17:01:55.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T17:01:55.104 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T17:01:55.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672970 -lt 42949672969 2020-09-08T17:01:55.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:01:55.509 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509448 2020-09-08T17:01:55.510 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:01:55.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T17:01:55.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509448 2020-09-08T17:01:55.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:01:55.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509448 2020-09-08T17:01:55.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509448' 2020-09-08T17:01:55.512 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T17:01:55.512 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509448 2020-09-08T17:01:55.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509448 -lt 64424509448 2020-09-08T17:01:55.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:01:55.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345926 2020-09-08T17:01:55.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:01:55.915 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T17:01:55.915 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345926 2020-09-08T17:01:55.915 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:01:55.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345926 2020-09-08T17:01:55.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345926' 2020-09-08T17:01:55.917 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T17:01:55.917 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345926 2020-09-08T17:01:56.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345927 -lt 85899345926 2020-09-08T17:01:56.306 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:01:56.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182405 2020-09-08T17:01:56.307 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:01:56.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T17:01:56.308 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182405 2020-09-08T17:01:56.308 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:01:56.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182405 2020-09-08T17:01:56.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182405' 2020-09-08T17:01:56.309 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T17:01:56.310 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182405 2020-09-08T17:01:56.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182405 -lt 107374182405 2020-09-08T17:01:56.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:01:56.713 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018883 2020-09-08T17:01:56.714 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:01:56.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T17:01:56.715 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018883 2020-09-08T17:01:56.715 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:01:56.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018883 2020-09-08T17:01:56.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018883' 2020-09-08T17:01:56.716 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T17:01:56.716 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018883 2020-09-08T17:01:57.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018884 -lt 128849018883 2020-09-08T17:01:57.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T17:01:57.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:01:57.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:01:57.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T17:01:57.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:01:57.639 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:01:57.639 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:01:57.639 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:01:57.640 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:01:57.640 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:01:57.640 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:01:58.016 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T17:01:58.017 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:01:58.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:01:58.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:01:58.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T17:01:58.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T17:01:58.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T17:01:58.534 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: seq 1 200 2020-09-08T17:01:58.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:58.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj1 /dev/null 2020-09-08T17:01:58.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:58.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj2 /dev/null 2020-09-08T17:01:58.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:58.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj3 /dev/null 2020-09-08T17:01:58.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:58.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj4 /dev/null 2020-09-08T17:01:58.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:58.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj5 /dev/null 2020-09-08T17:01:58.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:58.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj6 /dev/null 2020-09-08T17:01:59.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:59.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj7 /dev/null 2020-09-08T17:01:59.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:59.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj8 /dev/null 2020-09-08T17:01:59.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:59.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj9 /dev/null 2020-09-08T17:01:59.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:59.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj10 /dev/null 2020-09-08T17:01:59.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:59.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj11 /dev/null 2020-09-08T17:01:59.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:59.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj12 /dev/null 2020-09-08T17:01:59.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:59.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj13 /dev/null 2020-09-08T17:01:59.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:59.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj14 /dev/null 2020-09-08T17:01:59.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:59.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj15 /dev/null 2020-09-08T17:01:59.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:59.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj16 /dev/null 2020-09-08T17:01:59.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:59.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj17 /dev/null 2020-09-08T17:01:59.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:59.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj18 /dev/null 2020-09-08T17:01:59.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:59.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj19 /dev/null 2020-09-08T17:01:59.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:59.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj20 /dev/null 2020-09-08T17:01:59.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:59.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj21 /dev/null 2020-09-08T17:01:59.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:01:59.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj22 /dev/null 2020-09-08T17:02:00.043 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:00.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj23 /dev/null 2020-09-08T17:02:00.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:00.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj24 /dev/null 2020-09-08T17:02:00.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:00.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj25 /dev/null 2020-09-08T17:02:00.235 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:00.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj26 /dev/null 2020-09-08T17:02:00.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:00.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj27 /dev/null 2020-09-08T17:02:00.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:00.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj28 /dev/null 2020-09-08T17:02:00.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:00.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj29 /dev/null 2020-09-08T17:02:00.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:00.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj30 /dev/null 2020-09-08T17:02:00.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:00.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj31 /dev/null 2020-09-08T17:02:00.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:00.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj32 /dev/null 2020-09-08T17:02:00.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:00.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj33 /dev/null 2020-09-08T17:02:00.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:00.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj34 /dev/null 2020-09-08T17:02:00.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:00.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj35 /dev/null 2020-09-08T17:02:00.946 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:00.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj36 /dev/null 2020-09-08T17:02:01.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:01.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj37 /dev/null 2020-09-08T17:02:01.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:01.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj38 /dev/null 2020-09-08T17:02:01.180 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:01.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj39 /dev/null 2020-09-08T17:02:01.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:01.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj40 /dev/null 2020-09-08T17:02:01.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:01.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj41 /dev/null 2020-09-08T17:02:01.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:01.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj42 /dev/null 2020-09-08T17:02:01.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:01.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj43 /dev/null 2020-09-08T17:02:01.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:01.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj44 /dev/null 2020-09-08T17:02:01.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:01.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj45 /dev/null 2020-09-08T17:02:01.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:01.632 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj46 /dev/null 2020-09-08T17:02:01.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:01.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj47 /dev/null 2020-09-08T17:02:01.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:01.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj48 /dev/null 2020-09-08T17:02:01.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:01.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj49 /dev/null 2020-09-08T17:02:01.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:01.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj50 /dev/null 2020-09-08T17:02:01.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:01.941 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj51 /dev/null 2020-09-08T17:02:02.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:02.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj52 /dev/null 2020-09-08T17:02:02.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:02.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj53 /dev/null 2020-09-08T17:02:02.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:02.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj54 /dev/null 2020-09-08T17:02:02.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:02.236 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj55 /dev/null 2020-09-08T17:02:02.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:02.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj56 /dev/null 2020-09-08T17:02:02.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:02.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj57 /dev/null 2020-09-08T17:02:02.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:02.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj58 /dev/null 2020-09-08T17:02:02.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:02.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj59 /dev/null 2020-09-08T17:02:02.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:02.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj60 /dev/null 2020-09-08T17:02:02.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:02.629 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj61 /dev/null 2020-09-08T17:02:02.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:02.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj62 /dev/null 2020-09-08T17:02:02.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:02.805 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj63 /dev/null 2020-09-08T17:02:02.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:02.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj64 /dev/null 2020-09-08T17:02:02.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:02.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj65 /dev/null 2020-09-08T17:02:03.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:03.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj66 /dev/null 2020-09-08T17:02:03.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:03.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj67 /dev/null 2020-09-08T17:02:03.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:03.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj68 /dev/null 2020-09-08T17:02:03.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:03.215 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj69 /dev/null 2020-09-08T17:02:03.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:03.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj70 /dev/null 2020-09-08T17:02:03.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:03.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj71 /dev/null 2020-09-08T17:02:03.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:03.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj72 /dev/null 2020-09-08T17:02:03.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:03.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj73 /dev/null 2020-09-08T17:02:03.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:03.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj74 /dev/null 2020-09-08T17:02:03.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:03.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj75 /dev/null 2020-09-08T17:02:03.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:03.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj76 /dev/null 2020-09-08T17:02:03.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:03.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj77 /dev/null 2020-09-08T17:02:03.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:03.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj78 /dev/null 2020-09-08T17:02:03.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:03.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj79 /dev/null 2020-09-08T17:02:03.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:03.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj80 /dev/null 2020-09-08T17:02:03.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:03.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj81 /dev/null 2020-09-08T17:02:04.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:04.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj82 /dev/null 2020-09-08T17:02:04.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:04.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj83 /dev/null 2020-09-08T17:02:04.167 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:04.168 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj84 /dev/null 2020-09-08T17:02:04.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:04.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj85 /dev/null 2020-09-08T17:02:04.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:04.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj86 /dev/null 2020-09-08T17:02:04.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:04.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj87 /dev/null 2020-09-08T17:02:04.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:04.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj88 /dev/null 2020-09-08T17:02:04.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:04.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj89 /dev/null 2020-09-08T17:02:04.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:04.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj90 /dev/null 2020-09-08T17:02:04.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:04.652 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj91 /dev/null 2020-09-08T17:02:04.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:04.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj92 /dev/null 2020-09-08T17:02:04.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:04.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj93 /dev/null 2020-09-08T17:02:04.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:04.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj94 /dev/null 2020-09-08T17:02:04.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:04.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj95 /dev/null 2020-09-08T17:02:05.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:05.037 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj96 /dev/null 2020-09-08T17:02:05.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:05.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj97 /dev/null 2020-09-08T17:02:05.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:05.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj98 /dev/null 2020-09-08T17:02:05.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:05.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj99 /dev/null 2020-09-08T17:02:05.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:05.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj100 /dev/null 2020-09-08T17:02:05.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:05.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj101 /dev/null 2020-09-08T17:02:05.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:05.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj102 /dev/null 2020-09-08T17:02:05.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:05.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj103 /dev/null 2020-09-08T17:02:05.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:05.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj104 /dev/null 2020-09-08T17:02:05.613 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:05.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj105 /dev/null 2020-09-08T17:02:05.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:05.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj106 /dev/null 2020-09-08T17:02:05.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:05.730 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj107 /dev/null 2020-09-08T17:02:05.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:05.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj108 /dev/null 2020-09-08T17:02:05.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:05.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj109 /dev/null 2020-09-08T17:02:05.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:05.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj110 /dev/null 2020-09-08T17:02:05.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:05.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj111 /dev/null 2020-09-08T17:02:06.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:06.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj112 /dev/null 2020-09-08T17:02:06.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:06.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj113 /dev/null 2020-09-08T17:02:06.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:06.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj114 /dev/null 2020-09-08T17:02:06.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:06.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj115 /dev/null 2020-09-08T17:02:06.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:06.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj116 /dev/null 2020-09-08T17:02:06.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:06.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj117 /dev/null 2020-09-08T17:02:06.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:06.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj118 /dev/null 2020-09-08T17:02:06.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:06.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj119 /dev/null 2020-09-08T17:02:06.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:06.633 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj120 /dev/null 2020-09-08T17:02:06.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:06.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj121 /dev/null 2020-09-08T17:02:06.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:06.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj122 /dev/null 2020-09-08T17:02:07.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:07.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj123 /dev/null 2020-09-08T17:02:07.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:07.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj124 /dev/null 2020-09-08T17:02:07.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:07.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj125 /dev/null 2020-09-08T17:02:07.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:07.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj126 /dev/null 2020-09-08T17:02:07.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:07.427 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj127 /dev/null 2020-09-08T17:02:07.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:07.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj128 /dev/null 2020-09-08T17:02:07.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:07.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj129 /dev/null 2020-09-08T17:02:07.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:07.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj130 /dev/null 2020-09-08T17:02:07.703 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:07.742 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj131 /dev/null 2020-09-08T17:02:07.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:07.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj132 /dev/null 2020-09-08T17:02:07.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:07.853 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj133 /dev/null 2020-09-08T17:02:07.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:07.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj134 /dev/null 2020-09-08T17:02:07.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:07.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj135 /dev/null 2020-09-08T17:02:08.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:08.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj136 /dev/null 2020-09-08T17:02:08.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:08.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj137 /dev/null 2020-09-08T17:02:08.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:08.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj138 /dev/null 2020-09-08T17:02:08.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:08.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj139 /dev/null 2020-09-08T17:02:08.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:08.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj140 /dev/null 2020-09-08T17:02:08.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:08.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj141 /dev/null 2020-09-08T17:02:08.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:08.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj142 /dev/null 2020-09-08T17:02:08.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:08.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj143 /dev/null 2020-09-08T17:02:08.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:08.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj144 /dev/null 2020-09-08T17:02:08.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:08.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj145 /dev/null 2020-09-08T17:02:08.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:08.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj146 /dev/null 2020-09-08T17:02:08.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:08.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj147 /dev/null 2020-09-08T17:02:08.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:08.839 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj148 /dev/null 2020-09-08T17:02:08.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:08.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj149 /dev/null 2020-09-08T17:02:09.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:09.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj150 /dev/null 2020-09-08T17:02:09.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:09.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj151 /dev/null 2020-09-08T17:02:09.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:09.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj152 /dev/null 2020-09-08T17:02:09.198 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:09.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj153 /dev/null 2020-09-08T17:02:09.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:09.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj154 /dev/null 2020-09-08T17:02:09.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:09.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj155 /dev/null 2020-09-08T17:02:09.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:09.391 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj156 /dev/null 2020-09-08T17:02:09.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:09.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj157 /dev/null 2020-09-08T17:02:09.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:09.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj158 /dev/null 2020-09-08T17:02:09.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:09.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj159 /dev/null 2020-09-08T17:02:09.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:09.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj160 /dev/null 2020-09-08T17:02:09.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:09.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj161 /dev/null 2020-09-08T17:02:09.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:09.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj162 /dev/null 2020-09-08T17:02:09.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:09.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj163 /dev/null 2020-09-08T17:02:09.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:09.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj164 /dev/null 2020-09-08T17:02:10.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:10.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj165 /dev/null 2020-09-08T17:02:10.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:10.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj166 /dev/null 2020-09-08T17:02:10.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:10.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj167 /dev/null 2020-09-08T17:02:10.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:10.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj168 /dev/null 2020-09-08T17:02:10.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:10.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj169 /dev/null 2020-09-08T17:02:10.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:10.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj170 /dev/null 2020-09-08T17:02:10.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:10.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj171 /dev/null 2020-09-08T17:02:10.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:10.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj172 /dev/null 2020-09-08T17:02:10.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:10.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj173 /dev/null 2020-09-08T17:02:10.644 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:10.645 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj174 /dev/null 2020-09-08T17:02:10.711 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:10.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj175 /dev/null 2020-09-08T17:02:10.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:10.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj176 /dev/null 2020-09-08T17:02:10.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:10.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj177 /dev/null 2020-09-08T17:02:10.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:10.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj178 /dev/null 2020-09-08T17:02:11.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:11.046 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj179 /dev/null 2020-09-08T17:02:11.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:11.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj180 /dev/null 2020-09-08T17:02:11.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:11.163 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj181 /dev/null 2020-09-08T17:02:11.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:11.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj182 /dev/null 2020-09-08T17:02:11.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:11.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj183 /dev/null 2020-09-08T17:02:11.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:11.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj184 /dev/null 2020-09-08T17:02:11.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:11.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj185 /dev/null 2020-09-08T17:02:11.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:11.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj186 /dev/null 2020-09-08T17:02:11.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:11.539 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj187 /dev/null 2020-09-08T17:02:11.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:11.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj188 /dev/null 2020-09-08T17:02:11.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:11.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj189 /dev/null 2020-09-08T17:02:11.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:11.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj190 /dev/null 2020-09-08T17:02:11.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:11.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj191 /dev/null 2020-09-08T17:02:11.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:11.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj192 /dev/null 2020-09-08T17:02:11.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:11.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj193 /dev/null 2020-09-08T17:02:11.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:11.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj194 /dev/null 2020-09-08T17:02:12.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:12.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj195 /dev/null 2020-09-08T17:02:12.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:12.107 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj196 /dev/null 2020-09-08T17:02:12.165 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:12.166 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj197 /dev/null 2020-09-08T17:02:12.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:12.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj198 /dev/null 2020-09-08T17:02:12.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:12.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj199 /dev/null 2020-09-08T17:02:12.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2020-09-08T17:02:12.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj200 /dev/null 2020-09-08T17:02:12.544 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:203: TEST_backfill_sizeup_out: get_pg test obj1 2020-09-08T17:02:12.544 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1031: get_pg: local poolname=test 2020-09-08T17:02:12.545 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: local objectname=obj1 2020-09-08T17:02:12.545 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: ceph --format json osd map test obj1 2020-09-08T17:02:12.545 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: jq -r .pgid 2020-09-08T17:02:12.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:203: TEST_backfill_sizeup_out: local PG=1.0 2020-09-08T17:02:12.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:205: TEST_backfill_sizeup_out: get_primary test obj1 2020-09-08T17:02:12.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=test 2020-09-08T17:02:12.940 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=obj1 2020-09-08T17:02:12.941 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map test obj1 2020-09-08T17:02:12.941 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2020-09-08T17:02:13.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:205: TEST_backfill_sizeup_out: local primary=1 2020-09-08T17:02:13.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:207: TEST_backfill_sizeup_out: ceph osd set nobackfill 2020-09-08T17:02:14.054 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is set 2020-09-08T17:02:14.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:208: TEST_backfill_sizeup_out: ceph osd out osd.1 2020-09-08T17:02:14.599 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already out. 2020-09-08T17:02:14.607 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:209: TEST_backfill_sizeup_out: ceph osd pool set test size 3 2020-09-08T17:02:15.360 INFO:tasks.workunit.client.0.smithi065.stderr:set pool 1 size to 3 2020-09-08T17:02:15.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:210: TEST_backfill_sizeup_out: sleep 2 2020-09-08T17:02:17.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:211: TEST_backfill_sizeup_out: ceph osd unset nobackfill 2020-09-08T17:02:18.145 INFO:tasks.workunit.client.0.smithi065.stderr:nobackfill is unset 2020-09-08T17:02:18.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:213: TEST_backfill_sizeup_out: wait_for_clean 2020-09-08T17:02:18.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T17:02:18.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T17:02:18.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T17:02:18.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T17:02:18.155 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T17:02:18.156 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T17:02:18.156 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T17:02:18.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T17:02:18.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T17:02:18.157 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T17:02:18.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T17:02:18.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T17:02:18.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T17:02:18.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T17:02:18.251 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T17:02:18.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T17:02:18.667 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T17:02:18.668 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T17:02:18.668 INFO:tasks.workunit.client.0.smithi065.stderr:3 2020-09-08T17:02:18.668 INFO:tasks.workunit.client.0.smithi065.stderr:4 2020-09-08T17:02:18.668 INFO:tasks.workunit.client.0.smithi065.stderr:5' 2020-09-08T17:02:18.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T17:02:18.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:02:18.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T17:02:18.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836498 2020-09-08T17:02:18.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836498 2020-09-08T17:02:18.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498' 2020-09-08T17:02:18.834 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:02:18.834 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T17:02:18.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672977 2020-09-08T17:02:18.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672977 2020-09-08T17:02:18.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498 1-42949672977' 2020-09-08T17:02:18.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:02:18.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T17:02:19.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509455 2020-09-08T17:02:19.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509455 2020-09-08T17:02:19.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498 1-42949672977 2-64424509455' 2020-09-08T17:02:19.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:02:19.097 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T17:02:19.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=85899345933 2020-09-08T17:02:19.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 85899345933 2020-09-08T17:02:19.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498 1-42949672977 2-64424509455 3-85899345933' 2020-09-08T17:02:19.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:02:19.229 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-09-08T17:02:19.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182412 2020-09-08T17:02:19.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182412 2020-09-08T17:02:19.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498 1-42949672977 2-64424509455 3-85899345933 4-107374182412' 2020-09-08T17:02:19.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:02:19.360 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-09-08T17:02:19.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=128849018890 2020-09-08T17:02:19.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 128849018890 2020-09-08T17:02:19.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498 1-42949672977 2-64424509455 3-85899345933 4-107374182412 5-128849018890' 2020-09-08T17:02:19.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:02:19.490 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836498 2020-09-08T17:02:19.490 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:02:19.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T17:02:19.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836498 2020-09-08T17:02:19.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:02:19.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836498 2020-09-08T17:02:19.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836498' 2020-09-08T17:02:19.493 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 21474836498 2020-09-08T17:02:19.493 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T17:02:19.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836496 -lt 21474836498 2020-09-08T17:02:19.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T17:02:20.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T17:02:20.886 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T17:02:21.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836498 -lt 21474836498 2020-09-08T17:02:21.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:02:21.288 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672977 2020-09-08T17:02:21.288 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:02:21.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T17:02:21.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672977 2020-09-08T17:02:21.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:02:21.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672977 2020-09-08T17:02:21.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672977' 2020-09-08T17:02:21.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T17:02:21.290 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672977 2020-09-08T17:02:21.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672977 -lt 42949672977 2020-09-08T17:02:21.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:02:21.680 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509455 2020-09-08T17:02:21.680 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:02:21.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T17:02:21.681 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509455 2020-09-08T17:02:21.682 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:02:21.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509455 2020-09-08T17:02:21.682 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509455' 2020-09-08T17:02:21.683 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T17:02:21.683 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509455 2020-09-08T17:02:22.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509455 -lt 64424509455 2020-09-08T17:02:22.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:02:22.077 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-85899345933 2020-09-08T17:02:22.077 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:02:22.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T17:02:22.078 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-85899345933 2020-09-08T17:02:22.078 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:02:22.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=85899345933 2020-09-08T17:02:22.079 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 85899345933' 2020-09-08T17:02:22.080 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T17:02:22.080 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 85899345933 2020-09-08T17:02:22.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 85899345934 -lt 85899345933 2020-09-08T17:02:22.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:02:22.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 4-107374182412 2020-09-08T17:02:22.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:02:22.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=4 2020-09-08T17:02:22.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 4-107374182412 2020-09-08T17:02:22.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:02:22.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182412 2020-09-08T17:02:22.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.4 seq 107374182412' 2020-09-08T17:02:22.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 4 2020-09-08T17:02:22.539 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.4 seq 107374182412 2020-09-08T17:02:22.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182413 -lt 107374182412 2020-09-08T17:02:22.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:02:22.988 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 5-128849018890 2020-09-08T17:02:22.988 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:02:22.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=5 2020-09-08T17:02:22.989 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 5-128849018890 2020-09-08T17:02:22.989 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:02:22.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=128849018890 2020-09-08T17:02:22.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.5 seq 128849018890' 2020-09-08T17:02:22.990 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 5 2020-09-08T17:02:22.991 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.5 seq 128849018890 2020-09-08T17:02:23.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 128849018891 -lt 128849018890 2020-09-08T17:02:23.387 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T17:02:23.388 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:23.388 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:23.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 1 == 0 2020-09-08T17:02:23.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:23.913 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:23.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:23.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:23.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:23.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:23.914 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:24.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:24.295 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:24.295 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:24.295 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:24.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:24.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2020-09-08T17:02:24.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2020-09-08T17:02:24.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2020-09-08T17:02:24.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:24.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:24.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:24.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:24.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:24.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:24.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:24.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:24.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:24.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:25.320 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:25.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:25.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:25.321 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:25.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:25.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:25.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:25.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:25.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:25.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:25.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:25.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:25.847 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:26.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T17:02:26.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T17:02:26.389 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:26.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:26.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:26.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:26.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:26.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:26.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:26.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:26.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:26.491 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:26.492 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:26.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:26.873 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:26.874 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:26.874 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:27.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:27.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:27.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:27.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:27.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:27.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:27.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:27.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:27.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:27.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T17:02:27.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T17:02:27.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:27.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:27.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:28.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:28.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:28.077 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:28.077 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:28.078 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:28.078 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:28.078 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:28.078 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:28.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:28.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:28.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:28.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:28.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:28.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:28.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:28.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:28.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:28.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:28.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:28.981 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:28.982 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:29.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T17:02:29.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T17:02:29.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:29.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:29.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:29.616 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:29.617 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:29.617 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:29.617 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:29.617 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:29.618 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:29.618 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:29.618 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:30.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:30.002 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:30.002 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:30.002 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:30.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:30.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:30.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:30.527 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:30.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:30.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:30.528 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:30.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:30.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:31.048 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:02:31.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:02:31.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:31.049 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:31.050 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:31.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:31.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:31.150 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:31.150 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:31.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:31.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:31.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:31.152 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:31.534 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:31.534 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:31.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:31.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:32.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:32.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:32.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:32.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:32.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:32.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:32.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:32.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:32.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:32.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:02:32.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:02:32.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:32.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:32.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:32.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:32.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:32.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:32.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:32.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:32.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:32.725 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:32.725 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:33.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:33.135 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:33.136 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:33.136 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:33.657 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:33.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:33.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:33.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:33.658 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:33.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:33.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:33.659 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:33.659 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:34.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:02:34.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:02:34.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:34.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:34.188 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:34.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:34.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:34.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:34.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:34.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:34.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:34.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:34.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:34.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:34.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:34.678 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:34.678 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:35.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:35.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:35.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:35.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:35.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:35.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:35.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:35.207 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:35.208 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:35.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T17:02:35.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T17:02:35.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:35.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:35.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:35.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:35.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:35.823 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:35.824 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:35.824 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:35.824 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:35.824 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:35.824 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:36.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:36.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:36.205 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:36.205 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:36.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:36.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:36.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:36.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:36.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:36.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:36.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:36.722 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:36.722 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:37.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:02:37.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:02:37.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:37.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:37.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:37.378 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:37.379 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:37.379 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:37.379 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:37.380 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:37.380 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:37.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:37.381 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:37.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:37.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:37.772 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:37.772 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:38.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:38.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:38.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:38.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:38.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:38.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:38.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:38.374 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:38.374 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:38.916 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:02:38.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:02:38.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:38.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:38.918 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:39.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:39.018 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:39.018 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:39.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:39.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:39.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:39.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:39.019 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:39.441 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:39.441 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:39.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:39.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:39.972 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:39.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:39.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:39.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:39.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:39.973 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:39.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:39.974 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:39.974 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:40.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:02:40.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:02:40.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:40.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:40.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:40.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:40.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:40.600 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:40.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:40.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:40.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:40.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:40.601 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:40.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:40.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:40.986 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:40.986 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:41.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:41.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:41.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:41.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:41.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:41.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:41.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:41.506 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:41.506 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:42.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T17:02:42.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T17:02:42.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:42.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:42.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:42.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:42.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:42.127 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:42.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:42.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:42.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:42.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:42.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:42.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:42.509 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:42.509 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:42.509 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:43.025 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:43.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:43.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:43.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:43.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:43.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:43.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:43.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:43.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:43.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:02:43.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:02:43.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:43.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:43.565 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:43.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:43.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:43.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:43.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:43.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:43.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:43.667 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:43.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:44.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:44.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:44.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:44.099 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:44.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:44.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:44.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:44.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:44.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:44.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:44.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:44.639 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:44.640 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:45.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T17:02:45.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T17:02:45.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:45.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:45.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:45.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:45.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:45.259 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:45.259 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:45.259 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:45.259 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:45.259 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:45.260 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:45.640 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:45.640 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:45.641 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:45.641 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:46.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:46.181 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:46.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:46.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:46.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:46.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:46.182 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:46.183 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:46.183 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:46.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T17:02:46.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T17:02:46.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:46.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:46.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:46.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:46.801 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:46.801 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:46.801 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:46.801 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:46.802 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:46.802 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:46.802 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:47.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:47.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:47.209 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:47.210 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:47.731 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:47.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:47.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:47.732 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:47.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:47.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:47.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:47.733 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:47.733 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:48.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:02:48.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:02:48.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:48.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:48.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:48.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:48.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:48.364 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:48.365 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:48.365 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:48.365 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:48.365 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:48.366 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:48.745 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:48.745 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:48.746 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:48.746 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:49.264 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:49.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:49.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:49.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:49.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:49.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:49.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:49.266 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:49.266 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:49.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:02:49.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:02:49.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:49.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:49.790 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:49.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:49.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:49.891 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:49.891 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:49.891 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:49.891 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:49.892 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:49.892 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:50.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:50.278 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:50.279 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:50.279 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:50.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:50.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:50.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:50.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:50.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:50.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:50.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:50.859 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:50.859 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:51.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T17:02:51.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T17:02:51.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:51.397 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:51.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:51.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:51.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:51.498 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:51.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:51.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:51.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:51.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:51.499 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:51.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:51.886 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:51.886 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:51.887 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:52.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:52.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:52.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:52.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:52.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:52.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:52.467 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:52.467 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:52.467 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:53.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:02:53.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:02:53.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:53.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:53.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:53.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:53.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:53.131 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:53.131 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:53.131 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:53.132 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:53.132 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:53.133 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:53.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:53.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:53.516 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:53.516 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:54.039 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:54.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:54.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:54.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:54.040 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:54.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:54.041 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:54.041 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:54.041 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:54.560 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:02:54.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:02:54.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:54.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:54.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:54.659 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:54.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:54.660 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:54.660 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:54.660 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:54.661 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:54.661 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:54.661 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:55.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:55.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:55.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:55.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:55.608 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:55.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:55.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:55.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:55.609 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:55.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:55.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:55.610 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:55.610 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:56.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T17:02:56.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T17:02:56.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:56.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:56.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:56.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:56.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:56.232 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:56.232 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:56.232 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:56.232 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:56.232 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:56.233 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:56.614 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:56.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:56.615 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:56.615 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:57.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:57.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:57.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:57.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:57.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:57.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:57.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:57.133 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:57.133 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:57.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:02:57.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:02:57.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:57.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:57.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:57.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:57.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:57.757 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:57.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:57.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:57.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:57.758 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:57.759 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:58.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:58.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:58.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:58.146 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:02:58.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:02:58.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:02:58.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:02:58.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:02:58.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:02:58.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:02:58.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:02:58.670 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:02:58.670 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:02:59.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:02:59.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:02:59.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:02:59.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:02:59.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:02:59.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:02:59.318 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:02:59.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:02:59.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:02:59.319 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:02:59.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:02:59.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:02:59.320 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:02:59.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:02:59.698 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:02:59.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:02:59.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:03:00.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:03:00.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:03:00.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:03:00.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:03:00.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:03:00.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:03:00.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:03:00.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:03:00.234 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:03:00.753 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:03:00.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:03:00.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:03:00.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:03:00.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:03:00.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:03:00.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:03:00.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:03:00.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:03:00.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:03:00.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:03:00.857 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:03:00.857 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:03:01.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:03:01.308 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:03:01.309 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:03:01.309 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:03:01.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:03:01.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:03:01.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:03:01.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:03:01.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:03:01.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:03:01.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:03:01.828 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:03:01.828 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:03:02.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=4 2020-09-08T17:03:02.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 4 '!=' null 2020-09-08T17:03:02.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:03:02.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:03:02.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:03:02.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:03:02.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:03:02.445 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:03:02.445 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:03:02.446 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:03:02.446 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:03:02.446 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:03:02.446 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:03:02.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:03:02.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:03:02.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:03:02.828 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:03:03.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:03:03.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:03:03.344 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:03:03.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:03:03.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:03:03.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:03:03.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:03:03.345 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:03:03.346 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:03:03.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:03:03.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:03:03.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:03:03.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:03:03.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:03:03.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:03:03.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:03:03.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:03:03.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:03:03.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:03:03.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:03:03.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:03:03.968 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:03:04.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:03:04.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:03:04.348 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:03:04.348 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:03:04.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:03:04.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:03:04.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:03:04.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:03:04.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:03:04.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:03:04.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:03:04.893 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:03:04.893 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:03:05.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=5 2020-09-08T17:03:05.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 5 '!=' null 2020-09-08T17:03:05.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:03:05.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:03:05.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:03:05.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:03:05.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:03:05.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:03:05.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:03:05.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:03:05.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:03:05.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:03:05.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:03:05.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:03:05.893 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:03:05.893 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:03:05.893 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:03:06.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:03:06.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:03:06.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:03:06.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:03:06.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:03:06.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:03:06.434 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:03:06.434 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:03:06.434 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:03:06.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:03:06.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:03:06.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:03:06.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:03:06.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:03:07.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:03:07.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:03:07.057 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:03:07.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:03:07.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:03:07.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:03:07.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:03:07.058 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:03:07.442 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:03:07.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:03:07.443 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:03:07.443 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:03:07.963 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:03:07.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:03:07.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:03:07.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:03:07.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:03:07.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:03:07.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:03:07.965 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:03:07.965 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:03:08.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2020-09-08T17:03:08.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2020-09-08T17:03:08.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:03:08.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:03:08.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:03:08.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:03:08.612 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:03:08.613 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:03:08.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:03:08.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:03:08.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:03:08.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:03:08.614 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:03:08.991 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:03:08.991 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:03:08.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:03:08.992 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:03:09.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:03:09.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:03:09.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:03:09.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:03:09.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:03:09.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:03:09.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:03:09.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:03:09.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:03:10.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T17:03:10.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T17:03:10.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:03:10.034 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:03:10.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:03:10.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:03:10.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:03:10.136 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:03:10.136 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:03:10.136 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:03:10.136 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:03:10.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:03:10.137 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:03:10.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:03:10.513 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:03:10.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:03:10.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:03:11.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:03:11.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:03:11.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:03:11.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:03:11.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:03:11.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:03:11.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:03:11.033 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:03:11.033 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:03:11.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=2 2020-09-08T17:03:11.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 2 '!=' null 2020-09-08T17:03:11.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:03:11.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:03:11.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:03:11.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:03:11.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:03:11.648 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:03:11.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:03:11.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:03:11.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:03:11.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:03:11.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:03:12.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2020-09-08T17:03:12.029 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:03:12.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:03:12.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:03:12.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 1 2020-09-08T17:03:12.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2020-09-08T17:03:12.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2020-09-08T17:03:12.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2020-09-08T17:03:12.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2020-09-08T17:03:12.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2020-09-08T17:03:12.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2020-09-08T17:03:12.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2020-09-08T17:03:12.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2020-09-08T17:03:13.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=1 2020-09-08T17:03:13.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 1 '!=' null 2020-09-08T17:03:13.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2020-09-08T17:03:13.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2020-09-08T17:03:13.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2020-09-08T17:03:13.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2020-09-08T17:03:13.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:03:13.193 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:03:13.193 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:03:13.194 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:03:13.194 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:03:13.194 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:03:13.194 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:03:13.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=1 2020-09-08T17:03:13.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:03:13.574 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:03:13.575 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:03:14.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 1 = 1 2020-09-08T17:03:14.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T17:03:14.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T17:03:14.090 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:215: TEST_backfill_sizeup_out: expr 200 '*' 2 2020-09-08T17:03:14.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:215: TEST_backfill_sizeup_out: local degraded=400 2020-09-08T17:03:14.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:216: TEST_backfill_sizeup_out: check td/osd-backfill-stats 1.0 1 replicated 400 0 200 0 2020-09-08T17:03:14.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2020-09-08T17:03:14.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:64: check: local PG=1.0 2020-09-08T17:03:14.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:65: check: local primary=1 2020-09-08T17:03:14.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:66: check: local type=replicated 2020-09-08T17:03:14.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:67: check: local degraded_start=400 2020-09-08T17:03:14.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:68: check: local degraded_end=0 2020-09-08T17:03:14.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:69: check: local misplaced_start=200 2020-09-08T17:03:14.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:70: check: local misplaced_end=0 2020-09-08T17:03:14.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:71: check: local primary_start= 2020-09-08T17:03:14.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:72: check: local primary_end= 2020-09-08T17:03:14.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:73: check: local check_setup=true 2020-09-08T17:03:14.094 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2020-09-08T17:03:14.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2020-09-08T17:03:14.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:76: check: '[' true = true ']' 2020-09-08T17:03:14.096 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log td/osd-backfill-stats/osd.5.log 2020-09-08T17:03:14.103 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2020-09-08T17:03:14.103 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2020-09-08T17:03:14.103 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: wc -w 2020-09-08T17:03:14.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2020-09-08T17:03:14.104 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:86: check: local 'addp= ' 2020-09-08T17:03:14.105 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:87: check: '[' replicated = erasure ']' 2020-09-08T17:03:14.105 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2020-09-08T17:03:14.106 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats ' td/osd-backfill-stats/osd.1.log 2020-09-08T17:03:14.106 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: tail -1 2020-09-08T17:03:14.106 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2020-09-08T17:03:14.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:92: check: UPACT='[0,2,4]/[1]' 2020-09-08T17:03:14.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:93: check: '[' -n '[0,2,4]/[1]' ']' 2020-09-08T17:03:14.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:96: check: local which=degraded 2020-09-08T17:03:14.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T17:03:14.128 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2020-09-08T17:03:14.129 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -F ' [0,2,4]/[1] ' 2020-09-08T17:03:14.129 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: grep -v est 2020-09-08T17:03:14.129 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: head -1 2020-09-08T17:03:14.129 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T17:03:14.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:97: check: FIRST=400 2020-09-08T17:03:14.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:98: check: '[' -n 400 ']' 2020-09-08T17:03:14.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:99: check: below_margin 400 400 2020-09-08T17:03:14.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=400 2020-09-08T17:03:14.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T17:03:14.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=400 2020-09-08T17:03:14.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T17:03:14.134 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T17:03:14.134 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2020-09-08T17:03:14.134 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: tail -1 2020-09-08T17:03:14.134 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T17:03:14.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:100: check: LAST=2 2020-09-08T17:03:14.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:101: check: '[' -n 2 ']' 2020-09-08T17:03:14.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:102: check: above_margin 2 0 2020-09-08T17:03:14.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=2 2020-09-08T17:03:14.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T17:03:14.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=0 2020-09-08T17:03:14.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T17:03:14.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:105: check: which=misplaced 2020-09-08T17:03:14.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T17:03:14.145 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2020-09-08T17:03:14.145 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -F ' [0,2,4]/[1] ' 2020-09-08T17:03:14.145 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: grep -v est 2020-09-08T17:03:14.146 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: head -1 2020-09-08T17:03:14.146 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T17:03:14.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:106: check: FIRST=200 2020-09-08T17:03:14.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:107: check: '[' -n 200 ']' 2020-09-08T17:03:14.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:108: check: below_margin 200 200 2020-09-08T17:03:14.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:43: below_margin: local -i check=200 2020-09-08T17:03:14.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:44: below_margin: shift 2020-09-08T17:03:14.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:45: below_margin: local -i target=200 2020-09-08T17:03:14.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:47: below_margin: return 0 2020-09-08T17:03:14.149 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2020-09-08T17:03:14.151 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: tail -1 2020-09-08T17:03:14.151 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2020-09-08T17:03:14.151 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2020-09-08T17:03:14.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:109: check: LAST=1 2020-09-08T17:03:14.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:110: check: '[' -n 1 ']' 2020-09-08T17:03:14.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:111: check: above_margin 1 0 2020-09-08T17:03:14.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:51: above_margin: local -i check=1 2020-09-08T17:03:14.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:52: above_margin: shift 2020-09-08T17:03:14.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:53: above_margin: local -i target=0 2020-09-08T17:03:14.161 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:55: above_margin: return 0 2020-09-08T17:03:14.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2020-09-08T17:03:14.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:218: TEST_backfill_sizeup_out: delete_pool test 2020-09-08T17:03:14.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: delete_pool: local poolname=test 2020-09-08T17:03:14.162 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2020-09-08T17:03:14.675 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'test' does not exist 2020-09-08T17:03:14.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:219: TEST_backfill_sizeup_out: kill_daemons td/osd-backfill-stats 2020-09-08T17:03:14.684 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:03:14.684 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:03:14.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:03:14.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:03:14.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:03:14.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:03:14.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2020-09-08T17:03:14.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T17:03:14.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T17:03:14.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T17:03:14.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:03:14.796 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:03:14.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:03:14.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:03:14.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:03:14.802 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:03:14.802 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:03:14.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:03:14.803 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:03:14.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:03:14.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:03:14.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:03:14.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:03:14.806 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:03:14.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:03:14.807 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:03:14.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:03:14.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T17:03:14.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T17:03:14.824 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:03:14.824 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:03:14.824 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T17:03:14.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T17:03:14.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:03:14.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:03:14.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2151: main: code=0 2020-09-08T17:03:14.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2155: main: teardown td/osd-backfill-stats 0 2020-09-08T17:03:14.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2020-09-08T17:03:14.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2020-09-08T17:03:14.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2020-09-08T17:03:14.827 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:03:14.828 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:03:14.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:03:14.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:03:14.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:03:14.829 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:03:14.829 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:03:14.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:03:14.830 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:03:14.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:03:14.830 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:03:14.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:03:14.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:03:14.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:03:14.832 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:03:14.832 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:03:14.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:03:14.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2020-09-08T17:03:14.833 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2020-09-08T17:03:14.834 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:03:14.835 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:03:14.835 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.482138 2020-09-08T17:03:14.835 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.482138 2020-09-08T17:03:14.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:03:14.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:03:14.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2156: main: return 0 2020-09-08T17:03:14.838 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-09-08T17:03:14.839 INFO:teuthology.orchestra.run.smithi065:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-09-08T17:03:14.880 INFO:tasks.workunit:Running workunit osd/osd-bench.sh... 2020-09-08T17:03:14.881 INFO:teuthology.orchestra.run.smithi065:workunit test osd/osd-bench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dce4d291bd4243c9802c17d67b85a6da6bbc0f8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh 2020-09-08T17:03:14.941 INFO:tasks.workunit.client.0.smithi065.stderr:stty: 'standard input': Inappropriate ioctl for device 2020-09-08T17:03:14.949 INFO:tasks.workunit.client.0.smithi065.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2020-09-08T17:03:14.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T17:03:14.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T17:03:14.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: export PYTHONWARNINGS=ignore 2020-09-08T17:03:14.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: PYTHONWARNINGS=ignore 2020-09-08T17:03:14.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: export CEPH_CONF=/dev/null 2020-09-08T17:03:14.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: CEPH_CONF=/dev/null 2020-09-08T17:03:14.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2147: main: unset CEPH_ARGS 2020-09-08T17:03:14.951 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2149: main: local code 2020-09-08T17:03:14.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2150: main: run td/osd-bench 2020-09-08T17:03:14.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:22: run: local dir=td/osd-bench 2020-09-08T17:03:14.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:23: run: shift 2020-09-08T17:03:14.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: export CEPH_MON=127.0.0.1:7106 2020-09-08T17:03:14.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: CEPH_MON=127.0.0.1:7106 2020-09-08T17:03:14.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:26: run: export CEPH_ARGS 2020-09-08T17:03:14.953 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: uuidgen 2020-09-08T17:03:14.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: CEPH_ARGS+='--fsid=85526655-37ad-46c9-8127-2c93f203f056 --auth-supported=none ' 2020-09-08T17:03:14.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7106 ' 2020-09-08T17:03:14.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:29: run: CEPH_ARGS+='--debug-bluestore 20 ' 2020-09-08T17:03:14.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: set 2020-09-08T17:03:14.954 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2020-09-08T17:03:14.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: local funcs=TEST_bench 2020-09-08T17:03:14.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:32: run: for func in $funcs 2020-09-08T17:03:14.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:33: run: setup td/osd-bench 2020-09-08T17:03:14.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-bench 2020-09-08T17:03:14.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-bench 2020-09-08T17:03:14.957 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-bench 2020-09-08T17:03:14.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T17:03:14.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-bench KILL 2020-09-08T17:03:14.958 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:03:14.958 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:03:14.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:03:14.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:03:14.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:03:14.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:03:14.959 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:03:14.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:03:14.960 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:03:14.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:03:14.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:03:14.960 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:03:14.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:03:14.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:03:14.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:03:14.961 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:03:14.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:03:14.964 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T17:03:14.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-bench 2020-09-08T17:03:14.965 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:03:14.965 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:03:14.965 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.627544 2020-09-08T17:03:14.965 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.627544 2020-09-08T17:03:14.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:03:14.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:03:14.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-bench 2020-09-08T17:03:14.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T17:03:14.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:03:14.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.627544 2020-09-08T17:03:14.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.627544 2020-09-08T17:03:14.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T17:03:14.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2020-09-08T17:03:14.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2020-09-08T17:03:14.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T17:03:14.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-bench 1' TERM HUP INT 2020-09-08T17:03:14.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:34: run: TEST_bench td/osd-bench 2020-09-08T17:03:14.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:40: TEST_bench: local dir=td/osd-bench 2020-09-08T17:03:14.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:42: TEST_bench: run_mon td/osd-bench a 2020-09-08T17:03:14.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-bench 2020-09-08T17:03:14.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T17:03:14.969 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T17:03:14.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T17:03:14.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-bench/a 2020-09-08T17:03:14.970 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bench/a --run-dir=td/osd-bench 2020-09-08T17:03:15.264 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T17:03:15.265 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:03:15.265 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:03:15.265 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:03:15.265 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:03:15.266 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.627544 2020-09-08T17:03:15.266 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.627544/$cluster-$name.asok' 2020-09-08T17:03:15.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bench/a '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.627544/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bench/log --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T17:03:15.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T17:03:15.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T17:03:15.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T17:03:15.443 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T17:03:15.443 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T17:03:15.443 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T17:03:15.443 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T17:03:15.443 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T17:03:15.444 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T17:03:15.444 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T17:03:15.444 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:03:15.444 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.627544 2020-09-08T17:03:15.444 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.627544/ceph-mon.a.asok 2020-09-08T17:03:15.445 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T17:03:15.445 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.627544/ceph-mon.a.asok config get fsid 2020-09-08T17:03:15.534 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T17:03:15.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T17:03:15.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T17:03:15.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T17:03:15.535 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T17:03:15.536 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T17:03:15.536 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T17:03:15.536 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T17:03:15.536 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T17:03:15.536 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:03:15.537 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.627544 2020-09-08T17:03:15.537 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.627544/ceph-mon.a.asok 2020-09-08T17:03:15.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T17:03:15.537 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.627544/ceph-mon.a.asok config get mon_host 2020-09-08T17:03:15.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:43: TEST_bench: run_mgr td/osd-bench x 2020-09-08T17:03:15.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-bench 2020-09-08T17:03:15.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T17:03:15.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T17:03:15.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T17:03:15.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-bench/x 2020-09-08T17:03:15.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T17:03:16.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T17:03:16.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:03:16.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:03:16.512 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:03:16.512 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:03:16.512 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.627544 2020-09-08T17:03:16.512 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.627544/$cluster-$name.asok' 2020-09-08T17:03:16.512 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T17:03:16.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bench/x '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.627544/$cluster-$name.asok' --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T17:03:16.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:44: TEST_bench: run_osd td/osd-bench 0 2020-09-08T17:03:16.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-bench 2020-09-08T17:03:16.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T17:03:16.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T17:03:16.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T17:03:16.536 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-bench/0 2020-09-08T17:03:16.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=85526655-37ad-46c9-8127-2c93f203f056 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 ' 2020-09-08T17:03:16.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:03:16.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:03:16.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:03:16.537 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-bench/0' 2020-09-08T17:03:16.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-bench/0/journal' 2020-09-08T17:03:16.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T17:03:16.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T17:03:16.538 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-bench' 2020-09-08T17:03:16.538 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T17:03:16.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:03:16.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:03:16.539 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:03:16.539 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:03:16.539 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.627544 2020-09-08T17:03:16.539 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.627544/$cluster-$name.asok' 2020-09-08T17:03:16.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.627544/$cluster-$name.asok' 2020-09-08T17:03:16.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:03:16.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T17:03:16.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T17:03:16.540 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-bench/$name.log' 2020-09-08T17:03:16.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-bench/$name.pid' 2020-09-08T17:03:16.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:03:16.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:03:16.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:03:16.541 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T17:03:16.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T17:03:16.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-bench/0 2020-09-08T17:03:16.543 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T17:03:16.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=aa1efda9-b0bf-4d41-84ba-52a21c0ca78d 2020-09-08T17:03:16.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 aa1efda9-b0bf-4d41-84ba-52a21c0ca78d' 2020-09-08T17:03:16.543 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T17:03:16.544 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 aa1efda9-b0bf-4d41-84ba-52a21c0ca78d 2020-09-08T17:03:16.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBUuVdfxq4cIRAANI3h7H+3vIz3tw3hKBGKCw== 2020-09-08T17:03:16.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBUuVdfxq4cIRAANI3h7H+3vIz3tw3hKBGKCw=="}' 2020-09-08T17:03:16.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new aa1efda9-b0bf-4d41-84ba-52a21c0ca78d -i td/osd-bench/0/new.json 2020-09-08T17:03:16.900 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:03:16.910 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-bench/0/new.json 2020-09-08T17:03:16.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=85526655-37ad-46c9-8127-2c93f203f056 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.627544/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBUuVdfxq4cIRAANI3h7H+3vIz3tw3hKBGKCw== --osd-uuid aa1efda9-b0bf-4d41-84ba-52a21c0ca78d 2020-09-08T17:03:16.933 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:03:16.938+0000 7f2d495d7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:03:16.935 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:03:16.941+0000 7f2d495d7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:03:16.936 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:03:16.942+0000 7f2d495d7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:03:16.937 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:03:16.943+0000 7f2d495d7ec0 -1 bluestore(td/osd-bench/0/block) _read_bdev_label failed to open td/osd-bench/0/block: (2) No such file or directory 2020-09-08T17:03:16.938 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:03:16.943+0000 7f2d495d7ec0 -1 bluestore(td/osd-bench/0/block) _read_bdev_label failed to open td/osd-bench/0/block: (2) No such file or directory 2020-09-08T17:03:16.938 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:03:16.943+0000 7f2d495d7ec0 -1 bluestore(td/osd-bench/0/block) _read_bdev_label failed to open td/osd-bench/0/block: (2) No such file or directory 2020-09-08T17:03:16.981 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:03:16.987+0000 7f2d495d7ec0 -1 bluestore(td/osd-bench/0) _read_fsid unparsable uuid 2020-09-08T17:03:21.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-bench/0/keyring 2020-09-08T17:03:21.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T17:03:21.310 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T17:03:21.311 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-bench/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:03:21.311 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T17:03:21.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T17:03:21.846 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T17:03:21.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T17:03:21.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T17:03:21.847 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=85526655-37ad-46c9-8127-2c93f203f056 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.627544/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:03:21.847 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T17:03:21.866 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:03:21.871+0000 7f7354c3fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:03:21.889 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:03:21.895+0000 7f7354c3fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:03:21.891 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:03:21.896+0000 7f7354c3fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:03:22.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T17:03:22.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:03:22.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T17:03:22.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:03:22.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:03:22.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:03:22.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:03:22.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:03:22.234 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:03:22.234 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:03:22.407 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:03:22.412+0000 7f7354c3fec0 -1 Falling back to public interface 2020-09-08T17:03:22.668 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:03:23.207 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:03:23.212+0000 7f7354c3fec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T17:03:23.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:03:23.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:03:23.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:03:23.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:03:23.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:03:23.670 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:03:24.089 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/628402,v1:127.0.0.1:6803/628402] [v2:127.0.0.1:6804/628402,v1:127.0.0.1:6805/628402] exists,up aa1efda9-b0bf-4d41-84ba-52a21c0ca78d 2020-09-08T17:03:24.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:03:24.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:03:24.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:03:24.090 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: CEPH_ARGS= 2020-09-08T17:03:24.090 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: ceph-conf --show-config-value osd_bench_small_size_max_iops 2020-09-08T17:03:24.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: local osd_bench_small_size_max_iops=100 2020-09-08T17:03:24.100 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: CEPH_ARGS= 2020-09-08T17:03:24.100 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: ceph-conf --show-config-value osd_bench_large_size_max_throughput 2020-09-08T17:03:24.110 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: local osd_bench_large_size_max_throughput=104857600 2020-09-08T17:03:24.111 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: CEPH_ARGS= 2020-09-08T17:03:24.111 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: ceph-conf --show-config-value osd_bench_max_block_size 2020-09-08T17:03:24.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: local osd_bench_max_block_size=67108864 2020-09-08T17:03:24.121 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: CEPH_ARGS= 2020-09-08T17:03:24.121 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: ceph-conf --show-config-value osd_bench_duration 2020-09-08T17:03:24.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: local osd_bench_duration=30 2020-09-08T17:03:24.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:58: TEST_bench: expect_failure td/osd-bench osd_bench_max_block_size ceph tell osd.0 bench 1024 67108865 2020-09-08T17:03:24.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1832: expect_failure: local dir=td/osd-bench 2020-09-08T17:03:24.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: expect_failure: shift 2020-09-08T17:03:24.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1834: expect_failure: local expected=osd_bench_max_block_size 2020-09-08T17:03:24.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1835: expect_failure: shift 2020-09-08T17:03:24.133 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1836: expect_failure: local success 2020-09-08T17:03:24.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1838: expect_failure: ceph tell osd.0 bench 1024 67108865 2020-09-08T17:03:24.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1841: expect_failure: success=false 2020-09-08T17:03:24.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1844: expect_failure: false 2020-09-08T17:03:24.265 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1844: expect_failure: grep --quiet osd_bench_max_block_size td/osd-bench/out 2020-09-08T17:03:24.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1848: expect_failure: return 0 2020-09-08T17:03:24.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:64: TEST_bench: local bsize=1024 2020-09-08T17:03:24.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:65: TEST_bench: local max_count=3072000 2020-09-08T17:03:24.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:66: TEST_bench: expect_failure td/osd-bench bench_small_size_max_iops ceph tell osd.0 bench 3072001 1024 2020-09-08T17:03:24.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1832: expect_failure: local dir=td/osd-bench 2020-09-08T17:03:24.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: expect_failure: shift 2020-09-08T17:03:24.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1834: expect_failure: local expected=bench_small_size_max_iops 2020-09-08T17:03:24.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1835: expect_failure: shift 2020-09-08T17:03:24.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1836: expect_failure: local success 2020-09-08T17:03:24.268 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1838: expect_failure: ceph tell osd.0 bench 3072001 1024 2020-09-08T17:03:24.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1841: expect_failure: success=false 2020-09-08T17:03:24.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1844: expect_failure: false 2020-09-08T17:03:24.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1844: expect_failure: grep --quiet bench_small_size_max_iops td/osd-bench/out 2020-09-08T17:03:24.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1848: expect_failure: return 0 2020-09-08T17:03:24.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:72: TEST_bench: local bsize=1048577 2020-09-08T17:03:24.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:73: TEST_bench: local max_count=3145728000 2020-09-08T17:03:24.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:74: TEST_bench: expect_failure td/osd-bench osd_bench_large_size_max_throughput ceph tell osd.0 bench 3145728001 1048577 2020-09-08T17:03:24.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1832: expect_failure: local dir=td/osd-bench 2020-09-08T17:03:24.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: expect_failure: shift 2020-09-08T17:03:24.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1834: expect_failure: local expected=osd_bench_large_size_max_throughput 2020-09-08T17:03:24.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1835: expect_failure: shift 2020-09-08T17:03:24.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1836: expect_failure: local success 2020-09-08T17:03:24.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1838: expect_failure: ceph tell osd.0 bench 3145728001 1048577 2020-09-08T17:03:24.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1841: expect_failure: success=false 2020-09-08T17:03:24.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1844: expect_failure: false 2020-09-08T17:03:24.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1844: expect_failure: grep --quiet osd_bench_large_size_max_throughput td/osd-bench/out 2020-09-08T17:03:24.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1848: expect_failure: return 0 2020-09-08T17:03:24.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:80: TEST_bench: ceph tell osd.0 bench 2020-09-08T17:04:34.597 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T17:04:34.598 INFO:tasks.workunit.client.0.smithi065.stdout: "bytes_written": 1073741824, 2020-09-08T17:04:34.599 INFO:tasks.workunit.client.0.smithi065.stdout: "blocksize": 4194304, 2020-09-08T17:04:34.599 INFO:tasks.workunit.client.0.smithi065.stdout: "elapsed_sec": 42.052279833, 2020-09-08T17:04:34.599 INFO:tasks.workunit.client.0.smithi065.stdout: "bytes_per_sec": 25533498.49910859, 2020-09-08T17:04:34.599 INFO:tasks.workunit.client.0.smithi065.stdout: "iops": 6.0876604316493488 2020-09-08T17:04:34.600 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T17:04:34.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:84: TEST_bench: ceph tell osd.0 bench 10 14456 4444 3 2020-09-08T17:04:36.197 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T17:04:36.198 INFO:tasks.workunit.client.0.smithi065.stdout: "bytes_written": 10, 2020-09-08T17:04:36.198 INFO:tasks.workunit.client.0.smithi065.stdout: "blocksize": 4444, 2020-09-08T17:04:36.198 INFO:tasks.workunit.client.0.smithi065.stdout: "elapsed_sec": 0.15018562799999999, 2020-09-08T17:04:36.198 INFO:tasks.workunit.client.0.smithi065.stdout: "bytes_per_sec": 66.584267304192394, 2020-09-08T17:04:36.199 INFO:tasks.workunit.client.0.smithi065.stdout: "iops": 0.014982958439287217 2020-09-08T17:04:36.199 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T17:04:36.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:90: TEST_bench: ceph tell osd.0 bench 1 14456 2020-09-08T17:04:36.966 INFO:tasks.workunit.client.0.smithi065.stdout:{ 2020-09-08T17:04:36.966 INFO:tasks.workunit.client.0.smithi065.stdout: "bytes_written": 1, 2020-09-08T17:04:36.967 INFO:tasks.workunit.client.0.smithi065.stdout: "blocksize": 14456, 2020-09-08T17:04:36.967 INFO:tasks.workunit.client.0.smithi065.stdout: "elapsed_sec": 0.18097500699999999, 2020-09-08T17:04:36.967 INFO:tasks.workunit.client.0.smithi065.stdout: "bytes_per_sec": 5.5256248726101722, 2020-09-08T17:04:36.967 INFO:tasks.workunit.client.0.smithi065.stdout: "iops": 0.00038223747043512538 2020-09-08T17:04:36.967 INFO:tasks.workunit.client.0.smithi065.stdout:} 2020-09-08T17:04:36.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:35: run: teardown td/osd-bench 2020-09-08T17:04:36.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-bench 2020-09-08T17:04:36.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T17:04:36.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-bench KILL 2020-09-08T17:04:36.980 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:04:36.981 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:04:36.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:04:36.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:04:36.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:04:37.089 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:04:37.089 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:04:37.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:04:37.090 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:04:37.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:04:37.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:04:37.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:04:37.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:04:37.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:04:37.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:04:37.094 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:04:37.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:04:37.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T17:04:37.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-bench 2020-09-08T17:04:37.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:04:37.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:04:37.113 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.627544 2020-09-08T17:04:37.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.627544 2020-09-08T17:04:37.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:04:37.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:04:37.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2151: main: code=0 2020-09-08T17:04:37.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2155: main: teardown td/osd-bench 0 2020-09-08T17:04:37.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-bench 2020-09-08T17:04:37.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2020-09-08T17:04:37.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-bench KILL 2020-09-08T17:04:37.116 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:04:37.116 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:04:37.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:04:37.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:04:37.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:04:37.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:04:37.118 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:04:37.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:04:37.118 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:04:37.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:04:37.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:04:37.119 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:04:37.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:04:37.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:04:37.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:04:37.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:04:37.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:04:37.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2020-09-08T17:04:37.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-bench 2020-09-08T17:04:37.124 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:04:37.124 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:04:37.124 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.627544 2020-09-08T17:04:37.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.627544 2020-09-08T17:04:37.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:04:37.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:04:37.127 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2156: main: return 0 2020-09-08T17:04:37.128 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-09-08T17:04:37.128 INFO:teuthology.orchestra.run.smithi065:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-09-08T17:04:37.201 INFO:tasks.workunit:Running workunit osd/osd-bluefs-volume-ops.sh... 2020-09-08T17:04:37.202 INFO:teuthology.orchestra.run.smithi065:workunit test osd/osd-bluefs-volume-ops.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dce4d291bd4243c9802c17d67b85a6da6bbc0f8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh 2020-09-08T17:04:37.264 INFO:tasks.workunit.client.0.smithi065.stderr:stty: 'standard input': Inappropriate ioctl for device 2020-09-08T17:04:37.273 INFO:tasks.workunit.client.0.smithi065.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2020-09-08T17:04:37.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T17:04:37.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T17:04:37.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: export PYTHONWARNINGS=ignore 2020-09-08T17:04:37.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: PYTHONWARNINGS=ignore 2020-09-08T17:04:37.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: export CEPH_CONF=/dev/null 2020-09-08T17:04:37.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: CEPH_CONF=/dev/null 2020-09-08T17:04:37.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2147: main: unset CEPH_ARGS 2020-09-08T17:04:37.275 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2149: main: local code 2020-09-08T17:04:37.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2150: main: run td/osd-bluefs-volume-ops 2020-09-08T17:04:37.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:8: run: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:04:37.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:9: run: shift 2020-09-08T17:04:37.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: export CEPH_MON=127.0.0.1:7146 2020-09-08T17:04:37.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: CEPH_MON=127.0.0.1:7146 2020-09-08T17:04:37.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: export CEPH_ARGS 2020-09-08T17:04:37.277 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: uuidgen 2020-09-08T17:04:37.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: CEPH_ARGS+='--fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none ' 2020-09-08T17:04:37.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2020-09-08T17:04:37.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:15: run: CEPH_ARGS+='--bluestore_block_size=2147483648 ' 2020-09-08T17:04:37.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:16: run: CEPH_ARGS+='--bluestore_block_db_create=true ' 2020-09-08T17:04:37.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:17: run: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2020-09-08T17:04:37.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:18: run: CEPH_ARGS+='--bluestore_block_wal_size=536870912 ' 2020-09-08T17:04:37.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:19: run: CEPH_ARGS+='--bluestore_block_wal_create=true ' 2020-09-08T17:04:37.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:20: run: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2020-09-08T17:04:37.279 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:21: run: set 2020-09-08T17:04:37.279 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:21: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2020-09-08T17:04:37.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:21: run: local funcs=TEST_bluestore 2020-09-08T17:04:37.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: run: for func in $funcs 2020-09-08T17:04:37.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:23: run: setup td/osd-bluefs-volume-ops 2020-09-08T17:04:37.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:04:37.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-bluefs-volume-ops 2020-09-08T17:04:37.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:04:37.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T17:04:37.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2020-09-08T17:04:37.283 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:04:37.283 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:04:37.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:04:37.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:04:37.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:04:37.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:04:37.284 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:04:37.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:04:37.284 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:04:37.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:04:37.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:04:37.285 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:04:37.286 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:04:37.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:04:37.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:04:37.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:04:37.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:04:37.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T17:04:37.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-bluefs-volume-ops 2020-09-08T17:04:37.288 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:04:37.288 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:04:37.288 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:04:37.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.629101 2020-09-08T17:04:37.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:04:37.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:04:37.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-bluefs-volume-ops 2020-09-08T17:04:37.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T17:04:37.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:04:37.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:04:37.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.629101 2020-09-08T17:04:37.291 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T17:04:37.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2020-09-08T17:04:37.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2020-09-08T17:04:37.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T17:04:37.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2020-09-08T17:04:37.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:24: run: TEST_bluestore td/osd-bluefs-volume-ops 2020-09-08T17:04:37.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:30: TEST_bluestore: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:04:37.293 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:32: TEST_bluestore: ulimit -n 2020-09-08T17:04:37.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:32: TEST_bluestore: local flimit=4096 2020-09-08T17:04:37.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:33: TEST_bluestore: '[' 4096 -lt 1536 ']' 2020-09-08T17:04:37.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:37: TEST_bluestore: run_mon td/osd-bluefs-volume-ops a 2020-09-08T17:04:37.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:04:37.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T17:04:37.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T17:04:37.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T17:04:37.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-bluefs-volume-ops/a 2020-09-08T17:04:37.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2020-09-08T17:04:37.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T17:04:37.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:04:37.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:04:37.558 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:04:37.558 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:04:37.558 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:04:37.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:04:37.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T17:04:37.741 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T17:04:37.743 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T17:04:37.743 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T17:04:37.743 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T17:04:37.744 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T17:04:37.744 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T17:04:37.744 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T17:04:37.744 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T17:04:37.744 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T17:04:37.745 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T17:04:37.745 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:04:37.745 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:04:37.745 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.629101/ceph-mon.a.asok 2020-09-08T17:04:37.745 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T17:04:37.746 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.629101/ceph-mon.a.asok config get fsid 2020-09-08T17:04:37.842 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T17:04:37.842 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T17:04:37.842 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T17:04:37.843 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T17:04:37.843 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T17:04:37.843 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T17:04:37.843 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T17:04:37.843 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T17:04:37.844 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T17:04:37.844 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:04:37.844 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:04:37.844 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.629101/ceph-mon.a.asok 2020-09-08T17:04:37.845 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T17:04:37.845 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.629101/ceph-mon.a.asok config get mon_host 2020-09-08T17:04:37.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:38: TEST_bluestore: run_mgr td/osd-bluefs-volume-ops x 2020-09-08T17:04:37.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:04:37.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T17:04:37.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T17:04:37.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T17:04:37.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-bluefs-volume-ops/x 2020-09-08T17:04:37.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T17:04:38.829 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T17:04:38.829 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:04:38.829 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:04:38.830 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:04:38.830 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:04:38.830 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:04:38.830 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:04:38.831 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T17:04:38.831 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T17:04:38.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:39: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 0 2020-09-08T17:04:38.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:04:38.854 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T17:04:38.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T17:04:38.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T17:04:38.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2020-09-08T17:04:38.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true ' 2020-09-08T17:04:38.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:04:38.855 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:04:38.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:04:38.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2020-09-08T17:04:38.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2020-09-08T17:04:38.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T17:04:38.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T17:04:38.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2020-09-08T17:04:38.857 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T17:04:38.857 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:04:38.857 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:04:38.857 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:04:38.858 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:04:38.858 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:04:38.858 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:04:38.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:04:38.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:04:38.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T17:04:38.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T17:04:38.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2020-09-08T17:04:38.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2020-09-08T17:04:38.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:04:38.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:04:38.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:04:38.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T17:04:38.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T17:04:38.860 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2020-09-08T17:04:38.861 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T17:04:38.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=5e18a2df-85af-413d-bc4d-72cf32066082 2020-09-08T17:04:38.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 5e18a2df-85af-413d-bc4d-72cf32066082' 2020-09-08T17:04:38.862 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T17:04:38.862 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 5e18a2df-85af-413d-bc4d-72cf32066082 2020-09-08T17:04:38.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCmuVdfsYQiNBAAbqtSkrQWSK5ddYjytvRbZQ== 2020-09-08T17:04:38.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCmuVdfsYQiNBAAbqtSkrQWSK5ddYjytvRbZQ=="}' 2020-09-08T17:04:38.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 5e18a2df-85af-413d-bc4d-72cf32066082 -i td/osd-bluefs-volume-ops/0/new.json 2020-09-08T17:04:39.227 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:04:39.237 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2020-09-08T17:04:39.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCmuVdfsYQiNBAAbqtSkrQWSK5ddYjytvRbZQ== --osd-uuid 5e18a2df-85af-413d-bc4d-72cf32066082 2020-09-08T17:04:39.260 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:04:39.266+0000 7f3a44a83ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:04:39.262 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:04:39.268+0000 7f3a44a83ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:04:39.263 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:04:39.269+0000 7f3a44a83ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:04:39.264 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:04:39.269+0000 7f3a44a83ec0 -1 bluestore(td/osd-bluefs-volume-ops/0/block) _read_bdev_label failed to open td/osd-bluefs-volume-ops/0/block: (2) No such file or directory 2020-09-08T17:04:39.264 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:04:39.269+0000 7f3a44a83ec0 -1 bluestore(td/osd-bluefs-volume-ops/0/block) _read_bdev_label failed to open td/osd-bluefs-volume-ops/0/block: (2) No such file or directory 2020-09-08T17:04:39.264 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:04:39.269+0000 7f3a44a83ec0 -1 bluestore(td/osd-bluefs-volume-ops/0/block) _read_bdev_label failed to open td/osd-bluefs-volume-ops/0/block: (2) No such file or directory 2020-09-08T17:04:39.307 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:04:39.313+0000 7f3a44a83ec0 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2020-09-08T17:04:47.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2020-09-08T17:04:47.035 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T17:04:47.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T17:04:47.036 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:04:47.036 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T17:04:47.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T17:04:47.574 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:04:47.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T17:04:47.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T17:04:47.575 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T17:04:47.575 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T17:04:47.594 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:04:47.599+0000 7fed0ae2dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:04:47.617 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:04:47.622+0000 7fed0ae2dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:04:47.619 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:04:47.624+0000 7fed0ae2dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:04:47.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T17:04:47.959 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:04:47.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T17:04:47.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:04:47.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:04:47.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:04:47.960 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:04:47.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:04:47.961 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:04:47.961 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:04:48.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:04:48.635 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:04:48.640+0000 7fed0ae2dec0 -1 Falling back to public interface 2020-09-08T17:04:49.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:04:49.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:04:49.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:04:49.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:04:49.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:04:49.348 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:04:49.746 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:04:50.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:04:50.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:04:50.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T17:04:50.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:04:50.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:04:50.748 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T17:04:51.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:04:51.668 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:04:51.673+0000 7fed0ae2dec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T17:04:52.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:04:52.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:04:52.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 3 2020-09-08T17:04:52.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:04:52.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:04:52.143 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T17:04:52.542 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/630246,v1:127.0.0.1:6803/630246] [v2:127.0.0.1:6804/630246,v1:127.0.0.1:6805/630246] exists,up 5e18a2df-85af-413d-bc4d-72cf32066082 2020-09-08T17:04:52.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:04:52.542 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:04:52.543 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:04:52.543 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:40: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2020-09-08T17:04:52.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:40: TEST_bluestore: osd_pid0=630246 2020-09-08T17:04:52.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:41: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 1 2020-09-08T17:04:52.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:04:52.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T17:04:52.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T17:04:52.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T17:04:52.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-bluefs-volume-ops/1 2020-09-08T17:04:52.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true ' 2020-09-08T17:04:52.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:04:52.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:04:52.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:04:52.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2020-09-08T17:04:52.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2020-09-08T17:04:52.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T17:04:52.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T17:04:52.550 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2020-09-08T17:04:52.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T17:04:52.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:04:52.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:04:52.550 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:04:52.551 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:04:52.551 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:04:52.551 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:04:52.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:04:52.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:04:52.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T17:04:52.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T17:04:52.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2020-09-08T17:04:52.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2020-09-08T17:04:52.552 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:04:52.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:04:52.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:04:52.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T17:04:52.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T17:04:52.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-bluefs-volume-ops/1 2020-09-08T17:04:52.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T17:04:52.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=3442ad96-47be-49cc-902b-19e77e1362c4 2020-09-08T17:04:52.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 3442ad96-47be-49cc-902b-19e77e1362c4' 2020-09-08T17:04:52.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T17:04:52.554 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 3442ad96-47be-49cc-902b-19e77e1362c4 2020-09-08T17:04:52.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQC0uVdfoluuIRAA8tiuH2FkpCkxDA+9G+cbzw== 2020-09-08T17:04:52.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQC0uVdfoluuIRAA8tiuH2FkpCkxDA+9G+cbzw=="}' 2020-09-08T17:04:52.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 3442ad96-47be-49cc-902b-19e77e1362c4 -i td/osd-bluefs-volume-ops/1/new.json 2020-09-08T17:04:53.129 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:04:53.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-bluefs-volume-ops/1/new.json 2020-09-08T17:04:53.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQC0uVdfoluuIRAA8tiuH2FkpCkxDA+9G+cbzw== --osd-uuid 3442ad96-47be-49cc-902b-19e77e1362c4 2020-09-08T17:04:53.162 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:04:53.168+0000 7fe849334ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:04:53.164 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:04:53.169+0000 7fe849334ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:04:53.165 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:04:53.170+0000 7fe849334ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:04:53.166 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:04:53.171+0000 7fe849334ec0 -1 bluestore(td/osd-bluefs-volume-ops/1/block) _read_bdev_label failed to open td/osd-bluefs-volume-ops/1/block: (2) No such file or directory 2020-09-08T17:04:53.166 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:04:53.171+0000 7fe849334ec0 -1 bluestore(td/osd-bluefs-volume-ops/1/block) _read_bdev_label failed to open td/osd-bluefs-volume-ops/1/block: (2) No such file or directory 2020-09-08T17:04:53.166 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:04:53.171+0000 7fe849334ec0 -1 bluestore(td/osd-bluefs-volume-ops/1/block) _read_bdev_label failed to open td/osd-bluefs-volume-ops/1/block: (2) No such file or directory 2020-09-08T17:04:53.208 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:04:53.214+0000 7fe849334ec0 -1 bluestore(td/osd-bluefs-volume-ops/1) _read_fsid unparsable uuid 2020-09-08T17:05:00.907 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-bluefs-volume-ops/1/keyring 2020-09-08T17:05:00.908 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T17:05:00.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T17:05:00.909 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-bluefs-volume-ops/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:05:00.909 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T17:05:01.445 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T17:05:01.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T17:05:01.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T17:05:01.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:05:01.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T17:05:01.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T17:05:01.465 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:01.471+0000 7ff25b34bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:05:01.484 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:01.487+0000 7ff25b34bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:05:01.484 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:01.488+0000 7ff25b34bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:05:01.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T17:05:01.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:05:01.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T17:05:01.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:05:01.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:05:01.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:05:01.837 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:05:01.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:05:01.838 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:05:01.838 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:05:02.231 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:05:02.498 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:02.504+0000 7ff25b34bec0 -1 Falling back to public interface 2020-09-08T17:05:03.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:05:03.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:05:03.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:05:03.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:05:03.233 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:05:03.234 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:05:03.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:05:04.638 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:05:04.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:05:04.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T17:05:04.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:05:04.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:05:04.640 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T17:05:05.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:05:05.550 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:05.556+0000 7ff25b34bec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T17:05:06.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:05:06.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:05:06.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 3 2020-09-08T17:05:06.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:05:06.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:05:06.059 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T17:05:06.472 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/631839,v1:127.0.0.1:6811/631839] [v2:127.0.0.1:6812/631839,v1:127.0.0.1:6813/631839] exists,up 3442ad96-47be-49cc-902b-19e77e1362c4 2020-09-08T17:05:06.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:05:06.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:05:06.473 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:05:06.476 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2020-09-08T17:05:06.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: osd_pid1=631839 2020-09-08T17:05:06.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:43: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 2 2020-09-08T17:05:06.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:05:06.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T17:05:06.477 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T17:05:06.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T17:05:06.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-bluefs-volume-ops/2 2020-09-08T17:05:06.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true ' 2020-09-08T17:05:06.478 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:05:06.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:05:06.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:05:06.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2020-09-08T17:05:06.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2020-09-08T17:05:06.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T17:05:06.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T17:05:06.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2020-09-08T17:05:06.481 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T17:05:06.481 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:05:06.482 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:05:06.482 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:05:06.482 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:05:06.482 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:05:06.482 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:05:06.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:05:06.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:05:06.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T17:05:06.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T17:05:06.483 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2020-09-08T17:05:06.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2020-09-08T17:05:06.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:05:06.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:05:06.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:05:06.484 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T17:05:06.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T17:05:06.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-bluefs-volume-ops/2 2020-09-08T17:05:06.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T17:05:06.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=37cef38d-b4cf-4fcb-b138-010faccfba47 2020-09-08T17:05:06.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 37cef38d-b4cf-4fcb-b138-010faccfba47' 2020-09-08T17:05:06.486 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T17:05:06.487 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 37cef38d-b4cf-4fcb-b138-010faccfba47 2020-09-08T17:05:06.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDCuVdflye+HRAA3vmp0legaPn6jyEjB9qifw== 2020-09-08T17:05:06.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDCuVdflye+HRAA3vmp0legaPn6jyEjB9qifw=="}' 2020-09-08T17:05:06.493 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 37cef38d-b4cf-4fcb-b138-010faccfba47 -i td/osd-bluefs-volume-ops/2/new.json 2020-09-08T17:05:07.022 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T17:05:07.032 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-bluefs-volume-ops/2/new.json 2020-09-08T17:05:07.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDCuVdflye+HRAA3vmp0legaPn6jyEjB9qifw== --osd-uuid 37cef38d-b4cf-4fcb-b138-010faccfba47 2020-09-08T17:05:07.056 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:07.061+0000 7fe530c8eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:05:07.057 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:07.063+0000 7fe530c8eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:05:07.058 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:07.064+0000 7fe530c8eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:05:07.059 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:07.064+0000 7fe530c8eec0 -1 bluestore(td/osd-bluefs-volume-ops/2/block) _read_bdev_label failed to open td/osd-bluefs-volume-ops/2/block: (2) No such file or directory 2020-09-08T17:05:07.059 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:07.064+0000 7fe530c8eec0 -1 bluestore(td/osd-bluefs-volume-ops/2/block) _read_bdev_label failed to open td/osd-bluefs-volume-ops/2/block: (2) No such file or directory 2020-09-08T17:05:07.059 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:07.064+0000 7fe530c8eec0 -1 bluestore(td/osd-bluefs-volume-ops/2/block) _read_bdev_label failed to open td/osd-bluefs-volume-ops/2/block: (2) No such file or directory 2020-09-08T17:05:07.106 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:07.112+0000 7fe530c8eec0 -1 bluestore(td/osd-bluefs-volume-ops/2) _read_fsid unparsable uuid 2020-09-08T17:05:15.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-bluefs-volume-ops/2/keyring 2020-09-08T17:05:15.388 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T17:05:15.389 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T17:05:15.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T17:05:15.390 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-bluefs-volume-ops/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:05:15.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T17:05:15.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T17:05:15.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:05:15.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T17:05:15.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T17:05:15.923 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T17:05:15.942 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:15.948+0000 7fbadeeccec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:05:15.971 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:15.976+0000 7fbadeeccec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:05:15.972 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:15.978+0000 7fbadeeccec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:05:16.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T17:05:16.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:05:16.307 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T17:05:16.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:05:16.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:05:16.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:05:16.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:05:16.308 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:05:16.309 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T17:05:16.309 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:05:16.707 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:05:16.988 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:16.993+0000 7fbadeeccec0 -1 Falling back to public interface 2020-09-08T17:05:17.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:05:17.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:05:17.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:05:17.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:05:17.714 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T17:05:17.715 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:05:18.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:05:19.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:05:19.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:05:19.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T17:05:19.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:05:19.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T17:05:19.116 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T17:05:19.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:05:20.048 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:20.053+0000 7fbadeeccec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T17:05:20.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:05:20.516 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:05:20.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 3 2020-09-08T17:05:20.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:05:20.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T17:05:20.517 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T17:05:20.916 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/633432,v1:127.0.0.1:6819/633432] [v2:127.0.0.1:6820/633432,v1:127.0.0.1:6821/633432] exists,up 37cef38d-b4cf-4fcb-b138-010faccfba47 2020-09-08T17:05:20.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:05:20.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:05:20.917 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:05:20.921 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2020-09-08T17:05:20.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: osd_pid2=633432 2020-09-08T17:05:20.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:45: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 3 2020-09-08T17:05:20.921 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:05:20.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T17:05:20.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2020-09-08T17:05:20.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T17:05:20.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-bluefs-volume-ops/3 2020-09-08T17:05:20.922 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true ' 2020-09-08T17:05:20.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:05:20.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:05:20.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:05:20.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2020-09-08T17:05:20.923 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2020-09-08T17:05:20.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T17:05:20.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T17:05:20.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2020-09-08T17:05:20.924 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T17:05:20.924 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:05:20.925 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:05:20.925 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:05:20.925 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:05:20.925 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:05:20.926 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:05:20.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:05:20.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:05:20.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T17:05:20.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T17:05:20.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2020-09-08T17:05:20.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2020-09-08T17:05:20.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:05:20.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:05:20.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:05:20.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T17:05:20.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T17:05:20.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-bluefs-volume-ops/3 2020-09-08T17:05:20.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T17:05:20.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=abe75622-cff3-4e39-9757-1bdd82c1b7b4 2020-09-08T17:05:20.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 abe75622-cff3-4e39-9757-1bdd82c1b7b4' 2020-09-08T17:05:20.929 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T17:05:20.930 INFO:tasks.workunit.client.0.smithi065.stdout:add osd3 abe75622-cff3-4e39-9757-1bdd82c1b7b4 2020-09-08T17:05:20.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDQuVdfquguOBAAkB5p3x1d8DxWfVNASMCswQ== 2020-09-08T17:05:20.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDQuVdfquguOBAAkB5p3x1d8DxWfVNASMCswQ=="}' 2020-09-08T17:05:20.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new abe75622-cff3-4e39-9757-1bdd82c1b7b4 -i td/osd-bluefs-volume-ops/3/new.json 2020-09-08T17:05:21.428 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T17:05:21.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-bluefs-volume-ops/3/new.json 2020-09-08T17:05:21.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDQuVdfquguOBAAkB5p3x1d8DxWfVNASMCswQ== --osd-uuid abe75622-cff3-4e39-9757-1bdd82c1b7b4 2020-09-08T17:05:21.461 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:21.466+0000 7fde0e3a4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:05:21.463 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:21.468+0000 7fde0e3a4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:05:21.464 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:21.469+0000 7fde0e3a4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:05:21.465 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:21.470+0000 7fde0e3a4ec0 -1 bluestore(td/osd-bluefs-volume-ops/3/block) _read_bdev_label failed to open td/osd-bluefs-volume-ops/3/block: (2) No such file or directory 2020-09-08T17:05:21.465 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:21.470+0000 7fde0e3a4ec0 -1 bluestore(td/osd-bluefs-volume-ops/3/block) _read_bdev_label failed to open td/osd-bluefs-volume-ops/3/block: (2) No such file or directory 2020-09-08T17:05:21.466 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:21.470+0000 7fde0e3a4ec0 -1 bluestore(td/osd-bluefs-volume-ops/3/block) _read_bdev_label failed to open td/osd-bluefs-volume-ops/3/block: (2) No such file or directory 2020-09-08T17:05:21.510 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:21.515+0000 7fde0e3a4ec0 -1 bluestore(td/osd-bluefs-volume-ops/3) _read_fsid unparsable uuid 2020-09-08T17:05:29.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-bluefs-volume-ops/3/keyring 2020-09-08T17:05:29.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T17:05:29.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2020-09-08T17:05:29.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-bluefs-volume-ops/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:05:29.563 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd3 key to auth repository 2020-09-08T17:05:30.100 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T17:05:30.100 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2020-09-08T17:05:30.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:05:30.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T17:05:30.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T17:05:30.101 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T17:05:30.120 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:30.126+0000 7f42f4adcec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:05:30.136 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:30.142+0000 7f42f4adcec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:05:30.137 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:30.143+0000 7f42f4adcec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:05:30.485 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2020-09-08T17:05:30.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:05:30.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T17:05:30.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:05:30.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:05:30.486 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:05:30.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:05:30.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:05:30.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T17:05:30.487 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:05:30.911 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:05:31.154 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:31.160+0000 7f42f4adcec0 -1 Falling back to public interface 2020-09-08T17:05:31.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:05:31.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:05:31.913 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:05:31.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:05:31.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T17:05:31.914 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:05:32.314 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:05:33.315 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:05:33.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:05:33.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T17:05:33.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:05:33.316 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T17:05:33.317 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T17:05:33.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:05:34.188 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:05:34.193+0000 7f42f4adcec0 -1 osd.3 0 log_to_monitors {default=true} 2020-09-08T17:05:34.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:05:34.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:05:34.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 3 2020-09-08T17:05:34.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:05:34.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T17:05:34.716 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T17:05:35.117 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/635025,v1:127.0.0.1:6827/635025] [v2:127.0.0.1:6828/635025,v1:127.0.0.1:6829/635025] exists,up abe75622-cff3-4e39-9757-1bdd82c1b7b4 2020-09-08T17:05:35.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:05:35.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:05:35.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:05:35.119 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2020-09-08T17:05:35.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: osd_pid3=635025 2020-09-08T17:05:35.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: sleep 5 2020-09-08T17:05:40.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:50: TEST_bluestore: create_pool foo 16 2020-09-08T17:05:40.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create foo 16 2020-09-08T17:05:41.019 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'foo' already exists 2020-09-08T17:05:41.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T17:05:42.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:53: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2020-09-08T17:05:42.061 INFO:tasks.workunit.client.0.smithi065.stdout:hints = 1 2020-09-08T17:05:42.061 INFO:tasks.workunit.client.0.smithi065.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2020-09-08T17:05:42.062 INFO:tasks.workunit.client.0.smithi065.stdout:Object prefix: benchmark_data_smithi065_635759 2020-09-08T17:05:42.062 INFO:tasks.workunit.client.0.smithi065.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-09-08T17:05:42.062 INFO:tasks.workunit.client.0.smithi065.stdout: 0 0 0 0 0 0 - 0 2020-09-08T17:05:43.061 INFO:tasks.workunit.client.0.smithi065.stdout: 1 16 48 32 0.124987 0.125 0.517544 0.37579 2020-09-08T17:05:44.064 INFO:tasks.workunit.client.0.smithi065.stdout: 2 16 108 92 0.179666 0.234375 0.294177 0.317324 2020-09-08T17:05:45.061 INFO:tasks.workunit.client.0.smithi065.stdout: 3 16 172 156 0.203104 0.25 0.262118 0.293955 2020-09-08T17:05:46.061 INFO:tasks.workunit.client.0.smithi065.stdout: 4 16 233 217 0.211893 0.238281 0.26057 0.285704 2020-09-08T17:05:47.062 INFO:tasks.workunit.client.0.smithi065.stdout: 5 16 297 281 0.219507 0.25 0.267783 0.280072 2020-09-08T17:05:48.062 INFO:tasks.workunit.client.0.smithi065.stdout: 6 16 361 345 0.224584 0.25 0.238006 0.274201 2020-09-08T17:05:49.062 INFO:tasks.workunit.client.0.smithi065.stdout: 7 16 425 409 0.228209 0.25 0.272876 0.271497 2020-09-08T17:05:50.062 INFO:tasks.workunit.client.0.smithi065.stdout: 8 16 476 460 0.224581 0.199219 0.277374 0.271009 2020-09-08T17:05:51.062 INFO:tasks.workunit.client.0.smithi065.stdout: 9 16 540 524 0.227403 0.25 0.261585 0.26985 2020-09-08T17:05:52.062 INFO:tasks.workunit.client.0.smithi065.stdout: 10 16 601 585 0.228488 0.238281 0.25173 0.269341 2020-09-08T17:05:53.062 INFO:tasks.workunit.client.0.smithi065.stdout: 11 16 665 649 0.23044 0.25 0.284837 0.268908 2020-09-08T17:05:54.062 INFO:tasks.workunit.client.0.smithi065.stdout: 12 16 729 713 0.232068 0.25 0.255295 0.268258 2020-09-08T17:05:55.062 INFO:tasks.workunit.client.0.smithi065.stdout: 13 16 780 764 0.229539 0.199219 0.279671 0.268348 2020-09-08T17:05:56.063 INFO:tasks.workunit.client.0.smithi065.stdout: 14 16 848 832 0.232114 0.265625 0.241589 0.266888 2020-09-08T17:05:57.063 INFO:tasks.workunit.client.0.smithi065.stdout: 15 16 905 889 0.231482 0.222656 0.269712 0.267266 2020-09-08T17:05:58.063 INFO:tasks.workunit.client.0.smithi065.stdout: 16 16 972 956 0.233369 0.261719 0.267399 0.265459 2020-09-08T17:05:59.063 INFO:tasks.workunit.client.0.smithi065.stdout: 17 16 1036 1020 0.234346 0.25 0.257828 0.264711 2020-09-08T17:06:00.063 INFO:tasks.workunit.client.0.smithi065.stdout: 18 16 1097 1081 0.234563 0.238281 0.260065 0.264206 2020-09-08T17:06:01.063 INFO:tasks.workunit.client.0.smithi065.stdout: 19 16 1153 1137 0.233729 0.21875 0.313449 0.264487 2020-09-08T17:06:02.063 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T17:06:02.070478+0000 min lat: 0.17222 max lat: 0.552325 avg lat: 0.268246 2020-09-08T17:06:02.064 INFO:tasks.workunit.client.0.smithi065.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-09-08T17:06:02.064 INFO:tasks.workunit.client.0.smithi065.stdout: 20 16 1196 1180 0.230439 0.167969 0.267753 0.268246 2020-09-08T17:06:03.064 INFO:tasks.workunit.client.0.smithi065.stdout: 21 16 1260 1244 0.231369 0.25 0.265547 0.268106 2020-09-08T17:06:04.064 INFO:tasks.workunit.client.0.smithi065.stdout: 22 16 1321 1305 0.231682 0.238281 0.25684 0.26795 2020-09-08T17:06:05.064 INFO:tasks.workunit.client.0.smithi065.stdout: 23 16 1372 1356 0.230269 0.199219 0.299618 0.26856 2020-09-08T17:06:06.064 INFO:tasks.workunit.client.0.smithi065.stdout: 24 16 1433 1417 0.230601 0.238281 0.28179 0.269321 2020-09-08T17:06:07.064 INFO:tasks.workunit.client.0.smithi065.stdout: 25 16 1497 1481 0.231376 0.25 0.268134 0.26929 2020-09-08T17:06:08.064 INFO:tasks.workunit.client.0.smithi065.stdout: 26 16 1561 1545 0.232092 0.25 0.260742 0.269008 2020-09-08T17:06:09.064 INFO:tasks.workunit.client.0.smithi065.stdout: 27 16 1612 1596 0.230873 0.199219 0.250381 0.268718 2020-09-08T17:06:10.065 INFO:tasks.workunit.client.0.smithi065.stdout: 28 16 1676 1660 0.231555 0.25 0.247112 0.267924 2020-09-08T17:06:11.065 INFO:tasks.workunit.client.0.smithi065.stdout: 29 16 1739 1723 0.232056 0.246094 0.300164 0.267934 2020-09-08T17:06:12.065 INFO:tasks.workunit.client.0.smithi065.stdout: 30 16 1801 1785 0.232393 0.242188 0.26845 0.267926 2020-09-08T17:06:13.065 INFO:tasks.workunit.client.0.smithi065.stdout:Total time run: 30.2681 2020-09-08T17:06:13.066 INFO:tasks.workunit.client.0.smithi065.stdout:Total writes made: 1801 2020-09-08T17:06:13.066 INFO:tasks.workunit.client.0.smithi065.stdout:Write size: 4096 2020-09-08T17:06:13.066 INFO:tasks.workunit.client.0.smithi065.stdout:Object size: 4096 2020-09-08T17:06:13.067 INFO:tasks.workunit.client.0.smithi065.stdout:Bandwidth (MB/sec): 0.232428 2020-09-08T17:06:13.067 INFO:tasks.workunit.client.0.smithi065.stdout:Stddev Bandwidth: 0.0302359 2020-09-08T17:06:13.067 INFO:tasks.workunit.client.0.smithi065.stdout:Max bandwidth (MB/sec): 0.265625 2020-09-08T17:06:13.067 INFO:tasks.workunit.client.0.smithi065.stdout:Min bandwidth (MB/sec): 0.125 2020-09-08T17:06:13.068 INFO:tasks.workunit.client.0.smithi065.stdout:Average IOPS: 59 2020-09-08T17:06:13.068 INFO:tasks.workunit.client.0.smithi065.stdout:Stddev IOPS: 7.7404 2020-09-08T17:06:13.068 INFO:tasks.workunit.client.0.smithi065.stdout:Max IOPS: 68 2020-09-08T17:06:13.068 INFO:tasks.workunit.client.0.smithi065.stdout:Min IOPS: 32 2020-09-08T17:06:13.068 INFO:tasks.workunit.client.0.smithi065.stdout:Average Latency(s): 0.268697 2020-09-08T17:06:13.069 INFO:tasks.workunit.client.0.smithi065.stdout:Stddev Latency(s): 0.0398911 2020-09-08T17:06:13.069 INFO:tasks.workunit.client.0.smithi065.stdout:Max latency(s): 0.552325 2020-09-08T17:06:13.069 INFO:tasks.workunit.client.0.smithi065.stdout:Min latency(s): 0.17222 2020-09-08T17:06:13.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:55: TEST_bluestore: echo 'after bench' 2020-09-08T17:06:13.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:58: TEST_bluestore: kill 630246 2020-09-08T17:06:13.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:58: TEST_bluestore: sleep 1 2020-09-08T17:06:13.175 INFO:tasks.workunit.client.0.smithi065.stdout:after bench 2020-09-08T17:06:14.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:58: TEST_bluestore: kill 630246 2020-09-08T17:06:14.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 58: kill: (630246) - No such process 2020-09-08T17:06:14.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:59: TEST_bluestore: ceph osd down 0 2020-09-08T17:06:14.595 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already down. 2020-09-08T17:06:14.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 631839 2020-09-08T17:06:14.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: sleep 1 2020-09-08T17:06:15.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 631839 2020-09-08T17:06:15.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 60: kill: (631839) - No such process 2020-09-08T17:06:15.606 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:61: TEST_bluestore: ceph osd down 1 2020-09-08T17:06:16.014 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already down. 2020-09-08T17:06:16.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 633432 2020-09-08T17:06:16.022 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: sleep 1 2020-09-08T17:06:17.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 633432 2020-09-08T17:06:17.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 62: kill: (633432) - No such process 2020-09-08T17:06:17.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:63: TEST_bluestore: ceph osd down 2 2020-09-08T17:06:17.437 INFO:tasks.workunit.client.0.smithi065.stderr:osd.2 is already down. 2020-09-08T17:06:17.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 635025 2020-09-08T17:06:17.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: sleep 1 2020-09-08T17:06:18.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 635025 2020-09-08T17:06:18.447 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 64: kill: (635025) - No such process 2020-09-08T17:06:18.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:65: TEST_bluestore: ceph osd down 3 2020-09-08T17:06:19.055 INFO:tasks.workunit.client.0.smithi065.stderr:osd.3 is already down. 2020-09-08T17:06:19.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:68: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2020-09-08T17:06:20.845 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:06:20.848 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:69: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2020-09-08T17:06:22.636 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:06:22.639 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:70: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2020-09-08T17:06:24.426 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:06:24.429 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:71: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2020-09-08T17:06:26.214 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:06:26.217 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:73: TEST_bluestore: truncate td/osd-bluefs-volume-ops/0/block -s 4294967296 2020-09-08T17:06:26.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:74: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand 2020-09-08T17:06:26.269 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:06:27.125 INFO:tasks.workunit.client.0.smithi065.stdout:0 : device size 0x20000000 : own 0x[1000~1ffff000] = 0x1ffff000 : using 0xcff000(13 MiB) 2020-09-08T17:06:27.125 INFO:tasks.workunit.client.0.smithi065.stdout:1 : device size 0x40000000 : own 0x[2000~3fffe000] = 0x3fffe000 : using 0x9fe000(10 MiB) 2020-09-08T17:06:27.125 INFO:tasks.workunit.client.0.smithi065.stdout:2 : device size 0x100000000 : own 0x[2000~7fffe000] = 0x7fffe000 : using 0x565000(5.4 MiB) 2020-09-08T17:06:27.125 INFO:tasks.workunit.client.0.smithi065.stdout:Expanding DB/WAL... 2020-09-08T17:06:27.126 INFO:tasks.workunit.client.0.smithi065.stdout:2 : expanding from 0x80000000 to 0x100000000 2020-09-08T17:06:27.359 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:06:27.365+0000 7fc71925d200 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_bdev_label failed to read from td/osd-bluefs-volume-ops/0: (21) Is a directory 2020-09-08T17:06:27.360 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:06:27.365+0000 7fc71925d200 -1 bluestore(td/osd-bluefs-volume-ops/0) unable to read label for td/osd-bluefs-volume-ops/0: (21) Is a directory 2020-09-08T17:06:32.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:75: TEST_bluestore: truncate td/osd-bluefs-volume-ops/1/block -s 4311744512 2020-09-08T17:06:32.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:76: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 bluefs-bdev-expand 2020-09-08T17:06:32.073 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:06:32.923 INFO:tasks.workunit.client.0.smithi065.stdout:0 : device size 0x20000000 : own 0x[1000~1ffff000] = 0x1ffff000 : using 0xcff000(13 MiB) 2020-09-08T17:06:32.923 INFO:tasks.workunit.client.0.smithi065.stdout:1 : device size 0x40000000 : own 0x[2000~3fffe000] = 0x3fffe000 : using 0x9fe000(10 MiB) 2020-09-08T17:06:32.924 INFO:tasks.workunit.client.0.smithi065.stdout:2 : device size 0x101000000 : own 0x[2000~7fffe000] = 0x7fffe000 : using 0x58e000(5.6 MiB) 2020-09-08T17:06:32.924 INFO:tasks.workunit.client.0.smithi065.stdout:Expanding DB/WAL... 2020-09-08T17:06:32.924 INFO:tasks.workunit.client.0.smithi065.stdout:2 : expanding from 0x80000000 to 0x101000000 2020-09-08T17:06:33.182 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:06:33.187+0000 7f02adb43200 -1 bluestore(td/osd-bluefs-volume-ops/1) _read_bdev_label failed to read from td/osd-bluefs-volume-ops/1: (21) Is a directory 2020-09-08T17:06:33.182 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:06:33.187+0000 7f02adb43200 -1 bluestore(td/osd-bluefs-volume-ops/1) unable to read label for td/osd-bluefs-volume-ops/1: (21) Is a directory 2020-09-08T17:06:37.823 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:77: TEST_bluestore: truncate td/osd-bluefs-volume-ops/2/block -s 4295099392 2020-09-08T17:06:37.824 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:78: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 bluefs-bdev-expand 2020-09-08T17:06:37.838 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:06:38.746 INFO:tasks.workunit.client.0.smithi065.stdout:0 : device size 0x20000000 : own 0x[1000~1ffff000] = 0x1ffff000 : using 0xcff000(13 MiB) 2020-09-08T17:06:38.746 INFO:tasks.workunit.client.0.smithi065.stdout:1 : device size 0x40000000 : own 0x[2000~3fffe000] = 0x3fffe000 : using 0x9fe000(10 MiB) 2020-09-08T17:06:38.746 INFO:tasks.workunit.client.0.smithi065.stdout:2 : device size 0x100020000 : own 0x[2000~7fffe000] = 0x7fffe000 : using 0x584000(5.5 MiB) 2020-09-08T17:06:38.747 INFO:tasks.workunit.client.0.smithi065.stdout:Expanding DB/WAL... 2020-09-08T17:06:38.747 INFO:tasks.workunit.client.0.smithi065.stdout:2 : expanding from 0x80000000 to 0x100020000 2020-09-08T17:06:38.995 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:06:39.001+0000 7f966f346200 -1 bluestore(td/osd-bluefs-volume-ops/2) _read_bdev_label failed to read from td/osd-bluefs-volume-ops/2: (21) Is a directory 2020-09-08T17:06:38.995 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:06:39.001+0000 7f966f346200 -1 bluestore(td/osd-bluefs-volume-ops/2) unable to read label for td/osd-bluefs-volume-ops/2: (21) Is a directory 2020-09-08T17:06:43.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:79: TEST_bluestore: truncate td/osd-bluefs-volume-ops/3/block -s 4293918720 2020-09-08T17:06:43.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:80: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 bluefs-bdev-expand 2020-09-08T17:06:43.569 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:06:44.401 INFO:tasks.workunit.client.0.smithi065.stdout:0 : device size 0x20000000 : own 0x[1000~1ffff000] = 0x1ffff000 : using 0xcff000(13 MiB) 2020-09-08T17:06:44.401 INFO:tasks.workunit.client.0.smithi065.stdout:1 : device size 0x40000000 : own 0x[2000~3fffe000] = 0x3fffe000 : using 0x9fe000(10 MiB) 2020-09-08T17:06:44.401 INFO:tasks.workunit.client.0.smithi065.stdout:2 : device size 0xfff00000 : own 0x[2000~7fffe000] = 0x7fffe000 : using 0x5a5000(5.6 MiB) 2020-09-08T17:06:44.402 INFO:tasks.workunit.client.0.smithi065.stdout:Expanding DB/WAL... 2020-09-08T17:06:44.402 INFO:tasks.workunit.client.0.smithi065.stdout:2 : expanding from 0x80000000 to 0xfff00000 2020-09-08T17:06:44.599 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:06:44.606+0000 7f8ee0bbd200 -1 bluestore(td/osd-bluefs-volume-ops/3) _read_bdev_label failed to read from td/osd-bluefs-volume-ops/3: (21) Is a directory 2020-09-08T17:06:44.600 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:06:44.606+0000 7f8ee0bbd200 -1 bluestore(td/osd-bluefs-volume-ops/3) unable to read label for td/osd-bluefs-volume-ops/3: (21) Is a directory 2020-09-08T17:06:49.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:83: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2020-09-08T17:06:51.000 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:06:51.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:84: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2020-09-08T17:06:52.787 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:06:52.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:85: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2020-09-08T17:06:54.574 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:06:54.576 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:86: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2020-09-08T17:06:56.361 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:06:56.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:88: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-sizes 2020-09-08T17:06:56.377 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:06:58.153 INFO:tasks.workunit.client.0.smithi065.stdout:0 : device size 0x20000000 : own 0x[1000~1ffff000] = 0x1ffff000 : using 0x5ff000(6.0 MiB) 2020-09-08T17:06:58.153 INFO:tasks.workunit.client.0.smithi065.stdout:1 : device size 0x40000000 : own 0x[2000~3fffe000] = 0x3fffe000 : using 0xffe000(16 MiB) 2020-09-08T17:06:58.153 INFO:tasks.workunit.client.0.smithi065.stdout:2 : device size 0x100000000 : own 0x[2000~ffffe000] = 0xffffe000 : using 0x565000(5.4 MiB) 2020-09-08T17:06:58.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:90: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.wal --dev-target td/osd-bluefs-volume-ops/0/block.db --command bluefs-bdev-migrate 2020-09-08T17:06:58.167 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:06:59.687 INFO:tasks.workunit.client.0.smithi065.stdout: device removed:0 td/osd-bluefs-volume-ops/0/block.wal 2020-09-08T17:06:59.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:95: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2020-09-08T17:07:00.973 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:07:00.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:98: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --dev-target td/osd-bluefs-volume-ops/1/block --command bluefs-bdev-migrate 2020-09-08T17:07:00.989 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:07:02.759 INFO:tasks.workunit.client.0.smithi065.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2020-09-08T17:07:02.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:103: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2020-09-08T17:07:04.045 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:07:04.047 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:106: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block.wal --devs-source td/osd-bluefs-volume-ops/2/block.db --dev-target td/osd-bluefs-volume-ops/2/block --command bluefs-bdev-migrate 2020-09-08T17:07:04.060 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:07:06.081 INFO:tasks.workunit.client.0.smithi065.stdout: device removed:1 td/osd-bluefs-volume-ops/2/block.db 2020-09-08T17:07:06.081 INFO:tasks.workunit.client.0.smithi065.stdout: device removed:0 td/osd-bluefs-volume-ops/2/block.wal 2020-09-08T17:07:06.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:112: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2020-09-08T17:07:06.867 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:07:06.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:115: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.db --dev-target td/osd-bluefs-volume-ops/3/block.wal --command bluefs-bdev-migrate 2020-09-08T17:07:06.882 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:07:06.887 INFO:tasks.workunit.client.0.smithi065.stderr:Migrate to WAL device isn't supported. 2020-09-08T17:07:06.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:121: TEST_bluestore: '[' 1 -eq 0 ']' 2020-09-08T17:07:06.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:124: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2020-09-08T17:07:08.673 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:07:08.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:127: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.wal --dev-target td/osd-bluefs-volume-ops/3/block --command bluefs-bdev-migrate 2020-09-08T17:07:08.688 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:07:10.209 INFO:tasks.workunit.client.0.smithi065.stdout: device removed:0 td/osd-bluefs-volume-ops/3/block.wal 2020-09-08T17:07:10.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:132: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2020-09-08T17:07:11.495 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:07:11.497 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:134: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block --dev-target td/osd-bluefs-volume-ops/3/block.db --command bluefs-bdev-migrate 2020-09-08T17:07:11.511 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:07:12.783 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:139: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2020-09-08T17:07:14.071 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:07:14.074 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:141: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2020-09-08T17:07:14.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:07:14.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T17:07:14.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=0 2020-09-08T17:07:14.075 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T17:07:14.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2020-09-08T17:07:14.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true ' 2020-09-08T17:07:14.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:07:14.076 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:07:14.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:07:14.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2020-09-08T17:07:14.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2020-09-08T17:07:14.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T17:07:14.077 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T17:07:14.078 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2020-09-08T17:07:14.078 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T17:07:14.078 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:07:14.078 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:07:14.080 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:07:14.081 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:07:14.081 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:07:14.081 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:07:14.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:07:14.081 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:07:14.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2020-09-08T17:07:14.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2020-09-08T17:07:14.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:07:14.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:07:14.082 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:07:14.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T17:07:14.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T17:07:14.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2020-09-08T17:07:14.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.0 2020-09-08T17:07:14.083 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 0 --fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:07:14.084 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2020-09-08T17:07:14.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 0 = 0 ']' 2020-09-08T17:07:14.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T17:07:14.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T17:07:14.084 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T17:07:14.085 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T17:07:14.100 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:07:14.106+0000 7f0b5edb9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:07:14.102 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:07:14.108+0000 7f0b5edb9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:07:14.104 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:07:14.110+0000 7f0b5edb9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:07:14.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 0 2020-09-08T17:07:14.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:07:14.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T17:07:14.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:07:14.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:07:14.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:07:14.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:07:14.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:07:14.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:07:14.481 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:07:14.870 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:07:14.876+0000 7f0b5edb9ec0 -1 Falling back to public interface 2020-09-08T17:07:14.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:07:15.885 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:07:15.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:07:15.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:07:15.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:07:15.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:07:15.887 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:07:16.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:07:17.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:07:17.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:07:17.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T17:07:17.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:07:17.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:07:17.290 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T17:07:17.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:07:17.855 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:07:17.861+0000 7f0b5edb9ec0 -1 osd.0 27 log_to_monitors {default=true} 2020-09-08T17:07:18.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:07:18.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:07:18.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 3 2020-09-08T17:07:18.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:07:18.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:07:18.694 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T17:07:19.086 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 36 up_thru 36 down_at 28 last_clean_interval [5,27) [v2:127.0.0.1:6802/644269,v1:127.0.0.1:6803/644269] [v2:127.0.0.1:6804/644269,v1:127.0.0.1:6805/644269] exists,up 5e18a2df-85af-413d-bc4d-72cf32066082 2020-09-08T17:07:19.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:07:19.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:07:19.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:07:19.089 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:142: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2020-09-08T17:07:19.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:142: TEST_bluestore: osd_pid0=644269 2020-09-08T17:07:19.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:143: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2020-09-08T17:07:19.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:07:19.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T17:07:19.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=1 2020-09-08T17:07:19.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T17:07:19.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2020-09-08T17:07:19.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true ' 2020-09-08T17:07:19.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:07:19.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:07:19.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:07:19.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2020-09-08T17:07:19.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2020-09-08T17:07:19.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T17:07:19.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T17:07:19.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2020-09-08T17:07:19.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T17:07:19.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:07:19.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:07:19.094 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:07:19.094 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:07:19.094 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:07:19.094 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:07:19.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:07:19.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:07:19.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2020-09-08T17:07:19.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2020-09-08T17:07:19.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:07:19.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:07:19.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:07:19.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T17:07:19.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T17:07:19.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2020-09-08T17:07:19.097 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T17:07:19.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.1 2020-09-08T17:07:19.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 1 --fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:07:19.098 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2020-09-08T17:07:19.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 1 = 1 ']' 2020-09-08T17:07:19.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T17:07:19.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T17:07:19.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T17:07:19.110 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:07:19.116+0000 7f691e904ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:07:19.127 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:07:19.133+0000 7f691e904ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:07:19.128 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:07:19.134+0000 7f691e904ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:07:19.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 1 2020-09-08T17:07:19.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:07:19.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T17:07:19.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:07:19.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:07:19.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:07:19.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:07:19.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:07:19.482 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:07:19.483 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:07:19.866 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:07:19.897 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:07:19.903+0000 7f691e904ec0 -1 Falling back to public interface 2020-09-08T17:07:20.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:07:20.867 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:07:20.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:07:20.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:07:20.868 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:07:20.868 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:07:21.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:07:22.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:07:22.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:07:22.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T17:07:22.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:07:22.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:07:22.263 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T17:07:22.427 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:07:22.433+0000 7f691e904ec0 -1 osd.1 30 log_to_monitors {default=true} 2020-09-08T17:07:22.682 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 38 up_thru 28 down_at 31 last_clean_interval [10,30) [v2:127.0.0.1:6810/644980,v1:127.0.0.1:6811/644980] [v2:127.0.0.1:6812/644980,v1:127.0.0.1:6813/644980] exists,up 3442ad96-47be-49cc-902b-19e77e1362c4 2020-09-08T17:07:22.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:07:22.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:07:22.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:07:22.686 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:144: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2020-09-08T17:07:22.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:144: TEST_bluestore: osd_pid1=644980 2020-09-08T17:07:22.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:145: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2020-09-08T17:07:22.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:07:22.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T17:07:22.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=2 2020-09-08T17:07:22.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T17:07:22.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2020-09-08T17:07:22.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true ' 2020-09-08T17:07:22.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:07:22.688 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:07:22.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:07:22.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2020-09-08T17:07:22.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2020-09-08T17:07:22.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T17:07:22.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T17:07:22.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2020-09-08T17:07:22.690 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T17:07:22.690 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:07:22.690 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:07:22.690 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:07:22.690 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:07:22.691 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:07:22.691 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:07:22.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:07:22.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:07:22.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2020-09-08T17:07:22.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2020-09-08T17:07:22.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:07:22.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:07:22.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:07:22.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T17:07:22.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T17:07:22.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2020-09-08T17:07:22.694 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T17:07:22.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.2 2020-09-08T17:07:22.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 2 --fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:07:22.695 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2020-09-08T17:07:22.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 2 = 2 ']' 2020-09-08T17:07:22.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T17:07:22.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T17:07:22.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T17:07:22.708 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:07:22.714+0000 7fa2f2b64ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:07:22.710 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:07:22.716+0000 7fa2f2b64ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:07:22.716 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:07:22.722+0000 7fa2f2b64ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:07:23.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 2 2020-09-08T17:07:23.175 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:07:23.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T17:07:23.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:07:23.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:07:23.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:07:23.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:07:23.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:07:23.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T17:07:23.177 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:07:23.234 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:07:23.240+0000 7fa2f2b64ec0 -1 Falling back to public interface 2020-09-08T17:07:23.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:07:24.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:07:24.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:07:24.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:07:24.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:07:24.628 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T17:07:24.629 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:07:25.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:07:25.780 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:07:25.785+0000 7fa2f2b64ec0 -1 osd.2 32 log_to_monitors {default=true} 2020-09-08T17:07:26.023 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:07:26.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:07:26.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T17:07:26.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:07:26.024 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T17:07:26.024 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T17:07:26.459 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 41 up_thru 41 down_at 33 last_clean_interval [15,32) [v2:127.0.0.1:6818/645665,v1:127.0.0.1:6819/645665] [v2:127.0.0.1:6820/645665,v1:127.0.0.1:6821/645665] exists,up 37cef38d-b4cf-4fcb-b138-010faccfba47 2020-09-08T17:07:26.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:07:26.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:07:26.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:07:26.463 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:146: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2020-09-08T17:07:26.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:146: TEST_bluestore: osd_pid2=645665 2020-09-08T17:07:26.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:147: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2020-09-08T17:07:26.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:07:26.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T17:07:26.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=3 2020-09-08T17:07:26.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T17:07:26.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2020-09-08T17:07:26.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true ' 2020-09-08T17:07:26.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:07:26.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:07:26.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:07:26.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2020-09-08T17:07:26.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2020-09-08T17:07:26.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T17:07:26.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T17:07:26.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2020-09-08T17:07:26.466 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T17:07:26.467 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:07:26.467 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:07:26.467 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:07:26.467 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:07:26.467 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:07:26.468 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:07:26.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:07:26.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:07:26.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2020-09-08T17:07:26.468 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2020-09-08T17:07:26.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:07:26.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:07:26.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:07:26.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T17:07:26.469 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T17:07:26.470 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2020-09-08T17:07:26.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.3 2020-09-08T17:07:26.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 3 --fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:07:26.471 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2020-09-08T17:07:26.471 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 3 = 3 ']' 2020-09-08T17:07:26.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T17:07:26.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T17:07:26.472 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T17:07:26.472 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T17:07:26.484 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:07:26.490+0000 7faa7b204ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:07:26.485 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:07:26.492+0000 7faa7b204ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:07:26.486 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:07:26.492+0000 7faa7b204ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:07:26.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 3 2020-09-08T17:07:26.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:07:26.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T17:07:26.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:07:26.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:07:26.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:07:26.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:07:26.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:07:26.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T17:07:26.901 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:07:27.252 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:07:27.258+0000 7faa7b204ec0 -1 Falling back to public interface 2020-09-08T17:07:27.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:07:28.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:07:28.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:07:28.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:07:28.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:07:28.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T17:07:28.292 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:07:28.715 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:07:29.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:07:29.716 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:07:29.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T17:07:29.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:07:29.717 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T17:07:29.717 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T17:07:30.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:07:30.217 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:07:30.223+0000 7faa7b204ec0 -1 osd.3 34 log_to_monitors {default=true} 2020-09-08T17:07:31.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:07:31.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:07:31.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 3 2020-09-08T17:07:31.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:07:31.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T17:07:31.120 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T17:07:31.522 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 44 up_thru 44 down_at 35 last_clean_interval [20,34) [v2:127.0.0.1:6826/646340,v1:127.0.0.1:6827/646340] [v2:127.0.0.1:6828/646340,v1:127.0.0.1:6829/646340] exists,up abe75622-cff3-4e39-9757-1bdd82c1b7b4 2020-09-08T17:07:31.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:07:31.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:07:31.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:07:31.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:148: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2020-09-08T17:07:31.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:148: TEST_bluestore: osd_pid3=646340 2020-09-08T17:07:31.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:150: TEST_bluestore: wait_for_clean 2020-09-08T17:07:31.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T17:07:31.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T17:07:31.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T17:07:31.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T17:07:31.527 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T17:07:31.527 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T17:07:31.527 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T17:07:31.527 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T17:07:31.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T17:07:31.528 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T17:07:31.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T17:07:31.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T17:07:31.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T17:07:31.618 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T17:07:31.619 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T17:07:32.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T17:07:32.011 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T17:07:32.011 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T17:07:32.011 INFO:tasks.workunit.client.0.smithi065.stderr:3' 2020-09-08T17:07:32.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T17:07:32.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:07:32.012 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T17:07:32.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=154618822661 2020-09-08T17:07:32.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 154618822661 2020-09-08T17:07:32.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-154618822661' 2020-09-08T17:07:32.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:07:32.144 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T17:07:32.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=163208757252 2020-09-08T17:07:32.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 163208757252 2020-09-08T17:07:32.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-154618822661 1-163208757252' 2020-09-08T17:07:32.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:07:32.273 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T17:07:32.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=176093659140 2020-09-08T17:07:32.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 176093659140 2020-09-08T17:07:32.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-154618822661 1-163208757252 2-176093659140' 2020-09-08T17:07:32.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:07:32.402 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T17:07:32.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=188978561027 2020-09-08T17:07:32.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 188978561027 2020-09-08T17:07:32.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-154618822661 1-163208757252 2-176093659140 3-188978561027' 2020-09-08T17:07:32.531 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:07:32.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-154618822661 2020-09-08T17:07:32.532 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:07:32.533 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T17:07:32.534 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-154618822661 2020-09-08T17:07:32.534 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:07:32.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=154618822661 2020-09-08T17:07:32.535 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 154618822661' 2020-09-08T17:07:32.535 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 154618822661 2020-09-08T17:07:32.536 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T17:07:32.984 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 154618822661 -lt 154618822661 2020-09-08T17:07:32.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:07:32.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-163208757252 2020-09-08T17:07:32.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:07:32.985 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T17:07:32.985 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-163208757252 2020-09-08T17:07:32.986 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:07:32.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=163208757252 2020-09-08T17:07:32.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 163208757252' 2020-09-08T17:07:32.987 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T17:07:32.987 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 163208757252 2020-09-08T17:07:33.382 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 163208757253 -lt 163208757252 2020-09-08T17:07:33.383 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:07:33.383 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-176093659140 2020-09-08T17:07:33.383 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:07:33.384 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T17:07:33.385 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-176093659140 2020-09-08T17:07:33.386 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:07:33.386 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=176093659140 2020-09-08T17:07:33.387 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 176093659140' 2020-09-08T17:07:33.387 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 176093659140 2020-09-08T17:07:33.387 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T17:07:33.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 176093659140 -lt 176093659140 2020-09-08T17:07:33.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:07:33.808 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-188978561027 2020-09-08T17:07:33.809 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:07:33.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T17:07:33.811 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-188978561027 2020-09-08T17:07:33.811 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:07:33.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=188978561027 2020-09-08T17:07:33.812 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 188978561027' 2020-09-08T17:07:33.812 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 188978561027 2020-09-08T17:07:33.812 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T17:07:34.199 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 188978561027 -lt 188978561027 2020-09-08T17:07:34.200 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T17:07:34.201 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:07:34.201 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:07:34.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 16 == 0 2020-09-08T17:07:34.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:07:34.739 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:07:34.739 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:07:34.739 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:07:34.739 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:07:34.740 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:07:34.740 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:07:35.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=16 2020-09-08T17:07:35.118 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:07:35.118 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:07:35.118 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:07:35.630 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 16 = 16 2020-09-08T17:07:35.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T17:07:35.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T17:07:35.631 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:153: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2020-09-08T17:07:35.668 INFO:tasks.workunit.client.0.smithi065.stdout:hints = 1 2020-09-08T17:07:35.669 INFO:tasks.workunit.client.0.smithi065.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2020-09-08T17:07:35.669 INFO:tasks.workunit.client.0.smithi065.stdout:Object prefix: benchmark_data_smithi065_647458 2020-09-08T17:07:35.669 INFO:tasks.workunit.client.0.smithi065.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-09-08T17:07:35.669 INFO:tasks.workunit.client.0.smithi065.stdout: 0 0 0 0 0 0 - 0 2020-09-08T17:07:36.669 INFO:tasks.workunit.client.0.smithi065.stdout: 1 16 39 23 0.0898388 0.0898438 0.259344 0.278655 2020-09-08T17:07:37.669 INFO:tasks.workunit.client.0.smithi065.stdout: 2 16 43 27 0.0527299 0.015625 0.133966 0.270562 2020-09-08T17:07:38.669 INFO:tasks.workunit.client.0.smithi065.stdout: 3 16 43 27 0.0351533 0 - 0.270562 2020-09-08T17:07:39.669 INFO:tasks.workunit.client.0.smithi065.stdout: 4 16 44 28 0.0273413 0.00195312 3.88867 0.39978 2020-09-08T17:07:40.669 INFO:tasks.workunit.client.0.smithi065.stdout: 5 16 72 56 0.0437455 0.109375 0.284681 0.743894 2020-09-08T17:07:41.669 INFO:tasks.workunit.client.0.smithi065.stdout: 6 16 90 74 0.0481719 0.0703125 0.192573 0.619728 2020-09-08T17:07:42.669 INFO:tasks.workunit.client.0.smithi065.stdout: 7 16 99 83 0.0463117 0.0351562 0.125966 0.56576 2020-09-08T17:07:43.669 INFO:tasks.workunit.client.0.smithi065.stdout: 8 16 147 131 0.0639572 0.1875 0.27578 0.973613 2020-09-08T17:07:44.670 INFO:tasks.workunit.client.0.smithi065.stdout: 9 16 195 179 0.0776822 0.1875 0.306588 0.796232 2020-09-08T17:07:45.670 INFO:tasks.workunit.client.0.smithi065.stdout: 10 16 245 229 0.089443 0.195312 0.260121 0.688043 2020-09-08T17:07:46.670 INFO:tasks.workunit.client.0.smithi065.stdout: 11 16 307 291 0.103326 0.242188 0.284962 0.600854 2020-09-08T17:07:47.670 INFO:tasks.workunit.client.0.smithi065.stdout: 12 16 357 341 0.11099 0.195312 0.27693 0.553459 2020-09-08T17:07:48.670 INFO:tasks.workunit.client.0.smithi065.stdout: 13 16 419 403 0.12108 0.242188 0.251063 0.509268 2020-09-08T17:07:49.670 INFO:tasks.workunit.client.0.smithi065.stdout: 14 16 469 453 0.12638 0.195312 0.339827 0.486663 2020-09-08T17:07:50.670 INFO:tasks.workunit.client.0.smithi065.stdout: 15 16 531 515 0.134099 0.242188 0.241618 0.461262 2020-09-08T17:07:51.670 INFO:tasks.workunit.client.0.smithi065.stdout: 16 16 595 579 0.141341 0.25 0.257762 0.439836 2020-09-08T17:07:52.670 INFO:tasks.workunit.client.0.smithi065.stdout: 17 16 647 631 0.144973 0.203125 0.244806 0.425714 2020-09-08T17:07:53.670 INFO:tasks.workunit.client.0.smithi065.stdout: 18 16 711 695 0.150807 0.25 0.26332 0.410891 2020-09-08T17:07:54.671 INFO:tasks.workunit.client.0.smithi065.stdout: 19 16 771 755 0.155204 0.234375 0.400541 0.401224 2020-09-08T17:07:55.671 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T17:07:55.678173+0000 min lat: 0.108837 max lat: 7.40171 avg lat: 0.394523 2020-09-08T17:07:55.671 INFO:tasks.workunit.client.0.smithi065.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-09-08T17:07:55.671 INFO:tasks.workunit.client.0.smithi065.stdout: 20 16 823 807 0.157599 0.203125 0.249803 0.394523 2020-09-08T17:07:56.671 INFO:tasks.workunit.client.0.smithi065.stdout: 21 16 883 867 0.161254 0.234375 0.261443 0.385389 2020-09-08T17:07:57.671 INFO:tasks.workunit.client.0.smithi065.stdout: 22 16 936 920 0.163334 0.207031 0.251762 0.379818 2020-09-08T17:07:58.671 INFO:tasks.workunit.client.0.smithi065.stdout: 23 16 995 979 0.166251 0.230469 0.286048 0.373311 2020-09-08T17:07:59.671 INFO:tasks.workunit.client.0.smithi065.stdout: 24 16 1043 1027 0.167136 0.1875 0.312767 0.370311 2020-09-08T17:08:00.671 INFO:tasks.workunit.client.0.smithi065.stdout: 25 16 1096 1080 0.16873 0.207031 0.260144 0.367543 2020-09-08T17:08:01.672 INFO:tasks.workunit.client.0.smithi065.stdout: 26 16 1155 1139 0.171104 0.230469 0.286173 0.362877 2020-09-08T17:08:02.672 INFO:tasks.workunit.client.0.smithi065.stdout: 27 16 1219 1203 0.174025 0.25 0.254324 0.357922 2020-09-08T17:08:03.672 INFO:tasks.workunit.client.0.smithi065.stdout: 28 16 1267 1251 0.174505 0.1875 0.28587 0.355582 2020-09-08T17:08:04.672 INFO:tasks.workunit.client.0.smithi065.stdout: 29 16 1320 1304 0.175626 0.207031 0.310284 0.352908 2020-09-08T17:08:05.672 INFO:tasks.workunit.client.0.smithi065.stdout: 30 16 1368 1352 0.176021 0.1875 0.301679 0.352303 2020-09-08T17:08:06.672 INFO:tasks.workunit.client.0.smithi065.stdout:Total time run: 30.1254 2020-09-08T17:08:06.673 INFO:tasks.workunit.client.0.smithi065.stdout:Total writes made: 1368 2020-09-08T17:08:06.673 INFO:tasks.workunit.client.0.smithi065.stdout:Write size: 4096 2020-09-08T17:08:06.673 INFO:tasks.workunit.client.0.smithi065.stdout:Object size: 4096 2020-09-08T17:08:06.673 INFO:tasks.workunit.client.0.smithi065.stdout:Bandwidth (MB/sec): 0.177384 2020-09-08T17:08:06.673 INFO:tasks.workunit.client.0.smithi065.stdout:Stddev Bandwidth: 0.0784147 2020-09-08T17:08:06.674 INFO:tasks.workunit.client.0.smithi065.stdout:Max bandwidth (MB/sec): 0.25 2020-09-08T17:08:06.674 INFO:tasks.workunit.client.0.smithi065.stdout:Min bandwidth (MB/sec): 0 2020-09-08T17:08:06.674 INFO:tasks.workunit.client.0.smithi065.stdout:Average IOPS: 45 2020-09-08T17:08:06.674 INFO:tasks.workunit.client.0.smithi065.stdout:Stddev IOPS: 20.1126 2020-09-08T17:08:06.674 INFO:tasks.workunit.client.0.smithi065.stdout:Max IOPS: 64 2020-09-08T17:08:06.675 INFO:tasks.workunit.client.0.smithi065.stdout:Min IOPS: 0 2020-09-08T17:08:06.675 INFO:tasks.workunit.client.0.smithi065.stdout:Average Latency(s): 0.351464 2020-09-08T17:08:06.675 INFO:tasks.workunit.client.0.smithi065.stdout:Stddev Latency(s): 0.583512 2020-09-08T17:08:06.675 INFO:tasks.workunit.client.0.smithi065.stdout:Max latency(s): 7.40171 2020-09-08T17:08:06.675 INFO:tasks.workunit.client.0.smithi065.stdout:Min latency(s): 0.108837 2020-09-08T17:08:06.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:156: TEST_bluestore: kill 644269 2020-09-08T17:08:06.789 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:156: TEST_bluestore: sleep 1 2020-09-08T17:08:07.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:156: TEST_bluestore: kill 644269 2020-09-08T17:08:07.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 156: kill: (644269) - No such process 2020-09-08T17:08:07.791 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:157: TEST_bluestore: ceph osd down 0 2020-09-08T17:08:08.252 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already down. 2020-09-08T17:08:08.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: kill 644980 2020-09-08T17:08:08.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: sleep 1 2020-09-08T17:08:09.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: kill 644980 2020-09-08T17:08:09.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 158: kill: (644980) - No such process 2020-09-08T17:08:09.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:159: TEST_bluestore: ceph osd down 1 2020-09-08T17:08:09.679 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already down. 2020-09-08T17:08:09.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: kill 645665 2020-09-08T17:08:09.687 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: sleep 1 2020-09-08T17:08:10.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: kill 645665 2020-09-08T17:08:10.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 160: kill: (645665) - No such process 2020-09-08T17:08:10.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:161: TEST_bluestore: ceph osd down 2 2020-09-08T17:08:11.114 INFO:tasks.workunit.client.0.smithi065.stderr:osd.2 is already down. 2020-09-08T17:08:11.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: kill 646340 2020-09-08T17:08:11.122 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: sleep 1 2020-09-08T17:08:12.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: kill 646340 2020-09-08T17:08:12.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 162: kill: (646340) - No such process 2020-09-08T17:08:12.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:163: TEST_bluestore: ceph osd down 3 2020-09-08T17:08:12.658 INFO:tasks.workunit.client.0.smithi065.stderr:osd.3 is already down. 2020-09-08T17:08:12.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:166: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2020-09-08T17:08:13.948 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:08:13.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:168: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/wal count=512 bs=1M 2020-09-08T17:08:14.208 INFO:tasks.workunit.client.0.smithi065.stderr:512+0 records in 2020-09-08T17:08:14.209 INFO:tasks.workunit.client.0.smithi065.stderr:512+0 records out 2020-09-08T17:08:14.209 INFO:tasks.workunit.client.0.smithi065.stderr:536870912 bytes (537 MB, 512 MiB) copied, 0.256633 s, 2.1 GB/s 2020-09-08T17:08:14.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:169: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --dev-target td/osd-bluefs-volume-ops/0/wal --command bluefs-bdev-new-wal 2020-09-08T17:08:14.219 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:08:18.493 INFO:tasks.workunit.client.0.smithi065.stdout:WAL device added /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/wal 2020-09-08T17:08:18.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:173: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2020-09-08T17:08:20.280 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:08:20.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:176: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2020-09-08T17:08:21.567 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:08:21.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:178: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/1/db count=1024 bs=1M 2020-09-08T17:08:22.059 INFO:tasks.workunit.client.0.smithi065.stderr:1024+0 records in 2020-09-08T17:08:22.060 INFO:tasks.workunit.client.0.smithi065.stderr:1024+0 records out 2020-09-08T17:08:22.060 INFO:tasks.workunit.client.0.smithi065.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.489189 s, 2.2 GB/s 2020-09-08T17:08:22.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:179: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --dev-target td/osd-bluefs-volume-ops/1/db --command bluefs-bdev-new-db 2020-09-08T17:08:22.070 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:08:29.093 INFO:tasks.workunit.client.0.smithi065.stdout:DB device added /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/1/db 2020-09-08T17:08:29.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:183: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block --dev-target td/osd-bluefs-volume-ops/1/block.db --command bluefs-bdev-migrate 2020-09-08T17:08:29.108 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:08:30.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:188: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2020-09-08T17:08:32.664 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:08:32.667 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:191: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2020-09-08T17:08:33.451 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:08:33.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:193: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --command bluefs-bdev-new-db 2020-09-08T17:08:33.467 INFO:tasks.workunit.client.0.smithi065.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2020-09-08T17:08:33.467 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:08:34.237 INFO:tasks.workunit.client.0.smithi065.stdout:DB device added 2020-09-08T17:08:34.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:196: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --command bluefs-bdev-new-wal 2020-09-08T17:08:34.253 INFO:tasks.workunit.client.0.smithi065.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2020-09-08T17:08:34.253 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:08:35.523 INFO:tasks.workunit.client.0.smithi065.stdout:WAL device added 2020-09-08T17:08:35.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:199: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --dev-target td/osd-bluefs-volume-ops/2/block.db --command bluefs-bdev-migrate 2020-09-08T17:08:35.538 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:08:37.561 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:204: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2020-09-08T17:08:39.349 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:08:39.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:207: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2020-09-08T17:08:40.639 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:08:40.641 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:209: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --command bluefs-bdev-new-wal 2020-09-08T17:08:40.655 INFO:tasks.workunit.client.0.smithi065.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2020-09-08T17:08:40.655 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:08:41.924 INFO:tasks.workunit.client.0.smithi065.stdout:WAL device added 2020-09-08T17:08:41.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:212: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.db --dev-target td/osd-bluefs-volume-ops/3/block --command bluefs-bdev-migrate 2020-09-08T17:08:41.940 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:08:43.711 INFO:tasks.workunit.client.0.smithi065.stdout: device removed:1 td/osd-bluefs-volume-ops/3/block.db 2020-09-08T17:08:43.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:217: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2020-09-08T17:08:44.997 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:08:45.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:219: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2020-09-08T17:08:45.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:08:45.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T17:08:45.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=0 2020-09-08T17:08:45.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T17:08:45.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2020-09-08T17:08:45.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true ' 2020-09-08T17:08:45.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:08:45.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:08:45.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:08:45.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2020-09-08T17:08:45.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2020-09-08T17:08:45.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T17:08:45.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T17:08:45.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2020-09-08T17:08:45.006 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T17:08:45.006 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:08:45.007 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:08:45.007 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:08:45.007 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:08:45.007 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:08:45.007 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:08:45.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:08:45.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:08:45.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2020-09-08T17:08:45.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2020-09-08T17:08:45.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:08:45.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:08:45.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:08:45.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T17:08:45.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T17:08:45.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2020-09-08T17:08:45.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.0 2020-09-08T17:08:45.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 0 --fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:08:45.010 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2020-09-08T17:08:45.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 0 = 0 ']' 2020-09-08T17:08:45.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T17:08:45.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T17:08:45.011 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T17:08:45.011 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T17:08:45.027 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:08:45.032+0000 7f6d518caec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:08:45.029 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:08:45.034+0000 7f6d518caec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:08:45.030 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:08:45.035+0000 7f6d518caec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:08:45.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 0 2020-09-08T17:08:45.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:08:45.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T17:08:45.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:08:45.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:08:45.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:08:45.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:08:45.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:08:45.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:08:45.403 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:08:45.807 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:08:46.046 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:08:46.052+0000 7f6d518caec0 -1 Falling back to public interface 2020-09-08T17:08:46.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:08:46.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:08:46.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:08:46.809 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:08:46.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:08:46.810 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:08:47.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:08:48.207 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:08:48.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:08:48.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T17:08:48.208 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:08:48.209 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:08:48.209 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T17:08:48.603 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:08:49.502 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:08:49.509+0000 7f6d518caec0 -1 osd.0 46 log_to_monitors {default=true} 2020-09-08T17:08:49.604 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:08:49.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:08:49.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 3 2020-09-08T17:08:49.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:08:49.605 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:08:49.606 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T17:08:49.996 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 56 up_thru 56 down_at 47 last_clean_interval [36,46) [v2:127.0.0.1:6802/651767,v1:127.0.0.1:6803/651767] [v2:127.0.0.1:6804/651767,v1:127.0.0.1:6805/651767] exists,up 5e18a2df-85af-413d-bc4d-72cf32066082 2020-09-08T17:08:49.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:08:49.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:08:49.997 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:08:50.001 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:220: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2020-09-08T17:08:50.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:220: TEST_bluestore: osd_pid0=651767 2020-09-08T17:08:50.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:221: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2020-09-08T17:08:50.001 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:08:50.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T17:08:50.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=1 2020-09-08T17:08:50.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T17:08:50.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2020-09-08T17:08:50.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true ' 2020-09-08T17:08:50.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:08:50.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:08:50.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:08:50.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2020-09-08T17:08:50.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2020-09-08T17:08:50.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T17:08:50.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T17:08:50.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2020-09-08T17:08:50.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T17:08:50.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:08:50.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:08:50.005 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:08:50.005 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:08:50.005 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:08:50.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:08:50.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:08:50.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:08:50.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2020-09-08T17:08:50.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2020-09-08T17:08:50.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:08:50.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:08:50.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:08:50.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T17:08:50.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T17:08:50.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2020-09-08T17:08:50.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.1 2020-09-08T17:08:50.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 1 --fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:08:50.008 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T17:08:50.009 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2020-09-08T17:08:50.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 1 = 1 ']' 2020-09-08T17:08:50.009 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T17:08:50.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T17:08:50.010 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T17:08:50.021 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:08:50.027+0000 7fae14f16ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:08:50.022 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:08:50.029+0000 7fae14f16ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:08:50.023 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:08:50.030+0000 7fae14f16ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:08:50.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 1 2020-09-08T17:08:50.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:08:50.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T17:08:50.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:08:50.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:08:50.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:08:50.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:08:50.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:08:50.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:08:50.421 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:08:50.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:08:51.039 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:08:51.046+0000 7fae14f16ec0 -1 Falling back to public interface 2020-09-08T17:08:51.826 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:08:51.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:08:51.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:08:51.827 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:08:51.828 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:08:51.828 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:08:52.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:08:53.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:08:53.227 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:08:53.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T17:08:53.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:08:53.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:08:53.228 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T17:08:53.623 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:08:54.317 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:08:54.323+0000 7fae14f16ec0 -1 osd.1 49 log_to_monitors {default=true} 2020-09-08T17:08:54.624 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:08:54.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:08:54.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 3 2020-09-08T17:08:54.625 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:08:54.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:08:54.626 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T17:08:55.085 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 58 up_thru 58 down_at 50 last_clean_interval [38,49) [v2:127.0.0.1:6810/652496,v1:127.0.0.1:6811/652496] [v2:127.0.0.1:6812/652496,v1:127.0.0.1:6813/652496] exists,up 3442ad96-47be-49cc-902b-19e77e1362c4 2020-09-08T17:08:55.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:08:55.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:08:55.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:08:55.089 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:222: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2020-09-08T17:08:55.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:222: TEST_bluestore: osd_pid1=652496 2020-09-08T17:08:55.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:223: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2020-09-08T17:08:55.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:08:55.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T17:08:55.090 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=2 2020-09-08T17:08:55.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T17:08:55.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2020-09-08T17:08:55.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true ' 2020-09-08T17:08:55.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:08:55.091 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:08:55.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:08:55.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2020-09-08T17:08:55.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2020-09-08T17:08:55.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T17:08:55.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T17:08:55.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2020-09-08T17:08:55.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T17:08:55.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:08:55.093 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:08:55.093 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:08:55.094 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:08:55.094 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:08:55.094 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:08:55.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:08:55.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:08:55.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2020-09-08T17:08:55.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2020-09-08T17:08:55.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:08:55.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:08:55.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:08:55.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T17:08:55.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T17:08:55.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2020-09-08T17:08:55.097 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T17:08:55.097 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.2 2020-09-08T17:08:55.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 2 --fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:08:55.098 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2020-09-08T17:08:55.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 2 = 2 ']' 2020-09-08T17:08:55.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T17:08:55.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T17:08:55.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T17:08:55.110 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:08:55.116+0000 7fe245460ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:08:55.126 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:08:55.132+0000 7fe245460ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:08:55.128 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:08:55.134+0000 7fe245460ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:08:55.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 2 2020-09-08T17:08:55.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:08:55.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T17:08:55.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:08:55.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:08:55.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:08:55.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:08:55.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:08:55.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T17:08:55.481 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:08:55.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:08:56.143 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:08:56.150+0000 7fe245460ec0 -1 Falling back to public interface 2020-09-08T17:08:56.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:08:56.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:08:56.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:08:56.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:08:56.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T17:08:56.880 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:08:57.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:08:58.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:08:58.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:08:58.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T17:08:58.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:08:58.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T17:08:58.285 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T17:08:58.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:08:59.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:08:59.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:08:59.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 3 2020-09-08T17:08:59.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:08:59.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T17:08:59.699 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T17:09:00.096 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:09:00.143 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:09:00.149+0000 7fe245460ec0 -1 osd.2 52 log_to_monitors {default=true} 2020-09-08T17:09:01.098 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:09:01.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:09:01.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 4 2020-09-08T17:09:01.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:09:01.099 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T17:09:01.100 INFO:tasks.workunit.client.0.smithi065.stdout:4 2020-09-08T17:09:01.495 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 60 up_thru 60 down_at 53 last_clean_interval [41,52) [v2:127.0.0.1:6818/653217,v1:127.0.0.1:6819/653217] [v2:127.0.0.1:6820/653217,v1:127.0.0.1:6821/653217] exists,up 37cef38d-b4cf-4fcb-b138-010faccfba47 2020-09-08T17:09:01.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:09:01.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:09:01.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:09:01.500 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:224: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2020-09-08T17:09:01.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:224: TEST_bluestore: osd_pid2=653217 2020-09-08T17:09:01.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:225: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2020-09-08T17:09:01.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:09:01.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T17:09:01.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=3 2020-09-08T17:09:01.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T17:09:01.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2020-09-08T17:09:01.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true ' 2020-09-08T17:09:01.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:09:01.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:09:01.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:09:01.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2020-09-08T17:09:01.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2020-09-08T17:09:01.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T17:09:01.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T17:09:01.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2020-09-08T17:09:01.503 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T17:09:01.503 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:09:01.503 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:09:01.504 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:09:01.504 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:09:01.504 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:09:01.504 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:09:01.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:09:01.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:09:01.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2020-09-08T17:09:01.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2020-09-08T17:09:01.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:09:01.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:09:01.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:09:01.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T17:09:01.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T17:09:01.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2020-09-08T17:09:01.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.3 2020-09-08T17:09:01.507 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T17:09:01.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 3 --fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:09:01.508 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2020-09-08T17:09:01.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 3 = 3 ']' 2020-09-08T17:09:01.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T17:09:01.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T17:09:01.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T17:09:01.520 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:09:01.527+0000 7f438d3c1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:09:01.522 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:09:01.528+0000 7f438d3c1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:09:01.523 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:09:01.529+0000 7f438d3c1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:09:01.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 3 2020-09-08T17:09:01.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:09:01.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T17:09:01.899 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:09:01.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:09:01.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:09:01.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:09:01.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:09:01.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T17:09:01.901 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:09:02.292 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:09:02.298+0000 7f438d3c1ec0 -1 Falling back to public interface 2020-09-08T17:09:02.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:09:03.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:09:03.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:09:03.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:09:03.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:09:03.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T17:09:03.296 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:09:03.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:09:04.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:09:04.696 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:09:04.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T17:09:04.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:09:04.697 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T17:09:04.697 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T17:09:05.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:09:05.561 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:09:05.567+0000 7f438d3c1ec0 -1 osd.3 54 log_to_monitors {default=true} 2020-09-08T17:09:06.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:09:06.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:09:06.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 3 2020-09-08T17:09:06.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:09:06.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T17:09:06.137 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T17:09:06.635 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 62 up_thru 62 down_at 55 last_clean_interval [44,54) [v2:127.0.0.1:6826/653964,v1:127.0.0.1:6827/653964] [v2:127.0.0.1:6828/653964,v1:127.0.0.1:6829/653964] exists,up abe75622-cff3-4e39-9757-1bdd82c1b7b4 2020-09-08T17:09:06.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:09:06.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:09:06.635 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:09:06.636 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:226: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2020-09-08T17:09:06.636 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:226: TEST_bluestore: osd_pid3=653964 2020-09-08T17:09:06.637 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:229: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2020-09-08T17:09:06.662 INFO:tasks.workunit.client.0.smithi065.stdout:hints = 1 2020-09-08T17:09:06.662 INFO:tasks.workunit.client.0.smithi065.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2020-09-08T17:09:06.663 INFO:tasks.workunit.client.0.smithi065.stdout:Object prefix: benchmark_data_smithi065_654660 2020-09-08T17:09:06.663 INFO:tasks.workunit.client.0.smithi065.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-09-08T17:09:06.663 INFO:tasks.workunit.client.0.smithi065.stdout: 0 0 0 0 0 0 - 0 2020-09-08T17:09:07.663 INFO:tasks.workunit.client.0.smithi065.stdout: 1 16 25 9 0.0351519 0.0351562 0.17538 0.55436 2020-09-08T17:09:08.663 INFO:tasks.workunit.client.0.smithi065.stdout: 2 16 31 15 0.029293 0.0234375 0.158593 0.403786 2020-09-08T17:09:09.663 INFO:tasks.workunit.client.0.smithi065.stdout: 3 16 31 15 0.0195286 0 - 0.403786 2020-09-08T17:09:10.663 INFO:tasks.workunit.client.0.smithi065.stdout: 4 16 31 15 0.0146464 0 - 0.403786 2020-09-08T17:09:11.663 INFO:tasks.workunit.client.0.smithi065.stdout: 5 16 31 15 0.0117171 0 - 0.403786 2020-09-08T17:09:12.664 INFO:tasks.workunit.client.0.smithi065.stdout: 6 16 31 15 0.00976423 0 - 0.403786 2020-09-08T17:09:13.663 INFO:tasks.workunit.client.0.smithi065.stdout: 7 16 31 15 0.0083694 0 - 0.403786 2020-09-08T17:09:14.663 INFO:tasks.workunit.client.0.smithi065.stdout: 8 16 31 15 0.00732321 0 - 0.403786 2020-09-08T17:09:15.664 INFO:tasks.workunit.client.0.smithi065.stdout: 9 16 31 15 0.00650952 0 - 0.403786 2020-09-08T17:09:16.664 INFO:tasks.workunit.client.0.smithi065.stdout: 10 16 31 15 0.0058586 0 - 0.403786 2020-09-08T17:09:17.664 INFO:tasks.workunit.client.0.smithi065.stdout: 11 16 40 24 0.00852164 0.00390625 0.283017 3.7306 2020-09-08T17:09:18.664 INFO:tasks.workunit.client.0.smithi065.stdout: 12 16 70 54 0.0175759 0.117188 0.276616 1.81297 2020-09-08T17:09:19.664 INFO:tasks.workunit.client.0.smithi065.stdout: 13 16 113 97 0.0291428 0.167969 0.192437 2.12524 2020-09-08T17:09:20.664 INFO:tasks.workunit.client.0.smithi065.stdout: 14 16 154 138 0.0384994 0.160156 0.325198 1.59683 2020-09-08T17:09:21.664 INFO:tasks.workunit.client.0.smithi065.stdout: 15 16 210 194 0.0505142 0.21875 0.310337 1.22395 2020-09-08T17:09:22.664 INFO:tasks.workunit.client.0.smithi065.stdout: 16 16 257 241 0.0588302 0.183594 0.180823 1.05066 2020-09-08T17:09:23.664 INFO:tasks.workunit.client.0.smithi065.stdout: 17 16 312 296 0.068006 0.214844 0.340404 0.910546 2020-09-08T17:09:24.665 INFO:tasks.workunit.client.0.smithi065.stdout: 18 16 372 356 0.0772471 0.234375 0.335288 0.805885 2020-09-08T17:09:25.665 INFO:tasks.workunit.client.0.smithi065.stdout: 19 16 417 401 0.082432 0.175781 0.272814 0.753032 2020-09-08T17:09:26.665 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T17:09:26.672557+0000 min lat: 0.117084 max lat: 12.4587 avg lat: 0.696307 2020-09-08T17:09:26.666 INFO:tasks.workunit.client.0.smithi065.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-09-08T17:09:26.666 INFO:tasks.workunit.client.0.smithi065.stdout: 20 16 471 455 0.0888559 0.210938 0.301048 0.696307 2020-09-08T17:09:27.665 INFO:tasks.workunit.client.0.smithi065.stdout: 21 16 524 508 0.0944818 0.207031 0.309893 0.657024 2020-09-08T17:09:28.665 INFO:tasks.workunit.client.0.smithi065.stdout: 22 16 575 559 0.0992413 0.199219 0.196509 0.62318 2020-09-08T17:09:29.666 INFO:tasks.workunit.client.0.smithi065.stdout: 23 16 632 616 0.104606 0.222656 0.300472 0.593763 2020-09-08T17:09:30.666 INFO:tasks.workunit.client.0.smithi065.stdout: 24 16 677 661 0.107571 0.175781 0.216995 0.575001 2020-09-08T17:09:31.666 INFO:tasks.workunit.client.0.smithi065.stdout: 25 16 738 722 0.112798 0.238281 0.29898 0.551431 2020-09-08T17:09:32.666 INFO:tasks.workunit.client.0.smithi065.stdout: 26 16 780 764 0.114769 0.164062 0.220742 0.540187 2020-09-08T17:09:33.666 INFO:tasks.workunit.client.0.smithi065.stdout: 27 16 832 816 0.11804 0.203125 0.226367 0.526157 2020-09-08T17:09:34.666 INFO:tasks.workunit.client.0.smithi065.stdout: 28 16 884 868 0.121078 0.203125 0.354831 0.513609 2020-09-08T17:09:35.666 INFO:tasks.workunit.client.0.smithi065.stdout: 29 16 935 919 0.123771 0.199219 0.18417 0.501301 2020-09-08T17:09:36.667 INFO:tasks.workunit.client.0.smithi065.stdout: 30 16 995 979 0.127457 0.234375 0.185079 0.488834 2020-09-08T17:09:37.667 INFO:tasks.workunit.client.0.smithi065.stdout:Total time run: 30.2459 2020-09-08T17:09:37.667 INFO:tasks.workunit.client.0.smithi065.stdout:Total writes made: 995 2020-09-08T17:09:37.667 INFO:tasks.workunit.client.0.smithi065.stdout:Write size: 4096 2020-09-08T17:09:37.667 INFO:tasks.workunit.client.0.smithi065.stdout:Object size: 4096 2020-09-08T17:09:37.668 INFO:tasks.workunit.client.0.smithi065.stdout:Bandwidth (MB/sec): 0.128504 2020-09-08T17:09:37.668 INFO:tasks.workunit.client.0.smithi065.stdout:Stddev Bandwidth: 0.0968011 2020-09-08T17:09:37.668 INFO:tasks.workunit.client.0.smithi065.stdout:Max bandwidth (MB/sec): 0.238281 2020-09-08T17:09:37.668 INFO:tasks.workunit.client.0.smithi065.stdout:Min bandwidth (MB/sec): 0 2020-09-08T17:09:37.669 INFO:tasks.workunit.client.0.smithi065.stdout:Average IOPS: 32 2020-09-08T17:09:37.669 INFO:tasks.workunit.client.0.smithi065.stdout:Stddev IOPS: 24.7811 2020-09-08T17:09:37.669 INFO:tasks.workunit.client.0.smithi065.stdout:Max IOPS: 61 2020-09-08T17:09:37.669 INFO:tasks.workunit.client.0.smithi065.stdout:Min IOPS: 0 2020-09-08T17:09:37.669 INFO:tasks.workunit.client.0.smithi065.stdout:Average Latency(s): 0.485285 2020-09-08T17:09:37.670 INFO:tasks.workunit.client.0.smithi065.stdout:Stddev Latency(s): 1.38493 2020-09-08T17:09:37.670 INFO:tasks.workunit.client.0.smithi065.stdout:Max latency(s): 12.4587 2020-09-08T17:09:37.670 INFO:tasks.workunit.client.0.smithi065.stdout:Min latency(s): 0.117084 2020-09-08T17:09:37.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:232: TEST_bluestore: kill 651767 2020-09-08T17:09:37.786 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:232: TEST_bluestore: sleep 1 2020-09-08T17:09:38.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:232: TEST_bluestore: kill 651767 2020-09-08T17:09:38.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 232: kill: (651767) - No such process 2020-09-08T17:09:38.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:233: TEST_bluestore: ceph osd down 0 2020-09-08T17:09:39.234 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already down. 2020-09-08T17:09:39.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: kill 652496 2020-09-08T17:09:39.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: sleep 1 2020-09-08T17:09:40.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: kill 652496 2020-09-08T17:09:40.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 234: kill: (652496) - No such process 2020-09-08T17:09:40.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:235: TEST_bluestore: ceph osd down 1 2020-09-08T17:09:40.682 INFO:tasks.workunit.client.0.smithi065.stderr:osd.1 is already down. 2020-09-08T17:09:40.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: kill 653217 2020-09-08T17:09:40.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: sleep 1 2020-09-08T17:09:41.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: kill 653217 2020-09-08T17:09:41.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 236: kill: (653217) - No such process 2020-09-08T17:09:41.693 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:237: TEST_bluestore: ceph osd down 2 2020-09-08T17:09:42.105 INFO:tasks.workunit.client.0.smithi065.stderr:osd.2 is already down. 2020-09-08T17:09:42.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: kill 653964 2020-09-08T17:09:42.113 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: sleep 1 2020-09-08T17:09:43.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: kill 653964 2020-09-08T17:09:43.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 238: kill: (653964) - No such process 2020-09-08T17:09:43.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:239: TEST_bluestore: ceph osd down 3 2020-09-08T17:09:43.664 INFO:tasks.workunit.client.0.smithi065.stderr:osd.3 is already down. 2020-09-08T17:09:43.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:242: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2020-09-08T17:09:45.453 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:09:45.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:244: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/db2 count=1024 bs=1M 2020-09-08T17:09:45.947 INFO:tasks.workunit.client.0.smithi065.stderr:1024+0 records in 2020-09-08T17:09:45.947 INFO:tasks.workunit.client.0.smithi065.stderr:1024+0 records out 2020-09-08T17:09:45.947 INFO:tasks.workunit.client.0.smithi065.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.489602 s, 2.2 GB/s 2020-09-08T17:09:45.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:245: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.db --dev-target td/osd-bluefs-volume-ops/0/db2 --command bluefs-bdev-migrate 2020-09-08T17:09:45.958 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:09:54.231 INFO:tasks.workunit.client.0.smithi065.stdout: device removed:1 td/osd-bluefs-volume-ops/0/block.db 2020-09-08T17:09:54.231 INFO:tasks.workunit.client.0.smithi065.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/db2 2020-09-08T17:09:54.232 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:250: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2020-09-08T17:09:56.017 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:09:56.020 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:254: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/wal2 count=512 bs=1M 2020-09-08T17:09:56.275 INFO:tasks.workunit.client.0.smithi065.stderr:512+0 records in 2020-09-08T17:09:56.275 INFO:tasks.workunit.client.0.smithi065.stderr:512+0 records out 2020-09-08T17:09:56.276 INFO:tasks.workunit.client.0.smithi065.stderr:536870912 bytes (537 MB, 512 MiB) copied, 0.254364 s, 2.1 GB/s 2020-09-08T17:09:56.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:255: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.wal --dev-target td/osd-bluefs-volume-ops/0/wal2 --command bluefs-bdev-migrate 2020-09-08T17:09:56.286 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:10:01.060 INFO:tasks.workunit.client.0.smithi065.stdout: device removed:0 td/osd-bluefs-volume-ops/0/block.wal 2020-09-08T17:10:01.060 INFO:tasks.workunit.client.0.smithi065.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/wal2 2020-09-08T17:10:01.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:259: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/0/wal 2020-09-08T17:10:01.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:261: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2020-09-08T17:10:02.895 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:10:02.898 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:264: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2020-09-08T17:10:04.682 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:10:04.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:266: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/1/db2 count=1024 bs=1M 2020-09-08T17:10:05.178 INFO:tasks.workunit.client.0.smithi065.stderr:1024+0 records in 2020-09-08T17:10:05.179 INFO:tasks.workunit.client.0.smithi065.stderr:1024+0 records out 2020-09-08T17:10:05.179 INFO:tasks.workunit.client.0.smithi065.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.491752 s, 2.2 GB/s 2020-09-08T17:10:05.179 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:267: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --devs-source td/osd-bluefs-volume-ops/1/block.wal --dev-target td/osd-bluefs-volume-ops/1/db2 --command bluefs-bdev-migrate 2020-09-08T17:10:05.189 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:10:13.463 INFO:tasks.workunit.client.0.smithi065.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2020-09-08T17:10:13.464 INFO:tasks.workunit.client.0.smithi065.stdout: device removed:0 td/osd-bluefs-volume-ops/1/block.wal 2020-09-08T17:10:13.464 INFO:tasks.workunit.client.0.smithi065.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/1/db2 2020-09-08T17:10:13.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:273: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/1/db 2020-09-08T17:10:13.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:275: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2020-09-08T17:10:14.839 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:10:14.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:277: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --dev-target td/osd-bluefs-volume-ops/1/block --command bluefs-bdev-migrate 2020-09-08T17:10:14.856 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:10:16.125 INFO:tasks.workunit.client.0.smithi065.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2020-09-08T17:10:16.128 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:282: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/1/db2 2020-09-08T17:10:16.220 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:284: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2020-09-08T17:10:17.006 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:10:17.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:287: TEST_bluestore: ceph-objectstore-tool --type bluestore --data-path td/osd-bluefs-volume-ops/2 --op fsck --no-mon-config 2020-09-08T17:10:18.792 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:10:18.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:290: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/2/db2 count=1024 bs=1M 2020-09-08T17:10:19.287 INFO:tasks.workunit.client.0.smithi065.stderr:1024+0 records in 2020-09-08T17:10:19.288 INFO:tasks.workunit.client.0.smithi065.stderr:1024+0 records out 2020-09-08T17:10:19.288 INFO:tasks.workunit.client.0.smithi065.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.490877 s, 2.2 GB/s 2020-09-08T17:10:19.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:291: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --dev-target td/osd-bluefs-volume-ops/2/db2 --command bluefs-bdev-migrate 2020-09-08T17:10:19.298 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:10:19.302 INFO:tasks.workunit.client.0.smithi065.stderr:Unable to migrate Slow volume to new location, please allocate new DB or WAL with --bluefs-bdev-new-db(wal) command 2020-09-08T17:10:19.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:297: TEST_bluestore: '[' 1 -eq 0 ']' 2020-09-08T17:10:19.303 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:300: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2020-09-08T17:10:21.084 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:10:21.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:303: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/2/db2 count=1024 bs=1M 2020-09-08T17:10:27.943 INFO:tasks.workunit.client.0.smithi065.stderr:1024+0 records in 2020-09-08T17:10:27.944 INFO:tasks.workunit.client.0.smithi065.stderr:1024+0 records out 2020-09-08T17:10:27.944 INFO:tasks.workunit.client.0.smithi065.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.72589 s, 160 MB/s 2020-09-08T17:10:27.945 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:305: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --devs-source td/osd-bluefs-volume-ops/2/block.db --devs-source td/osd-bluefs-volume-ops/2/block.wal --dev-target td/osd-bluefs-volume-ops/2/db2 --command bluefs-bdev-migrate 2020-09-08T17:10:27.956 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:10:30.226 INFO:tasks.workunit.client.0.smithi065.stdout: device removed:1 td/osd-bluefs-volume-ops/2/block.db 2020-09-08T17:10:30.227 INFO:tasks.workunit.client.0.smithi065.stdout: device removed:0 td/osd-bluefs-volume-ops/2/block.wal 2020-09-08T17:10:30.227 INFO:tasks.workunit.client.0.smithi065.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/2/db2 2020-09-08T17:10:30.229 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:312: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2020-09-08T17:10:31.516 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:10:31.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:315: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/3/wal2 count=1024 bs=1M 2020-09-08T17:10:32.011 INFO:tasks.workunit.client.0.smithi065.stderr:1024+0 records in 2020-09-08T17:10:32.012 INFO:tasks.workunit.client.0.smithi065.stderr:1024+0 records out 2020-09-08T17:10:32.012 INFO:tasks.workunit.client.0.smithi065.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.490839 s, 2.2 GB/s 2020-09-08T17:10:32.012 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:317: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block --devs-source td/osd-bluefs-volume-ops/3/block.wal --dev-target td/osd-bluefs-volume-ops/3/wal2 --command bluefs-bdev-migrate 2020-09-08T17:10:32.022 INFO:tasks.workunit.client.0.smithi065.stdout:inferring bluefs devices from bluestore path 2020-09-08T17:10:39.794 INFO:tasks.workunit.client.0.smithi065.stdout: device removed:1 td/osd-bluefs-volume-ops/3/block 2020-09-08T17:10:39.795 INFO:tasks.workunit.client.0.smithi065.stdout: device removed:0 td/osd-bluefs-volume-ops/3/block.wal 2020-09-08T17:10:39.795 INFO:tasks.workunit.client.0.smithi065.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/3/wal2 2020-09-08T17:10:39.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:323: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2020-09-08T17:10:41.081 INFO:tasks.workunit.client.0.smithi065.stdout:fsck success 2020-09-08T17:10:41.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:325: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2020-09-08T17:10:41.085 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:10:41.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T17:10:41.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=0 2020-09-08T17:10:41.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T17:10:41.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2020-09-08T17:10:41.086 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true ' 2020-09-08T17:10:41.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:10:41.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:10:41.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:10:41.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2020-09-08T17:10:41.087 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2020-09-08T17:10:41.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T17:10:41.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T17:10:41.088 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2020-09-08T17:10:41.090 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T17:10:41.091 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:10:41.091 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:10:41.091 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:10:41.091 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:10:41.091 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:10:41.092 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:10:41.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:10:41.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:10:41.092 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2020-09-08T17:10:41.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2020-09-08T17:10:41.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:10:41.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:10:41.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:10:41.093 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T17:10:41.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T17:10:41.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2020-09-08T17:10:41.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.0 2020-09-08T17:10:41.094 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 0 --fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:10:41.094 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2020-09-08T17:10:41.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 0 = 0 ']' 2020-09-08T17:10:41.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T17:10:41.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T17:10:41.095 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T17:10:41.095 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T17:10:41.111 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:10:41.118+0000 7f06ac6e2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:10:41.113 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:10:41.120+0000 7f06ac6e2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:10:41.114 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:10:41.121+0000 7f06ac6e2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:10:41.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 0 2020-09-08T17:10:41.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:10:41.487 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T17:10:41.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:10:41.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:10:41.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:10:41.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:10:41.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:10:41.488 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:10:41.489 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:10:41.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:10:42.131 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:10:42.138+0000 7f06ac6e2ec0 -1 Falling back to public interface 2020-09-08T17:10:42.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:10:42.903 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:10:42.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:10:42.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:10:42.904 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:10:42.904 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:10:43.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:10:44.296 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:10:44.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:10:44.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T17:10:44.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:10:44.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:10:44.298 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T17:10:44.710 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:10:45.567 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:10:45.574+0000 7f06ac6e2ec0 -1 osd.0 64 log_to_monitors {default=true} 2020-09-08T17:10:45.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:10:45.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:10:45.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 3 2020-09-08T17:10:45.712 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:10:45.713 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:10:45.713 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T17:10:46.124 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 74 up_thru 74 down_at 65 last_clean_interval [56,64) [v2:127.0.0.1:6802/659005,v1:127.0.0.1:6803/659005] [v2:127.0.0.1:6804/659005,v1:127.0.0.1:6805/659005] exists,up 5e18a2df-85af-413d-bc4d-72cf32066082 2020-09-08T17:10:46.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:10:46.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:10:46.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:10:46.129 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:326: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2020-09-08T17:10:46.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:326: TEST_bluestore: osd_pid0=659005 2020-09-08T17:10:46.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:327: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2020-09-08T17:10:46.129 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:10:46.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T17:10:46.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=1 2020-09-08T17:10:46.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T17:10:46.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2020-09-08T17:10:46.130 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true ' 2020-09-08T17:10:46.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:10:46.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:10:46.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:10:46.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2020-09-08T17:10:46.131 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2020-09-08T17:10:46.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T17:10:46.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T17:10:46.132 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2020-09-08T17:10:46.132 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T17:10:46.132 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:10:46.133 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:10:46.133 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:10:46.133 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:10:46.134 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:10:46.134 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:10:46.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:10:46.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:10:46.134 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2020-09-08T17:10:46.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2020-09-08T17:10:46.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:10:46.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:10:46.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:10:46.135 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T17:10:46.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T17:10:46.136 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2020-09-08T17:10:46.137 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T17:10:46.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.1 2020-09-08T17:10:46.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 1 --fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:10:46.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2020-09-08T17:10:46.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 1 = 1 ']' 2020-09-08T17:10:46.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T17:10:46.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T17:10:46.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T17:10:46.149 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:10:46.156+0000 7f32df9c7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:10:46.151 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:10:46.158+0000 7f32df9c7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:10:46.152 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:10:46.159+0000 7f32df9c7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:10:46.517 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 1 2020-09-08T17:10:46.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:10:46.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T17:10:46.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:10:46.518 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:10:46.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:10:46.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:10:46.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:10:46.519 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:10:46.520 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:10:46.672 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:10:46.679+0000 7f32df9c7ec0 -1 Falling back to public interface 2020-09-08T17:10:46.927 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:10:47.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:10:47.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:10:47.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:10:47.929 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:10:47.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:10:47.930 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:10:48.328 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:10:49.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:10:49.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:10:49.330 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T17:10:49.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:10:49.331 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:10:49.331 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T17:10:49.344 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:10:49.351+0000 7f32df9c7ec0 -1 osd.1 67 log_to_monitors {default=true} 2020-09-08T17:10:49.850 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 76 up_thru 65 down_at 68 last_clean_interval [58,67) [v2:127.0.0.1:6810/659726,v1:127.0.0.1:6811/659726] [v2:127.0.0.1:6812/659726,v1:127.0.0.1:6813/659726] exists,up 3442ad96-47be-49cc-902b-19e77e1362c4 2020-09-08T17:10:49.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:10:49.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:10:49.852 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:10:49.856 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:328: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2020-09-08T17:10:49.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:328: TEST_bluestore: osd_pid1=659726 2020-09-08T17:10:49.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:329: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2020-09-08T17:10:49.856 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:10:49.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T17:10:49.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=2 2020-09-08T17:10:49.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T17:10:49.857 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2020-09-08T17:10:49.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true ' 2020-09-08T17:10:49.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:10:49.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:10:49.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:10:49.858 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2020-09-08T17:10:49.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2020-09-08T17:10:49.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T17:10:49.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T17:10:49.859 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2020-09-08T17:10:49.860 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T17:10:49.860 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:10:49.860 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:10:49.860 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:10:49.860 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:10:49.861 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:10:49.861 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:10:49.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:10:49.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:10:49.861 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2020-09-08T17:10:49.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2020-09-08T17:10:49.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:10:49.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:10:49.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:10:49.862 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T17:10:49.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T17:10:49.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2020-09-08T17:10:49.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.2 2020-09-08T17:10:49.863 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 2 --fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:10:49.864 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2020-09-08T17:10:49.864 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T17:10:49.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 2 = 2 ']' 2020-09-08T17:10:49.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T17:10:49.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T17:10:49.865 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T17:10:49.875 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:10:49.882+0000 7ff3f4085ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:10:49.877 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:10:49.884+0000 7ff3f4085ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:10:49.878 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:10:49.885+0000 7ff3f4085ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:10:50.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 2 2020-09-08T17:10:50.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:10:50.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T17:10:50.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:10:50.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:10:50.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:10:50.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:10:50.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:10:50.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T17:10:50.294 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:10:50.644 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:10:50.650+0000 7ff3f4085ec0 -1 Falling back to public interface 2020-09-08T17:10:50.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:10:51.883 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:10:51.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:10:51.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:10:51.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:10:51.884 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T17:10:51.885 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:10:52.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:10:53.284 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:10:53.290+0000 7ff3f4085ec0 -1 osd.2 70 log_to_monitors {default=true} 2020-09-08T17:10:53.290 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T17:10:53.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:10:53.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:10:53.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T17:10:53.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T17:10:53.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:10:53.763 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 79 up_thru 68 down_at 71 last_clean_interval [60,70) [v2:127.0.0.1:6818/660409,v1:127.0.0.1:6819/660409] [v2:127.0.0.1:6820/660409,v1:127.0.0.1:6821/660409] exists,up 37cef38d-b4cf-4fcb-b138-010faccfba47 2020-09-08T17:10:53.763 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:10:53.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:10:53.764 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:10:53.767 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:330: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2020-09-08T17:10:53.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:330: TEST_bluestore: osd_pid2=660409 2020-09-08T17:10:53.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:331: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2020-09-08T17:10:53.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:10:53.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T17:10:53.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=3 2020-09-08T17:10:53.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T17:10:53.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2020-09-08T17:10:53.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true ' 2020-09-08T17:10:53.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:10:53.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:10:53.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:10:53.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2020-09-08T17:10:53.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2020-09-08T17:10:53.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T17:10:53.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T17:10:53.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2020-09-08T17:10:53.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T17:10:53.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:10:53.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:10:53.772 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:10:53.772 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:10:53.772 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:10:53.772 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:10:53.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' 2020-09-08T17:10:53.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:10:53.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2020-09-08T17:10:53.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2020-09-08T17:10:53.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:10:53.773 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:10:53.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:10:53.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T17:10:53.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T17:10:53.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2020-09-08T17:10:53.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.3 2020-09-08T17:10:53.774 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 3 --fsid=349fb143-1a8f-4355-91a8-4e9710cd12f8 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.629101/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:10:53.775 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.3 2020-09-08T17:10:53.776 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2020-09-08T17:10:53.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 3 = 3 ']' 2020-09-08T17:10:53.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T17:10:53.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T17:10:53.776 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T17:10:53.788 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:10:53.795+0000 7f1c0b7c2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:10:53.789 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:10:53.796+0000 7f1c0b7c2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:10:53.791 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:10:53.798+0000 7f1c0b7c2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:10:54.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 3 2020-09-08T17:10:54.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:10:54.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2020-09-08T17:10:54.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:10:54.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:10:54.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:10:54.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:10:54.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:10:54.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T17:10:54.336 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:10:54.561 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:10:54.567+0000 7f1c0b7c2ec0 -1 Falling back to public interface 2020-09-08T17:10:54.808 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:10:55.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:10:55.810 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:10:55.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:10:55.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T17:10:55.811 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:10:55.811 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:10:56.200 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:10:57.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:10:57.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:10:57.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2020-09-08T17:10:57.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:10:57.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T17:10:57.203 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T17:10:57.473 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:10:57.480+0000 7f1c0b7c2ec0 -1 osd.3 72 log_to_monitors {default=true} 2020-09-08T17:10:57.619 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:10:58.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:10:58.621 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:10:58.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 3 2020-09-08T17:10:58.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:10:58.622 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2020-09-08T17:10:58.622 INFO:tasks.workunit.client.0.smithi065.stdout:3 2020-09-08T17:10:59.025 INFO:tasks.workunit.client.0.smithi065.stdout:osd.3 up in weight 1 up_from 82 up_thru 82 down_at 73 last_clean_interval [62,72) [v2:127.0.0.1:6826/661098,v1:127.0.0.1:6827/661098] [v2:127.0.0.1:6828/661098,v1:127.0.0.1:6829/661098] exists,up abe75622-cff3-4e39-9757-1bdd82c1b7b4 2020-09-08T17:10:59.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:10:59.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:10:59.026 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:10:59.027 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:332: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2020-09-08T17:10:59.027 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:332: TEST_bluestore: osd_pid3=661098 2020-09-08T17:10:59.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:335: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2020-09-08T17:10:59.053 INFO:tasks.workunit.client.0.smithi065.stdout:hints = 1 2020-09-08T17:10:59.053 INFO:tasks.workunit.client.0.smithi065.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2020-09-08T17:10:59.054 INFO:tasks.workunit.client.0.smithi065.stdout:Object prefix: benchmark_data_smithi065_661794 2020-09-08T17:10:59.054 INFO:tasks.workunit.client.0.smithi065.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-09-08T17:10:59.054 INFO:tasks.workunit.client.0.smithi065.stdout: 0 0 0 0 0 0 - 0 2020-09-08T17:11:00.054 INFO:tasks.workunit.client.0.smithi065.stdout: 1 16 49 33 0.128891 0.128906 0.167492 0.214815 2020-09-08T17:11:01.054 INFO:tasks.workunit.client.0.smithi065.stdout: 2 16 55 39 0.0761617 0.0234375 0.092111 0.207696 2020-09-08T17:11:02.053 INFO:tasks.workunit.client.0.smithi065.stdout: 3 16 55 39 0.0507743 0 - 0.207696 2020-09-08T17:11:03.054 INFO:tasks.workunit.client.0.smithi065.stdout: 4 16 55 39 0.0380805 0 - 0.207696 2020-09-08T17:11:04.054 INFO:tasks.workunit.client.0.smithi065.stdout: 5 16 55 39 0.0304643 0 - 0.207696 2020-09-08T17:11:05.054 INFO:tasks.workunit.client.0.smithi065.stdout: 6 16 55 39 0.0253869 0 - 0.207696 2020-09-08T17:11:06.055 INFO:tasks.workunit.client.0.smithi065.stdout: 7 16 55 39 0.0217601 0 - 0.207696 2020-09-08T17:11:07.054 INFO:tasks.workunit.client.0.smithi065.stdout: 8 16 79 63 0.0307571 0.015625 0.226096 0.91477 2020-09-08T17:11:08.055 INFO:tasks.workunit.client.0.smithi065.stdout: 9 16 88 72 0.0312453 0.0351562 0.0917864 0.820871 2020-09-08T17:11:09.055 INFO:tasks.workunit.client.0.smithi065.stdout: 10 16 88 72 0.0281208 0 - 0.820871 2020-09-08T17:11:10.055 INFO:tasks.workunit.client.0.smithi065.stdout: 11 16 88 72 0.0255644 0 - 0.820871 2020-09-08T17:11:11.055 INFO:tasks.workunit.client.0.smithi065.stdout: 12 16 147 131 0.042637 0.0768229 0.152872 1.43034 2020-09-08T17:11:12.055 INFO:tasks.workunit.client.0.smithi065.stdout: 13 16 215 199 0.0597869 0.265625 0.107811 1.03428 2020-09-08T17:11:13.055 INFO:tasks.workunit.client.0.smithi065.stdout: 14 16 276 260 0.0725342 0.238281 0.126138 0.851763 2020-09-08T17:11:14.055 INFO:tasks.workunit.client.0.smithi065.stdout: 15 16 349 333 0.0867064 0.285156 0.246657 0.717659 2020-09-08T17:11:15.055 INFO:tasks.workunit.client.0.smithi065.stdout: 16 16 415 399 0.0973982 0.257812 0.175733 0.637023 2020-09-08T17:11:16.056 INFO:tasks.workunit.client.0.smithi065.stdout: 17 16 467 451 0.103616 0.203125 0.142616 0.599697 2020-09-08T17:11:17.056 INFO:tasks.workunit.client.0.smithi065.stdout: 18 16 521 505 0.109577 0.210938 0.359351 0.563818 2020-09-08T17:11:18.056 INFO:tasks.workunit.client.0.smithi065.stdout: 19 16 582 566 0.116349 0.238281 0.142889 0.53278 2020-09-08T17:11:19.056 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T17:11:19.063877+0000 min lat: 0.0695718 max lat: 11.1762 avg lat: 0.497283 2020-09-08T17:11:19.056 INFO:tasks.workunit.client.0.smithi065.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-09-08T17:11:19.057 INFO:tasks.workunit.client.0.smithi065.stdout: 20 16 656 640 0.124982 0.289062 0.166973 0.497283 2020-09-08T17:11:20.056 INFO:tasks.workunit.client.0.smithi065.stdout: 21 16 724 708 0.131678 0.265625 0.239553 0.472072 2020-09-08T17:11:21.056 INFO:tasks.workunit.client.0.smithi065.stdout: 22 16 773 757 0.134392 0.191406 0.161497 0.458105 2020-09-08T17:11:22.056 INFO:tasks.workunit.client.0.smithi065.stdout: 23 16 838 822 0.139587 0.253906 0.280901 0.445822 2020-09-08T17:11:23.056 INFO:tasks.workunit.client.0.smithi065.stdout: 24 16 897 881 0.143373 0.230469 0.1247 0.432744 2020-09-08T17:11:24.056 INFO:tasks.workunit.client.0.smithi065.stdout: 25 16 953 937 0.146387 0.21875 0.180986 0.4236 2020-09-08T17:11:25.057 INFO:tasks.workunit.client.0.smithi065.stdout: 26 16 1023 1007 0.151272 0.273438 0.129096 0.410311 2020-09-08T17:11:26.057 INFO:tasks.workunit.client.0.smithi065.stdout: 27 16 1089 1073 0.155217 0.257812 0.0769227 0.400472 2020-09-08T17:11:27.057 INFO:tasks.workunit.client.0.smithi065.stdout: 28 16 1142 1126 0.157066 0.207031 0.160386 0.395917 2020-09-08T17:11:28.057 INFO:tasks.workunit.client.0.smithi065.stdout: 29 16 1200 1184 0.159461 0.226562 0.108562 0.389892 2020-09-08T17:11:29.057 INFO:tasks.workunit.client.0.smithi065.stdout: 30 16 1262 1246 0.162218 0.242188 0.327646 0.383511 2020-09-08T17:11:30.057 INFO:tasks.workunit.client.0.smithi065.stdout:Total time run: 30.1702 2020-09-08T17:11:30.058 INFO:tasks.workunit.client.0.smithi065.stdout:Total writes made: 1262 2020-09-08T17:11:30.058 INFO:tasks.workunit.client.0.smithi065.stdout:Write size: 4096 2020-09-08T17:11:30.058 INFO:tasks.workunit.client.0.smithi065.stdout:Object size: 4096 2020-09-08T17:11:30.058 INFO:tasks.workunit.client.0.smithi065.stdout:Bandwidth (MB/sec): 0.163396 2020-09-08T17:11:30.059 INFO:tasks.workunit.client.0.smithi065.stdout:Stddev Bandwidth: 0.113901 2020-09-08T17:11:30.059 INFO:tasks.workunit.client.0.smithi065.stdout:Max bandwidth (MB/sec): 0.289062 2020-09-08T17:11:30.059 INFO:tasks.workunit.client.0.smithi065.stdout:Min bandwidth (MB/sec): 0 2020-09-08T17:11:30.059 INFO:tasks.workunit.client.0.smithi065.stdout:Average IOPS: 41 2020-09-08T17:11:30.059 INFO:tasks.workunit.client.0.smithi065.stdout:Stddev IOPS: 29.1745 2020-09-08T17:11:30.059 INFO:tasks.workunit.client.0.smithi065.stdout:Max IOPS: 74 2020-09-08T17:11:30.060 INFO:tasks.workunit.client.0.smithi065.stdout:Min IOPS: 0 2020-09-08T17:11:30.060 INFO:tasks.workunit.client.0.smithi065.stdout:Average Latency(s): 0.381941 2020-09-08T17:11:30.060 INFO:tasks.workunit.client.0.smithi065.stdout:Stddev Latency(s): 1.02949 2020-09-08T17:11:30.060 INFO:tasks.workunit.client.0.smithi065.stdout:Max latency(s): 11.1762 2020-09-08T17:11:30.060 INFO:tasks.workunit.client.0.smithi065.stdout:Min latency(s): 0.0695718 2020-09-08T17:11:30.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:337: TEST_bluestore: wait_for_clean 2020-09-08T17:11:30.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T17:11:30.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T17:11:30.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T17:11:30.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T17:11:30.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T17:11:30.153 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T17:11:30.153 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T17:11:30.153 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T17:11:30.154 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T17:11:30.154 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T17:11:30.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T17:11:30.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T17:11:30.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T17:11:30.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T17:11:30.260 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T17:11:30.646 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T17:11:30.646 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T17:11:30.646 INFO:tasks.workunit.client.0.smithi065.stderr:2 2020-09-08T17:11:30.647 INFO:tasks.workunit.client.0.smithi065.stderr:3' 2020-09-08T17:11:30.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T17:11:30.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:11:30.648 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T17:11:30.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=317827579916 2020-09-08T17:11:30.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 317827579916 2020-09-08T17:11:30.803 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-317827579916' 2020-09-08T17:11:30.804 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:11:30.804 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T17:11:30.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=326417514507 2020-09-08T17:11:30.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 326417514507 2020-09-08T17:11:30.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-317827579916 1-326417514507' 2020-09-08T17:11:30.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:11:30.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T17:11:31.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=339302416394 2020-09-08T17:11:31.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 339302416394 2020-09-08T17:11:31.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-317827579916 1-326417514507 2-339302416394' 2020-09-08T17:11:31.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:11:31.063 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-09-08T17:11:31.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=352187318281 2020-09-08T17:11:31.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 352187318281 2020-09-08T17:11:31.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-317827579916 1-326417514507 2-339302416394 3-352187318281' 2020-09-08T17:11:31.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:11:31.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-317827579916 2020-09-08T17:11:31.192 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:11:31.193 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T17:11:31.193 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-317827579916 2020-09-08T17:11:31.194 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:11:31.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=317827579916 2020-09-08T17:11:31.195 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 317827579916' 2020-09-08T17:11:31.195 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 317827579916 2020-09-08T17:11:31.195 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T17:11:31.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 317827579914 -lt 317827579916 2020-09-08T17:11:31.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T17:11:32.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T17:11:32.584 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T17:11:33.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 317827579916 -lt 317827579916 2020-09-08T17:11:33.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:11:33.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-326417514507 2020-09-08T17:11:33.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:11:33.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T17:11:33.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-326417514507 2020-09-08T17:11:33.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:11:33.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=326417514507 2020-09-08T17:11:33.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 326417514507' 2020-09-08T17:11:33.006 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 326417514507 2020-09-08T17:11:33.007 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T17:11:33.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 326417514507 -lt 326417514507 2020-09-08T17:11:33.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:11:33.415 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-339302416394 2020-09-08T17:11:33.416 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:11:33.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T17:11:33.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-339302416394 2020-09-08T17:11:33.418 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:11:33.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=339302416394 2020-09-08T17:11:33.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 339302416394' 2020-09-08T17:11:33.419 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 339302416394 2020-09-08T17:11:33.419 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T17:11:33.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 339302416394 -lt 339302416394 2020-09-08T17:11:33.817 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:11:33.818 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-352187318281 2020-09-08T17:11:33.818 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:11:33.819 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2020-09-08T17:11:33.820 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-352187318281 2020-09-08T17:11:33.820 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:11:33.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=352187318281 2020-09-08T17:11:33.821 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 352187318281' 2020-09-08T17:11:33.821 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.3 seq 352187318281 2020-09-08T17:11:33.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2020-09-08T17:11:34.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 352187318282 -lt 352187318281 2020-09-08T17:11:34.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T17:11:34.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:11:34.222 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:11:34.747 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 16 == 0 2020-09-08T17:11:34.748 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:11:34.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:11:34.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:11:34.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:11:34.749 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:11:34.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:11:34.750 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:11:35.126 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=16 2020-09-08T17:11:35.127 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:11:35.127 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:11:35.128 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:11:35.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 16 = 16 2020-09-08T17:11:35.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T17:11:35.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T17:11:35.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:25: run: teardown td/osd-bluefs-volume-ops 2020-09-08T17:11:35.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:11:35.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T17:11:35.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2020-09-08T17:11:35.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:11:35.649 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:11:35.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:11:35.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:11:35.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:11:35.766 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:11:35.766 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:11:35.767 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:11:35.767 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:11:35.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:11:35.768 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:11:35.768 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:11:35.769 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:11:35.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:11:35.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:11:35.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:11:35.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:11:35.771 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T17:11:35.772 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-bluefs-volume-ops 2020-09-08T17:11:36.111 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:11:36.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:36.112 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:11:36.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.629101 2020-09-08T17:11:36.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:11:36.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:11:36.114 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2151: main: code=0 2020-09-08T17:11:36.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2155: main: teardown td/osd-bluefs-volume-ops 0 2020-09-08T17:11:36.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-bluefs-volume-ops 2020-09-08T17:11:36.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2020-09-08T17:11:36.115 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2020-09-08T17:11:36.115 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:11:36.116 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:11:36.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:11:36.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:11:36.116 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:11:36.117 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:11:36.117 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:11:36.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:11:36.118 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:11:36.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:11:36.118 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:11:36.118 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:11:36.119 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:11:36.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:11:36.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:11:36.120 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:11:36.120 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:11:36.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2020-09-08T17:11:36.121 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-bluefs-volume-ops 2020-09-08T17:11:36.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:11:36.122 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:36.123 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.629101 2020-09-08T17:11:36.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.629101 2020-09-08T17:11:36.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:11:36.124 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:11:36.125 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2156: main: return 0 2020-09-08T17:11:36.126 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-09-08T17:11:36.126 INFO:teuthology.orchestra.run.smithi065:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-09-08T17:11:36.203 INFO:tasks.workunit:Running workunit osd/osd-config.sh... 2020-09-08T17:11:36.203 INFO:teuthology.orchestra.run.smithi065:workunit test osd/osd-config.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dce4d291bd4243c9802c17d67b85a6da6bbc0f8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh 2020-09-08T17:11:36.264 INFO:tasks.workunit.client.0.smithi065.stderr:stty: 'standard input': Inappropriate ioctl for device 2020-09-08T17:11:36.271 INFO:tasks.workunit.client.0.smithi065.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2020-09-08T17:11:36.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T17:11:36.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T17:11:36.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: export PYTHONWARNINGS=ignore 2020-09-08T17:11:36.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: PYTHONWARNINGS=ignore 2020-09-08T17:11:36.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: export CEPH_CONF=/dev/null 2020-09-08T17:11:36.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: CEPH_CONF=/dev/null 2020-09-08T17:11:36.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2147: main: unset CEPH_ARGS 2020-09-08T17:11:36.272 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2149: main: local code 2020-09-08T17:11:36.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2150: main: run td/osd-config 2020-09-08T17:11:36.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:22: run: local dir=td/osd-config 2020-09-08T17:11:36.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:23: run: shift 2020-09-08T17:11:36.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:25: run: export CEPH_MON=127.0.0.1:7100 2020-09-08T17:11:36.273 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:25: run: CEPH_MON=127.0.0.1:7100 2020-09-08T17:11:36.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:26: run: export CEPH_ARGS 2020-09-08T17:11:36.274 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:27: run: uuidgen 2020-09-08T17:11:36.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:27: run: CEPH_ARGS+='--fsid=9a64a3ce-eaf3-4ba2-a90a-0c445f7d809b --auth-supported=none ' 2020-09-08T17:11:36.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7100 ' 2020-09-08T17:11:36.274 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:30: run: set 2020-09-08T17:11:36.276 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:30: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2020-09-08T17:11:36.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:30: run: local 'funcs=TEST_config_init 2020-09-08T17:11:36.277 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_config_track 2020-09-08T17:11:36.277 INFO:tasks.workunit.client.0.smithi065.stderr:TEST_default_adjustment' 2020-09-08T17:11:36.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:31: run: for func in $funcs 2020-09-08T17:11:36.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:32: run: setup td/osd-config 2020-09-08T17:11:36.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-config 2020-09-08T17:11:36.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-config 2020-09-08T17:11:36.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-config 2020-09-08T17:11:36.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T17:11:36.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-config KILL 2020-09-08T17:11:36.279 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:11:36.279 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:11:36.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:11:36.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:11:36.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:11:36.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:11:36.280 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:11:36.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:11:36.280 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:11:36.280 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:11:36.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:11:36.281 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:11:36.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:11:36.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:11:36.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:11:36.283 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:11:36.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:11:36.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T17:11:36.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-config 2020-09-08T17:11:36.284 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:11:36.284 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:36.284 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:36.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.662352 2020-09-08T17:11:36.284 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:11:36.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:11:36.285 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-config 2020-09-08T17:11:36.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T17:11:36.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:36.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:36.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.662352 2020-09-08T17:11:36.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T17:11:36.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2020-09-08T17:11:36.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2020-09-08T17:11:36.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T17:11:36.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-config 1' TERM HUP INT 2020-09-08T17:11:36.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:33: run: TEST_config_init td/osd-config 2020-09-08T17:11:36.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:39: TEST_config_init: local dir=td/osd-config 2020-09-08T17:11:36.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:41: TEST_config_init: run_mon td/osd-config a 2020-09-08T17:11:36.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-config 2020-09-08T17:11:36.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T17:11:36.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T17:11:36.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T17:11:36.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-config/a 2020-09-08T17:11:36.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-config/a --run-dir=td/osd-config 2020-09-08T17:11:36.576 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T17:11:36.577 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:11:36.577 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:11:36.577 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:11:36.577 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:36.577 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:36.578 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.662352/$cluster-$name.asok' 2020-09-08T17:11:36.578 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-config/a '--log-file=td/osd-config/$name.log' '--admin-socket=/tmp/ceph-asok.662352/$cluster-$name.asok' --mon-cluster-log-file=td/osd-config/log --run-dir=td/osd-config '--pid-file=td/osd-config/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T17:11:36.770 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T17:11:36.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T17:11:36.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T17:11:36.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T17:11:36.771 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T17:11:36.773 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T17:11:36.773 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T17:11:36.773 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T17:11:36.773 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T17:11:36.774 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T17:11:36.774 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:36.774 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:36.774 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.662352/ceph-mon.a.asok 2020-09-08T17:11:36.774 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T17:11:36.775 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.662352/ceph-mon.a.asok config get fsid 2020-09-08T17:11:36.863 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T17:11:36.863 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T17:11:36.863 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T17:11:36.864 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T17:11:36.864 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T17:11:36.864 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T17:11:36.864 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T17:11:36.864 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T17:11:36.865 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T17:11:36.865 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:36.865 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:36.865 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.662352/ceph-mon.a.asok 2020-09-08T17:11:36.866 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T17:11:36.866 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.662352/ceph-mon.a.asok config get mon_host 2020-09-08T17:11:36.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:42: TEST_config_init: run_mgr td/osd-config x 2020-09-08T17:11:36.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-config 2020-09-08T17:11:36.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T17:11:36.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T17:11:36.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T17:11:36.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-config/x 2020-09-08T17:11:36.956 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T17:11:37.848 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T17:11:37.849 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:11:37.849 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:11:37.850 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:11:37.850 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:37.850 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:37.850 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.662352/$cluster-$name.asok' 2020-09-08T17:11:37.850 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T17:11:37.851 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-config/x '--log-file=td/osd-config/$name.log' '--admin-socket=/tmp/ceph-asok.662352/$cluster-$name.asok' --run-dir=td/osd-config '--pid-file=td/osd-config/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T17:11:37.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:43: TEST_config_init: local stale=1000 2020-09-08T17:11:37.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:44: TEST_config_init: local cache=500 2020-09-08T17:11:37.872 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:45: TEST_config_init: run_osd td/osd-config 0 --osd-map-cache-size=500 --osd-pg-epoch-persisted-max-stale=1000 2020-09-08T17:11:37.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-config 2020-09-08T17:11:37.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T17:11:37.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T17:11:37.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T17:11:37.873 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-config/0 2020-09-08T17:11:37.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=9a64a3ce-eaf3-4ba2-a90a-0c445f7d809b --auth-supported=none --mon-host=127.0.0.1:7100 ' 2020-09-08T17:11:37.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:11:37.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:11:37.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:11:37.874 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-config/0' 2020-09-08T17:11:37.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-config/0/journal' 2020-09-08T17:11:37.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T17:11:37.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T17:11:37.875 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-config' 2020-09-08T17:11:37.875 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T17:11:37.876 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:11:37.876 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:11:37.876 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:11:37.876 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:37.876 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:37.877 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.662352/$cluster-$name.asok' 2020-09-08T17:11:37.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.662352/$cluster-$name.asok' 2020-09-08T17:11:37.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:11:37.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T17:11:37.877 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T17:11:37.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-config/$name.log' 2020-09-08T17:11:37.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-config/$name.pid' 2020-09-08T17:11:37.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:11:37.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:11:37.878 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:11:37.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T17:11:37.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+='--osd-map-cache-size=500 --osd-pg-epoch-persisted-max-stale=1000' 2020-09-08T17:11:37.879 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-config/0 2020-09-08T17:11:37.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T17:11:37.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=e4e48dff-4ba8-40c4-9ef1-4f968fccfac4 2020-09-08T17:11:37.880 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 e4e48dff-4ba8-40c4-9ef1-4f968fccfac4' 2020-09-08T17:11:37.880 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T17:11:37.881 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 e4e48dff-4ba8-40c4-9ef1-4f968fccfac4 2020-09-08T17:11:37.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBJu1df6Jo+NRAASfQ5B6yLhDhfUVG5ORMTWw== 2020-09-08T17:11:37.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBJu1df6Jo+NRAASfQ5B6yLhDhfUVG5ORMTWw=="}' 2020-09-08T17:11:37.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new e4e48dff-4ba8-40c4-9ef1-4f968fccfac4 -i td/osd-config/0/new.json 2020-09-08T17:11:38.239 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:11:38.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-config/0/new.json 2020-09-08T17:11:38.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=9a64a3ce-eaf3-4ba2-a90a-0c445f7d809b --auth-supported=none --mon-host=127.0.0.1:7100 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-config/0 --osd-journal=td/osd-config/0/journal --chdir= --run-dir=td/osd-config '--admin-socket=/tmp/ceph-asok.662352/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-config/$name.log' '--pid-file=td/osd-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-map-cache-size=500 --osd-pg-epoch-persisted-max-stale=1000 --mkfs --key AQBJu1df6Jo+NRAASfQ5B6yLhDhfUVG5ORMTWw== --osd-uuid e4e48dff-4ba8-40c4-9ef1-4f968fccfac4 2020-09-08T17:11:38.273 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:38.280+0000 7fda5c7f8ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:11:38.275 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:38.282+0000 7fda5c7f8ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:11:38.277 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:38.283+0000 7fda5c7f8ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:11:38.278 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:38.285+0000 7fda5c7f8ec0 -1 bluestore(td/osd-config/0/block) _read_bdev_label failed to open td/osd-config/0/block: (2) No such file or directory 2020-09-08T17:11:38.278 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:38.285+0000 7fda5c7f8ec0 -1 bluestore(td/osd-config/0/block) _read_bdev_label failed to open td/osd-config/0/block: (2) No such file or directory 2020-09-08T17:11:38.278 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:38.285+0000 7fda5c7f8ec0 -1 bluestore(td/osd-config/0/block) _read_bdev_label failed to open td/osd-config/0/block: (2) No such file or directory 2020-09-08T17:11:38.335 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:38.342+0000 7fda5c7f8ec0 -1 bluestore(td/osd-config/0) _read_fsid unparsable uuid 2020-09-08T17:11:42.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-config/0/keyring 2020-09-08T17:11:42.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T17:11:42.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T17:11:42.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-config/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:11:42.678 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T17:11:43.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T17:11:43.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=9a64a3ce-eaf3-4ba2-a90a-0c445f7d809b --auth-supported=none --mon-host=127.0.0.1:7100 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-config/0 --osd-journal=td/osd-config/0/journal --chdir= --run-dir=td/osd-config '--admin-socket=/tmp/ceph-asok.662352/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-config/$name.log' '--pid-file=td/osd-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-map-cache-size=500 --osd-pg-epoch-persisted-max-stale=1000 2020-09-08T17:11:43.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T17:11:43.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T17:11:43.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T17:11:43.211 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T17:11:43.231 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:43.237+0000 7febfeeebec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:11:43.249 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:43.256+0000 7febfeeebec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:11:43.251 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:43.258+0000 7febfeeebec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:11:43.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T17:11:43.599 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:11:43.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T17:11:43.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:11:43.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:11:43.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:11:43.600 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:11:43.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:11:43.601 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:11:43.601 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:11:43.767 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:43.774+0000 7febfeeebec0 -1 Falling back to public interface 2020-09-08T17:11:44.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:11:44.559 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:44.565+0000 7febfeeebec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T17:11:45.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:11:45.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:11:45.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:11:45.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:11:45.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:11:45.009 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:11:45.449 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/663210,v1:127.0.0.1:6803/663210] [v2:127.0.0.1:6804/663210,v1:127.0.0.1:6805/663210] exists,up e4e48dff-4ba8-40c4-9ef1-4f968fccfac4 2020-09-08T17:11:45.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:11:45.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:11:45.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:11:45.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:49: TEST_config_init: get_asok_path osd.0 2020-09-08T17:11:45.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-09-08T17:11:45.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-09-08T17:11:45.451 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T17:11:45.451 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:45.451 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:45.451 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.662352/ceph-osd.0.asok 2020-09-08T17:11:45.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:49: TEST_config_init: CEPH_ARGS= 2020-09-08T17:11:45.452 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:49: TEST_config_init: ceph --admin-daemon /tmp/ceph-asok.662352/ceph-osd.0.asok log flush 2020-09-08T17:11:45.543 INFO:tasks.workunit.client.0.smithi065.stdout:{} 2020-09-08T17:11:45.551 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:50: TEST_config_init: grep 'is not > osd_pg_epoch_persisted_max_stale' td/osd-config/osd.0.log 2020-09-08T17:11:45.553 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T17:11:44.852+0000 7febfeeebec0 0 log_channel(cluster) log [WRN] : osd_map_cache_size (500) is not > osd_pg_epoch_persisted_max_stale (1000) 2020-09-08T17:11:45.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:34: run: teardown td/osd-config 2020-09-08T17:11:45.553 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-config 2020-09-08T17:11:45.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T17:11:45.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-config KILL 2020-09-08T17:11:45.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:11:45.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:11:45.554 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:11:45.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:11:45.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:11:45.660 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:11:45.661 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:11:45.661 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:11:45.662 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:11:45.662 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:11:45.663 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:11:45.663 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:11:45.664 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:11:45.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:11:45.665 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:11:45.665 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:11:45.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:11:45.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T17:11:45.666 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-config 2020-09-08T17:11:45.668 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:11:45.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:45.669 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:45.669 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.662352 2020-09-08T17:11:45.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:11:45.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:11:45.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:31: run: for func in $funcs 2020-09-08T17:11:45.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:32: run: setup td/osd-config 2020-09-08T17:11:45.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-config 2020-09-08T17:11:45.671 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-config 2020-09-08T17:11:45.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-config 2020-09-08T17:11:45.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T17:11:45.672 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-config KILL 2020-09-08T17:11:45.672 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:11:45.672 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:11:45.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:11:45.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:11:45.673 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:11:45.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:11:45.674 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:11:45.674 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:11:45.674 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:11:45.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:11:45.675 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:11:45.675 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:11:45.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:11:45.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:11:45.676 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:11:45.677 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:11:45.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:11:45.677 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T17:11:45.678 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-config 2020-09-08T17:11:45.678 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:11:45.679 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:45.679 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:45.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.662352 2020-09-08T17:11:45.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:11:45.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:11:45.680 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-config 2020-09-08T17:11:45.681 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T17:11:45.681 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:45.681 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:45.681 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.662352 2020-09-08T17:11:45.683 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T17:11:45.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T17:11:45.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T17:11:45.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-config 1' TERM HUP INT 2020-09-08T17:11:45.683 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:33: run: TEST_config_track td/osd-config 2020-09-08T17:11:45.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:54: TEST_config_track: local dir=td/osd-config 2020-09-08T17:11:45.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:56: TEST_config_track: run_mon td/osd-config a 2020-09-08T17:11:45.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-config 2020-09-08T17:11:45.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T17:11:45.684 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T17:11:45.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T17:11:45.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-config/a 2020-09-08T17:11:45.685 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-config/a --run-dir=td/osd-config 2020-09-08T17:11:45.969 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T17:11:45.970 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:11:45.970 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:11:45.970 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:11:45.970 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:45.971 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:45.971 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.662352/$cluster-$name.asok' 2020-09-08T17:11:45.971 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-config/a '--log-file=td/osd-config/$name.log' '--admin-socket=/tmp/ceph-asok.662352/$cluster-$name.asok' --mon-cluster-log-file=td/osd-config/log --run-dir=td/osd-config '--pid-file=td/osd-config/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T17:11:46.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T17:11:46.155 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T17:11:46.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T17:11:46.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T17:11:46.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T17:11:46.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T17:11:46.157 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T17:11:46.157 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T17:11:46.157 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T17:11:46.157 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T17:11:46.157 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:46.158 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:46.158 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.662352/ceph-mon.a.asok 2020-09-08T17:11:46.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T17:11:46.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.662352/ceph-mon.a.asok config get fsid 2020-09-08T17:11:46.250 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T17:11:46.250 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T17:11:46.251 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T17:11:46.251 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T17:11:46.251 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T17:11:46.251 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T17:11:46.251 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T17:11:46.252 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T17:11:46.252 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T17:11:46.252 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:46.252 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:46.252 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.662352/ceph-mon.a.asok 2020-09-08T17:11:46.253 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T17:11:46.253 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.662352/ceph-mon.a.asok config get mon_host 2020-09-08T17:11:46.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:57: TEST_config_track: run_mgr td/osd-config x 2020-09-08T17:11:46.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-config 2020-09-08T17:11:46.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T17:11:46.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T17:11:46.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T17:11:46.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-config/x 2020-09-08T17:11:46.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T17:11:46.862 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T17:11:46.862 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:11:46.863 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:11:46.863 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:11:46.863 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:46.863 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:46.863 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.662352/$cluster-$name.asok' 2020-09-08T17:11:46.864 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T17:11:46.864 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-config/x '--log-file=td/osd-config/$name.log' '--admin-socket=/tmp/ceph-asok.662352/$cluster-$name.asok' --run-dir=td/osd-config '--pid-file=td/osd-config/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T17:11:46.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:58: TEST_config_track: run_osd td/osd-config 0 2020-09-08T17:11:46.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-config 2020-09-08T17:11:46.886 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T17:11:46.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T17:11:46.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T17:11:46.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-config/0 2020-09-08T17:11:46.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=9a64a3ce-eaf3-4ba2-a90a-0c445f7d809b --auth-supported=none --mon-host=127.0.0.1:7100 ' 2020-09-08T17:11:46.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:11:46.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:11:46.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:11:46.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-config/0' 2020-09-08T17:11:46.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-config/0/journal' 2020-09-08T17:11:46.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T17:11:46.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T17:11:46.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-config' 2020-09-08T17:11:46.889 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T17:11:46.889 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:11:46.890 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:11:46.890 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:11:46.890 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:46.890 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:46.890 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.662352/$cluster-$name.asok' 2020-09-08T17:11:46.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.662352/$cluster-$name.asok' 2020-09-08T17:11:46.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:11:46.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T17:11:46.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T17:11:46.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-config/$name.log' 2020-09-08T17:11:46.891 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-config/$name.pid' 2020-09-08T17:11:46.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:11:46.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:11:46.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:11:46.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T17:11:46.892 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T17:11:46.893 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-config/0 2020-09-08T17:11:46.893 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T17:11:46.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=2b81f5c9-aa6e-40c7-ac0f-d37ecec25525 2020-09-08T17:11:46.894 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 2b81f5c9-aa6e-40c7-ac0f-d37ecec25525' 2020-09-08T17:11:46.894 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T17:11:46.894 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 2b81f5c9-aa6e-40c7-ac0f-d37ecec25525 2020-09-08T17:11:46.900 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBSu1dfaEsZNhAAR2XtgUS30dptib/X4DpELA== 2020-09-08T17:11:46.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBSu1dfaEsZNhAAR2XtgUS30dptib/X4DpELA=="}' 2020-09-08T17:11:46.901 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 2b81f5c9-aa6e-40c7-ac0f-d37ecec25525 -i td/osd-config/0/new.json 2020-09-08T17:11:47.256 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:11:47.266 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-config/0/new.json 2020-09-08T17:11:47.267 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=9a64a3ce-eaf3-4ba2-a90a-0c445f7d809b --auth-supported=none --mon-host=127.0.0.1:7100 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-config/0 --osd-journal=td/osd-config/0/journal --chdir= --run-dir=td/osd-config '--admin-socket=/tmp/ceph-asok.662352/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-config/$name.log' '--pid-file=td/osd-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBSu1dfaEsZNhAAR2XtgUS30dptib/X4DpELA== --osd-uuid 2b81f5c9-aa6e-40c7-ac0f-d37ecec25525 2020-09-08T17:11:47.289 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:47.295+0000 7fcd1babbec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:11:47.290 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:47.297+0000 7fcd1babbec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:11:47.291 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:47.298+0000 7fcd1babbec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:11:47.292 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:47.299+0000 7fcd1babbec0 -1 bluestore(td/osd-config/0/block) _read_bdev_label failed to open td/osd-config/0/block: (2) No such file or directory 2020-09-08T17:11:47.292 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:47.299+0000 7fcd1babbec0 -1 bluestore(td/osd-config/0/block) _read_bdev_label failed to open td/osd-config/0/block: (2) No such file or directory 2020-09-08T17:11:47.293 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:47.299+0000 7fcd1babbec0 -1 bluestore(td/osd-config/0/block) _read_bdev_label failed to open td/osd-config/0/block: (2) No such file or directory 2020-09-08T17:11:47.336 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:47.343+0000 7fcd1babbec0 -1 bluestore(td/osd-config/0) _read_fsid unparsable uuid 2020-09-08T17:11:51.952 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-config/0/keyring 2020-09-08T17:11:51.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T17:11:51.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T17:11:51.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-config/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:11:51.954 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T17:11:52.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T17:11:52.479 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T17:11:52.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=9a64a3ce-eaf3-4ba2-a90a-0c445f7d809b --auth-supported=none --mon-host=127.0.0.1:7100 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-config/0 --osd-journal=td/osd-config/0/journal --chdir= --run-dir=td/osd-config '--admin-socket=/tmp/ceph-asok.662352/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-config/$name.log' '--pid-file=td/osd-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:11:52.480 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T17:11:52.480 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T17:11:52.481 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T17:11:52.499 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:52.506+0000 7fade4100ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:11:52.526 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:52.532+0000 7fade4100ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:11:52.527 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:52.534+0000 7fade4100ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:11:52.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T17:11:52.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:11:52.887 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T17:11:52.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:11:52.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:11:52.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:11:52.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:11:52.888 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:11:52.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:11:52.889 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:11:53.058 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:53.065+0000 7fade4100ec0 -1 Falling back to public interface 2020-09-08T17:11:53.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:11:53.886 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:53.892+0000 7fade4100ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T17:11:54.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:11:54.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:11:54.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:11:54.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:11:54.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:11:54.277 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:11:54.669 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/664481,v1:127.0.0.1:6803/664481] [v2:127.0.0.1:6804/664481,v1:127.0.0.1:6805/664481] exists,up 2b81f5c9-aa6e-40c7-ac0f-d37ecec25525 2020-09-08T17:11:54.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:11:54.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:11:54.670 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:11:54.670 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:61: TEST_config_track: CEPH_ARGS= 2020-09-08T17:11:54.671 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:61: TEST_config_track: ceph-conf --show-config-value osd_map_cache_size 2020-09-08T17:11:54.679 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:61: TEST_config_track: local osd_map_cache_size=50 2020-09-08T17:11:54.680 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:63: TEST_config_track: CEPH_ARGS= 2020-09-08T17:11:54.680 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:63: TEST_config_track: ceph-conf --show-config-value osd_pg_epoch_persisted_max_stale 2020-09-08T17:11:54.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:63: TEST_config_track: local osd_pg_epoch_persisted_max_stale=40 2020-09-08T17:11:54.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:68: TEST_config_track: grep 'is not > osd_pg_epoch_persisted_max_stale' td/osd-config/osd.0.log 2020-09-08T17:11:54.691 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:69: TEST_config_track: local stale=100 2020-09-08T17:11:54.692 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:70: TEST_config_track: ceph tell osd.0 injectargs '--osd-pg-epoch-persisted-max-stale 100' 2020-09-08T17:11:54.812 INFO:tasks.workunit.client.0.smithi065.stdout:{} 2020-09-08T17:11:54.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:71: TEST_config_track: get_asok_path osd.0 2020-09-08T17:11:54.822 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-09-08T17:11:54.823 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-09-08T17:11:54.823 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T17:11:54.824 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:54.824 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:54.824 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.662352/ceph-osd.0.asok 2020-09-08T17:11:54.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:71: TEST_config_track: CEPH_ARGS= 2020-09-08T17:11:54.825 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:71: TEST_config_track: ceph --admin-daemon /tmp/ceph-asok.662352/ceph-osd.0.asok log flush 2020-09-08T17:11:54.917 INFO:tasks.workunit.client.0.smithi065.stdout:{} 2020-09-08T17:11:54.924 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:72: TEST_config_track: grep 'is not > osd_pg_epoch_persisted_max_stale' td/osd-config/osd.0.log 2020-09-08T17:11:54.925 INFO:tasks.workunit.client.0.smithi065.stdout:2020-09-08T17:11:54.804+0000 7faddd914700 0 log_channel(cluster) log [WRN] : osd_map_cache_size (50) is not > osd_pg_epoch_persisted_max_stale (100) 2020-09-08T17:11:54.925 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:73: TEST_config_track: rm td/osd-config/osd.0.log 2020-09-08T17:11:54.926 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:74: TEST_config_track: get_asok_path osd.0 2020-09-08T17:11:54.927 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-09-08T17:11:54.927 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-09-08T17:11:54.927 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T17:11:54.927 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:54.927 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:54.928 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.662352/ceph-osd.0.asok 2020-09-08T17:11:54.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:74: TEST_config_track: CEPH_ARGS= 2020-09-08T17:11:54.928 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:74: TEST_config_track: ceph --admin-daemon /tmp/ceph-asok.662352/ceph-osd.0.asok log reopen 2020-09-08T17:11:55.021 INFO:tasks.workunit.client.0.smithi065.stdout:{} 2020-09-08T17:11:55.028 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:34: run: teardown td/osd-config 2020-09-08T17:11:55.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-config 2020-09-08T17:11:55.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T17:11:55.029 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-config KILL 2020-09-08T17:11:55.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:11:55.030 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:11:55.030 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:11:55.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:11:55.031 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:11:55.137 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:11:55.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:11:55.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:11:55.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:11:55.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:11:55.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:11:55.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:11:55.141 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:11:55.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:11:55.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:11:55.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:11:55.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:11:55.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T17:11:55.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-config 2020-09-08T17:11:55.145 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:11:55.146 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:55.146 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:55.146 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.662352 2020-09-08T17:11:55.147 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:11:55.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:11:55.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:31: run: for func in $funcs 2020-09-08T17:11:55.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:32: run: setup td/osd-config 2020-09-08T17:11:55.148 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-config 2020-09-08T17:11:55.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-config 2020-09-08T17:11:55.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-config 2020-09-08T17:11:55.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T17:11:55.149 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-config KILL 2020-09-08T17:11:55.149 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:11:55.150 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:11:55.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:11:55.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:11:55.150 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:11:55.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:11:55.151 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:11:55.151 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:11:55.152 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:11:55.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:11:55.152 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:11:55.152 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:11:55.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:11:55.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:11:55.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:11:55.154 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:11:55.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:11:55.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T17:11:55.155 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-config 2020-09-08T17:11:55.155 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:11:55.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:55.156 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:55.156 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.662352 2020-09-08T17:11:55.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:11:55.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:11:55.157 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-config 2020-09-08T17:11:55.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T17:11:55.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:55.158 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:55.158 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.662352 2020-09-08T17:11:55.159 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T17:11:55.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T17:11:55.159 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T17:11:55.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-config 1' TERM HUP INT 2020-09-08T17:11:55.160 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:33: run: TEST_default_adjustment td/osd-config 2020-09-08T17:11:55.160 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:78: TEST_default_adjustment: ceph-osd --no-mon-config --show-config-value rgw_torrent_origin 2020-09-08T17:11:55.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:78: TEST_default_adjustment: a= 2020-09-08T17:11:55.172 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:79: TEST_default_adjustment: ceph-osd --no-mon-config --show-config-value rgw_torrent_origin --default-rgw-torrent-origin default 2020-09-08T17:11:55.187 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:79: TEST_default_adjustment: b=default 2020-09-08T17:11:55.187 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:80: TEST_default_adjustment: ceph-osd --no-mon-config --show-config-value rgw_torrent_origin --default-rgw-torrent-origin arg 2020-09-08T17:11:55.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:80: TEST_default_adjustment: c=arg 2020-09-08T17:11:55.201 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:81: TEST_default_adjustment: '[' '' '!=' default ']' 2020-09-08T17:11:55.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:82: TEST_default_adjustment: '[' default = default ']' 2020-09-08T17:11:55.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:83: TEST_default_adjustment: '[' arg = arg ']' 2020-09-08T17:11:55.202 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:85: TEST_default_adjustment: ceph-osd --no-mon-config --show-config-value log_to_file 2020-09-08T17:11:55.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:85: TEST_default_adjustment: a=true 2020-09-08T17:11:55.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:86: TEST_default_adjustment: ceph-osd --no-mon-config --show-config-value log_to_file --default-log-to-file=false 2020-09-08T17:11:55.228 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:86: TEST_default_adjustment: b=false 2020-09-08T17:11:55.228 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:87: TEST_default_adjustment: ceph-osd --no-mon-config --show-config-value log_to_file --default-log-to-file=false --log-to-file 2020-09-08T17:11:55.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:87: TEST_default_adjustment: c=true 2020-09-08T17:11:55.243 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:88: TEST_default_adjustment: '[' true = true ']' 2020-09-08T17:11:55.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:89: TEST_default_adjustment: '[' false = false ']' 2020-09-08T17:11:55.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:90: TEST_default_adjustment: '[' true = true ']' 2020-09-08T17:11:55.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh:34: run: teardown td/osd-config 2020-09-08T17:11:55.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-config 2020-09-08T17:11:55.244 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T17:11:55.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-config KILL 2020-09-08T17:11:55.245 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:11:55.245 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:11:55.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:11:55.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:11:55.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:11:55.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:11:55.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:11:55.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:11:55.247 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:11:55.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:11:55.247 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:11:55.248 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:11:55.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:11:55.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:11:55.249 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:11:55.250 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:11:55.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:11:55.250 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T17:11:55.251 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-config 2020-09-08T17:11:55.251 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:11:55.252 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:55.252 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:55.252 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.662352 2020-09-08T17:11:55.253 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:11:55.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:11:55.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2151: main: code=0 2020-09-08T17:11:55.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2155: main: teardown td/osd-config 0 2020-09-08T17:11:55.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-config 2020-09-08T17:11:55.254 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2020-09-08T17:11:55.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-config KILL 2020-09-08T17:11:55.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:11:55.255 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:11:55.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:11:55.255 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:11:55.256 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:11:55.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:11:55.257 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:11:55.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:11:55.257 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:11:55.257 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:11:55.258 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:11:55.258 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:11:55.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:11:55.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:11:55.259 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:11:55.259 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:11:55.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:11:55.260 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2020-09-08T17:11:55.261 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-config 2020-09-08T17:11:55.261 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:11:55.261 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:55.262 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.662352 2020-09-08T17:11:55.262 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.662352 2020-09-08T17:11:55.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:11:55.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:11:55.263 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2156: main: return 0 2020-09-08T17:11:55.264 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-09-08T17:11:55.264 INFO:teuthology.orchestra.run.smithi065:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-09-08T17:11:55.334 INFO:tasks.workunit:Running workunit osd/osd-copy-from.sh... 2020-09-08T17:11:55.334 INFO:teuthology.orchestra.run.smithi065:workunit test osd/osd-copy-from.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dce4d291bd4243c9802c17d67b85a6da6bbc0f8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh 2020-09-08T17:11:55.394 INFO:tasks.workunit.client.0.smithi065.stderr:stty: 'standard input': Inappropriate ioctl for device 2020-09-08T17:11:55.401 INFO:tasks.workunit.client.0.smithi065.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2020-09-08T17:11:55.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T17:11:55.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T17:11:55.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: export PYTHONWARNINGS=ignore 2020-09-08T17:11:55.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: PYTHONWARNINGS=ignore 2020-09-08T17:11:55.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: export CEPH_CONF=/dev/null 2020-09-08T17:11:55.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: CEPH_CONF=/dev/null 2020-09-08T17:11:55.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2147: main: unset CEPH_ARGS 2020-09-08T17:11:55.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2149: main: local code 2020-09-08T17:11:55.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2150: main: run td/osd-copy-from 2020-09-08T17:11:55.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:23: run: local dir=td/osd-copy-from 2020-09-08T17:11:55.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:24: run: shift 2020-09-08T17:11:55.403 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:26: run: export CEPH_MON=127.0.0.1:7111 2020-09-08T17:11:55.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:26: run: CEPH_MON=127.0.0.1:7111 2020-09-08T17:11:55.404 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:27: run: export CEPH_ARGS 2020-09-08T17:11:55.404 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:28: run: uuidgen 2020-09-08T17:11:55.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:28: run: CEPH_ARGS+='--fsid=97da2edd-e256-492c-9268-370b42ad2f05 --auth-supported=none ' 2020-09-08T17:11:55.406 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:29: run: CEPH_ARGS+='--mon-host=127.0.0.1:7111 ' 2020-09-08T17:11:55.406 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:31: run: set 2020-09-08T17:11:55.406 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2020-09-08T17:11:55.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:31: run: local funcs=TEST_copy_from 2020-09-08T17:11:55.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:32: run: for func in $funcs 2020-09-08T17:11:55.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:33: run: setup td/osd-copy-from 2020-09-08T17:11:55.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-copy-from 2020-09-08T17:11:55.407 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-copy-from 2020-09-08T17:11:55.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-copy-from 2020-09-08T17:11:55.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T17:11:55.408 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-copy-from KILL 2020-09-08T17:11:55.408 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:11:55.408 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:11:55.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:11:55.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:11:55.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:11:55.409 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:11:55.409 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:11:55.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:11:55.411 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:11:55.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:11:55.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:11:55.411 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:11:55.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:11:55.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:11:55.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:11:55.412 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:11:55.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:11:55.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T17:11:55.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-copy-from 2020-09-08T17:11:55.414 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:11:55.414 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:55.414 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.665020 2020-09-08T17:11:55.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.665020 2020-09-08T17:11:55.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:11:55.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:11:55.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-copy-from 2020-09-08T17:11:55.415 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T17:11:55.416 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:55.416 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.665020 2020-09-08T17:11:55.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.665020 2020-09-08T17:11:55.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T17:11:55.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2020-09-08T17:11:55.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2020-09-08T17:11:55.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T17:11:55.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-copy-from 1' TERM HUP INT 2020-09-08T17:11:55.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:34: run: TEST_copy_from td/osd-copy-from 2020-09-08T17:11:55.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:40: TEST_copy_from: local dir=td/osd-copy-from 2020-09-08T17:11:55.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:42: TEST_copy_from: run_mon td/osd-copy-from a 2020-09-08T17:11:55.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-copy-from 2020-09-08T17:11:55.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T17:11:55.419 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T17:11:55.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T17:11:55.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-copy-from/a 2020-09-08T17:11:55.420 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-copy-from/a --run-dir=td/osd-copy-from 2020-09-08T17:11:55.704 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T17:11:55.705 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:11:55.705 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:11:55.705 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:11:55.705 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:55.706 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.665020 2020-09-08T17:11:55.706 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.665020/$cluster-$name.asok' 2020-09-08T17:11:55.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-copy-from/a '--log-file=td/osd-copy-from/$name.log' '--admin-socket=/tmp/ceph-asok.665020/$cluster-$name.asok' --mon-cluster-log-file=td/osd-copy-from/log --run-dir=td/osd-copy-from '--pid-file=td/osd-copy-from/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T17:11:55.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T17:11:55.883 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T17:11:55.883 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T17:11:55.883 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T17:11:55.884 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T17:11:55.884 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T17:11:55.884 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T17:11:55.884 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T17:11:55.884 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T17:11:55.885 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T17:11:55.885 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:55.885 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.665020 2020-09-08T17:11:55.885 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.665020/ceph-mon.a.asok 2020-09-08T17:11:55.885 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T17:11:55.886 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.665020/ceph-mon.a.asok config get fsid 2020-09-08T17:11:55.979 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T17:11:55.979 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T17:11:55.979 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T17:11:55.980 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T17:11:55.980 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T17:11:55.980 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T17:11:55.980 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T17:11:55.980 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T17:11:55.981 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T17:11:55.981 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:55.981 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.665020 2020-09-08T17:11:55.981 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.665020/ceph-mon.a.asok 2020-09-08T17:11:55.982 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T17:11:55.982 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.665020/ceph-mon.a.asok config get mon_host 2020-09-08T17:11:56.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:43: TEST_copy_from: run_mgr td/osd-copy-from x 2020-09-08T17:11:56.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-copy-from 2020-09-08T17:11:56.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T17:11:56.070 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T17:11:56.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T17:11:56.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-copy-from/x 2020-09-08T17:11:56.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T17:11:56.951 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T17:11:56.951 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:11:56.951 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:11:56.952 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:11:56.952 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:56.952 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.665020 2020-09-08T17:11:56.952 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.665020/$cluster-$name.asok' 2020-09-08T17:11:56.953 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T17:11:56.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-copy-from/x '--log-file=td/osd-copy-from/$name.log' '--admin-socket=/tmp/ceph-asok.665020/$cluster-$name.asok' --run-dir=td/osd-copy-from '--pid-file=td/osd-copy-from/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T17:11:56.974 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:44: TEST_copy_from: run_osd td/osd-copy-from 0 2020-09-08T17:11:56.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-copy-from 2020-09-08T17:11:56.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T17:11:56.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T17:11:56.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T17:11:56.975 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-copy-from/0 2020-09-08T17:11:56.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=97da2edd-e256-492c-9268-370b42ad2f05 --auth-supported=none --mon-host=127.0.0.1:7111 ' 2020-09-08T17:11:56.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:11:56.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:11:56.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:11:56.976 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-copy-from/0' 2020-09-08T17:11:56.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-copy-from/0/journal' 2020-09-08T17:11:56.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T17:11:56.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T17:11:56.977 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-copy-from' 2020-09-08T17:11:56.977 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T17:11:56.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:11:56.978 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:11:56.978 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:11:56.978 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:11:56.978 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.665020 2020-09-08T17:11:56.979 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.665020/$cluster-$name.asok' 2020-09-08T17:11:56.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.665020/$cluster-$name.asok' 2020-09-08T17:11:56.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:11:56.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T17:11:56.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T17:11:56.979 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-copy-from/$name.log' 2020-09-08T17:11:56.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-copy-from/$name.pid' 2020-09-08T17:11:56.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:11:56.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:11:56.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:11:56.980 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T17:11:56.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T17:11:56.981 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-copy-from/0 2020-09-08T17:11:56.982 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T17:11:56.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=9180a210-69af-44cb-8843-a415d1babae6 2020-09-08T17:11:56.982 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 9180a210-69af-44cb-8843-a415d1babae6' 2020-09-08T17:11:56.982 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T17:11:56.983 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 9180a210-69af-44cb-8843-a415d1babae6 2020-09-08T17:11:56.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBcu1dfgc5cOxAA5ti7orQqeHu9w00kvnT82A== 2020-09-08T17:11:56.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBcu1dfgc5cOxAA5ti7orQqeHu9w00kvnT82A=="}' 2020-09-08T17:11:56.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 9180a210-69af-44cb-8843-a415d1babae6 -i td/osd-copy-from/0/new.json 2020-09-08T17:11:57.350 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:11:57.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-copy-from/0/new.json 2020-09-08T17:11:57.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=97da2edd-e256-492c-9268-370b42ad2f05 --auth-supported=none --mon-host=127.0.0.1:7111 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-copy-from/0 --osd-journal=td/osd-copy-from/0/journal --chdir= --run-dir=td/osd-copy-from '--admin-socket=/tmp/ceph-asok.665020/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-copy-from/$name.log' '--pid-file=td/osd-copy-from/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBcu1dfgc5cOxAA5ti7orQqeHu9w00kvnT82A== --osd-uuid 9180a210-69af-44cb-8843-a415d1babae6 2020-09-08T17:11:57.387 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:57.390+0000 7fd1979bfec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:11:57.388 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:57.391+0000 7fd1979bfec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:11:57.388 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:57.392+0000 7fd1979bfec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:11:57.388 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:57.393+0000 7fd1979bfec0 -1 bluestore(td/osd-copy-from/0/block) _read_bdev_label failed to open td/osd-copy-from/0/block: (2) No such file or directory 2020-09-08T17:11:57.388 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:57.393+0000 7fd1979bfec0 -1 bluestore(td/osd-copy-from/0/block) _read_bdev_label failed to open td/osd-copy-from/0/block: (2) No such file or directory 2020-09-08T17:11:57.389 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:57.393+0000 7fd1979bfec0 -1 bluestore(td/osd-copy-from/0/block) _read_bdev_label failed to open td/osd-copy-from/0/block: (2) No such file or directory 2020-09-08T17:11:57.429 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:11:57.436+0000 7fd1979bfec0 -1 bluestore(td/osd-copy-from/0) _read_fsid unparsable uuid 2020-09-08T17:12:01.654 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-copy-from/0/keyring 2020-09-08T17:12:01.655 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T17:12:01.656 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T17:12:01.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T17:12:01.656 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-copy-from/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:12:02.176 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T17:12:02.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=97da2edd-e256-492c-9268-370b42ad2f05 --auth-supported=none --mon-host=127.0.0.1:7111 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-copy-from/0 --osd-journal=td/osd-copy-from/0/journal --chdir= --run-dir=td/osd-copy-from '--admin-socket=/tmp/ceph-asok.665020/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-copy-from/$name.log' '--pid-file=td/osd-copy-from/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:12:02.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T17:12:02.177 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T17:12:02.178 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T17:12:02.178 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T17:12:02.197 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:02.203+0000 7f82aa98eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:02.218 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:02.224+0000 7f82aa98eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:02.220 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:02.226+0000 7f82aa98eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:02.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T17:12:02.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:12:02.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T17:12:02.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:12:02.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:12:02.563 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:12:02.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:12:02.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:12:02.564 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:12:02.564 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:12:02.737 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:02.742+0000 7f82aa98eec0 -1 Falling back to public interface 2020-09-08T17:12:02.947 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:12:03.519 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:03.524+0000 7f82aa98eec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T17:12:03.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:12:03.949 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:12:03.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:12:03.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:12:03.950 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:12:03.950 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:12:04.344 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/665878,v1:127.0.0.1:6803/665878] [v2:127.0.0.1:6804/665878,v1:127.0.0.1:6805/665878] exists,up 9180a210-69af-44cb-8843-a415d1babae6 2020-09-08T17:12:04.345 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 b38107aa-a06d-469d-8015-235cd7817d8d 2020-09-08T17:12:04.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:12:04.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:12:04.345 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:12:04.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:45: TEST_copy_from: run_osd td/osd-copy-from 1 2020-09-08T17:12:04.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-copy-from 2020-09-08T17:12:04.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T17:12:04.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T17:12:04.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T17:12:04.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-copy-from/1 2020-09-08T17:12:04.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=97da2edd-e256-492c-9268-370b42ad2f05 --auth-supported=none --mon-host=127.0.0.1:7111 ' 2020-09-08T17:12:04.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:12:04.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:12:04.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:12:04.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-copy-from/1' 2020-09-08T17:12:04.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-copy-from/1/journal' 2020-09-08T17:12:04.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T17:12:04.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T17:12:04.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-copy-from' 2020-09-08T17:12:04.349 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T17:12:04.349 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:12:04.349 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:12:04.349 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:12:04.349 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:12:04.349 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.665020 2020-09-08T17:12:04.350 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.665020/$cluster-$name.asok' 2020-09-08T17:12:04.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.665020/$cluster-$name.asok' 2020-09-08T17:12:04.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:12:04.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T17:12:04.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T17:12:04.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-copy-from/$name.log' 2020-09-08T17:12:04.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-copy-from/$name.pid' 2020-09-08T17:12:04.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:12:04.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:12:04.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:12:04.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T17:12:04.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T17:12:04.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-copy-from/1 2020-09-08T17:12:04.352 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T17:12:04.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=b38107aa-a06d-469d-8015-235cd7817d8d 2020-09-08T17:12:04.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 b38107aa-a06d-469d-8015-235cd7817d8d' 2020-09-08T17:12:04.353 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T17:12:04.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBku1dfHnS5FRAAfVgAicBNs5tOteETAgQ5zA== 2020-09-08T17:12:04.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBku1dfHnS5FRAAfVgAicBNs5tOteETAgQ5zA=="}' 2020-09-08T17:12:04.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new b38107aa-a06d-469d-8015-235cd7817d8d -i td/osd-copy-from/1/new.json 2020-09-08T17:12:04.878 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:12:04.889 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-copy-from/1/new.json 2020-09-08T17:12:04.890 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=97da2edd-e256-492c-9268-370b42ad2f05 --auth-supported=none --mon-host=127.0.0.1:7111 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-copy-from/1 --osd-journal=td/osd-copy-from/1/journal --chdir= --run-dir=td/osd-copy-from '--admin-socket=/tmp/ceph-asok.665020/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-copy-from/$name.log' '--pid-file=td/osd-copy-from/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBku1dfHnS5FRAAfVgAicBNs5tOteETAgQ5zA== --osd-uuid b38107aa-a06d-469d-8015-235cd7817d8d 2020-09-08T17:12:04.911 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:04.918+0000 7f9688d45ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:04.913 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:04.920+0000 7f9688d45ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:04.914 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:04.921+0000 7f9688d45ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:04.915 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:04.922+0000 7f9688d45ec0 -1 bluestore(td/osd-copy-from/1/block) _read_bdev_label failed to open td/osd-copy-from/1/block: (2) No such file or directory 2020-09-08T17:12:04.915 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:04.922+0000 7f9688d45ec0 -1 bluestore(td/osd-copy-from/1/block) _read_bdev_label failed to open td/osd-copy-from/1/block: (2) No such file or directory 2020-09-08T17:12:04.915 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:04.922+0000 7f9688d45ec0 -1 bluestore(td/osd-copy-from/1/block) _read_bdev_label failed to open td/osd-copy-from/1/block: (2) No such file or directory 2020-09-08T17:12:04.967 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:04.974+0000 7f9688d45ec0 -1 bluestore(td/osd-copy-from/1) _read_fsid unparsable uuid 2020-09-08T17:12:09.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-copy-from/1/keyring 2020-09-08T17:12:09.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T17:12:09.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T17:12:09.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-copy-from/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:12:09.502 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T17:12:10.044 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T17:12:10.044 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T17:12:10.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=97da2edd-e256-492c-9268-370b42ad2f05 --auth-supported=none --mon-host=127.0.0.1:7111 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-copy-from/1 --osd-journal=td/osd-copy-from/1/journal --chdir= --run-dir=td/osd-copy-from '--admin-socket=/tmp/ceph-asok.665020/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-copy-from/$name.log' '--pid-file=td/osd-copy-from/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:12:10.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T17:12:10.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T17:12:10.045 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T17:12:10.064 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:10.071+0000 7f6e364daec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:10.073 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:10.080+0000 7f6e364daec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:10.074 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:10.080+0000 7f6e364daec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:10.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T17:12:10.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:12:10.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T17:12:10.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:12:10.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:12:10.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:12:10.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:12:10.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:12:10.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:12:10.433 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:12:10.592 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:10.599+0000 7f6e364daec0 -1 Falling back to public interface 2020-09-08T17:12:10.842 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:12:11.424 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:11.430+0000 7f6e364daec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T17:12:11.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:12:11.844 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:12:11.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:12:11.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:12:11.845 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:12:11.845 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:12:12.237 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/666872,v1:127.0.0.1:6811/666872] [v2:127.0.0.1:6812/666872,v1:127.0.0.1:6813/666872] exists,up b38107aa-a06d-469d-8015-235cd7817d8d 2020-09-08T17:12:12.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:12:12.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:12:12.238 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:12:12.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:46: TEST_copy_from: create_rbd_pool 2020-09-08T17:12:12.239 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2020-09-08T17:12:12.700 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'rbd' does not exist 2020-09-08T17:12:12.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: create_pool rbd 4 2020-09-08T17:12:12.708 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create rbd 4 2020-09-08T17:12:13.266 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'rbd' already exists 2020-09-08T17:12:13.274 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T17:12:14.276 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: rbd pool init rbd 2020-09-08T17:12:15.270 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:49: TEST_copy_from: which rados 2020-09-08T17:12:15.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:49: TEST_copy_from: rados -p rbd put foo /usr/bin/rados 2020-09-08T17:12:15.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:50: TEST_copy_from: rados -p rbd cp foo foo2 2020-09-08T17:12:15.595 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:51: TEST_copy_from: rados -p rbd stat foo2 2020-09-08T17:12:15.619 INFO:tasks.workunit.client.0.smithi065.stdout:rbd/foo2 mtime 2020-09-08T17:12:15.000000+0000, size 788752 2020-09-08T17:12:15.620 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:54: TEST_copy_from: ceph tell 'osd.*' injectargs -- --osd-debug-inject-copyfrom-error 2020-09-08T17:12:15.745 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0: {} 2020-09-08T17:12:15.779 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1: {} 2020-09-08T17:12:15.788 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:55: TEST_copy_from: rados -p rbd cp foo foo3 2020-09-08T17:12:15.811 INFO:tasks.workunit.client.0.smithi065.stderr:error copying rbd/foo => rbd/foo3: (5) Input/output error 2020-09-08T17:12:15.813 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:56: TEST_copy_from: rados -p rbd stat foo3 2020-09-08T17:12:15.834 INFO:tasks.workunit.client.0.smithi065.stderr: error stat-ing rbd/foo3: (2) No such file or directory 2020-09-08T17:12:15.836 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:59: TEST_copy_from: ceph tell 'osd.*' injectargs -- --no-osd-debug-inject-copyfrom-error 2020-09-08T17:12:15.956 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0: {} 2020-09-08T17:12:15.991 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1: {} 2020-09-08T17:12:16.000 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:60: TEST_copy_from: rados -p rbd cp foo foo3 2020-09-08T17:12:16.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:61: TEST_copy_from: rados -p rbd stat foo3 2020-09-08T17:12:16.167 INFO:tasks.workunit.client.0.smithi065.stdout:rbd/foo3 mtime 2020-09-08T17:12:15.000000+0000, size 788752 2020-09-08T17:12:16.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh:35: run: teardown td/osd-copy-from 2020-09-08T17:12:16.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-copy-from 2020-09-08T17:12:16.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T17:12:16.169 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-copy-from KILL 2020-09-08T17:12:16.170 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:12:16.170 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:12:16.170 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:12:16.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:12:16.171 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:12:16.277 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:12:16.277 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:12:16.278 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:12:16.278 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:12:16.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:12:16.279 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:12:16.279 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:12:16.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:12:16.281 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:12:16.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:12:16.282 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:12:16.282 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:12:16.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T17:12:16.283 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-copy-from 2020-09-08T17:12:16.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:12:16.286 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:12:16.287 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.665020 2020-09-08T17:12:16.287 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.665020 2020-09-08T17:12:16.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:12:16.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:12:16.288 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2151: main: code=0 2020-09-08T17:12:16.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2155: main: teardown td/osd-copy-from 0 2020-09-08T17:12:16.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-copy-from 2020-09-08T17:12:16.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2020-09-08T17:12:16.289 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-copy-from KILL 2020-09-08T17:12:16.289 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:12:16.290 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:12:16.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:12:16.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:12:16.290 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:12:16.291 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:12:16.291 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:12:16.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:12:16.292 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:12:16.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:12:16.292 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:12:16.292 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:12:16.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:12:16.293 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:12:16.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:12:16.294 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:12:16.294 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:12:16.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2020-09-08T17:12:16.295 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-copy-from 2020-09-08T17:12:16.296 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:12:16.296 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:12:16.296 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.665020 2020-09-08T17:12:16.297 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.665020 2020-09-08T17:12:16.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:12:16.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:12:16.298 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2156: main: return 0 2020-09-08T17:12:16.299 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-09-08T17:12:16.299 INFO:teuthology.orchestra.run.smithi065:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-09-08T17:12:16.368 INFO:tasks.workunit:Running workunit osd/osd-dup.sh... 2020-09-08T17:12:16.369 INFO:teuthology.orchestra.run.smithi065:workunit test osd/osd-dup.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dce4d291bd4243c9802c17d67b85a6da6bbc0f8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh 2020-09-08T17:12:16.428 INFO:tasks.workunit.client.0.smithi065.stderr:stty: 'standard input': Inappropriate ioctl for device 2020-09-08T17:12:16.436 INFO:tasks.workunit.client.0.smithi065.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2020-09-08T17:12:16.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T17:12:16.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T17:12:16.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: export PYTHONWARNINGS=ignore 2020-09-08T17:12:16.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: PYTHONWARNINGS=ignore 2020-09-08T17:12:16.437 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: export CEPH_CONF=/dev/null 2020-09-08T17:12:16.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: CEPH_CONF=/dev/null 2020-09-08T17:12:16.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2147: main: unset CEPH_ARGS 2020-09-08T17:12:16.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2149: main: local code 2020-09-08T17:12:16.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2150: main: run td/osd-dup 2020-09-08T17:12:16.438 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:8: run: local dir=td/osd-dup 2020-09-08T17:12:16.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:9: run: shift 2020-09-08T17:12:16.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:11: run: export CEPH_MON=127.0.0.1:7146 2020-09-08T17:12:16.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:11: run: CEPH_MON=127.0.0.1:7146 2020-09-08T17:12:16.439 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:12: run: export CEPH_ARGS 2020-09-08T17:12:16.439 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:13: run: uuidgen 2020-09-08T17:12:16.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:13: run: CEPH_ARGS+='--fsid=99a59926-c7f2-4e55-9844-271f7250cec2 --auth-supported=none ' 2020-09-08T17:12:16.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:14: run: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2020-09-08T17:12:16.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:16: run: CEPH_ARGS+='--filestore_wbthrottle_xfs_ios_hard_limit=900 ' 2020-09-08T17:12:16.440 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:17: run: CEPH_ARGS+='--filestore_wbthrottle_btrfs_ios_hard_limit=900 ' 2020-09-08T17:12:16.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:18: run: set 2020-09-08T17:12:16.442 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:18: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2020-09-08T17:12:16.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:18: run: local funcs=TEST_filestore_to_bluestore 2020-09-08T17:12:16.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:19: run: for func in $funcs 2020-09-08T17:12:16.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:20: run: setup td/osd-dup 2020-09-08T17:12:16.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-dup 2020-09-08T17:12:16.443 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-dup 2020-09-08T17:12:16.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-dup 2020-09-08T17:12:16.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T17:12:16.444 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-dup KILL 2020-09-08T17:12:16.444 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:12:16.444 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:12:16.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:12:16.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:12:16.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:12:16.445 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:12:16.445 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:12:16.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:12:16.446 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:12:16.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:12:16.446 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:12:16.446 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:12:16.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:12:16.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:12:16.448 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:12:16.448 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:12:16.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:12:16.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T17:12:16.449 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-dup 2020-09-08T17:12:16.449 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:12:16.449 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:12:16.450 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.667599 2020-09-08T17:12:16.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.667599 2020-09-08T17:12:16.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:12:16.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:12:16.450 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-dup 2020-09-08T17:12:16.452 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T17:12:16.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:12:16.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.667599 2020-09-08T17:12:16.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.667599 2020-09-08T17:12:16.453 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T17:12:16.453 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2020-09-08T17:12:16.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2020-09-08T17:12:16.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T17:12:16.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-dup 1' TERM HUP INT 2020-09-08T17:12:16.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:21: run: TEST_filestore_to_bluestore td/osd-dup 2020-09-08T17:12:16.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:27: TEST_filestore_to_bluestore: local dir=td/osd-dup 2020-09-08T17:12:16.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:29: TEST_filestore_to_bluestore: ulimit -n 2020-09-08T17:12:16.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:29: TEST_filestore_to_bluestore: local flimit=4096 2020-09-08T17:12:16.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:30: TEST_filestore_to_bluestore: '[' 4096 -lt 1536 ']' 2020-09-08T17:12:16.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:34: TEST_filestore_to_bluestore: run_mon td/osd-dup a 2020-09-08T17:12:16.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-dup 2020-09-08T17:12:16.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T17:12:16.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T17:12:16.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T17:12:16.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-dup/a 2020-09-08T17:12:16.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-dup/a --run-dir=td/osd-dup 2020-09-08T17:12:16.742 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T17:12:16.742 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:12:16.743 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:12:16.743 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:12:16.743 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:12:16.743 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.667599 2020-09-08T17:12:16.743 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.667599/$cluster-$name.asok' 2020-09-08T17:12:16.744 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-dup/a '--log-file=td/osd-dup/$name.log' '--admin-socket=/tmp/ceph-asok.667599/$cluster-$name.asok' --mon-cluster-log-file=td/osd-dup/log --run-dir=td/osd-dup '--pid-file=td/osd-dup/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-09-08T17:12:16.926 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T17:12:16.927 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T17:12:16.928 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T17:12:16.928 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T17:12:16.928 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T17:12:16.928 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T17:12:16.928 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T17:12:16.929 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T17:12:16.929 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T17:12:16.930 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T17:12:16.930 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:12:16.930 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.667599 2020-09-08T17:12:16.930 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.667599/ceph-mon.a.asok 2020-09-08T17:12:16.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T17:12:16.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.667599/ceph-mon.a.asok config get fsid 2020-09-08T17:12:17.020 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T17:12:17.020 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T17:12:17.021 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T17:12:17.021 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T17:12:17.021 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T17:12:17.021 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T17:12:17.021 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T17:12:17.022 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T17:12:17.022 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T17:12:17.022 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:12:17.022 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.667599 2020-09-08T17:12:17.022 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.667599/ceph-mon.a.asok 2020-09-08T17:12:17.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T17:12:17.023 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.667599/ceph-mon.a.asok config get mon_host 2020-09-08T17:12:17.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:35: TEST_filestore_to_bluestore: run_mgr td/osd-dup x 2020-09-08T17:12:17.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-dup 2020-09-08T17:12:17.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T17:12:17.111 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T17:12:17.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T17:12:17.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-dup/x 2020-09-08T17:12:17.112 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T17:12:18.031 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T17:12:18.031 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:12:18.031 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:12:18.032 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:12:18.032 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:12:18.032 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.667599 2020-09-08T17:12:18.032 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.667599/$cluster-$name.asok' 2020-09-08T17:12:18.033 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T17:12:18.033 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-dup/x '--log-file=td/osd-dup/$name.log' '--admin-socket=/tmp/ceph-asok.667599/$cluster-$name.asok' --run-dir=td/osd-dup '--pid-file=td/osd-dup/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T17:12:18.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:36: TEST_filestore_to_bluestore: run_osd_filestore td/osd-dup 0 2020-09-08T17:12:18.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:687: run_osd_filestore: local dir=td/osd-dup 2020-09-08T17:12:18.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:688: run_osd_filestore: shift 2020-09-08T17:12:18.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:689: run_osd_filestore: local id=0 2020-09-08T17:12:18.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:690: run_osd_filestore: shift 2020-09-08T17:12:18.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:691: run_osd_filestore: local osd_data=td/osd-dup/0 2020-09-08T17:12:18.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:693: run_osd_filestore: local 'ceph_args=--fsid=99a59926-c7f2-4e55-9844-271f7250cec2 --auth-supported=none --mon-host=127.0.0.1:7146 --filestore_wbthrottle_xfs_ios_hard_limit=900 --filestore_wbthrottle_btrfs_ios_hard_limit=900 ' 2020-09-08T17:12:18.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:694: run_osd_filestore: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:12:18.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:695: run_osd_filestore: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:12:18.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:696: run_osd_filestore: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:12:18.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:697: run_osd_filestore: ceph_args+=' --osd-data=td/osd-dup/0' 2020-09-08T17:12:18.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:698: run_osd_filestore: ceph_args+=' --osd-journal=td/osd-dup/0/journal' 2020-09-08T17:12:18.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:699: run_osd_filestore: ceph_args+=' --chdir=' 2020-09-08T17:12:18.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:700: run_osd_filestore: ceph_args+= 2020-09-08T17:12:18.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:701: run_osd_filestore: ceph_args+=' --run-dir=td/osd-dup' 2020-09-08T17:12:18.059 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:702: run_osd_filestore: get_asok_path 2020-09-08T17:12:18.059 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:12:18.059 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:12:18.059 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:12:18.060 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:12:18.060 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.667599 2020-09-08T17:12:18.060 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.667599/$cluster-$name.asok' 2020-09-08T17:12:18.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:702: run_osd_filestore: ceph_args+=' --admin-socket=/tmp/ceph-asok.667599/$cluster-$name.asok' 2020-09-08T17:12:18.060 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:703: run_osd_filestore: ceph_args+=' --debug-osd=20' 2020-09-08T17:12:18.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:704: run_osd_filestore: ceph_args+=' --debug-ms=1' 2020-09-08T17:12:18.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:705: run_osd_filestore: ceph_args+=' --debug-monc=20' 2020-09-08T17:12:18.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:706: run_osd_filestore: ceph_args+=' --log-file=td/osd-dup/$name.log' 2020-09-08T17:12:18.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:707: run_osd_filestore: ceph_args+=' --pid-file=td/osd-dup/$name.pid' 2020-09-08T17:12:18.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:708: run_osd_filestore: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:12:18.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:709: run_osd_filestore: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:12:18.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:710: run_osd_filestore: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:12:18.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:711: run_osd_filestore: ceph_args+=' ' 2020-09-08T17:12:18.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:712: run_osd_filestore: ceph_args+= 2020-09-08T17:12:18.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:713: run_osd_filestore: mkdir -p td/osd-dup/0 2020-09-08T17:12:18.062 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:715: run_osd_filestore: uuidgen 2020-09-08T17:12:18.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:715: run_osd_filestore: local uuid=9936775a-964d-4c19-9110-d831ae527bae 2020-09-08T17:12:18.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:716: run_osd_filestore: echo 'add osd 9936775a-964d-4c19-9110-d831ae527bae' 2020-09-08T17:12:18.064 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:717: run_osd_filestore: ceph-authtool --gen-print-key 2020-09-08T17:12:18.064 INFO:tasks.workunit.client.0.smithi065.stdout:add osd 9936775a-964d-4c19-9110-d831ae527bae 2020-09-08T17:12:18.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:717: run_osd_filestore: OSD_SECRET=AQByu1dfgmymBBAAuMKBBgJQvinStwi5B4p8AQ== 2020-09-08T17:12:18.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:718: run_osd_filestore: echo '{"cephx_secret": "AQByu1dfgmymBBAAuMKBBgJQvinStwi5B4p8AQ=="}' 2020-09-08T17:12:18.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:719: run_osd_filestore: ceph osd new 9936775a-964d-4c19-9110-d831ae527bae -i td/osd-dup/0/new.json 2020-09-08T17:12:18.505 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:12:18.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:720: run_osd_filestore: rm td/osd-dup/0/new.json 2020-09-08T17:12:18.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:721: run_osd_filestore: ceph-osd -i 0 --fsid=99a59926-c7f2-4e55-9844-271f7250cec2 --auth-supported=none --mon-host=127.0.0.1:7146 --filestore_wbthrottle_xfs_ios_hard_limit=900 --filestore_wbthrottle_btrfs_ios_hard_limit=900 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-dup/0 --osd-journal=td/osd-dup/0/journal --chdir= --run-dir=td/osd-dup '--admin-socket=/tmp/ceph-asok.667599/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-dup/$name.log' '--pid-file=td/osd-dup/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQByu1dfgmymBBAAuMKBBgJQvinStwi5B4p8AQ== --osd-uuid 9936775a-964d-4c19-9110-d831ae527bae --osd-objectstore=filestore 2020-09-08T17:12:18.539 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:18.546+0000 7f2555505ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:18.541 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:18.548+0000 7f2555505ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:18.543 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:18.550+0000 7f2555505ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:18.878 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:18.885+0000 7f2555505ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-09-08T17:12:19.256 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:19.263+0000 7f2555505ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-09-08T17:12:19.257 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:19.263+0000 7f2555505ec0 -1 journal do_read_entry(4096): bad header magic 2020-09-08T17:12:19.257 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:19.263+0000 7f2555505ec0 -1 journal do_read_entry(4096): bad header magic 2020-09-08T17:12:19.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:723: run_osd_filestore: local key_fn=td/osd-dup/0/keyring 2020-09-08T17:12:19.689 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:724: run_osd_filestore: cat 2020-09-08T17:12:19.690 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T17:12:19.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:728: run_osd_filestore: echo adding osd0 key to auth repository 2020-09-08T17:12:19.690 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:729: run_osd_filestore: ceph -i td/osd-dup/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:12:19.867 INFO:tasks.workunit.client.0.smithi065.stderr:Error EINVAL: key for osd.0 not found in provided keyring 2020-09-08T17:12:19.869 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T17:12:19.869 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:730: run_osd_filestore: echo start osd.0 2020-09-08T17:12:19.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:731: run_osd_filestore: ceph-osd -i 0 --fsid=99a59926-c7f2-4e55-9844-271f7250cec2 --auth-supported=none --mon-host=127.0.0.1:7146 --filestore_wbthrottle_xfs_ios_hard_limit=900 --filestore_wbthrottle_btrfs_ios_hard_limit=900 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-dup/0 --osd-journal=td/osd-dup/0/journal --chdir= --run-dir=td/osd-dup '--admin-socket=/tmp/ceph-asok.667599/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-dup/$name.log' '--pid-file=td/osd-dup/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:12:19.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:734: run_osd_filestore: ceph osd dump --format=json 2020-09-08T17:12:19.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:734: run_osd_filestore: grep -q '"noup"' 2020-09-08T17:12:19.870 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:734: run_osd_filestore: jq '.flags_set[]' 2020-09-08T17:12:19.891 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:19.898+0000 7f68df4dbec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:19.894 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:19.900+0000 7f68df4dbec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:19.896 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:19.902+0000 7f68df4dbec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:19.897 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:19.904+0000 7f68df4dbec0 -1 Falling back to public interface 2020-09-08T17:12:20.190 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:737: run_osd_filestore: wait_for_osd up 0 2020-09-08T17:12:20.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:12:20.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T17:12:20.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:12:20.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:12:20.191 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:12:20.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:12:20.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:12:20.192 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:12:20.192 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:12:20.194 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:20.201+0000 7f68df4dbec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-09-08T17:12:20.211 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:20.218+0000 7f68df4dbec0 -1 journal do_read_entry(8192): bad header magic 2020-09-08T17:12:20.212 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:20.218+0000 7f68df4dbec0 -1 journal do_read_entry(8192): bad header magic 2020-09-08T17:12:20.217 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:20.224+0000 7f68df4dbec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T17:12:20.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:12:21.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:12:21.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:12:21.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:12:21.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:12:21.466 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:12:21.466 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:12:21.724 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/667920,v1:127.0.0.1:6801/667920] [v2:127.0.0.1:6802/667920,v1:127.0.0.1:6803/667920] exists,up 9936775a-964d-4c19-9110-d831ae527bae 2020-09-08T17:12:21.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:12:21.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:12:21.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:12:21.726 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:37: TEST_filestore_to_bluestore: cat td/osd-dup/osd.0.pid 2020-09-08T17:12:21.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:37: TEST_filestore_to_bluestore: osd_pid=667920 2020-09-08T17:12:21.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:38: TEST_filestore_to_bluestore: run_osd_filestore td/osd-dup 1 2020-09-08T17:12:21.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:687: run_osd_filestore: local dir=td/osd-dup 2020-09-08T17:12:21.733 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:688: run_osd_filestore: shift 2020-09-08T17:12:21.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:689: run_osd_filestore: local id=1 2020-09-08T17:12:21.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:690: run_osd_filestore: shift 2020-09-08T17:12:21.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:691: run_osd_filestore: local osd_data=td/osd-dup/1 2020-09-08T17:12:21.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:693: run_osd_filestore: local 'ceph_args=--fsid=99a59926-c7f2-4e55-9844-271f7250cec2 --auth-supported=none --mon-host=127.0.0.1:7146 --filestore_wbthrottle_xfs_ios_hard_limit=900 --filestore_wbthrottle_btrfs_ios_hard_limit=900 ' 2020-09-08T17:12:21.734 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:694: run_osd_filestore: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:12:21.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:695: run_osd_filestore: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:12:21.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:696: run_osd_filestore: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:12:21.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:697: run_osd_filestore: ceph_args+=' --osd-data=td/osd-dup/1' 2020-09-08T17:12:21.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:698: run_osd_filestore: ceph_args+=' --osd-journal=td/osd-dup/1/journal' 2020-09-08T17:12:21.735 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:699: run_osd_filestore: ceph_args+=' --chdir=' 2020-09-08T17:12:21.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:700: run_osd_filestore: ceph_args+= 2020-09-08T17:12:21.736 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:701: run_osd_filestore: ceph_args+=' --run-dir=td/osd-dup' 2020-09-08T17:12:21.736 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:702: run_osd_filestore: get_asok_path 2020-09-08T17:12:21.736 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:12:21.736 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:12:21.737 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:12:21.737 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:12:21.737 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.667599 2020-09-08T17:12:21.737 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.667599/$cluster-$name.asok' 2020-09-08T17:12:21.737 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:702: run_osd_filestore: ceph_args+=' --admin-socket=/tmp/ceph-asok.667599/$cluster-$name.asok' 2020-09-08T17:12:21.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:703: run_osd_filestore: ceph_args+=' --debug-osd=20' 2020-09-08T17:12:21.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:704: run_osd_filestore: ceph_args+=' --debug-ms=1' 2020-09-08T17:12:21.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:705: run_osd_filestore: ceph_args+=' --debug-monc=20' 2020-09-08T17:12:21.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:706: run_osd_filestore: ceph_args+=' --log-file=td/osd-dup/$name.log' 2020-09-08T17:12:21.738 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:707: run_osd_filestore: ceph_args+=' --pid-file=td/osd-dup/$name.pid' 2020-09-08T17:12:21.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:708: run_osd_filestore: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:12:21.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:709: run_osd_filestore: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:12:21.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:710: run_osd_filestore: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:12:21.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:711: run_osd_filestore: ceph_args+=' ' 2020-09-08T17:12:21.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:712: run_osd_filestore: ceph_args+= 2020-09-08T17:12:21.739 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:713: run_osd_filestore: mkdir -p td/osd-dup/1 2020-09-08T17:12:21.740 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:715: run_osd_filestore: uuidgen 2020-09-08T17:12:21.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:715: run_osd_filestore: local uuid=4b24c577-2bb2-4cce-8e94-5ced2c2daee9 2020-09-08T17:12:21.740 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:716: run_osd_filestore: echo 'add osd 4b24c577-2bb2-4cce-8e94-5ced2c2daee9' 2020-09-08T17:12:21.740 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:717: run_osd_filestore: ceph-authtool --gen-print-key 2020-09-08T17:12:21.740 INFO:tasks.workunit.client.0.smithi065.stdout:add osd 4b24c577-2bb2-4cce-8e94-5ced2c2daee9 2020-09-08T17:12:21.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:717: run_osd_filestore: OSD_SECRET=AQB1u1dfMzm1LBAAv6t3AO6mSNeVtgUsrCnifg== 2020-09-08T17:12:21.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:718: run_osd_filestore: echo '{"cephx_secret": "AQB1u1dfMzm1LBAAv6t3AO6mSNeVtgUsrCnifg=="}' 2020-09-08T17:12:21.743 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:719: run_osd_filestore: ceph osd new 4b24c577-2bb2-4cce-8e94-5ced2c2daee9 -i td/osd-dup/1/new.json 2020-09-08T17:12:22.112 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:12:22.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:720: run_osd_filestore: rm td/osd-dup/1/new.json 2020-09-08T17:12:22.123 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:721: run_osd_filestore: ceph-osd -i 1 --fsid=99a59926-c7f2-4e55-9844-271f7250cec2 --auth-supported=none --mon-host=127.0.0.1:7146 --filestore_wbthrottle_xfs_ios_hard_limit=900 --filestore_wbthrottle_btrfs_ios_hard_limit=900 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-dup/1 --osd-journal=td/osd-dup/1/journal --chdir= --run-dir=td/osd-dup '--admin-socket=/tmp/ceph-asok.667599/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-dup/$name.log' '--pid-file=td/osd-dup/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQB1u1dfMzm1LBAAv6t3AO6mSNeVtgUsrCnifg== --osd-uuid 4b24c577-2bb2-4cce-8e94-5ced2c2daee9 --osd-objectstore=filestore 2020-09-08T17:12:22.147 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:22.154+0000 7fe4b60f9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:22.149 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:22.156+0000 7fe4b60f9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:22.150 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:22.157+0000 7fe4b60f9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:22.485 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:22.492+0000 7fe4b60f9ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-09-08T17:12:22.888 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:22.894+0000 7fe4b60f9ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-09-08T17:12:22.888 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:22.895+0000 7fe4b60f9ec0 -1 journal do_read_entry(4096): bad header magic 2020-09-08T17:12:22.888 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:22.895+0000 7fe4b60f9ec0 -1 journal do_read_entry(4096): bad header magic 2020-09-08T17:12:23.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:723: run_osd_filestore: local key_fn=td/osd-dup/1/keyring 2020-09-08T17:12:23.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:724: run_osd_filestore: cat 2020-09-08T17:12:23.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:728: run_osd_filestore: echo adding osd1 key to auth repository 2020-09-08T17:12:23.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:729: run_osd_filestore: ceph -i td/osd-dup/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:12:23.362 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T17:12:23.716 INFO:tasks.workunit.client.0.smithi065.stderr:Error EINVAL: key for osd.1 not found in provided keyring 2020-09-08T17:12:23.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:730: run_osd_filestore: echo start osd.1 2020-09-08T17:12:23.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:731: run_osd_filestore: ceph-osd -i 1 --fsid=99a59926-c7f2-4e55-9844-271f7250cec2 --auth-supported=none --mon-host=127.0.0.1:7146 --filestore_wbthrottle_xfs_ios_hard_limit=900 --filestore_wbthrottle_btrfs_ios_hard_limit=900 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-dup/1 --osd-journal=td/osd-dup/1/journal --chdir= --run-dir=td/osd-dup '--admin-socket=/tmp/ceph-asok.667599/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-dup/$name.log' '--pid-file=td/osd-dup/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:12:23.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:734: run_osd_filestore: ceph osd dump --format=json 2020-09-08T17:12:23.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:734: run_osd_filestore: jq '.flags_set[]' 2020-09-08T17:12:23.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:734: run_osd_filestore: grep -q '"noup"' 2020-09-08T17:12:23.719 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T17:12:23.739 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:23.746+0000 7fc7d97cbec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:23.741 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:23.748+0000 7fc7d97cbec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:23.742 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:23.749+0000 7fc7d97cbec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:23.748 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:23.751+0000 7fc7d97cbec0 -1 Falling back to public interface 2020-09-08T17:12:24.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:737: run_osd_filestore: wait_for_osd up 1 2020-09-08T17:12:24.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:12:24.172 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T17:12:24.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:12:24.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:12:24.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:12:24.173 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:12:24.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:12:24.174 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:12:24.174 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:12:24.185 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:24.191+0000 7fc7d97cbec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-09-08T17:12:24.185 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:24.192+0000 7fc7d97cbec0 -1 journal do_read_entry(8192): bad header magic 2020-09-08T17:12:24.185 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:24.192+0000 7fc7d97cbec0 -1 journal do_read_entry(8192): bad header magic 2020-09-08T17:12:24.193 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:24.200+0000 7fc7d97cbec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T17:12:24.647 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:12:25.648 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:12:25.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:12:25.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:12:25.649 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:12:25.650 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:12:25.650 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:12:26.055 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/668278,v1:127.0.0.1:6811/668278] [v2:127.0.0.1:6812/668278,v1:127.0.0.1:6813/668278] exists,up 4b24c577-2bb2-4cce-8e94-5ced2c2daee9 2020-09-08T17:12:26.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:12:26.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:12:26.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:12:26.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:39: TEST_filestore_to_bluestore: run_osd_filestore td/osd-dup 2 2020-09-08T17:12:26.056 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:687: run_osd_filestore: local dir=td/osd-dup 2020-09-08T17:12:26.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:688: run_osd_filestore: shift 2020-09-08T17:12:26.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:689: run_osd_filestore: local id=2 2020-09-08T17:12:26.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:690: run_osd_filestore: shift 2020-09-08T17:12:26.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:691: run_osd_filestore: local osd_data=td/osd-dup/2 2020-09-08T17:12:26.057 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:693: run_osd_filestore: local 'ceph_args=--fsid=99a59926-c7f2-4e55-9844-271f7250cec2 --auth-supported=none --mon-host=127.0.0.1:7146 --filestore_wbthrottle_xfs_ios_hard_limit=900 --filestore_wbthrottle_btrfs_ios_hard_limit=900 ' 2020-09-08T17:12:26.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:694: run_osd_filestore: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:12:26.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:695: run_osd_filestore: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:12:26.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:696: run_osd_filestore: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:12:26.058 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:697: run_osd_filestore: ceph_args+=' --osd-data=td/osd-dup/2' 2020-09-08T17:12:26.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:698: run_osd_filestore: ceph_args+=' --osd-journal=td/osd-dup/2/journal' 2020-09-08T17:12:26.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:699: run_osd_filestore: ceph_args+=' --chdir=' 2020-09-08T17:12:26.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:700: run_osd_filestore: ceph_args+= 2020-09-08T17:12:26.059 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:701: run_osd_filestore: ceph_args+=' --run-dir=td/osd-dup' 2020-09-08T17:12:26.059 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:702: run_osd_filestore: get_asok_path 2020-09-08T17:12:26.059 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:12:26.060 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:12:26.060 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:12:26.060 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:12:26.060 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.667599 2020-09-08T17:12:26.060 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.667599/$cluster-$name.asok' 2020-09-08T17:12:26.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:702: run_osd_filestore: ceph_args+=' --admin-socket=/tmp/ceph-asok.667599/$cluster-$name.asok' 2020-09-08T17:12:26.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:703: run_osd_filestore: ceph_args+=' --debug-osd=20' 2020-09-08T17:12:26.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:704: run_osd_filestore: ceph_args+=' --debug-ms=1' 2020-09-08T17:12:26.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:705: run_osd_filestore: ceph_args+=' --debug-monc=20' 2020-09-08T17:12:26.061 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:706: run_osd_filestore: ceph_args+=' --log-file=td/osd-dup/$name.log' 2020-09-08T17:12:26.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:707: run_osd_filestore: ceph_args+=' --pid-file=td/osd-dup/$name.pid' 2020-09-08T17:12:26.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:708: run_osd_filestore: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:12:26.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:709: run_osd_filestore: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:12:26.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:710: run_osd_filestore: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:12:26.062 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:711: run_osd_filestore: ceph_args+=' ' 2020-09-08T17:12:26.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:712: run_osd_filestore: ceph_args+= 2020-09-08T17:12:26.063 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:713: run_osd_filestore: mkdir -p td/osd-dup/2 2020-09-08T17:12:26.064 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:715: run_osd_filestore: uuidgen 2020-09-08T17:12:26.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:715: run_osd_filestore: local uuid=452c1dfd-d5a6-49eb-9c42-675d2ff2879e 2020-09-08T17:12:26.064 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:716: run_osd_filestore: echo 'add osd 452c1dfd-d5a6-49eb-9c42-675d2ff2879e' 2020-09-08T17:12:26.064 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:717: run_osd_filestore: ceph-authtool --gen-print-key 2020-09-08T17:12:26.064 INFO:tasks.workunit.client.0.smithi065.stdout:add osd 452c1dfd-d5a6-49eb-9c42-675d2ff2879e 2020-09-08T17:12:26.071 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:717: run_osd_filestore: OSD_SECRET=AQB6u1dfm062BBAAImSqU/GJWsZAqc7SP1TMRw== 2020-09-08T17:12:26.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:718: run_osd_filestore: echo '{"cephx_secret": "AQB6u1dfm062BBAAImSqU/GJWsZAqc7SP1TMRw=="}' 2020-09-08T17:12:26.072 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:719: run_osd_filestore: ceph osd new 452c1dfd-d5a6-49eb-9c42-675d2ff2879e -i td/osd-dup/2/new.json 2020-09-08T17:12:26.575 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T17:12:26.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:720: run_osd_filestore: rm td/osd-dup/2/new.json 2020-09-08T17:12:26.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:721: run_osd_filestore: ceph-osd -i 2 --fsid=99a59926-c7f2-4e55-9844-271f7250cec2 --auth-supported=none --mon-host=127.0.0.1:7146 --filestore_wbthrottle_xfs_ios_hard_limit=900 --filestore_wbthrottle_btrfs_ios_hard_limit=900 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-dup/2 --osd-journal=td/osd-dup/2/journal --chdir= --run-dir=td/osd-dup '--admin-socket=/tmp/ceph-asok.667599/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-dup/$name.log' '--pid-file=td/osd-dup/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQB6u1dfm062BBAAImSqU/GJWsZAqc7SP1TMRw== --osd-uuid 452c1dfd-d5a6-49eb-9c42-675d2ff2879e --osd-objectstore=filestore 2020-09-08T17:12:26.609 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:26.616+0000 7f6d33b95ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:26.611 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:26.618+0000 7f6d33b95ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:26.612 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:26.619+0000 7f6d33b95ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:26.956 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:26.963+0000 7f6d33b95ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-09-08T17:12:27.438 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:27.445+0000 7f6d33b95ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-09-08T17:12:27.439 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:27.445+0000 7f6d33b95ec0 -1 journal do_read_entry(4096): bad header magic 2020-09-08T17:12:27.439 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:27.445+0000 7f6d33b95ec0 -1 journal do_read_entry(4096): bad header magic 2020-09-08T17:12:27.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:723: run_osd_filestore: local key_fn=td/osd-dup/2/keyring 2020-09-08T17:12:27.953 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:724: run_osd_filestore: cat 2020-09-08T17:12:27.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:728: run_osd_filestore: echo adding osd2 key to auth repository 2020-09-08T17:12:27.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:729: run_osd_filestore: ceph -i td/osd-dup/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:12:27.954 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T17:12:28.299 INFO:tasks.workunit.client.0.smithi065.stderr:Error EINVAL: key for osd.2 not found in provided keyring 2020-09-08T17:12:28.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:730: run_osd_filestore: echo start osd.2 2020-09-08T17:12:28.301 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T17:12:28.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:734: run_osd_filestore: ceph osd dump --format=json 2020-09-08T17:12:28.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:731: run_osd_filestore: ceph-osd -i 2 --fsid=99a59926-c7f2-4e55-9844-271f7250cec2 --auth-supported=none --mon-host=127.0.0.1:7146 --filestore_wbthrottle_xfs_ios_hard_limit=900 --filestore_wbthrottle_btrfs_ios_hard_limit=900 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-dup/2 --osd-journal=td/osd-dup/2/journal --chdir= --run-dir=td/osd-dup '--admin-socket=/tmp/ceph-asok.667599/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-dup/$name.log' '--pid-file=td/osd-dup/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:12:28.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:734: run_osd_filestore: jq '.flags_set[]' 2020-09-08T17:12:28.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:734: run_osd_filestore: grep -q '"noup"' 2020-09-08T17:12:28.322 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:28.329+0000 7fb2de7f9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:28.324 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:28.331+0000 7fb2de7f9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:28.325 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:28.332+0000 7fb2de7f9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:12:28.326 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:28.333+0000 7fb2de7f9ec0 -1 Falling back to public interface 2020-09-08T17:12:28.685 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:28.692+0000 7fb2de7f9ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-09-08T17:12:28.686 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:28.692+0000 7fb2de7f9ec0 -1 journal do_read_entry(8192): bad header magic 2020-09-08T17:12:28.686 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:28.692+0000 7fb2de7f9ec0 -1 journal do_read_entry(8192): bad header magic 2020-09-08T17:12:28.691 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:28.698+0000 7fb2de7f9ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T17:12:28.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:737: run_osd_filestore: wait_for_osd up 2 2020-09-08T17:12:28.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:12:28.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T17:12:28.881 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:12:28.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:12:28.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:12:28.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:12:28.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:12:28.882 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T17:12:28.883 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:12:29.299 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:12:30.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:12:30.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:12:30.301 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:12:30.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:12:30.302 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T17:12:30.302 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:12:30.694 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/668571,v1:127.0.0.1:6819/668571] [v2:127.0.0.1:6820/668571,v1:127.0.0.1:6821/668571] exists,up 452c1dfd-d5a6-49eb-9c42-675d2ff2879e 2020-09-08T17:12:30.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:12:30.694 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:12:30.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:12:30.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:41: TEST_filestore_to_bluestore: sleep 5 2020-09-08T17:12:35.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:43: TEST_filestore_to_bluestore: create_pool foo 16 2020-09-08T17:12:35.695 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create foo 16 2020-09-08T17:12:36.237 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'foo' already exists 2020-09-08T17:12:36.245 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T17:12:37.246 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:46: TEST_filestore_to_bluestore: timeout 20 rados bench -p foo 10 write -b 4096 --no-cleanup 2020-09-08T17:12:37.275 INFO:tasks.workunit.client.0.smithi065.stdout:hints = 1 2020-09-08T17:12:37.276 INFO:tasks.workunit.client.0.smithi065.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 10 seconds or 0 objects 2020-09-08T17:12:37.276 INFO:tasks.workunit.client.0.smithi065.stdout:Object prefix: benchmark_data_smithi065_668757 2020-09-08T17:12:37.276 INFO:tasks.workunit.client.0.smithi065.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-09-08T17:12:37.276 INFO:tasks.workunit.client.0.smithi065.stdout: 0 0 0 0 0 0 - 0 2020-09-08T17:12:38.276 INFO:tasks.workunit.client.0.smithi065.stdout: 1 16 16 0 0 0 - 0 2020-09-08T17:12:39.276 INFO:tasks.workunit.client.0.smithi065.stdout: 2 16 16 0 0 0 - 0 2020-09-08T17:12:40.276 INFO:tasks.workunit.client.0.smithi065.stdout: 3 16 18 2 0.00260381 0.00260417 2.8959 2.82918 2020-09-08T17:12:41.276 INFO:tasks.workunit.client.0.smithi065.stdout: 4 16 19 3 0.00292929 0.00390625 3.35747 3.00528 2020-09-08T17:12:42.276 INFO:tasks.workunit.client.0.smithi065.stdout: 5 16 19 3 0.00234346 0 - 3.00528 2020-09-08T17:12:43.276 INFO:tasks.workunit.client.0.smithi065.stdout: 6 16 89 73 0.0475202 0.136719 0.111891 1.2978 2020-09-08T17:12:44.276 INFO:tasks.workunit.client.0.smithi065.stdout: 7 16 216 200 0.111594 0.496094 0.129096 0.557519 2020-09-08T17:12:45.276 INFO:tasks.workunit.client.0.smithi065.stdout: 8 16 296 280 0.136703 0.3125 0.129406 0.455614 2020-09-08T17:12:46.276 INFO:tasks.workunit.client.0.smithi065.stdout: 9 16 377 361 0.156666 0.316406 0.170511 0.39572 2020-09-08T17:12:47.277 INFO:tasks.workunit.client.0.smithi065.stdout: 10 16 468 452 0.176542 0.355469 0.154637 0.351517 2020-09-08T17:13:25.675 INFO:tasks.workunit.client.0.smithi065.stdout:Total time run: 10.0689 2020-09-08T17:13:40.370 INFO:tasks.workunit.client.0.smithi065.stdout:Total writes made: 468 2020-09-08T17:13:40.371 INFO:tasks.workunit.client.0.smithi065.stdout:Write size: 4096 2020-09-08T17:13:40.371 INFO:tasks.workunit.client.0.smithi065.stdout:Object size: 4096 2020-09-08T17:13:40.371 INFO:tasks.workunit.client.0.smithi065.stdout:Bandwidth (MB/sec): 0.181562 2020-09-08T17:13:40.371 INFO:tasks.workunit.client.0.smithi065.stdout:Stddev Bandwidth: 0.19012 2020-09-08T17:13:40.371 INFO:tasks.workunit.client.0.smithi065.stdout:Max bandwidth (MB/sec): 0.496094 2020-09-08T17:13:40.372 INFO:tasks.workunit.client.0.smithi065.stdout:Min bandwidth (MB/sec): 0 2020-09-08T17:13:40.372 INFO:tasks.workunit.client.0.smithi065.stdout:Average IOPS: 46 2020-09-08T17:13:40.372 INFO:tasks.workunit.client.0.smithi065.stdout:Stddev IOPS: 48.7334 2020-09-08T17:13:40.372 INFO:tasks.workunit.client.0.smithi065.stdout:Max IOPS: 127 2020-09-08T17:13:40.372 INFO:tasks.workunit.client.0.smithi065.stdout:Min IOPS: 0 2020-09-08T17:13:40.373 INFO:tasks.workunit.client.0.smithi065.stdout:Average Latency(s): 0.343667 2020-09-08T17:13:40.373 INFO:tasks.workunit.client.0.smithi065.stdout:Stddev Latency(s): 0.88276 2020-09-08T17:13:40.373 INFO:tasks.workunit.client.0.smithi065.stdout:Max latency(s): 5.64657 2020-09-08T17:13:40.373 INFO:tasks.workunit.client.0.smithi065.stdout:Min latency(s): 0.110896 2020-09-08T17:13:40.373 INFO:tasks.workunit.client.0.smithi065.stdout:osd fsid 9936775a-964d-4c19-9110-d831ae527bae 2020-09-08T17:13:40.374 INFO:tasks.workunit.client.0.smithi065.stdout:dup from filestore: td/osd-dup/0.old 2020-09-08T17:13:40.374 INFO:tasks.workunit.client.0.smithi065.stdout: to bluestore: td/osd-dup/0 2020-09-08T17:13:40.374 INFO:tasks.workunit.client.0.smithi065.stdout:fsid 9936775a-964d-4c19-9110-d831ae527bae 2020-09-08T17:13:40.374 INFO:tasks.workunit.client.0.smithi065.stdout:17 collections 2020-09-08T17:13:40.374 INFO:tasks.workunit.client.0.smithi065.stdout:1/17 1.8_head 2020-09-08T17:13:40.578 INFO:tasks.workunit.client.0.smithi065.stdout: 0 objects, 0 bytes, 0 keys 27 objects, 106496 bytes, 32 keys 2020-09-08T17:13:40.578 INFO:tasks.workunit.client.0.smithi065.stdout:2/17 1.6_head 2020-09-08T17:13:40.578 INFO:tasks.workunit.client.0.smithi065.stdout: 0 objects, 0 bytes, 0 keys 33 objects, 131072 bytes, 38 keys 2020-09-08T17:13:40.579 INFO:tasks.workunit.client.0.smithi065.stdout:3/17 1.0_head 2020-09-08T17:13:40.579 INFO:tasks.workunit.client.0.smithi065.stdout: 0 objects, 0 bytes, 0 keys 26 objects, 102400 bytes, 31 keys 2020-09-08T17:13:40.579 INFO:tasks.workunit.client.0.smithi065.stdout:4/17 1.c_head 2020-09-08T17:13:40.579 INFO:tasks.workunit.client.0.smithi065.stdout: 0 objects, 0 bytes, 0 keys 25 objects, 98304 bytes, 30 keys 2020-09-08T17:13:40.579 INFO:tasks.workunit.client.0.smithi065.stdout:5/17 1.e_head 2020-09-08T17:13:40.580 INFO:tasks.workunit.client.0.smithi065.stdout: 0 objects, 0 bytes, 0 keys 28 objects, 110592 bytes, 33 keys 2020-09-08T17:13:40.580 INFO:tasks.workunit.client.0.smithi065.stdout:6/17 1.2_head 2020-09-08T17:13:40.580 INFO:tasks.workunit.client.0.smithi065.stdout: 0 objects, 0 bytes, 0 keys 23 objects, 90112 bytes, 28 keys 2020-09-08T17:13:40.580 INFO:tasks.workunit.client.0.smithi065.stdout:7/17 1.f_head 2020-09-08T17:13:40.580 INFO:tasks.workunit.client.0.smithi065.stdout: 0 objects, 0 bytes, 0 keys 31 objects, 122880 bytes, 36 keys 2020-09-08T17:13:40.581 INFO:tasks.workunit.client.0.smithi065.stdout:8/17 1.7_head 2020-09-08T17:13:40.581 INFO:tasks.workunit.client.0.smithi065.stdout: 0 objects, 0 bytes, 0 keys 30 objects, 118784 bytes, 35 keys 2020-09-08T17:13:40.581 INFO:tasks.workunit.client.0.smithi065.stdout:9/17 1.b_head 2020-09-08T17:13:40.581 INFO:tasks.workunit.client.0.smithi065.stdout: 0 objects, 0 bytes, 0 keys 32 objects, 126976 bytes, 37 keys 2020-09-08T17:13:40.581 INFO:tasks.workunit.client.0.smithi065.stdout:10/17 1.1_head 2020-09-08T17:13:40.582 INFO:tasks.workunit.client.0.smithi065.stdout: 0 objects, 0 bytes, 0 keys 35 objects, 139264 bytes, 40 keys 2020-09-08T17:13:40.582 INFO:tasks.workunit.client.0.smithi065.stdout:11/17 1.4_head 2020-09-08T17:13:40.582 INFO:tasks.workunit.client.0.smithi065.stdout: 0 objects, 0 bytes, 0 keys 38 objects, 151552 bytes, 43 keys 2020-09-08T17:13:40.582 INFO:tasks.workunit.client.0.smithi065.stdout:12/17 1.9_head 2020-09-08T17:13:40.583 INFO:tasks.workunit.client.0.smithi065.stdout: 0 objects, 0 bytes, 0 keys 37 objects, 147456 bytes, 42 keys 2020-09-08T17:13:40.583 INFO:tasks.workunit.client.0.smithi065.stdout:13/17 1.5_head 2020-09-08T17:13:40.583 INFO:tasks.workunit.client.0.smithi065.stdout: 0 objects, 0 bytes, 0 keys 34 objects, 135168 bytes, 39 keys 2020-09-08T17:13:40.583 INFO:tasks.workunit.client.0.smithi065.stdout:14/17 1.3_head 2020-09-08T17:13:40.583 INFO:tasks.workunit.client.0.smithi065.stdout: 0 objects, 0 bytes, 0 keys 31 objects, 122880 bytes, 36 keys 2020-09-08T17:13:40.786 INFO:tasks.workunit.client.0.smithi065.stdout:15/17 1.a_head 2020-09-08T17:13:40.786 INFO:tasks.workunit.client.0.smithi065.stdout: 0 objects, 0 bytes, 0 keys 25 objects, 98304 bytes, 30 keys 2020-09-08T17:13:40.786 INFO:tasks.workunit.client.0.smithi065.stdout:16/17 meta 2020-09-08T17:13:40.787 INFO:tasks.workunit.client.0.smithi065.stdout: 0 objects, 0 bytes, 0 keys 46 objects, 47104 bytes, 0 keys 2020-09-08T17:13:40.787 INFO:tasks.workunit.client.0.smithi065.stdout:17/17 1.d_head 2020-09-08T17:13:40.787 INFO:tasks.workunit.client.0.smithi065.stdout: 0 objects, 0 bytes, 0 keys 30 objects, 114712 bytes, 35 keys 2020-09-08T17:13:40.787 INFO:tasks.workunit.client.0.smithi065.stdout:keyring 2020-09-08T17:13:40.787 INFO:tasks.workunit.client.0.smithi065.stdout:duping osd metadata 2020-09-08T17:13:40.788 INFO:tasks.workunit.client.0.smithi065.stdout:done. 2020-09-08T17:13:40.788 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T17:13:40.788 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:13:40.788 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:13:40.788 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 25 up_thru 17 down_at 22 last_clean_interval [5,21) [v2:127.0.0.1:6800/669408,v1:127.0.0.1:6801/669408] [v2:127.0.0.1:6802/669408,v1:127.0.0.1:6803/669408] exists,up 9936775a-964d-4c19-9110-d831ae527bae 2020-09-08T17:13:40.789 INFO:tasks.workunit.client.0.smithi065.stdout:3 osds: 3 up (since 0.716354s), 3 in (since 31s); epoch: e26 2020-09-08T17:13:40.789 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_access_mode": "file", 2020-09-08T17:13:40.789 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_block_size": "4096", 2020-09-08T17:13:40.789 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_devices": "sda", 2020-09-08T17:13:40.789 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_driver": "KernelDevice", 2020-09-08T17:13:40.790 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_path": "td/osd-dup/0/block", 2020-09-08T17:13:40.790 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_rotational": "1", 2020-09-08T17:13:40.790 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_size": "107374182400", 2020-09-08T17:13:40.790 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_support_discard": "0", 2020-09-08T17:13:40.790 INFO:tasks.workunit.client.0.smithi065.stdout: "bluestore_bdev_type": "hdd", 2020-09-08T17:13:40.791 INFO:tasks.workunit.client.0.smithi065.stdout: "osd_objectstore": "bluestore", 2020-09-08T17:13:40.791 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 107374182406 2020-09-08T17:13:40.791 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672973 2020-09-08T17:13:40.791 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509452 2020-09-08T17:13:40.791 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.0 seq 107374182408 2020-09-08T17:13:40.792 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.1 seq 42949672975 2020-09-08T17:13:40.792 INFO:tasks.workunit.client.0.smithi065.stdout:waiting osd.2 seq 64424509454 2020-09-08T17:13:40.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:49: TEST_filestore_to_bluestore: kill 667920 2020-09-08T17:13:40.792 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:49: TEST_filestore_to_bluestore: sleep 1 2020-09-08T17:13:40.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:49: TEST_filestore_to_bluestore: kill 667920 2020-09-08T17:13:40.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh: line 49: kill: (667920) - No such process 2020-09-08T17:13:40.793 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:50: TEST_filestore_to_bluestore: ceph osd down 0 2020-09-08T17:13:40.793 INFO:tasks.workunit.client.0.smithi065.stderr:osd.0 is already down. 2020-09-08T17:13:40.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:52: TEST_filestore_to_bluestore: mv td/osd-dup/0 td/osd-dup/0.old 2020-09-08T17:13:40.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:53: TEST_filestore_to_bluestore: mkdir td/osd-dup/0 2020-09-08T17:13:40.794 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:54: TEST_filestore_to_bluestore: cat td/osd-dup/0.old/fsid 2020-09-08T17:13:40.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:54: TEST_filestore_to_bluestore: ofsid=9936775a-964d-4c19-9110-d831ae527bae 2020-09-08T17:13:40.795 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:55: TEST_filestore_to_bluestore: echo 'osd fsid 9936775a-964d-4c19-9110-d831ae527bae' 2020-09-08T17:13:40.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:56: TEST_filestore_to_bluestore: O='--fsid=99a59926-c7f2-4e55-9844-271f7250cec2 --auth-supported=none --mon-host=127.0.0.1:7146 --filestore_wbthrottle_xfs_ios_hard_limit=900 --filestore_wbthrottle_btrfs_ios_hard_limit=900 ' 2020-09-08T17:13:40.796 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:57: TEST_filestore_to_bluestore: CEPH_ARGS+='--log-file td/osd-dup/cot.log --log-max-recent 0 ' 2020-09-08T17:13:40.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:58: TEST_filestore_to_bluestore: ceph-objectstore-tool --type bluestore --data-path td/osd-dup/0 --fsid 9936775a-964d-4c19-9110-d831ae527bae --op mkfs --no-mon-config 2020-09-08T17:13:40.797 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:60: TEST_filestore_to_bluestore: ceph-objectstore-tool --data-path td/osd-dup/0.old --target-data-path td/osd-dup/0 --op dup 2020-09-08T17:13:40.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:62: TEST_filestore_to_bluestore: CEPH_ARGS='--fsid=99a59926-c7f2-4e55-9844-271f7250cec2 --auth-supported=none --mon-host=127.0.0.1:7146 --filestore_wbthrottle_xfs_ios_hard_limit=900 --filestore_wbthrottle_btrfs_ios_hard_limit=900 ' 2020-09-08T17:13:40.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:64: TEST_filestore_to_bluestore: activate_osd td/osd-dup 0 2020-09-08T17:13:40.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/osd-dup 2020-09-08T17:13:40.798 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-09-08T17:13:40.799 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=0 2020-09-08T17:13:40.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2020-09-08T17:13:40.800 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/osd-dup/0 2020-09-08T17:13:41.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--fsid=99a59926-c7f2-4e55-9844-271f7250cec2 --auth-supported=none --mon-host=127.0.0.1:7146 --filestore_wbthrottle_xfs_ios_hard_limit=900 --filestore_wbthrottle_btrfs_ios_hard_limit=900 ' 2020-09-08T17:13:41.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:13:41.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:13:41.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:13:41.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/osd-dup/0' 2020-09-08T17:13:41.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/osd-dup/0/journal' 2020-09-08T17:13:41.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2020-09-08T17:13:41.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2020-09-08T17:13:41.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/osd-dup' 2020-09-08T17:13:41.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2020-09-08T17:13:41.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:13:41.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:13:41.005 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:13:41.005 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:13:41.005 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.667599 2020-09-08T17:13:41.005 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.667599/$cluster-$name.asok' 2020-09-08T17:13:41.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.667599/$cluster-$name.asok' 2020-09-08T17:13:41.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:13:41.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/osd-dup/$name.log' 2020-09-08T17:13:41.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/osd-dup/$name.pid' 2020-09-08T17:13:41.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:13:41.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:13:41.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:13:41.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2020-09-08T17:13:41.626 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2020-09-08T17:13:41.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/osd-dup/0 2020-09-08T17:13:41.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.0 2020-09-08T17:13:41.627 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 0 --fsid=99a59926-c7f2-4e55-9844-271f7250cec2 --auth-supported=none --mon-host=127.0.0.1:7146 --filestore_wbthrottle_xfs_ios_hard_limit=900 --filestore_wbthrottle_btrfs_ios_hard_limit=900 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-dup/0 --osd-journal=td/osd-dup/0/journal --chdir= --run-dir=td/osd-dup '--admin-socket=/tmp/ceph-asok.667599/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-dup/$name.log' '--pid-file=td/osd-dup/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:13:41.627 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/osd-dup/0/whoami 2020-09-08T17:14:04.498 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 0 = 0 ']' 2020-09-08T17:14:04.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2020-09-08T17:14:04.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2020-09-08T17:14:04.499 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2020-09-08T17:14:04.499 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:58.127+0000 7f0547192ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:14:04.500 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:58.156+0000 7f0547192ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:14:04.500 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:58.158+0000 7f0547192ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:14:04.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 0 2020-09-08T17:14:04.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:14:04.500 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T17:14:04.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:14:04.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:14:04.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:14:04.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:14:04.501 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:14:04.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:14:04.502 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:12:58.675+0000 7f0547192ec0 -1 Falling back to public interface 2020-09-08T17:14:04.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:14:04.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:14:04.502 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:14:04.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:14:04.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:14:04.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:14:04.503 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:13:00.128+0000 7f0547192ec0 -1 osd.0 21 log_to_monitors {default=true} 2020-09-08T17:14:04.503 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:14:04.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:14:04.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:14:04.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:66: TEST_filestore_to_bluestore: grep '3 up' 2020-09-08T17:14:04.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:66: TEST_filestore_to_bluestore: ceph osd stat 2020-09-08T17:14:04.504 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:67: TEST_filestore_to_bluestore: ceph osd metadata 0 2020-09-08T17:14:04.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:67: TEST_filestore_to_bluestore: grep bluestore 2020-09-08T17:14:04.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:69: TEST_filestore_to_bluestore: ceph osd scrub 0 2020-09-08T17:14:04.505 INFO:tasks.workunit.client.0.smithi065.stderr:instructed osd(s) 0 to scrub 2020-09-08T17:14:04.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:72: TEST_filestore_to_bluestore: sleep 15 2020-09-08T17:14:04.505 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:74: TEST_filestore_to_bluestore: flush_pg_stats 2020-09-08T17:14:04.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T17:14:04.506 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T17:14:04.506 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T17:14:04.506 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T17:14:04.506 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T17:14:04.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T17:14:04.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:14:04.507 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T17:14:04.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182406 2020-09-08T17:14:04.507 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182406 2020-09-08T17:14:04.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-107374182406' 2020-09-08T17:14:04.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:14:04.508 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T17:14:04.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672973 2020-09-08T17:14:04.508 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672973 2020-09-08T17:14:04.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-107374182406 1-42949672973' 2020-09-08T17:14:04.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:14:04.509 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T17:14:04.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509452 2020-09-08T17:14:04.509 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509452 2020-09-08T17:14:04.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-107374182406 1-42949672973 2-64424509452' 2020-09-08T17:14:04.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:14:04.510 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-107374182406 2020-09-08T17:14:04.510 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:14:04.510 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T17:14:04.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-107374182406 2020-09-08T17:14:04.511 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:14:04.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182406 2020-09-08T17:14:04.511 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 107374182406' 2020-09-08T17:14:04.512 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T17:14:04.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182406 -lt 107374182406 2020-09-08T17:14:04.512 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:14:04.512 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672973 2020-09-08T17:14:04.512 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:14:04.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T17:14:04.513 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672973 2020-09-08T17:14:04.513 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:14:04.513 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672973 2020-09-08T17:14:04.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672973' 2020-09-08T17:14:04.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T17:14:04.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672973 -lt 42949672973 2020-09-08T17:14:04.514 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:14:04.514 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509452 2020-09-08T17:14:04.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:14:04.515 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T17:14:04.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509452 2020-09-08T17:14:04.515 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:14:04.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509452 2020-09-08T17:14:04.718 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509452' 2020-09-08T17:14:04.719 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T17:14:04.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509452 -lt 64424509452 2020-09-08T17:14:04.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:76: TEST_filestore_to_bluestore: wait_for_clean 2020-09-08T17:14:04.719 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2020-09-08T17:14:04.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2020-09-08T17:14:04.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2020-09-08T17:14:04.720 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-09-08T17:14:04.720 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2020-09-08T17:14:04.720 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2020-09-08T17:14:04.721 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2020-09-08T17:14:04.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2020-09-08T17:14:04.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2020-09-08T17:14:04.721 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2020-09-08T17:14:04.721 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2020-09-08T17:14:04.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2020-09-08T17:14:04.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2020-09-08T17:14:04.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2020-09-08T17:14:04.722 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2020-09-08T17:14:04.722 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2020-09-08T17:14:04.723 INFO:tasks.workunit.client.0.smithi065.stderr:1 2020-09-08T17:14:04.723 INFO:tasks.workunit.client.0.smithi065.stderr:2' 2020-09-08T17:14:04.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2020-09-08T17:14:04.723 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:14:04.724 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-09-08T17:14:04.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=107374182408 2020-09-08T17:14:04.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 107374182408 2020-09-08T17:14:04.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-107374182408' 2020-09-08T17:14:04.724 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:14:04.725 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-09-08T17:14:04.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672975 2020-09-08T17:14:04.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672975 2020-09-08T17:14:04.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-107374182408 1-42949672975' 2020-09-08T17:14:04.725 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2020-09-08T17:14:04.726 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-09-08T17:14:04.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509454 2020-09-08T17:14:04.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509454 2020-09-08T17:14:04.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-107374182408 1-42949672975 2-64424509454' 2020-09-08T17:14:04.726 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:14:04.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-107374182408 2020-09-08T17:14:04.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:14:04.727 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2020-09-08T17:14:04.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-107374182408 2020-09-08T17:14:04.727 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:14:04.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=107374182408 2020-09-08T17:14:04.728 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 107374182408' 2020-09-08T17:14:04.930 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2020-09-08T17:14:04.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 107374182408 -lt 107374182408 2020-09-08T17:14:04.930 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:14:04.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672975 2020-09-08T17:14:04.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:14:04.931 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2020-09-08T17:14:04.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672975 2020-09-08T17:14:04.931 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:14:04.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672975 2020-09-08T17:14:04.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672975' 2020-09-08T17:14:04.932 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2020-09-08T17:14:04.932 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672975 -lt 42949672975 2020-09-08T17:14:04.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2020-09-08T17:14:04.933 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509454 2020-09-08T17:14:04.933 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2020-09-08T17:14:04.933 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2020-09-08T17:14:04.933 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509454 2020-09-08T17:14:04.934 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2020-09-08T17:14:04.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509454 2020-09-08T17:14:04.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509454' 2020-09-08T17:14:04.934 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T17:14:04.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509452 -lt 64424509454 2020-09-08T17:14:05.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2020-09-08T17:14:05.138 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2020-09-08T17:14:05.138 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2020-09-08T17:14:05.139 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509455 -lt 64424509454 2020-09-08T17:14:05.139 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2020-09-08T17:14:05.139 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:14:05.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:14:05.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 16 == 0 2020-09-08T17:14:05.140 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2020-09-08T17:14:05.140 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2020-09-08T17:14:05.141 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2020-09-08T17:14:05.141 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-09-08T17:14:05.141 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-09-08T17:14:05.141 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2020-09-08T17:14:05.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-09-08T17:14:05.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=16 2020-09-08T17:14:05.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2020-09-08T17:14:05.142 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2020-09-08T17:14:05.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2020-09-08T17:14:05.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 16 = 16 2020-09-08T17:14:05.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2020-09-08T17:14:05.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2020-09-08T17:14:05.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh:22: run: teardown td/osd-dup 2020-09-08T17:14:05.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-dup 2020-09-08T17:14:05.346 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T17:14:05.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-dup KILL 2020-09-08T17:14:05.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:14:05.347 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:14:05.347 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:14:05.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:14:05.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:14:05.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:14:05.348 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:14:05.348 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:14:05.349 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:14:05.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:14:05.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:14:05.349 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:14:05.349 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:14:05.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:14:05.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:14:05.350 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:14:05.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:14:05.350 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T17:14:05.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-dup 2020-09-08T17:14:05.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:14:05.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:14:05.554 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.667599 2020-09-08T17:14:05.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.667599 2020-09-08T17:14:05.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:14:05.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:14:05.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2151: main: code=0 2020-09-08T17:14:05.555 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2155: main: teardown td/osd-dup 0 2020-09-08T17:14:05.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-dup 2020-09-08T17:14:05.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2020-09-08T17:14:05.556 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-dup KILL 2020-09-08T17:14:05.556 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:14:05.557 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:14:05.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:14:05.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:14:05.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:14:05.557 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:14:05.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:14:05.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:14:05.558 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:14:05.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:14:05.558 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:14:05.559 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:14:05.559 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:14:05.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:14:05.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:14:05.966 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:14:05.966 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:14:05.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2020-09-08T17:14:05.967 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-dup 2020-09-08T17:14:05.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:14:05.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:14:05.967 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.667599 2020-09-08T17:14:05.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.667599 2020-09-08T17:14:05.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:14:05.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:14:05.968 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2156: main: return 0 2020-09-08T17:14:05.969 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-09-08T17:14:05.970 INFO:teuthology.orchestra.run.smithi065:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-09-08T17:14:06.008 INFO:tasks.workunit:Running workunit osd/osd-fast-mark-down.sh... 2020-09-08T17:14:17.455 INFO:teuthology.orchestra.run.smithi065:workunit test osd/osd-fast-mark-down.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dce4d291bd4243c9802c17d67b85a6da6bbc0f8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh 2020-09-08T17:14:17.481 INFO:tasks.workunit.client.0.smithi065.stderr:stty: 'standard input': Inappropriate ioctl for device 2020-09-08T17:14:17.489 INFO:tasks.workunit.client.0.smithi065.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2020-09-08T17:14:17.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T17:14:17.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T17:14:17.489 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: export PYTHONWARNINGS=ignore 2020-09-08T17:14:17.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: PYTHONWARNINGS=ignore 2020-09-08T17:14:17.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: export CEPH_CONF=/dev/null 2020-09-08T17:14:17.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: CEPH_CONF=/dev/null 2020-09-08T17:14:17.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2147: main: unset CEPH_ARGS 2020-09-08T17:14:17.490 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2149: main: local code 2020-09-08T17:14:17.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2150: main: run td/osd-fast-mark-down 2020-09-08T17:14:17.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:23: run: local dir=td/osd-fast-mark-down 2020-09-08T17:14:17.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:24: run: shift 2020-09-08T17:14:17.491 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:25: run: rm -f 'td/osd-fast-mark-down/*.pid' 2020-09-08T17:14:17.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:26: run: export CEPH_MON=127.0.0.1:7126 2020-09-08T17:14:17.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:26: run: CEPH_MON=127.0.0.1:7126 2020-09-08T17:14:17.492 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:27: run: export CEPH_ARGS 2020-09-08T17:14:17.494 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:28: run: uuidgen 2020-09-08T17:14:17.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:28: run: CEPH_ARGS+='--fsid=a70bc30b-ceae-451e-ae63-ea1e7de9d660 --auth-supported=none ' 2020-09-08T17:14:17.494 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:30: run: OLD_ARGS='--fsid=a70bc30b-ceae-451e-ae63-ea1e7de9d660 --auth-supported=none ' 2020-09-08T17:14:17.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:31: run: CEPH_ARGS+='--osd-fast-fail-on-connection-refused=false ' 2020-09-08T17:14:17.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:32: run: echo 'Ensuring old behavior is there...' 2020-09-08T17:14:17.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:33: run: test_fast_kill td/osd-fast-mark-down 2020-09-08T17:14:17.495 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:48: test_fast_kill: setup td/osd-fast-mark-down 2020-09-08T17:14:17.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-fast-mark-down 2020-09-08T17:14:17.496 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-fast-mark-down 2020-09-08T17:14:17.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-fast-mark-down 2020-09-08T17:14:17.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T17:14:17.698 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-fast-mark-down KILL 2020-09-08T17:14:17.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:14:17.699 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:14:17.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:14:17.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:14:17.699 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:14:17.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:14:17.700 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:14:17.700 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:14:17.700 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:14:17.701 INFO:tasks.workunit.client.0.smithi065.stdout:Ensuring old behavior is there... 2020-09-08T17:14:17.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:14:17.704 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:14:17.704 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:14:17.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:14:17.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:14:17.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:14:17.705 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:14:17.705 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:14:17.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T17:14:17.706 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-fast-mark-down 2020-09-08T17:14:17.910 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:14:18.522 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:14:18.522 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.670538 2020-09-08T17:14:18.522 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.670538 2020-09-08T17:14:18.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:14:18.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:14:18.523 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-fast-mark-down 2020-09-08T17:14:18.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T17:14:18.523 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:14:18.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.670538 2020-09-08T17:14:18.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.670538 2020-09-08T17:14:18.524 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T17:14:18.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2020-09-08T17:14:18.524 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2020-09-08T17:14:18.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T17:14:18.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-fast-mark-down 1' TERM HUP INT 2020-09-08T17:14:18.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:49: test_fast_kill: run_mon td/osd-fast-mark-down a --osd_pool_default_size=3 2020-09-08T17:14:18.525 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-fast-mark-down 2020-09-08T17:14:18.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T17:14:18.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T17:14:18.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T17:14:18.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-fast-mark-down/a 2020-09-08T17:14:18.526 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-fast-mark-down/a --run-dir=td/osd-fast-mark-down --osd_pool_default_size=3 2020-09-08T17:14:18.742 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:17.533+0000 7ff000c236c0 -1 failed for service _ceph-mon._tcp 2020-09-08T17:14:37.726 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:17.533+0000 7ff000c236c0 -1 unable to get monitor info from DNS SRV with service name: ceph-mon 2020-09-08T17:14:37.727 INFO:tasks.workunit.client.0.smithi065.stderr: 2020-09-08T17:14:37.727 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:17.533+0000 7ff000c236c0 -1 ceph-mon: warning: no initial monitors; must use admin socket to feed hints 2020-09-08T17:14:37.753 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T17:14:37.753 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:14:37.753 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:14:37.754 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:14:37.754 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:14:37.754 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.670538 2020-09-08T17:14:37.754 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.670538/$cluster-$name.asok' 2020-09-08T17:14:37.754 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-fast-mark-down/a '--log-file=td/osd-fast-mark-down/$name.log' '--admin-socket=/tmp/ceph-asok.670538/$cluster-$name.asok' --mon-cluster-log-file=td/osd-fast-mark-down/log --run-dir=td/osd-fast-mark-down '--pid-file=td/osd-fast-mark-down/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --osd_pool_default_size=3 2020-09-08T17:14:37.755 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:18.001+0000 7f1b8cd806c0 -1 failed for service _ceph-mon._tcp 2020-09-08T17:14:37.755 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:18.001+0000 7f1b8cd806c0 -1 unable to get monitor info from DNS SRV with service name: ceph-mon 2020-09-08T17:14:37.755 INFO:tasks.workunit.client.0.smithi065.stderr: 2020-09-08T17:14:37.755 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:18.001+0000 7f1b8cd806c0 -1 ceph-mon: error generating initial monmap: (2) No such file or directory 2020-09-08T17:14:37.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:484: run_mon: return 1 2020-09-08T17:14:37.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:49: test_fast_kill: return 1 2020-09-08T17:14:37.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:35: run: CEPH_ARGS='--fsid=a70bc30b-ceae-451e-ae63-ea1e7de9d660 --auth-supported=none --osd-fast-fail-on-connection-refused=true ' 2020-09-08T17:14:37.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:36: run: OLD_ARGS='--fsid=a70bc30b-ceae-451e-ae63-ea1e7de9d660 --auth-supported=none --osd-fast-fail-on-connection-refused=true ' 2020-09-08T17:14:37.958 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:38: run: CEPH_ARGS='--fsid=a70bc30b-ceae-451e-ae63-ea1e7de9d660 --auth-supported=none --osd-fast-fail-on-connection-refused=true --ms_type=async --mon-host=127.0.0.1:7126' 2020-09-08T17:14:39.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:39: run: echo 'Testing async msgr...' 2020-09-08T17:14:39.794 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:40: run: test_fast_kill td/osd-fast-mark-down 2020-09-08T17:14:40.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:48: test_fast_kill: setup td/osd-fast-mark-down 2020-09-08T17:14:40.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-fast-mark-down 2020-09-08T17:14:40.202 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-fast-mark-down 2020-09-08T17:14:40.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-fast-mark-down 2020-09-08T17:14:40.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T17:14:40.203 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-fast-mark-down KILL 2020-09-08T17:14:40.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:14:40.203 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:14:40.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:14:40.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:14:40.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:14:40.204 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:14:40.204 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:14:40.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:14:40.205 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:14:40.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:14:40.205 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:14:40.205 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:14:40.206 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:14:40.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:14:42.042 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:14:43.270 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:14:43.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:14:43.270 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T17:14:43.271 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-fast-mark-down 2020-09-08T17:14:43.271 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:14:43.271 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:14:43.271 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.670538 2020-09-08T17:14:59.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.670538 2020-09-08T17:14:59.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:14:59.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:14:59.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-fast-mark-down 2020-09-08T17:14:59.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T17:14:59.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:14:59.003 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.670538 2020-09-08T17:14:59.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.670538 2020-09-08T17:14:59.004 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T17:14:59.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-09-08T17:14:59.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T17:14:59.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-fast-mark-down 1' TERM HUP INT 2020-09-08T17:14:59.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:49: test_fast_kill: run_mon td/osd-fast-mark-down a --osd_pool_default_size=3 2020-09-08T17:14:59.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-fast-mark-down 2020-09-08T17:14:59.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T17:14:59.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T17:14:59.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T17:14:59.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-fast-mark-down/a 2020-09-08T17:14:59.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-fast-mark-down/a --run-dir=td/osd-fast-mark-down --osd_pool_default_size=3 2020-09-08T17:14:59.006 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T17:14:59.006 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:14:59.007 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:14:59.007 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:14:59.007 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:14:59.007 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.670538 2020-09-08T17:14:59.007 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.670538/$cluster-$name.asok' 2020-09-08T17:14:59.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-fast-mark-down/a '--log-file=td/osd-fast-mark-down/$name.log' '--admin-socket=/tmp/ceph-asok.670538/$cluster-$name.asok' --mon-cluster-log-file=td/osd-fast-mark-down/log --run-dir=td/osd-fast-mark-down '--pid-file=td/osd-fast-mark-down/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --osd_pool_default_size=3 2020-09-08T17:14:59.008 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T17:14:59.008 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T17:14:59.008 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T17:14:59.008 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T17:14:59.009 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T17:14:59.009 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T17:14:59.009 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T17:14:59.009 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T17:14:59.009 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T17:14:59.010 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T17:14:59.010 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:14:59.010 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.670538 2020-09-08T17:14:59.010 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.670538/ceph-mon.a.asok 2020-09-08T17:14:59.011 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T17:14:59.011 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.670538/ceph-mon.a.asok config get fsid 2020-09-08T17:14:59.011 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T17:14:59.011 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T17:14:59.011 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T17:14:59.012 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T17:14:59.012 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T17:14:59.012 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T17:14:59.012 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T17:14:59.012 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T17:14:59.013 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T17:14:59.013 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:14:59.013 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.670538 2020-09-08T17:14:59.013 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.670538/ceph-mon.a.asok 2020-09-08T17:14:59.013 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T17:14:59.014 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.670538/ceph-mon.a.asok config get mon_host 2020-09-08T17:14:59.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:50: test_fast_kill: run_mgr td/osd-fast-mark-down x 2020-09-08T17:14:59.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-fast-mark-down 2020-09-08T17:14:59.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T17:14:59.218 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T17:14:59.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T17:14:59.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-fast-mark-down/x 2020-09-08T17:14:59.219 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T17:14:59.219 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T17:14:59.219 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:14:59.220 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:14:59.220 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:14:59.220 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:14:59.220 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.670538 2020-09-08T17:14:59.220 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.670538/$cluster-$name.asok' 2020-09-08T17:14:59.221 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T17:14:59.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-fast-mark-down/x '--log-file=td/osd-fast-mark-down/$name.log' '--admin-socket=/tmp/ceph-asok.670538/$cluster-$name.asok' --run-dir=td/osd-fast-mark-down '--pid-file=td/osd-fast-mark-down/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T17:14:59.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:51: test_fast_kill: for oi in {0..2} 2020-09-08T17:14:59.221 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:52: test_fast_kill: run_osd td/osd-fast-mark-down 0 2020-09-08T17:14:59.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-fast-mark-down 2020-09-08T17:14:59.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T17:14:59.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T17:14:59.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T17:14:59.222 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-fast-mark-down/0 2020-09-08T17:14:59.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a70bc30b-ceae-451e-ae63-ea1e7de9d660 --auth-supported=none --osd-fast-fail-on-connection-refused=true --ms_type=async --mon-host=127.0.0.1:7126' 2020-09-08T17:14:59.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:14:59.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:14:59.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:14:59.223 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-fast-mark-down/0' 2020-09-08T17:14:59.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-fast-mark-down/0/journal' 2020-09-08T17:14:59.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T17:14:59.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T17:14:59.224 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-fast-mark-down' 2020-09-08T17:14:59.224 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T17:14:59.225 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:14:59.225 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:14:59.225 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:14:59.225 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:14:59.225 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.670538 2020-09-08T17:14:59.226 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.670538/$cluster-$name.asok' 2020-09-08T17:14:59.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.670538/$cluster-$name.asok' 2020-09-08T17:14:59.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:14:59.226 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T17:14:59.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T17:14:59.430 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-fast-mark-down/$name.log' 2020-09-08T17:14:59.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-fast-mark-down/$name.pid' 2020-09-08T17:14:59.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:14:59.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:14:59.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:14:59.431 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T17:14:59.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T17:14:59.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-fast-mark-down/0 2020-09-08T17:14:59.432 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T17:14:59.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=3bc31797-37b0-4e30-a4f5-c6780755f34a 2020-09-08T17:14:59.432 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 3bc31797-37b0-4e30-a4f5-c6780755f34a' 2020-09-08T17:14:59.433 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T17:14:59.433 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDru1dfwfgJJxAAyCCNC++8JXCOIIyy+H5Bmw== 2020-09-08T17:15:03.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDru1dfwfgJJxAAyCCNC++8JXCOIIyy+H5Bmw=="}' 2020-09-08T17:15:03.954 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 3bc31797-37b0-4e30-a4f5-c6780755f34a -i td/osd-fast-mark-down/0/new.json 2020-09-08T17:15:03.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-fast-mark-down/0/new.json 2020-09-08T17:15:03.955 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=a70bc30b-ceae-451e-ae63-ea1e7de9d660 --auth-supported=none --osd-fast-fail-on-connection-refused=true --ms_type=async --mon-host=127.0.0.1:7126 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-fast-mark-down/0 --osd-journal=td/osd-fast-mark-down/0/journal --chdir= --run-dir=td/osd-fast-mark-down '--admin-socket=/tmp/ceph-asok.670538/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-fast-mark-down/$name.log' '--pid-file=td/osd-fast-mark-down/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDru1dfwfgJJxAAyCCNC++8JXCOIIyy+H5Bmw== --osd-uuid 3bc31797-37b0-4e30-a4f5-c6780755f34a 2020-09-08T17:15:04.158 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:20.029+0000 7f25f4333ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:15:04.362 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:20.031+0000 7f25f4333ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:15:04.362 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:20.032+0000 7f25f4333ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:15:04.362 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:20.033+0000 7f25f4333ec0 -1 bluestore(td/osd-fast-mark-down/0/block) _read_bdev_label failed to open td/osd-fast-mark-down/0/block: (2) No such file or directory 2020-09-08T17:15:04.363 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:20.033+0000 7f25f4333ec0 -1 bluestore(td/osd-fast-mark-down/0/block) _read_bdev_label failed to open td/osd-fast-mark-down/0/block: (2) No such file or directory 2020-09-08T17:15:04.363 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:20.033+0000 7f25f4333ec0 -1 bluestore(td/osd-fast-mark-down/0/block) _read_bdev_label failed to open td/osd-fast-mark-down/0/block: (2) No such file or directory 2020-09-08T17:15:04.363 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:20.073+0000 7f25f4333ec0 -1 bluestore(td/osd-fast-mark-down/0) _read_fsid unparsable uuid 2020-09-08T17:15:04.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-fast-mark-down/0/keyring 2020-09-08T17:15:04.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T17:15:04.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T17:15:04.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-fast-mark-down/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:15:04.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T17:15:04.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T17:15:04.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=a70bc30b-ceae-451e-ae63-ea1e7de9d660 --auth-supported=none --osd-fast-fail-on-connection-refused=true --ms_type=async --mon-host=127.0.0.1:7126 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-fast-mark-down/0 --osd-journal=td/osd-fast-mark-down/0/journal --chdir= --run-dir=td/osd-fast-mark-down '--admin-socket=/tmp/ceph-asok.670538/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-fast-mark-down/$name.log' '--pid-file=td/osd-fast-mark-down/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:15:04.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T17:15:04.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T17:15:04.566 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:25.113+0000 7f3d9828eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:15:04.566 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:25.127+0000 7f3d9828eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:15:04.566 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:25.129+0000 7f3d9828eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:15:04.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T17:15:04.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:15:04.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T17:15:04.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:15:04.567 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:15:04.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:15:04.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:15:04.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:15:04.568 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:15:04.569 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:25.645+0000 7f3d9828eec0 -1 Falling back to public interface 2020-09-08T17:15:04.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:15:04.569 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:26.402+0000 7f3d9828eec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T17:15:04.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:15:04.569 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:15:04.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:15:04.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:15:04.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:15:04.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:15:04.570 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:15:04.571 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:15:04.571 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:53: test_fast_kill: cat td/osd-fast-mark-down/osd.0.pid 2020-09-08T17:15:04.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:53: test_fast_kill: pids[$oi]=671465 2020-09-08T17:15:04.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:51: test_fast_kill: for oi in {0..2} 2020-09-08T17:15:04.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:52: test_fast_kill: run_osd td/osd-fast-mark-down 1 2020-09-08T17:15:04.778 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-fast-mark-down 2020-09-08T17:15:04.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T17:15:04.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T17:15:04.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T17:15:04.779 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-fast-mark-down/1 2020-09-08T17:15:04.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a70bc30b-ceae-451e-ae63-ea1e7de9d660 --auth-supported=none --osd-fast-fail-on-connection-refused=true --ms_type=async --mon-host=127.0.0.1:7126' 2020-09-08T17:15:04.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:15:04.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:15:04.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:15:04.780 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-fast-mark-down/1' 2020-09-08T17:15:04.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-fast-mark-down/1/journal' 2020-09-08T17:15:04.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T17:15:04.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T17:15:04.781 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-fast-mark-down' 2020-09-08T17:15:04.781 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T17:15:04.782 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:15:04.782 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:15:04.782 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:15:04.782 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:15:04.986 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.670538 2020-09-08T17:15:04.986 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.670538/$cluster-$name.asok' 2020-09-08T17:15:04.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.670538/$cluster-$name.asok' 2020-09-08T17:15:04.986 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:15:04.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T17:15:04.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T17:15:04.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-fast-mark-down/$name.log' 2020-09-08T17:15:04.987 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-fast-mark-down/$name.pid' 2020-09-08T17:15:04.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:15:04.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:15:04.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:15:04.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T17:15:04.988 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T17:15:04.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-fast-mark-down/1 2020-09-08T17:15:04.989 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T17:15:04.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=7add7497-35cf-4c26-a85e-3354c22d0d3b 2020-09-08T17:15:04.989 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 7add7497-35cf-4c26-a85e-3354c22d0d3b' 2020-09-08T17:15:04.989 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T17:15:04.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDzu1dfW0AGFBAA0Hb/nnZq9uBjqed9sYUuDg== 2020-09-08T17:15:04.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDzu1dfW0AGFBAA0Hb/nnZq9uBjqed9sYUuDg=="}' 2020-09-08T17:15:04.990 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 7add7497-35cf-4c26-a85e-3354c22d0d3b -i td/osd-fast-mark-down/1/new.json 2020-09-08T17:15:05.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-fast-mark-down/1/new.json 2020-09-08T17:15:05.194 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=a70bc30b-ceae-451e-ae63-ea1e7de9d660 --auth-supported=none --osd-fast-fail-on-connection-refused=true --ms_type=async --mon-host=127.0.0.1:7126 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-fast-mark-down/1 --osd-journal=td/osd-fast-mark-down/1/journal --chdir= --run-dir=td/osd-fast-mark-down '--admin-socket=/tmp/ceph-asok.670538/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-fast-mark-down/$name.log' '--pid-file=td/osd-fast-mark-down/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDzu1dfW0AGFBAA0Hb/nnZq9uBjqed9sYUuDg== --osd-uuid 7add7497-35cf-4c26-a85e-3354c22d0d3b 2020-09-08T17:15:05.194 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:27.861+0000 7f6e1f2b1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:15:05.195 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:27.862+0000 7f6e1f2b1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:15:05.195 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:27.863+0000 7f6e1f2b1ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:15:05.195 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:27.864+0000 7f6e1f2b1ec0 -1 bluestore(td/osd-fast-mark-down/1/block) _read_bdev_label failed to open td/osd-fast-mark-down/1/block: (2) No such file or directory 2020-09-08T17:15:05.195 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:27.864+0000 7f6e1f2b1ec0 -1 bluestore(td/osd-fast-mark-down/1/block) _read_bdev_label failed to open td/osd-fast-mark-down/1/block: (2) No such file or directory 2020-09-08T17:15:05.195 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:27.864+0000 7f6e1f2b1ec0 -1 bluestore(td/osd-fast-mark-down/1/block) _read_bdev_label failed to open td/osd-fast-mark-down/1/block: (2) No such file or directory 2020-09-08T17:15:05.196 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:27.926+0000 7f6e1f2b1ec0 -1 bluestore(td/osd-fast-mark-down/1) _read_fsid unparsable uuid 2020-09-08T17:15:05.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-fast-mark-down/1/keyring 2020-09-08T17:15:05.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T17:15:05.196 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T17:15:05.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-fast-mark-down/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:15:05.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T17:15:05.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T17:15:05.197 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=a70bc30b-ceae-451e-ae63-ea1e7de9d660 --auth-supported=none --osd-fast-fail-on-connection-refused=true --ms_type=async --mon-host=127.0.0.1:7126 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-fast-mark-down/1 --osd-journal=td/osd-fast-mark-down/1/journal --chdir= --run-dir=td/osd-fast-mark-down '--admin-socket=/tmp/ceph-asok.670538/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-fast-mark-down/$name.log' '--pid-file=td/osd-fast-mark-down/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:15:05.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T17:15:05.398 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T17:15:05.398 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:32.713+0000 7f483c29eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:15:05.399 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:32.731+0000 7f483c29eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:15:05.399 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:32.733+0000 7f483c29eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:15:05.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T17:15:05.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:15:05.399 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T17:15:05.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:15:05.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:15:05.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:15:05.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:15:05.400 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:15:05.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:15:05.401 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:33.248+0000 7f483c29eec0 -1 Falling back to public interface 2020-09-08T17:15:05.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:15:05.401 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:34.049+0000 7f483c29eec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T17:15:05.401 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:15:05.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:15:05.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:15:05.402 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:15:05.610 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:15:07.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:15:07.454 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:15:07.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:15:07.455 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:53: test_fast_kill: cat td/osd-fast-mark-down/osd.1.pid 2020-09-08T17:15:07.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:53: test_fast_kill: pids[$oi]=672460 2020-09-08T17:15:07.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:51: test_fast_kill: for oi in {0..2} 2020-09-08T17:15:07.455 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:52: test_fast_kill: run_osd td/osd-fast-mark-down 2 2020-09-08T17:15:07.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-fast-mark-down 2020-09-08T17:15:07.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T17:15:07.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T17:15:07.456 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T17:15:07.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-fast-mark-down/2 2020-09-08T17:15:07.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=a70bc30b-ceae-451e-ae63-ea1e7de9d660 --auth-supported=none --osd-fast-fail-on-connection-refused=true --ms_type=async --mon-host=127.0.0.1:7126' 2020-09-08T17:15:07.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:15:07.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:15:07.457 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:15:07.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-fast-mark-down/2' 2020-09-08T17:15:07.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-fast-mark-down/2/journal' 2020-09-08T17:15:07.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T17:15:07.458 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T17:15:07.459 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-fast-mark-down' 2020-09-08T17:15:07.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T17:15:07.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:15:07.459 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:15:07.459 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:15:07.460 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:15:07.460 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.670538 2020-09-08T17:15:07.460 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.670538/$cluster-$name.asok' 2020-09-08T17:15:07.460 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.670538/$cluster-$name.asok' 2020-09-08T17:15:07.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:15:07.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T17:15:07.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T17:15:07.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-fast-mark-down/$name.log' 2020-09-08T17:15:07.461 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-fast-mark-down/$name.pid' 2020-09-08T17:15:07.462 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:15:07.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:15:07.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:15:07.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T17:15:07.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T17:15:07.463 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-fast-mark-down/2 2020-09-08T17:15:07.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T17:15:07.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=01224440-9b9b-496b-9a75-0e2a3eecf782 2020-09-08T17:15:07.464 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 01224440-9b9b-496b-9a75-0e2a3eecf782' 2020-09-08T17:15:07.464 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T17:15:07.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQD6u1dflbFROhAAmequH/XaOMMPtko77TbDzw== 2020-09-08T17:15:07.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQD6u1dflbFROhAAmequH/XaOMMPtko77TbDzw=="}' 2020-09-08T17:15:07.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 01224440-9b9b-496b-9a75-0e2a3eecf782 -i td/osd-fast-mark-down/2/new.json 2020-09-08T17:15:07.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-fast-mark-down/2/new.json 2020-09-08T17:15:07.465 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=a70bc30b-ceae-451e-ae63-ea1e7de9d660 --auth-supported=none --osd-fast-fail-on-connection-refused=true --ms_type=async --mon-host=127.0.0.1:7126 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-fast-mark-down/2 --osd-journal=td/osd-fast-mark-down/2/journal --chdir= --run-dir=td/osd-fast-mark-down '--admin-socket=/tmp/ceph-asok.670538/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-fast-mark-down/$name.log' '--pid-file=td/osd-fast-mark-down/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQD6u1dflbFROhAAmequH/XaOMMPtko77TbDzw== --osd-uuid 01224440-9b9b-496b-9a75-0e2a3eecf782 2020-09-08T17:15:07.466 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:35.583+0000 7fcb54141ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:15:07.466 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:35.585+0000 7fcb54141ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:15:07.466 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:35.586+0000 7fcb54141ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:15:07.466 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:35.587+0000 7fcb54141ec0 -1 bluestore(td/osd-fast-mark-down/2/block) _read_bdev_label failed to open td/osd-fast-mark-down/2/block: (2) No such file or directory 2020-09-08T17:15:07.467 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:35.587+0000 7fcb54141ec0 -1 bluestore(td/osd-fast-mark-down/2/block) _read_bdev_label failed to open td/osd-fast-mark-down/2/block: (2) No such file or directory 2020-09-08T17:15:07.467 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:35.587+0000 7fcb54141ec0 -1 bluestore(td/osd-fast-mark-down/2/block) _read_bdev_label failed to open td/osd-fast-mark-down/2/block: (2) No such file or directory 2020-09-08T17:15:07.467 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:35.639+0000 7fcb54141ec0 -1 bluestore(td/osd-fast-mark-down/2) _read_fsid unparsable uuid 2020-09-08T17:15:07.467 INFO:tasks.workunit.client.0.smithi065.stdout:Testing async msgr... 2020-09-08T17:15:07.468 INFO:tasks.workunit.client.0.smithi065.stdout:add osd0 3bc31797-37b0-4e30-a4f5-c6780755f34a 2020-09-08T17:15:07.468 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:15:07.468 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd0 key to auth repository 2020-09-08T17:15:07.468 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.0 2020-09-08T17:15:07.469 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:15:07.670 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:15:11.138 INFO:tasks.workunit.client.0.smithi065.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/671465,v1:127.0.0.1:6803/671465] [v2:127.0.0.1:6804/671465,v1:127.0.0.1:6805/671465] exists,up 3bc31797-37b0-4e30-a4f5-c6780755f34a 2020-09-08T17:15:11.139 INFO:tasks.workunit.client.0.smithi065.stdout:add osd1 7add7497-35cf-4c26-a85e-3354c22d0d3b 2020-09-08T17:15:11.139 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:15:11.139 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd1 key to auth repository 2020-09-08T17:15:11.139 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.1 2020-09-08T17:15:11.139 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:15:11.140 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:15:11.140 INFO:tasks.workunit.client.0.smithi065.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/672460,v1:127.0.0.1:6811/672460] [v2:127.0.0.1:6812/672460,v1:127.0.0.1:6813/672460] exists,up 7add7497-35cf-4c26-a85e-3354c22d0d3b 2020-09-08T17:15:11.140 INFO:tasks.workunit.client.0.smithi065.stdout:add osd2 01224440-9b9b-496b-9a75-0e2a3eecf782 2020-09-08T17:15:11.140 INFO:tasks.workunit.client.0.smithi065.stdout:2 2020-09-08T17:15:11.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-fast-mark-down/2/keyring 2020-09-08T17:15:11.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T17:15:11.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2020-09-08T17:15:11.153 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-fast-mark-down/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:15:11.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2020-09-08T17:15:11.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=a70bc30b-ceae-451e-ae63-ea1e7de9d660 --auth-supported=none --osd-fast-fail-on-connection-refused=true --ms_type=async --mon-host=127.0.0.1:7126 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-fast-mark-down/2 --osd-journal=td/osd-fast-mark-down/2/journal --chdir= --run-dir=td/osd-fast-mark-down '--admin-socket=/tmp/ceph-asok.670538/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-fast-mark-down/$name.log' '--pid-file=td/osd-fast-mark-down/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:15:11.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T17:15:11.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T17:15:11.154 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T17:15:11.155 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:40.273+0000 7f06211e4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:15:11.155 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:40.286+0000 7f06211e4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:15:11.358 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:40.288+0000 7f06211e4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:15:11.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2020-09-08T17:15:11.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:15:11.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2020-09-08T17:15:11.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:15:11.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:15:11.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:15:11.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:15:11.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:15:11.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T17:15:11.360 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:40.809+0000 7f06211e4ec0 -1 Falling back to public interface 2020-09-08T17:15:11.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:15:11.360 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:14:41.646+0000 7f06211e4ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-09-08T17:15:11.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:15:11.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:15:11.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:15:11.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:15:11.361 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2020-09-08T17:15:11.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:15:11.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:15:11.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:15:11.362 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:53: test_fast_kill: cat td/osd-fast-mark-down/osd.2.pid 2020-09-08T17:15:11.362 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:53: test_fast_kill: pids[$oi]=673455 2020-09-08T17:15:11.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:56: test_fast_kill: create_rbd_pool 2020-09-08T17:15:11.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2020-09-08T17:15:11.363 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'rbd' does not exist 2020-09-08T17:15:11.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: create_pool rbd 4 2020-09-08T17:15:11.363 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create rbd 4 2020-09-08T17:15:11.364 INFO:tasks.workunit.client.0.smithi065.stderr:pool 'rbd' already exists 2020-09-08T17:15:11.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2020-09-08T17:15:11.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: rbd pool init rbd 2020-09-08T17:15:11.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:59: test_fast_kill: timeout 20 rados -p rbd bench 10 write -b 4096 --max-objects 128 --no-cleanup 2020-09-08T17:15:11.364 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:60: test_fast_kill: sleep 1 2020-09-08T17:15:11.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:62: test_fast_kill: killid=0 2020-09-08T17:15:11.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:63: test_fast_kill: previd=0 2020-09-08T17:15:11.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:66: test_fast_kill: for i in {1..2} 2020-09-08T17:15:11.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:67: test_fast_kill: '[' 0 -eq 0 ']' 2020-09-08T17:15:11.365 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:68: test_fast_kill: killid=671465 2020-09-08T17:15:11.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:67: test_fast_kill: '[' 671465 -eq 0 ']' 2020-09-08T17:15:11.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:70: test_fast_kill: previd=671465 2020-09-08T17:15:11.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:72: test_fast_kill: kill -9 671465 2020-09-08T17:15:11.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:73: test_fast_kill: time_left=30 2020-09-08T17:15:11.366 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:74: test_fast_kill: down_osds=0 2020-09-08T17:15:11.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:76: test_fast_kill: '[' 30 -gt 0 ']' 2020-09-08T17:15:11.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:77: test_fast_kill: sleep 1 2020-09-08T17:15:11.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:78: test_fast_kill: time_left=29 2020-09-08T17:15:11.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:80: test_fast_kill: grep -m 1 -c -F ms_handle_refused td/osd-fast-mark-down/osd.0.log td/osd-fast-mark-down/osd.1.log td/osd-fast-mark-down/osd.2.log 2020-09-08T17:15:11.367 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:81: test_fast_kill: '[' 0 -ne 0 ']' 2020-09-08T17:15:11.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:85: test_fast_kill: ceph osd tree 2020-09-08T17:15:11.368 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:85: test_fast_kill: grep -c down 2020-09-08T17:15:11.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:85: test_fast_kill: down_osds=1 2020-09-08T17:15:11.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:86: test_fast_kill: '[' 1 -lt 1 ']' 2020-09-08T17:15:11.368 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:89: test_fast_kill: '[' 1 -gt 1 ']' 2020-09-08T17:15:11.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:93: test_fast_kill: break 2020-09-08T17:15:11.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:97: test_fast_kill: '[' 1 -lt 1 ']' 2020-09-08T17:15:11.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:66: test_fast_kill: for i in {1..2} 2020-09-08T17:15:11.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:67: test_fast_kill: '[' 671465 -eq 671465 ']' 2020-09-08T17:15:11.369 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:68: test_fast_kill: killid=673455 2020-09-08T17:15:11.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:67: test_fast_kill: '[' 673455 -eq 671465 ']' 2020-09-08T17:15:11.370 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:70: test_fast_kill: previd=673455 2020-09-08T17:15:11.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:72: test_fast_kill: kill -9 673455 2020-09-08T17:15:11.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:73: test_fast_kill: time_left=30 2020-09-08T17:15:11.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:74: test_fast_kill: down_osds=0 2020-09-08T17:15:11.371 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:76: test_fast_kill: '[' 30 -gt 0 ']' 2020-09-08T17:15:11.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:77: test_fast_kill: sleep 1 2020-09-08T17:15:11.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:78: test_fast_kill: time_left=29 2020-09-08T17:15:11.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:80: test_fast_kill: grep -m 1 -c -F ms_handle_refused td/osd-fast-mark-down/osd.0.log td/osd-fast-mark-down/osd.1.log td/osd-fast-mark-down/osd.2.log 2020-09-08T17:15:11.372 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:81: test_fast_kill: '[' 0 -ne 0 ']' 2020-09-08T17:15:11.373 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:85: test_fast_kill: ceph osd tree 2020-09-08T17:15:11.373 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:85: test_fast_kill: grep -c down 2020-09-08T17:15:11.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:85: test_fast_kill: down_osds=2 2020-09-08T17:15:11.373 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:86: test_fast_kill: '[' 2 -lt 2 ']' 2020-09-08T17:15:11.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:89: test_fast_kill: '[' 2 -gt 2 ']' 2020-09-08T17:15:11.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:93: test_fast_kill: break 2020-09-08T17:15:11.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:97: test_fast_kill: '[' 2 -lt 2 ']' 2020-09-08T17:15:11.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:103: test_fast_kill: pkill -SIGTERM rados 2020-09-08T17:15:11.374 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:104: test_fast_kill: teardown td/osd-fast-mark-down 2020-09-08T17:15:11.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-fast-mark-down 2020-09-08T17:15:11.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T17:15:11.375 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-fast-mark-down KILL 2020-09-08T17:15:11.375 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:15:11.375 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:15:11.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:15:11.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:15:11.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:15:11.376 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:15:11.376 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:15:11.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:15:11.377 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:15:11.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:15:11.377 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:15:11.378 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:15:11.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:15:11.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:15:11.582 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:15:11.583 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:15:11.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:15:11.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T17:15:11.583 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-fast-mark-down 2020-09-08T17:15:11.583 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:15:11.584 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:15:11.584 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.670538 2020-09-08T17:15:11.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.670538 2020-09-08T17:15:11.584 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:15:11.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:15:11.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh:42: run: return 0 2020-09-08T17:15:11.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2151: main: code=0 2020-09-08T17:15:11.585 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2155: main: teardown td/osd-fast-mark-down 0 2020-09-08T17:15:11.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-fast-mark-down 2020-09-08T17:15:11.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2020-09-08T17:15:11.586 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-fast-mark-down KILL 2020-09-08T17:15:11.586 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:15:11.587 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:15:11.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:15:11.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:15:11.587 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:15:11.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:15:11.588 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:15:11.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:15:11.588 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:15:11.588 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:15:11.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:15:11.589 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:15:11.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:15:11.589 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:15:11.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:15:11.590 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:15:11.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:15:11.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2020-09-08T17:15:11.590 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-fast-mark-down 2020-09-08T17:15:11.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:15:11.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:15:11.591 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.670538 2020-09-08T17:15:11.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.670538 2020-09-08T17:15:11.591 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:15:11.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:15:11.592 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2156: main: return 0 2020-09-08T17:15:11.592 INFO:tasks.workunit.client.0.smithi065.stdout:adding osd2 key to auth repository 2020-09-08T17:15:11.592 INFO:tasks.workunit.client.0.smithi065.stdout:start osd.2 2020-09-08T17:15:11.593 INFO:tasks.workunit.client.0.smithi065.stdout:0 2020-09-08T17:15:11.593 INFO:tasks.workunit.client.0.smithi065.stdout:1 2020-09-08T17:15:11.593 INFO:tasks.workunit.client.0.smithi065.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/673455,v1:127.0.0.1:6819/673455] [v2:127.0.0.1:6820/673455,v1:127.0.0.1:6821/673455] exists,up 01224440-9b9b-496b-9a75-0e2a3eecf782 2020-09-08T17:15:11.593 INFO:tasks.workunit.client.0.smithi065.stdout:hints = 1 2020-09-08T17:15:11.593 INFO:tasks.workunit.client.0.smithi065.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 10 seconds or 128 objects 2020-09-08T17:15:11.594 INFO:tasks.workunit.client.0.smithi065.stdout:Object prefix: benchmark_data_smithi065_673908 2020-09-08T17:15:11.594 INFO:tasks.workunit.client.0.smithi065.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-09-08T17:15:11.594 INFO:tasks.workunit.client.0.smithi065.stdout: 0 0 0 0 0 0 - 0 2020-09-08T17:15:11.594 INFO:tasks.workunit.client.0.smithi065.stdout: 1 16 80 64 0.249976 0.25 0.276006 0.226926 2020-09-08T17:15:11.594 INFO:tasks.workunit.client.0.smithi065.stdout:Total time run: 1.91545 2020-09-08T17:15:11.595 INFO:tasks.workunit.client.0.smithi065.stdout:Total writes made: 128 2020-09-08T17:15:11.595 INFO:tasks.workunit.client.0.smithi065.stdout:Write size: 4096 2020-09-08T17:15:11.595 INFO:tasks.workunit.client.0.smithi065.stdout:Object size: 4096 2020-09-08T17:15:11.595 INFO:tasks.workunit.client.0.smithi065.stdout:Bandwidth (MB/sec): 0.261035 2020-09-08T17:15:11.595 INFO:tasks.workunit.client.0.smithi065.stdout:Stddev Bandwidth: 0 2020-09-08T17:15:11.595 INFO:tasks.workunit.client.0.smithi065.stdout:Max bandwidth (MB/sec): 0.25 2020-09-08T17:15:11.596 INFO:tasks.workunit.client.0.smithi065.stdout:Min bandwidth (MB/sec): 0.25 2020-09-08T17:15:11.596 INFO:tasks.workunit.client.0.smithi065.stdout:Average IOPS: 66 2020-09-08T17:15:11.596 INFO:tasks.workunit.client.0.smithi065.stdout:Stddev IOPS: 0 2020-09-08T17:15:11.596 INFO:tasks.workunit.client.0.smithi065.stdout:Max IOPS: 64 2020-09-08T17:15:11.596 INFO:tasks.workunit.client.0.smithi065.stdout:Min IOPS: 64 2020-09-08T17:15:11.597 INFO:tasks.workunit.client.0.smithi065.stdout:Average Latency(s): 0.234755 2020-09-08T17:15:11.597 INFO:tasks.workunit.client.0.smithi065.stdout:Stddev Latency(s): 0.0218537 2020-09-08T17:15:11.597 INFO:tasks.workunit.client.0.smithi065.stdout:Max latency(s): 0.276006 2020-09-08T17:15:11.597 INFO:tasks.workunit.client.0.smithi065.stdout:Min latency(s): 0.167978 2020-09-08T17:15:11.598 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-09-08T17:15:11.599 INFO:teuthology.orchestra.run.smithi065:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-09-08T17:15:11.636 INFO:tasks.workunit:Running workunit osd/osd-force-create-pg.sh... 2020-09-08T17:15:11.637 INFO:teuthology.orchestra.run.smithi065:workunit test osd/osd-force-create-pg.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dce4d291bd4243c9802c17d67b85a6da6bbc0f8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh 2020-09-08T17:15:11.701 INFO:tasks.workunit.client.0.smithi065.stderr:stty: 'standard input': Inappropriate ioctl for device 2020-09-08T17:15:11.708 INFO:tasks.workunit.client.0.smithi065.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2020-09-08T17:15:11.914 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T17:15:12.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-09-08T17:15:12.322 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: export PYTHONWARNINGS=ignore 2020-09-08T17:15:12.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: PYTHONWARNINGS=ignore 2020-09-08T17:15:12.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: export CEPH_CONF=/dev/null 2020-09-08T17:15:12.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: CEPH_CONF=/dev/null 2020-09-08T17:15:12.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2147: main: unset CEPH_ARGS 2020-09-08T17:15:12.323 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2149: main: local code 2020-09-08T17:15:12.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2150: main: run td/osd-force-create-pg 2020-09-08T17:15:12.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh:5: run: local dir=td/osd-force-create-pg 2020-09-08T17:15:12.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh:6: run: shift 2020-09-08T17:15:12.324 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh:8: run: export CEPH_MON=127.0.0.1:7145 2020-09-08T17:15:12.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh:8: run: CEPH_MON=127.0.0.1:7145 2020-09-08T17:15:12.325 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh:9: run: export CEPH_ARGS 2020-09-08T17:15:12.325 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh:10: run: uuidgen 2020-09-08T17:15:12.332 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh:10: run: CEPH_ARGS+='--fsid=036a1a9b-0bb6-4a24-b197-362b801f616d --auth-supported=none ' 2020-09-08T17:15:12.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh:11: run: CEPH_ARGS+='--mon-host=127.0.0.1:7145 ' 2020-09-08T17:15:12.333 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh:13: run: set 2020-09-08T17:15:12.333 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh:13: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2020-09-08T17:15:12.333 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh:13: run: local funcs=TEST_reuse_id 2020-09-08T17:15:12.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh:14: run: for func in $funcs 2020-09-08T17:15:12.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh:15: run: TEST_reuse_id td/osd-force-create-pg 2020-09-08T17:15:12.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh:20: TEST_reuse_id: local dir=td/osd-force-create-pg 2020-09-08T17:15:12.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh:22: TEST_reuse_id: setup td/osd-force-create-pg 2020-09-08T17:15:12.334 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-force-create-pg 2020-09-08T17:15:12.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-force-create-pg 2020-09-08T17:15:12.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-force-create-pg 2020-09-08T17:15:12.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-09-08T17:15:12.335 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-force-create-pg KILL 2020-09-08T17:15:12.335 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-09-08T17:15:12.336 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-09-08T17:15:12.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-09-08T17:15:12.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-09-08T17:15:12.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-09-08T17:15:12.336 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-09-08T17:15:12.337 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-09-08T17:15:12.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-09-08T17:15:12.337 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-09-08T17:15:12.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-09-08T17:15:12.337 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-09-08T17:15:12.338 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-09-08T17:15:12.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:15:12.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-09-08T17:15:12.338 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-09-08T17:15:12.338 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-09-08T17:15:12.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-09-08T17:15:12.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-09-08T17:15:12.339 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-force-create-pg 2020-09-08T17:15:12.339 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-09-08T17:15:12.339 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:15:12.340 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.674079 2020-09-08T17:15:12.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.674079 2020-09-08T17:15:12.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-09-08T17:15:12.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-09-08T17:15:12.340 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-force-create-pg 2020-09-08T17:15:12.341 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-09-08T17:15:12.341 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:15:12.341 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.674079 2020-09-08T17:15:12.341 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.674079 2020-09-08T17:15:12.342 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-09-08T17:15:12.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2020-09-08T17:15:12.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2020-09-08T17:15:12.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-09-08T17:15:12.342 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-force-create-pg 1' TERM HUP INT 2020-09-08T17:15:12.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh:23: TEST_reuse_id: run_mon td/osd-force-create-pg a --osd_pool_default_size=1 2020-09-08T17:15:12.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-force-create-pg 2020-09-08T17:15:12.343 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-09-08T17:15:12.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-09-08T17:15:12.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-09-08T17:15:12.546 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-force-create-pg/a 2020-09-08T17:15:12.547 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-force-create-pg/a --run-dir=td/osd-force-create-pg --osd_pool_default_size=1 2020-09-08T17:15:12.547 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-09-08T17:15:12.547 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:15:12.547 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:15:12.547 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:15:12.548 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:15:12.548 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.674079 2020-09-08T17:15:12.548 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.674079/$cluster-$name.asok' 2020-09-08T17:15:12.548 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-force-create-pg/a '--log-file=td/osd-force-create-pg/$name.log' '--admin-socket=/tmp/ceph-asok.674079/$cluster-$name.asok' --mon-cluster-log-file=td/osd-force-create-pg/log --run-dir=td/osd-force-create-pg '--pid-file=td/osd-force-create-pg/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --osd_pool_default_size=1 2020-09-08T17:15:12.549 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2020-09-08T17:15:12.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2020-09-08T17:15:12.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T17:15:12.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T17:15:12.549 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2020-09-08T17:15:12.550 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2020-09-08T17:15:12.550 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T17:15:12.550 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T17:15:12.754 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T17:15:12.754 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T17:15:12.755 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:15:12.755 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.674079 2020-09-08T17:15:12.755 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.674079/ceph-mon.a.asok 2020-09-08T17:15:12.756 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T17:15:12.756 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.674079/ceph-mon.a.asok config get fsid 2020-09-08T17:15:12.756 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2020-09-08T17:15:12.757 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2020-09-08T17:15:12.757 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2020-09-08T17:15:12.757 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2020-09-08T17:15:12.757 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2020-09-08T17:15:12.757 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2020-09-08T17:15:12.758 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-09-08T17:15:12.758 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-09-08T17:15:12.758 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-09-08T17:15:12.758 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:15:12.759 INFO:tasks.workunit.client.0.smithi065.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.674079 2020-09-08T17:15:12.759 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.674079/ceph-mon.a.asok 2020-09-08T17:15:12.759 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2020-09-08T17:15:12.759 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.674079/ceph-mon.a.asok config get mon_host 2020-09-08T17:15:12.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh:24: TEST_reuse_id: run_mgr td/osd-force-create-pg x 2020-09-08T17:15:12.760 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/osd-force-create-pg 2020-09-08T17:15:12.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2020-09-08T17:15:12.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2020-09-08T17:15:12.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2020-09-08T17:15:12.761 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/osd-force-create-pg/x 2020-09-08T17:15:12.762 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2020-09-08T17:15:13.303 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2020-09-08T17:17:20.675 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:17:20.878 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:17:20.878 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:17:20.878 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:17:20.879 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.674079 2020-09-08T17:17:20.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.674079/$cluster-$name.asok' 2020-09-08T17:17:20.879 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T17:17:20.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-force-create-pg/x '--log-file=td/osd-force-create-pg/$name.log' '--admin-socket=/tmp/ceph-asok.674079/$cluster-$name.asok' --run-dir=td/osd-force-create-pg '--pid-file=td/osd-force-create-pg/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-09-08T17:17:20.934 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh:25: TEST_reuse_id: run_osd td/osd-force-create-pg 0 2020-09-08T17:17:20.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-force-create-pg 2020-09-08T17:17:20.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T17:17:20.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2020-09-08T17:17:20.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T17:17:20.935 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-force-create-pg/0 2020-09-08T17:17:20.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=036a1a9b-0bb6-4a24-b197-362b801f616d --auth-supported=none --mon-host=127.0.0.1:7145 ' 2020-09-08T17:17:20.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:17:20.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:17:20.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:17:20.936 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-force-create-pg/0' 2020-09-08T17:17:20.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-force-create-pg/0/journal' 2020-09-08T17:17:20.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T17:17:20.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T17:17:20.937 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-force-create-pg' 2020-09-08T17:17:20.938 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T17:17:20.938 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:17:20.938 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:17:20.938 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:17:20.938 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:17:20.939 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.674079 2020-09-08T17:17:20.939 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.674079/$cluster-$name.asok' 2020-09-08T17:17:20.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.674079/$cluster-$name.asok' 2020-09-08T17:17:20.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:17:20.939 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T17:17:20.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T17:17:20.940 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-force-create-pg/$name.log' 2020-09-08T17:17:21.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-force-create-pg/$name.pid' 2020-09-08T17:17:21.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:17:21.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:17:21.142 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:17:21.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T17:17:21.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T17:17:21.143 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-force-create-pg/0 2020-09-08T17:17:21.143 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T17:17:21.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=2a0a260a-6f6d-456d-85ed-f61dd589b3f1 2020-09-08T17:17:21.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 2a0a260a-6f6d-456d-85ed-f61dd589b3f1' 2020-09-08T17:17:21.144 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T17:17:21.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAhvFdfmm++FBAAEg+yUj8FlwfLET4994Up8w== 2020-09-08T17:17:21.144 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAhvFdfmm++FBAAEg+yUj8FlwfLET4994Up8w=="}' 2020-09-08T17:17:21.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 2a0a260a-6f6d-456d-85ed-f61dd589b3f1 -i td/osd-force-create-pg/0/new.json 2020-09-08T17:17:21.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-force-create-pg/0/new.json 2020-09-08T17:17:21.145 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=036a1a9b-0bb6-4a24-b197-362b801f616d --auth-supported=none --mon-host=127.0.0.1:7145 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-force-create-pg/0 --osd-journal=td/osd-force-create-pg/0/journal --chdir= --run-dir=td/osd-force-create-pg '--admin-socket=/tmp/ceph-asok.674079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-force-create-pg/$name.log' '--pid-file=td/osd-force-create-pg/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAhvFdfmm++FBAAEg+yUj8FlwfLET4994Up8w== --osd-uuid 2a0a260a-6f6d-456d-85ed-f61dd589b3f1 2020-09-08T17:17:21.145 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:13.724+0000 7fb8899b9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:17:21.350 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:13.726+0000 7fb8899b9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:17:21.350 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:13.727+0000 7fb8899b9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:17:21.350 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:13.728+0000 7fb8899b9ec0 -1 bluestore(td/osd-force-create-pg/0/block) _read_bdev_label failed to open td/osd-force-create-pg/0/block: (2) No such file or directory 2020-09-08T17:17:21.351 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:13.728+0000 7fb8899b9ec0 -1 bluestore(td/osd-force-create-pg/0/block) _read_bdev_label failed to open td/osd-force-create-pg/0/block: (2) No such file or directory 2020-09-08T17:17:21.351 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:13.728+0000 7fb8899b9ec0 -1 bluestore(td/osd-force-create-pg/0/block) _read_bdev_label failed to open td/osd-force-create-pg/0/block: (2) No such file or directory 2020-09-08T17:17:21.351 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:13.762+0000 7fb8899b9ec0 -1 bluestore(td/osd-force-create-pg/0) _read_fsid unparsable uuid 2020-09-08T17:17:21.351 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-force-create-pg/0/keyring 2020-09-08T17:17:21.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T17:17:21.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2020-09-08T17:17:21.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-force-create-pg/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:17:21.352 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2020-09-08T17:17:21.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=036a1a9b-0bb6-4a24-b197-362b801f616d --auth-supported=none --mon-host=127.0.0.1:7145 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-force-create-pg/0 --osd-journal=td/osd-force-create-pg/0/journal --chdir= --run-dir=td/osd-force-create-pg '--admin-socket=/tmp/ceph-asok.674079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-force-create-pg/$name.log' '--pid-file=td/osd-force-create-pg/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:17:21.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T17:17:21.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T17:17:21.353 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T17:17:21.354 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:18.418+0000 7f91699d3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:17:21.354 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:18.444+0000 7f91699d3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:17:21.354 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:18.445+0000 7f91699d3ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:17:21.354 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2020-09-08T17:17:21.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:17:21.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2020-09-08T17:17:21.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:17:21.355 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:17:21.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:17:21.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:17:21.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:17:21.356 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:17:21.357 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:18.960+0000 7f91699d3ec0 -1 Falling back to public interface 2020-09-08T17:17:21.357 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:17:21.357 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:19.777+0000 7f91699d3ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-09-08T17:17:21.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:17:21.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:17:21.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:17:21.358 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:17:21.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2020-09-08T17:17:21.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:17:21.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:17:21.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:17:21.359 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh:26: TEST_reuse_id: run_osd td/osd-force-create-pg 1 2020-09-08T17:17:21.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-force-create-pg 2020-09-08T17:17:21.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T17:17:21.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2020-09-08T17:17:21.360 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T17:17:21.562 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-force-create-pg/1 2020-09-08T17:17:23.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=036a1a9b-0bb6-4a24-b197-362b801f616d --auth-supported=none --mon-host=127.0.0.1:7145 ' 2020-09-08T17:17:23.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:17:23.410 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:17:23.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:17:23.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-force-create-pg/1' 2020-09-08T17:17:23.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-force-create-pg/1/journal' 2020-09-08T17:17:23.411 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T17:17:23.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T17:17:23.412 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-force-create-pg' 2020-09-08T17:17:23.412 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T17:17:23.412 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:17:23.412 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:17:23.413 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:17:23.413 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:17:23.413 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.674079 2020-09-08T17:17:23.413 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.674079/$cluster-$name.asok' 2020-09-08T17:17:23.413 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.674079/$cluster-$name.asok' 2020-09-08T17:17:23.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:17:23.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T17:17:23.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2020-09-08T17:17:23.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/osd-force-create-pg/$name.log' 2020-09-08T17:17:23.414 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/osd-force-create-pg/$name.pid' 2020-09-08T17:17:23.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-09-08T17:17:23.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-09-08T17:17:23.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:17:23.415 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2020-09-08T17:17:23.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2020-09-08T17:17:23.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/osd-force-create-pg/1 2020-09-08T17:17:23.416 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2020-09-08T17:17:23.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=3fe92a6a-0736-42d6-adb4-d53b95bcc1f4 2020-09-08T17:17:23.416 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 3fe92a6a-0736-42d6-adb4-d53b95bcc1f4' 2020-09-08T17:17:23.417 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2020-09-08T17:17:23.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAovFdfXGAvJhAAuhoF0U9CgJAG4bzvA/TNyQ== 2020-09-08T17:17:23.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAovFdfXGAvJhAAuhoF0U9CgJAG4bzvA/TNyQ=="}' 2020-09-08T17:17:23.417 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 3fe92a6a-0736-42d6-adb4-d53b95bcc1f4 -i td/osd-force-create-pg/1/new.json 2020-09-08T17:17:23.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/osd-force-create-pg/1/new.json 2020-09-08T17:17:23.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=036a1a9b-0bb6-4a24-b197-362b801f616d --auth-supported=none --mon-host=127.0.0.1:7145 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-force-create-pg/1 --osd-journal=td/osd-force-create-pg/1/journal --chdir= --run-dir=td/osd-force-create-pg '--admin-socket=/tmp/ceph-asok.674079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-force-create-pg/$name.log' '--pid-file=td/osd-force-create-pg/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAovFdfXGAvJhAAuhoF0U9CgJAG4bzvA/TNyQ== --osd-uuid 3fe92a6a-0736-42d6-adb4-d53b95bcc1f4 2020-09-08T17:17:23.622 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:21.156+0000 7fde0e74fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:17:29.754 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:21.157+0000 7fde0e74fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:17:29.754 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:21.158+0000 7fde0e74fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:17:29.754 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:21.159+0000 7fde0e74fec0 -1 bluestore(td/osd-force-create-pg/1/block) _read_bdev_label failed to open td/osd-force-create-pg/1/block: (2) No such file or directory 2020-09-08T17:17:29.755 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:21.159+0000 7fde0e74fec0 -1 bluestore(td/osd-force-create-pg/1/block) _read_bdev_label failed to open td/osd-force-create-pg/1/block: (2) No such file or directory 2020-09-08T17:17:29.755 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:21.159+0000 7fde0e74fec0 -1 bluestore(td/osd-force-create-pg/1/block) _read_bdev_label failed to open td/osd-force-create-pg/1/block: (2) No such file or directory 2020-09-08T17:17:29.755 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:21.207+0000 7fde0e74fec0 -1 bluestore(td/osd-force-create-pg/1) _read_fsid unparsable uuid 2020-09-08T17:17:29.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/osd-force-create-pg/1/keyring 2020-09-08T17:17:29.755 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2020-09-08T17:17:29.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2020-09-08T17:17:29.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/osd-force-create-pg/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-09-08T17:17:29.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2020-09-08T17:17:29.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2020-09-08T17:17:29.756 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2020-09-08T17:17:29.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2020-09-08T17:17:29.757 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=036a1a9b-0bb6-4a24-b197-362b801f616d --auth-supported=none --mon-host=127.0.0.1:7145 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-force-create-pg/1 --osd-journal=td/osd-force-create-pg/1/journal --chdir= --run-dir=td/osd-force-create-pg '--admin-socket=/tmp/ceph-asok.674079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-force-create-pg/$name.log' '--pid-file=td/osd-force-create-pg/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-09-08T17:17:29.757 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:25.996+0000 7fe5e3e66ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:17:29.757 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:26.013+0000 7fe5e3e66ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:17:29.962 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:26.015+0000 7fe5e3e66ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-09-08T17:17:32.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2020-09-08T17:17:32.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2020-09-08T17:17:32.002 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2020-09-08T17:17:32.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2020-09-08T17:17:32.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2020-09-08T17:17:32.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:17:32.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2020-09-08T17:17:32.003 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:17:32.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:17:32.004 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:26.531+0000 7fe5e3e66ec0 -1 Falling back to public interface 2020-09-08T17:17:32.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2020-09-08T17:17:32.004 INFO:tasks.workunit.client.0.smithi065.stderr:2020-09-08T17:15:27.384+0000 7fe5e3e66ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-09-08T17:17:32.004 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2020-09-08T17:17:32.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2020-09-08T17:17:32.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2020-09-08T17:17:32.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2020-09-08T17:17:32.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2020-09-08T17:17:32.005 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2020-09-08T17:17:32.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2020-09-08T17:17:32.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2020-09-08T17:17:32.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh:27: TEST_reuse_id: run_osd td/osd-force-create-pg 2 2020-09-08T17:17:32.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/osd-force-create-pg 2020-09-08T17:17:32.006 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-09-08T17:17:32.007 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2020-09-08T17:17:32.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2020-09-08T17:17:32.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/osd-force-create-pg/2 2020-09-08T17:17:32.210 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=036a1a9b-0bb6-4a24-b197-362b801f616d --auth-supported=none --mon-host=127.0.0.1:7145 ' 2020-09-08T17:17:32.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-09-08T17:17:32.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2020-09-08T17:17:32.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-09-08T17:17:32.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/osd-force-create-pg/2' 2020-09-08T17:17:32.211 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/osd-force-create-pg/2/journal' 2020-09-08T17:17:32.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2020-09-08T17:17:32.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2020-09-08T17:17:32.212 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/osd-force-create-pg' 2020-09-08T17:17:32.212 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2020-09-08T17:17:32.212 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-09-08T17:17:32.213 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-09-08T17:17:32.213 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-09-08T17:17:32.213 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-09-08T17:17:32.213 INFO:tasks.workunit.client.0.smithi065.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.674079 2020-09-08T17:17:32.214 INFO:tasks.workunit.client.0.smithi065.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.674079/$cluster-$name.asok' 2020-09-08T17:17:32.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.674079/$cluster-$name.asok' 2020-09-08T17:17:32.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2020-09-08T17:17:32.214 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2020-09-08T17:17:32.418 INFO:tasks.workunit.client.0.smithi065.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20'